nebius logo

Nebius

H100_sxm5x8_NVLINK

| 640GB VRAMs | gpu-h100-sxm|8gpu-128vcpu-1600gb

Explore Nebius's H100 cloud instance specifications and benchmarks. Compare hardware configurations and performance metrics to optimize your AI and ML workloads.

LLM Benchmark Comparison

Compare performance metrics between different language models

Hardware Specifications

GPU ConfigurationValue
GPU TypeH100
GPU InterconnectSXM5
GPU Model NameNVIDIA H100 80GB HBM3
Driver Version550.127.08
GPU VRAM640 GB
Power Limit (W)700.00
GPU Temperature (°C)29
GPU Clock Speed (MHz)345
Memory Clock Speed (MHz)2619
PstateP0
CPU ConfigurationValue
Model NameIntel(R) Xeon(R) Platinum 8468
Vendor IDGenuineIntel
CPUs128
CPU Clock Speed4200.00
Threads Per Core2
Cores Per Socket32
Sockets2
MemoryValue
Total1.5Tb

Disks Specifications

StorageValue
Total1945.60 GB

Available Disks

PropertyValue
Disk 1
Modelvda
Size1.9Tb
TypeHDD
Mount PointUnmounted
Disk 2
Modelvdb
Size1Mb
TypeHDD
Mount PointUnmounted

Software Specifications

SoftwareValue
OSUbuntu
OS Version22.04.5 LTS (Jammy Jellyfish)
Cuda Driver12.4
Docker Version28.0.1
Python VersionPython 3.10.12

Benchmarks

powered byLLM Benchmark Logo
BenchmarkValue
ffmpeg91ms
Coremark (Iterations per sec)35252.644
llama2Inference (Tokens per sec)83.68
Tensorflow Mnist Training1.425

Launch instance

CloudNebius
GPU TypeH100
Shadeform Instance TypeH100 sxm5x8 NVLINK
Cloud Instance Typegpu-h100-sxm|8gpu-128vcpu-1600gb
Spin Up Time5-10 mins
Hourly Price$23.99

By clicking launch you agree to our Terms of Service.

Feedback