GeForce RTX 4060 Ti 16 GB vs H100 SXM5 94 GB
We compared two Desktop platform GPUs: 16GB VRAM GeForce RTX 4060 Ti 16 GB and 94GB VRAM H100 SXM5 94 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
GeForce RTX 4060 Ti 16 GB 's Advantages
Boost Clock has increased by 28% (2535MHz vs 1980MHz)
Lower TDP (165W vs 700W)
H100 SXM5 94 GB 's Advantages
More VRAM (94GB vs 16GB)
Larger VRAM bandwidth (3.36TB/s vs 288.0GB/s)
12544 additional rendering cores
Score
Benchmark
FP32 (float)
GeForce RTX 4060 Ti 16 GB
22060
H100 SXM5 94 GB
+203%
66910
Graphics Card
May 2023
Release Date
Mar 2023
GeForce 40
Generation
Server Hopper
Desktop
Type
Desktop
PCIe 4.0 x8
Bus Interface
PCIe 5.0 x16
Clock Speeds
2310 MHz
Base Clock
1350 MHz
2535 MHz
Boost Clock
1980 MHz
2250 MHz
Memory Clock
1313 MHz
Memory
16GB
Memory Size
94GB
GDDR6
Memory Type
HBM3
128bit
Memory Bus
5120bit
288.0GB/s
Bandwidth
3.36TB/s
Render Config
34
SM Count
132
4352
Shading Units
16896
136
TMUs
528
48
ROPs
24
136
Tensor Cores
528
34
RT Cores
-
128 KB (per SM)
L1 Cache
256 KB (per SM)
32 MB
L2 Cache
50 MB
Theoretical Performance
121.7 GPixel/s
Pixel Rate
47.52 GPixel/s
344.8 GTexel/s
Texture Rate
1045 GTexel/s
22.06 TFLOPS
FP16 (half)
267.6 TFLOPS
22.06 TFLOPS
FP32 (float)
66.91 TFLOPS
344.8 GFLOPS
FP64 (double)
33.45 TFLOPS
Board Design
165W
TDP
700W
450 W
Suggested PSU
1100 W
1x HDMI 2.1
3x DisplayPort 1.4a
Outputs
No outputs
1x 16-pin
Power Connectors
8-pin EPS
Graphics Processor
AD106
GPU Name
GH100
AD106-351-A1
GPU Variant
-
Ada Lovelace
Architecture
Hopper
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
22.9 billion
Transistors
80 billion
188 mm²
Die Size
814 mm²
Graphics Features
12 Ultimate (12_2)
DirectX
N/A
4.6
OpenGL
N/A
3.0
OpenCL
3.0
1.3
Vulkan
N/A
8.9
CUDA
9.0
6.7
Shader Model
N/A
