NVIDIA GeForce RTX 4070 GDDR6 vs NVIDIA H100 SXM5 94 GB
We compared two Desktop platform GPUs: 12GB VRAM GeForce RTX 4070 GDDR6 and 94GB VRAM H100 SXM5 94 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
NVIDIA GeForce RTX 4070 GDDR6 's Advantages
Released 1 years and 5 months late
Boost Clock has increased by 25% (2475MHz vs 1980MHz)
Lower TDP (200W vs 700W)
NVIDIA H100 SXM5 94 GB 's Advantages
More VRAM (94GB vs 12GB)
Larger VRAM bandwidth (3.36TB/s vs 480.0GB/s)
11008 additional rendering cores
Score
Benchmark
FP32 (float)
GeForce RTX 4070 GDDR6
29.15 TFLOPS
H100 SXM5 94 GB
+129%
66.91 TFLOPS
Graphics Card
Aug 2024
Release Date
Mar 2023
GeForce 40
Generation
Server Hopper
Desktop
Type
Desktop
PCIe 4.0 x16
Bus Interface
PCIe 5.0 x16
Clock Speeds
1920 MHz
Base Clock
1350 MHz
2475 MHz
Boost Clock
1980 MHz
2500 MHz
Memory Clock
1313 MHz
Memory
12GB
Memory Size
94GB
GDDR6
Memory Type
HBM3
192bit
Memory Bus
5120bit
480.0GB/s
Bandwidth
3.36TB/s
Render Config
-
-
-
46
SM Count
132
5888
Shading Units
16896
184
TMUs
528
64
ROPs
24
184
Tensor Cores
528
46
RT Cores
-
128 KB (per SM)
L1 Cache
256 KB (per SM)
36 MB
L2 Cache
50 MB
-
-
-
Theoretical Performance
158.4 GPixel/s
Pixel Rate
47.52 GPixel/s
455.4 GTexel/s
Texture Rate
1045 GTexel/s
29.15 TFLOPS
FP16 (half)
267.6 TFLOPS
29.15 TFLOPS
FP32 (float)
66.91 TFLOPS
455.4 GFLOPS
FP64 (double)
33.45 TFLOPS
Board Design
200W
TDP
700W
550 W
Suggested PSU
1100 W
1x HDMI 2.1
3x DisplayPort 1.4a
Outputs
No outputs
1x 16-pin
Power Connectors
8-pin EPS
Graphics Processor
AD104
GPU Name
GH100
AD104-2XX-A1
GPU Variant
-
Ada Lovelace
Architecture
Hopper
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
35.8 billion
Transistors
80 billion
294 mm²
Die Size
814 mm²
Graphics Features
12 Ultimate (12_2)
DirectX
N/A
4.6
OpenGL
N/A
3.0
OpenCL
3.0
1.3
Vulkan
N/A
8.9
CUDA
9.0
6.8
Shader Model
N/A
