Home GPU Comparison NVIDIA H100 PCIe 80 GB vs NVIDIA GeForce RTX 4090

NVIDIA H100 PCIe 80 GB vs NVIDIA GeForce RTX 4090

AI GPU We compared a GPU: 80GB VRAM H100 PCIe 80 GB and a Desktop platform GPU: 24GB VRAM GeForce RTX 4090 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA H100 PCIe 80 GB 's Advantages
Released 6 months late
More VRAM (80GB vs 24GB)
Larger VRAM bandwidth (2040GB/s vs 1.01TB/s)
Lower TDP (350W vs 450W)
NVIDIA GeForce RTX 4090 's Advantages
Boost Clock has increased by 44% (2520MHz vs 1755MHz)
1792 additional rendering cores

Score

Benchmark

FP32 (float)
H100 PCIe 80 GB
51.22 TFLOPS
GeForce RTX 4090 +61%
82.58 TFLOPS
VS

Graphics Card

Mar 2023
Release Date
Sep 2022
Tesla Hopper
Generation
GeForce 40
AI GPU
Type
Desktop
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x16

Clock Speeds

1095 MHz
Base Clock
2235 MHz
1755 MHz
Boost Clock
2520 MHz
1593 MHz
Memory Clock
1313 MHz

Memory

80GB
Memory Size
24GB
HBM2e
Memory Type
GDDR6X
5120bit
Memory Bus
384bit
2040GB/s
Bandwidth
1.01TB/s

Render Config

-
-
-
114
SM Count
128
14592
Shading Units
16384
456
TMUs
512
24
ROPs
176
456
Tensor Cores
512
-
RT Cores
128
256 KB (per SM)
L1 Cache
128 KB (per SM)
50 MB
L2 Cache
72 MB
-
-
-

Theoretical Performance

42.12 GPixel/s
Pixel Rate
443.5 GPixel/s
800.3 GTexel/s
Texture Rate
1290 GTexel/s
204.9 TFLOPS
FP16 (half)
82.58 TFLOPS
51.22 TFLOPS
FP32 (float)
82.58 TFLOPS
25.61 TFLOPS
FP64 (double)
1290 GFLOPS

Board Design

350W
TDP
450W
750 W
Suggested PSU
850 W
No outputs
Outputs
1x HDMI 2.13x DisplayPort 1.4a
1x 16-pin
Power Connectors
1x 16-pin

Graphics Processor

GH100
GPU Name
AD102
-
GPU Variant
AD102-300-A1
Hopper
Architecture
Ada Lovelace
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
80 billion
Transistors
76.3 billion
814 mm²
Die Size
609 mm²

Graphics Features

N/A
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
3.0
OpenCL
3.0
N/A
Vulkan
1.3
9.0
CUDA
8.9
N/A
Shader Model
6.8

Related GPU Comparisons

Related News

© 2024 - TopCPU.net   Contact Us Privacy Policy