NVIDIA H100 SXM5 80 GB vs NVIDIA GeForce RTX 4090

VS

NVIDIA H100 SXM5 80 GB

NVIDIA GeForce RTX 4090

AI GPU We compared a GPU: 80GB VRAM H100 SXM5 80 GB and a Desktop platform GPU: 24GB VRAM GeForce RTX 4090 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA H100 SXM5 80 GB 's Advantages

Released 6 months late

More VRAM (80GB vs 24GB)

Larger VRAM bandwidth (1681GB/s vs 1.01TB/s)

512 additional rendering cores

NVIDIA GeForce RTX 4090 's Advantages

Boost Clock has increased by 27% (2520MHz vs 1980MHz)

Lower TDP (450W vs 700W)

Score

Benchmark

FP32 (float)

H100 SXM5 80 GB

66.91 TFLOPS

GeForce RTX 4090 +23%

82.58 TFLOPS

H100 SXM5 80 GB

VS

GeForce RTX 4090

Graphics Card

Mar 2023

Release Date

Sep 2022

Tesla Hopper

Generation

GeForce 40

AI GPU

Type

Desktop

PCIe 5.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

1590 MHz

Base Clock

2235 MHz

1980 MHz

Boost Clock

2520 MHz

1313 MHz

Memory Clock

1313 MHz

Memory

80GB

Memory Size

24GB

HBM3

Memory Type

GDDR6X

5120bit

Memory Bus

384bit

1681GB/s

Bandwidth

1.01TB/s

Render Config

-

132

SM Count

128

16896

Shading Units

16384

528

TMUs

512

24

ROPs

176

528

Tensor Cores

512

-

RT Cores

128

256 KB (per SM)

L1 Cache

128 KB (per SM)

50 MB

L2 Cache

72 MB

-

Theoretical Performance

47.52 GPixel/s

Pixel Rate

443.5 GPixel/s

1045 GTexel/s

Texture Rate

1290 GTexel/s

267.6 TFLOPS

FP16 (half)

82.58 TFLOPS

66.91 TFLOPS

FP32 (float)

82.58 TFLOPS

33.45 TFLOPS

FP64 (double)

1290 GFLOPS

Board Design

700W

TDP

450W

1100 W

Suggested PSU

850 W

No outputs

Outputs

1x HDMI 2.13x DisplayPort 1.4a

8-pin EPS

Power Connectors

1x 16-pin

Graphics Processor

GH100

GPU Name

AD102

-

GPU Variant

AD102-300-A1

Hopper

Architecture

Ada Lovelace

TSMC

Foundry

TSMC

4 nm

Process Size

5 nm

80 billion

Transistors

76.3 billion

814 mm²

Die Size

609 mm²

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

9.0

CUDA

8.9

N/A

Shader Model

6.8

Related GPU Comparisons

1

NVIDIA H100 SXM5 80 GB vs NVIDIA H800 SXM5

2

NVIDIA H100 SXM5 80 GB vs NVIDIA H100 PCIe 80 GB

3

NVIDIA H100 SXM5 80 GB vs NVIDIA H100 CNX

4

NVIDIA H100 SXM5 80 GB vs NVIDIA H100 PCIe 96 GB

5

NVIDIA H100 SXM5 80 GB vs NVIDIA A100 SXM4 40 GB

6

NVIDIA H100 SXM5 80 GB vs NVIDIA A100 PCIe

7

NVIDIA H100 SXM5 80 GB vs NVIDIA H100 SXM5 96 GB

8

NVIDIA H100 SXM5 80 GB vs NVIDIA H100 SXM5

9

NVIDIA H100 SXM5 80 GB vs NVIDIA H800 PCIe 80 GB

10

NVIDIA H100 SXM5 80 GB vs NVIDIA A100 SXM4 80 GB

Related News

1

AMD Unveils New RX 9070 XT Graphics Card Performance: Positioned Between RX 7900 GRE and RX 7900 XT

2

Double the Excitement! AMD FSR 4.0 to Launch Alongside RX 9070 XT Graphics Card

3

CPU-Z Minor Update: Support for Intel's Four New Products and New Memory

4

CXMT Reportedly Achieves 80% Yield in DDR5 Production

5

Intel Wildcat Lake Appears on Shipping List with FCBGA1516 Socket, Poised to Replace Alder Lake-N

6

The Commencement of ARM and Qualcomm Licensing Dispute Trial: Potential Major Impact on PC Market

7

NVIDIA Allegedly Equips RTX 5080 with 30Gbps Memory Speed, Other Models to Feature 28Gbps

8

Intel Reports High Return Rates for Devices Featuring Snapdragon X Series; Qualcomm Counters with 'Industry Standard' Claim

9

Intel Confirms Panther Lake Adopts 18A Process, ES0 Samples Already Sent to Customers

10

Complete Lineup of Core Ultra 200HX/H/U and Core 200H/U Revealed: 31 Models to Dazzle the Eyes