NVIDIA GeForce RTX 4090 vs NVIDIA A100 SXM4 80 GB

VS

NVIDIA GeForce RTX 4090

NVIDIA A100 SXM4 80 GB

AI GPU We compared a Desktop platform GPU: 24GB VRAM GeForce RTX 4090 and a GPU: 80GB VRAM A100 SXM4 80 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA GeForce RTX 4090 's Advantages

Released 1 years and 10 months late

Boost Clock has increased by 79% (2520MHz vs 1410MHz)

9472 additional rendering cores

NVIDIA A100 SXM4 80 GB 's Advantages

More VRAM (80GB vs 24GB)

Larger VRAM bandwidth (2039GB/s vs 1.01TB/s)

Lower TDP (400W vs 450W)

Score

Benchmark

FP32 (float)

GeForce RTX 4090 +323%

82.58 TFLOPS

A100 SXM4 80 GB

19.49 TFLOPS

OctaneBench

GeForce RTX 4090 +146%

1274

A100 SXM4 80 GB

516

GeForce RTX 4090

VS

A100 SXM4 80 GB

Graphics Card

Sep 2022

Release Date

Nov 2020

GeForce 40

Generation

Tesla Ampere

Desktop

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

2235 MHz

Base Clock

1275 MHz

2520 MHz

Boost Clock

1410 MHz

1313 MHz

Memory Clock

1593 MHz

Memory

24GB

Memory Size

80GB

GDDR6X

Memory Type

HBM2e

384bit

Memory Bus

5120bit

1.01TB/s

Bandwidth

2039GB/s

Render Config

-

128

SM Count

108

16384

Shading Units

6912

512

TMUs

432

176

ROPs

160

512

Tensor Cores

432

128

RT Cores

-

128 KB (per SM)

L1 Cache

192 KB (per SM)

72 MB

L2 Cache

40 MB

-

Theoretical Performance

443.5 GPixel/s

Pixel Rate

225.6 GPixel/s

1290 GTexel/s

Texture Rate

609.1 GTexel/s

82.58 TFLOPS

FP16 (half)

77.97 TFLOPS

82.58 TFLOPS

FP32 (float)

19.49 TFLOPS

1290 GFLOPS

FP64 (double)

9.746 TFLOPS

Board Design

450W

TDP

400W

850 W

Suggested PSU

800 W

1x HDMI 2.13x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

None

Graphics Processor

AD102

GPU Name

GA100

AD102-300-A1

GPU Variant

-

Ada Lovelace

Architecture

Ampere

TSMC

Foundry

TSMC

5 nm

Process Size

7 nm

76.3 billion

Transistors

54.2 billion

609 mm²

Die Size

826 mm²

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.9

CUDA

8.0

6.8

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA GeForce RTX 4090 vs NVIDIA GeForce GTX 1630

2

NVIDIA GeForce RTX 4090 vs NVIDIA GeForce RTX 4060 Ti 8 GB

3

NVIDIA GeForce RTX 4090 vs ATI Radeon HD 2400

4

NVIDIA GeForce RTX 4090 vs AMD Radeon R7 350

5

NVIDIA GeForce RTX 4090 vs AMD Radeon HD 7970 GHz Edition

6

NVIDIA GeForce RTX 4090 vs NVIDIA GeForce GTX 660 OEM

7

NVIDIA GeForce RTX 4090 vs NVIDIA GeForce 7800 GTX 512

8

NVIDIA GeForce RTX 4090 vs AMD Radeon HD 7950 Monica BIOS 2

9

NVIDIA GeForce RTX 4090 vs ATI Radeon X1950 XTX Uber Edition

10

NVIDIA GeForce RTX 4090 vs ATI FirePro V5800 DVI

Related News

1

NVIDIA GB202 Chip Unveiled for the First Time, to be Used in RTX 5090 with 512-bit GDDR7 Memory

2

Strix Halo Integrated Graphics Score Appears on Passmark, Currently Slightly Below RTX 3060 12GB

3

AMD Unveils New RX 9070 XT Graphics Card Performance: Positioned Between RX 7900 GRE and RX 7900 XT

4

Double the Excitement! AMD FSR 4.0 to Launch Alongside RX 9070 XT Graphics Card

5

CPU-Z Minor Update: Support for Intel's Four New Products and New Memory

6

CXMT Reportedly Achieves 80% Yield in DDR5 Production

7

Intel Wildcat Lake Appears on Shipping List with FCBGA1516 Socket, Poised to Replace Alder Lake-N

8

The Commencement of ARM and Qualcomm Licensing Dispute Trial: Potential Major Impact on PC Market

9

NVIDIA Allegedly Equips RTX 5080 with 30Gbps Memory Speed, Other Models to Feature 28Gbps

10

Intel Reports High Return Rates for Devices Featuring Snapdragon X Series; Qualcomm Counters with 'Industry Standard' Claim