NVIDIA A100 PCIe vs NVIDIA GeForce RTX 4090

VS

NVIDIA A100 PCIe

NVIDIA GeForce RTX 4090

AI GPU We compared a GPU: 40GB VRAM A100 PCIe and a Desktop platform GPU: 24GB VRAM GeForce RTX 4090 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA A100 PCIe 's Advantages

More VRAM (40GB vs 24GB)

Larger VRAM bandwidth (1555GB/s vs 1.01TB/s)

Lower TDP (250W vs 450W)

NVIDIA GeForce RTX 4090 's Advantages

Released 2 years and 3 months late

Boost Clock has increased by 79% (2520MHz vs 1410MHz)

9472 additional rendering cores

Score

Benchmark

FP32 (float)

A100 PCIe

19.49 TFLOPS

GeForce RTX 4090 +323%

82.58 TFLOPS

A100 PCIe

VS

GeForce RTX 4090

Graphics Card

Jun 2020

Release Date

Sep 2022

Tesla

Generation

GeForce 40

AI GPU

Type

Desktop

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

765 MHz

Base Clock

2235 MHz

1410 MHz

Boost Clock

2520 MHz

1215 MHz

Memory Clock

1313 MHz

Memory

40GB

Memory Size

24GB

HBM2e

Memory Type

GDDR6X

5120bit

Memory Bus

384bit

1555GB/s

Bandwidth

1.01TB/s

Render Config

-

108

SM Count

128

6912

Shading Units

16384

432

TMUs

512

160

ROPs

176

432

Tensor Cores

512

-

RT Cores

128

192 KB (per SM)

L1 Cache

128 KB (per SM)

40 MB

L2 Cache

72 MB

-

Theoretical Performance

225.6 GPixel/s

Pixel Rate

443.5 GPixel/s

609.1 GTexel/s

Texture Rate

1290 GTexel/s

77.97 TFLOPS

FP16 (half)

82.58 TFLOPS

19.49 TFLOPS

FP32 (float)

82.58 TFLOPS

9.746 TFLOPS

FP64 (double)

1290 GFLOPS

Board Design

250W

TDP

450W

600 W

Suggested PSU

850 W

No outputs

Outputs

1x HDMI 2.13x DisplayPort 1.4a

8-pin EPS

Power Connectors

1x 16-pin

Graphics Processor

GA100

GPU Name

AD102

-

GPU Variant

AD102-300-A1

Ampere

Architecture

Ada Lovelace

TSMC

Foundry

TSMC

7 nm

Process Size

5 nm

54.2 billion

Transistors

76.3 billion

826 mm²

Die Size

609 mm²

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

8.0

CUDA

8.9

N/A

Shader Model

6.8

Related GPU Comparisons

1

NVIDIA A100 PCIe vs NVIDIA A100 SXM4 80 GB

2

NVIDIA A100 PCIe vs NVIDIA H100 PCIe 80 GB

3

NVIDIA A100 PCIe vs NVIDIA H800 SXM5

4

NVIDIA A100 PCIe vs NVIDIA A800 PCIe 40 GB

5

NVIDIA A100 PCIe vs NVIDIA A800 SXM4 80 GB

6

NVIDIA A100 PCIe vs NVIDIA H100 PCIe

7

NVIDIA A100 PCIe vs NVIDIA A100 SXM4 40 GB

8

NVIDIA A100 PCIe vs NVIDIA H800 PCIe 80 GB

9

NVIDIA A100 PCIe vs NVIDIA H100 PCIe 96 GB

10

NVIDIA A100 PCIe vs H200 SXM

Related News

1

AMD Unveils New RX 9070 XT Graphics Card Performance: Positioned Between RX 7900 GRE and RX 7900 XT

2

Double the Excitement! AMD FSR 4.0 to Launch Alongside RX 9070 XT Graphics Card

3

CPU-Z Minor Update: Support for Intel's Four New Products and New Memory

4

CXMT Reportedly Achieves 80% Yield in DDR5 Production

5

Intel Wildcat Lake Appears on Shipping List with FCBGA1516 Socket, Poised to Replace Alder Lake-N

6

The Commencement of ARM and Qualcomm Licensing Dispute Trial: Potential Major Impact on PC Market

7

NVIDIA Allegedly Equips RTX 5080 with 30Gbps Memory Speed, Other Models to Feature 28Gbps

8

Intel Reports High Return Rates for Devices Featuring Snapdragon X Series; Qualcomm Counters with 'Industry Standard' Claim

9

Intel Confirms Panther Lake Adopts 18A Process, ES0 Samples Already Sent to Customers

10

Complete Lineup of Core Ultra 200HX/H/U and Core 200H/U Revealed: 31 Models to Dazzle the Eyes