NVIDIA A100 SXM4 40 GB vs NVIDIA GeForce RTX 4090

VS

NVIDIA A100 SXM4 40 GB

NVIDIA GeForce RTX 4090

AI GPU We compared a GPU: 40GB VRAM A100 SXM4 40 GB and a Desktop platform GPU: 24GB VRAM GeForce RTX 4090 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA A100 SXM4 40 GB 's Advantages

More VRAM (40GB vs 24GB)

Larger VRAM bandwidth (1555GB/s vs 1.01TB/s)

Lower TDP (400W vs 450W)

NVIDIA GeForce RTX 4090 's Advantages

Released 2 years and 4 months late

Boost Clock has increased by 79% (2520MHz vs 1410MHz)

9472 additional rendering cores

Score

Benchmark

FP32 (float)

A100 SXM4 40 GB

19.49 TFLOPS

GeForce RTX 4090 +323%

82.58 TFLOPS

Blender

A100 SXM4 40 GB

2186

GeForce RTX 4090 +466%

12393

OctaneBench

A100 SXM4 40 GB

505

GeForce RTX 4090 +152%

1274

A100 SXM4 40 GB

VS

GeForce RTX 4090

Graphics Card

May 2020

Release Date

Sep 2022

Tesla Ampere

Generation

GeForce 40

AI GPU

Type

Desktop

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

1095 MHz

Base Clock

2235 MHz

1410 MHz

Boost Clock

2520 MHz

1215 MHz

Memory Clock

1313 MHz

Memory

40GB

Memory Size

24GB

HBM2e

Memory Type

GDDR6X

5120bit

Memory Bus

384bit

1555GB/s

Bandwidth

1.01TB/s

Render Config

-

108

SM Count

128

6912

Shading Units

16384

432

TMUs

512

160

ROPs

176

432

Tensor Cores

512

-

RT Cores

128

192 KB (per SM)

L1 Cache

128 KB (per SM)

40 MB

L2 Cache

72 MB

-

Theoretical Performance

225.6 GPixel/s

Pixel Rate

443.5 GPixel/s

609.1 GTexel/s

Texture Rate

1290 GTexel/s

77.97 TFLOPS

FP16 (half)

82.58 TFLOPS

19.49 TFLOPS

FP32 (float)

82.58 TFLOPS

9.746 TFLOPS

FP64 (double)

1290 GFLOPS

Board Design

400W

TDP

450W

800 W

Suggested PSU

850 W

No outputs

Outputs

1x HDMI 2.13x DisplayPort 1.4a

None

Power Connectors

1x 16-pin

Graphics Processor

GA100

GPU Name

AD102

-

GPU Variant

AD102-300-A1

Ampere

Architecture

Ada Lovelace

TSMC

Foundry

TSMC

7 nm

Process Size

5 nm

54.2 billion

Transistors

76.3 billion

826 mm²

Die Size

609 mm²

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

8.0

CUDA

8.9

N/A

Shader Model

6.8

Related GPU Comparisons

1

NVIDIA A100 SXM4 40 GB vs NVIDIA H100 SXM5

2

NVIDIA A100 SXM4 40 GB vs NVIDIA H800 PCIe 80 GB

3

NVIDIA A100 SXM4 40 GB vs NVIDIA A100 SXM4 80 GB

4

NVIDIA A100 SXM4 40 GB vs H200 SXM

5

NVIDIA A100 SXM4 40 GB vs NVIDIA A100 PCIe

6

NVIDIA A100 SXM4 40 GB vs NVIDIA H800 SXM5

7

NVIDIA A100 SXM4 40 GB vs NVIDIA H100 PCIe 96 GB

8

NVIDIA A100 SXM4 40 GB vs NVIDIA H100 SXM5 96 GB

9

NVIDIA A100 SXM4 40 GB vs NVIDIA A800 PCIe 40 GB

10

NVIDIA A100 SXM4 40 GB vs NVIDIA H100 CNX

Related News

1

Complete Lineup of Core Ultra 200HX/H/U and Core 200H/U Revealed: 31 Models to Dazzle the Eyes

2

Amechi Unveils V1 Mini PC: Only 0.33L Volume with 150W Power Consumption

3

iPhone 17 Series Set for Major Design Overhaul: Camera Module Transformed into Sleek Strip

4

The Thinnest iPhone Ever! iPhone 17 Air Reportedly Enters Foxconn's NPI Stage

5

Apple Allegedly Cancels M4 Extreme, Originally Planned for Mac Pro with 64-Core CPU and 160-Core GPU

6

Cyberpunk 2077 Update 2.2: Intel Arrow Lake Gaming Performance Soars by 33%!

7

Intel Finally Achieves Frame Generation! 'F1 24' Becomes the First XeSS 2 Game

8

World's First! Intel Arc B580 Graphics Card Arrives Early

9

Linux Creator Criticizes AMD and Intel's x86 Microarchitecture: A Complete Disaster

10

Preliminary Support for Intel Nova Lake in AIDA64: Identity Remains a Mystery