NVIDIA L40 vs AMD Radeon Instinct MI100

VS

We compared two Professional market GPUs: 48GB VRAM L40 and 32GB VRAM Radeon Instinct MI100 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA L40 's Advantages

Released 1 years and 11 months late

Boost Clock has increased by 66% (2490MHz vs 1502MHz)

More VRAM (48GB vs 32GB)

10496 additional rendering cores

AMD Radeon Instinct MI100 's Advantages

Larger VRAM bandwidth (1229GB/s vs 864.0GB/s)

Score

Benchmark

FP32 (float)

L40 +292%

90.52 TFLOPS

Radeon Instinct MI100

23.07 TFLOPS

L40

VS

Radeon Instinct MI100

Graphics Card

Oct 2022

Release Date

Nov 2020

Tesla Ada

Generation

Radeon Instinct

Professional

Type

Professional

PCIe 4.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

735 MHz

Base Clock

1000 MHz

2490 MHz

Boost Clock

1502 MHz

2250 MHz

Memory Clock

1200 MHz

Memory

48GB

Memory Size

32GB

GDDR6

Memory Type

HBM2

384bit

Memory Bus

4096bit

864.0GB/s

Bandwidth

1229GB/s

Render Config

142

SM Count

-

Compute Units

120

18176

Shading Units

7680

568

TMUs

480

192

ROPs

64

568

Tensor Cores

-

142

RT Cores

-

128 KB (per SM)

L1 Cache

16 KB (per CU)

96 MB

L2 Cache

8 MB

Theoretical Performance

478.1 GPixel/s

Pixel Rate

96.13 GPixel/s

1414 GTexel/s

Texture Rate

721.0 GTexel/s

90.52 TFLOPS

FP16 (half)

184.6 TFLOPS

90.52 TFLOPS

FP32 (float)

23.07 TFLOPS

1414 GFLOPS

FP64 (double)

11.54 TFLOPS

Graphics Processor

AD102

GPU Name

Arcturus

AD102-895-A1

GPU Variant

Arcturus XL

Ada Lovelace

Architecture

CDNA 1.0

TSMC

Foundry

TSMC

4 nm

Process Size

7 nm

76.3 billion

Transistors

25.6 billion

608 mm²

Die Size

750 mm²

Board Design

300W

TDP

300W

700 W

Suggested PSU

700 W

4x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

2x 8-pin

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

2.1

1.3

Vulkan

N/A

8.9

CUDA

-

6.6

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA L40 vs NVIDIA L40S

2

NVIDIA L4 vs NVIDIA L40

3

NVIDIA RTX A6000 vs NVIDIA L40

4

NVIDIA L40 vs NVIDIA GeForce RTX 4090

5

NVIDIA A100 PCIe vs NVIDIA L40

6

NVIDIA L20 vs NVIDIA L40

7

NVIDIA L40 vs NVIDIA H100 PCIe

8

NVIDIA L40 vs NVIDIA Tesla PG500 216

9

NVIDIA L40 vs NVIDIA Quadro M5500 Mobile

10

NVIDIA L40 vs NVIDIA GRID K340

Related News

1

NVIDIA Grace CPU Benchmark Results Released, Stunning Performance

2

Minisforum Launches UM890 Pro Mini PC with R9 8945HS and Dual USB4 Ports

3

Does the Apple A18 Neural Engine Boast Superior Performance? Computational Power May Surpass M4 Chip

4

AMD's Commitment to Pioneering Each Generation with Cutting-Edge Process Technology and Continuous Innovation in Design, Packaging, and Assembly

5

NVIDIA to Ramp Up Orders and Add New Suppliers to Meet Explosive Demand for Blackwell Products

6

NVIDIA Informs Brands of Reduced Supply for RTX 40 Series GPUs

7

Only 3 Weeks Left! AMD Zen5 Launching Soon

8

Ilya Departs OpenAI to Launch New Company Aiming at Superintelligence!

9

Comprehensive Overview of AMD Ryzen 9000 Zen5 Desktop CPUs

10

Intel May Increase Base Frequencies for Arrow Lake-S / H / HX, High-End Chips to Reach 3GHz or Higher