Home GPU Comparison NVIDIA L40G vs AMD Instinct MI300A

NVIDIA L40G vs AMD Instinct MI300A

We compared two Professional market GPUs: 24GB VRAM L40G and 128GB VRAM AMD Instinct MI300A to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA L40G 's Advantages
Boost Clock has increased by 18% (2475MHz vs 2100MHz)
3584 additional rendering cores
Lower TDP (300W vs 760W)
AMD Instinct MI300A 's Advantages
Released 1 years and 2 months late
More VRAM (128GB vs 24GB)
Larger VRAM bandwidth (5300GB/s vs 864.0GB/s)

Score

Benchmark

FP32 (float)
L40G
89.97 TFLOPS
AMD Instinct MI300A +36%
122.6 TFLOPS
VS

Graphics Card

Oct 2022
Release Date
Dec 2023
Tesla Ada
Generation
Instinct
Professional
Type
Professional
PCIe 4.0 x16
Bus Interface
PCIe 5.0 x16

Clock Speeds

1005 MHz
Base Clock
1000 MHz
2475 MHz
Boost Clock
2100 MHz
2250 MHz
Memory Clock
5200 MHz

Memory

24GB
Memory Size
128GB
GDDR6
Memory Type
HBM3
384bit
Memory Bus
8192bit
864.0GB/s
Bandwidth
5300GB/s

Render Config

-
Compute Units
228
142
SM Count
-
18176
Shading Units
14592
568
TMUs
880
192
ROPs
0
568
Tensor Cores
-
142
RT Cores
-
128 KB (per SM)
L1 Cache
16 KB (per CU)
48 MB
L2 Cache
16 MB
-
-
-

Theoretical Performance

475.2 GPixel/s
Pixel Rate
0 MPixel/s
1406 GTexel/s
Texture Rate
1496 GTexel/s
89.97 TFLOPS
FP16 (half)
980.6 TFLOPS
89.97 TFLOPS
FP32 (float)
122.6 TFLOPS
1406 GFLOPS
FP64 (double)
61.3 TFLOPS

Board Design

300W
TDP
760W
700 W
Suggested PSU
1000 W
1x HDMI 2.1 3x DisplayPort 1.4a
Outputs
No outputs
1x 16-pin
Power Connectors
None

Graphics Processor

AD102
GPU Name
MI300
AD102-???-A1
GPU Variant
-
Ada Lovelace
Architecture
CDNA 3.0
TSMC
Foundry
TSMC
4 nm
Process Size
5 nm
76.3 billion
Transistors
146 billion
608 mm²
Die Size
1017 mm²

Graphics Features

12 Ultimate (12_2)
DirectX
N/A
4.6
OpenGL
N/A
3.0
OpenCL
3.0
1.3
Vulkan
N/A
8.9
CUDA
-
6.6
Shader Model
N/A

Related GPU Comparisons

Related News

© 2024 - TopCPU.net   Contact Us Privacy Policy