Home GPU Comparison AMD Instinct MI300X vs NVIDIA A100 SXM4 80 GB

AMD Instinct MI300X vs NVIDIA A100 SXM4 80 GB

AI GPU We compared a Professional market GPU: 192GB VRAM AMD Instinct MI300X and a GPU: 80GB VRAM A100 SXM4 80 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Instinct MI300X 's Advantages
Released 3 years and 1 months late
Boost Clock has increased by 49% (2100MHz vs 1410MHz)
More VRAM (192GB vs 80GB)
Larger VRAM bandwidth (5300GB/s vs 2039GB/s)
12544 additional rendering cores
NVIDIA A100 SXM4 80 GB 's Advantages
Lower TDP (400W vs 750W)

Score

Benchmark

FP32 (float)
AMD Instinct MI300X +738%
163.4 TFLOPS
A100 SXM4 80 GB
19.49 TFLOPS
VS

Graphics Card

Dec 2023
Release Date
Nov 2020
Instinct
Generation
Tesla Ampere
Professional
Type
AI GPU
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x16

Clock Speeds

1000 MHz
Base Clock
1275 MHz
2100 MHz
Boost Clock
1410 MHz
5200 MHz
Memory Clock
1593 MHz

Memory

192GB
Memory Size
80GB
HBM3
Memory Type
HBM2e
8192bit
Memory Bus
5120bit
5300GB/s
Bandwidth
2039GB/s

Render Config

304
Compute Units
-
-
SM Count
108
19456
Shading Units
6912
880
TMUs
432
0
ROPs
160
-
Tensor Cores
432
-
-
-
16 KB (per CU)
L1 Cache
192 KB (per SM)
16 MB
L2 Cache
40 MB
-
-
-

Theoretical Performance

0 MPixel/s
Pixel Rate
225.6 GPixel/s
1496 GTexel/s
Texture Rate
609.1 GTexel/s
1300 TFLOPS
FP16 (half)
77.97 TFLOPS
163.4 TFLOPS
FP32 (float)
19.49 TFLOPS
81.7 TFLOPS
FP64 (double)
9.746 TFLOPS

Board Design

750W
TDP
400W
1000 W
Suggested PSU
800 W
No outputs
Outputs
No outputs
None
Power Connectors
None

Graphics Processor

MI300
GPU Name
GA100
-
-
-
CDNA 3.0
Architecture
Ampere
TSMC
Foundry
TSMC
5 nm
Process Size
7 nm
146 billion
Transistors
54.2 billion
1017 mm²
Die Size
826 mm²

Graphics Features

N/A
DirectX
N/A
N/A
OpenGL
N/A
3.0
OpenCL
3.0
N/A
Vulkan
N/A
-
CUDA
8.0
N/A
Shader Model
N/A

Related GPU Comparisons

Related News

© 2024 - TopCPU.net   Contact Us Privacy Policy