AMD Instinct MI300A vs NVIDIA RTX 4000 SFF Ada Generation
We compared two Professional market GPUs: 128GB VRAM AMD Instinct MI300A and 16GB VRAM RTX 4000 SFF Ada Generation to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
AMD Instinct MI300A 's Advantages
Released 5 years and 1 months late
Boost Clock has increased by 20% (2100MHz vs 1746MHz)
More VRAM (128GB vs 16GB)
Larger VRAM bandwidth (5300GB/s vs 1.02TB/s)
10752 additional rendering cores
NVIDIA RTX 4000 SFF Ada Generation 's Advantages
Lower TDP (300W vs 760W)
Score
Benchmark
FP32 (float)
AMD Instinct MI300A
+814%
122.6 TFLOPS
RTX 4000 SFF Ada Generation
13.41 TFLOPS
Graphics Card
Dec 2023
Release Date
Nov 2018
Instinct
Generation
Radeon Instinct
Professional
Type
Professional
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x16
Clock Speeds
1000 MHz
Base Clock
1200 MHz
2100 MHz
Boost Clock
1746 MHz
5200 MHz
Memory Clock
1000 MHz
Memory
128GB
Memory Size
16GB
HBM3
Memory Type
HBM2
8192bit
Memory Bus
4096bit
5300GB/s
Bandwidth
1.02TB/s
Render Config
228
Compute Units
60
-
SM Count
48
14592
Shading Units
3840
880
TMUs
240
0
ROPs
64
-
Tensor Cores
192
-
RT Cores
48
16 KB (per CU)
L1 Cache
16 KB (per CU)
16 MB
L2 Cache
4 MB
-
-
-
Theoretical Performance
0 MPixel/s
Pixel Rate
111.7 GPixel/s
1496 GTexel/s
Texture Rate
419.0 GTexel/s
980.6 TFLOPS
FP16 (half)
26.82 TFLOPS
122.6 TFLOPS
FP32 (float)
13.41 TFLOPS
61.3 TFLOPS
FP64 (double)
6.705 TFLOPS
Board Design
760W
TDP
300W
1000 W
Suggested PSU
700 W
No outputs
Outputs
1x mini-DisplayPort 1.4a
None
Power Connectors
2x 8-pin
Graphics Processor
MI300
GPU Name
Vega 20
-
GPU Variant
Vega 20 GLXT
CDNA 3.0
Architecture
GCN 5.1
TSMC
Foundry
TSMC
5 nm
Process Size
7 nm
146 billion
Transistors
13.23 billion
1017 mm²
Die Size
331 mm²
Graphics Features
N/A
DirectX
12 (12_1)
N/A
OpenGL
4.6
3.0
OpenCL
2.1
N/A
Vulkan
1.3
-
CUDA
8.9
N/A
Shader Model
6.7
