AMD Radeon Instinct MI300A vs NVIDIA RTX 2000 Ada Generation
We compared two Desktop platform GPUs: 192GB VRAM Radeon Instinct MI300A and 16GB VRAM RTX 2000 Ada Generation to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
AMD Radeon Instinct MI300A 's Advantages
More VRAM (192GB vs 16GB)
Larger VRAM bandwidth (10.3TB/s vs 256.0GB/s)
16640 additional rendering cores
NVIDIA RTX 2000 Ada Generation 's Advantages
Boost Clock has increased by 1% (2130MHz vs 2100MHz)
Lower TDP (70W vs 750W)
Score
Benchmark
FP32 (float)
Radeon Instinct MI300A
+581%
81.72 TFLOPS
RTX 2000 Ada Generation
12 TFLOPS
Graphics Card
Dec 2023
Release Date
Feb 2024
Radeon Instinct
Generation
Quadro Ada
Desktop
Type
Desktop
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x8
Clock Speeds
1000 MHz
Base Clock
1620 MHz
2100 MHz
Boost Clock
2130 MHz
2525 MHz
Memory Clock
2000 MHz
Memory
192GB
Memory Size
16GB
HBM3
Memory Type
GDDR6
8192bit
Memory Bus
128bit
10.3TB/s
Bandwidth
256.0GB/s
Render Config
304
Compute Units
-
-
SM Count
22
19456
Shading Units
2816
1216
TMUs
88
0
ROPs
48
1216
Tensor Cores
88
-
RT Cores
22
16 KB (per CU)
L1 Cache
128 KB (per SM)
16 MB
L2 Cache
12 MB
256 MB
L3 Cache
-
Theoretical Performance
0 MPixel/s
Pixel Rate
102.2 GPixel/s
2554 GTexel/s
Texture Rate
187.4 GTexel/s
653.7 TFLOPS
FP16 (half)
12.00 TFLOPS
81.72 TFLOPS
FP32 (float)
12.00 TFLOPS
81.72 TFLOPS
FP64 (double)
187.4 GFLOPS
Board Design
750W
TDP
70W
1150 W
Suggested PSU
250 W
No outputs
Outputs
4x mini-DisplayPort 1.4a
None
Power Connectors
None
Graphics Processor
Aqua Vanjaram
GPU Name
AD107
-
-
-
CDNA 3.0
Architecture
Ada Lovelace
TSMC
Foundry
TSMC
5 nm
Process Size
5 nm
153 billion
Transistors
18.9 billion
1017 mm²
Die Size
159 mm²
Graphics Features
N/A
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
3.0
OpenCL
3.0
N/A
Vulkan
1.3
-
CUDA
8.9
N/A
Shader Model
6.7
