AMD Radeon Instinct MI300A vs NVIDIA RTX A4000H
We compared two Desktop platform GPUs: 192GB VRAM Radeon Instinct MI300A and 16GB VRAM RTX A4000H to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
AMD Radeon Instinct MI300A 's Advantages
Released 2 years and 8 months late
Boost Clock has increased by 35% (2100MHz vs 1560MHz)
More VRAM (192GB vs 16GB)
Larger VRAM bandwidth (10.3TB/s vs 448.0GB/s)
13312 additional rendering cores
NVIDIA RTX A4000H 's Advantages
Lower TDP (140W vs 750W)
Score
Benchmark
FP32 (float)
Radeon Instinct MI300A
+326%
81.72 TFLOPS
RTX A4000H
19.17 TFLOPS
Graphics Card
Dec 2023
Release Date
Apr 2021
Radeon Instinct
Generation
Quadro Ampere
Desktop
Type
Desktop
PCIe 5.0 x16
Bus Interface
PCIe 4.0 x16
Clock Speeds
1000 MHz
Base Clock
735 MHz
2100 MHz
Boost Clock
1560 MHz
2525 MHz
Memory Clock
1750 MHz
Memory
192GB
Memory Size
16GB
HBM3
Memory Type
GDDR6
8192bit
Memory Bus
256bit
10.3TB/s
Bandwidth
448.0GB/s
Render Config
304
Compute Units
-
-
SM Count
48
19456
Shading Units
6144
1216
TMUs
192
0
ROPs
96
1216
Tensor Cores
192
-
RT Cores
48
16 KB (per CU)
L1 Cache
128 KB (per SM)
16 MB
L2 Cache
4 MB
256 MB
L3 Cache
-
Theoretical Performance
0 MPixel/s
Pixel Rate
149.8 GPixel/s
2554 GTexel/s
Texture Rate
299.5 GTexel/s
653.7 TFLOPS
FP16 (half)
19.17 TFLOPS
81.72 TFLOPS
FP32 (float)
19.17 TFLOPS
81.72 TFLOPS
FP64 (double)
299.5 GFLOPS
Board Design
750W
TDP
140W
1150 W
Suggested PSU
300 W
No outputs
Outputs
4x DisplayPort 1.4a
None
Power Connectors
1x 6-pin
Graphics Processor
Aqua Vanjaram
GPU Name
GA104
-
GPU Variant
GA104-???-A1
CDNA 3.0
Architecture
Ampere
TSMC
Foundry
Samsung
5 nm
Process Size
8 nm
153 billion
Transistors
17.4 billion
1017 mm²
Die Size
392 mm²
Graphics Features
N/A
DirectX
12 Ultimate (12_2)
N/A
OpenGL
4.6
3.0
OpenCL
3.0
N/A
Vulkan
1.3
-
CUDA
8.6
N/A
Shader Model
6.7
