NVIDIA RTX A4000 vs AMD Instinct MI300A
We compared two Professional market GPUs: 16GB VRAM RTX A4000 and 128GB VRAM AMD Instinct MI300A to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
NVIDIA RTX A4000 's Advantages
Lower TDP (140W vs 760W)
AMD Instinct MI300A 's Advantages
Released 2 years and 8 months late
Boost Clock has increased by 35% (2100MHz vs 1560MHz)
More VRAM (128GB vs 16GB)
Larger VRAM bandwidth (5300GB/s vs 448.0GB/s)
8448 additional rendering cores
Score
Benchmark
FP32 (float)
RTX A4000
19.17 TFLOPS
AMD Instinct MI300A
+539%
122.6 TFLOPS
Graphics Card
Apr 2021
Release Date
Dec 2023
Quadro Ampere
Generation
Instinct
Professional
Type
Professional
PCIe 4.0 x16
Bus Interface
PCIe 5.0 x16
Clock Speeds
735 MHz
Base Clock
1000 MHz
1560 MHz
Boost Clock
2100 MHz
1750 MHz
Memory Clock
5200 MHz
Memory
16GB
Memory Size
128GB
GDDR6
Memory Type
HBM3
256bit
Memory Bus
8192bit
448.0GB/s
Bandwidth
5300GB/s
Render Config
-
Compute Units
228
48
SM Count
-
6144
Shading Units
14592
192
TMUs
880
96
ROPs
0
192
Tensor Cores
-
48
RT Cores
-
128 KB (per SM)
L1 Cache
16 KB (per CU)
4 MB
L2 Cache
16 MB
-
-
-
Theoretical Performance
149.8 GPixel/s
Pixel Rate
0 MPixel/s
299.5 GTexel/s
Texture Rate
1496 GTexel/s
19.17 TFLOPS
FP16 (half)
980.6 TFLOPS
19.17 TFLOPS
FP32 (float)
122.6 TFLOPS
299.5 GFLOPS
FP64 (double)
61.3 TFLOPS
Board Design
140W
TDP
760W
300 W
Suggested PSU
1000 W
4x DisplayPort 1.4a
Outputs
No outputs
1x 6-pin
Power Connectors
None
Graphics Processor
GA104
GPU Name
MI300
GA104-875-A1
GPU Variant
-
Ampere
Architecture
CDNA 3.0
Samsung
Foundry
TSMC
8 nm
Process Size
5 nm
17.4 billion
Transistors
146 billion
392 mm²
Die Size
1017 mm²
Graphics Features
12 Ultimate (12_2)
DirectX
N/A
4.6
OpenGL
N/A
3.0
OpenCL
3.0
1.3
Vulkan
N/A
8.6
CUDA
-
6.7
Shader Model
N/A
