NVIDIA GRID A100B vs AMD Instinct MI300X
We compared two Professional market GPUs: 48GB VRAM GRID A100B and 192GB VRAM AMD Instinct MI300X to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.
Main Differences
NVIDIA GRID A100B 's Advantages
Lower TDP (400W vs 750W)
AMD Instinct MI300X 's Advantages
Released 3 years and 7 months late
Boost Clock has increased by 109% (2100MHz vs 1005MHz)
More VRAM (192GB vs 48GB)
Larger VRAM bandwidth (5300GB/s vs 1866GB/s)
12544 additional rendering cores
Score
Benchmark
FP32 (float)
GRID A100B
13.89 TFLOPS
AMD Instinct MI300X
+1076%
163.4 TFLOPS
Graphics Card
May 2020
Release Date
Dec 2023
GRID
Generation
Instinct
Professional
Type
Professional
PCIe 4.0 x16
Bus Interface
PCIe 5.0 x16
Clock Speeds
900 MHz
Base Clock
1000 MHz
1005 MHz
Boost Clock
2100 MHz
1215 MHz
Memory Clock
5200 MHz
Memory
48GB
Memory Size
192GB
HBM2e
Memory Type
HBM3
6144bit
Memory Bus
8192bit
1866GB/s
Bandwidth
5300GB/s
Render Config
-
Compute Units
304
108
SM Count
-
6912
Shading Units
19456
432
TMUs
880
192
ROPs
0
432
Tensor Cores
-
-
-
-
192 KB (per SM)
L1 Cache
16 KB (per CU)
48 MB
L2 Cache
16 MB
-
-
-
Theoretical Performance
193.0 GPixel/s
Pixel Rate
0 MPixel/s
434.2 GTexel/s
Texture Rate
1496 GTexel/s
55.57 TFLOPS
FP16 (half)
1300 TFLOPS
13.89 TFLOPS
FP32 (float)
163.4 TFLOPS
6.947 TFLOPS
FP64 (double)
81.7 TFLOPS
Board Design
400W
TDP
750W
800 W
Suggested PSU
1000 W
No outputs
Outputs
No outputs
None
Power Connectors
None
Graphics Processor
GA100
GPU Name
MI300
-
-
-
Ampere
Architecture
CDNA 3.0
TSMC
Foundry
TSMC
7 nm
Process Size
5 nm
54.2 billion
Transistors
146 billion
826 mm²
Die Size
1017 mm²
Graphics Features
N/A
DirectX
N/A
N/A
OpenGL
N/A
3.0
OpenCL
3.0
N/A
Vulkan
N/A
8.0
CUDA
-
N/A
Shader Model
N/A
