AMD Instinct MI300A vs NVIDIA RTX 4000 SFF Ada Generation

VS

AMD Instinct MI300A NVIDIA RTX 4000 SFF Ada Generation

We compared two Professional market GPUs: 128GB VRAM AMD Instinct MI300A and 20GB VRAM RTX 4000 SFF Ada Generation to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Instinct MI300A 's Advantages

Released 9 months late

Boost Clock has increased by 35% (2100MHz vs 1560MHz)

More VRAM (128GB vs 20GB)

Larger VRAM bandwidth (5300GB/s vs 280.0GB/s)

8448 additional rendering cores

NVIDIA RTX 4000 SFF Ada Generation 's Advantages

Lower TDP (70W vs 760W)

Score

Benchmark

FP32 (float)

AMD Instinct MI300A +539%

122.6 TFLOPS

RTX 4000 SFF Ada Generation

19.17 TFLOPS

AMD Instinct MI300A

VS

RTX 4000 SFF Ada Generation

Graphics Card

Dec 2023

Release Date

Mar 2023

Instinct

Generation

Quadro Ada

Professional

Type

Professional

PCIe 5.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

1000 MHz

Base Clock

720 MHz

2100 MHz

Boost Clock

1560 MHz

5200 MHz

Memory Clock

1750 MHz

Memory

128GB

Memory Size

20GB

HBM3

Memory Type

GDDR6

8192bit

Memory Bus

160bit

5300GB/s

Bandwidth

280.0GB/s

Render Config

-

SM Count

48

228

Compute Units

-

14592

Shading Units

6144

880

TMUs

192

0

ROPs

80

-

Tensor Cores

192

-

RT Cores

48

16 KB (per CU)

L1 Cache

128 KB (per SM)

16 MB

L2 Cache

48 MB

Theoretical Performance

0 MPixel/s

Pixel Rate

124.8 GPixel/s

1496 GTexel/s

Texture Rate

299.5 GTexel/s

980.6 TFLOPS

FP16 (half)

19.17 TFLOPS

122.6 TFLOPS

FP32 (float)

19.17 TFLOPS

61.3 TFLOPS

FP64 (double)

299.5 GFLOPS

Graphics Processor

MI300

GPU Name

AD104

-

GPU Variant

-

CDNA 3.0

Architecture

Ada Lovelace

TSMC

Foundry

TSMC

5 nm

Process Size

5 nm

146 billion

Transistors

35.8 billion

1017 mm²

Die Size

294 mm²

Board Design

760W

TDP

70W

1000 W

Suggested PSU

250 W

No outputs

Outputs

4x mini-DisplayPort 1.4a

None

Power Connectors

None

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

-

CUDA

8.9

N/A

Shader Model

6.7

Related GPU Comparisons

1

AMD Instinct MI300A vs AMD Instinct MI300X

2

NVIDIA L40 vs AMD Instinct MI300A

3

NVIDIA Tesla V100 SXM2 16 GB vs AMD Instinct MI300A

4

NVIDIA Quadro K2000M vs AMD Instinct MI300A

5

NVIDIA Quadro M1200 Mobile vs AMD Instinct MI300A

6

AMD Instinct MI300A vs NVIDIA Quadro P4000 Max Q

7

NVIDIA L4 vs AMD Instinct MI300A

8

AMD Instinct MI300A vs NVIDIA Quadro K4000

9

AMD Instinct MI300A vs NVIDIA RTX A2000 Mobile

10

AMD Instinct MI300A vs NVIDIA RTX A5000 Mobile

Related News

1

AMD's Strix Halo Supports Up to 128GB Memory, Clearly Designed for AI Large Language Models

2

AMD to Launch Advanced Ryzen AI PRO Series Soon

3

Intel Delays Lunar Lake Shipment: Postponed from June to September

4

Initial Test Results of AMD Ryzen AI 9 365 Revealed: IPC Improvement Meets Expectations

5

Elon Musk Responds to Nvidia’s Jensen Huang: Humanoid Robots Will Be Ten Times More Common than Cars

6

AMD Revives Multi-GPU Support: Up to Four Cards and 192GB VRAM

7

TSMC Explores Advanced Chip Packaging Technology: Switches to Rectangular Substrate, Nearly Tripling Usable Area on 300mm Wafers

8

Western Digital WD Blue SN5000 SSD Launched: Up to 8TB Capacity with Mixed TLC/QLC Flash

9

Apple's Most Powerful Laptop is Coming: A Preview of the New MacBook Pro

10

AMD Breakthrough: Ryzen AI HX 370 Processor Benchmark Revealed with Aggressive Performance