AMD Instinct MI300X vs H200 SXM

VS

AMD Instinct MI300X

H200 SXM

AI GPU We compared a Professional market GPU: 192GB VRAM AMD Instinct MI300X and a GPU: 141GB VRAM H200 SXM to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Instinct MI300X 's Advantages

Boost Clock has increased by 6% (2100MHz vs 1980MHz)

More VRAM (192GB vs 141GB)

Larger VRAM bandwidth (5300GB/s vs 4800GB/s)

2560 additional rendering cores

H200 SXM 's Advantages

Lower TDP (700W vs 750W)

Score

Benchmark

FP32 (float)

AMD Instinct MI300X +143%

163.4 TFLOPS

H200 SXM

67 TFLOPS

AMD Instinct MI300X

VS

H200 SXM

Graphics Card

Dec 2023

Release Date

Nov 2023

Instinct

Generation

Hopper

Professional

Type

AI GPU

PCIe 5.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

1000 MHz

Base Clock

1590 MHz

2100 MHz

Boost Clock

1980 MHz

5200 MHz

Memory Clock

1313 MHz

Memory

192GB

Memory Size

141GB

HBM3

Memory Type

HBM3e

8192bit

Memory Bus

5120bit

5300GB/s

Bandwidth

4800GB/s

Render Config

304

Compute Units

-

SM Count

132

19456

Shading Units

16896

880

TMUs

528

0

ROPs

24

-

Tensor Cores

528

-

16 KB (per CU)

L1 Cache

256 KB (per SM)

16 MB

L2 Cache

50 MB

-

Theoretical Performance

0 MPixel/s

Pixel Rate

47.52 GPixel/s

1496 GTexel/s

Texture Rate

1045 GTexel/s

1300 TFLOPS

FP16 (half)

1979 TFLOPS

163.4 TFLOPS

FP32 (float)

67 TFLOPS

81.7 TFLOPS

FP64 (double)

34 TFLOPS

Board Design

750W

TDP

700W

1000 W

Suggested PSU

1100 W

No outputs

Outputs

No outputs

None

Power Connectors

8-pin EPS

Graphics Processor

MI300

GPU Name

GH200

-

CDNA 3.0

Architecture

Hopper

TSMC

Foundry

TSMC

5 nm

Process Size

4 nm

146 billion

Transistors

80 billion

1017 mm²

Die Size

814 mm²

Graphics Features

N/A

DirectX

N/A

OpenGL

N/A

3.0

OpenCL

3.0

N/A

Vulkan

N/A

-

CUDA

9.0

N/A

Shader Model

N/A

Related GPU Comparisons

1

AMD Instinct MI300X vs NVIDIA Tesla P10

2

AMD Instinct MI300X vs NVIDIA Tesla S1070

3

AMD Instinct MI300X vs NVIDIA Quadro RTX 6000 Mobile

4

AMD Instinct MI300X vs NVIDIA Quadro K610M

5

AMD Instinct MI300X vs NVIDIA Quadro NVS 420

6

AMD Instinct MI300X vs NVIDIA Quadro RTX 4000 Mobile

7

AMD Instinct MI300X vs NVIDIA Tesla K20Xm

8

AMD Instinct MI300X vs NVIDIA Quadro FX 380

9

AMD Instinct MI300X vs NVIDIA Quadro Plex 2100 S4

10

AMD Instinct MI300X vs NVIDIA A10G

Related News

1

AMD Unveils New RX 9070 XT Graphics Card Performance: Positioned Between RX 7900 GRE and RX 7900 XT

2

Double the Excitement! AMD FSR 4.0 to Launch Alongside RX 9070 XT Graphics Card

3

CPU-Z Minor Update: Support for Intel's Four New Products and New Memory

4

CXMT Reportedly Achieves 80% Yield in DDR5 Production

5

Intel Wildcat Lake Appears on Shipping List with FCBGA1516 Socket, Poised to Replace Alder Lake-N

6

The Commencement of ARM and Qualcomm Licensing Dispute Trial: Potential Major Impact on PC Market

7

NVIDIA Allegedly Equips RTX 5080 with 30Gbps Memory Speed, Other Models to Feature 28Gbps

8

Intel Reports High Return Rates for Devices Featuring Snapdragon X Series; Qualcomm Counters with 'Industry Standard' Claim

9

Intel Confirms Panther Lake Adopts 18A Process, ES0 Samples Already Sent to Customers

10

Complete Lineup of Core Ultra 200HX/H/U and Core 200H/U Revealed: 31 Models to Dazzle the Eyes