AMD Instinct MI300A vs NVIDIA L40

VS

AMD Instinct MI300A NVIDIA L40

We compared two Professional market GPUs: 128GB VRAM AMD Instinct MI300A and 48GB VRAM L40 to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

AMD Instinct MI300A 's Advantages

Released 1 years and 2 months late

More VRAM (128GB vs 48GB)

Larger VRAM bandwidth (5300GB/s vs 864.0GB/s)

NVIDIA L40 's Advantages

Boost Clock has increased by 19% (2490MHz vs 2100MHz)

3584 additional rendering cores

Lower TDP (300W vs 760W)

Score

Benchmark

FP32 (float)

AMD Instinct MI300A +35%

122.6 TFLOPS

L40

90.52 TFLOPS

AMD Instinct MI300A

VS

L40

Graphics Card

Dec 2023

Release Date

Oct 2022

Instinct

Generation

Tesla Ada

Professional

Type

Professional

PCIe 5.0 x16

Bus Interface

PCIe 4.0 x16

Clock Speeds

1000 MHz

Base Clock

735 MHz

2100 MHz

Boost Clock

2490 MHz

5200 MHz

Memory Clock

2250 MHz

Memory

128GB

Memory Size

48GB

HBM3

Memory Type

GDDR6

8192bit

Memory Bus

384bit

5300GB/s

Bandwidth

864.0GB/s

Render Config

-

SM Count

142

228

Compute Units

-

14592

Shading Units

18176

880

TMUs

568

0

ROPs

192

-

Tensor Cores

568

-

RT Cores

142

16 KB (per CU)

L1 Cache

128 KB (per SM)

16 MB

L2 Cache

96 MB

Theoretical Performance

0 MPixel/s

Pixel Rate

478.1 GPixel/s

1496 GTexel/s

Texture Rate

1414 GTexel/s

980.6 TFLOPS

FP16 (half)

90.52 TFLOPS

122.6 TFLOPS

FP32 (float)

90.52 TFLOPS

61.3 TFLOPS

FP64 (double)

1414 GFLOPS

Graphics Processor

MI300

GPU Name

AD102

-

GPU Variant

AD102-895-A1

CDNA 3.0

Architecture

Ada Lovelace

TSMC

Foundry

TSMC

5 nm

Process Size

4 nm

146 billion

Transistors

76.3 billion

1017 mm²

Die Size

608 mm²

Board Design

760W

TDP

300W

1000 W

Suggested PSU

700 W

No outputs

Outputs

4x DisplayPort 1.4a

None

Power Connectors

1x 16-pin

Graphics Features

N/A

DirectX

12 Ultimate (12_2)

N/A

OpenGL

4.6

3.0

OpenCL

3.0

N/A

Vulkan

1.3

-

CUDA

8.9

N/A

Shader Model

6.6

Related GPU Comparisons

1

AMD Instinct MI300A vs AMD Instinct MI300X

2

AMD Instinct MI300A vs NVIDIA RTX A1000 Mobile 6 GB

3

AMD Instinct MI300A vs NVIDIA Quadro P4000 Max Q

4

AMD Instinct MI300A vs NVIDIA Quadro T1000 Mobile

5

AMD Instinct MI300A vs NVIDIA Quadro K5000M

6

AMD Instinct MI300A vs NVIDIA Tesla T10 Processor

7

AMD Instinct MI300A vs NVIDIA Tesla M2070 Q

8

AMD Instinct MI300A vs NVIDIA Quadro K420

9

AMD Instinct MI300A vs NVIDIA Tesla K40d

10

AMD Instinct MI300A vs NVIDIA GRID K560Q

Related News

1

Intel May Increase Base Frequencies for Arrow Lake-S / H / HX, High-End Chips to Reach 3GHz or Higher

2

It's 2024: This Company Released a Laptop Supporting DOS and Windows 95

3

AMD's Strix Halo Supports Up to 128GB Memory, Clearly Designed for AI Large Language Models

4

AMD to Launch Advanced Ryzen AI PRO Series Soon

5

Intel Delays Lunar Lake Shipment: Postponed from June to September

6

Initial Test Results of AMD Ryzen AI 9 365 Revealed: IPC Improvement Meets Expectations

7

Elon Musk Responds to Nvidia’s Jensen Huang: Humanoid Robots Will Be Ten Times More Common than Cars

8

AMD Revives Multi-GPU Support: Up to Four Cards and 192GB VRAM

9

TSMC Explores Advanced Chip Packaging Technology: Switches to Rectangular Substrate, Nearly Tripling Usable Area on 300mm Wafers

10

Western Digital WD Blue SN5000 SSD Launched: Up to 8TB Capacity with Mixed TLC/QLC Flash