NVIDIA L40S vs AMD Instinct MI300A

VS

NVIDIA L40S AMD Instinct MI300A

We compared two Professional market GPUs: 48GB VRAM L40S and 128GB VRAM AMD Instinct MI300A to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA L40S 's Advantages

Boost Clock has increased by 20% (2520MHz vs 2100MHz)

3584 additional rendering cores

Lower TDP (300W vs 760W)

AMD Instinct MI300A 's Advantages

Released 1 years and 2 months late

More VRAM (128GB vs 48GB)

Larger VRAM bandwidth (5300GB/s vs 864.0GB/s)

Score

Benchmark

FP32 (float)

L40S

91.61 TFLOPS

AMD Instinct MI300A +33%

122.6 TFLOPS

L40S

VS

AMD Instinct MI300A

Graphics Card

Oct 2022

Release Date

Dec 2023

Tesla Ada

Generation

Instinct

Professional

Type

Professional

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

1110 MHz

Base Clock

1000 MHz

2520 MHz

Boost Clock

2100 MHz

2250 MHz

Memory Clock

5200 MHz

Memory

48GB

Memory Size

128GB

GDDR6

Memory Type

HBM3

384bit

Memory Bus

8192bit

864.0GB/s

Bandwidth

5300GB/s

Render Config

142

SM Count

-

Compute Units

228

18176

Shading Units

14592

568

TMUs

880

192

ROPs

0

568

Tensor Cores

-

142

RT Cores

-

128 KB (per SM)

L1 Cache

16 KB (per CU)

48 MB

L2 Cache

16 MB

Theoretical Performance

483.8 GPixel/s

Pixel Rate

0 MPixel/s

1431 GTexel/s

Texture Rate

1496 GTexel/s

91.61 TFLOPS

FP16 (half)

980.6 TFLOPS

91.61 TFLOPS

FP32 (float)

122.6 TFLOPS

1431 GFLOPS

FP64 (double)

61.3 TFLOPS

Graphics Processor

AD102

GPU Name

MI300

AD102-???-A1

GPU Variant

-

Ada Lovelace

Architecture

CDNA 3.0

TSMC

Foundry

TSMC

5 nm

Process Size

5 nm

76.3 billion

Transistors

146 billion

609 mm²

Die Size

1017 mm²

Board Design

300W

TDP

760W

700 W

Suggested PSU

1000 W

1x HDMI 2.1 3x DisplayPort 1.4a

Outputs

No outputs

1x 16-pin

Power Connectors

None

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

8.9

CUDA

-

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA L40S vs NVIDIA L4

2

NVIDIA L40S vs NVIDIA GeForce GTX 280

3

NVIDIA L40S vs NVIDIA RTX A3000 Mobile

4

NVIDIA L40S vs NVIDIA Tesla P100 PCIe 16 GB

5

NVIDIA L40S vs NVIDIA Quadro M6000

6

NVIDIA L40S vs NVIDIA GeForce RTX 4090 D

7

NVIDIA L40S vs NVIDIA Tesla T4

8

NVIDIA L40S vs NVIDIA Tesla V100 SXM2 32 GB

9

NVIDIA L40S vs NVIDIA RTX A4500 Max-Q

10

NVIDIA L40S vs NVIDIA Quadro P600 Mobile

Related News

1

Researchers Utilize NVIDIA Omniverse Platform to Analyze and Improve 3D Stacked Chip Designs

2

TSMC to Receive Over 60 EUV Lithography Machines Over the Next Two Years, Investing More Than $12.3 Billion

3

Samsung's Own 3nm Yield is Disheartening: Galaxy S25 May Introduce MediaTek for the First Time

4

AMD Ryzen 9000 DDR5 Memory Frequency Soars: Reaches 8000MHz with All Four Slots Occupied

5

Snapdragon 8 Gen 4 to Feature Frame Interpolation for GPU: A Game-Changing Experience

6

Intel Adds 5 New Device IDs to Latest Linux Xe Kernel in Preparation for Battlemage

7

Ryzen AI 9 365 Benchmark Results Leaked: Significant Improvements in Multi-Core and IPC Performance Over Previous Generation

8

Concerns Raised by Unstable 13th/14th Gen Core CPUs: Motherboard Manufacturers Worry About Impact on Arrow Lake Release and Sales

9

Do You Really Know What a "Rendering Engine" Is? Read This Article to Understand All About It

10

New AMD Zen5 Ryzen 9000 Motherboards X870E/X870 to Adopt USB4! But You’ll Have to Wait Two More Months