NVIDIA Tesla T40 24 GB vs AMD Instinct MI300A

VS

NVIDIA Tesla T40 24 GB AMD Instinct MI300A

We compared two Professional market GPUs: 24GB VRAM Tesla T40 24 GB and 128GB VRAM AMD Instinct MI300A to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA Tesla T40 24 GB 's Advantages

Lower TDP (260W vs 760W)

AMD Instinct MI300A 's Advantages

Boost Clock has increased by 35% (2100MHz vs 1560MHz)

More VRAM (128GB vs 24GB)

Larger VRAM bandwidth (5300GB/s vs 624.0GB/s)

9984 additional rendering cores

Score

Benchmark

FP32 (float)

Tesla T40 24 GB

14.38 TFLOPS

AMD Instinct MI300A +752%

122.6 TFLOPS

Tesla T40 24 GB

VS

AMD Instinct MI300A

Graphics Card

Unknown

Release Date

Dec 2023

Tesla Turing

Generation

Instinct

Professional

Type

Professional

PCIe 3.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

1305 MHz

Base Clock

1000 MHz

1560 MHz

Boost Clock

2100 MHz

1625 MHz

Memory Clock

5200 MHz

Memory

24GB

Memory Size

128GB

GDDR6

Memory Type

HBM3

384bit

Memory Bus

8192bit

624.0GB/s

Bandwidth

5300GB/s

Render Config

72

SM Count

-

Compute Units

228

4608

Shading Units

14592

288

TMUs

880

96

ROPs

0

576

Tensor Cores

-

72

RT Cores

-

64 KB (per SM)

L1 Cache

16 KB (per CU)

6 MB

L2 Cache

16 MB

Theoretical Performance

149.8 GPixel/s

Pixel Rate

0 MPixel/s

449.3 GTexel/s

Texture Rate

1496 GTexel/s

28.75 TFLOPS

FP16 (half)

980.6 TFLOPS

14.38 TFLOPS

FP32 (float)

122.6 TFLOPS

449.3 GFLOPS

FP64 (double)

61.3 TFLOPS

Graphics Processor

TU102

GPU Name

MI300

-

GPU Variant

-

Turing

Architecture

CDNA 3.0

TSMC

Foundry

TSMC

12 nm

Process Size

5 nm

18.6 billion

Transistors

146 billion

754 mm²

Die Size

1017 mm²

Board Design

260W

TDP

760W

600 W

Suggested PSU

1000 W

No outputs

Outputs

No outputs

1x 6-pin + 1x 8-pin

Power Connectors

None

Graphics Features

12 Ultimate (12_2)

DirectX

N/A

4.6

OpenGL

N/A

3.0

OpenCL

3.0

1.3

Vulkan

N/A

7.5

CUDA

-

6.7

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA Tesla P40 vs NVIDIA Tesla T40 24 GB

2

NVIDIA Tesla T40 24 GB vs NVIDIA Tesla T4

3

NVIDIA Tesla K80 vs NVIDIA Tesla T40 24 GB

4

NVIDIA Tesla T40 24 GB vs NVIDIA GeForce RTX 4070

5

NVIDIA Tesla M40 vs NVIDIA Tesla T40 24 GB

6

NVIDIA Tesla T40 24 GB vs NVIDIA Tesla V100 PCIe 16 GB

7

NVIDIA Quadro 4100 vs NVIDIA Tesla T40 24 GB

8

NVIDIA Tesla T40 24 GB vs NVIDIA RTX 4000 SFF Ada Generation

9

NVIDIA Tesla T40 24 GB vs NVIDIA Quadro FX 4600 SDI

10

NVIDIA Tesla T40 24 GB vs NVIDIA Quadro K420

Related News

1

NVIDIA Grace CPU Benchmark Results Released, Stunning Performance

2

Minisforum Launches UM890 Pro Mini PC with R9 8945HS and Dual USB4 Ports

3

Does the Apple A18 Neural Engine Boast Superior Performance? Computational Power May Surpass M4 Chip

4

AMD's Commitment to Pioneering Each Generation with Cutting-Edge Process Technology and Continuous Innovation in Design, Packaging, and Assembly

5

NVIDIA to Ramp Up Orders and Add New Suppliers to Meet Explosive Demand for Blackwell Products

6

NVIDIA Informs Brands of Reduced Supply for RTX 40 Series GPUs

7

Only 3 Weeks Left! AMD Zen5 Launching Soon

8

Ilya Departs OpenAI to Launch New Company Aiming at Superintelligence!

9

Comprehensive Overview of AMD Ryzen 9000 Zen5 Desktop CPUs

10

Intel May Increase Base Frequencies for Arrow Lake-S / H / HX, High-End Chips to Reach 3GHz or Higher