NVIDIA A100 PCIe

This is a GPU manufactured with TSMC 7nm process, based on Nvidia Ampere architecture and released on Jun 2020. It features 54.2 billion transistors, 6912 CUDA cores and 40GB HBM2e memory, with 40MB L2 cache, theoretical performance of 19.49TFLOPS, with total power consumption of 250W.

Graphics Card

[Report Issues]

Release Date

Jun 2020

Generation

Tesla

Type

AI GPU

Bus Interface

PCIe 4.0 x16

Clock Speeds

[Report Issues]

Base Clock

765 MHz

Boost Clock

1410 MHz

Memory Clock

1215 MHz

Memory

[Report Issues]

Memory Size

40GB

Memory Type

HBM2e

Memory Bus

5120bit

Bandwidth

1555GB/s

Render Config

[Report Issues]

SM Count

108

Shading Units

6912

TMUs

432

ROPs

160

Tensor Cores

432

L1 Cache

192 KB (per SM)

L2 Cache

40 MB

Theoretical Performance

[Report Issues]

Pixel Rate

225.6 GPixel/s

Texture Rate

609.1 GTexel/s

FP16 (half)

77.97 TFLOPS

FP32 (float)

19.49 TFLOPS

FP64 (double)

9.746 TFLOPS

Graphics Processor

[Report Issues]

GPU Name

GA100

Architecture

Ampere

Foundry

TSMC

Process Size

7 nm

Transistors

54.2 billion

Die Size

826 mm²

Board Design

[Report Issues]

TDP

250W

Suggested PSU

600 W

Outputs

No outputs

Power Connectors

8-pin EPS

Graphics Features

[Report Issues]

DirectX

N/A

OpenGL

N/A

OpenCL

3.0

Vulkan

N/A

CUDA

8.0

Shader Model

N/A

Rankings

[Report Issues]

FP32 (float)

AMD Radeon PRO W7600 8 GB GDDR6

19.99 TFLOPS

AMD Radeon RX 8800 XT 16 GB GDDR6

19.91 TFLOPS

Intel Arc A770 16 GB GDDR6

19.66 TFLOPS

NVIDIA A100 PCIe 80 GB 80 GB HBM2e

19.49 TFLOPS

NVIDIA A100 PCIe 40 GB HBM2e

19.49 TFLOPS

NVIDIA A100 SXM4 40 GB 40 GB HBM2e

19.49 TFLOPS

NVIDIA A100 SXM4 80 GB 80 GB HBM2e

19.49 TFLOPS

Related Comparisons

1

NVIDIA L4 vs NVIDIA A100 PCIe

2

NVIDIA Tesla T4 vs NVIDIA A100 PCIe

3

NVIDIA A100 PCIe vs NVIDIA L40

4

NVIDIA A100 PCIe vs NVIDIA RTX 6000 Ada

5

NVIDIA A100 PCIe vs NVIDIA A40 PCIe

6

NVIDIA H100 PCIe vs NVIDIA A100 PCIe

7

NVIDIA A100 PCIe vs NVIDIA A10 PCIe

8

NVIDIA A100 PCIe vs NVIDIA A800 SXM4 80 GB

9

NVIDIA A100 PCIe vs NVIDIA H100 CNX

10

NVIDIA A100 PCIe vs NVIDIA H100 SXM5 96 GB