NVIDIA GRID A100B vs NVIDIA H100 PCIe 96 GB

VS

NVIDIA GRID A100B NVIDIA H100 PCIe 96 GB

AI GPU We compared a Professional market GPU: 48GB VRAM GRID A100B and a GPU: 96GB VRAM H100 PCIe 96 GB to see which GPU has better performance in key specifications, benchmark tests, power consumption, etc.

Main Differences

NVIDIA GRID A100B 's Advantages

Larger VRAM bandwidth (1866GB/s vs 1681GB/s)

Lower TDP (400W vs 700W)

NVIDIA H100 PCIe 96 GB 's Advantages

Released 2 years and 10 months late

Boost Clock has increased by 83% (1837MHz vs 1005MHz)

More VRAM (96GB vs 48GB)

9984 additional rendering cores

Score

Benchmark

FP32 (float)

GRID A100B

13.89 TFLOPS

H100 PCIe 96 GB +346%

62.08 TFLOPS

GRID A100B

VS

H100 PCIe 96 GB

Graphics Card

May 2020

Release Date

Mar 2023

GRID

Generation

Tesla Hopper

Professional

Type

AI GPU

PCIe 4.0 x16

Bus Interface

PCIe 5.0 x16

Clock Speeds

900 MHz

Base Clock

1665 MHz

1005 MHz

Boost Clock

1837 MHz

1215 MHz

Memory Clock

1313 MHz

Memory

48GB

Memory Size

96GB

HBM2e

Memory Type

HBM3

6144bit

Memory Bus

5120bit

1866GB/s

Bandwidth

1681GB/s

Render Config

108

SM Count

132

-

Compute Units

-

6912

Shading Units

16896

432

TMUs

528

192

ROPs

24

432

Tensor Cores

528

-

RT Cores

-

192 KB (per SM)

L1 Cache

256 KB (per SM)

48 MB

L2 Cache

50 MB

Theoretical Performance

193.0 GPixel/s

Pixel Rate

44.09 GPixel/s

434.2 GTexel/s

Texture Rate

969.9 GTexel/s

55.57 TFLOPS

FP16 (half)

248.3 TFLOPS

13.89 TFLOPS

FP32 (float)

62.08 TFLOPS

6.947 TFLOPS

FP64 (double)

31.04 TFLOPS

Graphics Processor

GA100

GPU Name

GH100

-

GPU Variant

-

Ampere

Architecture

Hopper

TSMC

Foundry

TSMC

7 nm

Process Size

4 nm

54.2 billion

Transistors

80 billion

826 mm²

Die Size

814 mm²

Board Design

400W

TDP

700W

800 W

Suggested PSU

1100 W

No outputs

Outputs

No outputs

None

Power Connectors

8-pin EPS

Graphics Features

N/A

DirectX

N/A

OpenGL

N/A

3.0

OpenCL

3.0

N/A

Vulkan

N/A

8.0

CUDA

9.0

N/A

Shader Model

N/A

Related GPU Comparisons

1

NVIDIA RTX A4500 vs NVIDIA GRID A100B

2

NVIDIA Tesla T4 vs NVIDIA GRID A100B

3

NVIDIA Quadro M500M vs NVIDIA GRID A100B

4

NVIDIA RTX A5500 vs NVIDIA GRID A100B

5

NVIDIA L40 vs NVIDIA GRID A100B

6

NVIDIA GRID A100B vs NVIDIA Quadro FX 3600M

7

NVIDIA H100 CNX vs NVIDIA H100 PCIe 96 GB

8

NVIDIA GRID A100B vs NVIDIA GRID RTX T10 8

9

NVIDIA GRID A100B vs NVIDIA Quadro FX 770M

10

NVIDIA GRID A100B vs NVIDIA Quadro K4000

Related News

1

Intel Releases BIOS Update to Improve Gaming Stability for 13th and 14th Gen Core Processors

2

MSI Unveils Laptop with AMD Ryzen AI 300 Chip at Computex Taipei 2024