NVIDIA accelerators for data centres

NVIDIA introduces the most powerful graphics accelerators on the market. These cards can accelerate many massively parallel tasks and scientific (HPC) applications or efficiently solve artificial intelligence (AI) algorithms.

NVIDIA A100

NVIDIA’s latest and most powerful HPC and AI card for data centres.

spec sheet

NVIDIA V100

NVIDIA’s HPC and AI card for data centres, the predecessor to the A100.

spec sheet

NVIDIA A30

The A30 is the latest successor to NVIDIA T4 accelerators and is most commonly used in accelerating HPC computing applications or artificial intelligence inference.

spec sheet

NVIDIA A16

The A16 accelerator combines the power of 4 graphics chips on a single board with 4x 16GB GDDR6 memory. This means support for up to 64 concurrent users on a single card in a dual-slot design.

spec sheet

NVIDIA Tesla T4

The card with the best performance to power ratio, especially suitable for neural network applications.

spec sheet

NVIDIA A10

The A10 could be described as the younger sibling of the A40 accelerator. It will be used in visualization and virtualization. The compact single-slot A10 is suitable as an absolutely versatile card for a large number of tasks.

spec sheet

NVIDIA A40

It delivers unmatched performance in ray-traced rendering, high-performance virtual workstations, simulation, 3D design, VR and virtual production.

spec sheet

NVIDIA DGX systems

Supercomputers for solving machine learning and artificial intelligence problems. It is the most powerful hardware and fine-tuned software stack that includes the most widely used machine learning frameworks in the form of application containers.

More information

NVIDIA GPU Comparison for Data Centres

Parameter	Tesla T4	Tesla V100s	NVIDIA A40	NVIDIA A30	NVIDIA A10	NVIDIA A100 SXM4 \| PCIe	DGX Station A100	DGX A100
Chip Architecture	Turing	Volta	Ampere	Ampere	Ampere	Ampere	Ampere	Ampere
Card chip	TU104	GV100	GA102	GA100	GA102	GA100	GA100	GA100
# CUDA cores	2 560	5 120	10 752	6 912	9 216	6 912	27 648	55 296
# Tensor cores	320	640	336	224	288	432	1 728	3 456
FP64 (TFlops)	0,25	8,2	1,179	5,2	0,97	9,7	38,8	77,6
FP64 Tensor (TFlops)	—	—	—	10,3	—	19,5	78	156
FP32 (TFlops)	8,1	16,4	37,4	10,3	31,2	19,5	78	156
TF32 Tensor (TFlops)	—	—	150*	165*	125*	312*	1 248*	2 496*
FP16 Tensor (TFlops)	65	130	299*	330*	250*	624*	2 496*	4 992*
INT8 Tensor (TOPS)	130	—	599*	661*	500*	1248*	4 992*	9 994*
INT4 Tensor (TOPS)	260	—	1197*	1321*	1000*	2496*	9 992*	19 968*
GPU memory	16 GB	32 GB	48 GB	24 GB	24 GB	40 GB / 80 GB	160 / 320 GB	320 / 640 GB
Multi-Instance GPU	1 instance	1 instance	vGPU mode	4 instance	vGPU mode	7 instances	28 instances	56 instances
Memory technology	GDDR6	HBM2	GDDR6	HBM2	GDDR6	HBM2	HBM2	HBM2
Memory throughput	300 GB/s	1 134 GB/s	696 GB/s	933 GB/s	600 GB/s	1 ,5 / 2,0 TB/s	1 ,5 / 2,0 TB/s	1 ,5 / 2,0 TB/s
GPU link	PCIe 3	NVLink	NVLink	NVLink 3	PCIe 4	NVLink 3	NVLink 3	NVSwitch3, non-blocking, 4.8 TB/s
Power consumption	70 W	250 W	300 W	165 W	150 W	400 W \| 250 W	1 500 W	6,6 kW
Form factor	PCIe card	PCIe card	PCIe card	PCIe card	PCIe card	SXM4 \| PCIe	tower, water cooling CPU and GPU	rack, 6U
PCIe generation	PCIe gen3	PCIe gen3	PCIe gen4	PCIe gen4	PCIe gen4	PCI gen4	PCIe gen4	PCIe gen4
Year of launch	2018	2019	2020	2021	2021	2020	2020	2020
Card	Tesla T4	Tesla V100s	NVIDIA A40	NVIDIA A30	NVIDIA A10	NVIDIA A100 SXM4	DGX Station A100	DGX A100
	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet

* the stated power is for calculations with sparse nuts (Sparsity), for standard calculations the power is half of the specified values
** NVIDIA A100 PCIe achieves 90% of the stated computing power

GPU Accelerators for data centres

NVIDIA Tesla and Ampere graphics accelerators are designed to accelerate HPC applications or deploy artificial intelligence and deep learning algorithms.

Key benefits of NVIDIA cards include dedicated Tensor cores for machine learning applications. And large memory (up to 80 GB per accelerator), secured by ECC technology. To enable the accelerators to communicate quickly with each other, NVIDIA has connected them with a special interface with huge data throughput – NVLink. NVLink achieves transfer rates of up to 600 GB/s. In addition, the NVIDIA DGX A100 offers a super-powerful NVSwitch. This provides a total throughput between eight NVIDIA Ampere A100 cards of up to 4.8 TB/s.

Intersect360 Research analysis shows that most of the most widely used HPC applications already support NVIDIA cards. These include These include GROMACS, Ansys Fluent, Gaussian, VASP, NAMD, Abaqus, OpenFoam, LS Dyna, BLAST, Amber, Gamess, ParaView, NASTRAN and many others. The large expansion of NVIDIA accelerators has been helped by support for deep learning frameworks – TensorFlow, Caffe, PyTorch, MXNET, Chainer, Keras and many more.

The graph on the right shows how fast the graphics accelerator field is evolving, with a ninefold increase in performance in just four years. The figures are based on the average of benchmark results for the most widely used AI and HPC applications (Amber, Chroma, GROMACS, MILC, NAMD, PyTorch, Quantum Espresso, TensorFlow and VASP), measured on dual-socket servers with four P100, V100 or A100 accelerators each.

NVIDIA GP GPU Performance Evolution in Time

How to choose the best GPU?

The current GP GPU cards for data centers and their typical deployments are mentioned in the infographics.

NVIDIA visualization cards

NVIDIA RTX professional cards are designed primarily for graphics processing and simulation, machine learning, data analytics, and high-performance workstation virtualization.

Comparison of Nvidia cards for visualization

Parameter	GeForce RTX 2080Ti	RTX 3080	RTX 3090	Quadro RTX 5000	Quadro RTX 6000 / 8000	RTX A6000	RTX A5000	RTX A4000
Architecture	Turing	Ampere	Ampere	Turing	Turing	Ampere	Ampere	Ampere
Card chip	TU102	GA102	GA102	TU104	TU102	GA102	GA102	GA104
# CUDA cores	4 352	8704	10 496	3 072	4 608	10 752	8 192	6 144
# Tensor cores	544	272	328	384	576	336	256	192
FP64 (TFlops)	0,4	0,47	0,56	0,4	0,5	1,25	0,87	0,6
FP32 (TFlops)	13,4	29,8	35.6	11,2	16,3	40	27,7	19,2
FP16 Tensor (TFlops)	107,6	119/238*	142/284*	89,2	130	309,7*	222,2*	153,4*
GPU memory	11 GB	10 GB	24 GB	16 GB	24 / 48 GB	48 GB	24 GB	16 GB
Memory	GDDR6	GDDR6X	GDDR6X	GDDR6	GDDR6	GDDR6	GDDR6	GDDR6
Memory throughput	616 GB / s	760 GB / s	936 GB / s	448 GB / s	624 GB / s	768 GB / s	768 GB / s	448 GB / s
ECC memory	none	none	none	ECC	ECC	ECC	ECC	ECC
GPU link	NVLink 2-way	PCIe gen4	NVLink 2-way	NVLink 2-way	NVLink 2-way	NVLink 2-way	NVLink 2-way	PCIe gen4
Max. power consumption	250 W	320 W	350 W	265 W	295 W	300 W	230 W	140 W
Form factor	PCIe gen3	PCIe gen4	PCIe gen4	PCIe gen3	PCIe gen3	PCIe gen4	PCIe gen4	PCIe gen4
For data centres**	No	No	No	Yes	Yes	Yes	Yes	Yes
Announcement year	2018	2020	2020	2018	2018	2020	2021	2021
Card	GeForce RTX 2080Ti	RTX 3080	RTX 3090	Quadro RTX 5000	RTX 6000 / 8000	RTX A6000	RTX A5000	RTX A4000
	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet	spec sheet

* uvedený výkon je pro výpočty s řídkými maticemi (Sparcity), pro standardní výpočty je výkon poloviční oproti uvedeným hodnotám

** podle Nvidia licenčních podmínek k ovladačům karet (EULA) nejsou grafické karty GeForce (GTX, RTX) určeny pro datová centra:
“No Datacenter Deployment. The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted.”
zdroj: https://www.nvidia.com/content/DriverDownload-March2009/licence.php?lang=us&type=GeForce

NVIDIA offers special pricing and project-specific programs on both GPU and DGX systems, plus support for educational institutions (EDUs) and start-ups.

Get an offer

Testing

To test the performance and especially the speed of deploying ML and AI applications, we have the NVIDIA DGX Station and, as part of the NVIDIA Test Drive program, the NVIDIA A100, NVIDIA A40, NVIDIA A10, Tesla V100 or Tesla T4 accelerators. If you are interested in our testing offer, please fill out this form.