Your inference queue is backing up because 24 GB just isn't enough anymore. You've outgrown the mid-range card, but you don't want to wait three weeks for a national chain's back-order or ship a rack unit overseas. This is the card that sits on your shelf and handles the workload today.
The LEADTEK RTX PRO 6000 Blackwell Server Edition gives you 96 GB of GDDR7 with error-correcting code on a 512-bit bus. That's 1,597 GB/s of memory bandwidth behind 24,064 CUDA cores and 752 fifth-generation Tensor Cores. You get 4 PFLOPS of FP4 AI throughput for inference workloads that used to need a cluster.
Split it into up to four Multi-Instance GPU partitions at 24 GB each if you're serving multiple tenants. Confidential Compute is supported, so sensitive model weights stay encrypted in transit and at rest. Secure Boot with a hardware Root of Trust closes the supply-chain gap.
It slots into a PCIe 5.0 x16 lane, runs dual-slot (4.4 in H × 10.5 in L), and draws up to 600 W — configurable down if your PSU headroom is tighter. Four DisplayPort 2.1 connectors are on board for local debug or direct attach.
If your workload is AI inference, large-model serving, or GPU-accelerated rendering in a server chassis, this is the spec you've been circling. Call us and we'll confirm fit with your chassis and power budget before it ships
| brand | LEADTEK |
| gpu_architecture | NVIDIA Blackwell |
| cuda_cores | 24,064 |
| tensor_cores | 752 (5th Gen) |
| rt_cores | 188 (4th Gen) |
| fp32_performance | 120 TFLOPS |
| fp4_ai_performance | 4 PFLOPS |
| rt_core_performance | 355 TFLOPS |
| gpu_memory | 96 GB GDDR7 with ECC |
| memory_interface | 512-bit |
| memory_bandwidth | 1,597 GB/s |
| power_consumption | Up to 600 W (configurable) |
| multi_instance_gpu | Up to 4 MIGs @ 24 GB |
| nvenc_nvdec_jpeg | 4× / 4× / 4× |
| confidential_compute | Supported |
| secure_boot | Yes (Root of Trust) |
| graphics_bus | PCI Express 5.0 x16 |
| display_connectors | 4× DisplayPort 2.1 |
| form_factor | 4.4 in (H) × 10.5 in (L), dual slot |
| model_number | 900-2G153-0000-000 |
| category | TECHNOLOGY > COMPUTER ACCESSORIES |