NVIDIA Quadro RTX 8000 - 48GB usable

Specifications

BrandNVIDIA
ModelQuadro RTX 8000
Usable VRAM48GB
ArchitectureTuring
CUDA / Stream Processors4,608
Memory Bandwidth672 GB/s
TDP260W
FP32 TFLOPS16.3

Current Offers

Used from £1891

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Price History

  • eBay£1891near high
Aug 21Sep 4£1882£1893

For AI / LLM Use

Best for running 70B+ models on a single GPU.

What Models Can It Run?

  • 70B Q4_K_M, 30B full precision
  • 30B Q6_K, 70B Q2_K
  • 30B Q4_K_M, 14B full precision, 70B Q2 (tight)
  • 14B Q6_K, 30B Q3_K (tight)
  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~50 tokens/sec

Prefill: ~291 tokens/sec

Recommended Quantisations

  • Q6_K or Q8 for best quality
  • Q4_K_M for larger models
  • Full precision for 30B and below

Pros & Cons

Pros

  • 48GB usable VRAM: handles large models
  • Turing architecture: broad CUDA software support
  • Workstation card with display outputs and active cooling

Cons

  • Moderate memory bandwidth: not the fastest for inference

Community Verdict

No community reviews yet for the Quadro RTX 8000. Know a good review? Let us know.