NVIDIA Titan Xp - 12GB usable

Specifications

BrandNVIDIA
ModelTitan Xp
Usable VRAM12GB
ArchitecturePascal
CUDA / Stream Processors3,840
Memory Bandwidth548 GB/s
TDP250W
FP32 TFLOPS12.1

Current Offers

Used from £157

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Price History

  • eBay£157at low
Aug 21Aug 28Sep 1Sep 4£160£157

For AI / LLM Use

Entry-level for local AI. Handles 7B-8B models well. Older architecture may have limited software support (check CUDA compatibility).

What Models Can It Run?

  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~41 tokens/sec

Prefill: ~216 tokens/sec

Recommended Quantisations

  • Q4_K_M for 14B (tight fit)
  • Q6_K or Q8 for 7B models

Pros & Cons

Pros

  • Consumer card: easy to install, display output

Cons

  • 12GB usable VRAM: may need quantization for 30B+ models
  • Moderate memory bandwidth: not the fastest for inference
  • Older Pascal architecture: verify current CUDA support

Community Verdict

No community reviews yet for the Titan Xp. Know a good review? Let us know.