NVIDIA RTX 4060 Ti 16GB - 16GB usable

Specifications

BrandNVIDIA
ModelRTX 4060 Ti 16GB
Usable VRAM16GB
ArchitectureAda
CUDA / Stream Processors4,352
Memory Bandwidth288 GB/s
TDP165W
FP32 TFLOPS22

Current Offers

Used from 520

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Price History

  • eBay520at high
Aug 21Aug 28Sep 1Sep 4460520

For AI / LLM Use

Good for 14B models. 30B requires aggressive quantization. Slower generation, usable but not snappy.

What Models Can It Run?

  • 14B Q6_K, 30B Q3_K (tight)
  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~22 tokens/sec

Prefill: ~393 tokens/sec

Recommended Quantisations

  • Q4_K_M for 14B models
  • Q6_K for 7B-8B models
  • Q8 for 7B if VRAM allows

Pros & Cons

Pros

  • Ada architecture: broad CUDA software support
  • Consumer card: easy to install, display output

Cons

  • 16GB usable VRAM: may need quantization for 30B+ models
  • Low memory bandwidth: slower token generation

Community Verdict

No community reviews yet for the RTX 4060 Ti 16GB. Know a good review? Let us know.