NVIDIA RTX 3070 - 8GB usable

Specifications

BrandNVIDIA
ModelRTX 3070
Usable VRAM8GB
ArchitectureAmpere
CUDA / Stream Processors5,888
Memory Bandwidth448 GB/s
TDP220W
FP32 TFLOPS20

Current Offers

Used from 250

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Price History

  • eBay250at high
Mar 13May 1Jun 19Jul 17Aug 14Sep 4225245

For AI / LLM Use

Limited VRAM restricts you to 7B quantized models.

What Models Can It Run?

  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~34 tokens/sec

Prefill: ~357 tokens/sec

Recommended Quantisations

  • Q4_K_M for 7B models
  • Q3_K for larger experiments

Pros & Cons

Pros

  • Ampere architecture: broad CUDA software support
  • Consumer card: easy to install, display output

Cons

  • Only 8GB usable VRAM: limited to small models
  • Moderate memory bandwidth: not the fastest for inference

Community Verdict

No community reviews yet for the RTX 3070. Know a good review? Let us know.