NVIDIA RTX 4080 - 16GB usable

Great performance but 16GB limits you to 14B models. Consider 3090 for more VRAM at lower cost.

Specifications

BrandNVIDIA
ModelRTX 4080
Usable VRAM16GB
ArchitectureAda
CUDA / Stream Processors9,728
Memory Bandwidth717 GB/s
TDP320W
FP32 TFLOPS49

Current Offers

Used from $920New from $1,400

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Lowest tracked offers by retailer

US · USD · Weekly since May 2026 · Shipping may be extra

$750$1,000$1,250$1,500$1,750$2,000May 8Jun 21Aug 5Sep 19Nov 3Newegg $1,799Amazon $1,400eBay $920
About these prices

Each line is the lowest offer we tracked from that retailer at weekly snapshots, ending at today's offer. The condition can vary between snapshots (new, used, or unrecorded for older ones). eBay prices exclude shipping. Tax is excluded. Amazon shows a current price only.

Weekly offers table
Lowest tracked offer per retailer · US · USD
DateeBayAmazonNewegg
Today, Nov 3, 2026 $920.00$1,399.99–
Oct 30, 2026 $920.00––
Oct 23, 2026 $999.99––
Oct 9, 2026 $999.99––
Oct 2, 2026 $1,039.97–$1,799.00
Sep 25, 2026 $1,059.99–$1,819.99
Sep 18, 2026 $999.99–$1,499.00
Sep 11, 2026 $939.99––
Sep 4, 2026 $820.00––
Sep 1, 2026 $849.00––
Aug 28, 2026 $870.00––
Aug 21, 2026 $820.00––
Aug 14, 2026 $799.00––
Aug 7, 2026 $800.00––
Jul 31, 2026 $759.99–$1,499.00
Jul 24, 2026 $795.99–$1,423.00
Jul 17, 2026 $819.99–$1,423.00
Jul 10, 2026 $799.95–$1,423.00
Jul 3, 2026 $824.99–$1,396.01
Jun 26, 2026 $849.99–$1,423.00
Jun 19, 2026 $849.99–$1,423.00
Jun 12, 2026 $795.00–$1,423.00
Jun 5, 2026 $795.00–$1,423.00
May 29, 2026 $839.50–$1,423.00
May 22, 2026 $829.99–$1,423.00
May 15, 2026 $849.95–$1,423.00
May 8, 2026 $810.00–$1,423.00

For AI / LLM Use

Good for 14B models. 30B requires aggressive quantization.

What Models Can It Run?

  • 14B Q6_K, 30B Q3_K (tight)
  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~54 tokens/sec

Prefill: ~875 tokens/sec

Recommended Quantisations

  • Q4_K_M for 14B models
  • Q6_K for 7B-8B models
  • Q8 for 7B if VRAM allows

Pros & Cons

Pros

  • Ada architecture: broad CUDA software support
  • Consumer card: easy to install, display output

Cons

  • 16GB usable VRAM: may need quantization for 30B+ models
  • Moderate memory bandwidth: not the fastest for inference
  • 320W TDP: high power draw

Community Verdict

  • r/LocalLLaMA

    Fast but 16GB is the bottleneck. Most recommend spending the same money on a 3090 for more VRAM.

    Source