NVIDIA L4 - 24GB usable

Specifications

BrandNVIDIA
ModelL4
Usable VRAM24GB
ArchitectureAda
CUDA / Stream Processors7,424
Memory Bandwidth300 GB/s
TDP72W
FP32 TFLOPS30

Current Offers

Used from $4,000New from $3,950

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Lowest tracked offers by retailer

US · USD · Weekly since Aug 2026 · Shipping may be extra

$2,500$3,000$3,500$4,000$4,500$5,000Aug 21Sep 8Sep 27Oct 15Nov 3eBay $4,000Amazon $3,950Newegg $3,599
About these prices

Each line is the lowest offer we tracked from that retailer at weekly snapshots, ending at today's offer. The condition can vary between snapshots (new, used, or unrecorded for older ones). eBay prices exclude shipping. Tax is excluded. Amazon shows a current price only.

Weekly offers table
Lowest tracked offer per retailer · US · USD
DateeBayAmazonNewegg
Today, Nov 3, 2026 $3,999.99$3,950.00–
Oct 30, 2026 $3,999.99––
Oct 23, 2026 $4,399.00––
Oct 9, 2026 $4,599.00–$3,599.00
Oct 2, 2026 $4,295.00–$3,599.00
Sep 25, 2026 $3,699.00–$3,599.00
Sep 18, 2026 $3,500.00–$3,599.00
Sep 11, 2026 $3,699.00–$3,599.00
Sep 4, 2026 $3,699.00–$3,599.00
Sep 1, 2026 $3,699.00–$3,399.00
Aug 28, 2026 $3,699.00–$2,749.99
Aug 21, 2026 $3,500.00–$2,749.99

For AI / LLM Use

Solid choice for 30B models and comfortable 14B inference. Slower generation, usable but not snappy. Datacenter card with no display output, may need aftermarket cooling.

What Models Can It Run?

  • 30B Q4_K_M, 14B full precision, 70B Q2 (tight)
  • 14B Q6_K, 30B Q3_K (tight)
  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~23 tokens/sec

Prefill: ~536 tokens/sec

Recommended Quantisations

  • Q4_K_M recommended for 30B models
  • Q6_K or Q8 for 14B and below
  • Full precision for 7B

Pros & Cons

Pros

  • 24GB usable VRAM: handles large models
  • Only 72W TDP: power efficient
  • Ada architecture: broad CUDA software support

Cons

  • Moderate memory bandwidth: not the fastest for inference
  • No display output: headless only
  • May need aftermarket cooling solution

Community Verdict

No community reviews yet for the L4. Know a good review? Let us know.