NVIDIA A40 - 48GB usable

48GB of Ampere in a passive shell, an A6000 without the blower. Needs server front-to-back airflow, not a desktop case.

Specifications

BrandNVIDIA
ModelA40
Usable VRAM48GB
ArchitectureAmpere
CUDA / Stream Processors10,752
Memory Bandwidth696 GB/s
TDP300W
FP32 TFLOPS37.4

Current Offers

Used from $4,000New from $5,699

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Lowest tracked offers by retailer

US · USD · Weekly since Jul 2026 · Shipping may be extra

$2,500$5,000$7,500$10,000Jul 31Aug 23Sep 16Oct 10Nov 3Newegg $8,890Amazon $5,699eBay $4,000
About these prices

Each line is the lowest offer we tracked from that retailer at weekly snapshots, ending at today's offer. The condition can vary between snapshots (new, used, or unrecorded for older ones). eBay prices exclude shipping. Tax is excluded. Amazon shows a current price only.

Weekly offers table
Lowest tracked offer per retailer · US · USD
DateeBayAmazonNewegg
Today, Nov 3, 2026 $3,999.99$5,699.00–
Oct 30, 2026 $3,500.00––
Oct 23, 2026 $3,600.00––
Oct 9, 2026 $3,999.99–$8,890.00
Oct 2, 2026 $3,999.99–$8,890.00
Sep 25, 2026 $3,999.99–$8,890.00
Sep 18, 2026 $4,249.99–$7,999.99
Sep 11, 2026 $4,599.99–$8,890.00
Sep 4, 2026 $4,599.99–$7,999.99
Sep 1, 2026 $4,599.99–$7,999.99
Aug 28, 2026 $4,599.99–$7,999.99
Aug 21, 2026 $4,319.99–$7,999.99
Aug 14, 2026 $4,319.99–$7,999.99
Aug 7, 2026 $4,319.99–$7,999.99
Jul 31, 2026 $4,599.99–$7,999.99

For AI / LLM Use

Best for running 70B+ models on a single GPU. Datacenter card with no display output, may need aftermarket cooling.

What Models Can It Run?

  • 70B Q4_K_M, 30B full precision
  • 30B Q6_K, 70B Q2_K
  • 30B Q4_K_M, 14B full precision, 70B Q2 (tight)
  • 14B Q6_K, 30B Q3_K (tight)
  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~52 tokens/sec

Prefill: ~668 tokens/sec

Recommended Quantisations

  • Q6_K or Q8 for best quality
  • Q4_K_M for larger models
  • Full precision for 30B and below

Pros & Cons

Pros

  • 48GB usable VRAM: handles large models
  • Ampere architecture: broad CUDA software support

Cons

  • Moderate memory bandwidth: not the fastest for inference
  • 300W TDP: high power draw
  • No display output: headless only
  • May need aftermarket cooling solution

Community Verdict

No community reviews yet for the A40. Know a good review? Let us know.