NVIDIA A100 40GB - 40GB usable
Specifications
| Brand | NVIDIA |
|---|---|
| Model | A100 40GB |
| Usable VRAM | 40GB |
| Architecture | Ampere |
| CUDA / Stream Processors | 6,912 |
| Memory Bandwidth | 1555 GB/s |
| TDP | 250W |
| FP32 TFLOPS | 19.5 |
Current Offers
Used from $6,500New from $5,045
Prices last updated:
GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.
Lowest tracked offers by retailer
US · USD · Weekly since Aug 2026 · Shipping may be extra
About these prices
Each line is the lowest offer we tracked from that retailer at weekly snapshots, ending at today's offer. The condition can vary between snapshots (new, used, or unrecorded for older ones). eBay prices exclude shipping. Tax is excluded. Amazon shows a current price only.
Weekly offers table
| Date | eBay | Amazon | Newegg |
|---|---|---|---|
| Today, Nov 3, 2026 | $6,500.00 | $5,044.99 | – |
| Oct 30, 2026 | $5,995.00 | – | – |
| Oct 23, 2026 | $4,495.00 | – | – |
| Oct 9, 2026 | $4,495.00 | – | $6,599.00 |
| Oct 2, 2026 | $3,500.00 | – | $5,999.00 |
| Sep 25, 2026 | $4,495.00 | – | $5,599.00 |
| Sep 18, 2026 | $4,495.00 | – | $5,599.00 |
| Sep 11, 2026 | $3,799.99 | – | $5,599.00 |
| Sep 4, 2026 | – | – | $5,599.00 |
| Sep 1, 2026 | – | – | $4,599.00 |
| Aug 28, 2026 | – | – | $4,599.00 |
| Aug 21, 2026 | – | – | $4,745.00 |
For AI / LLM Use
Solid choice for 30B models and comfortable 14B inference. Very fast generation speed. Datacenter card with no display output, may need aftermarket cooling.
What Models Can It Run?
- 30B Q6_K, 70B Q2_K
- 30B Q4_K_M, 14B full precision, 70B Q2 (tight)
- 14B Q6_K, 30B Q3_K (tight)
- 14B Q4_K_M, 7B full precision
- 7B Q6_K, 14B Q3_K (tight)
- 7B Q4_K_M only
Estimated Performance
Generation: ~117 tokens/sec
Prefill: ~348 tokens/sec
Recommended Quantisations
- Q4_K_M recommended for 30B models
- Q6_K or Q8 for 14B and below
- Full precision for 7B
Pros & Cons
Pros
- 40GB usable VRAM: handles large models
- High memory bandwidth for fast generation
- Ampere architecture: broad CUDA software support
Cons
- No display output: headless only
- May need aftermarket cooling solution
Community Verdict
No community reviews yet for the A100 40GB. Know a good review? Let us know.