Prices as of , and are subject to change. The price shown on the retailer's site at the time of purchase is the one that applies.
Budget 24GBTesla P4024GB usablefrom $239Best low-cost route to 24GB. Advanced setup. Compare offers →Desktop PickRTX 309024GB usablefrom $1570Fast, display-ready and broadly compatible. Compare offers →Speed PickRTX 409024GB usablefrom $2074Top-tier consumer inference speed. Compare offers →
Default ranking: AI value. It balances usable VRAM, estimated generation speed, software compatibility, setup difficulty and current price. You can still sort by raw $/GB.
Retailer offer links are affiliate links. GPUDojo may earn a commission at no extra cost to you; commissions do not affect the ranking.
| GPU | Usable VRAM | Runs | Gen t/s | Setup | Best price | $/usable GB | Offers |
|---|---|---|---|---|---|---|---|
| MI300X | 192GB | 70B+ | ~398 | Advanced | $19000used | $98.96 | |
| Tesla P100 | 16GB | 14-30B | ~55 | Advanced | $80used | $5.00 | |
| H200 | 141GB | 70B+ | ~360 | Easy | $38599used | $273.75 | |
| Quadro RTX 8000 | 48GB | 70B+ | ~50 | Easy | $1975used | $41.15 | |
| Tesla V100 32GB | 32GB | 30B+ | ~68 | Advanced | $650used | $20.31 | |
| RTX PRO 6000 | 96GB | 70B+ | ~134 | Easy | $14500new | $151.04 | |
| Tesla P40 | 24GB | 30B+ | ~26 | Advanced | $239used | $9.96 | |
| Quadro RTX 5000 | 16GB | 14-30B | ~34 | Easy | $260used | $16.25 | |
| MI100 | 32GB | 30B+ | ~92 | Advanced | $880used | $27.50 | |
| MI210 | 64GB | 70B+ | ~123 | Advanced | $4299used | $67.17 | |
| Quadro RTX 6000 | 24GB | 30B+ | ~50 | Easy | $880used | $36.67 | |
| Titan RTX | 24GB | 30B+ | ~50 | Easy | $880used | $36.67 | |
| Titan Xp | 12GB | 14B | ~41 | Easy | $150used | $12.50 | |
| A6000 | 48GB | 70B+ | ~58 | Easy | $3900used | $81.25 | |
| GTX 1080 | 8GB | 7-8B | ~24 | Easy | $52used | $6.56 | |
| MI50 | 16GB | 14-30B | ~77 | Advanced | $150used | $9.37 | |
| RX 7900 XTX | 24GB | 30B+ | ~72 | Moderate | $790used | $32.92 | |
| Radeon Pro W7900 | 48GB | 70B+ | ~65 | Moderate | $3000used | $62.50 | |
| Titan V | 12GB | 14B | ~49 | Easy | $229used | $19.08 | |
| RTX 3090 Ti | 24GB | 30B+ | ~76 | Easy | $1500used | $62.50 | |
| RTX 3090 | 24GB | 30B+ | ~70 | Easy | $1570new | $65.42 | |
| Radeon Pro W6800 | 32GB | 30B+ | ~38 | Moderate | $1300used | $40.63 | |
| GTX 1080 Ti | 11GB | 7-8B | ~36 | Easy | $185new | $16.82 | |
| RX 6800 | 16GB | 14-30B | ~38 | Moderate | $345used | $21.56 | |
| RTX 3080 12GB | 12GB | 14B | ~68 | Easy | $430used | $35.83 | |
| A100 40GB | 40GB | 30B+ | ~117 | Advanced | $4627new | $115.67 | |
| RTX 3080 Ti | 12GB | 14B | ~68 | Easy | $450used | $37.50 | |
| RX 7900 XT | 20GB | 14-30B | ~60 | Moderate | $720used | $36.00 | |
| A40 | 48GB | 70B+ | ~52 | Advanced | $4600used | $95.83 | |
| A100 80GB | 80GB | 70B+ | ~153 | Advanced | $21999new | $274.99 | |
| Arc A770 16GB | 16GB | 14-30B | ~42 | Moderate | $300used | $18.75 | |
| RTX PRO 5000 | 48GB | 70B+ | ~101 | Easy | $9000new | $187.50 | |
| RTX 2080 Ti | 11GB | 7-8B | ~46 | Easy | $320new | $29.09 | |
| RX 6800 XT | 16GB | 14-30B | ~38 | Moderate | $380used | $23.75 | |
| RTX 5090 | 32GB | 30B+ | ~134 | Easy | $4850used | $151.56 | |
| Radeon Pro W7800 | 32GB | 30B+ | ~43 | Moderate | $1699new | $53.09 | |
| RTX 4090 | 24GB | 30B+ | ~76 | Easy | $2073new | $86.40 | |
| RTX 5060 Ti 16GB | 16GB | 14-30B | ~34 | Easy | $618new | $38.62 | |
| RTX 4080 | 16GB | 14-30B | ~54 | Easy | $820used | $51.25 | |
| RTX 4070 Ti Super | 16GB | 14-30B | ~50 | Easy | $800used | $50.00 | |
| L40S | 48GB | 70B+ | ~65 | Advanced | $5999new | $124.98 | |
| RX 6950 XT | 16GB | 14-30B | ~43 | Moderate | $475used | $29.69 | |
| RX 7800 XT | 16GB | 14-30B | ~47 | Moderate | $500used | $31.25 | |
| T4 | 16GB | 14-30B | ~24 | Advanced | $423used | $26.44 | |
| RTX 5070 Ti | 16GB | 14-30B | ~67 | Easy | $995new | $62.19 | |
| GTX 1070 Ti | 8GB | 7-8B | ~19 | Easy | $100used | $12.50 | |
| Quadro RTX 4000 | 8GB | 7-8B | ~31 | Easy | $170used | $21.25 | |
| Tesla M40 | 24GB | 30B+ | ~22 | Advanced | $229used | $9.55 | |
| L40 | 48GB | 70B+ | ~65 | Advanced | $6499used | $135.40 | |
| H100 PCIe | 80GB | 70B+ | ~150 | Advanced | $28000used | $350.00 | |
| RTX 3060 12GB | 12GB | 14B | ~27 | Easy | $380new | $31.66 | |
| RTX PRO 4500 | 32GB | 30B+ | ~67 | Easy | $4280used | $133.75 | |
| RTX 2060 Super | 8GB | 7-8B | ~34 | Easy | $190used | $23.75 | |
| RTX 4080 Super | 16GB | 14-30B | ~55 | Easy | $980used | $61.25 | |
| GTX 1070 | 8GB | 7-8B | ~19 | Easy | $109new | $13.63 | |
| RX 7900 GRE | 16GB | 14-30B | ~43 | Moderate | $535used | $33.44 | |
| RTX 3070 Ti | 8GB | 7-8B | ~46 | Easy | $230used | $28.75 | |
| RX 7600 XT | 16GB | 14-30B | ~22 | Moderate | $389used | $24.31 | |
| A4000 | 16GB | 14-30B | ~34 | Easy | $800used | $50.00 | |
| RTX 4060 Ti 16GB | 16GB | 14-30B | ~22 | Easy | $650used | $40.63 | |
| A5000 | 24GB | 30B+ | ~58 | Easy | $2414new | $100.58 | |
| RTX PRO 4000 | 24GB | 30B+ | ~50 | Easy | $2299used | $95.79 | |
| RTX 4070 | 12GB | 14B | ~38 | Easy | $498used | $41.50 | |
| RTX 3080 | 10GB | 7-8B | ~57 | Easy | $430new | $43.00 | |
| RX 9060 XT | 16GB | 14-30B | ~24 | Moderate | $450used | $28.12 | |
| RTX 2080 Super | 8GB | 7-8B | ~37 | Easy | $230new | $28.75 | |
| RTX 2070 | 8GB | 7-8B | ~34 | Easy | $220new | $27.50 | |
| RTX 2070 Super | 8GB | 7-8B | ~34 | Easy | $235new | $29.37 | |
| RX 9070 XT | 16GB | 14-30B | ~48 | Moderate | $700used | $43.75 | |
| RTX 2080 | 8GB | 7-8B | ~34 | Easy | $240new | $30.00 | |
| RTX 5080 | 16GB | 14-30B | ~72 | Easy | $1450used | $90.62 | |
| RTX 4070 Ti | 12GB | 14B | ~38 | Easy | $600used | $50.00 | |
| RTX 5070 | 12GB | 14B | ~50 | Easy | $700used | $58.33 | |
| RX 6750 XT | 12GB | 14B | ~32 | Moderate | $344used | $28.66 | |
| RTX 4070 Super | 12GB | 14B | ~38 | Easy | $650used | $54.16 | |
| RX 6900 XT | 16GB | 14-30B | ~38 | Moderate | $719new | $44.94 | |
| A30 | 24GB | 30B+ | ~70 | Advanced | $2599used | $108.29 | |
| RX 6700 XT | 12GB | 14B | ~29 | Moderate | $355new | $29.58 | |
| RTX 3060 Ti | 8GB | 7-8B | ~34 | Easy | $280used | $35.00 | |
| RTX 3070 | 8GB | 7-8B | ~34 | Easy | $280new | $35.00 | |
| RX 7700 XT | 12GB | 14B | ~32 | Moderate | $400used | $33.33 | |
| RTX 3060 | 8GB | 7-8B | ~18 | Easy | $240used | $30.00 | |
| Arc A750 | 8GB | 7-8B | ~38 | Moderate | $180used | $22.50 | |
| Arc A580 | 8GB | 7-8B | ~38 | Moderate | $182new | $22.77 | |
| RTX 4060 | 8GB | 7-8B | ~20 | Easy | $290used | $36.25 | |
| RTX 4060 Ti | 8GB | 7-8B | ~22 | Easy | $300used | $37.50 | |
| RTX 2060 | 6GB | 7-8B | ~25 | Easy | $190new | $31.66 | |
| RX 6600 XT | 8GB | 7-8B | ~19 | Moderate | $189used | $23.63 | |
| Tesla P4 | 8GB | 7-8B | ~14 | Advanced | $150new | $18.75 | |
| A10 | 24GB | 30B+ | ~45 | Advanced | $3500used | $145.83 | |
| RX 6650 XT | 8GB | 7-8B | ~21 | Moderate | $230used | $28.74 | |
| Arc A770 8GB | 8GB | 7-8B | ~38 | Moderate | $240used | $30.00 | |
| RX 7600 | 8GB | 7-8B | ~22 | Moderate | $265used | $33.12 | |
| L4 | 24GB | 30B+ | ~23 | Advanced | $3395new | $141.46 | |
| RX 6600 | 8GB | 7-8B | ~17 | Moderate | $290new | $36.25 | |
| Tesla K80 | 12GB of 24GB board | 14B | ~36 | Avoid | $60used | $5.00 |