Prices as of , and are subject to change. The price shown on the retailer’s site at the time of purchase is the one that applies.
Budget 24GBTesla P4024GB usablefrom $345Best low-cost route to 24GB. Advanced setup. Compare offers →Desktop PickRTX 309024GB usablefrom $1,500Fast, display-ready and broadly compatible. Compare offers →Speed PickRTX 409024GB usablefrom $2,074Top-tier consumer inference speed. Compare offers →
Default ranking: AI value. It balances usable VRAM, estimated generation speed, software compatibility, setup difficulty and current price. You can still sort by raw $/GB.
Retailer offer links are affiliate links. GPUDojo may earn a commission at no extra cost to you; commissions do not affect the ranking.
| GPU | Usable VRAM | Runs | Gen t/s | Setup | Best Price | $/usable GB | Offers |
|---|---|---|---|---|---|---|---|
| MI250X | 128GB | 70B+ | ~246 | Advanced | $3,632used | $28.38 | |
| H200 | 141GB | 70B+ | ~360 | Easy | $35,999used | $255.31 | |
| MI300X | 192GB | 70B+ | ~398 | Advanced | $34,530used | $179.84 | |
| Quadro RTX 8000 | 48GB | 70B+ | ~50 | Easy | $1,875used | $39.06 | |
| Tesla P100 | 16GB | 14-30B | ~55 | Advanced | $150used | $9.37 | |
| T4 | 16GB | 14-30B | ~24 | Advanced | $135new | $8.44 | |
| RTX PRO 6000 | 96GB | 70B+ | ~134 | Easy | $15,999new | $166.66 | |
| Tesla V100 32GB | 32GB | 30B+ | ~68 | Advanced | $845new | $26.41 | |
| Quadro RTX 5000 | 16GB | 14-30B | ~34 | Easy | $260used | $16.25 | |
| Data Center GPU Max 1100 | 48GB | 70B+ | ~92 | Moderate | $2,000used | $41.67 | |
| MI210 | 64GB | 70B+ | ~123 | Advanced | $4,299used | $67.17 | |
| Tesla P40 | 24GB | 30B+ | ~26 | Advanced | $345used | $14.38 | |
| A100 80GB | 80GB | 70B+ | ~153 | Advanced | $12,500used | $156.25 | |
| Quadro RTX 6000 | 24GB | 30B+ | ~50 | Easy | $925used | $38.54 | |
| Tesla V100 16GB | 16GB | 14-30B | ~68 | Advanced | $299used | $18.69 | |
| Titan RTX | 24GB | 30B+ | ~50 | Easy | $1,000used | $41.67 | |
| A6000 | 48GB | 70B+ | ~58 | Easy | $4,460used | $92.92 | |
| Radeon Pro W6800 | 32GB | 30B+ | ~38 | Moderate | $1,024new | $32.00 | |
| MI100 | 32GB | 30B+ | ~92 | Advanced | $1,299used | $40.59 | |
| GTX 1080 Ti | 11GB | 7-8B | ~36 | Easy | $160used | $14.54 | |
| RTX PRO 5000 | 48GB | 70B+ | ~101 | Easy | $6,800used | $141.67 | |
| RTX 2080 Ti | 11GB | 7-8B | ~46 | Easy | $250used | $22.73 | |
| GTX 1070 | 8GB | 7-8B | ~19 | Easy | $65used | $8.10 | |
| RTX 3090 | 24GB | 30B+ | ~70 | Easy | $1,500used | $62.50 | |
| A40 | 48GB | 70B+ | ~52 | Advanced | $4,000used | $83.33 | |
| RTX 3090 Ti | 24GB | 30B+ | ~76 | Easy | $1,800used | $75.00 | |
| RX 7900 XT | 20GB | 14-30B | ~60 | Moderate | $720used | $36.00 | |
| Tesla M40 | 24GB | 30B+ | ~22 | Advanced | $191used | $7.96 | |
| A100 40GB | 40GB | 30B+ | ~117 | Advanced | $5,045new | $126.12 | |
| RX 7900 XTX | 24GB | 30B+ | ~72 | Moderate | $1,220used | $50.83 | |
| Radeon Pro W7800 | 32GB | 30B+ | ~43 | Moderate | $1,699used | $53.09 | |
| RTX 4090 | 24GB | 30B+ | ~76 | Easy | $2,073new | $86.40 | |
| RTX 5060 Ti 16GB | 16GB | 14-30B | ~34 | Easy | $618new | $38.62 | |
| GTX 1080 | 8GB | 7-8B | ~24 | Easy | $99used | $12.38 | |
| Arc A770 16GB | 16GB | 14-30B | ~42 | Moderate | $330used | $20.62 | |
| Arc Pro B65 | 32GB | 30B+ | ~46 | Moderate | $1,400new | $43.75 | |
| Titan Xp | 12GB | 14B | ~41 | Easy | $300used | $25.00 | |
| RTX 3060 12GB | 12GB | 14B | ~27 | Easy | $325used | $27.08 | |
| RTX 3080 12GB | 12GB | 14B | ~68 | Easy | $550used | $45.83 | |
| RX 6800 | 16GB | 14-30B | ~38 | Moderate | $449used | $28.06 | |
| RTX 2070 | 8GB | 7-8B | ~34 | Easy | $175used | $21.88 | |
| RTX PRO 4000 | 24GB | 30B+ | ~50 | Easy | $1,931new | $80.45 | |
| RTX 5070 Ti | 16GB | 14-30B | ~67 | Easy | $995new | $62.19 | |
| GTX 1070 Ti | 8GB | 7-8B | ~19 | Easy | $100used | $12.50 | |
| RTX 3080 Ti | 12GB | 14B | ~68 | Easy | $580used | $48.33 | |
| RX 6900 XT | 16GB | 14-30B | ~38 | Moderate | $475used | $29.69 | |
| RTX 4080 | 16GB | 14-30B | ~54 | Easy | $920used | $57.50 | |
| L40S | 48GB | 70B+ | ~65 | Advanced | $6,599new | $137.48 | |
| A5000 | 24GB | 30B+ | ~58 | Easy | $2,200used | $91.67 | |
| RTX 5090 | 32GB | 30B+ | ~134 | Easy | $6,000used | $187.50 | |
| L40 | 48GB | 70B+ | ~65 | Advanced | $6,799used | $141.65 | |
| RTX 4070 Ti Super | 16GB | 14-30B | ~50 | Easy | $950used | $59.37 | |
| Titan V | 12GB | 14B | ~49 | Easy | $450used | $37.50 | |
| RTX 2060 Super | 8GB | 7-8B | ~34 | Easy | $195used | $24.38 | |
| Quadro RTX 4000 | 8GB | 7-8B | ~31 | Easy | $189used | $23.63 | |
| RTX 3080 | 10GB | 7-8B | ~57 | Easy | $400used | $40.00 | |
| RTX PRO 4500 | 32GB | 30B+ | ~67 | Easy | $4,450used | $139.06 | |
| RX 6800 XT | 16GB | 14-30B | ~38 | Moderate | $520used | $32.50 | |
| RX 7800 XT | 16GB | 14-30B | ~47 | Moderate | $575used | $35.94 | |
| RTX 2080 | 8GB | 7-8B | ~34 | Easy | $200used | $25.00 | |
| RTX 2070 Super | 8GB | 7-8B | ~34 | Easy | $201used | $25.12 | |
| RTX 4060 Ti 16GB | 16GB | 14-30B | ~22 | Easy | $650used | $40.63 | |
| A4000 | 16GB | 14-30B | ~34 | Easy | $850used | $53.13 | |
| RX 6950 XT | 16GB | 14-30B | ~43 | Moderate | $595used | $37.19 | |
| Arc Pro B70 | 32GB | 30B+ | ~46 | Moderate | $1,900new | $59.37 | |
| RTX 2080 Super | 8GB | 7-8B | ~37 | Easy | $230used | $28.75 | |
| Arc Pro B60 | 24GB | 30B+ | ~34 | Moderate | $950used | $39.58 | |
| RX 7600 XT | 16GB | 14-30B | ~22 | Moderate | $450used | $28.13 | |
| H100 PCIe | 80GB | 70B+ | ~150 | Advanced | $35,999used | $449.99 | |
| RTX 4080 Super | 16GB | 14-30B | ~55 | Easy | $1,220used | $76.25 | |
| RTX 4070 | 12GB | 14B | ~38 | Easy | $570new | $47.50 | |
| RX 7900 GRE | 16GB | 14-30B | ~43 | Moderate | $675used | $42.19 | |
| RTX 3070 Ti | 8GB | 7-8B | ~46 | Easy | $289used | $36.13 | |
| RX 6700 XT | 12GB | 14B | ~29 | Moderate | $330used | $27.50 | |
| RTX 3070 | 8GB | 7-8B | ~34 | Easy | $270used | $33.75 | |
| RTX 3060 Ti | 8GB | 7-8B | ~34 | Easy | $275used | $34.38 | |
| A30 | 24GB | 30B+ | ~70 | Advanced | $2,599used | $108.29 | |
| Arc B580 | 12GB | 14B | ~34 | Moderate | $300used | $25.00 | |
| RX 7700 XT | 12GB | 14B | ~32 | Moderate | $390used | $32.50 | |
| RX 9060 XT | 16GB | 14-30B | ~24 | Moderate | $600used | $37.50 | |
| RTX 5070 | 12GB | 14B | ~50 | Easy | $800used | $66.67 | |
| RTX 4070 Super | 12GB | 14B | ~38 | Easy | $700used | $58.33 | |
| RTX 4070 Ti | 12GB | 14B | ~38 | Easy | $715used | $59.58 | |
| Arc A750 | 8GB | 7-8B | ~38 | Moderate | $150used | $18.75 | |
| RX 9070 XT | 16GB | 14-30B | ~48 | Moderate | $900used | $56.25 | |
| RTX 5080 | 16GB | 14-30B | ~72 | Easy | $1,900used | $118.75 | |
| RX 6750 XT | 12GB | 14B | ~32 | Moderate | $440used | $36.66 | |
| RTX 2060 | 6GB | 7-8B | ~25 | Easy | $160used | $26.66 | |
| Arc A580 | 8GB | 7-8B | ~38 | Moderate | $175used | $21.88 | |
| MI50 | 16GB | 14-30B | ~77 | Advanced | $618new | $38.65 | |
| RTX 3060 | 8GB | 7-8B | ~18 | Easy | $260used | $32.50 | |
| Radeon Pro VII | 16GB | 14-30B | ~77 | Moderate | $750new | $46.88 | |
| RTX 4060 | 8GB | 7-8B | ~20 | Easy | $320new | $40.00 | |
| Tesla P4 | 8GB | 7-8B | ~14 | Advanced | $172new | $21.54 | |
| RX 6600 | 8GB | 7-8B | ~17 | Moderate | $215used | $26.87 | |
| RX 6600 XT | 8GB | 7-8B | ~19 | Moderate | $230used | $28.75 | |
| RTX 4060 Ti | 8GB | 7-8B | ~22 | Easy | $400used | $50.00 | |
| A10 | 24GB | 30B+ | ~45 | Advanced | $3,999used | $166.63 | |
| Arc A770 8GB | 8GB | 7-8B | ~38 | Moderate | $270used | $33.75 | |
| RX 7600 | 8GB | 7-8B | ~22 | Moderate | $270used | $33.75 | |
| RX 6650 XT | 8GB | 7-8B | ~21 | Moderate | $270used | $33.75 | |
| L4 | 24GB | 30B+ | ~23 | Advanced | $3,950new | $164.58 | |
| Tesla K80 | 12GB of 24GB board | 14B | ~36 | Avoid | $55used | $4.58 |