AMD RX 6700 XT - 12GB usable

Specifications

BrandAMD
ModelRX 6700 XT
Usable VRAM12GB
ArchitectureRDNA2
CUDA / Stream Processors2,560
Memory Bandwidth384 GB/s
TDP230W
FP32 TFLOPS13.2

Current Offers

No fresh used offer today · recently $275 on eBayNew from $310

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Price History

  • eBayno current offer
  • Amazon$355current
  • Newegg$310near low
Mar 13Apr 17May 22Jul 3Aug 7Sep 4$345$310$288$275$355

For AI / LLM Use

Entry-level for local AI. Handles 7B-8B models well. Slower generation, usable but not snappy. Verify ROCm support for the exact framework and operating system you plan to use.

What Models Can It Run?

  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~29 tokens/sec

Prefill: ~236 tokens/sec

Recommended Quantisations

  • Q4_K_M for 14B (tight fit)
  • Q6_K or Q8 for 7B models

Pros & Cons

Pros

  • RDNA2 architecture: supported by current ROCm stacks
  • Consumer card: easy to install, display output

Cons

  • 12GB usable VRAM: may need quantization for 30B+ models
  • Moderate memory bandwidth: not the fastest for inference
  • ROCm and CUDA-first framework compatibility should be checked before purchase

Community Verdict

No community reviews yet for the RX 6700 XT. Know a good review? Let us know.