AMD RX 6700 XT - 12GB usable

Specifications

BrandAMD
ModelRX 6700 XT
Usable VRAM12GB
ArchitectureRDNA2
CUDA / Stream Processors2,560
Memory Bandwidth384 GB/s
TDP230W
FP32 TFLOPS13.2

Current Offers

Used from 290

Prices last updated:

GPUDojo is reader-supported. When you buy through links on our site, we may earn an affiliate commission.

Price History

  • eBay290near high
Mar 13May 15Jul 3Jul 31Aug 28Sep 4220275

For AI / LLM Use

Entry-level for local AI. Handles 7B-8B models well. Slower generation, usable but not snappy. Verify ROCm support for the exact framework and operating system you plan to use.

What Models Can It Run?

  • 14B Q4_K_M, 7B full precision
  • 7B Q6_K, 14B Q3_K (tight)
  • 7B Q4_K_M only

Estimated Performance

Generation: ~29 tokens/sec

Prefill: ~236 tokens/sec

Recommended Quantisations

  • Q4_K_M for 14B (tight fit)
  • Q6_K or Q8 for 7B models

Pros & Cons

Pros

  • RDNA2 architecture: supported by current ROCm stacks
  • Consumer card: easy to install, display output

Cons

  • 12GB usable VRAM: may need quantization for 30B+ models
  • Moderate memory bandwidth: not the fastest for inference
  • ROCm and CUDA-first framework compatibility should be checked before purchase

Community Verdict

No community reviews yet for the RX 6700 XT. Know a good review? Let us know.