VRAM fit
Will it fit?
Pick a model, a quantization and a context length. The page works out the memory it needs — weights, KV cache, overhead — and tells you whether it fits the card or Mac you have.
Weights0
KV cache0
Overhead0estimate
Total0
Usable0
Sources & method