VRAM fit

Will it fit?

Pick a model, a quantization and a context length. The page works out the memory it needs — weights, KV cache, overhead — and tells you whether it fits the card or Mac you have.

 
 
Weights0 
KV cache0 
Overhead0estimate
Total0 
Usable0 

 

Sources & method