Can I run this LLM?
Can your computer run 1-bit Bonsai 27B?
Bonsai · Apache 2.0
Memory & fit
Needs about 4.9 GB of memory at its smallest quantization (4K context). It runs on 87 of 88 tracked machines.
Only the shipped native packs are available. An Arena reference does not measure these local weights unless exact tested evidence is available. The trained context limit is 256K tokens. These estimates use 4K context.