Can I run this LLM?
Can your computer run Ternary Bonsai 2 27B?
Bonsai · Apache 2.0
Memory & fit
Needs about 7.0 GB of memory at its smallest quantization (4K context). It runs on 81 of 88 tracked machines.
Requires the vendor's llama.cpp fork; stock runtime support is not assumed.
Only the shipped native packs are available. An Arena reference does not measure these local weights unless exact tested evidence is available. The trained context limit is 256K tokens. These estimates use 4K context.