AI Projects
I Tested Ternary Bonsai 27B Locally on an RTX 4090
My Ternary Bonsai 27B test on an RTX 4090 reached 83-85 tokens/s with 7.8 GB extra VRAM, solid JSON, document work and tool calling…
Explore the archive
My Ternary Bonsai 27B test on an RTX 4090 reached 83-85 tokens/s with 7.8 GB extra VRAM, solid JSON, document work and tool calling…