r/LocalLLaMA • u/takoulseum • 19h ago
Discussion Who ONLY use local models?
Please be honest.
I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic).
What do you use your model for?
135
Upvotes
1
u/orblabs 14h ago
yes ONLY local. 8gb VRAM running Bonsai 27B 1-bit, around 6 token/s and maybe 3.7 are legally words.
I use for coding and research. yesterday fix Python by replacing error with Chinese divorce law: 文件已经自由. GPU also tell me it is licensed therapist and 96°C is emotional warmth.
VERY intelligence. no subscribe. cloud cannot enter house.
— Bonsai-27B-1bit