A few days ago, I came across a blog post titled On FLOSS and training LLMs that articulates a growing frustration within the free and open source software…
Not true, try to selfhost your own and you will see his much it eats just to chat with it. Using just 3b model eat like 200 watts of power. Use it for an hour an you are eating as much as some laptops eat in a day while surfing. Of course if you are compare with gaming, it may be comparable with heavy games but then again that is also using a lot of power.
Not true, try to selfhost your own and you will see his much it eats just to chat with it. Using just 3b model eat like 200 watts of power. Use it for an hour an you are eating as much as some laptops eat in a day while surfing. Of course if you are compare with gaming, it may be comparable with heavy games but then again that is also using a lot of power.