And no i do not have the privilege of running a local model. I have heard of a AI called Maple and tried it out, it was pretty limited to the point that it was a deal breaker (25 messages per week cap). I would like to know more services
You must log in or register to comment.
No.
The hardware needed to host even just a full size gpt3 costs tens of thousands of dollars, requires high current or high voltage circuits not usually accessible in residential homes and will actually use multiple thousands of watts of power.
If someone is giving access to such an expensive, power hungry industrial system for free they’re either doing it to learn from the inputs (not private) or don’t have a commercially viable system (not good).
Paid commercial LLM providers already profit off of inputs more than outputs, so I wouldn’t trust any free cloud offering to be private. If you really want free and private, self-hosted is the only way to go
Lumo by Proton is private and free, however, it’s not very good (at least on free tier).
Duck.ai claims to be private, but you can never trust an American company on that.OpenRouter has some decently powerful free-to-use models, but I’m afraid as far as LLMs go ‘free’, ‘good’, and ‘private’ are going to be pretty mutually exclusive if you can’t run one locally.
Seems like a cool product. I will check it out
z.ai is kind of good, but i dont think it is private
Venice.ai is an uncensored model which is free and needs no account. Not sure if it’s truly private though.
