And no i do not have the privilege of running a local model. I have heard of a AI called Maple and tried it out, it was pretty limited to the point that it was a deal breaker (25 messages per week cap). I would like to know more services

  • stupid_asshole69 [none/use name]@hexbear.netEnglish
    3·
    2 days ago

    No.

    The hardware needed to host even just a full size gpt3 costs tens of thousands of dollars, requires high current or high voltage circuits not usually accessible in residential homes and will actually use multiple thousands of watts of power.

    If someone is giving access to such an expensive, power hungry industrial system for free they’re either doing it to learn from the inputs (not private) or don’t have a commercially viable system (not good).

  • floquant@lemmy.dbzer0.com
    5·
    3 days ago

    Paid commercial LLM providers already profit off of inputs more than outputs, so I wouldn’t trust any free cloud offering to be private. If you really want free and private, self-hosted is the only way to go

  • PiraHxCx@lemmy.mlEnglish
    7·
    3 days ago

    Lumo by Proton is private and free, however, it’s not very good (at least on free tier).
    Duck.ai claims to be private, but you can never trust an American company on that.

  • Trent@lemmy.mlEnglish
    6·
    3 days ago

    OpenRouter has some decently powerful free-to-use models, but I’m afraid as far as LLMs go ‘free’, ‘good’, and ‘private’ are going to be pretty mutually exclusive if you can’t run one locally.