You subscription is about to go up.

I'm going to start looking into alternative solutions ;)

Anyone have a solid alternative solution for local streaming?

Nice, My current PC uses DDR4 Time to dust off my 2012 PC and put Linux on it.

I like AI to figure out complex issue or something I would just find on stackoverflow. It's great for doing boiler plate crap that I don't want to do anyways. But when you need it to do something that it hasn't found in a git repo, it struggles.

If I'm understanding this right. I can train it on private data only for my company and then I can use the chat bot only for my site to acquire customers?

You could! We have a number of users who do something like that (e.g. Ramp's in-app chat bot is powered by Onyx)

LM Studio?

Yes, because LM Studio is openai-compatible. When you run rowboatx the first time, it creates a ~/.rowboat/config/models.json. You can then configure LM Studio there. Here is an example: https://gist.github.com/ramnique/9e4b783f41cecf0fcc8d92b277d...

API, Please make an API? I could integrate my RSVP system into it which requires more specific features but could use this to create the base for the event.

You need an API for creating events?

Yes, I would piggyback on to the base event which would be created, which would allow me to build out my extra features which need a base event.

API's are always a good thing, weather they are private or not.

Not the person who asked for it, but I think they were suggesting they'd use the API to retrieve information about RSVPs/current state of a planned event. (Perhaps even RSVP on someone else's behalf.)

Cool, can you make it use local free models because I'm broke and can't afford AI's crazy costs.

Yep, change nothing in the code in the article but spin up an Ollama server and use the OpenAI API https://docs.ollama.com/api/openai-compatibility.

Any way to access this with python so I can use it programmatically?

This isn't run using Python, but also no

No