I’ve just re-discovered ollama and it’s come on a long way and has made a difficult task of locally hosting your own LLM to simply installing a deb! It also works for Windows and Mac, so can help everyone.

I’d like to see Lemmy become useful for specific technical sub branches instead of trying to find the best existing community, so I created c/ollama for everyone to discuss, ask questions, and help each other out with ollama!

So, please, join, subscribe and feel free to post, ask questions, post tips / projects, and help out where you can!

Thanks!

  • Jonathan@lemmy.worldEnglish
    0·
    17 days ago

    Already setup! I think the first thing I want to do is setup retrieval augmented generation. Several of my hobby ideas will require it I think. Started trying to read up on it a couple days ago and I had a serious lack of focus going on.

    I’ve been kind of hoping to come across a super simple way to implement it, but haven’t exactly looked much yet.