FreeBSD: running a Large Language Model with ollama

In this video I will install ollama in FreeBSD and explore how to use two Large Language Models - Mistra and Llama3.2.
For additional models, check the following webpage: ollama.com/lib...
#FreeBSD #Unix #BSD #LLM #opensource

[@RoboNuggie]

This was very interesting...... thank you!

[@BSDJedi]

My only issue is the lack of time for making the videos; if it were me, I would be doing them all the time 🙂
BTW, did you catch the LLM hallucinating? It says that FreeBSD was first released in the year 2000.... yeah... sure... hahahaha

[@GokhanKaya]

Thank you for the great video.
Does this mean we can run our own AI at home server?

[@BSDJedi]

Hi. Yes, you can run your own AI model in your home server with ollama. I heard it can even run on a RPi, but I did not try this. Problem, though, is that it might require a beefy video card, if you want the model to run at any usable speed...
Cheers :-)

[@daGraveR]

13:30 Yeah, I'm sure FreeBSD was first released in 2000 and not 1993... 😬

[@BSDJedi]

AI has hallucinations FTW... 🤣

[@jondycz]

Ollama isn't by Meta. Llama is.

[@BSDJedi]

Thanks for clarification. I will update the cover ASAP… Cheers :-)