A deep dive into olama AI models on docker with promox dual GPU virtualisation

In this video, we deep dive into using Olama on Ubuntu with multiple P100 GPUS as well as how we can utilize and test different LLM models, we also take a look at how to debug a few issues when it comes to utilizing the different models and different optimization we can make to make the models return output a faster response