วีดีโอ

KubeAI, private Open AI on K8s: github.com/substratusai/kubeai Tutorial with copy pasteable steps: github.com/substratusai/kubeai/blob/main/docs/tutorials/weaviate.md Learn how to deploy Weaviate, Embedding and Generate models all within the same K8s cluster. It works on both CPU or GPU, but in the tutorial CPU is used.

Live demo that shows how to deploy an end-to-end Retrieval Augmented Generation stack including the LLM and Embedding Server on top of any K8s cluster. Lingo as the model proxy and autoscaler: github.com/substratusai/lingo Verba as the RAG application: github.com/weaviate/Verba Weaviate as the Vector DB: github.com/weaviate/weaviate Mistral-7B-Instruct-v2 as the LLM STAPI with MiniLM-L6-v2 as t...

Lingo, open source ML Proxy and autoscaler for K8s: github.com/substratusai/lingo Blog post with copy pasteable instructions: www.substratus.ai/blog/deploying-mixtral-gptq-on-gke-l4-gpus Learn how to deploy Mixtral on GKE using just 2 x L4 24 GB GPUs. We do this by using GPTQ which loads Mixtral on 4 bit mode. 0:00 - Introduction 0:12 - Calculating GPU memory required for Mixtral with GPTQ 1:40...

Blog post: www.substratus.ai/blog/kind-with-gpus 0:00 Intro 0:18 Fun background on the PR that wasn't needed 2:28 Step by step tutorial using the blog post to configure kind with support 8:00 Verifying we can create a GPU pod

Github repo: github.com/substratusai/substratus Try it yourself: www.substratus.ai/docs/quickstart Substratus.ai lets you deploy and finetune Open Source LLMs without needing to write. Substratus itself is free and open source. Currently only supports GCP, want it on another cloud provider? Let us know! Book a session with me to get it up and running in your environment: topmate.io/samos123

Prevent privileged pods from being created to improve security of your K8s cluster. This video shows how to do this using Pod Security Admission/Standards through a fun hands-on screenshare with explanations. Blog post: samos-it.com/posts/Preventing-Privileged-pods-using-Pod-Security-Admission-Standards.html Content 0:00 Introduction 1:42 Background on Pod Security Standards and Admission 2:43 ...

Blog post with copy paste able instructions: samos-it.com/posts/chatgpt-python-using-an-unofficial-library.html Library used: github.com/acheong08/ChatGPT This video shows how to use one of the unofficial Python libraries for ChatGPT. You can use this to incorporate ChatGPT in your personal project until ChatGPT releases an official library. Content: 00:00 Introduction 00:16 Setting up virtuale...

Can't sit inside all day when it rains. Umbrellas and a game of tag while taking shelter in the Hayward Japanese Garden.

Live demo trying out the new Validating Admission Policy fom K8s 1.26 which is also known as CEL admission policy. Commands can be copy pasted from blog: samos-it.com/posts/trying-cel-admission-control-validation-admission-policy.html Outline: 0:00 Introduction and agenda 0:22 Creating a K8s 1.26 cluster using minikube with ValidatingAdmissionPolicy enabled 1:27 Creating a ValidatingAdmissionPo...

Deploying K8s on your laptop with Minikube - Hands-on lab / screenshare

K8s Migrating from PSP to PSA with pspmigrator and mutating PSPs

K8s Migrating from PSP to PSA with mutating PSP

K8s Migrating from PSP to PSA - easy and fast path

Live demo to learn What is Network Address Translation (NAT)?

K8s GKE Pod Conatiner Networking and ip-masq-agent deep-dive

PSPMigrator Demo - Migrating from PSP to PSA CLI tool

Seattle airport landing

Arthurx at Fremont Slap Face Coffee Open Mic

Openstack node install with Fuel stuck on partitioner