- 344
- 91 387
Cloud Native Rejekts
Germany
เข้าร่วมเมื่อ 31 พ.ค. 2019
Deep dive: Collect and process your logs on K8s with Opentelemetry Collector
In this session, the speaker will dive into the problem of log collection and processing in Kubernetes environments. Despite there are many tools and projects that one can use to collect logs from k8s environments, not all the details are always covered and well understood.
The speaker will explore how different container runtimes can produce different log formats and what operations are required in order to extract useful information from them. With this session, the speaker will present how a complex set of operations required, can be simplified by using the Opentelemetry Collector's native support for container logs' parsing and how this can play along with logs coming from instrumented applications. In addition, the speaker will run a live demo for some common scenarios to illustrate how OpenTelemetry ecosystem aims to make k8s logs' collection and processing robust and easy.
Last but not least, as an active contributor, the speaker will share the latest project's updates (and what is coming next) providing the audience with a clearer understanding of the ideal logs processing landscape and inspire individuals to actively participate in the ongoing efforts within the OpenTelemetry ecosystem.
---
Speaker: Christos Markou
---
The speaker will explore how different container runtimes can produce different log formats and what operations are required in order to extract useful information from them. With this session, the speaker will present how a complex set of operations required, can be simplified by using the Opentelemetry Collector's native support for container logs' parsing and how this can play along with logs coming from instrumented applications. In addition, the speaker will run a live demo for some common scenarios to illustrate how OpenTelemetry ecosystem aims to make k8s logs' collection and processing robust and easy.
Last but not least, as an active contributor, the speaker will share the latest project's updates (and what is coming next) providing the audience with a clearer understanding of the ideal logs processing landscape and inspire individuals to actively participate in the ongoing efforts within the OpenTelemetry ecosystem.
---
Speaker: Christos Markou
---
มุมมอง: 134
วีดีโอ
Migrating Distributed Systems Infrastructure to a Serverless Model: Methodology and Insights
มุมมอง 182 หลายเดือนก่อน
In a long running distributed service, time takes a toll, tech debt eats at it. Rising tech debt causes fear of augmenting the system with new features, and inevitably leads to heavy ops, and starts taking a toll on maintenance. In this talk, I present a real example of how Azure Cloud Shell addressed a large tech debt by migrating from a self-managed K8s to a managed serverless infrastructure,...
Building Kubectl Plugins Like A Pro
มุมมอง 2062 หลายเดือนก่อน
Let’s talk about how to build idiomatic CLI tools that look and feel like kubectl, using the libraries and techniques from SIG CLI. In this talk, we’ll also talk about Krew kubectl plugin manager (a SIG CLI project) and showcase some useful popular plugins. Speaker: Ahmet Balkan
Scaling Private LLM Model Services with Kserve and Modelcar OCI: A Real-World Implementation
มุมมอง 762 หลายเดือนก่อน
Deploying large language models (LLMs) is inherently complex, challenging, and expensive. This case study demonstrates how Kubernetes, specifically Kserve with Modelcar OCI storage backend, simplifies the deployment and management of private LLM services. First, we explore how Kserve enables efficient and scalable model serving within a Kubernetes environment, allowing seamless integration and ...
Maximising Microservice Databases with Kubernetes, Postgres, and CloudNativePG
มุมมอง 2372 หลายเดือนก่อน
Ready to rethink how you handle databases in your microservices? This talk dives into how pairing PostgreSQL with Kubernetes through CloudNativePG can help you break free from vendor lock-in and streamline your database workflows. We’ll cover practical tips on continuous delivery, database changes, and security-all designed to help your team move faster and work smarter. Speaker: Gabriele Barto...
Abstracting Kubernetes: How Intuit is Migrating Services to a Simplified, Abstracted Paved Road
มุมมอง 1472 หลายเดือนก่อน
Are you grappling with the complexities of managing K8s for your application developers? Join us for an insightful session where we share how Intuit has evolved and abstracted its platform and the journey toward migrating 1k services to the abstracted paved road. At Intuit, developers spent more time on infrastructure configuration than coding, and adding to standardization drift. To address th...
Malicious Compliance Automated: When You Have 4000 Vulnerabilities and only 24 Hours Before Release
มุมมอง 802 หลายเดือนก่อน
You know that feeling when you think are done, but then you realize you are not even close and you don't have time to do anything about it? In this talk we'll go on a journey with a developer, who just finished his application. He's happy because he's done early and there's still 24 hours before the application has to be released, but then he learns that he has 4000 vulnerabilities in his appli...
Have Half The Mesh With Half The Mess
มุมมอง 712 หลายเดือนก่อน
Have you ever wanted to enjoy the benefits of a service mesh but didn't want to deal with all the overhead? Projects Linkerd, Knative, and Istio are all highly capable and advanced platforms! But they come with non-trivial installation and management burdens. What if you could leverage some of the features and power of a service mesh without the overhead? Good news: you can! This talk will show...
Welcome to Cloud Native Rejekts NA 2024 in Salt Lake City!
มุมมอง 122 หลายเดือนก่อน
Opening Remarks Speaker: Benazir Khan Cloud Native Rejekts NA 2024 Salt Lake City, Utah November 10-11, 2024 Website: cloud-native.rejekts.io/
Platforms Need AI Copilots
มุมมอง 192 หลายเดือนก่อน
Your team wastes hours each day constructing sequences of operations to accomplish tasks. Foyle is an AI that translates an operator’s high level intent (e.g. deploy this python code on a GPU) into a sequence of operations (e.g. kubectl commands). Foyle learns this translation automatically, reducing the need for platform teams to create handcrafted tools. Foyle is an open source AI (foyle.io)....
Building an Open Source Observability Stack from Raw Telemetry
มุมมอง 1322 หลายเดือนก่อน
This session will guide you through the process of building a complete observability stack from the ground up using raw telemetry data ingested directly into a datastore, combining a variety of open source signals including OpenTelemetry and Prometheus formats. We’ll start by leveraging our existing telemetry - likely logs and metrics - for maximum effectiveness - because telemetry without acti...
Ten years of Kubernetes: Building the future
มุมมอง 582 หลายเดือนก่อน
Join Lachlan as he recounts the transformative journey through the last decade of cloud native open source. From humble beginnings, we’ll retrace the milestones from the creation of the CNCF to the explosive growth of the cloud native landscape, fortified by strong communities supporting the biggest open source projects in the world. We'll conclude by discussing how cloud native is powering the...
The Untold Story of Unikernels and WASM
มุมมอง 1122 หลายเดือนก่อน
The Untold Story of Unikernels and WASM
Debug Like a Pro: Ephemeral Containers and Wolfi Linux in Action
มุมมอง 392 หลายเดือนก่อน
Debug Like a Pro: Ephemeral Containers and Wolfi Linux in Action
Evaluating runtime threat detection strategies in Kubernetes
มุมมอง 322 หลายเดือนก่อน
Evaluating runtime threat detection strategies in Kubernetes
It’s Not About the Database Operator, It’s About the Deployment
มุมมอง 232 หลายเดือนก่อน
It’s Not About the Database Operator, It’s About the Deployment
Thinking outside the classroom: building an edge device to monitor atmospheric conditions.
มุมมอง 42 หลายเดือนก่อน
Thinking outside the classroom: building an edge device to monitor atmospheric conditions.
Images Bite Back -- Dealing with Day 2 Build Issues
มุมมอง 942 หลายเดือนก่อน
Images Bite Back Dealing with Day 2 Build Issues
A Day in the Life of Kubernetes Release with Tools, Challenges, and Operations
มุมมอง 672 หลายเดือนก่อน
A Day in the Life of Kubernetes Release with Tools, Challenges, and Operations
Effortless Inference, Fine-Tuning, and RAG using Kubernetes Operators
มุมมอง 522 หลายเดือนก่อน
Deploying large OSS LLMs in public/private cloud infrastructure is a complex task. Users inevitably face challenges such as managing huge model files, provisioning GPU resources, configuring model runtime engines, and handling troublesome Day 2 operations like model upgrades or performance tuning. In this talk, we will present Kaito, an open-source Kubernetes AI toolchain operator, which simpli...
Secure-by-Default Cloud Native Applications
มุมมอง 1192 หลายเดือนก่อน
A new era of cloud-native applications that are secure by default is emerging. From zero-vulnerability container images to container runtime isolation, we’ll learn how to build secure-by-default Kubernetes applications that don't require complex policy configuration or constant log monitoring. Speaker: Jed Salazar & Jason Hall
Papers, Please - Scrutinizing AI model creation
มุมมอง 152 หลายเดือนก่อน
When an AI model misbehaves (e.g., it tells you to put glue on pizza), you must investigate how this happened. Sometimes these are accidents caused by the training data, but these incidents can also be due to nefarious activities - we’ve seen ML malware deployed in 2024. At the end of the day AI is still software, so security needs to be established around its creation. The same transparency an...
Mastering Zero Downtime: Container State Replication for Seamless Migrations on Kubernetes
มุมมอง 402 หลายเดือนก่อน
Mastering Zero Downtime: Container State Replication for Seamless Migrations on Kubernetes
Six Degrees of Kevin Bacon - Open Source Community Edition
มุมมอง 8242 หลายเดือนก่อน
Six Degrees of Kevin Bacon - Open Source Community Edition
You Can Score It! Shift Down to the Platform. Do Not Shift Left to the Developers.
มุมมอง 322 หลายเดือนก่อน
You Can Score It! Shift Down to the Platform. Do Not Shift Left to the Developers.
SPIFFE runs in the cloud, but can it run on my laptop?
มุมมอง 152 หลายเดือนก่อน
SPIFFE runs in the cloud, but can it run on my laptop?
Platform Engineering Loves Security: Shift Down to Your Platform, not Left to Your Developers!
มุมมอง 502 หลายเดือนก่อน
Platform Engineering Loves Security: Shift Down to Your Platform, not Left to Your Developers!
fantastic!
The talk is really helpful! Thank you @ Stéphane!
Thank you so much! Glad you find it helpful 😊
Good one Abhinav🙌🏻
Uploading 8hour videos is not interesting at all. These videos need to be broken down into each respective segments so people can watch the sessions they are interesting in
You can check individual talk recordings in the playlist: th-cam.com/play/PLnfCaIV4aZe-4zfJeSl1bN9xKBhlIEGSt.html
(10:58) “Deep dive: Collect and process your logs on K8s with Opentelemetry Collector” by Christos Markou (45:16) “It’s Not About the Database Operator, It’s About the Deployment” by Peter Szczepaniak, Jan Wieremjewicz (1:20:14) “The Untold Story of Unikernels and WASM” by Ram Iyengar (2:09:58) “Abstracting Kubernetes: How Intuit is Migrating Services to a Simplified, Abstracted Paved Road” by Avni Sharma, Shail Shah (5:15:30) “Evaluating runtime threat detection strategies in Kubernetes” by Ben Hirschberg (5:52:39) “Scaling Private LLM Model Services with Kserve and Modelcar OCI: A Real-World Implementation” by Mayuresh Krishna (6:26:26) “Secure-by-Default Cloud Native Applications” by Jason Hall, Jed Salazar (7:10:19) “Building Kubectl Plugins Like A Pro” by Ahmet Balkan
(5:44) “Thinking outside the classroom: building an edge device to monitor atmospheric conditions” by Hadijat Sanni, Jubril Oyetunji (39:12) “Migrating Distributed Systems Infrastructure to a Serverless Model: Methodology and Insights” by Priya Ananthasankar (1:14:34) “Have Half The Mesh With Half The Mess” by Carson J Anderson (2:04:47) “Papers, Please - Scrutinizing AI model creation” by Mihai Maruseac, Parth Patel (2:39:54) “Effortless Inference, Fine-Tuning, and RAG using Kubernetes Operators” by Ishaan Sehgal (4:34:24) “Platforms Need AI Copilots” by Jeremy Lewi (5:08:13) “Maximising Microservice Databases with Kubernetes, Postgres, and CloudNativePG” by Leonardo Cecchi, Gabriele Bartolini (5:47:00) “When Things Go Sideways: Troubleshooting the OpenTelemetry Operator” by Reese Lee, Adriana Villela (6:19:18) “The wrong way to Reconcile” by Scott Nichols (7:04:35) “The GitOps First Deployment: ArgoCD and Beyond” by Abhinav Dubey (7:40:08) “Publish your Kubernetes tool as a GUI on Headlamp” by Joaquim Rocha Lightning talks: (8:13:23) “Six Degrees of Kevin Bacon - Open Source Community Edition” by Lori Lorusso (8:19:11) “So Flatcar's in the CNCF... What's Next?” by Andrew Randall (8:24:09) “You Can Score It! Shift Down to the Platform. Do Not Shift Left to the Developers.” by Mathieu Benoit (8:30:06) “Building MLOps pipeline with Dagger.io and KitOps” by Shivay Lamba (8:33:51) “Hyperlight: Process VMs” by Ralph Squillace (8:39:52) “Rethinking Ephemeral Environments in K8s” by Prakarsh (8:44:28) ??? (8:47:30) “Better Together. Leveraging your Existing Observability Tool as a SIEM” by Mathias Palmersheim (8:52:41) “Akcess. Share Fine Grained Access Of Your K8s Cluster Temporarily” by Vivek Singh (8:57:03) “SUSE - 5 mins Closing Keynote on Community Initiatives” by Divya Mohan
Thankyou for such a good and simplified explanation!
Thank you very much for streaming it! Very helpful for those who're FOMO :-) Since we've made the timeline for Kubernative, happy to share it for all viewers here as well: (6:40) “Welcome to Cloud Native Rejekts NA 2024!” by Benazir Khan (16:33) “Malicious Compliance Automated: When You Have 4000 Vulnerabilities and only 24 Hours Before Release” by Duffie Cooley, Kyle Quest (43:29) “Ten years of Kubernetes: Building the future” by Lachlan Evenson (54:57) “Images Bite Back -- Dealing with Day 2 Build Issues” by Adrian Mouat (1:48:26) “A Day in the Life of Kubernetes Release with Tools, Challenges, and Operations” by Meha Bhalodiya (2:18:49) “Building an Open Source Observability Stack from Raw Telemetry” by Joshua Lee (4:32:49) “Debug Like a Pro: Ephemeral Containers and Wolfi Linux in Action” by Chad Crowell, Natalie Lunbeck (5:08:28) “Integrating eBPF superpowers into your observability tooling” by Mauricio Vasquez Bernal, Chris Kuehl (5:43:36) “Meet the New Kid in the Sandbox - Integrating Visualization with Prometheus” by Eric D. Schabell (6:34:00) “From Fragile to Resilient: Using Admission Policies to Strengthen Kubernetes” by Marcus Noble (7:07:10) “Cloud Native Nix!” by Leigh Capili (7:45:05) “Virtual Machines, Containers, and WebAssembly Face-off” by Danilo (Dan) Chiarlone, Jiaxiao (Joe) Zhou (8:23:17) “Platform Engineering Loves Security: Shift Down to Your Platform, not Left to Your Developers!” by Mathieu Benoit, Maxime Coquerel
Here's a timeline for these talks: (7:32) “Dynamically Provisioning Volumes With Pre-Existing Data | Magic Behind Kubernetes Volume Populators” by Vivek Singh (43:40) “What Kubernetes Should Learn from Other Orchestrators” by Justin Garrison (2:57:53) “I explained eBPF to my grandma!” by Matteo Bianchi (3:32:25) “How the heck do I debug distroless containers?” by Eric Smalling (4:07:41) “Karpenter and Cluster Autoscaler: A data-driven comparison” by Michael McCune, David Morrison (4:56:58) “Mastering Zero Downtime: Container State Replication for Seamless Migrations on Kubernetes” by Shivansh Vij (5:32:42) “SPIFFE runs in the cloud, but can it run on my laptop?” by Mattias Gees
am i the only one who thinks that this is insane? prometheus was not complex enough? the speaker spent ~10 minutes talking about all the stuff that did not work for him - that's a great testimony for this tool: i install it, add to my project and... it does not work - dependencies missing :D
Remarkable peek under the hood. Thanks!
Shoulda repeated the questions from the audience
So the slow image copy issue is basically self inflicted. If you use rook-ceph or netapp or portworx or any other enterprise grade CSI driver that supports either snapshots or csi clone, HCO will use that instead of doing the slow copy. The slow copy is just a fallback for storage that doesn't support snapshots or CSI clone. So if you don't use longhorn, you will not have to do the craziness that is creating a storage class per image. I think that is a unique property of longhorn, and your solution is now tied to longhorn since no other CSI driver does this.
Any update on the Blog or documentation for this talk ?
Rego language seems to suck a bit... the examples presented beg for an 'if' statement if protocol != https then result = False if person.age < 21 then result =False etc..
@@rafayahmed6259 Agree, never understand why these tools like reinvent the wheel. There are plenty of exist battle-tested language.
stateful platform costs a shrillion bucks.
Great presentation! really interesting topic, K8s on FreeBSD is surely another great alternative
Just in case that can help others find the talk that they're looking for: 😊 00:15:45 Welcome to the Rejekts (Benazir Khan) 00:22:02 OCI Registry: Beyond Container Images (Stéphane Este-Gracias) 00:54:05 Microsoft Keynote on Community Initiatives (Andy Randall) 01:01:25 How eBPF Actually Works (James Laverack) 01:32:05 Cisco Keynote on OpenSSF Scorecard (Stephen Augustus) 01:57:30 Avoiding Common CRD Design Errors (Nick Young) 02:30:12 The Perilous Passage to Production (Whitney Lee, Viktor Farcic) 04:46:10 Context-Based Security (Oshrat Nir) 05:20:55 Exploring Attacker Persistence Strategies (Rory McCune) 05:56:22 Migrating 2 million CPU cores to Kubernetes (Lucy Sweet) 06:45:58 Creating a common framework for eBPF data collection (Chris Kuehl) 07:21:10 ValidatingAdmissionPolicies Strengthen Kubernetes (Marcus Noble) 08:01:05 Open Source Project Growth: The Non-Tech Needs... (Kim McMahon) 08:31:05 What's new in the K8S Gateway API (Abdelfettah Sghiouar)
Thank you so much!🤩
This looks great, but sadly missing dark theme
Big true.
This is one of the most useful talks on Web Assembly I've ever seen. There's a lot of confusion going around about what WASM is/isn't, how it works, etc. This is an amazing introduction, thank you!
Extremely clear and helpful talk! There are tools such as Langsmith and Weights and Biases that support this type of observability and tracing for LLMs, but from what I can tell they have a cost. I have been looking for what people are doing with open source tools. This talk by Daniel Kim is the best info I have found regarding using OpenTelemetry to support LLM applications. His mention of OpenLLMetry is appreciated also.
wwo wowoo owowow what?
Great presentation, thank you!
"Promosm" 🏃
It’s nice!
Great talk!
Great session Thank you so much.
We need more videos about opni!
First talk has mixed audio as for one of the talk in Room.1 video. The other talks have none.
there are 2 speakers talking over each other
Thank you for sharing this!
Is not a single node k3s Cluster better suited? as described in the beginning? But the talk is basically missing the conclusions.
1:54 lol
Moving to the frontend trends in a good direction, but I think ultimately we need to move OPA checks to "compile-time". I want my IDE to notify me as I'm writing my manifest/terraform/cloudformation config that I'm violating a rego rule somewhere. Tightening this feedback loop is a better UX than waiting for my gitops CI/CD build pipelines to start failing and an even better UX than waiting for a kubectl apply in production to fail (presumably it's prod because you'll likely have relaxed policies on your dev cluster). Great talk, thanks!
Nice 🙂 one .... Just a hands on session would be very helpful
Thanks for the great and informative time.
It was great to be there💝
pքɾօʍօʂʍ
2:07:40 - Now That We Can Checkpoint Containers - What's Next?, Adrian Reber (Red Hat)
Nice talk Wesley!
This video has zero comments and only 1k views, which is a shame, this is really awesome.
is there a reason we didnt use openstaack
We need to create strong multi-tenancy and virtualization is not the first option to do so.
how you compare to metal3.io ?
Thanks for putting this together, a lot of things I had't considered yet.
Can't wait for more