- 129
- 133 586
Kestra
France
เข้าร่วมเมื่อ 11 เม.ย. 2022
The Unified Orchestration Platform for All Engineers ⚡
Deploy Your Python Code to Kestra
Looking to orchestrate your code but don't want to spend ages setting up a system? Will walks through how you can migrate your Python Code into Kestra, specifically looking at what will work out of the box, as well as how you can integrate your code further into Kestra
Read the more in the docs here: go.kestra.io/python
0:00 - Introduction
0:37 - Inline vs Execute File
2:58 - Dynamically Pass Data to your code with Expressions
3:52 - Sync/Clone your Code from GitHub
4:50 - Dynamically Pass Data to your code with Environment Variables
5:08 - Integrate with other tasks
6:37 - Send Custom Log Levels to Kestra
7:11 - What works out of the box without modifying my code?
9:50 - What works out of the box vs extending with Kestra?
12:56 - Summary
----------
📖 Read the documentation: go.kestra.io/docs
⭐ Start your journey with Kestra: go.kestra.io/github
🚀 Join the Kestra Community: go.kestra.io/slack
For more information, visit Kestra's Website: go.kestra.io/
Read the more in the docs here: go.kestra.io/python
0:00 - Introduction
0:37 - Inline vs Execute File
2:58 - Dynamically Pass Data to your code with Expressions
3:52 - Sync/Clone your Code from GitHub
4:50 - Dynamically Pass Data to your code with Environment Variables
5:08 - Integrate with other tasks
6:37 - Send Custom Log Levels to Kestra
7:11 - What works out of the box without modifying my code?
9:50 - What works out of the box vs extending with Kestra?
12:56 - Summary
----------
📖 Read the documentation: go.kestra.io/docs
⭐ Start your journey with Kestra: go.kestra.io/github
🚀 Join the Kestra Community: go.kestra.io/slack
For more information, visit Kestra's Website: go.kestra.io/
มุมมอง: 84
วีดีโอ
Integrate Your Python Code in Kestra | How-to Guide
มุมมอง 729 ชั่วโมงที่ผ่านมา
To be able to get the most out of running Python inside of Kestra, you can use the Kestra Python Library to access data generated by your code. Will walks through how you can generate outputs, logs, metrics and files with Kestra's Python Integration. Read the more in the docs here: go.kestra.io/python 0:00 - Introduction 0:23 - Output Variables 4:15 - Output Files 5:38 - Metrics 6:38 - Logging ...
Make Your Workflows Dynamic with Expressions in Kestra
มุมมอง 11816 ชั่วโมงที่ผ่านมา
Kestra's expressions combine the Pebble templating engine with the execution context to dynamically render flow properties. This video walks through a few common examples and explains how to use them in your flows. Read the expressions reference here: kestra.io/docs/expressions 0:00 - Introduction 0:24 - Inputs 1:11 - Outputs 1:50 - Variables 2:39 - Triggers 3:19 - Executions 3:36 - Operators 4...
Build Python Packages in Kestra | How-to Guide
มุมมอง 147วันที่ผ่านมา
Sometimes it can be useful to build your own packages in Python to use with your code. Will walks through how you can automate this process inside of Kestra and share your packages across namespaces for multiple workflows to use! Read the more in the docs here: go.kestra.io/python-dependencies 0:00 - Introduction 1:03 - Build .tar.gz package 2:42 - Install .tar.gz package 4:32 - Build wheel 5:2...
Parallel vs Sequential in Kestra - What's the difference? | How-to Guide
มุมมอง 8214 วันที่ผ่านมา
Kestra provides both a Parallel and Sequential Task in Kestra to help you control your workflow's orchestration logic. Will walks through how to use them and how to combine them to build powerful workflows. Read the more in the docs here: go.kestra.io/parallel-vs-sequential 0:00 - Introduction 0:28 - Parallel Example 2:17 - Sequential Example 5:32 - Summary Read the documentation: go.kestra.io...
Handling Null and Undefined Values in Kestra | How-to Guide
มุมมอง 7714 วันที่ผ่านมา
The null coalescing operator is a binary operator that returns its left-hand value if it's not null; otherwise, it returns its right-hand value. You can think of it as a way to provide a default value when the left-hand value is null. Will walks through a number of examples of where you might use this. Read the more in the docs here: go.kestra.io/null 0:00 - Introduction 0:19 - Process Date Val...
Access Different Docker Containers on Localhost with host.docker.internal | How-to Guide
มุมมอง 18614 วันที่ผ่านมา
Sometimes you want to interact with other services that are running in different docker containers on your local machine, for example to access a Postgres Database or Interact with Kestra's API with Python from a Docker Task Runner. Will walks through how you can use host.docker.internal over localhost to solve this issue. 0:00 - Introduction 0:26 - Example 1:56 - Summary Read the documentatio...
Namespace Variables vs KV Store
มุมมอง 13021 วันที่ผ่านมา
When navigating to a namespace in the Kestra UI, you can see two tabs: Variables and KV Store. Both allow you to store key-value pairs, but there are some significant differences in how those are handled and stored, and when you should use one over the other. Will walks through the differences and when to use each one! go.kestra.io/namespace-variables-vs-kv-store 0:00 - Introduction 0:31 - Name...
Enable CORS for Local Development in Kestra | How-to Guides
มุมมอง 6221 วันที่ผ่านมา
To make sure we can make requests to Kestra from our JavaScript application locally, we'll need to enable CORS in our Kestra Configuration. We can do that by adding the following configuration: Read the more in the guide here: go.kestra.io/cors Like, and Subscribe for more quick guides on using Kestra! 0:00 - Introduction 0:25 - Add CORS to Kestra Configuration 0:59 - Test it: Webhook Trigger w...
Clean Up Kestra by Purging Old Executions | How-to Guide
มุมมอง 7121 วันที่ผ่านมา
Overtime, you can gain a lot of Executions and Logs in your Kestra instance. This can take up valuable database space which could be cleared up if these older executions aren't used anymore. By using the Purge tasks in a System Flow, we can automatically clean up Kestra. Will walks you through how to set this up. Check out the Blueprint example here: go.kestra.io/purge 0:00 - Introduction 0:50 ...
Access Local Files inside of Kestra | How-to Guide
มุมมอง 28928 วันที่ผ่านมา
In Kestra, you can access files stored on your local machine inside of your Flows. This can be useful if you have a directory of files you want to process, or code you want to run without having to run them. In this video, Will walks you through how to configure Kestra to access local files. Read the more in the guide here: go.kestra.io/access-local-files Like, and Subscribe for more quick guid...
Light or Dark Mode? Sync with System Theme in Kestra 0.20
มุมมอง 38หลายเดือนก่อน
Being able to sync your theme with your system is helpful, especially if your system automatically switches at sunrise and sunset. You can now Sync your Theme with your System in Kestra 0.20 Read the full release notes here: go.kestra.io/release-0-20 Like, and Subscribe for more quick guides on using Kestra! Read the documentation: go.kestra.io/docs ⭐ Start your journey with Kestra: go.kestra....
SLAs for Your Workflows in Kestra 0.20 | How-to Guide
มุมมอง 139หลายเดือนก่อน
An SLA (Service Level Agreement) is a core property of a flow that defines a behavior that should be triggered if the flow runs for too long or doesn't satisfy the assertion defined in the SLA. Kestra allows you to set these up in your Workflows - Will walks us through how to set it up. Read the more in the docs here: go.kestra.io/sla 0:00 - Introduction 0:43 - Max Duration SLA 3:28 - Execution...
Capture Error Logs for Alerts in Kestra 0.20 | How-to Guide
มุมมอง 115หลายเดือนก่อน
We have introduced a new errorLogs() Pebble function, allowing you to add specific error details to alert notifications. This makes it easier to understand what went wrong without diving into individual execution logs. Read the more in the docs here: go.kestra.io/errorlogs Like, and Subscribe for more quick guides on using Kestra! 0:00 - Introduction 0:06 - Example with Fail task 1:15 - Example...
Run Your Workflows in Blocks with If Statements in Kestra
มุมมอง 194หลายเดือนก่อน
With runIf, you can skip a task if the provided condition evaluates to false. This is useful if you want to skip an individual task without having to wrap it in an If task. Will compares the two in the video. Read the full release notes here: go.kestra.io/release-0-20 Like, and Subscribe for more quick guides on using Kestra! 0:00 - Introduction 0:23 - If Task Example 1:38 - runIf Example 2:29 ...
Sync Local Flows to Kestra | How-to Guide
มุมมอง 208หลายเดือนก่อน
Sync Local Flows to Kestra | How-to Guide
Build your own Custom UIs for Flows with Apps in Kestra | How-to Guide
มุมมอง 441หลายเดือนก่อน
Build your own Custom UIs for Flows with Apps in Kestra | How-to Guide
Pause Executions Manually in Kestra 0.20
มุมมอง 124หลายเดือนก่อน
Pause Executions Manually in Kestra 0.20
Introducing Apps - Custom UIs for Kestra Workflows
มุมมอง 725หลายเดือนก่อน
Introducing Apps - Custom UIs for Kestra Workflows
Kestra 0.20 is here and adds SLAs, Invites, User-Facing Apps, Isolated Storage and Secrets per Team
มุมมอง 868หลายเดือนก่อน
Kestra 0.20 is here and adds SLAs, Invites, User-Facing Apps, Isolated Storage and Secrets per Team
Using the Kestra API in less than 60 seconds
มุมมอง 163หลายเดือนก่อน
Using the Kestra API in less than 60 seconds
Manage Users inside of Kestra with Role Based Access Control (RBAC)
มุมมอง 233หลายเดือนก่อน
Manage Users inside of Kestra with Role Based Access Control (RBAC)
Manage Python Dependencies in Kestra | How-to Guide
มุมมอง 319หลายเดือนก่อน
Manage Python Dependencies in Kestra | How-to Guide
Get Started with the Kestra API | How-to Guide
มุมมอง 529หลายเดือนก่อน
Get Started with the Kestra API | How-to Guide
Capture Python Logs in Kestra in 60 seconds
มุมมอง 241หลายเดือนก่อน
Capture Python Logs in Kestra in 60 seconds
Kestra vs Jenkins - Picking The Right Tool
มุมมอง 5582 หลายเดือนก่อน
Kestra vs Jenkins - Picking The Right Tool
ForEach vs ForEachItem in Kestra - What's the difference?
มุมมอง 2172 หลายเดือนก่อน
ForEach vs ForEachItem in Kestra - What's the difference?
Sync Your Flows from Git to Kestra in 60 seconds
มุมมอง 2762 หลายเดือนก่อน
Sync Your Flows from Git to Kestra in 60 seconds
Manage Files inside of Kestra with Namespace Files
มุมมอง 3482 หลายเดือนก่อน
Manage Files inside of Kestra with Namespace Files
Moving from Development to Production | Kestra Best Practices
มุมมอง 3992 หลายเดือนก่อน
Moving from Development to Production | Kestra Best Practices
Thanks! Very robust!
Thank you for the great videos !! In GCP, we have event based trigger on object creation, I would like to know how can we mimic that behaviour in Kestra .
We have a GCP GCS trigger which can do something similar. I’d recommend checking that out!
Great Tutorial, Thanks for. Is it secure set the IPV4 to 0.0.0.0/0 ?
I really like your detailed tutorial, I’ve tried several automation tools include Kestra, but the way to store secrets is really an obstacle for me to get into this project, this feature only for enterprise version is kinda sad, for me to actually build something on it compared to other competitors product.
We appreciate your feedback. While you can't save secrets in the UI on the OSS edition, you can save them inside of your Kestra configuration. Hope this helps!
Kestra is amazing!
Maybe some email orchestration system?
Excellent! 🎉
Thats owsome! It will findout those specific logs which we mention in the yaml like "something went wrong" in your example mentioned in video right ?
I have just started Kestra yesterday. And i was thinking about that " How can i manage file(Yaml) in local instead of manage them on Kestra UI. Thank you😊😊
How can i install plugins on kestra. It is necessary to go inside Kestra's container to install extra plugins (which are not installed on kestra by default). Isn't it possible to install them through the UI?
You'll need to install plugins in the container currently so we recommend using the `latest` image which contains all the plugins unless you only want a few. We're looking to add a UI page in the future.
Its owesome Also provide a detailed automated project of DevOps through Kestra... Thank you
Thanks! We've got a few videos on the channel covering CI/CD too!
Cool. I will definitely try it out. Is it possible to access the errors within a python script?
Not quite as Python just gives us an error code 1 currently - but we're looking to add a deeper integration in a future release
This is epic! Looking forward to trying it out
Is there a way to merge the outputs of a ForEachItem loop where I can get the outfputiles of each subflow in one list or dictionary?
This is a great tutorial. Also, you have the voice of an angel :D
Amazing tutorial 👌I just wanted to confirm whether all of this can be accomplished using only Self-hosted Open-Source and is not restricted to the Enterprise edition.
Yup our GitHub action works with both editions!
When you use the Kestra build task does that run every time the workflow is executed and thus is basically the same as using the beforeCommand?
Yes - The benefit here is you can also upload to a registry and configure to pull that instead of build every time.
Can you lock down / restrict the forms to users? If so, can you also restrict different parts based on a role so say when resuming a workflow only users with a specific role/group could do the approval?
Yes! You can currently assign custom RBAC on a namespace level to allow only specific users to use specific Apps. Regarding resuming to approve/reject, we are working on a HumanTask plugin that will allow you to assign a specific person or a group of users to approve the workflow, and if someone else tries to resume it, they will get an error saying they are not allowed to perform that action. Great to see you're thinking about this. If you want to discuss this use case more, feel free to ping us in our Slack.
❤
You should perhaps mention that none of these features is included the open source version.
so true
Appreciate the feedback. I'd recommend checking out our release blog post and docs which highlight which features are for which edition. To be transparent, we want to make sure this content is evergreen in case we open source these features one day, as we continue to grow the product and expand the offering. Hopefully this gives you an insight into how we're thinking about it.
Wow! This is simply amazing! Thanks for open sourcing the complete project! 😍❤
thank you sir.
why dont i have editor tab like him?
This has been changed in newer versions of Kestra. Now you can edit your workflow from the flows tab. You can access code files under namespaces
there is no editor tab in my ui in the left side. why is it such a bad tutorial
Since making this video, our UI has changed meaning the Editor is now only accessible when you create a flow or via the Namespaces page. Hopefully this clears things up!
Wow! an awesome feature, love it
That looks awesome, love these short videos demonstrating the cool work you can accomplish on Kestra. Feedback -- it would be nice to reference docs while showing the capabilities so that we can get going fast . Continue making these and stay open source and profitable
I really like the design, it looks so clean and intuitively designed. Love the videos, shows the power that is being unleashed. Qq - namespaces are for enterprise only? Would be nice to state which awesome features are part of open source and those for enterprise. Got any opening for the cloud alpha trial?
Thank you! Namespaces are OSS too! If you're interested in Cloud, join our Slack and get in touch! kestra.io/slack
good
Is it independently work in a local environment? Do a business team can define the process ?
You can have multiple instances and use Git to sync your flows between them. As we have a UI editor as well as a code editor, business teams can develop workflows too!
This is very useful for failure management triggers and status updates. Good stuff
just discovered this. thanx, interesting. easier than trigger. im new to the dev world.
What is a kestra and why would one use it?
Kestra is a Fast, Scalable, Declarative Orchestrator. Kestra allows building workflows as code. This approach facilitates seamless integration with existing CI/CD processes, Infrastructure as Code tools like Terraform, and version control systems like Git. I'd recommend checking out our 4 minute overview video to learn more: th-cam.com/video/feC6-KQLYyA/w-d-xo.htmlsi=qFPH5b4_M4kExlR3
Having worked with orchestrators such as Airflow, or prefect or even custom ones, I think Kestra nailed it, there is just one little thing I don’t know if it is possible or not, it’s the ability to choose from where to play a flow (even if the flow never ran) this is useful when you have decommissioning flows , the starting point depends on when the principal flow has failed
This is a good question for our Slack community: kestra.io/slack!
Are there an email or contact number because i have an urgent situation i want to ask about?
I’d recommend joining our Slack at kestra.io/slack
Hell yeah! ❤
this is cool
Thank you Kestra