Scheduling Tasks Professionally in Python
ฝัง
- เผยแพร่เมื่อ 31 ก.ค. 2024
- Today we are going to learn how to professionally schedule Python tasks.
◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
📚 Programming Books & Merch 📚
🐍 The Python Bible Book: www.neuralnine.com/books/
💻 The Algorithm Bible Book: www.neuralnine.com/books/
👕 Programming Merch: www.neuralnine.com/shop
🌐 Social Media & Contact 🌐
📱 Website: www.neuralnine.com/
📷 Instagram: / neuralnine
🐦 Twitter: / neuralnine
🤵 LinkedIn: / neuralnine
📁 GitHub: github.com/NeuralNine
🎙 Discord: / discord
🎵 Outro Music From: www.bensound.com/ - วิทยาศาสตร์และเทคโนโลยี
![เบิ้ล ปทุมราช - อ้ายกินดอง น้องลาบงัว ft. สแน็ก อัจฉรีย์ [OFFICIAL MV]](http://i.ytimg.com/vi/-OK--KaSPcI/mqdefault.jpg)
Hey man, been a python dev for 3 years, this channel is awesome for both pros and enthusiasts. Not too much high quality advanced/applied python content out there, and most channels that do have these niche topics people like us are looking for are either low quality or outdated. With u the best, and Godspeed and good luck in carrying out gods work out here 🤘👊
Hats off to your consistency 👍
Btw thanks for the video
Cool library. Very natural-language focused. Thanks for taking time to show it.
One of best video. Never knew scheduling could be that much easier.
One of the biggest reasons I tend to run Python VENV's on Linux, for Cron execution. Cool to see alternatives here in this video.
Short, detailed, great! Keep sharing and keep growing..
Very useful utility. Thanks for the demo.
This was great! Thank you for sharing
Super useful. Didn't know this module existed
Great video! Thank you!
Awesome! Thanks!
For some reason, if i amend the schedule and re run the code, it will apply both the old and new schedules?
If i run the cell twice too it will treat it as 2 schedules too.
eg if my def is print('hello')
and i set schedule to run every 5 seconds
then i run the cell again, it will then print 'hello' twice every 5 seconds
Only way for me to reset them is to start a new script
do you know why this might be?
I am crying for discovering such an incredible channel so late. Definitely love the contents you make and they are all very useful for my current job. I cannot describe how much I love your videos👍
don't cry
Great tutorial. Thanks! :-)
Great Content bro.
thank you brother! Good video! subbed/liked/and commented!
Can i use this if i want to run whole script at exact time every day, not just a defined function? If yes, how?
Thank you!
Supposing I want to Design and implement a distributed system that monitors and optimizes resource utilization across multiple nodes in a network. What changes do I do?
you could use airflow for that, how about you make a video on it? great video as always! :)
Thanks for the lesson, does this work in micro python, e.g. on the Pi Pico?
This helps. Thanks
Great Video!!! Hey can u make about shedule+Timezone set
Great Video Sir
Definitely... learnt something new
can I use this in the Flask app (production)? is this work with workers?
How to schedule running such script? I mean what is we need to run the script itself at some specific time?
Why do it like this and not with task scheduler? And how to set it up, so that it runs, even when having restarted the PC? Thanks!
Great video
This is exactly the concept of cron jobs in Unix-like OS's
In unix linux are cron and ansible do this thing
But wouldn't you have to turn on/run the code manually? how do you have it running in the background at all time?
Can you run the scheduler in its own thread so that the main thread does not have to loop?
Thank you very much
Thank you for the video. I used fastapi, but I faced a problem
Run time of job....was missed
Can you help find a solution?
Hey excellent video!!! One question, does schedule works also in Micropython? 🤔
why did you mention tm.sleep(1) in the loop?
is it really necessary
Great content tho i guess in real applicstions you would likely considder aitflow. Anyway, do you know of qny library that helps you control your jobflow and enable you to process in batches. For example simple etl jobs (example: sync folder to ftp which has loads of csv files, transform them , bulk load them to db, write logs to db, all eith the posibility to redo failed jobs erc?). I often wrote semi professional custom scripts for thi or used something like powercenter. A pure python approach would be nice.
I don't understand the concept of the sleep() function, I added to mine and it printed a specified phrase twice every five seconds instead of once.
What is the loop doing at 4:52
I fail to see the point of this as you would have the computer running whilst you are away with the script on and I do not know about everyone else but i'm not about to leave my PC running all day. Any answers?
Thanks chief
Nice explanation. One thing not covered is scheduling multiple jobs. Our use case is scheduling 100+ jobs. Is there a better management of scheduling all these tasks?
does it work even when windows is locked?
How would you keep the persistence if the script stopped ? or if the computer restarted ?
probably need cron for that
You can do this with the subprocess module
Good program logic shared. Though am a good python coder and architect did not take a chance to program this way. how is Airflow it got most of the codes you did get covered through its libraries!! But overall thanks and had a new thing to look and learn.
Could you make a redis and redis queue tutorial for ml and with flask or fastapi ?
Is there any benefit for doing this over something like Windows Task Scheduler?
just a different tool. depends which tool you like better or is more convenient. on linux there is no windows task scheduler
Great video & looks useful. How would you implement a repeated task online or not having to have the computer on running python all the time? What do you suggest? thanks
Same! Also, how to run under a service account? On windows, I've used Windows Task Scheduler to run python programs, but it is a bit limited. Could something like Docker be used?
you could use docker and deploy it in cloud
Cool. Wonder if it's accurate enough to build a crude programmatic drum machine. Another program in the todoqueue.
will this program run even if our computer power is off
Great video, thanks! Any chance you can show us how to make such a code run on the cloud?
Try replit
Sir, I would like to know why we need to use timer.sleep.
Nice video
thanks
How can I make that program run in the background of my system so i don't have to run the program and stuff. Basically how can I make that as a background running application which starts itself at startup?
You need to actiavte the "Autostart",:
Select the Start button and scroll to find the app you want to run at startup.
Right-click the app, select More, and then select Open file location. This opens the location where the shortcut to the app is saved. If there isn't an option for Open file location, it means the app can't run at startup.
With the file location open, press the Windows logo key + R, type shell:startup, then select OK. This opens the Startup folder.
Copy and paste the shortcut to the app from the file location to the Startup folder.
this is one solution, there are still some different.
@@nexo4151 thanks will try them 👍
mine says schedule has no attribute 'every'
how did the function work without call it, is it the while loop? ,,, watch 9:56 minute in the video
Can anyone reply to this....if im scheduling day basis a script using this library, is it will executed on time daily basis without any manual effort?....like im going to schedule my script to run on daily basis at 10am....do i need to manually run the script one time before the schedule on daily or it will run automatically without any manual things involved
As long as you keep the script running, it will run it every day at the specified time. So let’s say you run the script and close it, it will not continue to run your script but if you keep your computer running/powered it will continue to run the scheduled function.
Good video! But what I find really hard to find a proper solution to is where to run it. I can't let my computer at work on the whole day so the script has to run somewhere else. What is a professional solution?
Would love an answer to this too
Yes same
Is this python script more memory and processor consuming over crond?
Subjectively speaking. Yes.
ok but the main point should be to let this running as a background task and it should be continuing whene you restart your computer.
Windows has a Task Scheduler that can be triggered whenever you want.. And you don't need to have the Python app running all time.
In order to schedule tasks "professionally", you need features like pesistance storage, clustering, fault tolerance and many more.
For a complete solution, you should look at APScheduler (Python) or Quartz/Jobrunr (Java)
I recomment apscheduler over this library personally
it is giving an error as
import schedule
ImportError: No module named schedule
You need to first install the module. Use this:
pip install schedule
@@abdullahhasan-kq5kc i did that, same problem. vscode or python just doesnt see it
Please make a video for the "powerplan" python package how to change windows power plan and see info
First🔥
First view
for some reason this is not working for me:
```
schedule.every(1).hour.do(job)
while True:
schedule.run_pending()
time.sleep(1)
````