ฝัง
- เผยแพร่เมื่อ 6 ก.ย. 2024
- There's a lot of data on the web and in your desktop apps, but accessing it can involve a lot of tedious typing and clicking. This talk is an introduction to the Selenium and PyAutoGUI modules, with live demos straight from the interactive shell. Al Sweigart explains web scraping techniques and programmatically controlling the keyboard and mouse to automate these tasks for you.
Abstract
The internet and personal computer are central tools in many jobs, including professions outside of engineering. This makes web scraping and GUI automation are relevant to not just developers and QA testers, but academics, organizers, and office workers. This talk is an introduction to Selenium and PyAutoGUI modules. and programatically controlling your browser and desktop applications from Python.
Web scraping and GUI automation frameworks have an intimidating reputation for a steep learning curve. While they do have many sophisticated features, the basics that most folks will ever need can be covered in a single presentation.
This presentation has multiple live demos to showcase these modules straight from the interactive shell.
The content from this talk is derived from Automate the Boring Stuff with Python, a beginner's Python book freely available under a Creative Commons license at automatethebor...
Bio
Al Sweigart is a software developer and the author of Automate the Boring Stuff with Python, Invent Your Own Computer Games with Python, Making Games with Python & Pygame, and Hacking Secret Ciphers with Python. These books are freely available under a Creative Commons license at inventwithpyth.... Al enjoys haunting coffee shops, writing educational materials, cat whispering, and making useful software. He lives in San Francisco.
speakerdeck.co...
![POLYCAT - ข้อความรูปยิ้ม [Music Video]](http://i.ytimg.com/vi/lBhIgPGCgbI/mqdefault.jpg)
I highly recommend his book. It got me back into programming after a 17-year hiatus.
You encourage me as well. I felt dummy on programming.
For us beginners watching in 2022, at the 6:30 minute mark the selenium commands are out of date. It now looks like: driver.find_element(By.ID," "). Here's a recent short tutorial video with the new commands: th-cam.com/video/p24C_0d8FcQ/w-d-xo.html&t
This is my very humble teacher.
I leant virtually everything I know in python from him.
True
My very first programming class used one of his books as a textbook called "Invent Your Own Computer Games with Python." I just recently started using pyautogui and literally just found out he also wrote it. Pretty low-key humble guy.
I've just built a program to extract FX data automatically from MT5 using this PyAutoGUI. It took about 2 hours to write the code as there are no keyboard short cuts in the popup window. Works like a charm. It 'automates the boring stuff', as I need to do this task monthly! thanks Al
His book is killer! One of my all time favorites when I'm trying to show someone why they should be interested in Python.
Which book ?
Please mention name ?
@@ayeshavlogsfun Automate the boring stuff with Python
This man's voice is really soothing.
I thought the same too.
Me too!
It makes me feel good about life.
Great video. After I watched this I got the motivation to really dig in to both selenium and pyautogui and I have already automated so much.
I used to hate coding before reading Automate Boring stuff with Python, it was fun though and Now I am watching videos on Selenium!! thank you, Mr. Albert, for making fun from boring bits!!
Awesome guy. I love people that legitimately want to help others learn with few or no strings attached.
I owe this man everything... I learnt how to code from his book, 'Invent Your Own Games With Python' back when I was a kid.
Al Sweigart, Hero. Thank you for writing such an awesome book(s)!
Great book. Great talk. What kind of person "thumbs down" this video? I hope you choose to pass on more of your knowledge in such a manner. You are a very good instructor. Thank you!
"Hi, I'm AI." Whoa! That's some good AI. At first I was convinced you were an organic human.
Al thank you so much for making PyAutoGui. You're a real hero.
I finished your book today it was one of the greatest book I've ever read, Thank you for this amazing book.❤❤❤
Instructions for installing, for those who are beginning with pyautogui: Go to pypi.python.org/pypi and search for "pyautogui" from there download "PyAutoGUI-0.9.36.tar" then (if not already) drag to download files (easy way for me)from the left side of file explorer, then Left shift-right click on downloads then click on "open command window here" then type where you have your python file (bear in mind that it only works well on python versions that are 3.4 or lower) e.g C:/python27/Scripts/pip install py(press tab) then once the full name pops up ("PyAutoGUI-0.9.36.tar") press "Enter" on your key board, it should be installing/downloading from there(it usually takes a minute or two on a slow system)
This is for windows but other users should get an idea of what they should do with this info.
Great talk. There is an interesting live demo using MS Paint at time 17:30. Do not miss it.
I love python so much. So much to learn in it yet so much fun to learn. It’s simple, sweet, efficient and fun to use. I was so interested in front end but now I’m basically sold on being a backend with python or an engineer in general rocking python in my career
Greatest programming teacher.
this is the video I am searching for years
I use AutoIt to automate the boring stuff, but only for Windows and it can be used to scrape stuff from the internet as well, not to be underestimated one can also create fully fledged GUI's. To avoid mouse move/click and sorcerers apprentice phenomena autoit is able to locate Windows program controls and programmatically activate them.
Al, you are an amazing teacher! Thank you.
I would highly recommend his book, I bought it and its simple to follow and read.
I was trying to do some desktop automation with tools like pywinauto... It was h a r d. With pyautogui I achieved what I needed literally within 5 minutes... Thanks Al!
AI is getting me really interested in learning Python.
Look I'm not the one to write replies or even reviews, but I can't help myself after discovering this man and reading your comment. I was on /r/python on reddit, looking into what resources were out there to start learning. I came across MITs OCW program and figured what a blessing...and MIT education for free. I went through about 3-4 lecture's before going back on the subreddit and came across someone mentioning his book "How to automate the boring stuff."
If you've ever asked yourself where to get started on learning how to code, sign up for his course on Udemy. It's $10 if you use his discount code on www.automatetheboringstuff.com. If you are unable to afford that, you can read the text for free. He does move very quickly through the video's but he makes it SO easy to understand. What took me a week with the MIT course, I learned in a few hours with Al.
I am amazed that this man is not the face of coding in general. Do yourself a favor this year and sign up, you will get lifetime access. I started today and am already halfway through his course. I never would have thought it was this easy nor would I be this intrigued. Thanks, Al.
python = plain english
It's the reason I program in Python
Same
Thanks, I really enjoyed this talk, a remember me to have fun and remove from my mind the cliché of "everybody should learn to code".
Al is an excellent teacher!
protect this guy at all costs!
I liek the attention to detail as well. Its my favourite part.
Thank for the great info, I'm just learning Python and found this and got it working. I'll be looking at your book.
Nice talk. As someone that works in QA my advice for anyone serious about automation would be to use or create your own framework. Simply automating a web browser with a few scripts is kinda...pointless really. And very tedious. I've never needed to automate a web browser for anything other than testing so perhaps I'm missing something here.
If you're interested in web testing and automation I'd recommend researching the Page Object Pattern.
Here's where you could automate personal web browsing:
If you bank online and want to monitor your books without doing the majority of the work, you can create a file structure that would have an encryption key for your passwords to your bank accounts, that would then go to the different locations, find your expenses and plug them into a spreadsheet, providing an expense report for the month.
Wow! he wrote the Automate the Boring Stuff! That's my favorite book, I don't think I'd be here if I didn't read that book haha.
Your book is awesome.,.
AI is a great teacher. He teaches awesome programming to everyone, most wouldn't even be programming if it wasn't for him.
super cool talk. Selenium looks awesome. will be trying it out. Thanks!
Great talk!
very nice tool, but there's pywinauto that works directly on win controls.
PYwinauto is windows only. He wanted something cross platform.
Bought his book. Have to start reading it.
Thanks for the free book, i lost my job so free stuff helps ^-^
Great presentation! Live demo rockstar! I read the book as an intro. Very well written! Thanks!
U r awesome sir love that. Tnx for those all u done with python using selenium and pyautogui. It's help me a lot to get deep into python. Make more videos related this. I'll be greatful to you.
I also learnt python from this book..
🤖
And today's I'm a python Django developer
.
Firefox 45 and Selenium 2.53.1 will work with auto-install. Took me two days to figure it out! Windows 10 Python Firefox.
Just felt happy by seeing below letter on your laptop. There is meaning for below letters.
ಠ_ಠ. ಠ is one of the Consonant letter in Kannada Language.
I read the book and it is really a great python book, beginners should read it
Started watching this & I'm reading the book without realising this is the author!
how would you search for certain information in a page source with sellenium? like an url
I have installed Python and PIP correctly, all showing up in the CMD, updated and everything. Installed selenium using PIP, fully set and everything, even in the python folder, it's showing up.
Though, after all of that, the python script does not run properly and shows this as the error message. Any help would be appreciated!
Code >
from selenium import webdriver
driver = webdriver.Chrome()
Error Message >
Traceback (most recent call last):
File "C:/Users/MyName/PycharmProjects/Test project/Test Script Selenium.py", line 1, in
from selenium import webdriver
ModuleNotFoundError: No module named 'selenium'
I assume that you are running Python 3.x
As a mac user, I know that any command where you want to affect Python 3.x instead of saying python you say python3.
So try running pip3 install selenium.
"Selenium" sounds like a "group-2 element"
Beryllium-Magnesium-Calcium-Strontium-Barium-Radium
Selenium...
Look at the element with atomic number 34 on the periodic table
If you Ctrl + Alt + Del then it will also stop the program, so in a way this is a hot key to stop all pyautogui programs too.
How to install PythonAutoGui in Python 3+ (Anaconda environment)?
Amazing module! Al is awesome!!
Great talk. A very interesting presentation.
Wow! I have used selenium, but this is awesome stuff! Thanks!
Thank you Al!
Thank you Al for your videos, This was very helpful
Beautiful talk.
Grate demo by you. Can you resolve auto search multiple, word from checklist and highlight in word. And reverse check whole document against list and highlight in list. This will be most useful for researchers. Fro cross check this task manually takes many days for 500 pages. Your help will be much valuable to me and to the world.
Do it yourself.
Very good video. I wanted to use Pyautogui to automate my desktop application. It works fine with pyautogui. I wanted to know how I can get the test results logged to a report or something with a Pass or Fail. I also like to know whether I can use a Test Framework for this using pyautogui.
Thanks
Good presentation. You've made some great stuff. I've experimented a bit with pyautogui and I wanted to know if with displayMousePosition is it supposed to return Nan for the RGB values if you use it with extended screens in a two monitor setup?
Says your book is freely available? But I only see buy buttons on there
Bret Hagen It is. Just look up "Automate the boring stuff with python PDF" and it'll show up
automatetheboringstuff.com/
Bought Al's books for the simplicity and audience he addresses which is me, hobbyist. Don't want to be a programmer just looking for tools to make my life simpler and not in need of a semester to remember how I did something.
My ideas are easy for me to formulate finding out if there is a way to carry out such an idea not so much.
I am constantly storing away nuggets (URLs) for my review or as reference material, unfortunately, it is rather a labor-intensive to find them based on a simple search (of course unless I have missed some rudimentary method for doing so).
There are times when I can not remember the names of the URL's in question but only basic parts of the subject matter embedded in the reference material.
How does one go about this search with in ones bookmarks(where my nuggets reside)?
I done Webgui automation on 2014 it has been uploaded in TH-cam. Am expecting more and more flexible way.
Great demos
Thank you very much for sharing such an informative and interesting video.
If. Check. Light blink in web game. How to check?
somehow webdriver.Chrome() doesnot work, undefined Chromedriver. Even if i add path to chromedriver it does not work.
i sometimes forget to browser. get( " ")
Clear, concise, simple. Thank you.
Is Selenium a bad idea for long term progress as a programmer since it shields you from learning harder stuff?
Now I'm curious as to what the thing is that he keeps "not showing".
Probably some helpful Windows helper such as Clippy.
"He that shall not be named"
Hii..sir how to work with function keys(f1,f2...etc)
Please help me out with this.
I think it can be usefull to trace pictures in illustrator from normal drawings using OPEN CV :D
what happens if i resize the apps afterward, can it still detect the button that i screenshot before?
I wanted to block web sites on chrome after analyzing the content of web page by python
it is possible
no
Al is great!
can you use pyautogui with full screen applications?
nice video mate. thoroughly enjoyed it as well as your udemy course.
Is it actually pronounced "goo-ee"? I always pronounce it "gwee". Or just "jee, yoo, ai", if i'm trying to sound technical.
Hunter Lee: I’ve only ever heard it as he used it. Personally my brain spells it out when I read/say it.
It's "jee yoo ai" but people call it "goo ee" because it's shorter and easier to say
...I' really like the attention to detail that programming required", and miss type Like as Liek, what a legend!!, pretty sure was on purpose.
This guy is AMAZING
how did no one laugh at 1:58?
@Bigtombowski :)
the nerds were trying to fix the issue
I don't understand how nobody laughed at 0:28
because they we disappointed it didnt work and he was poorly prepared
How to use it with google docs?
what should I do. to install them? this " pip install pyautogui" and " pop install selenium" dont work
@@advaitvariyar thank you. I installed pip test and it works now
How do you webdriver.Firefox without getting 10 million lines of error code?
Now i can practice programming while playing games! will flash games :(
pip install webdriver-manager
Now the above code in the question will work simply with below change,
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
driver = webdriver.Chrome(ChromeDriverManager().install())
The same can be used to set Firefox, Edge and ie binaries
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'webdriver_manager'
Another Great GUI Programming tool:Sikuli
DoEs pyautogui can read values from desktop app based on objects available in app ?
Is there way to open paint by code, instead of manually opening it?
You can use an os.system call or a subprocess.call. Languages other than Python usually have similar ways to do system calls.
Hi, i have been playing around with pyautogui and selenium with python and also completed an automation project for sap but i could not figure out as to how run the pyautogui script in background, that is I am unable to do some other activity while the script runs. Is there any solution?
Nice talk! Thanks!
PyAutoGui supports .Net applications ?
On my Mac , how to get the selenium installed? what IDE to use?
U can use python idle terminal....
Just type.. pip3 install selenium for Mac
with the help of this video i made a progrmm that installs an adblocker and then rickrolls you xD
is it good if i watch in now in 2021 ?
I got an WebDriverException how to fix it
does puautogui still work? i just tried to do the thing he shows off at 14:50 but the pip install of pyautogui seems to be broken
No matter what else was said, I can't get over how he pronounced it heighth at 23:43
Master in programming..
This guy is really awesome :)