ฝัง
- เผยแพร่เมื่อ 16 ก.ย. 2016
- There's a lot of data on the web and in your desktop apps, but accessing it can involve a lot of tedious typing and clicking. This talk is an introduction to the Selenium and PyAutoGUI modules, with live demos straight from the interactive shell. Al Sweigart explains web scraping techniques and programmatically controlling the keyboard and mouse to automate these tasks for you.
Abstract
The internet and personal computer are central tools in many jobs, including professions outside of engineering. This makes web scraping and GUI automation are relevant to not just developers and QA testers, but academics, organizers, and office workers. This talk is an introduction to Selenium and PyAutoGUI modules. and programatically controlling your browser and desktop applications from Python.
Web scraping and GUI automation frameworks have an intimidating reputation for a steep learning curve. While they do have many sophisticated features, the basics that most folks will ever need can be covered in a single presentation.
This presentation has multiple live demos to showcase these modules straight from the interactive shell.
The content from this talk is derived from Automate the Boring Stuff with Python, a beginner's Python book freely available under a Creative Commons license at automatetheboringstuff.com
Bio
Al Sweigart is a software developer and the author of Automate the Boring Stuff with Python, Invent Your Own Computer Games with Python, Making Games with Python & Pygame, and Hacking Secret Ciphers with Python. These books are freely available under a Creative Commons license at inventwithpython.com. Al enjoys haunting coffee shops, writing educational materials, cat whispering, and making useful software. He lives in San Francisco.
speakerdeck.com/pybay/2016-al... - วิทยาศาสตร์และเทคโนโลยี
I highly recommend his book. It got me back into programming after a 17-year hiatus.
You encourage me as well. I felt dummy on programming.
For us beginners watching in 2022, at the 6:30 minute mark the selenium commands are out of date. It now looks like: driver.find_element(By.ID," "). Here's a recent short tutorial video with the new commands: th-cam.com/video/p24C_0d8FcQ/w-d-xo.html&t
I've just built a program to extract FX data automatically from MT5 using this PyAutoGUI. It took about 2 hours to write the code as there are no keyboard short cuts in the popup window. Works like a charm. It 'automates the boring stuff', as I need to do this task monthly! thanks Al
This is my very humble teacher.
I leant virtually everything I know in python from him.
True
My very first programming class used one of his books as a textbook called "Invent Your Own Computer Games with Python." I just recently started using pyautogui and literally just found out he also wrote it. Pretty low-key humble guy.
Great video. After I watched this I got the motivation to really dig in to both selenium and pyautogui and I have already automated so much.
I used to hate coding before reading Automate Boring stuff with Python, it was fun though and Now I am watching videos on Selenium!! thank you, Mr. Albert, for making fun from boring bits!!
Awesome guy. I love people that legitimately want to help others learn with few or no strings attached.
His book is killer! One of my all time favorites when I'm trying to show someone why they should be interested in Python.
Which book ?
Please mention name ?
@@ayeshavlogsfun Automate the boring stuff with Python
Al Sweigart, Hero. Thank you for writing such an awesome book(s)!
Al thank you so much for making PyAutoGui. You're a real hero.
I owe this man everything... I learnt how to code from his book, 'Invent Your Own Games With Python' back when I was a kid.
Great book. Great talk. What kind of person "thumbs down" this video? I hope you choose to pass on more of your knowledge in such a manner. You are a very good instructor. Thank you!
This man's voice is really soothing.
I thought the same too.
Me too!
It makes me feel good about life.
"Hi, I'm AI." Whoa! That's some good AI. At first I was convinced you were an organic human.
Al, you are an amazing teacher! Thank you.
this is the video I am searching for years
Thanks, I really enjoyed this talk, a remember me to have fun and remove from my mind the cliché of "everybody should learn to code".
Thank for the great info, I'm just learning Python and found this and got it working. I'll be looking at your book.
Al is an excellent teacher!
Great presentation! Live demo rockstar! I read the book as an intro. Very well written! Thanks!
super cool talk. Selenium looks awesome. will be trying it out. Thanks!
I have installed Python and PIP correctly, all showing up in the CMD, updated and everything. Installed selenium using PIP, fully set and everything, even in the python folder, it's showing up.
Though, after all of that, the python script does not run properly and shows this as the error message. Any help would be appreciated!
Code >
from selenium import webdriver
driver = webdriver.Chrome()
Error Message >
Traceback (most recent call last):
File "C:/Users/MyName/PycharmProjects/Test project/Test Script Selenium.py", line 1, in
from selenium import webdriver
ModuleNotFoundError: No module named 'selenium'
I assume that you are running Python 3.x
As a mac user, I know that any command where you want to affect Python 3.x instead of saying python you say python3.
So try running pip3 install selenium.
Greatest programming teacher.
I finished your book today it was one of the greatest book I've ever read, Thank you for this amazing book.❤❤❤
I was trying to do some desktop automation with tools like pywinauto... It was h a r d. With pyautogui I achieved what I needed literally within 5 minutes... Thanks Al!
Great talk. A very interesting presentation.
protect this guy at all costs!
Great talk!
Thank you Al for your videos, This was very helpful
Thank you very much for sharing such an informative and interesting video.
U r awesome sir love that. Tnx for those all u done with python using selenium and pyautogui. It's help me a lot to get deep into python. Make more videos related this. I'll be greatful to you.
I love python so much. So much to learn in it yet so much fun to learn. It’s simple, sweet, efficient and fun to use. I was so interested in front end but now I’m basically sold on being a backend with python or an engineer in general rocking python in my career
Wow! I have used selenium, but this is awesome stuff! Thanks!
Beautiful talk.
I would highly recommend his book, I bought it and its simple to follow and read.
Amazing module! Al is awesome!!
Great demos
Great talk. There is an interesting live demo using MS Paint at time 17:30. Do not miss it.
I liek the attention to detail as well. Its my favourite part.
AI is getting me really interested in learning Python.
Look I'm not the one to write replies or even reviews, but I can't help myself after discovering this man and reading your comment. I was on /r/python on reddit, looking into what resources were out there to start learning. I came across MITs OCW program and figured what a blessing...and MIT education for free. I went through about 3-4 lecture's before going back on the subreddit and came across someone mentioning his book "How to automate the boring stuff."
If you've ever asked yourself where to get started on learning how to code, sign up for his course on Udemy. It's $10 if you use his discount code on www.automatetheboringstuff.com. If you are unable to afford that, you can read the text for free. He does move very quickly through the video's but he makes it SO easy to understand. What took me a week with the MIT course, I learned in a few hours with Al.
I am amazed that this man is not the face of coding in general. Do yourself a favor this year and sign up, you will get lifetime access. I started today and am already halfway through his course. I never would have thought it was this easy nor would I be this intrigued. Thanks, Al.
python = plain english
It's the reason I program in Python
Same
Nice talk! Thanks!
Your book is awesome.,.
Wow! he wrote the Automate the Boring Stuff! That's my favorite book, I don't think I'd be here if I didn't read that book haha.
Good presentation. You've made some great stuff. I've experimented a bit with pyautogui and I wanted to know if with displayMousePosition is it supposed to return Nan for the RGB values if you use it with extended screens in a two monitor setup?
AI is a great teacher. He teaches awesome programming to everyone, most wouldn't even be programming if it wasn't for him.
Thanks for the free book, i lost my job so free stuff helps ^-^
nice video mate. thoroughly enjoyed it as well as your udemy course.
Bought his book. Have to start reading it.
Thank you Al!
Thank you, very helpful
how would you search for certain information in a page source with sellenium? like an url
How to install PythonAutoGui in Python 3+ (Anaconda environment)?
I Like your video. Thanks you so much.
Al is great!
I use AutoIt to automate the boring stuff, but only for Windows and it can be used to scrape stuff from the internet as well, not to be underestimated one can also create fully fledged GUI's. To avoid mouse move/click and sorcerers apprentice phenomena autoit is able to locate Windows program controls and programmatically activate them.
I read the book and it is really a great python book, beginners should read it
DoEs pyautogui can read values from desktop app based on objects available in app ?
Instructions for installing, for those who are beginning with pyautogui: Go to pypi.python.org/pypi and search for "pyautogui" from there download "PyAutoGUI-0.9.36.tar" then (if not already) drag to download files (easy way for me)from the left side of file explorer, then Left shift-right click on downloads then click on "open command window here" then type where you have your python file (bear in mind that it only works well on python versions that are 3.4 or lower) e.g C:/python27/Scripts/pip install py(press tab) then once the full name pops up ("PyAutoGUI-0.9.36.tar") press "Enter" on your key board, it should be installing/downloading from there(it usually takes a minute or two on a slow system)
This is for windows but other users should get an idea of what they should do with this info.
can you use pyautogui with full screen applications?
This guy is AMAZING
Firefox 45 and Selenium 2.53.1 will work with auto-install. Took me two days to figure it out! Windows 10 Python Firefox.
Started watching this & I'm reading the book without realising this is the author!
AMAZING!
Another Great GUI Programming tool:Sikuli
what happens if i resize the apps afterward, can it still detect the button that i screenshot before?
learnt a lot. really nice talk.
Bought Al's books for the simplicity and audience he addresses which is me, hobbyist. Don't want to be a programmer just looking for tools to make my life simpler and not in need of a semester to remember how I did something.
My ideas are easy for me to formulate finding out if there is a way to carry out such an idea not so much.
I am constantly storing away nuggets (URLs) for my review or as reference material, unfortunately, it is rather a labor-intensive to find them based on a simple search (of course unless I have missed some rudimentary method for doing so).
There are times when I can not remember the names of the URL's in question but only basic parts of the subject matter embedded in the reference material.
How does one go about this search with in ones bookmarks(where my nuggets reside)?
Hi, i have been playing around with pyautogui and selenium with python and also completed an automation project for sap but i could not figure out as to how run the pyautogui script in background, that is I am unable to do some other activity while the script runs. Is there any solution?
Master in programming..
Now i can practice programming while playing games! will flash games :(
I also learnt python from this book..
🤖
And today's I'm a python Django developer
.
PyAutoGui supports .Net applications ?
I done Webgui automation on 2014 it has been uploaded in TH-cam. Am expecting more and more flexible way.
Clear, concise, simple. Thank you.
Very good video. I wanted to use Pyautogui to automate my desktop application. It works fine with pyautogui. I wanted to know how I can get the test results logged to a report or something with a Pass or Fail. I also like to know whether I can use a Test Framework for this using pyautogui.
Thanks
Just felt happy by seeing below letter on your laptop. There is meaning for below letters.
ಠ_ಠ. ಠ is one of the Consonant letter in Kannada Language.
does puautogui still work? i just tried to do the thing he shows off at 14:50 but the pip install of pyautogui seems to be broken
How do you webdriver.Firefox without getting 10 million lines of error code?
I hope we can laugh at ourselves: 8:02
Good content!
Hii..sir how to work with function keys(f1,f2...etc)
Please help me out with this.
Thanks
Nice!
You are amazing
I got an WebDriverException how to fix it
very nice tool, but there's pywinauto that works directly on win controls.
PYwinauto is windows only. He wanted something cross platform.
This guy is really awesome :)
Grate demo by you. Can you resolve auto search multiple, word from checklist and highlight in word. And reverse check whole document against list and highlight in list. This will be most useful for researchers. Fro cross check this task manually takes many days for 500 pages. Your help will be much valuable to me and to the world.
Do it yourself.
Nice talk. As someone that works in QA my advice for anyone serious about automation would be to use or create your own framework. Simply automating a web browser with a few scripts is kinda...pointless really. And very tedious. I've never needed to automate a web browser for anything other than testing so perhaps I'm missing something here.
If you're interested in web testing and automation I'd recommend researching the Page Object Pattern.
Here's where you could automate personal web browsing:
If you bank online and want to monitor your books without doing the majority of the work, you can create a file structure that would have an encryption key for your passwords to your bank accounts, that would then go to the different locations, find your expenses and plug them into a spreadsheet, providing an expense report for the month.
Cool!
Cool guy
Learned python from his book
I wanted to block web sites on chrome after analyzing the content of web page by python
it is possible
no
I think it can be usefull to trace pictures in illustrator from normal drawings using OPEN CV :D
Is there way to open paint by code, instead of manually opening it?
You can use an os.system call or a subprocess.call. Languages other than Python usually have similar ways to do system calls.
How to use it with google docs?
What a legend
Nice :)
On my Mac , how to get the selenium installed? what IDE to use?
U can use python idle terminal....
Just type.. pip3 install selenium for Mac
If. Check. Light blink in web game. How to check?
is it good if i watch in now in 2021 ?
Its really nice.. Can you please let me know can we extract text from screen i,e silverlight or adobe flash enabled page (I mean text interpretation of image).
Ye you should
Ya you should