I agree with many comments that say this is not for beginners. Beginner implies someone with no experience could do it. Its not a full beginner course.
It doesn’t matter if we know the concepts if we don’t know how to apply these tools. It’s okay you know Python, you know all the fundamental, now go make something with it, but what do you right? How do you develop your skills that would eventually land a job at a tech company? That’s an entirely different story. Most of the time, people are just wasting their time attempting to figure out ‘the path.’ Wouldn’t it be amazing to just know, this is the projects you’ll need to make to solidify specific skills. From there, you’ll branch out to other languages, and eventually landing a coding job. Unfortunately, it’s a headache knowing where to begin. The tech industry feels like a place where the people who were great at coding were groomed from the beginning, they already have this established path from relatives who went through this. There’s so much information out there on the internet (amazing), but you don’t know which you should focus your time and energy on.
I am a beginning python programmer and Jupyter that he is using in pycharm is free for 30 Days but mine is still installing and Frank is explaining everything as if you have already installed it so be sure and wait for it to completely upgrade your pycharm I am using the free pycharm too.
Automation isn't something that a beginner should do either way. They should first play with some basic codes. Here beginner is used in the sense that someone who knows how to code in python but has never done any kind of automation
@@Icarus47249fd You have some really good points there. I have been learning since long. I had my ups and downs. I felt I was lacking projects. Even though my goal is to land a job as a data analyst or product analyst I am definitely going to add an automation project to my CV. I have seen people talking about automation in data industry. Nowadays there are tools to do this at the click of a button but knowing how to do it using code is a another level of expertise.
I want to thank freeCodeCamp and Frank for demonstrating this. I am taking a course and just learning syntax and to be honest it was difficult to hold my attention. But with the first few minutes of watching this video I feel like your way is so much more effective. I'm learning how to do something that is modern and that I can follow right away. Please keep these videos coming!
00:00 Learn Python automation with pandas library 07:05 Learn how to extract tables from PDFs using Camelot library 20:53 Learn HTML basics and XPath for effective web scraping 28:02 Learn how to use expat expressions with HTML code 41:43 Automate website using Selenium 4 48:01 Learn how to extract specific elements using XPath 1:00:13 Learned how to locate and extract elements from a website 1:06:23 Extract and export headlines to CSV using Pandas 1:18:42 Preparing script for executable file 1:25:11 Learn how to customize file names using f-strings and concatenate variables. 1:37:46 Learn how to schedule an executable file to run at any time using Chrome Tab Guru 1:43:56 Created a pivot table and exported it to an Excel file 1:56:10 Create a bar chart for sales by product line 2:02:12 Learned how to create bar charts and formulas using OpenPyXL in Python. 2:14:24 Learned how to create formulas in a spreadsheet using Python 2:20:29 Convert Python script to executable 2:32:25 Automate Excel reports and send WhatsApp messages using Python 2:38:24 Learned how to send messages in WhatsApp to contacts and groups using Pi WhatKit
FYI: unless using JUPYTER, you'll need to print out the tables. Typing _len(simpsons)_ on it's own won't produce any results. Instead, type _print(simpsons)._
Now am learning the basics of Python like variables & inputs & loops, classes, dictionaries, etc. I guess i have to build good background before moving to Automation
Thank you!!! Previously when I was learning Python, all the past references were for older version Selenium 3. I was facing difficulty with launching selenium. Now we have a proper guide thank you!
When you are describing something that is shown in the screen, it would be easier for the viewers to follow if you use some kind of pointer (e.g. a highlighted mouse pointer) instead of just plainly saying the description -- noticed this in explanation of xpath syntax; too many descriptions that didn't stick to mind.
Well done, I could binge it. Easy to use framework, perfect explained. I feel like I can replicate it without knowing anything about python code before. Automate loops like Dr. Frankenstein and call it Cleon 1.0
Yo this helped so much and I always appreciate the content and when i found the channel and got the energy from you from the previous video, you've been nothing but real and can vouch for the amazing content and how down to earth you are with everything! All the most love, respect, and appreciation
I‘m at 1:17 and first i have to say something: THANK YOU FOR USING A PROPER MIC!❤ Cheeses crisis, the last 5 Videos I watched before, there have been people, without proper English speaking or the worse mic quality or a combination of both. Or a lady which hammered her keyboard right beside the microphone. How should someone proper learn from that content? 1:52 Okay the CTRL Key seems to be right beside your mic right? Each time to copy or paste something it‘s clear you pressed a key very loud. 3:00 what happened? You sound so much quieter 8:53 But if i turn it up it‘s okay. Anyway it‘s a way better video than the other ones i watched before! 19:29 i love that someone really specifies all the tags you find in that chaos of a modern website, very well explained 👍 Gone through the whole video and it was VERY interesting 😮 thanks for that tutorial
Some of this information was neat and helpful, but I definitely felt like it wasn't well paced. There was a lot of "I've shown this before so I'll go over it really quick" that we literally didn't get to see
Hi everyone! First of all, thank you guys for this amazing content that you keep delivering! You are the world's No 1 free school for learning Tech! Now to my question: i run the first 2 programs with success but it doesn't give me the output as in the video. Doesn't matter if i rung it from VS Code, git bash or cmd. The program runs successful but the output is not as expected with the lists. Can you someone help?
Errors with extracting tables from PDF's: In order to get it to work on current versions I needed to (in my notebook): ``` !pip install tk !pip install ghostscript !pip install 'PyPDF2
Hi, I don't know if I have chance to get an aswer but I still ask. I just finished my web scrapping automation in python using selenium. The automation should search for some items and extract the data like price, date etc. The scrapped data should be exported in an excel file and also is a exception when the data for an item is not found the item needs to be exported with "No data" . I run some test but from 5 runs only 3 are correct, sometimes the items are skipped even though the data is availbale for them. I tried to slow the code, to increase the load page time, to use different methods to locate the element from which I need the data to be extracted, but nothing seems to work very good. Any advice? Thanks!
Hi all, I am using Python 3.7 and pycharm, installed pandas, entered the code for the first project (table Extraction) it is showing "Process finished with exit code 0 " but not showing the extracted tables, any idea? regards
well idk about pycharm but printing a dataframe in colab becomes hella messy it only properly prints out if u just type the dataframe variable name@@mikerobin8410
I followed the tuto by doing, until I installed "camelot". It didn't work at all. It issued an error regarding a deprecated version of a internal function. I searched through several forums but none of the troubleshootings worked properly. Even after a note issued by the developers yesterday, presenting another troubleshoot, I wasn't able to make camelot work at all.
This video should be updated what to do when the chromium browser doesn't have the latest version of Chrome (mine is 118, the highest it goes to on the website is 114), and the fact that headless mode as the video shows it has been deprecated.
This is incomplete. It lacks a README to describe how to setup an environment you can run these examples. It assumes all the Python libraries needed to do these exercises are already installed and that the student knows how to install them. 1st video uses jupyter-lab notebook but says nothing on how to install it. 2nd video uses a traditional editor with code completion but no mention as to which one. I'll review the other exercises and send you mods I made to your repo that I forked.
@baya Than maybe “Full course for beginners” isn’t the most accurate title for the tutorial? Thanks to the op for making the effort to fill in some of the gaps.
@@arthur_p_dent4282 automation is not a "basic" or beginner friendly itself it is concluded that you have basic knowledge about python already if you are about to go directly to automation then it is basically idiotic in itself and that's self explanatory
Hi, tks for your lectures After finishing lesson Automate the news- exporting data at 1:30, file headline.csv only shows many the same contents in all rows, could u tell me how to fix it. Tks
So, I faced issues with the Camelot library. The output is Ghostscript is not installed, although it is installed. I cannot install Tk either through pip3 and brew. Already spent so much time troubleshooting the issue. I am giving up and proceeding to the next.
Hey thanks! In the scraping part, what do you do with this error: "ERROR: Couldn't read tbsCertificate as SEQUENCE" "ERROR: Failed parsing Certificate" ?
Need help. Table extraction is not working from pdf. It shows no such directories found. And if i put the full directory path instead of just the file name, it gives error saying "'unicodeescape' codec can't decode bytes"
⌨️ (0:00:00) Intro
⌨️ (0:00:31) Project #1 Table Extraction - Extract Tables from Websites
⌨️ (0:02:53) Table Extraction - Extract CSV Files from Websites
⌨️ (0:09:38) Table Extraction - Extract Tables from PDFs
⌨️ (0:13:06) Project #2 - Web Automation & Web Scraping - HTML Basics - Tags and Elements
⌨️ (0:20:57) Web Automation & Web Scraping - HTML Basics - Tree Structure
⌨️ (0:24:22) Web Automation & Web Scraping - XPath - Syntax, Functions and Operators
⌨️ (0:28:06) Web Automation & Web Scraping - XPath - Test Your XPath
⌨️ (0:33:38) Web Automation & Web Scraping - XPath - Special Characters and Syntax
⌨️ (0:38:17) Automate The News - Installing Selenium and ChromeDriver
⌨️ (0:40:34) Automate The News - Creating The Driver
⌨️ (0:44:46) Automate The News - Finding Elements
⌨️ (1:04:34) Automate The News - Exporting Data to a CSV File
⌨️ (1:12:34) Automate The News - Headless mode
⌨️ (1:18:18) Automate The News - Preparing Script to Be Run Everyday
⌨️ (1:30:17) Automate The News - Convert py to exe
⌨️ (1:37:18) Automate The News - Schedule Python Script with crontab (masOS)
⌨️ (1:42:16) Project #3 - Automate Excel Report - Create a Pivot Table with Python
⌨️ (1:49:42) Automate Excel Report - Add a Barchart
⌨️ (2:05:02) Automate Excel Report - Write Excel Formulas with Python
⌨️ (2:19:18) Automate Excel Report - Format Cells
⌨️ (2:23:04) Automate Excel Report - Convert Pivot Table to Excel Report
⌨️ (2:25:32) Automate Excel Report - Generate Excel Reports with One Click (py to exe)
⌨️ (2:33:22) Project #4 - Automate WhatsApp
Thanks mate
Thanks
Thank you..
Hey, is this something that you typed out manually or is it something you were able to use code to get?
@@josephlee6865 He copy pasted it from the description...
I agree with many comments that say this is not for beginners. Beginner implies someone with no experience could do it. Its not a full beginner course.
It doesn’t matter if we know the concepts if we don’t know how to apply these tools. It’s okay you know Python, you know all the fundamental, now go make something with it, but what do you right? How do you develop your skills that would eventually land a job at a tech company? That’s an entirely different story. Most of the time, people are just wasting their time attempting to figure out ‘the path.’ Wouldn’t it be amazing to just know, this is the projects you’ll need to make to solidify specific skills. From there, you’ll branch out to other languages, and eventually landing a coding job. Unfortunately, it’s a headache knowing where to begin. The tech industry feels like a place where the people who were great at coding were groomed from the beginning, they already have this established path from relatives who went through this. There’s so much information out there on the internet (amazing), but you don’t know which you should focus your time and energy on.
I am a beginning python programmer and Jupyter that he is using in pycharm is free for 30 Days but mine is still installing and Frank is explaining everything as if you have already installed it so be sure and wait for it to completely upgrade your pycharm I am using the free pycharm too.
Automation isn't something that a beginner should do either way. They should first play with some basic codes. Here beginner is used in the sense that someone who knows how to code in python but has never done any kind of automation
@@Icarus47249fd You have some really good points there. I have been learning since long. I had my ups and downs. I felt I was lacking projects. Even though my goal is to land a job as a data analyst or product analyst I am definitely going to add an automation project to my CV. I have seen people talking about automation in data industry. Nowadays there are tools to do this at the click of a button but knowing how to do it using code is a another level of expertise.
I want to thank freeCodeCamp and Frank for demonstrating this. I am taking a course and just learning syntax and to be honest it was difficult to hold my attention. But with the first few minutes of watching this video I feel like your way is so much more effective. I'm learning how to do something that is modern and that I can follow right away. Please keep these videos coming!
what a perfect time, i just started python
Same here ✌️✌️✌️✌️
same here, really need this 😂
Welcome to the club
For those of you getting a certificate error :
import ssl
ssl._create_default_https_context = ssl._create_unverified_context
^ Worked for me :D
Please keep this excellent job up! As someone who loves python and currently learning it, this material is pure diamond!!
these kind of real world applications of python are real gold, i look forward to them
This is way batter than I expected. Kudos.
I think this course may be for people that are beginners in automation, not necessarily beginners in python. That being said, great course!
00:00 Learn Python automation with pandas library
07:05 Learn how to extract tables from PDFs using Camelot library
20:53 Learn HTML basics and XPath for effective web scraping
28:02 Learn how to use expat expressions with HTML code
41:43 Automate website using Selenium 4
48:01 Learn how to extract specific elements using XPath
1:00:13 Learned how to locate and extract elements from a website
1:06:23 Extract and export headlines to CSV using Pandas
1:18:42 Preparing script for executable file
1:25:11 Learn how to customize file names using f-strings and concatenate variables.
1:37:46 Learn how to schedule an executable file to run at any time using Chrome Tab Guru
1:43:56 Created a pivot table and exported it to an Excel file
1:56:10 Create a bar chart for sales by product line
2:02:12 Learned how to create bar charts and formulas using OpenPyXL in Python.
2:14:24 Learned how to create formulas in a spreadsheet using Python
2:20:29 Convert Python script to executable
2:32:25 Automate Excel reports and send WhatsApp messages using Python
2:38:24 Learned how to send messages in WhatsApp to contacts and groups using Pi WhatKit
Finally a Python Automation Course from freeCodeCamp!!! 👍
I never skip add on this channel because it help the channel that provides priceless video
This code instructor is amazing!!!
FYI: unless using JUPYTER, you'll need to print out the tables. Typing _len(simpsons)_ on it's own won't produce any results. Instead, type _print(simpsons)._
Dear Frank Andrade, thanks a lot for sharing the Automation Cheat Sheet. Congrats for this class that is amazing!
hi i'm a student can you share me the cheetsheet please.
Awesome, this channel is one of the best learning sources on the internet.
This is the best I have seen on python automation. Kudos for the good job
I'm hooked. A thousand years away from assembler, COBOL, Fortran, Pascal. Champagne vs. cheap beer.
Perfect timing, Im gonna listen to this like a podcast
I think is fine. It is beginning in automation. If you are beginner in phyton then go check those videos first
Now am learning the basics of Python like variables & inputs & loops, classes, dictionaries, etc. I guess i have to build good background before moving to Automation
Thank you!!! Previously when I was learning Python, all the past references were for older version Selenium 3. I was facing difficulty with launching selenium. Now we have a proper guide thank you!
Undoubtedly, Python is the king Programming Language for data processing ......
When you are describing something that is shown in the screen, it would be easier for the viewers to follow if you use some kind of pointer (e.g. a highlighted mouse pointer) instead of just plainly saying the description -- noticed this in explanation of xpath syntax; too many descriptions that didn't stick to mind.
What about LASERS!!!@!@@@@
And duck hunt.
This can be solved with over engineering
SUBSCRIPTION LASERS!!!!!!!
Agreed, Finally someone telling it like it is instead of fanboying
About to end all my teammates' careers with the learnings from this video ayyyy
OMG!!!! This is the course that I have always hoping for.😆
Thank you for the whole tutorial 🫡
Well done, I could binge it. Easy to use framework, perfect explained. I feel like I can replicate it without knowing anything about python code before.
Automate loops like Dr. Frankenstein and call it Cleon 1.0
Wow very useful i will complete it after finishing with 8 sem exams
Yo this helped so much and I always appreciate the content and when i found the channel and got the energy from you from the previous video, you've been nothing but real and can vouch for the amazing content and how down to earth you are with everything! All the most love, respect, and appreciation
Thank you for this tutorial!
TNice tutorials was an amazing tutorial. You are a great teacher
This is actually insane, thank you!!!
I‘m at 1:17 and first i have to say something: THANK YOU FOR USING A PROPER MIC!❤ Cheeses crisis, the last 5 Videos I watched before, there have been people, without proper English speaking or the worse mic quality or a combination of both. Or a lady which hammered her keyboard right beside the microphone. How should someone proper learn from that content?
1:52 Okay the CTRL Key seems to be right beside your mic right? Each time to copy or paste something it‘s clear you pressed a key very loud.
3:00 what happened? You sound so much quieter
8:53 But if i turn it up it‘s okay. Anyway it‘s a way better video than the other ones i watched before!
19:29 i love that someone really specifies all the tags you find in that chaos of a modern website, very well explained 👍
Gone through the whole video and it was VERY interesting 😮 thanks for that tutorial
After learning from 12hrs. Video now I think 2hrs. Video is shorter for me I can easily learn from them ♥️😀🖐️
This is what I needed. Thank u❤️
Some of this information was neat and helpful, but I definitely felt like it wasn't well paced. There was a lot of "I've shown this before so I'll go over it really quick" that we literally didn't get to see
Nice video to just binge. Thanks for this
I wish we get Python, Playwright someday !!
Where was the table.pdf located before exporting into CSV when extracting the table from the PDF project? Inside the Python project?
Woot! Thank goodness, I needed this back on my computer! Thank you!! :D
Awesome video! Will definitely get to do some of these :D
How funny there are a lot of people still think that universities are for learning and so content is free and more
Hi everyone! First of all, thank you guys for this amazing content that you keep delivering! You are the world's No 1 free school for learning Tech! Now to my question: i run the first 2 programs with success but it doesn't give me the output as in the video. Doesn't matter if i rung it from VS Code, git bash or cmd. The program runs successful but the output is not as expected with the lists. Can you someone help?
Nothing but ❤ for this course
12:40 39:35 47:35 2:22:27 2:30:50 2:32:00
Wow. I am currently learning automation, great timing for the vid
For the projects . Can they be converted as an API or a tool . if they can , How to do it?
Set to Speed 1.5x and you'll be able to cram the whole video in an hour
Quick maths
THKS!!!!! I WILL CHECK THIS VIEO AFTER MY OFFICE HRS!!!
i was reading this as a blog just yesterday
Errors with extracting tables from PDF's:
In order to get it to work on current versions I needed to (in my notebook):
```
!pip install tk
!pip install ghostscript
!pip install 'PyPDF2
this helped tremendously. THANK U
you guys can read my mind i swear
Just what I needed
Can u please teach ,how to scan a barcode and insert data into a database along with timestamp of login and logout.
Hi, I don't know if I have chance to get an aswer but I still ask.
I just finished my web scrapping automation in python using selenium. The automation should search for some items and extract the data like price, date etc. The scrapped data should be exported in an excel file and also is a exception when the data for an item is not found the item needs to be exported with "No data" . I run some test but from 5 runs only 3 are correct, sometimes the items are skipped even though the data is availbale for them. I tried to slow the code, to increase the load page time, to use different methods to locate the element from which I need the data to be extracted, but nothing seems to work very good. Any advice? Thanks!
nice tutorials sir
i wanted to ask if there is a library to fetch images online...
are the libraries installable on python 3.11 ? My work laptop has python 3.11 with the NodeJS i got installed.
Camelot doesnt work after installing, it gives me error 'AttributeError: module 'camelot' has no attribute 'read_pdf''. I am using a jupyternotebook
Hi all,
I am using Python 3.7 and pycharm, installed pandas, entered the code for the first project (table Extraction) it is showing "Process finished with exit code 0 " but not showing the extracted tables, any idea?
regards
print the output to your console
well idk about pycharm but printing a dataframe in colab becomes hella messy it only properly prints out if u just type the dataframe variable name@@mikerobin8410
thanks very much i hope this tutorial would be helped ,thanks a lot
I followed the tuto by doing, until I installed "camelot". It didn't work at all. It issued an error regarding a deprecated version of a internal function. I searched through several forums but none of the troubleshootings worked properly. Even after a note issued by the developers yesterday, presenting another troubleshoot, I wasn't able to make camelot work at all.
Automate the Boring stuff 👏
Can't download the cheatsheet. It throws error "Account is cancelled and can not accept new subscribers."
Wow so easy ! great course
This video should be updated what to do when the chromium browser doesn't have the latest version of Chrome (mine is 118, the highest it goes to on the website is 114), and the fact that headless mode as the video shows it has been deprecated.
although i am new, it's understandable explanation 👍👍
but how about scaping web pages requiring auth?
here beginner means, beginner in automation
Thanks a lot ❤️, if you record video how to automat wordpress after we scrap the data
This channel is awesome
agreed
(1:18:18) Automate The News - Preparing Script to Be Run Everyday
Kindly make Javascript Automation course excel and web scraping
Thanks.
This is incomplete. It lacks a README to describe how to setup an environment you can run these examples. It assumes all the Python libraries needed to do these exercises are already installed and that the student knows how to install them. 1st video uses jupyter-lab notebook but says nothing on how to install it. 2nd video uses a traditional editor with code completion but no mention as to which one. I'll review the other exercises and send you mods I made to your repo that I forked.
if you don't know how to install every single library or jupyter-lab you shouldn't be watching this tutorial. Go watch other Python videos first
@@baya6002 the word "beginner" is rather self explanatory.
@baya Than maybe “Full course for beginners” isn’t the most accurate title for the tutorial?
Thanks to the op for making the effort to fill in some of the gaps.
@@arthur_p_dent4282 automation is not a "basic" or beginner friendly itself it is concluded that you have basic knowledge about python already if you are about to go directly to automation then it is basically idiotic in itself and that's self explanatory
@@arthur_p_dent4282 it's not a beginner course if you don't know anything about anything you shouldn't directly go on automation
yet another great tutorial, love this
Hi, tks for your lectures
After finishing lesson Automate the news- exporting data at 1:30, file headline.csv only shows many the same contents in all rows, could u tell me how to fix it. Tks
super video pls continue other topics of any other language
Awesome work mentor... I hope to meet you someday
So, I faced issues with the Camelot library. The output is Ghostscript is not installed, although it is installed. I cannot install Tk either through pip3 and brew. Already spent so much time troubleshooting the issue. I am giving up and proceeding to the next.
Great explanation, thank so much!
Hey thanks! In the scraping part, what do you do with this error: "ERROR: Couldn't read tbsCertificate as SEQUENCE" "ERROR: Failed parsing Certificate" ?
Wow thank you for sharing this to us.
Your are awesome... Thank you so much for this course 😍✌️✌️✌️✌️
great course!
but i am using win 11 and chromedriver have only a 32 version, what should i do?
I must jump on this. So inspiring. Thank you
very good , thank you!!
Camelot package is not loading "read_pdf"
About the crontab, what is an alternative for Windows?
Could you please insert a valid link for the Cheat Sheet? The old one sais that the account is no longer valid
Need help. Table extraction is not working from pdf. It shows no such directories found. And if i put the full directory path instead of just the file name, it gives error saying "'unicodeescape' codec can't decode bytes"
I downloaded python from the main site but I can't find the terminal, what did I do wrong and should I reinstall it? Thank you.
What is the python page he has. I am very new to this and trying to follow through
Awesome 😍😍😍
AttributeError: module 'camelot' has no attribute 'read_pdf'
in both jupyter notebook and colab
Is this enough for python scripting for semiconductor domain professionals curious to know.
খুব সুন্দর একটা ভিডিও
I generally use brave and firefox instead of Chrome. Is it possible to do 'automate the news' project without chrome?
Great one. I love it. It helps in daily life
A tutorial regarding Filemaker?? It would be pretty useful!
what modules do we need for this course? I keep having errors from the intro with pandas.
meee tooo!! I don't get it. I 've tried everything. Please, someone help me.
same
I guess some good basic to medium python skill is needed for this course.
In command prompt do
pip install pandas