Flutter Web Scraping + Javascript 🤫 | The Ultimate Guide

แชร์
ฝัง
  • เผยแพร่เมื่อ 1 ธ.ค. 2024

ความคิดเห็น • 74

  • @HeyFlutter
    @HeyFlutter  2 ปีที่แล้ว +1

    This might help you :)
    👉 12 Week Flutter Training from Newbie to Expert: heyflutter.com
    Source Code: github.com/JohannesMilke/web_scrapping_ii
    WebScraping (Simple Way): th-cam.com/video/9ZfRE_DN9a0/w-d-xo.html
    Fetching JSON (HTTP GET) Tutorial: th-cam.com/video/1OEhIpBIZXM/w-d-xo.html
    FutureBuilder Tutorial: th-cam.com/video/Pp3zoNDGZUI/w-d-xo.html
    StreamBuilder Tutorial: th-cam.com/video/g8Y1Eqa4pbc/w-d-xo.html
    Futures Tutorial: th-cam.com/video/RAOoVvTQeAI/w-d-xo.html
    Nested ListViews and Columns Tutorial: th-cam.com/video/ZpHuAbYWL3w/w-d-xo.html
    ChatApp UI Design Tutorial: th-cam.com/video/eGhvL082-Pc/w-d-xo.html
    Flexible Widget Tutorial: th-cam.com/video/5TwBXLZdVvk/w-d-xo.html
    Expanded Widget Tutorial: th-cam.com/video/N1FMX4rDn6Y/w-d-xo.html
    Spacer Widget Tutorial: th-cam.com/video/n4dJVUdj4ik/w-d-xo.html
    FittedBox Widget Tutorial: th-cam.com/video/WpTMNArnXdc/w-d-xo.html
    Flutter Layout Basics Tutorial: th-cam.com/video/yYxueTNIDlA/w-d-xo.html
    Row Layout Basics Tutorial: th-cam.com/video/lY5GtNkvyhM/w-d-xo.html
    Column Layout Basics Tutorial: th-cam.com/video/nW9pAyDs-wE/w-d-xo.html
    Expansion Tile Tutorial: th-cam.com/video/vRWY-IQAin0/w-d-xo.html
    Expansion Panel Tutorial: th-cam.com/video/r7L146d9YA8/w-d-xo.html
    Bottom Sheet Tutorial: th-cam.com/video/TXYuaiukw7E/w-d-xo.html
    Popup Dialog Tutorial: th-cam.com/video/4pn-_md5Ol4/w-d-xo.html
    Dropdown Menu Tutorial: th-cam.com/video/z0ihUbwlSHs/w-d-xo.html
    PageView Tutorial: th-cam.com/video/sFXg-phkbQU/w-d-xo.html
    Page Transition Animation Tutorial: th-cam.com/video/_R3E_aof69c/w-d-xo.html
    Horizontal ListView Tutorial: th-cam.com/video/baA_J5tUtEU/w-d-xo.html

  • @mkhwanazicebo4448
    @mkhwanazicebo4448 2 ปีที่แล้ว +5

    Milke i love you man, you got any idea how much trouble Beautiful soup was giving me.. u just made thingz a lot more easier for me man.....you the best. Literaly

    • @hiruthicsha
      @hiruthicsha 2 ปีที่แล้ว +1

      Same dude, I just spent last two days migrating from beautifulsoup impl to html package implementation. Its just way too better.
      I literally reduced the error rate upto 60% just by migrating 🤣

  • @desmond2235
    @desmond2235 2 ปีที่แล้ว

    Awesome Milke, you are my favorite flutter tutor on youtube

  • @crazy-man
    @crazy-man 2 ปีที่แล้ว +3

    very cool technique for parsing sites in javascript, I thought it was impossible to copy them

  • @ttlrd7
    @ttlrd7 2 ปีที่แล้ว +1

    Thanks Mike! It's another beautiful flutter tutorial!

  • @TheTahmeed
    @TheTahmeed 2 ปีที่แล้ว +1

    I really love your explanation. Great work brother

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank you, Binary Express! 🙂

  • @sim5483
    @sim5483 2 ปีที่แล้ว +1

    Hello, very good video. However I can't get the source code you put on github : when I click on "access" it doesn't find the page, error 404. Is there another way to find the source code ?
    Thanks

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว +1

      Thank You Sim!. I showed the main functionality, which is important for this package. Learn more about it here: github.com/JohannesMilke/sponsorware

  • @TheWhoIsTom
    @TheWhoIsTom 2 ปีที่แล้ว +1

    Maybe you could do a video how to rum for example time tracker in the background. Seems to be not that easy to run stuff in the background in flutter

  • @TheWhoIsTom
    @TheWhoIsTom 2 ปีที่แล้ว

    Awesome Johannes :) herzlichen Dank

  • @Geceparlayan
    @Geceparlayan 2 ปีที่แล้ว +1

    Is it possible to listen to webview even if your application is closed??? if yes how????

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thanks, FTF Music! 🙂 Once application is closed it's not possible to listen to webview

  • @raphaelcherobim7327
    @raphaelcherobim7327 2 ปีที่แล้ว +1

    Hi!
    How access of flutter page?
    Thank you so much for this.

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Raphael Cherobim! Follow this link: stackoverflow.com/questions/60285160/read-a-websites-html-code-then-select-an-element-and-then-make-an-action-on-tha
      I hope you will get your answer 🙂

  • @tentacle_sama3822
    @tentacle_sama3822 2 ปีที่แล้ว +1

    loading the webVeiw to scrape websites with JS is genius

  • @dev.faizan
    @dev.faizan ปีที่แล้ว

    is there any article on how to manipulate other tags

    • @HeyFlutter
      @HeyFlutter  ปีที่แล้ว

      Thank You Faizan Ahmad! Follow this link: stackoverflow.com/questions/59619279/manipulating-text-field-data-saving-it-in-a-local-text-file-and-showing-it-subs
      I hope you will get your answer 🙂

  • @justincoding
    @justincoding 2 ปีที่แล้ว

    Hi, I wanted to make a web app that had to take data (text) from html elements of a site and press a button, I followed your tutorial but for web flutter there are no webview packages that work to press the (runJavascript () ).
    Do you know a way to do this without needing to use WebView?

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Lukas Coding! Follow this link: stackoverflow.com/questions/59483574/how-to-access-data-from-html-element-scrape-a-website-in-flutter
      I hope you will get your answer 🙂

  • @uditmishra5583
    @uditmishra5583 2 ปีที่แล้ว

    Learn something new today👍

  • @rorojoselito6896
    @rorojoselito6896 ปีที่แล้ว

    Hi Johannes, is it also possible to scrape with pagination in flutter as well, please? Thank you!

    • @HeyFlutter
      @HeyFlutter  ปีที่แล้ว

      Thank You Roro Joselito! Follow this link: medium.com/analytics-vidhya/webscraping-a-site-with-pagination-using-beautifulsoup-fa0a09804445
      I hope you will get your answer 🙂

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 ปีที่แล้ว

    Great video as usual.

  • @mdshahidali3132
    @mdshahidali3132 2 ปีที่แล้ว +1

    Create a full video about web scrapping in flutter.

  • @DaniTeCuenta
    @DaniTeCuenta 11 หลายเดือนก่อน

    in devtools network, I see some files that I want to get with flutter or Js or any other language. is that Possible? how?

    • @HeyFlutter
      @HeyFlutter  11 หลายเดือนก่อน

      Thanks for the idea @DaniTeCuenta 😀, i have added it in my list of future videos

  • @alwayzahead5549
    @alwayzahead5549 2 ปีที่แล้ว

    Hello Please answer my question, most of the websites use lazy loading with infinite scroll, how do we scrape that. I can only scrap the visible elements not the elements which are shown after scrolling further down

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Alwayz Ahead! Follow this link: pub.dev/packages/web_scraper
      I hope you will get your answer 🙂

  • @ezeaguprincewill7005
    @ezeaguprincewill7005 2 ปีที่แล้ว

    Thank you so much for this.
    However what about scraping videos from a website and scraping a live video, does it use the same technique? Especially for live video that changes every second

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Ezeagu Princewill! Follow this link: stackoverflow.com/questions/62255032/is-there-a-way-to-scrape-the-link-of-a-video-inside-a-webview-in-flutter
      I hope you will get your answer 🙂

  • @Its_2024
    @Its_2024 2 ปีที่แล้ว

    Thanks J Mike! But how to scrape a table from a website?

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Entertainment Time! Follow this link: asaddigital1.medium.com/advanced-scrapping-in-flutter-533b78b7e44d
      I hope you will get your answer 🙂

  • @dev.faizan
    @dev.faizan ปีที่แล้ว

    Amazing tutorial 🤗

    • @HeyFlutter
      @HeyFlutter  ปีที่แล้ว

      Thank you, Faizan Ahmad! 🙂

  • @V_1997.
    @V_1997. 2 ปีที่แล้ว

    How can I go to previous tab on each time back button click .like if I move to index 3,4,6,8 than back button press how can I navigate all previous tabs 8,6,4,3,0 in this order

    • @V_1997.
      @V_1997. 2 ปีที่แล้ว

      @@HeyFlutter actually I want make tabbarview like when I click the back button the tabcontroller pop back to last tabcontroller index. Let support when I opened the tabbar page controller index is 0 and it's stay on first page and when click 3rd tab than 5th tab after that when I click the back button my tabcontroller sent me back to 5th tab to 3rd tab and when I click again back tab controller sent me to 3rd tab 0 tab index. I want to do like this on back button press it's goes to previous tab unitl get the 0 index of tab in flutter

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You ʟȗċıғєя! Follow this link: docs.flutter.dev/cookbook/navigation/navigation-basics
      I hope you will get your answer 🙂

  • @alialagha665
    @alialagha665 2 ปีที่แล้ว

    Is there is a way to scrape multi pages ?

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You ali alagha! Follow this link: www.geeksforgeeks.org/web-scraping-in-flutter/
      I hope you will get your answer 🙂

  • @FatihAcar-nh8qr
    @FatihAcar-nh8qr ปีที่แล้ว

    After logging in to a website, the page is accessed. Member login is done with javascript. How to do web scraping on such a web page. How to scrape after logging in in Flutter?

    • @HeyFlutter
      @HeyFlutter  ปีที่แล้ว

      Thank You @FatihAcar-nh8qr! Follow this link: apgapg.medium.com/website-scraping-with-dart-flutter-56db60033d49
      I hope you will get your answer 🙂

  • @cavidanbagiri7837
    @cavidanbagiri7837 2 ปีที่แล้ว

    Krasava teacher

  • @SW-vc3ux
    @SW-vc3ux 2 ปีที่แล้ว

    Is it possible to import html source using Flutter?

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You S W! Follow this link: stackoverflow.com/questions/53831312/how-to-render-a-local-html-file-with-flutter-dart-webview
      I hope you will get your answer 🙂

  • @manggamusasuleiman
    @manggamusasuleiman 2 ปีที่แล้ว

    Thank you so much

  • @aayankhhan5698
    @aayankhhan5698 2 ปีที่แล้ว

    Hey can you please tell me how to Enable download often on web Apps in flutter... I can't access a download link

    • @aayankhhan5698
      @aayankhhan5698 2 ปีที่แล้ว

      @@HeyFlutter can you please make a video i couldn't find a solution 🤧

    • @aayankhhan5698
      @aayankhhan5698 2 ปีที่แล้ว

      @@HeyFlutter kindly please watch this video
      drive.google.com/file/d/1iuJD8pqhrGLgyyoDjmj4auIvmDMFYQqt/view?usp=drivesdk

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Aayan Khhan! Follow this link: stackoverflow.com/questions/59783344/flutter-web-download-option
      I hope you will get your answer 🙂

    • @aayankhhan5698
      @aayankhhan5698 2 ปีที่แล้ว

      @@HeyFlutter sorry sir but could you please make a video 🤧

  • @bhabhayt398
    @bhabhayt398 2 ปีที่แล้ว +1

    Video player how to change video quality in flutter this is very important topic

    • @bhabhayt398
      @bhabhayt398 2 ปีที่แล้ว

      Any one this solution

    • @bhabhayt398
      @bhabhayt398 2 ปีที่แล้ว

      How maintenance quality in flutter video and change quality another one is auto version

  • @techzone2009
    @techzone2009 2 ปีที่แล้ว

    Make a video series on serverpod

  • @defensivepower7988
    @defensivepower7988 2 ปีที่แล้ว

    Make a video on Hook widget in flutter

  • @The_Fun_Era
    @The_Fun_Era ปีที่แล้ว

    Wow..thts tasty.
    Can I web scrap links that plays movies?

    • @HeyFlutter
      @HeyFlutter  ปีที่แล้ว

      Yes, @ramprasanth9009 🙂

  • @Rahadians82
    @Rahadians82 2 ปีที่แล้ว

    Cn you tell me, how insert symbol like checklist in the text? Sorry i'm noob hehehe...

    • @Rahadians82
      @Rahadians82 2 ปีที่แล้ว

      @@HeyFlutter thank you for your answer sir...btw are you think to some framework like bootstrap ? 😁

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Rahadian Santoso! Follow this link: stackoverflow.com/questions/50060648/special-characters-in-flutter
      I hope you will get your answer 🙂

  • @bohdanilkiv2208
    @bohdanilkiv2208 2 ปีที่แล้ว

    What is "parser" in "parser.parse(rawHtml)"? 04:15

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Bohdan Ilkiv! Follow this link: api.flutter.dev/flutter/dart-core/num/parse.html
      I hope you will get your answer 🙂

    • @TheTahmeed
      @TheTahmeed 2 ปีที่แล้ว

      @@HeyFlutter He asked about parser not parse

    • @TheTahmeed
      @TheTahmeed 2 ปีที่แล้ว

      Can you please tell me how you define parser?

    • @codecreatiwitty4073
      @codecreatiwitty4073 2 ปีที่แล้ว +1

      @@TheTahmeed import 'package:html/parser.dart' as parser;

    • @TheTahmeed
      @TheTahmeed 2 ปีที่แล้ว

      @@codecreatiwitty4073 Thanks brother

  • @devsutong
    @devsutong 2 ปีที่แล้ว

    sauce code?

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Ymphaidien Sutong!. I showed the main functionality, which is important for this package. Learn more about it here: github.com/JohannesMilke/sponsorware

  • @imachris4769
    @imachris4769 2 ปีที่แล้ว

    Lol, you should say in advance that it is necessary to pay to access the source code, it was a waste of time.

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You I'ma Chris!. I showed the main functionality, which is important for this package. Learn more about it here: github.com/JohannesMilke/sponsorware

  • @pauladityashaw4590
    @pauladityashaw4590 2 ปีที่แล้ว

    Is there any way I can use javascript engine to scrape websites?

    • @HeyFlutter
      @HeyFlutter  2 ปีที่แล้ว

      Thank You Paul Aditya Shaw! Follow this link: stackoverflow.com/questions/44688544/flutter-scraping-a-site-with-javascript-generated-content-without-darthtml
      I hope you will get your answer 🙂