Rotating Proxies For Web Requests in Python

แชร์
ฝัง
  • เผยแพร่เมื่อ 8 ก.พ. 2025
  • Today we learn how to do proxy rotation for free when doing web requests in Python.
    ◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
    📚 Programming Books & Merch 📚
    🐍 The Python Bible Book: www.neuralnine...
    💻 The Algorithm Bible Book: www.neuralnine...
    👕 Programming Merch: www.neuralnine...
    🌐 Social Media & Contact 🌐
    📱 Website: www.neuralnine...
    📷 Instagram: / neuralnine
    🐦 Twitter: / neuralnine
    🤵 LinkedIn: / neuralnine
    📁 GitHub: github.com/Neu...
    🎙 Discord: / discord
    🎵 Outro Music From: www.bensound.com/

ความคิดเห็น • 63

  • @GCGoose
    @GCGoose 2 ปีที่แล้ว +35

    All of your videos have been just what I've been looking for. Swear nobody else makes a simple yet extensive video about programming concepts that can be easily confusing. I've watched plenty of videos about threading but your tiny bit of use in it here helped me understand how it works within the system.

  • @jissoune2009
    @jissoune2009 2 ปีที่แล้ว +7

    I'm a big fan of your videos. Each week I learn something. Thanks a lot for your work.

  • @fishingtrippy
    @fishingtrippy ปีที่แล้ว +9

    The pacing of your videos and explanations are really easy to digest. Thank you!

    • @7ingz
      @7ingz 11 หลายเดือนก่อน

      cap

    • @Drevex88
      @Drevex88 หลายเดือนก่อน

      @@7ingz bruh

  • @mathflixbyumer2425
    @mathflixbyumer2425 22 วันที่ผ่านมา

    Excellent video ! your code worked perfectly fine for me. Thankyou so much

  • @Jelvix
    @Jelvix 2 ปีที่แล้ว +4

    Thanks for so useful video! As we told in one of our own videos - Python is one of the most prospective languages of programming, extremely important for developers! You showed good hints, and the explanation is very clear.

  • @zulucharlie5244
    @zulucharlie5244 ปีที่แล้ว +4

    Another fantastic video. Thank you.

  • @zeelthumar
    @zeelthumar ปีที่แล้ว +1

    I am just speechless...............................awesome work

  • @rexby
    @rexby ปีที่แล้ว +1

    &= seems should be in the last line of code at the end of video. Thanks for this tutorial!

  • @DBSQ-wb3ht
    @DBSQ-wb3ht 5 หลายเดือนก่อน

    Great video! Got this to work in my program using the same method!

  • @노랑망원경
    @노랑망원경 ปีที่แล้ว

    Oh my god, Thank you for making this video! i was finding how to avoid block all day. and now i solved it haha~ thank you^^~

  • @michawiseka1785
    @michawiseka1785 2 ปีที่แล้ว +1

    Sheeesh, that modulo thing at the end is so smart

  • @kirill_good_job
    @kirill_good_job ปีที่แล้ว

    thank you man for this tutorial. you are wonderful.

  • @willykitheka7618
    @willykitheka7618 2 ปีที่แล้ว

    I like the way you teach! Thanks for sharing!

  • @hannesbeukes345
    @hannesbeukes345 11 หลายเดือนก่อน

    Awesome thank you !!

  • @thehuman5607
    @thehuman5607 ปีที่แล้ว

    You, sir, have saved my life😊

  • @bogite8734
    @bogite8734 ปีที่แล้ว

    Love your videos man

  • @playmaker-u4y
    @playmaker-u4y ปีที่แล้ว +1

    Thanks for the tutorial, and I have an idea that will make InshaeALLAH you content more useful, is providing the source code, so we can practice and get familiar quickly with the topic.

    • @DeniiseLiz
      @DeniiseLiz 2 หลายเดือนก่อน

      😂

  • @노랑망원경
    @노랑망원경 ปีที่แล้ว +3

    hmm there is mistake in your code. 5:33 "https:":proxy
    using other free proxy is so slow i think

  • @thierrytrouillet5602
    @thierrytrouillet5602 8 หลายเดือนก่อน

    Really very nice V.S. Code customization at display! How did you do that? Regards.

  • @jonbarg5762
    @jonbarg5762 ปีที่แล้ว +3

    Hey there! I have a problem with the proxy rotation. The proxy server program works, but it doesn't rotate the proxies, it always uses the same. Do you know what I can do to solve the problem? Thanks!

    • @IPCOLA-
      @IPCOLA- ปีที่แล้ว

      Try IPcola, residential IP proxy, sticky and rotation sessions,100% new, 99% pure

    • @yusufabi1539
      @yusufabi1539 4 หลายเดือนก่อน

      for me to

    • @prof.tahseen6104
      @prof.tahseen6104 2 หลายเดือนก่อน

      Are you sure you did counter += 1 ?
      Check if it's counter = 1 you need to do += not =

  • @AkashSethi-bk3pq
    @AkashSethi-bk3pq 9 หลายเดือนก่อน

    Thank for this video. Can you also make a video for proxies which can be used for SMTP with open port 25 for email verification

  • @ivan3584
    @ivan3584 4 หลายเดือนก่อน

    Nice but is not better use one proxy at time until we get a 429 and use another proxy ?

  • @georginedyalkov661
    @georginedyalkov661 2 หลายเดือนก่อน

    Hi, amazing video but what happens if I want to scrape with https? Is there anyway to do that?

  • @nabilkhaldi5566
    @nabilkhaldi5566 ปีที่แล้ว

    AttributeError: 'str' object has no attribute 'put' -what's wrong here?

  • @Karymemontolis
    @Karymemontolis ปีที่แล้ว

    When considering the safety of my internet connection, Zeus Proxy emerges as a trusted provider, offering residential proxies known for their reliability.

    • @roycedot
      @roycedot ปีที่แล้ว +1

      Sounds like a real comment from a real user

  • @moizdn
    @moizdn หลายเดือนก่อน

    Does this currently work or the technology advanced 😅

  • @amirnorozi1085
    @amirnorozi1085 ปีที่แล้ว

    thanks a lot it worked

  • @AhmedThahir2002
    @AhmedThahir2002 2 ปีที่แล้ว +2

    Wait so if proxy[0] doesn't work, will this code retry with proxy[1]?

  • @YMuhammadyusuf
    @YMuhammadyusuf ปีที่แล้ว +2

    Hey Can anyone share the code of tutorial please?

  • @DonHolga
    @DonHolga ปีที่แล้ว

    good job , thank y

  • @gustavorosas-dev
    @gustavorosas-dev 11 หลายเดือนก่อน

    Top! ⬆

  • @agustotara
    @agustotara ปีที่แล้ว

    In the realm of rotating residential proxies, Zeus Proxy consistently earns my trust by providing a comprehensive solution that aligns with my diverse online endeavors.

    • @roycedot
      @roycedot ปีที่แล้ว +8

      Sounds like a real comment from a real user

  •  9 หลายเดือนก่อน

    Great video! Any idea how to fix SSL: CERTIFICATE_VERIFY_FAILED?

  • @nattyzaddy6555
    @nattyzaddy6555 ปีที่แล้ว

    Guys I was confused af Ill let yall know this will only work in a script dont try doing this in a ipynb lmao. Specifically threading doesnt work well with jupyter

  • @vratislavgoldie7386
    @vratislavgoldie7386 7 หลายเดือนก่อน +7

    why do i not find any proxy server that seems to be working??

    • @marvelcontestofchampions3927
      @marvelcontestofchampions3927 7 หลายเดือนก่อน

      Me too

    • @vratislavgoldie7386
      @vratislavgoldie7386 6 หลายเดือนก่อน

      @marvelcontestofchampions3927 yeah i wrote a code which would automatically go to the website copy all the 300 proxy servers and check them individually and then create a list of working servers.

  • @paulthomas1052
    @paulthomas1052 2 ปีที่แล้ว

    I'm at work and our proxies seem to block me searching for other proxies (😃) - any ideas how I can get round this ? Thanks xx

    • @ike654
      @ike654 ปีที่แล้ว

      You can try a vpn or change your dns

  • @BearZachar1us
    @BearZachar1us ปีที่แล้ว

    that if statement is giving me a traceback.

  • @timbrap4693
    @timbrap4693 ปีที่แล้ว

    How do I use http proxies to request https websites?

    • @IPCOLA-
      @IPCOLA- ปีที่แล้ว

      Try IPCola, residential IP proxy, sticky and rotation sessions,100% new, 99% pure

  • @moinmemon2439
    @moinmemon2439 9 หลายเดือนก่อน

    Hello sir I am your subscriber
    I am facing an issue that the code is printing failed and failed only
    And also please help me if someone see it

  • @cheemzboi
    @cheemzboi 2 ปีที่แล้ว

    please link me this src

  • @none_ghost6204
    @none_ghost6204 2 ปีที่แล้ว +1

    Next video be like: How to make a botnet in python

  • @jaderson-ds.eng.naveia
    @jaderson-ds.eng.naveia 10 หลายเดือนก่อน

    Hi! I would to thank you to address this solution. Greetings from Brazil +1. subscribe.

  • @RayHorn5128088056
    @RayHorn5128088056 2 ปีที่แล้ว

    If the web server uses a session and you got blocked you will likely remain blocked after switching proxies. But now we know your just a hacker.

    • @rikkilleen3169
      @rikkilleen3169 2 ปีที่แล้ว +1

      You say that like it's a bad thing.

    • @CappySmack
      @CappySmack 2 ปีที่แล้ว

      @@rikkilleen3169 There are far more effective methods for doing what you wanted to present during your video. Go and learn them if you want to be a hacker.

    • @rikkilleen3169
      @rikkilleen3169 2 ปีที่แล้ว +1

      @@CappySmack I'm a tad confused. I don't have any videos. So I'm not sure if you are thinking of someone else or simply making a rhetorical reference to me
      Either way, my interest in hacking derives from working for the US Army. They insisted I obtain Sec+ despite my never working anywhere IT critical beyond building out-of-the-box SharePoint, O365, & Powerapps solutions (maybe with some JSON). In the class, the instructor had us set up KaliLinux VMs to keep the material from being too abstract and dry. Four weeks later, I now know a lot more than I need, and I can follow videos like this and ruminate on ways to work past issues such as your mention of sessions. It's strictly an academic interest.

    • @yonishachar1887
      @yonishachar1887 5 หลายเดือนก่อน

      What do you mean by "uses a session"? Are you talking about sending the same cookie for every proxy used?
      Also what are the more effective methods you're talking about?

  • @dot_dot_pwn2650
    @dot_dot_pwn2650 2 ปีที่แล้ว +1

    Dude turn those drug out for loops into one liners, makes it look better and work faster in most cases