Hi, I want to create my own proxy in order to play in "silkroad online". Game's server do not allow us to open more than 2 account at the same time. They ban very common ports such as 1080. But players know that a lot of people are using proxies bought from oxylabs which sells only to corporates. Would you describe how can I create proxy v5 with your methods?
Hi @Uǧur KAKİ, Thanks for watching! So to play your game using a SOCKS5 proxy, and not use a proxy provider should be easy enough. All you’ll have to do is create a cloud hosting account with a provider (like Digital Ocean, Linode, AWS, etc) and stand up your own Linux server and configure any networking so you can access it using SSH. They will also provide you with a public IP to use. This will likely have OpenSSH installed on it to begin with. Because of that, all you’ll have to do is connect to this server using the command I write at 11:40 and once you authenticate, then you’re ready to use the SOCKS5 proxy, such as the way I do so using FoxyProxy, you’ll just need to configure your client computer to connect to the proxy. Then from there your traffic to the game should be router from the proxy server and since the traffic is coming from your cloud server (and not a proxy service like oxylabs) you shouldn’t be blocked or have any problem connecting to your game. Hope this helps!
@@DevOdyssey It will take me some time to figure out what are those terms and programs. But I will try this. Thank you so much man. Hope you will reach your goals on youtube. Have a good day.
@Uǧur KAKİ you should be able to search for it online and find the information you need. Setting up a cloud server does require some configuration, which I don't have too much experience with for those cloud providers I mentioned, but I know its easily found. Once you get the cloud server up and running, then following this video (or the SOCKS5 proxy part) should be all else that you'd need to do. You're welcome! Glad this video helped you, and I appreciate the kind words. Good luck on your proxy!
Hello Odyssey, thanks for the great video. I've just followed all the steps in order to configure the squid and digital ocean integration not from that video but yeah lol. The problem is when I test the proxy it's seems working perfectly fine on FOGLDN proxy (around 200ms). But when I try to log into the same game as Uğur told you(Silkroad Online), I can not get any response from Socks4 server (that's what our bot for the game tells at least and the frustrating part is I don't have access to that code which generates that exception print line). I've tried to change the port from ssh to different values 1280,4444,1490 etc but nothing worked yet... Do you have any tips for this issue, by any chance? Looking forward for your advices.
This guy is super intelligent to explain everything in simple and easy word. Learning networking and other communication stuffs is like blindly walking into a dark room to me. I would love to get all the networking terminologies explained by him.
Thanks for watching and the very thoughtful and kind comment @abdurrahmanrafi7946! It means a lot to hear these nice words. I know how hard it is to learn this on your own. I never received a formal education on networking and related concepts, I’ve learned this all from my work, from the internet, videos, colleagues, and most importantly, from doing it on my own, and from teaching it. So coming from this perspective, I’ve been able to create my own understandings of these concepts that make it easy for me, and I’m happy to share that so others can learn based on how I think about them. So hearing about the impact my videos have on my viewers makes me happy 😊 . I hope I can continue to by your source of network concepts and information.
Thanks for watching DJ Chris! That’s a great idea, and yes that process should we try with a a 4G modem to get a 4G IP. But it wouldn’t work without additional configuration, that’s because likely it would be using a CGNAT ip, and not a real public IP. Because of that you can’t just open ports up. You’d have to first use something like a cloud server with a public IP address, which then you can create a tunnel between the 4G modem / router and the cloud server. The. When you want to use the 4G modem / router as a proxy, you’d connect to the cloud server first and then router that traffic though the cloud server to the 4G router, thereby using it as a proxy. Only way around this is if you’re using IPv6 which might be publicly accessible where you can port forward traffic through it directly. I haven’t tested this out but in theory using IPv6 should be publicly accessible and thereby using it as a direct proxy. You’d probably have to do some IPv4 to IPv6 translation, but nonetheless it should be possible. I’d say I it’s probably easier with a cloud server and IPv4 so if I were you I’d try that first, unless you’re an IPv6 pro, I’d do the IPv4 method first.
Thank you very much for the thoughtful words. It really means a lot to hear that. I'm glad to hear you find my videos informative and easy to understand 😊 Plenty more videos to come!
Thanks for the compliment @rahulsingh7508! It really means a lot to hear that. I truly a pleasure making these explainer videos, and I enjoy it more when I hear feedback such as this, so thanks for sharing that with me.
Do not create a proxy without a proper authentication, thinking that "no body knows the IP to my server, How are they going to find out I'm running a proxy on my server and try to use it anyway". Based on my experience botnets are always running and scanning every port on every IP on internet including your server's IP, looking for vulnerabilities and they will eventually find your free and open proxy(which requires no authentication) and will use it for such things as applying DDOS attacks to their victims and whatnot. So be aware of that, and in order to prevent it, set up password for your proxy as the video suggests 07:51👍 P.S you can also use fail2ban to prevent brute force attacks which will be directed to find out the password you've set for your proxy. BTW Dev Odyssey, Thanks for your great video man👍
Thanks for watching Sadegh! Definitely agree with your first point. If you are not creating a proxy behind a NAT / Firewall, like I did as an example, and are creating one open to the public internet, as most are, then you certainly want authentications for it. Bots scan the whole internet all the time, your server is fingerprinted within hours of opening it up to the public. So I definitely do not recommend creating a free and open one, let alone using a free and open proxy server. My example at 7:51 is a mere concept of setting up a password, and I'd recommend stronger forms of authentication with Squid wherever possible, such as OAuth-2.0. wiki.squid-cache.org/Features/Authentication Using public-private keys is also recommended for using the server as a SOCKS5 proxy, in addition to rotating keys frequently. And lastly, fail2ban is also a great recommendation for protecting against SSH attacks, so thanks for sharing that with everyone. Nonetheless, I certainly appreciate the compliment and your thoughts 😊
I do proxies in a cool niche way. I make a local proxy so that I can VPN using a certain application, but using the native internet for my browser. Basically I use a space computer to use as the proxy which also eliminates the need for port forwarding :) .
Thanks for watching @lextacy2008! I'm not sure I completely understand. When you say you make a local proxy, are you saying you stand up a server / machine on the local network thats running a proxy server like Squid or a VPN server like OpenVPN / Wireguard? And then when you want certain applications to point to it, are those applications on other machines, and if so, are you just pointing to that VPN server as your gateway? It's definitely very cool to use an application over the VPN, while still being able to use your browser over your local internet and not over the VPN. What do you mean by "space computer"? You definitely shouldn't have the need to do any port forwarding unless you want to access your local (home) network over the internet (or if you have a VPS network in a cloud provider, and want to access that network remotely at any time.) If I am understanding correctly, I think I did something similar at one point, until somehow my VM just vanished. I had a VM that was connected to a VPN server, and when I wanted to tunnel my connection over the VPN, I would just SSH to that server using the -D switch, to stand up a local SOCKS tunnel that I'd use to access that VPN connection, instead of directly VPNing from my laptop / client machine.
Hey thank you for reciprocating and asking for clarification. That was spare computer not space ,lol. And yes this spare PC is the is a local proxy. My Chrome traffic gets sent to there using my main internet. My VPN tunnel on my main PC runs globally. But the cool thing is anything that triggers a need for internet will prompt the Proxy username and password. So I basically can Ala Cart what applications login to the Spare machines proxy. Hope this helps! @@DevOdyssey
Спасибо за просмотр summer2019! Я не говорю по-русски, поэтому я не уверен, что понял, однако это «красивый шрифт» по умолчанию, который использует Postman.
Thank you so much for your how to does Qustodio works? we use client of qustodio on the kinds laptop but do not change proxy manually. How does the client side controls laptop? I am interested for developing a parental control application and proxy server for a school.
You're welcome and thanks for watching @mdsalahuddin2841! I am not personally familiar with Qustodio, but I did just do a quick search to learn more. I do see it performs web filtering. So in order for it to do that, its probably monitoring DNS traffic and using DNS categorization services to check what category a website falls under, and sinkholes the DNS request, or allows it, depending on what category it comes back with. I made a video on PiHole that basically describes the same process. th-cam.com/video/XTk8eZ4NmFc/w-d-xo.html In this regard, its not really acting as a proxy, but rather a DNS server. This wouldn't be happening client side, but instead, server side, since its just force configuring the DNS server to be one of theirs after the app is installed. I can't say for certain this is whats going on, since I haven't used it myself, but this is commonly how web filtering is done and very likely that this is what they are doing.
Hi, Very nice video. I understand whole video except you showed you have no internet connection on mac (am i right?) then you connected to ubuntu server from same mac computer (am i right?). I did not understand this part. Why your mac has no connection to internet but not from terminal? Sorry i am really confused
Thanks for watching @test-account5635 and the compliment! The purpose of showing I had no internet connection (on my mac) was to demonstrate that I needed to connect to a proxy first in order to reach the internet. The proxy server (ubuntu) was hosted on my local network, where I had SSH / terminal access to it. Then once I configured the proxy connection on my mac to my ubuntu server, I was able to access the internet (HTTP(s) traffic), effectively demonstrating how a proxy works, at least a very common use case.
Thanks for watching @plbader3714! So I found there is a port of squid for Windows, but I haven't tried it out. github.com/diladele/squid-windows Not sure if the configuration mappings are 1:1 with Linux, but I'd imagine it would be pretty similar. Haha, so connecting from Mars. First, if they get the infrastructure to connect Earth to Mars at a reasonable speed, then you can come back to me on that. And when that happens, you can then watch your favorite Earth based TV shows instead of the Martian ones 😂
Thanks for the vid and all the info. i am new into this and want to start hosting my own proxys for myself. i am stucked at the begin of this video. it looks like youre using 2 different screens. 1. where you using a terminal and 2nd one your local pc or smth. how do i get the terminal at 04:22?
Hi @lesley middelham thanks for watching and you're welcome! 😊 Sounds like a fun project. Hosting your own proxy shouldn't be too difficult once you can acquire the right hosting, unless you are self hosting and not using a cloud. Yes you are correct, I do use the terminal and another screen depending on the application I am using, like Postman or the terminal. So depending on your Operating System of your computer, you have a couple ways to get a terminal. On macOS its pretty simple, the terminal is there by default and you can search for that application and open the terminal. If you're on a Windows PC, and on Windows 10 or newer, you can download Windows Terminal, which I believe should work for accessing Linux based servers if you have the OpenSSH client installed. You can also download PuTTY which has been around for quite some time as an SSH client to access and SSH enabled servers.
what type of computing power would be required to setup multiple proxies , as i plan to make some for my sneaker bot ? plus would it be possible to create multiple proxies
Thanks for watching Omar. I actually have a friend who has a sneaker bot, so I have some small knowledge around sneaker bots. First, yes you can make multiple proxies, but if we really want to get at the core of it, what you mean by multiple proxies is simply multiple "Public IPs", at least in this context. So with that, you'd want multiple network interfaces on your virtual machine. Then with squid installed on the virtual machine (this case it would be in the cloud, so a Virtual Private Server, or VPS), you'd create policies that let you forward traffic to different public interfaces, or somehow rotate between them. This is where I'm not sure how sneaker bots work 100%, and how they'd need to rotate between these different public IPs. There may be a policy that lets you rotate between public IPs on the squid server depending on how many requests are made. That seems like what you'd want. Otherwise, you might have to install more than one instance of squid proxy, and then have them run on different ports, assign them separate public interfaces, and then you can switch your proxy settings between the two, to quickly change your public IPs. In terms of computing power, it really depends on how many connections you are trying to make from the proxy. It shouldn't be too much, so maybe like 8 GB of RAM and a 4 core processor, especially if its just a dedicated proxy with no graphics (headless). I'm honestly spitballing here as I really don't know, it mostly depends on concurrent connections the sneaker bot will have to endpoints, but also connections to the sneaker bot. You can always increase the resources as well if you see throttling occurring, since its a virtual machine, but it does mean you will have to pay more. So I advise to start there, and monitor to see if you can increase resources, or decrease them to save on costs. With limited knowledge of sneaker bots, thats my 2 cents.
Thanks for watching @zaktv3595! The IPs you use to access the proxy server really don’t matter in this instance. When using public IPs to access the proxy server, your traffic will be proxied out the same IP you use to log in, if this were a cloud server with a public IP assigned to it. As I’m using a local IP, my traffic ends hp being NATted to reach the internet, which is expected. You won’t have to NAT when using a cloud server with public IPs, which is setup I’d expect most people to implement.
Thanks for watching Pavlegaming 42! Yes you can use a custom DNS server that would override system default settings. You can configure it using the `dns_nameservers` option in the squid.conf file. You can refer to an example in the squid-cache documentation. www.squid-cache.org/Doc/config/dns_nameservers/
Before you changed localnet to authenticated [...] could you have still used that as a proxy server, but that it just would allow anyone to connect to it? And replacing that iwth the authenticated [...] makes it restricted to only the ip address you want?
Thanks for watching @kimaegaii! For your first question, yes, I could have still used that with localnet in place as the ACL instead of authenticated (and authenticated_ips) and it would allow anyone to connect to it without authentication being necessary. It would effectively be an open proxy server on the local network. Adding my authenticated ACL makes it restricted to anyone who's credentials match whats created in the file. Adding authenticated_ips ACL ensures that only my IP, or any other IP in my ACL has access to use the proxy server. This ACL can be changed to use whatever IP you want, to enforce that the originating connection has that IP address of your choosing.
Great video! thanks. Just a question, you didn't have access to internet on you local computer? how did you ssh into the server? doesn't ssh need internet connection? sorry if my question is naive
You're welcome Behnam! Happy you watched it. No worries, we're all here to learn. Yes, so on my local computer, I did restrict internet access on my firewall, intentionally, to showcase the use of this proxy. In addition, this proxy server I set up was locally, on my home network, and not in the cloud. So for that reason, I didn't need an internet connection. If my proxy server was in the cloud, I'd need an internet connection to access it over SSH. My proxy server had access to the internet, and so once I routed my connection through the proxy, you could see that I was able to access the internet. Generally speaking, proxy servers you'll use are "on the internet" so you'll need an internet connection to get to them, and of course, route your traffic through them.
@@DevOdyssey - So you had another computer (physical server) which was connected internet and you connected your "mainframe" computer with that physical server (either through LAN or whatever) to access the internet. And then used the SSH method to login to the physical server. Is that correct?
@@rahulsingh7508 Yes, I had another computer that was connected to the internet, while my laptop was not. This computer was my proxy, and also a virtual server in this example, but that doesn't matter. I connected my laptop (I wouldn't call it a mainframe) to the proxy server to access the internet. SSH is my means (let alone the IT world) for logging into that proxy server, and also a way to set up a SOCKS5 proxy as well.
Thanks for watching Omizyss! If by multiple proxies, you mean multiple public IP addresses with multiple network interfaces, then yes you can. That would be dependent on your machine configuration and the public IP addresses you receive from your cloud provider that you'd purchase for use. You can write policies in Squid proxy that lets you chose which public interface you want to route HTTP traffic to, depending on the criteria you want to use. If you mean multiple instances of Squid proxy service, I believe that should be possible but I personally have not tried it. In that case, you can then use different connection criteria (such as the service running on a different port, same, or different public IP address) and then route your traffic that way, dedicating one public IP / interface per running instance of Squid proxy.
Thanks for watching, and yes you can set it up on your PC (assuming you mean Windows). I actually talked about it in the comment below, but you can follow the github link I shared. github.com/diladele/squid-windows I haven't tested it out, so I can't share any personal experience, but I assume it works the same. Keep in mind, squid is intended to be a proxy server, so installing it on your PC (client) doesn't really do anything for you, unless you are using that PC as a server, or if you're connecting that PC to an upstream proxy, something you don't actually need squid to do, unless you want to get granular about how you proxy your HTTP traffic.
Thanks for watching Ryan! I’m not sure exactly what you mean, but I think I know. If you want to use your local network, that is a /24, to connect through the proxy. So if you have a laptop, and a phone on the same /24 network, you can use the squid proxy for both the laptop and the phone. If you want the squid proxy server to use all ips in the /24 network, you can do that by basically spoofing an IP address per unique port. I found this article below that briefly explains it, but I do not have any personal experience. tastyplacement.com/squid-proxy-multiple-outgoing-ip-addresses You can also google “multiple outgoing IPs with squid”, and you’ll see more results. Be mindful this will not work with public IPs as you have to be assigned the public IP by your ISP. Unless your ISP has given you a pool IPs to use, then you’ll be restricted to using the one IP you’ve been assigned.
What's the difference between a proxy and a proxy server and a proxy service? People seem to use these terms imprecisely. It makes me confused and upset.
Thanks for watching zaphbeeblebrox! That is a great question, I can relate to your frustration. The word "proxy" is thrown around all the time, and apply it to anything "proxy related" but they don't all mean the same thing, so then it certainly becomes confusing. If we start with the word proxy, it effectively means an intermediary that is used between two points. In essence, it introduces a third point, or node, between two points, or nodes. This intermediary is then used to communicate to the second point, on your behalf. So in terms of software, a proxy and proxy server are basically one in the same. The proxy server, is that intermediary, that is making requests on your behalf, to your desired endpoint. The proxy server is _doing_ the proxying for you. The same goes with a proxy service. They are being used, as an intermediary, in the same way as a proxy server. Now the confusing point is when people say "proxies", what do they mean? Well I don't think everyone knows what they mean, but what they want, is to be represented by more than one point. In terms of IT, this means multiple public IP addresses. So proxies ~= multiple public IP addresses. But this is not a true definition. The true definition would be multiple proxy servers or instances. Now, you can configure a single proxy server, to have multiple public IP addresses, and therefore look like multiple different public endpoints, so it seems like its more than one internet endpoint. This would mean you would need multiple network interfaces on your server, with each their own public IP address (at least in terms of IPv4). Then, your proxy server software (Squid or SOCKS), can choose between the public interfaces, and that can be controlled by you. Now its still one proxy server, but now, it seems like its more than endpoint. When you choose a proxy service, they basically do all that for you. They have lots of public IP addresses (think proxies), that you can use to make requests on your behalf, coming from more than one internet endpoint. This is often used in rotating proxies, where services will block a public IP address if it is making too many requests, so then the proxy service changes the public IP address to get access to the endpoint again. So if I may say, the easiest solution honestly, is to go through a proxy service that has already bought all this IT infrastructure to suit your needs. If you don't need a rotating public IP address, then you can create your own proxy server in the cloud with your own public IP given by a cloud provider. That's somewhat what I tried to highlight in this video. But otherwise, anything more complicated than that, just go with a proxy service / provider.
@@DevOdyssey Thank you so much!! Much clearer!! No I can communicate a bit more productively with the devops people at my work :-) Usually I get one-liners full of overloaded jargon. It makes me upset.
@@qrubmeeaz You’re welcome! Glad I could clear that up for you. Oh I can relate to the jargon working in IT haha. It’s like speaking another language haha. Let’s hope they understand the same as you now on the most fundamental level so there aren’t more miscommunications in the future. Best of luck!
Thanks for watching @hichbelahmer9025! I really appreciate the compliment. I don’t have any additional documentation here sadly. Your best bet is to do your research in advance and check the IPs and ranges to see if they’re clean. A proxy service should be ensuring a clean IP range, it’s part of what you pay for, but I can’t guarantee that for all proxy services and let alone, it’s difficult given the nature of why people use proxies. So at best you can ask them. Same goes with cloud providers, if you deployed a proxy server in the cloud, you should get a clean public IP from them, and they should do the work to ensure the reputation of any IP they give you is clean. It takes a lot of effort to do, especially not clean IPs to begin with, but again it’s what you pay for, and important for any services you’d run behind that public IP. All in all it comes down to making sure you get a good IP and range from your service provider.
Thanks for watching @aimanesennouni2644! And you’re welcome! If I’m understanding correctly, technically this process wouldn’t be the only thing you need to create a rotating proxy. If you wanted to create a fully rotating proxy on your own, there would be a lot more involvement with getting a pool of IP addresses, and setting up a system to random choose from them per outbound connection, which can get complicated. If you want a rotating proxy, id suggest using an existing proxy provider that already rotates IP Addresses for you per connection(s), depending on how it’s configured. This video mimics how you’d stand up a proxy service in the cloud, assuming you have one IP address, but doesn’t go further in depth regarding the assignment of public IPs to an instance as that was out of scope. I mostly wanted to show the proxy software and it’s configuration.
Hi it looks like I got this configured to work but I'm not seeing anything in the access.log. Is there anything I'm missing to why this is not printing there?
Thanks for watching @AlexanderDavila-q9r! Thats interesting, I haven't seen that before. Doing a quick search, it seems like entries can be logged in the /var/log/messages. Have you checked any other OS log location to see if squid is logging there? I'm not sure what distro you are using but thats something to consider here where it can mess with logging. Also, can you confirm that the proxy is working as expected? Are your requests being proxied after you've configured it? I used the base install of squid from Ubuntu, and didn't modify anything for logging, so depending on how you installed it, I wouldn't expect you to have missed something from a default install. Otherwise, I'd encourage doing some research to see how you can resolve this.
Thanks for watching @amVinhBiet-yh4lt! So this depends on the way the proxy server is configured. If its configured to do decryption, then yes, it could read your files that you upload to One Drive. However, if its not configured for decryption, then it will not be able to read your files. When configured for decryption, it will actually terminate the TLS connection, and restart it on your behalf to the destination that you are going to. This breaks newer versions of TLS, but with TLS 1.2 this is still possible. If you're curious, you can check the Lock icon in your browser when you visit and website while on the proxy, and if you click it, and see the certificate's subject alternate name (SAN) matches the website name, then you're good. If you see a lock icon in the browser next to the address bar, thats another indication you are good. Otherwise, your browser should tell you if decryption is happening, as it will sense the encryption is broken in between the source and destination. Changes are they are not doing decryption, as thats very intensive work, but what I mentioned above should provide you with the guidance you're looking for.
Hey guys I have a doubt. I have 30 devices connected with my local network and I want to configure my proxy settings to all the machine's via DHCP server. Ubuntu acting as a squid proxy and windows acting as DHCP . Is it possible or is there any way to push my proxy configuration to all my machines?
Thanks for watching AbyaZ! To my understanding, it's not "exactly" supported in DHCP to hand out a proxy server IP and port. However, there seems to be ways you can do this, such as by hosting a PAC file and having the DHCP server hand out the url to the PAC file, as part of the proxy config. I am not familiar with this process, but it's worth a shot. Try the links below and see if they help. serverfault.com/questions/707586/is-it-possible-to-configure-proxy-setting-through-dhcp community.spiceworks.com/how_to/2424-deploy-proxy-settings-via-dhcp
Thanks for watching Kiran. I have not used proxifier before, but their documentation seems very well defined. You can take a look at it here. www.proxifier.com/docs/win-v4/quick.html When configuring proxifier, just use the settings / info for the server that you create following this video. With regards to putty, I'm not sure what you're asking for, but if you want to make a SOCKS tunnel with Putty, you can follow this article. www.pwndefend.com/2022/06/25/how-to-use-putty-as-a-socks-proxy/
Please do you have a video about how to create VPS and connect your home computer to it to browse the internet. Step by step. If you can provide me with a step by step and well explain course for me.
Thanks for watching @PHILACOMEDY-gs4xb! My next evolution of this video is to repeat this same process using a VPS,, which really is what I meant to demonstrate in this video, at least the concept of it. I intend to make that video in the future, but don't have a timeline of when that will be. In general, if you can stand up a VPS, and know how to configure and firewall rules provided by your cloud provider (if the do provide an interface for it), then you can repeat this same process in the video, and it'll work.
I have an internet connection that has a proxy and its IP is 192.168.49.1:8000, in order to connect to the internet I must configure this data, how do I configure the same on the raspberry pi4, I have not been able to use the internet via wifi, the raspberry pi4 connects to the wifi and assigns an IP automatically but does not browse because I have not configured this data as would be done when it is in client mode.
To configure a proxy client on the Raspberry Pi 4b, that will greatly vary depends on your operating system. From other comments I've seen you make on different videos it seems like you are using OpenWrt. If so, you can follow this video below that reviews it. th-cam.com/video/tjiMyuLrejA/w-d-xo.html You can use privoxy to forward requests to an upstream http proxy, as you've given in your comment. For Raspberry Pi OS, you should be able to do it in your OS configuration, and a simple search should give you plenty of information to do that. I'd be sure to specify if you are using Raspberry Pi OS with a GUI or just a terminal. Either way, heres an example of how to set one up using the terminal. forums.raspberrypi.com/viewtopic.php?t=28835
Thanks for watching Gofur! So doing SSL and caching are both bigger endeavor's than this video shows, so I am not experienced there. However, this is the generally what you need to do. First, you need to enable HTTPS proxying. This is basically setting up your squid proxy to do decryption / Man in the Middle (MITM). They also refer to this feature as SSL Bump or "peak and slice" in the newer versions of squid. This link below is a general example of how to do that. medium.com/@steensply/installing-and-configuring-squid-proxy-for-ssl-bumping-or-peek-n-splice-34afd3f69522 wiki.squid-cache.org/Features/SslPeekAndSplice The medium article seems to talk about caching, and that may be all you need to do for basic caching. In squid, caching has lots of directives / options, so there is plenty to be configured. I personally haven't tested out either of the above, but they should both be a good starting point. For more information you can refer to the wiki here on directives and caching. www.squid-cache.org/Doc/config/
Huh? I'm feeling dumb and scared that I will mess up my computer. I can follow instructions but I would have no idea what I am doing. Are you available for house calls? Kidding or ???? Suggestions?
Thanks for watching Kim! Configuring a proxy won't mess up your computer, where it's not reversible, not to worry. If you have any questions you'd like to discuss, I'd be happy to answer your questions over comments or emails.
Thanks for watching @stefanlaterra5797! I'm not sure where you are talking about in the video. The first SSH (when I'm SSHing into the squid server), I'm simply logging in with my password. The other time I refer to a password is creating a Squid proxy password at 9:52, such that when in order to connect to the Squid proxy, you need to use this password. This command is actually out of date here, and you can refer to the comments section and video description for that updated command.
@@DevOdyssey Thank you very much, yeah it was the initial SSH one, there was an issue on my Ubuntu where it was not connected to the internet at all causing problems, user error, thanks for responding anyway, greatly appreciated.
Hi, Great Video, btw can u make how to setup squid proxy on windows 11? and it is possible to setup squid proxy directly to an internet router, so every client when accessing the internet using router connection will automatically using squid too. Sorry for my bad english, hopefully u will understand what i'm talking about. Thanks😇
Thanks for watching @-_MHDWILDANATTAMIM! So first off, looks like you can get squid proxy on Windows, though its only available via third parties, according to their website. As for setting up squid proxy directly on an internet router, yes, you can do that, though you'd need a router firmware / OS like OpenWrt to do that (or technically a linux distro in general, but that requires more configuration to make it a router). openwrt.org/packages/pkgdata/squid I was able to understand everything, no worries! But just to be clear, you don't need to have squid proxy on a Windows client. You would simply need to configure your Windows client to access the proxy by changing proxy settings, but don't need to run the proxy server itself. That is, unless you want to run a Windows server as a squid proxy, but given you said Windows 11, that doesn't seem like the case.
I don't clearly understand should I install Squid in case SOCKS proxy? Or I just configure sshd on the remote server and create a ssh connection with -D option to it, after that configure my local listen port to the web browser
Thanks for watching VladF! This video was meant to showcase 2 different options for proxies you can create and configure yourself, SOCKS5 and HTTP. Depending on your needs, a SOCKS5 proxy might work better than an HTTP proxy, or vice versa, depending on certain network limitations you may have. If you want to quickest and easiest setup, I'd recommend using a SOCKS5 proxy via SSH, since SSH is on Ubuntu (and frankly most Linux distros), by default. So yes, you'd just configure sshd on the remote server, and connect to it via your client, using SSH with the -D switch, for a dynamic forwarding proxy, and then set your local proxy settings (OS based settings or plugin settings, like Foxy Proxy) to the loop back interface / IP (127[.]0[.]0[.]1), and the dynamic port you chose. For using a proxy service directly from a client machine, this is the option I'd recommend. For setting up a proxy service in your local network for multiple client devices, HTTP (Squid) might be better, as not all client devices have a SOCKS5 client available.
If you are using Openssl 3 in any distribution of linux -crypt command whas removed instead to generate the encrypted password you could use : sudo sh -c 'printf "usuario:$(openssl passwd -6 -salt $(openssl rand -hex 16)) " >> /etc/squid/htpasswd' replace 'usuario' with the username
Thanks for watching @andressebastianpaez6806 and thanks for sharing! I appreciate you helping out and providing updates and advice for and users who would run into this situation. Should definitely be helpful. While I don't recommend and production use of Squid using an authentication scheme like this, especially if its public, its good for anyone doing testing or whom have a Squid instance that is within their internal network to use as a system wide proxy. It's too bad the password here can only be 8 characters in length, due to the limitations within openssl, if I'm remembering correctly. So with the passwd -6 portion of the command, does it actually generate a 6 character length password? If so, we could probably modify that command to -8 to make it a 8 character password, to create as long and secure of a password that this command is willing to accept and not get truncated.
@@DevOdyssey Thank you very much for the answer, what I have investigated about this command is the following: The command "openssl passwd -6 -salt" in OpenSSL 3 is used to generate a password hash using the SHA-512crypt algorithm with a specific salt. Here's the meaning of each part of the command: "openssl passwd": It is the command that invokes the OpenSSL tool to generate a password hash. "-6": This option specifies the use of the SHA-512crypt algorithm for generating the password hash. The number 6 is associated with the SHA-512crypt algorithm in OpenSSL. "-salt": This option specifies a custom salt that will be used in the hash generation process. The salt is a random string that is concatenated with the password before applying the hash function, enhancing security by making brute-force and rainbow table attacks more difficult.
Thanks for really digging into the command options and providing a an explanation of each portion of the one-liner. Everything else about the command seemed fairly obvious to me, including the -salt switch, the passwd command, and the salt generation using the rand command and -hex switch. I was unsure on what the -6 meant, whether it be final password length or something else. I appreciate you taking the time to research and share the results with everyone here so they can know it actually means to use the SHA512 hashing algorithm, as opposed to the my initial though on password length. I’m not extremely well versed in the openssl command, so I learned something here. This makes sense to me as I have used other commands that use a number to specify the hashing algorithm, such as hashcat. Thanks again for the contribution!
Thank you! However, wouldn't salting the password require additional changes in the squid.conf file? I don't think the "basic_ncsa_auth" is able to verify the password. It worked for me when I removed the "salt" flag 👍
Thanks for watching@@mihir8675! You make a very good point. This is something I also overlooked when responding to these comments. I don't think basic_ncsa_auth can handle salts. Generally, salts are great to use to avoid a password crack via rainbow tables, but at the same time, squid does not know the salt, it can't generate the appropriate hash to match during the authentication process. That being said, salted passwords wouldn't work unless there is a place you can add the salt in the configuration file. Doing some research, I can't seem to find that. Unless OpenSSL is handling the salt on the backend. I saw this community post here for someone else, but I can't verify their claims as I haven't tested it. www.twit.community/t/setting-up-squid-proxy/13187 I'm happy to hear that you got it working when you removed the salt flag above. I appreciate you sharing this so that others can refer to it and get their setups working. Nonetheless, using this authentication type was purely demonstrative, and for anyone setting this up public facing should use something stronger, such as OAuth2.0. Much more complicated, but enables much stronger security than basic passwords. I've been meaning to do a follow up to this video where I set it up in a cloud service provider, with improved authentication. I look forward to making that video.
Thanks for watching Krod! To be honest, I'm not really sure. Thats because I don't know what communication protocols League of Legends uses, such as if its only HTTP(s), or more. Chances are, its more so using Squid proxy will not work in that scenario. However, you could use a SOCKS5 proxy, and that should tunnel all your traffic through an encrypted SSH session, at which it could work for League of Legends. But, I'm not sure at how fast the proxy will be, and knowing how important latency is in gameplay, I would keep that in mind if you do try a SOCKS proxy. I guess this also depends on how you play league of legends, as if its through a browser, you could then put the proxy settings in your browser, and that you should be tunneling through the SOCKS proxy. If the gameplay is through an app like on your desktop, then you'd need to configure the proxy settings on your Operating System in your network settings.
Thanks for watching joel! Honestly I don't have any experience caching websites via squid, but someone else did ask the same question in the comments below and I shared some research I found. These links below should be helpful to get something set up. medium.com/@steensply/installing-and-configuring-squid-proxy-for-ssl-bumping-or-peek-n-splice-34afd3f69522 wiki.squid-cache.org/Features/SslPeekAndSplice www.squid-cache.org/Doc/config/ Hope this helps!
Very good video. How did squid handle SSL certificates? I didn't see any config but postman api call to https site worked. Do you disable disable SSL verification?
Thank you Aykut! Thats a good question. I did not have squid handle the TLS certificates, and it was disabled, or I should say I didn't explicitly enable it. Though, if you want to be able to analyze the traffic, you'd want to get an https certificate and put it on squid, and have Postman trust squid's certificate. I haven't tried this out, but it shouldn't be too difficult, just requires some work. The instructions below should be helpful. elatov.github.io/2019/01/using-squid-to-proxy-ssl-sites/
Great vid 👍 is this something I can do on an ipad which has a website blocking system so that I can access those websites? I think I need a special link to use because proxies and vpns are all blocked
Thanks for watching! Just to elaborate, when you say VPNs are blocked, do you mean VPN apps? If so, then you probably are using something called MDM (Mobile Device Management), and have essentially configured it to secure it as per their policies. Given that, you likely don't have access over all the settings on the iPad, including app downloads and administrative settings. In that case, creating your own proxy is not something that will help unblock websites, as chances are you wont be able to configure the proxy settings on the iPad. You can give it a try in the WiFi settings, where you can specify an HTTP proxy to connect to, but I'm not sure if that will be exposed on a managed device, as I have not experienced this before. Give it a shot and see if you can edit those settings. If you can, then an HTTP proxy can help you get around blocks. But you still won't be able to install a VPN app. It all depends on how much is locked down on your iPad.
You're welcome Deyaa! Thanks for watching. Yes! you definitely can, and that would be a great way to use it over the internet (if you want to expose your Squid service over the internet). If you do try this, I'd definitely caution to make sure you set up your Squid service with authentication, even better authentication than what I demonstrated. OAuth would be ideal, but thats definitely not easy. There are other forms of auth you can look into, but the basic auth here is not good enough. In addition, you should also set up an SSL cert. You can go with a LetsEncrypt certificate, that you can generate for free. Doing this publicly is a bit more challenge for an HTTPs Squid proxy, versus using a SOCKS proxy over SSH publicly. With SSH I'd recommend using an SSH key, and that would be secure enough. Much easier than following best practices for HTTPs. I'd look into how to create that certificate, and how to configure squid with HTTPs before you go down the route of using it as a proxy over the internet.
Thanks for watching Business Intelligence! From my understanding, and in theory, you should be able to run multiple instances of Squid Proxy on the same server. You’ll just have to run them on different internal ports, as otherwise it wouldn’t start up. As I haven’t tried multiple proxies on the same server, I’m not sure if you can use multiple outbound interfaces, on the same squid instance, but if so that would be the better option, as opposed to running multiple instances of the squid server proxy. What I haven’t done yet or figured out is how to delegate traffic to different Ethernet interfaces, to reflect that you’re going out through different IPs, since that’s likely your goal. You’d need to create these interfaces, and then assign the Public IPs to those interfaces. This could be through DHCP, or manual assignment, but this is where you may have some difficulty. Then once you’ve done that, you’ll have to tell squid proxy server(s) to use specific interfaces for internet based traffic (basically specify which proxy IP to use). Then after all that, you should have multiple proxies working on the same server. As for how many, I think you’re really only limited by server resources, mostly RAM and CPU, so I imagine you could run many proxies one server, but I can’t say specifically since it depends on the server resources. Otherwise, an easier option is to use proxy services that host multiple proxies, that’s likely the easier option. Sorry for the long answer but in theory that’s how I imagine it would work, and should be possible.
Thanks for watching @zekadoodle6488! I’m not that knowledgeable on Chromebooks, but from what I know, it’s not possible to make a Chromebook into a proxy server. I’m sure you can connect to a proxy, just not make it a proxy server as shown in this video. Now you could flash Linux onto a Chromebook at which you then could make it into a proxy server, but not on Chrome OS.
I have webapp with "signinwithgoogle" option. "sign in with Google" works when the url is localhost. But, when I want to run my web-app with dynamic IP address, web-app works but sign in with Google option alone doesn't work. Is there way, I can run my web-app with dynamic IP where sign in with google option works with help of proxy. I need HELP!!!
Thanks for watching Coderart__! I'm not sure how much this relates to proxies, and is likely dependent on your webapp that you're building, but I'll offer my input. I am not sure what you mean by "running with a dynamic IP address" but I assume you mean a proxy or "IP other than localhost". Using Sign In With Google option is likely using OAuth 2.0 and OpenID Connect, but chances are, you need to investigate your integration with Google, and check to see where you can allow specific IP's or hosts to use the OAuth 2 integration from Google. Doing that, should then enable you to "sign in with google" on your webapp. You should have some sort of dashboard that should help you here. Other than that, I'm not sure what else it would be, and that would require more troubleshooting.
Hi, I'm having a problem related to my work, and I was hoping after watching this video I would be able to fix it myself, but I still don't know how to. My work requires accessing websites that are region-specific, and in order to do so, I need to have an IP address from that particular country. Unfortunately, due to the restrictions and limitations in my country, I'm having major difficulties accessing these websites using a VPN. So I live in Egypt, and my work is in Kuwait. I tried using the NordVPN service, but they don't provide servers in Kuwait. I heard of Meshnet from Nord, and it did work (kind of). The issue is that in order to use Nord's application, I have to be on a VPN already (just to access the app and use the mesh feature), so as soon as I obtain the Kuwaiti IP through Meshnet, the VPN (used to access the Nord app) disconnects, and subsequently I lose access to the Kuwaiti IP obtained using Meshnet. As a workaround, I'm currently accessing the websites using on of our team's lap using AnyDesk, so working from his pc directly. Great video btw 😀
Thanks for watching @big-jo89! I appreciate the compliment 😊 So it looks like a proxy solution could help you here, but seemingly you're looked more into VPNs. If it's just web traffic, you could use an HTTP(s) proxy, but if its more than that, a VPN (or even a SOCKS proxy), would be better. In your scenario, I'd probably lean more toward using a VPN service. But before I dive into that, have you tried other proxy services and gotten any working results? Just curious, as there may be some potential here, with more selectivity of regional IP rotation. What you essentially need is a couple of "hops" in your connection. You need to connect to a place where you are allowed to from your current location, and then from that place, is allowed to connect to your true destination, basically, an intermediary. As I don't know a lot of the geo politics about countries blocked or allowed, do you know of any country that you can access from Egypt, but also has access to Kuwait? Here is where you'd get your best bet. What you can do, is set up a cloud server that you have access to that can VPN into. Then on that cloud server, you VPN into Kuwait. Then with proper routing rules, you can tunnel your connection from your PC, to the cloud server, and into Kuwait. So it would require some manual effort, but thats how I'd see it working.
hi, gpt4 taught me to setup squid and i duno is it http or https (between client and proxy), it then taught me to wrap thru SSH tunnel as you did. however i found your teaching better. thanks
Thanks for watching! First time I've heard someone talk abut using GPT4 to learn tech, though I know its being widely used in IT. I have to say I've used it to help me too. But, my thoughts here are to double check the output, because often it can miss the context of what you're trying to to. Anyway, happy to hear my teaching style was better than GPT4, thats probably good for any youtube educator to hear 😊. As for the squid setup, its both http and https. But if you want something quick and easy, the ssh tunnel works best. For a network wide proxy, you'd want to use a dedicated proxy, such as squid.
Thanks for watching @KhabaristanToday! I haven’t done that, but I’m sure you can use the extensive APIs available in AWS to stand up an EC2 instance with one IP, install squid on it, and then configure it. I’m not sure what you mean by multiple proxies with one IP. The IP is really the “proxy” in the sense that this AWS IP is proving your real IP. Multiple would assume multiple IP addresses. Sure you can have multiple instances of squid running, but then if they all are behind the same IP, there really is no point to having another instance running, at least that I know of). And if you want to load balance, you run another instance of the proxy on another machine / EC2 instance anyway. Your best bet is to start researching the AWS API and see why you can do with it. I’d also look into terraform, as that will be very helpful in automating your environment creation.
Thanks for watching @reesegonzales9585. The video and the comments here should help, as generating a password seems to be a bit different than prior, due to deprecated libraries from my ubuntu instance at the time of filming. For example, this command from @NickHope below should work: sudo printf "USERNAME:$(openssl passwd -1 'PASSWORD') " | sudo tee -a /etc/squid/htpasswd Just insert whatever your username and password that you want. Then doing all other necessary configuration to turn it authentication, as per the video, should work as demonstrated.
Thanks for watching! So not necessarily. SOCKS is just a proxy that uses a different network protocol (when compared to HTTPS) to proxy traffic, but also can proxy more than just HTTPS traffic. Squid, as an HTTP(s) proxy can only proxy HTTP based traffic. SOCKS can proxy send not only HTTPS, but also SMTP, FTP, etc, as a Layer 5 proxy. In my opinion, its benefit is that its a simpler and still secure way of proxying traffic in when compared to a Squid / HTTP(s) proxy. Getting HTTP(s) Proxy to work can be more difficult, since it involves setting up certificates. If you want to do inspection on the traffic, that would involve breaking the HTTPS connection, effectively man in the middle, and that adds another layer of complexity. So I like to use SOCKS proxies where I can for simplicity, but a HTTP(s) proxy is likely to scale better, especially in larger deployments.
I had the proxy working but after I set the password I started getting 403 authentication errors. I checked the conf file multiple times and I forwarded the ports in my wan setting on my router. I'm also using a windows computer without using putty because after configuring Openssh in ubuntu, I was having problems connecting to the gui version of ubuntu 20.04.
Thanks for watching Jay! From the sound of it, it seems like you didn't set the username and password on your client so you can authenticate to your proxy. When you set the password, it means that credentials will need to be presented in order for any client to use the proxy. If there are no credentials (or incorrect credentials) provided, then you would get a 403 Unauthorized error, so it seems to line up. I'm not sure where you are trying to use the proxy on your client, but wherever you set the proxy IP / URL and port, just specify the username and password, and that should resolve your issue. So for Windows, you can set the proxy in your network settings. As for the GUI issues you're having connecting to Ubuntu, i'm not really sure where that is originating from, but it shouldn't have anything to do with Putty or OpenSSH in Ubuntu. That would just really depend on what protocol you are using, to connect to the GUI (like VNC) and if there some issue with its configuration.
I learned the hard way! 1.You can't(apparently) use capital letters in username 2. My server didn't have htpasswd installed, so password authentication didn't work oob. It is part of apache2-utils package (~1MB).
Thanks for watching LPFan4! Learning the hardware is all I do, so I can relate😄 1. I didn't know that, and I don't think I encountered that in my testing, but good to know, so thanks for sharing! 2. Yes, that package is required for htpasswd for password authentication. My ubuntu installation may have had it already by default. This is definitely an example can can be done better too, so if you want to use other ways of authentication against squid, you certainly can do that.
Hello, I'm having issues connecting to the proxy I created outside of my local network since I'm hosting this on vmware, I've tried my public IP address on another network with no firewall on, correct port and it fails to connect.
Thanks for watching! Half the battle in setting any networking up is troubleshooting, so hopefully you can figure out the problem with some guidance. So since this is hosted in the public internet, I’d first do some troubleshooting in your local network’s end. See if you can verify that connection attempts are leaving your computer. In this case, you can use wireshark to test outbound tcp connection attempts to the public IP address that your squid server is listening on, and then make sure it’s the right port. If you’re using the default it should be 3128. Then if all is well on that side, you can do this same process on the squid server side. Make sure it’s receiving packets from your public IP where the request is originating from, and on the incoming port (or destination port) of your squid server (again, 3128 if the default). In addition, you can check if squid is listening for incoming tcp connections by running a command like netstat, at least in Linux, and check the interface it’s listening on. Lastly, I’m not sure if your squid server is behind a NAT, but if so, you’ll want to be sure you have the right port forwarding rule in place for that. That should provide you with enough guidance to see where the problem resides and hopefully how to resolve it.
Thanks for watching Movie Syndrome. You can’t create your own random public IP with this process. If that’s what you need, then I’d suggest paying for a rotation proxy service, that with give your random public IP addresses on demand. Those have to be assigned by your ISP, there’s no way to randomly create your own public IP addresses.
@@DevOdyssey Thans dev, this is exactly the answer I was chasing. Do you know if webshare is a legit provider of proxies? Or do you have any personal recommendations on affordable proxies?
@@moviesynopsis001 you’re welcome! As for webshare, I’m not that familiar with them so I can’t personally recommend then. I have used a proxy service called IPRoyal and they work well for me when I use them. I made a video showcasing how to interact with their proxy, which includes a rotating proxy. You can find that video here. th-cam.com/video/tjiMyuLrejA/w-d-xo.html They’re also pretty affordable. I can’t say I’ve shopped around for the cheapest but their prices aren’t bad.
Thanks for watching @rmbringas1! Sadly, you cannot do SFTP over Squid Proxy. Squid Proxy is an HTTP proxy, at Layer 7 in the OSI network model. SFTP is Secure FTP, which is a different protocol also in Layer 7. You can only send HTTP(s) traffic over the Squid Proxy. In order to tunnel SFTP traffic over a proxy, you'd need to use SOCKS proxy, which works on the transport Layer (4). So you'd want to follow @11:35 in the video, where you can do dynamic forwarding over SSH. Otherwise, if you don't want to do this over SOCKS proxy, you can set up a VPN and that would work as well. You just can't use an HTTP proxy for anything else other than HTTP traffic.
i have some issues installing squid, could you maybe help me (the guide in your description doesn't work it tells me to install java apt but when I install java It doesn't work and I can't seem to find a java "apt"
Thanks for watching donquavious III! I am not sure what you mean by "install java apt". If you are using a base install of Ubuntu, apt is the default package manager. Using apt, you should be able to find the squid "package", which is really just the squid server software. Nor does it seem like java is a dependency of squid. So I am not sure where you are encountering this, but if you can explain more, I may be able to better assist.
Thanks for watching Bradnilious! I'm not sure what you mean, as the video shows it. The operating system being used is Ubuntu, but any Linux OS should really do, especially that supports SSH. This is what runs the SOCKS proxy. Squid runs the HTTP(s) proxy which is a program you can install on Ubuntu using apt, though similarly can do that on other Linux OSes. If you can get a little more clearer on your question, I can give you a bette answer.
@@DevOdyssey You answered my question anyways :) I actaully had another question. You mention this being able to access things that were blocked. For example, a school computer. How would I use this for that? Another question, when I install squid through apt, it doesn't generate a squid.conf file. I do not know what is going wrong.
@@bradnilious Glad I did! So by access things that are blocked, I’m referring to content on the internet, like movies, tv shows, etc. you can’t really access a school computer this way. I’d have to understand how it’s blocked and how you re trying to access it. But if in general you’re on a school computer and something is blocked, there may not be much to circumvent those blocks due to controls they have. I wouldn’t recommend trying it either as you’d likely raise alerts doing so. I’m not sure why the squid.conf wasn’t generated. Have you checked / searched all directories? Try doing a locate squid.conf or find command on it. should be in the /etc/squid or squid3 directory.
Thanks for watching Swaced! To my knowledge, for making usernames for SOCKS proxy, that should be as simple as making new users on your Linux distro (Ubuntu), and giving them permission to login over SSH. Then that username, password, or public key (more secure) combination should authenticate users to the OS itself, and give them access to the server as a SOCKS proxy.
Hello, I am having some issues where auth just does not seem to be working for me at all. I have tried yours + many other guides out there, completely reinstalled my squid proxy time and time again but it just never seems to work for me. I'm following your examples exactly as they are but just never seems to work, any reason or help you can give here?
Thanks for watching VanGendt! I’m sorry to hear about the trouble you are having getting authentication to work. Depending on where you are deploying your squid proxy, and if it’s publicly accessible over the internet, I’d use a different authentication mechanism than the one I did in this video, as it’s for demonstration purpose only. There are plenty of other authentication mechanisms you can use for squid proxy, as you can see here. wiki.squid-cache.org/Features/Authentication Without much more detail, or error messages, it would be hard to troubleshoot the issues you are having, or provide any reason why what you’re doing is not working. If you can’t get squid proxy authentication to work, I’d definitely try setting up a SOCKS5 proxy using dynamic forwarding over SSH as I show in the second half of the video. I’d recommend that over squid since it’s much easier, and if you don’t have a hard requirement of using an HTTP proxy. Combine that with a SSH key and that would be very secure.
Thanks for watching haispntong1251! When you create this in a cloud environment, say on a VPS, you can have as many proxies as public IP addresses, at least in terms of what makes sense. You can have multiple instances of squid proxy but you really don’t need that unless you have specific use case that requires it. One instance should be able to handle traffic routing through different interfaces with public IPs. It really comes down to how many public IPs / interfaces your VPS has.
Thanks for watching Kot. I'm not sure how to answer your question, as I'm a little confused, but I think I know what you're asking for. If you want to create a TCP connection between a phone and a server, you can do that with the rights tools, pretty easily. Depending on your phone and its abilities, you can create an SOCKS proxy on the server, and connect to it via your phone. Then you'd just need to make sure your phone is set to use that SOCKS proxy in your phone settings. This, in essence, would be a TCP connection, because SSH uses TCP on the transport layer. Then on your server, you just need to configure it to use an HTTP proxy in its settings, and from there, it should forward any HTTP traffic the server receives, to the HTTP proxy server you're connecting to, even if the traffic originates from a SOCKS proxy. I think this is what you're asking for but if I'm wrong, let me know.
@@KillerKotHD If you'd like to contact me further you can find my email on my channel page. Otherwise, if the troubleshooting can be of value to others who watch this video, we can continue discussing here as well.
@@DevOdyssey ok, i found another question. How can we redirect all http trafic from openvpn client to squid? i have a openvpnserver set up and a squid proxy setup on my rasberry pi. now how can i merge them? i'm not really good at networking unfortunatly..
@@KillerKotHD So if you have OpenVPN Server and Squid, on the same machine, you can hypothetically set up a proxy client in your Raspberry Pi OS settings, to connect to the proxy service running locally on the raspberry Pi itself. And then any http traffic from OpenVPN clients, that are connected to the OpenVPN server, will have their http traffic proxied through squid. But, if I may say, this doesn't really make too much sense. Unless the squid proxy service is running on another interface (aka your Raspberry Pi is multi-homed), then I'm not sure what purpose it would serve to proxy your OpenVPN Server http traffic through squid proxy server, when they are running on the same machine. If you care to elaborate what goal are trying to accomplish, I could suggest a solution / setup for you that would achieve your desired result.
how do i fix this. I tried checking the status of the server, and it says failed result exit:code. How do I fix this I am completely new to this I NEED HELP BADLY
Thanks for watching Vyra! I am not sure what that error message is referring to. Is it for starting HTTP Proxy (squid)? or is it for the SOCKS proxy (ssh)? Depending on if its squid, or ssh, there are different logs you can refer to, such as for squid it's likely in the file var/log/squid.log. For SSH, you can use the v flag (ex: -vv) to see the some more messaging and give you an idea of why you are seeing an error. Otherwise, googling the error code with more detail will likely help too.
@@DevOdyssey I manage to fix my previous issue but when I try to configure socks proxy it says my password is incorrect when I literally copied and pasted
@@zvyraz I am not sure how you are configuring your SOCKS proxy, but in the way that I set up the SOCKS proxy in this video, there is no username and password. While you can set it up that way, I am not too familiar with that. In this video, I connect to a Ubuntu server running SSH. While connecting over SSH (on port 22), I open up port 40932 locally (aka on my client computer), for the SOCKS proxy. This port sends anything it receives, through the existing SSH connection to the server over port 22. This is referred to as tunneling. Then when the tunneled connection exists the server, it leaves via an arbitrary port on the server, and thats what "dynamic" means in that case. This "tunnel", is effectively the SOCKS proxy connection, and when setting it up, there is no username and password, just an open port on your computer to use for the SOCKS proxy connection.
Thanks for watching! Yes, you can create a USA based proxy even if you are not in the US. You'd simply have to stand up a cloud server / VPS, in a US based datacenter with an public IP in the range dedicated to the US. There are many cloud providers you can chose from. Once you have done this, its a matter of ensuring you have a remote connection to that VPS, i.e. firewall rules that let you into that server, so you can SSH into it, or directly connect over the squid port if you want to expose squid over the public internet. However, I would caution here as anything you expose over the public internet should have good authentication. For SSH, I'd recommend SSH keys at a minimum (when using a SOCKS tunnel over SSH as shown in the video, rather than setting up your own independent SOCKS server which I didn't cover, but also an option), and for Squid, I'd go beyond setting up Basic Authentication, and ensure you use HTTPS as well. That is definitely going to complicate the setup more, i.e. stronger security like OAUTH, and certificates for HTTPS, and if you want to inspect that traffic, you'll have to set that up as well, and thats additional setup. So if you simple want to proxy out, I'd suggest using SOCKS over SSH implementation like I did at the end of the video, 11:35.
Thanks for watching Inspire you UP! So this video does cover the Socks 5 part, but as noted, it does not cover the creating a VPS part. That could be a good video to do in the future, but for now, I can refer you to some documentation on how to create a VPS on a cloud service. If you used Linode, for example, you can follow their documentation (see below), and specifically, the section on "Log in Using SSH". You'd log in over SSH using the -D flag for dynamic port forwarding (as noted in 11:35), which your local port number of choice, and then using a SOCKS 5 client (such as Foxy Proxy) to connect, and thats basically it. Your traffic will then be tunneled out the public IP of the Linode Server. You could do this with other providers as well, but Linode comes to mind first and I have heard good things about them. I personally have not tried out Linode, and nor do I have any affiliation with them, but thats probably a VPS provider that I'd try out. www.linode.com/docs/guides/getting-started/
Thanks for watching Antonasia! So after logging into your Ubuntu / Debian based Linux server that you've dedicated for use with Squid via SSH, you download and install Squid by using the command "sudo apt install squid" at 05:12 in the video.
Hello Sir. I'm using a VPS (USA Location) and trying to access some Indian websites. I need to create a proxy server for India Location. I'm from India and I have plenty of Internet for my PC (windows 10). Is it possible to create India proxy using my own PC internet to use the same in the above said USA Machine? I'm very much new to this coding world. All I know is little bit of python. Please help me sir.
Thanks for watching @friend1439! In order to create an "India based proxy", you'll need an Indian IP address. Whether that come from a VPS, or a VPN provider, you need some sort of machine that gets assigned an Indian IP. This would then indicate to the Indian websites you are visiting, that you area coming from India, even if you aren't physically in India at the time. Since it sounds like you know a bit about VPS's you can stand up a new VPS and ask to be assigned an Indian IP. How do you do this will vary amongst cloud providers, but the general gist is you want an Indian IP. But as I read your response more, and try to make sense of it, it seems like you don't need to necessarily do this. If you have a laptop, thats already accessing the internet with an Indian IP, theres nothing you need to do then. You can shut off your proxy connection to access the Indian websites without being proxied, or you can create rules for what websites you do not want to access over the proxy, in that, they're simply accessed via your Indian IP. This is something you'd have to do using split tunneling, but thats technically VPN based, which might be an option for you if you want to stand up a VPN in your VPS. Doing a bit of quick research, I dont think its possible to "split tunnel" between different domains, in that what goes through the proxy, and what does not. There are block lists and allow lists, but I think thats all the domain filtering you can do.
@DevOdyssey Thanks for the response sir. It is like this, I'm in India having a windows 10 laptop with active internet connection and Indian IP obviously. My brother is in USA and he needs India IP for accessing Indian OTT websites. I don't prefer using VPN. I'm thinking to make my personal IP as a HTTP proxy IP for him to use. I read about squid but I'm not completely sure about the process to achieve this in windows system sir.
@@friend1439 Thanks for the additional detail. Now I understand your set up better than I had before. Given that, you have a few ways you can address this. First, you would need to know if your public IP is one you control, or is CG-NAT. If its one you control, you can simple stand up a http proxy or your own VPN server, and port forward to that service, which your brother can connect to, and use to tunnel his connection out from your computer / public IP, giving him an Indian IP. If you have a CG-NAT IP, then this process will not work, as you do not control your public IP, and you cannot port forward. Here, I would suggest setting up a VPN server (can't do an HTTP proxy here) on your brothers VPS (or any VPS you control), where your computer, establishes a tunnel to that VPS. Then, you can configure any connections to that VPS, to tunnel our through your tunnel between your computer and the VPS. Then this would make it seem like any traffic would be coming out of your Indian public IP. I don't have a extremely specific video for this situation, but the best one I'd recommend is the site to site VPN video I made. th-cam.com/video/2dH-O0crThk/w-d-xo.html Now, if you end up getting another VPS and you get one with an Indian IP, then you can simply install an http proxy on that VPS. However, in general, I'd recommend establishing a VPN server on a VPS as that will be more secure, in my opinion. If you do proceed with a public facing HTTP proxy, ensure that all traffic is HTTPS, and it has strong credentials protecting it, using something better than basic authentication. I prefer VPN servers likely because I have done this process many more times, and I find it quite easier than setting up an HTTP proxy.
Thanks for watching Gog- playz. Could you specify what you mean by bulk proxies? From what I understand, it seems like you want multiple proxy instances with multiple IP addresses. You can certainly do that, and use this method to create multiple cloud instances of Ubuntu with different public IP addresses. The cost of this would increase pretty quickly though with more cloud servers you create. Otherwise you can try and buy your own Public IP address block, which might save some money, but again the cost will add up over time.
Thanks for watching Nur Amalia! Yes, you can use the squid proxy without auth no problem at all. Basically you'd complete the step 5:01 to 6:31, and that's it. Now if you running this locally on your own network, where you only want to access it, I'd say leaving off authentication is not a big deal. However for any larger deployments (larger internal networks with multiple users, or external networks), I'd recommend to have some sort of authentication on for tracking authorized use.
Hello sir I'm confused at ip where can I get ip were you enter on postman and first of the video in terminal like " ssh squid@ip " So where can I find this ip can u tell me pls Edit : and when i type ifcongif command on terminal i found "wlan0 and there is ip showing that ip i entered in postman and then i follow ur next "http/ifconfig" so i found ip but is different and ur too different and 3rd step u type in terminal " sudo vim var/log and then i found same IP were i entered in postman but ur ip is different and so also it's work for me ? And where i found my ip last digit like "109.09.09.0/this number
Thanks for watching Tarun! That IP comes from my ubuntu server I set up as my Squid (HTTP) / SOCKS5 proxy. Doing "ifconfig" or "ip a" on my Ubuntu terminal got me that IP. I'm not sure i completely understand your edited comment, but I'll try my best. So i would expect to have a different IP than you see, as chances are we have different networks setup with different ranges. I am using an Ubuntu server in my local network as a proxy, and if you are using a server in the cloud, with a public IP, you will definitely have a different IP address. It really comes down to your use case and what you want to set up your proxy for, which will dictate how you set it up, and what parameters / values you see. I don't know your setup, so I really can't comment on things like IP addresses. If you set it up correctly, using your IP address, you should have no problem getting this working. From the IP you mentioned, it sounds like your interface is a public IP address. If you have Squid (or SSH) listening on that IP address, then that is the IP address you want to use in Postman. You don't want to use your wlan0 IP address, unless, you intend to connect to your proxy via your local wireless network. Without much more detail on how you want to define your setup, this is all I can really comment on.
how do I find out the IP address of my squid server so I can go to postman and insert this? I have an hour trying to figure this out and there's nothing in Google.
Thanks for watching Victor! If you're running on ubuntu, or another linux distro, you can run the command "ip a" in the terminal and see an output of your server's IP address. That is then what you can use in Postman. However you'll have to be logged in to begin with in order to run that command, which you'd already most likely know the IP address be then (unless you're running a local VM).
Ah that makes sense then. Open up a terminal and running “ip a” should give you an IP address for the Ubuntu machine and as a result the IP squid is running under
@@DevOdyssey I tested and when trying to connect to the squid server it says "connection refused". I check the status and it's active (running). How can I resolve this? Also, should I use a postman inside the VM or outside in my host machine to do the test in postman? Sorry I'm trying to do a project and there's not much info about Squid out there easy to find.
Thanks for watching KingzCostz! To download squid on Ubuntu, you simply open the terminal app, and type the command sudo apt install squid, as you can see at 05:08. This should install the latest version of squid HTTP proxy service. To make an account to use for basic authentication, you can follow along in the video starting at 07:52. Though, know there are other methods of authentication you can add that I didn’t cover.
Thanks for watching Anderson! If you want to create multiple users and password for a SOCKS5 proxy, you can simply create multiple different Linux users and allow them SSH access (say via sshd_config), set up SSH keys if you'd like, and thats it. Since SOCKS5 works over SSH, and SSH authenticates with the Operating System's users, you'd just have to create those system users. It's pretty simple. For example, this link below shows you how to create users on Ubuntu using the "adduser" command. www.digitalocean.com/community/tutorials/how-to-add-and-delete-users-on-ubuntu-20-04
hey dev, i have a licensed software ( Minitab ) it has two parts one is the license server( windows ) and the other is the client software(windows and mac). The client can use the software by putting license servers ip and port directly however, i want to restrict access to the clients by mac filtering or user authentication or proxy. Iam totally lost please help how do i accomplish this...
Thanks for watching Raj! So I'm not 100% how you can accomplish this, but I'll share my thoughts. If this were possible, you'd want to use a SOCKS proxy, as opposed to an HTTP proxy. I don't know the protocol of the license server (Minitab) and how it checks for license usage, but I'm not going to assume its HTTP. With a SOCKS proxy you should be able to tunnel all traffic through it, regardless of application protocol (ex: all TCP or UDP traffic) In addition, you'd want the client and the server to be on two different networks. Thats because if they are both on the same network, I don't think the traffic would run through the proxy, it would just reach out to the server directly being on the same network. I won't get into the technical details of this, unless you'd like to know, but it's mostly about communicating over Layer 2 or Layer 3. You'd want to communicate over Layer 3, and above) since the SOCKS proxy operates on higher layers like 4 and 5. Then you'd just configure your clients to use that proxy, and all network traffic would go through the SOCKS proxy. With regards to mac filtering, I'm not sure how you'd do that with a SOCKS proxy. MAC Filtering happens on Layer 2, and since we want our controls on higher layers, MAC Filtering isn't really an option for restricting access to the server. The above recommendations should work for you. However, it can also be achieved via firewall and routing rules, a proxy isn't necessary.
@@DevOdyssey i tried a lot of things but couldn't get it to work. I tried creating a socket io nodejs proxy with auth, Sometimes the proxy wont recieve data, sometimes its not able respond back. Can you pls help me with the firewall method ? Like how do i allow only predefined mac ids that can connect to the licensing server
@@rajsaroj4696 With regards to the nodejs proxy, I am not too familiar with nodejs web sockets, though the general concepts of web sockets should apply. With regards to using a firewall, I suggest researching subnetting and firewalls, as there are plenty of videos / reading materials online that can assist and educate you on these concepts. If you don't have a firewall that supports custom rules, you will have to get one / set one up, in order to achieve that. OpenWrt is a great candidate for firewall software, but there are also others out there like pfSense, OPNSense, etc. As noted, using a firewall, you cannot do MAC Address filtering, as that is performed on a layer 2, Data link layer, while a firewall operates on layer 3, IP layer. The method you want to apply / target is subnetting and firewall rules. You want your clients on a different subnet than your license server. Then, you can create firewall block / deny rules, that prevent certain client IP addresses from reaching out to the license server. This should accomplish the same thing you want via MAC filters, but this approach is generally how you would accomplish your goal.
Thanks for watching Shopwhat! If you don't want to create your own proxy, you can purchase access through a proxy service provider that will give you all the connection info you need. If you want to create one, you can purchase a VPS (Virtual Private Server), from one of many cloud providers, and all you have to do is ensure that the VPS resides in Indonesia, or at the very least, has an Indonesian public IP. Then you can follow along in this video and install a proxy server in the cloud, like using ubuntu, set up SSH access via the cloud's firewall management, setup SSH keys, and you should have a socks5 proxy.
*- Very very informative and intrusting TKS FOR THAT !, the problem come from the set up Ubuntu 20.04 LTS...it's very long to start and to detect my personnal material...i can't understand why on my DELL optiplex 3020 it is so long.... is it possible to do the same work on a Centos7 or Centos8 ? or do we have to buy some space disk in the cloud to do it anyway ? *- Does the setting-up and the using on the cloud is free for few weeks or do we have to pay quickly ? *- if i understand deeply, the other way is maybe to setup a proxmox server between our router's provider and our computer (more secure) tks forward++
Thanks for watching david! That’s odd for the start up time for your Ubuntu 20.04 LTS taking so long. This should be possible using CentOS, though I will offer my two cents in that the project is not being developed anymore so you’ll be stuck with whatever the latest CentOS version is. You can certainly buy some “space disk” in the cloud, but if you can self host, I encourage that way first! Setting up a proxmox server can certainly help you do that, to virtualize and servers, including a squid proxy server. But if you also have some old hardware laying around, you can install CentOS onto that and squid to make it your proxy server. Self hosting does provide more control which nice in my opinion, and you save costs from going into cloud environments. It could be argued as more secure by self hosting, but that’s mostly based on if you configure your instance properly, no matter where it’s located (self hosted or cloud) Anyway, welcome! Glad you enjoyed this video 😊
Sure @xila8861! So a proxies and VPNs are different networking technologies, but very often used for the same purpose, to act as an intermediary, especially with how VPNs are marketed today. VPN is a Virtual Private Network, the whole point of the VPN is to create a virtual private network, or that enables you to connect to it remotely. Its basically a network next to (or on top of depending on the tech) another network. This is done at the IP Layer (layer 3). A proxy is a service that uses transport protocols (layer 4), to enable the forwarding of traffic via an intermediary endpoint. Proxy, inherently, represents an intentional middleman between the source and destination. Because VPNs can do what proxies do, they are often touted as the solution you need to proxy your internet traffic. But, a proxy can do the same thing. How they accomplish this varies. A VPN (at layer 3) allows you to tunnel any traffic over it, using encryption and encapsulation. A proxy (at layer 4+) uses different network protocols to send your traffic to an intermediary, for example, using an HTTP proxy, or even a SOCKs proxy. Overall, VPNs can do what proxy does, but proxies can't do what VPNs can (i.e. creating networks). They just achieve the same result in a different manner, and which to use truly depends on your needs and use cases.
Thanks for watching Ozumcan! So it seems like you are having an issue within oostman for connecting to the proxy. Without more details, I can’t really be sure what’s wrong, other than you cannot connect. In this scenario I’d normally assume the port you are establishing the proxy connect on is being blocked. This could be a issue with your firewall, or proxy configuration. Is this error the result of using a HTTP proxy or a SOCKS5 proxy? Regardless, feel free to share how you configured the proxy in Postman, and then from there, we can backtrack the issue to the proxy server if there is one.
@@DevOdyssey i just installed squid on windows and tested the proxy on that machine and it works. But I can't connect to the machine remotely despite creating an inbound rule for port 3128. I guess it's because ISP is providing a NAT ip which is the most common case I guess? I used to overcome this issue by using ngrok but you can use it for either http or tcp but I see two possibilities here: proxy protocol is different or the connection must be established directly. If it's the latter, we are back to the original problem of connecting from a remote machine again.
@@ozumcan I'd say you are troubleshooting around the right lines. in this scenario, you'd really have to make sure that your public IP address from your ISP is one you control. If you are getting a CGNAT IP 100[.]64[.]0[.]0 to 100[.]127[.]255[.]255, then its not an IP you control, and any inbound rule wont work, because that CGNAT IP is not your real public ip out on the internet. I am familiar with ngrok, but I don't have much familiarity using it. Without knowing your network setup, its difficult to provide any further guidance. But if is a CGNAT IP you don't control, you'd basically need a cloud server with an IP you control in order to back into your network remotely, and use it as a proxy. There are other more technical solutions you can try, such as tailscale, that will help you bypass CGNAT (if thats the case), but thats technically a VPN solution build on top of Wireguard, and not a proxy. though if your sole purpose is to get back to your network and tunnel out from your home network, this may be a solution you want to explore.
Hi Ritu, thanks for watching! I am not sure what you mean make a project on proxy server. If you can elaborate, I may be able to help. All I can recommend is to refer to the links in the description to get started with Squid, or if you want a simple SOCKS proxy, just create a virtual machine with any flavor of Linux, and so long is has OpenSSH server, you can use it for a SOCKS proxy.
Sorry to hear that. If traffic was sent over the proxy and it’s configured to log, you should see entries in your log file. Were you able to do any troubleshooting? Did you observe your http(s) request resolve after you configured your client (Postman, browser, OS), to use the proxy? Did you check the config and make sure squid is running and that the logged daemon was running? Providing these detail can help figure out what may be wrong and resolve it.
Thanks for the vid very informative, But I'm faced with a an error. After creating the password file my squid won't restart. I get the error Job for squid. Service failed because the control process exited with error code Please what can I do
Hi Tyres Thug, Thanks for watching! While I haven't encountered this error before, I did a quick search with that error to see what I would find. It looks like there may be another process running, and you have to stop that PID. askubuntu.com/questions/898321/can-not-start-squids-service While I can't say for sure that this is the solution to your problem, as I don't have more log detail, this may be something you are encountering. I hope it works!
Thanks for watching Nifty Bazar! This video is focused on creating your own proxy service, so hypothetically, if you're inclined, you can create a server in the cloud, with your choice of the hosting provider (Linode, AWS, Google Cloud, etc) and use your own proxy service for unlimited requests. However, there are plenty of proxy services available out of the box, and seem like that is what you're looking for. I haven't used too many online proxy services, but one you can check out is ScraperAPI. While their focus is on web scraping, they do act as a proxy as well. Not sure if they have proxies available in India but feel free to take a look. You can also google other proxy providers and I'm sure you will find some reputable ones. I just don't have any I can completely personally recommend since I haven't really used any.
Thanks for watching @nsckrreddy1888! Another person has commented asking the same thing actually, which you should be able to find my answer below, but I'll provide the summary here. To create multiple proxies in the way that we perceive it, you'd need to stand up a virtual private server with multiple public interfaces. Then, you can router your HTTP traffic against those interfaces depending on specific logic, as discussed in this video. This does become cost prohibitive and a bit more complicated. I'm not sure how much additional public interfaces cost, as that probably depends on your cloud platform, but it needs to be considered. As for more complicated, it depends on how / when you want to use different IP addresses, when you want them to be the same / different, etc. I haven't really set that up before, but its certainly possible, given thats exactly what proxy companies are doing. Which they are for a reason, thats the service they sell because setting that up and managing is a lot. So depending on how deep your proxy needs are, it might be worth it to first consider using a proxy service.
Thanks for watching Abdelmalek! I appreciate the compliment, but I'm sorry to hear that you're having trouble getting it working. If you can share more detail about the issue(s) you are having, I may be able to help you get the proxy working, HTTP or SOCKS. Were you having an issue with Squid or with SOCKS? Infrastructure also plays a big part into this as well, so if I can get more detail around your use case, I can likely help you resolve the issue you're having.
@@DevOdyssey thanks for replying, well i did set ubuntu in a virtual machine, downloaded updates and upgrades ... then i followed the steps on the video, when i tested it in Firefox proxy extension it didn't work.
@@abdelmalekait6207 you’re welcome! Let’s see if we can get a tad more specific. Which proxy are you trying to use, HTTP or SOCKS? If you tried running the Squid proxy service, did you get an error when it started? Can you verify the squid service is running g by using the command “systemctl status squid”? If you tried the SOCKS proxy, can you verify you were able to SSH into it using the -D flag and port number? Lastly your settings in foxyproxy will vary depending on the proxy type. So If you use SOCKS, you should set the up address to your loopback IP (127 . 0 . 0 . 1) and the port to the number you gave in the -D flag earlier. If you are using Squid, just set the IP in foxyproxy to the IP address of the Ubuntu server, and the port number should be the port of the squid service, by default it’s 3128. One more thing, can you tell me why it’s not working? What information are you using to say that it’s not working? All this info should be helpful in figuring out your issue.
Unfortunate that it focused on adding authentication to a proxy instead of actually show useful configurations, such as stripping headers, blocking some destination URLs, etc.
Thanks for watching @ralmslb. I’d certainly consider authentication useful, however there definitely are plenty of other useful features I didn’t cover with squid. Those ideas would be really good for a follow up, however this video was intended to get squid up and running with a barebones configuration. I appreciate the feedback and thoughts for a future video!
@@DevOdysseyRight, however authentication might be used on a traditional enterprise environment, most modern companies nowadays just use transparent proxies, which don't use authentication :)
@@ralmslb that is a good point. While maybe some immature enterprise would use credentials for proxies, many are transparent. Frankly, if you are authenticated to the network, you’re already authenticated to the proxy. My intent for the video was for non enterprise users, basically for anyone who’d want to stand up their own proxy in the cloud, where authentication would be useful to single small deployments, especially if it’s exposed to the public internet. But there definitely is way more to Squid than I covered it this video. I only scratched the surface of all what’s possible with Squid proxy. Nonetheless I appreciate the feedback and for sharing other great features of Squid that would be great to cover!
Alright so i had this idea, and i think its amazing, i like ethical hacking and programming and thinks like this alot and I recently ordered a raspberry pi. And i thought what if i make my raspberry pi my proxy. But i obviously cant just keep that in my own home cause than it would still have my ip, so… I ask my school for a locker which as an outlet, those are used for people with electric bikes to recharge there battery. But if i get my raspberry pi in that locker, connect it to the outlet and wifi (i have a wifi adapter and theres a router in the same room as the lockers) and i than connect to my raspberry pi from home, i have a proxy right? Just imagine, how cool is that! Well i know some about this subject but by far not everything or as much as you, so can someone tell me, isn’t this the best and coolest idea ever??
Thanks for watching Jent! That sounds like a really interesting idea. I enjoy that as well, and have my roots in programming, and have interest in read team and blue team security. With what you have described to me, you would technically have your own proxy server at the school, which is pretty neat. However, you'd have to be sure that you can actually connect a raspberry pi to the school wireless network, as there could be configurations in place to prevent that. In addition, be cautious of the traffic you'd be proxying through that network, as there are also likely controls in place that would block certain kinds of traffic. It might not have the best signal sitting in a locker, but nonetheless since there is a an access point in the area, it shouldn't have too much trouble connecting. Anyway the finish it off, even if you can connect to the WiFi, you'll need a way to actually connect to the Raspberry Pi remotely. Since I'm sure the school wouldn't be opening up their firewall for incoming connections, you'd have to have the Raspberry Pi connect back to your (or a cloud server) in order to actually establish a proxy connection that you can use. You can do this via VPN protocols or SSH, and you'd want this configuration to happen on boot every single time. Now if you can't connect to the WiFi, you can always add a cell modem to the raspberry pi, and connect to it using cellular networks. You'd also have to set up the Pi to connect out to you as well due to the way cellular connections are set up (usually with CGNAT). Keep up the creative thinking 😎
@@jentkuipers You're welcome! I know its a lot to learn, but you pick up pieces and parts of information here and there. Glad to be one of those pieces of info for you 😊
Thanks for watching marcello42! Great observation! By no means do I recommend using an 8 character password for squid proxy. This video definitely wasn't to showcase a "squid in production and externally facing example". I'd certainly recommend a more hardened setup, that probably uses a different authentication mechanism other than basic auth, especially if deploying in a more public facing setup. Generally, I prefer SOCKS proxies as it's available right out of the box and simple to set up, at least for traffic for one user and not a whole environment of users. Bigger deployments would require a more dedicated setup and specialized configuration.
@@marcello4258 I do see your point now. If this were a squid flaw this would certainly not be good. However, I was doing a refresher on this video, and during my research I confirmed that the issue here is actually related to the OpenSSL command, and not actually squid itself. lists.yoctoproject.org/g/yocto/message/47432 IIRC, I did it this way because I didn't want to install additional packages. However you can create a different basic password using htpasswd tool, provided by the apache httpd, or apache2-utils package. stackoverflow.com/questions/3297196/how-to-set-up-a-squid-proxy-with-basic-username-and-password-authentication In retrospect, this was an oversight on my end with creating a 8 character limited password. Now if you want to explore other methods of authentication, I'd refer to the wiki documentation below where they answer a lot of good questions, and discuss using NTLM and digest, which arguable are better. wiki.squid-cache.org/Features/Authentication#Proxy_Authentication
Thanks for watching Boring Channel! Oh I'm not actually typing that fast, I've sped up portions of the video so that it doesn't become a really long video filled with gaps of typing, waiting for response, and not talking about the process. I do have the steps in the video description that should make it easier follow along with the video. I'm sorry to hear the steps didn't work. What issue(s) / error(s) in particular were you seeing when following the steps in the video?
@@boringchannel6313 That is correct 😊. Now yes, definitely ideally want this proxy to have a public IP address that is not your own. These same concepts apply for creating a proxy server in the cloud. Once you log into your Linux cloud instance over SSH, you can follow with the video and it should work. Only thing I would note is making sure the Squid port is open on the cloud instance. That might require changing cloud settings to allow access to that port over the internet, though you'd want to be sure it's well secured so no one tries to brute force it. And for that reason, I'd recommend doing a SOCKS proxy over SSH with public key authentication, as that its a more secured tunnel thats encrypted over SSH. Or, you could connect that "local" proxy server to a VPN, and that would accomplish the same thing 😊. As with anything, there's a lot ways to accomplish the same goal.
Thanks for watching Kowshick! I do speed up the video when I'm typing / drawing as to not make the video unnecessarily long. If need be, you can actually slow down the playback of the video in youtube to catch what you may have missed. I also do have an outline of the video in the description that you can use to follow along.
What do you use proxies for? Curious to learn all what Squid (HTTP) Proxy or SOCKS can do?
Hi, I want to create my own proxy in order to play in "silkroad online". Game's server do not allow us to open more than 2 account at the same time. They ban very common ports such as 1080. But players know that a lot of people are using proxies bought from oxylabs which sells only to corporates. Would you describe how can I create proxy v5 with your methods?
Hi @Uǧur KAKİ,
Thanks for watching! So to play your game using a SOCKS5 proxy, and not use a proxy provider should be easy enough. All you’ll have to do is create a cloud hosting account with a provider (like Digital Ocean, Linode, AWS, etc) and stand up your own Linux server and configure any networking so you can access it using SSH. They will also provide you with a public IP to use.
This will likely have OpenSSH installed on it to begin with. Because of that, all you’ll have to do is connect to this server using the command I write at 11:40 and once you authenticate, then you’re ready to use the SOCKS5 proxy, such as the way I do so using FoxyProxy, you’ll just need to configure your client computer to connect to the proxy. Then from there your traffic to the game should be router from the proxy server and since the traffic is coming from your cloud server (and not a proxy service like oxylabs) you shouldn’t be blocked or have any problem connecting to your game.
Hope this helps!
@@DevOdyssey It will take me some time to figure out what are those terms and programs. But I will try this. Thank you so much man. Hope you will reach your goals on youtube. Have a good day.
@Uǧur KAKİ you should be able to search for it online and find the information you need. Setting up a cloud server does require some configuration, which I don't have too much experience with for those cloud providers I mentioned, but I know its easily found. Once you get the cloud server up and running, then following this video (or the SOCKS5 proxy part) should be all else that you'd need to do.
You're welcome! Glad this video helped you, and I appreciate the kind words. Good luck on your proxy!
Hello Odyssey, thanks for the great video.
I've just followed all the steps in order to configure the squid and digital ocean integration not from that video but yeah lol. The problem is when I test the proxy it's seems working perfectly fine on FOGLDN proxy (around 200ms). But when I try to log into the same game as Uğur told you(Silkroad Online), I can not get any response from Socks4 server (that's what our bot for the game tells at least and the frustrating part is I don't have access to that code which generates that exception print line). I've tried to change the port from ssh to different values 1280,4444,1490 etc but nothing worked yet... Do you have any tips for this issue, by any chance?
Looking forward for your advices.
This guy is super intelligent to explain everything in simple and easy word. Learning networking and other communication stuffs is like blindly walking into a dark room to me. I would love to get all the networking terminologies explained by him.
Thanks for watching and the very thoughtful and kind comment @abdurrahmanrafi7946! It means a lot to hear these nice words.
I know how hard it is to learn this on your own. I never received a formal education on networking and related concepts, I’ve learned this all from my work, from the internet, videos, colleagues, and most importantly, from doing it on my own, and from teaching it. So coming from this perspective, I’ve been able to create my own understandings of these concepts that make it easy for me, and I’m happy to share that so others can learn based on how I think about them. So hearing about the impact my videos have on my viewers makes me happy 😊 . I hope I can continue to by your source of network concepts and information.
can you make this process using a 4g Modem to get 4g Ip ?
Thanks for watching DJ Chris!
That’s a great idea, and yes that process should we try with a a 4G modem to get a 4G IP.
But it wouldn’t work without additional configuration, that’s because likely it would be using a CGNAT ip, and not a real public IP. Because of that you can’t just open ports up. You’d have to first use something like a cloud server with a public IP address, which then you can create a tunnel between the 4G modem / router and the cloud server. The. When you want to use the 4G modem / router as a proxy, you’d connect to the cloud server first and then router that traffic though the cloud server to the 4G router, thereby using it as a proxy. Only way around this is if you’re using IPv6 which might be publicly accessible where you can port forward traffic through it directly. I haven’t tested this out but in theory using IPv6 should be publicly accessible and thereby using it as a direct proxy. You’d probably have to do some IPv4 to IPv6 translation, but nonetheless it should be possible.
I’d say I it’s probably easier with a cloud server and IPv4 so if I were you I’d try that first, unless you’re an IPv6 pro, I’d do the IPv4 method first.
Your channel is underrated sir. Very informative information and easily digestable. Keep up the great work!
Thank you very much for the thoughtful words. It really means a lot to hear that. I'm glad to hear you find my videos informative and easy to understand 😊
Plenty more videos to come!
This is by far the best video I have ever watched on proxies. Thanks for making this video.
Thanks for the compliment @rahulsingh7508! It really means a lot to hear that. I truly a pleasure making these explainer videos, and I enjoy it more when I hear feedback such as this, so thanks for sharing that with me.
Do not create a proxy without a proper authentication, thinking that "no body knows the IP to my server, How are they going to find out I'm running a proxy on my server and try to use it anyway". Based on my experience botnets are always running and scanning every port on every IP on internet including your server's IP, looking for vulnerabilities and they will eventually find your free and open proxy(which requires no authentication) and will use it for such things as applying DDOS attacks to their victims and whatnot. So be aware of that, and in order to prevent it, set up password for your proxy as the video suggests 07:51👍
P.S you can also use fail2ban to prevent brute force attacks which will be directed to find out the password you've set for your proxy.
BTW Dev Odyssey, Thanks for your great video man👍
Thanks for watching Sadegh!
Definitely agree with your first point. If you are not creating a proxy behind a NAT / Firewall, like I did as an example, and are creating one open to the public internet, as most are, then you certainly want authentications for it. Bots scan the whole internet all the time, your server is fingerprinted within hours of opening it up to the public. So I definitely do not recommend creating a free and open one, let alone using a free and open proxy server.
My example at 7:51 is a mere concept of setting up a password, and I'd recommend stronger forms of authentication with Squid wherever possible, such as OAuth-2.0.
wiki.squid-cache.org/Features/Authentication
Using public-private keys is also recommended for using the server as a SOCKS5 proxy, in addition to rotating keys frequently. And lastly, fail2ban is also a great recommendation for protecting against SSH attacks, so thanks for sharing that with everyone.
Nonetheless, I certainly appreciate the compliment and your thoughts 😊
I do proxies in a cool niche way. I make a local proxy so that I can VPN using a certain application, but using the native internet for my browser. Basically I use a space computer to use as the proxy which also eliminates the need for port forwarding :) .
Thanks for watching @lextacy2008!
I'm not sure I completely understand. When you say you make a local proxy, are you saying you stand up a server / machine on the local network thats running a proxy server like Squid or a VPN server like OpenVPN / Wireguard? And then when you want certain applications to point to it, are those applications on other machines, and if so, are you just pointing to that VPN server as your gateway? It's definitely very cool to use an application over the VPN, while still being able to use your browser over your local internet and not over the VPN.
What do you mean by "space computer"? You definitely shouldn't have the need to do any port forwarding unless you want to access your local (home) network over the internet (or if you have a VPS network in a cloud provider, and want to access that network remotely at any time.)
If I am understanding correctly, I think I did something similar at one point, until somehow my VM just vanished. I had a VM that was connected to a VPN server, and when I wanted to tunnel my connection over the VPN, I would just SSH to that server using the -D switch, to stand up a local SOCKS tunnel that I'd use to access that VPN connection, instead of directly VPNing from my laptop / client machine.
Hey thank you for reciprocating and asking for clarification. That was spare computer not space ,lol. And yes this spare PC is the is a local proxy. My Chrome traffic gets sent to there using my main internet. My VPN tunnel on my main PC runs globally. But the cool thing is anything that triggers a need for internet will prompt the Proxy username and password. So I basically can Ala Cart what applications login to the Spare machines proxy. Hope this helps! @@DevOdyssey
7:26 ты картинки в CLI формате тоже смотришь в 8 бит цветах? Сколько много воды бессмысленной...
Спасибо за просмотр summer2019! Я не говорю по-русски, поэтому я не уверен, что понял, однако это «красивый шрифт» по умолчанию, который использует Postman.
Thank you so much for your how to does Qustodio works? we use client of qustodio on the kinds laptop but do not change proxy manually. How does the client side controls laptop? I am interested for developing a parental control application and proxy server for a school.
You're welcome and thanks for watching @mdsalahuddin2841!
I am not personally familiar with Qustodio, but I did just do a quick search to learn more. I do see it performs web filtering. So in order for it to do that, its probably monitoring DNS traffic and using DNS categorization services to check what category a website falls under, and sinkholes the DNS request, or allows it, depending on what category it comes back with. I made a video on PiHole that basically describes the same process.
th-cam.com/video/XTk8eZ4NmFc/w-d-xo.html
In this regard, its not really acting as a proxy, but rather a DNS server. This wouldn't be happening client side, but instead, server side, since its just force configuring the DNS server to be one of theirs after the app is installed. I can't say for certain this is whats going on, since I haven't used it myself, but this is commonly how web filtering is done and very likely that this is what they are doing.
Hi, Very nice video. I understand whole video except you showed you have no internet connection on mac (am i right?) then you connected to ubuntu server from same mac computer (am i right?). I did not understand this part. Why your mac has no connection to internet but not from terminal? Sorry i am really confused
Thanks for watching @test-account5635 and the compliment! The purpose of showing I had no internet connection (on my mac) was to demonstrate that I needed to connect to a proxy first in order to reach the internet. The proxy server (ubuntu) was hosted on my local network, where I had SSH / terminal access to it. Then once I configured the proxy connection on my mac to my ubuntu server, I was able to access the internet (HTTP(s) traffic), effectively demonstrating how a proxy works, at least a very common use case.
can this run on windows ? and again how can i connect to that proxy from mars ?😅
Thanks for watching @plbader3714!
So I found there is a port of squid for Windows, but I haven't tried it out.
github.com/diladele/squid-windows
Not sure if the configuration mappings are 1:1 with Linux, but I'd imagine it would be pretty similar.
Haha, so connecting from Mars. First, if they get the infrastructure to connect Earth to Mars at a reasonable speed, then you can come back to me on that. And when that happens, you can then watch your favorite Earth based TV shows instead of the Martian ones 😂
@@DevOdyssey 🙂❤️so some how i made it with ngrok tcp 😂and its working in earth so far so good
ngrok tcp [squid port]
Thanks for the vid and all the info.
i am new into this and want to start hosting my own proxys for myself.
i am stucked at the begin of this video. it looks like youre using 2 different screens. 1. where you using a terminal and 2nd one your local pc or smth.
how do i get the terminal at 04:22?
Hi @lesley middelham thanks for watching and you're welcome! 😊
Sounds like a fun project. Hosting your own proxy shouldn't be too difficult once you can acquire the right hosting, unless you are self hosting and not using a cloud.
Yes you are correct, I do use the terminal and another screen depending on the application I am using, like Postman or the terminal.
So depending on your Operating System of your computer, you have a couple ways to get a terminal. On macOS its pretty simple, the terminal is there by default and you can search for that application and open the terminal.
If you're on a Windows PC, and on Windows 10 or newer, you can download Windows Terminal, which I believe should work for accessing Linux based servers if you have the OpenSSH client installed. You can also download PuTTY which has been around for quite some time as an SSH client to access and SSH enabled servers.
what type of computing power would be required to setup multiple proxies , as i plan to make some for my sneaker bot ? plus would it be possible to create multiple proxies
Thanks for watching Omar.
I actually have a friend who has a sneaker bot, so I have some small knowledge around sneaker bots. First, yes you can make multiple proxies, but if we really want to get at the core of it, what you mean by multiple proxies is simply multiple "Public IPs", at least in this context. So with that, you'd want multiple network interfaces on your virtual machine. Then with squid installed on the virtual machine (this case it would be in the cloud, so a Virtual Private Server, or VPS), you'd create policies that let you forward traffic to different public interfaces, or somehow rotate between them. This is where I'm not sure how sneaker bots work 100%, and how they'd need to rotate between these different public IPs. There may be a policy that lets you rotate between public IPs on the squid server depending on how many requests are made. That seems like what you'd want. Otherwise, you might have to install more than one instance of squid proxy, and then have them run on different ports, assign them separate public interfaces, and then you can switch your proxy settings between the two, to quickly change your public IPs.
In terms of computing power, it really depends on how many connections you are trying to make from the proxy. It shouldn't be too much, so maybe like 8 GB of RAM and a 4 core processor, especially if its just a dedicated proxy with no graphics (headless). I'm honestly spitballing here as I really don't know, it mostly depends on concurrent connections the sneaker bot will have to endpoints, but also connections to the sneaker bot. You can always increase the resources as well if you see throttling occurring, since its a virtual machine, but it does mean you will have to pay more. So I advise to start there, and monitor to see if you can increase resources, or decrease them to save on costs.
With limited knowledge of sneaker bots, thats my 2 cents.
@@DevOdyssey thanks for the reply
@@omarwardak-yg9ls You’re welcome!
Try IPCola, residential IP proxy, sticky and rotation sessions，100% new, 99% pure
but this is all happening in the same local network, what about using public ips
Thanks for watching @zaktv3595!
The IPs you use to access the proxy server really don’t matter in this instance. When using public IPs to access the proxy server, your traffic will be proxied out the same IP you use to log in, if this were a cloud server with a public IP assigned to it.
As I’m using a local IP, my traffic ends hp being NATted to reach the internet, which is expected.
You won’t have to NAT when using a cloud server with public IPs, which is setup I’d expect most people to implement.
Can you use Custom DNS server on squid?
Thanks for watching Pavlegaming 42!
Yes you can use a custom DNS server that would override system default settings. You can configure it using the `dns_nameservers` option in the squid.conf file.
You can refer to an example in the squid-cache documentation.
www.squid-cache.org/Doc/config/dns_nameservers/
@@pavlegaming4263 You're welcome! Glad to help 😊
Before you changed localnet to authenticated [...] could you have still used that as a proxy server, but that it just would allow anyone to connect to it? And replacing that iwth the authenticated [...] makes it restricted to only the ip address you want?
Thanks for watching @kimaegaii!
For your first question, yes, I could have still used that with localnet in place as the ACL instead of authenticated (and authenticated_ips) and it would allow anyone to connect to it without authentication being necessary. It would effectively be an open proxy server on the local network.
Adding my authenticated ACL makes it restricted to anyone who's credentials match whats created in the file. Adding authenticated_ips ACL ensures that only my IP, or any other IP in my ACL has access to use the proxy server. This ACL can be changed to use whatever IP you want, to enforce that the originating connection has that IP address of your choosing.
Great video! thanks. Just a question, you didn't have access to internet on you local computer? how did you ssh into the server? doesn't ssh need internet connection? sorry if my question is naive
You're welcome Behnam! Happy you watched it.
No worries, we're all here to learn.
Yes, so on my local computer, I did restrict internet access on my firewall, intentionally, to showcase the use of this proxy. In addition, this proxy server I set up was locally, on my home network, and not in the cloud. So for that reason, I didn't need an internet connection. If my proxy server was in the cloud, I'd need an internet connection to access it over SSH.
My proxy server had access to the internet, and so once I routed my connection through the proxy, you could see that I was able to access the internet. Generally speaking, proxy servers you'll use are "on the internet" so you'll need an internet connection to get to them, and of course, route your traffic through them.
@@DevOdyssey - So you had another computer (physical server) which was connected internet and you connected your "mainframe" computer with that physical server (either through LAN or whatever) to access the internet. And then used the SSH method to login to the physical server. Is that correct?
@@rahulsingh7508 Yes, I had another computer that was connected to the internet, while my laptop was not. This computer was my proxy, and also a virtual server in this example, but that doesn't matter.
I connected my laptop (I wouldn't call it a mainframe) to the proxy server to access the internet. SSH is my means (let alone the IT world) for logging into that proxy server, and also a way to set up a SOCKS5 proxy as well.
Could you make multiple proxies?
Thanks for watching Omizyss!
If by multiple proxies, you mean multiple public IP addresses with multiple network interfaces, then yes you can. That would be dependent on your machine configuration and the public IP addresses you receive from your cloud provider that you'd purchase for use. You can write policies in Squid proxy that lets you chose which public interface you want to route HTTP traffic to, depending on the criteria you want to use. If you mean multiple instances of Squid proxy service, I believe that should be possible but I personally have not tried it. In that case, you can then use different connection criteria (such as the service running on a different port, same, or different public IP address) and then route your traffic that way, dedicating one public IP / interface per running instance of Squid proxy.
You have tested it on VPS.
Can I apply this to my PC??
Thanks for watching, and yes you can set it up on your PC (assuming you mean Windows).
I actually talked about it in the comment below, but you can follow the github link I shared.
github.com/diladele/squid-windows
I haven't tested it out, so I can't share any personal experience, but I assume it works the same.
Keep in mind, squid is intended to be a proxy server, so installing it on your PC (client) doesn't really do anything for you, unless you are using that PC as a server, or if you're connecting that PC to an upstream proxy, something you don't actually need squid to do, unless you want to get granular about how you proxy your HTTP traffic.
Can input and have a whole subnet /24 on squid so I can use all 254 proxies at the same time?
Thanks for watching Ryan!
I’m not sure exactly what you mean, but I think I know. If you want to use your local network, that is a /24, to connect through the proxy. So if you have a laptop, and a phone on the same /24 network, you can use the squid proxy for both the laptop and the phone.
If you want the squid proxy server to use all ips in the /24 network, you can do that by basically spoofing an IP address per unique port. I found this article below that briefly explains it, but I do not have any personal experience.
tastyplacement.com/squid-proxy-multiple-outgoing-ip-addresses
You can also google “multiple outgoing IPs with squid”, and you’ll see more results.
Be mindful this will not work with public IPs as you have to be assigned the public IP by your ISP. Unless your ISP has given you a pool IPs to use, then you’ll be restricted to using the one IP you’ve been assigned.
What's the difference between a proxy and a proxy server and a proxy service? People seem to use these terms imprecisely. It makes me confused and upset.
Thanks for watching zaphbeeblebrox!
That is a great question, I can relate to your frustration. The word "proxy" is thrown around all the time, and apply it to anything "proxy related" but they don't all mean the same thing, so then it certainly becomes confusing. If we start with the word proxy, it effectively means an intermediary that is used between two points. In essence, it introduces a third point, or node, between two points, or nodes. This intermediary is then used to communicate to the second point, on your behalf.
So in terms of software, a proxy and proxy server are basically one in the same. The proxy server, is that intermediary, that is making requests on your behalf, to your desired endpoint. The proxy server is _doing_ the proxying for you. The same goes with a proxy service. They are being used, as an intermediary, in the same way as a proxy server.
Now the confusing point is when people say "proxies", what do they mean? Well I don't think everyone knows what they mean, but what they want, is to be represented by more than one point. In terms of IT, this means multiple public IP addresses. So proxies ~= multiple public IP addresses. But this is not a true definition. The true definition would be multiple proxy servers or instances.
Now, you can configure a single proxy server, to have multiple public IP addresses, and therefore look like multiple different public endpoints, so it seems like its more than one internet endpoint. This would mean you would need multiple network interfaces on your server, with each their own public IP address (at least in terms of IPv4). Then, your proxy server software (Squid or SOCKS), can choose between the public interfaces, and that can be controlled by you. Now its still one proxy server, but now, it seems like its more than endpoint.
When you choose a proxy service, they basically do all that for you. They have lots of public IP addresses (think proxies), that you can use to make requests on your behalf, coming from more than one internet endpoint. This is often used in rotating proxies, where services will block a public IP address if it is making too many requests, so then the proxy service changes the public IP address to get access to the endpoint again.
So if I may say, the easiest solution honestly, is to go through a proxy service that has already bought all this IT infrastructure to suit your needs. If you don't need a rotating public IP address, then you can create your own proxy server in the cloud with your own public IP given by a cloud provider. That's somewhat what I tried to highlight in this video. But otherwise, anything more complicated than that, just go with a proxy service / provider.
@@DevOdyssey Thank you so much!! Much clearer!! No I can communicate a bit more productively with the devops people at my work :-) Usually I get one-liners full of overloaded jargon. It makes me upset.
@@qrubmeeaz You’re welcome! Glad I could clear that up for you. Oh I can relate to the jargon working in IT haha. It’s like speaking another language haha. Let’s hope they understand the same as you now on the most fundamental level so there aren’t more miscommunications in the future. Best of luck!
Try IPCola, residential IP proxy, sticky and rotation sessions，100% new, 99% pure
Are you using macbook?
Thanks for watching Floder!
Yes I am, Having a native *nix terminal has always been helpful with the projects I work on.
amazing video thanks. Would u have aditional documentation on how to associate a clean ip range to those proxies ?
Thanks for watching @hichbelahmer9025! I really appreciate the compliment. I don’t have any additional documentation here sadly. Your best bet is to do your research in advance and check the IPs and ranges to see if they’re clean.
A proxy service should be ensuring a clean IP range, it’s part of what you pay for, but I can’t guarantee that for all proxy services and let alone, it’s difficult given the nature of why people use proxies. So at best you can ask them.
Same goes with cloud providers, if you deployed a proxy server in the cloud, you should get a clean public IP from them, and they should do the work to ensure the reputation of any IP they give you is clean. It takes a lot of effort to do, especially not clean IPs to begin with, but again it’s what you pay for, and important for any services you’d run behind that public IP.
All in all it comes down to making sure you get a good IP and range from your service provider.
Hi Dev, thank you for your informative video,
That means when using a rotating IP services , Is it possible to do the same process to create proxy ?
Thanks for watching @aimanesennouni2644! And you’re welcome! If I’m understanding correctly, technically this process wouldn’t be the only thing you need to create a rotating proxy. If you wanted to create a fully rotating proxy on your own, there would be a lot more involvement with getting a pool of IP addresses, and setting up a system to random choose from them per outbound connection, which can get complicated.
If you want a rotating proxy, id suggest using an existing proxy provider that already rotates IP Addresses for you per connection(s), depending on how it’s configured. This video mimics how you’d stand up a proxy service in the cloud, assuming you have one IP address, but doesn’t go further in depth regarding the assignment of public IPs to an instance as that was out of scope. I mostly wanted to show the proxy software and it’s configuration.
Hi it looks like I got this configured to work but I'm not seeing anything in the access.log. Is there anything I'm missing to why this is not printing there?
Thanks for watching @AlexanderDavila-q9r!
Thats interesting, I haven't seen that before. Doing a quick search, it seems like entries can be logged in the /var/log/messages. Have you checked any other OS log location to see if squid is logging there? I'm not sure what distro you are using but thats something to consider here where it can mess with logging.
Also, can you confirm that the proxy is working as expected? Are your requests being proxied after you've configured it? I used the base install of squid from Ubuntu, and didn't modify anything for logging, so depending on how you installed it, I wouldn't expect you to have missed something from a default install.
Otherwise, I'd encourage doing some research to see how you can resolve this.
can a HTTP proxy provider read my files when i upload them to a website use HTTPs like Onedrive ? help me please !!!!
Thanks for watching @amVinhBiet-yh4lt!
So this depends on the way the proxy server is configured. If its configured to do decryption, then yes, it could read your files that you upload to One Drive. However, if its not configured for decryption, then it will not be able to read your files.
When configured for decryption, it will actually terminate the TLS connection, and restart it on your behalf to the destination that you are going to. This breaks newer versions of TLS, but with TLS 1.2 this is still possible. If you're curious, you can check the Lock icon in your browser when you visit and website while on the proxy, and if you click it, and see the certificate's subject alternate name (SAN) matches the website name, then you're good. If you see a lock icon in the browser next to the address bar, thats another indication you are good. Otherwise, your browser should tell you if decryption is happening, as it will sense the encryption is broken in between the source and destination.
Changes are they are not doing decryption, as thats very intensive work, but what I mentioned above should provide you with the guidance you're looking for.
thank you so much for your help !
@@amVinhBiet-yh4lt You're welcome! 😊
Hey guys I have a doubt. I have 30 devices connected with my local network and I want to configure my proxy settings to all the machine's via DHCP server. Ubuntu acting as a squid proxy and windows acting as DHCP . Is it possible or is there any way to push my proxy configuration to all my machines?
Thanks for watching AbyaZ!
To my understanding, it's not "exactly" supported in DHCP to hand out a proxy server IP and port. However, there seems to be ways you can do this, such as by hosting a PAC file and having the DHCP server hand out the url to the PAC file, as part of the proxy config. I am not familiar with this process, but it's worth a shot. Try the links below and see if they help.
serverfault.com/questions/707586/is-it-possible-to-configure-proxy-setting-through-dhcp
community.spiceworks.com/how_to/2424-deploy-proxy-settings-via-dhcp
Thanks Dev !! Lemme go through that.
You’re welcome AbyaZ! 😊
help with putty
can u guide me to create proxies which can be used through proxifier
Thanks for watching Kiran. I have not used proxifier before, but their documentation seems very well defined. You can take a look at it here.
www.proxifier.com/docs/win-v4/quick.html
When configuring proxifier, just use the settings / info for the server that you create following this video. With regards to putty, I'm not sure what you're asking for, but if you want to make a SOCKS tunnel with Putty, you can follow this article.
www.pwndefend.com/2022/06/25/how-to-use-putty-as-a-socks-proxy/
Please do you have a video about how to create VPS and connect your home computer to it to browse the internet. Step by step. If you can provide me with a step by step and well explain course for me.
Thanks for watching @PHILACOMEDY-gs4xb!
My next evolution of this video is to repeat this same process using a VPS,, which really is what I meant to demonstrate in this video, at least the concept of it. I intend to make that video in the future, but don't have a timeline of when that will be.
In general, if you can stand up a VPS, and know how to configure and firewall rules provided by your cloud provider (if the do provide an interface for it), then you can repeat this same process in the video, and it'll work.
I have an internet connection that has a proxy and its IP is 192.168.49.1:8000, in order to connect to the internet I must configure this data, how do I configure the same on the raspberry pi4, I have not been able to use the internet via wifi, the raspberry pi4 connects to the wifi and assigns an IP automatically but does not browse because I have not configured this data as would be done when it is in client mode.
To configure a proxy client on the Raspberry Pi 4b, that will greatly vary depends on your operating system. From other comments I've seen you make on different videos it seems like you are using OpenWrt. If so, you can follow this video below that reviews it.
th-cam.com/video/tjiMyuLrejA/w-d-xo.html
You can use privoxy to forward requests to an upstream http proxy, as you've given in your comment.
For Raspberry Pi OS, you should be able to do it in your OS configuration, and a simple search should give you plenty of information to do that. I'd be sure to specify if you are using Raspberry Pi OS with a GUI or just a terminal. Either way, heres an example of how to set one up using the terminal.
forums.raspberrypi.com/viewtopic.php?t=28835
How to config squid proxy for https caching?
Thanks for watching Gofur!
So doing SSL and caching are both bigger endeavor's than this video shows, so I am not experienced there. However, this is the generally what you need to do.
First, you need to enable HTTPS proxying. This is basically setting up your squid proxy to do decryption / Man in the Middle (MITM). They also refer to this feature as SSL Bump or "peak and slice" in the newer versions of squid. This link below is a general example of how to do that.
medium.com/@steensply/installing-and-configuring-squid-proxy-for-ssl-bumping-or-peek-n-splice-34afd3f69522
wiki.squid-cache.org/Features/SslPeekAndSplice
The medium article seems to talk about caching, and that may be all you need to do for basic caching.
In squid, caching has lots of directives / options, so there is plenty to be configured. I personally haven't tested out either of the above, but they should both be a good starting point. For more information you can refer to the wiki here on directives and caching.
www.squid-cache.org/Doc/config/
Huh? I'm feeling dumb and scared that I will mess up my computer. I can follow instructions but I would have no idea what I am doing. Are you available for house calls? Kidding or ???? Suggestions?
Thanks for watching Kim!
Configuring a proxy won't mess up your computer, where it's not reversible, not to worry. If you have any questions you'd like to discuss, I'd be happy to answer your questions over comments or emails.
@@DevOdyssey I would love that please 🙏
@@Kwakuyb Sure PUBG! Ask away 😊
I am curious in your first ssh of the video where does that password come from?
Thanks for watching @stefanlaterra5797!
I'm not sure where you are talking about in the video. The first SSH (when I'm SSHing into the squid server), I'm simply logging in with my password.
The other time I refer to a password is creating a Squid proxy password at 9:52, such that when in order to connect to the Squid proxy, you need to use this password. This command is actually out of date here, and you can refer to the comments section and video description for that updated command.
@@DevOdyssey Thank you very much, yeah it was the initial SSH one, there was an issue on my Ubuntu where it was not connected to the internet at all causing problems, user error, thanks for responding anyway, greatly appreciated.
@stefanlaterra5797 ah gotcha, thanks for following up, and you’re welcome! Happy you were able to resolve your issue and login. Best of luck!
SOCKS is the protocol, OpenSSH just provides a SOCKS server implementation. Just like squid is an HTTP proxy
Thanks for watching @tutacat.
Couldn't have said it better myself!
Try IPCola, residential IP proxy, sticky and rotation sessions，100% new, 99% pure
Hi, Great Video, btw can u make how to setup squid proxy on windows 11? and it is possible to setup squid proxy directly to an internet router, so every client when accessing the internet using router connection will automatically using squid too. Sorry for my bad english, hopefully u will understand what i'm talking about.
Thanks😇
Thanks for watching @-_MHDWILDANATTAMIM!
So first off, looks like you can get squid proxy on Windows, though its only available via third parties, according to their website.
As for setting up squid proxy directly on an internet router, yes, you can do that, though you'd need a router firmware / OS like OpenWrt to do that (or technically a linux distro in general, but that requires more configuration to make it a router).
openwrt.org/packages/pkgdata/squid
I was able to understand everything, no worries! But just to be clear, you don't need to have squid proxy on a Windows client. You would simply need to configure your Windows client to access the proxy by changing proxy settings, but don't need to run the proxy server itself. That is, unless you want to run a Windows server as a squid proxy, but given you said Windows 11, that doesn't seem like the case.
I don't clearly understand should I install Squid in case SOCKS proxy? Or I just configure sshd on the remote server and create a ssh connection with -D option to it, after that configure my local listen port to the web browser
Thanks for watching VladF!
This video was meant to showcase 2 different options for proxies you can create and configure yourself, SOCKS5 and HTTP. Depending on your needs, a SOCKS5 proxy might work better than an HTTP proxy, or vice versa, depending on certain network limitations you may have.
If you want to quickest and easiest setup, I'd recommend using a SOCKS5 proxy via SSH, since SSH is on Ubuntu (and frankly most Linux distros), by default. So yes, you'd just configure sshd on the remote server, and connect to it via your client, using SSH with the -D switch, for a dynamic forwarding proxy, and then set your local proxy settings (OS based settings or plugin settings, like Foxy Proxy) to the loop back interface / IP (127[.]0[.]0[.]1), and the dynamic port you chose.
For using a proxy service directly from a client machine, this is the option I'd recommend. For setting up a proxy service in your local network for multiple client devices, HTTP (Squid) might be better, as not all client devices have a SOCKS5 client available.
Well created and well presented squid proxy video.
Thanks for watching Ashish! I appreciate the compliment 😊
If you are using Openssl 3 in any distribution of linux -crypt command whas removed instead to generate the encrypted password you could use :
sudo sh -c 'printf "usuario:$(openssl passwd -6 -salt $(openssl rand -hex 16))
" >> /etc/squid/htpasswd'
replace 'usuario' with the username
Thanks for watching @andressebastianpaez6806 and thanks for sharing!
I appreciate you helping out and providing updates and advice for and users who would run into this situation. Should definitely be helpful. While I don't recommend and production use of Squid using an authentication scheme like this, especially if its public, its good for anyone doing testing or whom have a Squid instance that is within their internal network to use as a system wide proxy. It's too bad the password here can only be 8 characters in length, due to the limitations within openssl, if I'm remembering correctly.
So with the passwd -6 portion of the command, does it actually generate a 6 character length password? If so, we could probably modify that command to -8 to make it a 8 character password, to create as long and secure of a password that this command is willing to accept and not get truncated.
@@DevOdyssey Thank you very much for the answer, what I have investigated about this command is the following:
The command "openssl passwd -6 -salt" in OpenSSL 3 is used to generate a password hash using the SHA-512crypt algorithm with a specific salt.
Here's the meaning of each part of the command:
"openssl passwd": It is the command that invokes the OpenSSL tool to generate a password hash.
"-6": This option specifies the use of the SHA-512crypt algorithm for generating the password hash. The number 6 is associated with the SHA-512crypt algorithm in OpenSSL.
"-salt": This option specifies a custom salt that will be used in the hash generation process. The salt is a random string that is concatenated with the password before applying the hash function, enhancing security by making brute-force and rainbow table attacks more difficult.
Thanks for really digging into the command options and providing a an explanation of each portion of the one-liner.
Everything else about the command seemed fairly obvious to me, including the -salt switch, the passwd command, and the salt generation using the rand command and -hex switch. I was unsure on what the -6 meant, whether it be final password length or something else.
I appreciate you taking the time to research and share the results with everyone here so they can know it actually means to use the SHA512 hashing algorithm, as opposed to the my initial though on password length. I’m not extremely well versed in the openssl command, so I learned something here. This makes sense to me as I have used other commands that use a number to specify the hashing algorithm, such as hashcat.
Thanks again for the contribution!
Thank you! However, wouldn't salting the password require additional changes in the squid.conf file? I don't think the "basic_ncsa_auth" is able to verify the password. It worked for me when I removed the "salt" flag 👍
Thanks for watching@@mihir8675!
You make a very good point. This is something I also overlooked when responding to these comments. I don't think basic_ncsa_auth can handle salts.
Generally, salts are great to use to avoid a password crack via rainbow tables, but at the same time, squid does not know the salt, it can't generate the appropriate hash to match during the authentication process. That being said, salted passwords wouldn't work unless there is a place you can add the salt in the configuration file. Doing some research, I can't seem to find that.
Unless OpenSSL is handling the salt on the backend. I saw this community post here for someone else, but I can't verify their claims as I haven't tested it.
www.twit.community/t/setting-up-squid-proxy/13187
I'm happy to hear that you got it working when you removed the salt flag above. I appreciate you sharing this so that others can refer to it and get their setups working.
Nonetheless, using this authentication type was purely demonstrative, and for anyone setting this up public facing should use something stronger, such as OAuth2.0. Much more complicated, but enables much stronger security than basic passwords.
I've been meaning to do a follow up to this video where I set it up in a cloud service provider, with improved authentication. I look forward to making that video.
can this work for gaming like playing league of legends?
Thanks for watching Krod!
To be honest, I'm not really sure. Thats because I don't know what communication protocols League of Legends uses, such as if its only HTTP(s), or more. Chances are, its more so using Squid proxy will not work in that scenario.
However, you could use a SOCKS5 proxy, and that should tunnel all your traffic through an encrypted SSH session, at which it could work for League of Legends.
But, I'm not sure at how fast the proxy will be, and knowing how important latency is in gameplay, I would keep that in mind if you do try a SOCKS proxy. I guess this also depends on how you play league of legends, as if its through a browser, you could then put the proxy settings in your browser, and that you should be tunneling through the SOCKS proxy.
If the gameplay is through an app like on your desktop, then you'd need to configure the proxy settings on your Operating System in your network settings.
How to cache youtube and other video websites
Thanks for watching joel!
Honestly I don't have any experience caching websites via squid, but someone else did ask the same question in the comments below and I shared some research I found. These links below should be helpful to get something set up.
medium.com/@steensply/installing-and-configuring-squid-proxy-for-ssl-bumping-or-peek-n-splice-34afd3f69522
wiki.squid-cache.org/Features/SslPeekAndSplice
www.squid-cache.org/Doc/config/
Hope this helps!
Many thanks @@DevOdyssey
@@joellopez4414 You're welcome!
Very good video. How did squid handle SSL certificates? I didn't see any config but postman api call to https site worked. Do you disable disable SSL verification?
Thank you Aykut!
Thats a good question. I did not have squid handle the TLS certificates, and it was disabled, or I should say I didn't explicitly enable it. Though, if you want to be able to analyze the traffic, you'd want to get an https certificate and put it on squid, and have Postman trust squid's certificate. I haven't tried this out, but it shouldn't be too difficult, just requires some work.
The instructions below should be helpful.
elatov.github.io/2019/01/using-squid-to-proxy-ssl-sites/
Great vid 👍 is this something I can do on an ipad which has a website blocking system so that I can access those websites? I think I need a special link to use because proxies and vpns are all blocked
Thanks for watching! Just to elaborate, when you say VPNs are blocked, do you mean VPN apps? If so, then you probably are using something called MDM (Mobile Device Management), and have essentially configured it to secure it as per their policies. Given that, you likely don't have access over all the settings on the iPad, including app downloads and administrative settings.
In that case, creating your own proxy is not something that will help unblock websites, as chances are you wont be able to configure the proxy settings on the iPad. You can give it a try in the WiFi settings, where you can specify an HTTP proxy to connect to, but I'm not sure if that will be exposed on a managed device, as I have not experienced this before. Give it a shot and see if you can edit those settings. If you can, then an HTTP proxy can help you get around blocks. But you still won't be able to install a VPN app. It all depends on how much is locked down on your iPad.
Thanks for informative video, can I assign to the squid proxy server public IP ,so it will be accessible by other devices on the internet?
You're welcome Deyaa! Thanks for watching.
Yes! you definitely can, and that would be a great way to use it over the internet (if you want to expose your Squid service over the internet).
If you do try this, I'd definitely caution to make sure you set up your Squid service with authentication, even better authentication than what I demonstrated. OAuth would be ideal, but thats definitely not easy. There are other forms of auth you can look into, but the basic auth here is not good enough. In addition, you should also set up an SSL cert. You can go with a LetsEncrypt certificate, that you can generate for free.
Doing this publicly is a bit more challenge for an HTTPs Squid proxy, versus using a SOCKS proxy over SSH publicly. With SSH I'd recommend using an SSH key, and that would be secure enough. Much easier than following best practices for HTTPs.
I'd look into how to create that certificate, and how to configure squid with HTTPs before you go down the route of using it as a proxy over the internet.
how many proxies can you create on a server ?
Thanks for watching Business Intelligence!
From my understanding, and in theory, you should be able to run multiple instances of Squid Proxy on the same server. You’ll just have to run them on different internal ports, as otherwise it wouldn’t start up.
As I haven’t tried multiple proxies on the same server, I’m not sure if you can use multiple outbound interfaces, on the same squid instance, but if so that would be the better option, as opposed to running multiple instances of the squid server proxy.
What I haven’t done yet or figured out is how to delegate traffic to different Ethernet interfaces, to reflect that you’re going out through different IPs, since that’s likely your goal. You’d need to create these interfaces, and then assign the Public IPs to those interfaces. This could be through DHCP, or manual assignment, but this is where you may have some difficulty. Then once you’ve done that, you’ll have to tell squid proxy server(s) to use specific interfaces for internet based traffic (basically specify which proxy IP to use). Then after all that, you should have multiple proxies working on the same server.
As for how many, I think you’re really only limited by server resources, mostly RAM and CPU, so I imagine you could run many proxies one server, but I can’t say specifically since it depends on the server resources.
Otherwise, an easier option is to use proxy services that host multiple proxies, that’s likely the easier option.
Sorry for the long answer but in theory that’s how I imagine it would work, and should be possible.
@@DevOdyssey It makes sense ...Thanks for the detailed explanation
@@businessintelligence9790 You're welcome! Thanks for asking, as it helps me verify my understanding and knowledge 😊
Is there a way to somehow create a proxy on a google chromebook?
Thanks for watching @zekadoodle6488! I’m not that knowledgeable on Chromebooks, but from what I know, it’s not possible to make a Chromebook into a proxy server. I’m sure you can connect to a proxy, just not make it a proxy server as shown in this video.
Now you could flash Linux onto a Chromebook at which you then could make it into a proxy server, but not on Chrome OS.
I have webapp with "signinwithgoogle" option. "sign in with Google" works when the url is localhost. But, when I want to run my web-app with dynamic IP address, web-app works but sign in with Google option alone doesn't work. Is there way, I can run my web-app with dynamic IP where sign in with google option works with help of proxy. I need HELP!!!
Thanks for watching Coderart__!
I'm not sure how much this relates to proxies, and is likely dependent on your webapp that you're building, but I'll offer my input.
I am not sure what you mean by "running with a dynamic IP address" but I assume you mean a proxy or "IP other than localhost". Using Sign In With Google option is likely using OAuth 2.0 and OpenID Connect, but chances are, you need to investigate your integration with Google, and check to see where you can allow specific IP's or hosts to use the OAuth 2 integration from Google. Doing that, should then enable you to "sign in with google" on your webapp. You should have some sort of dashboard that should help you here.
Other than that, I'm not sure what else it would be, and that would require more troubleshooting.
Hi, I'm having a problem related to my work, and I was hoping after watching this video I would be able to fix it myself, but I still don't know how to.
My work requires accessing websites that are region-specific, and in order to do so, I need to have an IP address from that particular country. Unfortunately, due to the restrictions and limitations in my country, I'm having major difficulties accessing these websites using a VPN.
So I live in Egypt, and my work is in Kuwait. I tried using the NordVPN service, but they don't provide servers in Kuwait.
I heard of Meshnet from Nord, and it did work (kind of). The issue is that in order to use Nord's application, I have to be on a VPN already (just to access the app and use the mesh feature), so as soon as I obtain the Kuwaiti IP through Meshnet, the VPN (used to access the Nord app) disconnects, and subsequently I lose access to the Kuwaiti IP obtained using Meshnet.
As a workaround, I'm currently accessing the websites using on of our team's lap using AnyDesk, so working from his pc directly.
Great video btw 😀
Thanks for watching @big-jo89! I appreciate the compliment 😊
So it looks like a proxy solution could help you here, but seemingly you're looked more into VPNs. If it's just web traffic, you could use an HTTP(s) proxy, but if its more than that, a VPN (or even a SOCKS proxy), would be better.
In your scenario, I'd probably lean more toward using a VPN service. But before I dive into that, have you tried other proxy services and gotten any working results? Just curious, as there may be some potential here, with more selectivity of regional IP rotation.
What you essentially need is a couple of "hops" in your connection. You need to connect to a place where you are allowed to from your current location, and then from that place, is allowed to connect to your true destination, basically, an intermediary.
As I don't know a lot of the geo politics about countries blocked or allowed, do you know of any country that you can access from Egypt, but also has access to Kuwait? Here is where you'd get your best bet.
What you can do, is set up a cloud server that you have access to that can VPN into. Then on that cloud server, you VPN into Kuwait. Then with proper routing rules, you can tunnel your connection from your PC, to the cloud server, and into Kuwait. So it would require some manual effort, but thats how I'd see it working.
hi, gpt4 taught me to setup squid and i duno is it http or https (between client and proxy), it then taught me to wrap thru SSH tunnel as you did. however i found your teaching better. thanks
Thanks for watching!
First time I've heard someone talk abut using GPT4 to learn tech, though I know its being widely used in IT. I have to say I've used it to help me too.
But, my thoughts here are to double check the output, because often it can miss the context of what you're trying to to.
Anyway, happy to hear my teaching style was better than GPT4, thats probably good for any youtube educator to hear 😊.
As for the squid setup, its both http and https. But if you want something quick and easy, the ssh tunnel works best. For a network wide proxy, you'd want to use a dedicated proxy, such as squid.
@DevOdyssey can you teach me how to create multiple proxies by 1 script on aws instense with 1 ip
Thanks for watching @KhabaristanToday!
I haven’t done that, but I’m sure you can use the extensive APIs available in AWS to stand up an EC2 instance with one IP, install squid on it, and then configure it. I’m not sure what you mean by multiple proxies with one IP. The IP is really the “proxy” in the sense that this AWS IP is proving your real IP. Multiple would assume multiple IP addresses. Sure you can have multiple instances of squid running, but then if they all are behind the same IP, there really is no point to having another instance running, at least that I know of). And if you want to load balance, you run another instance of the proxy on another machine / EC2 instance anyway.
Your best bet is to start researching the AWS API and see why you can do with it. I’d also look into terraform, as that will be very helpful in automating your environment creation.
I can't set up my username and password. Can you help me about this one?
Thanks for watching @reesegonzales9585. The video and the comments here should help, as generating a password seems to be a bit different than prior, due to deprecated libraries from my ubuntu instance at the time of filming. For example, this command from @NickHope below should work:
sudo printf "USERNAME:$(openssl passwd -1 'PASSWORD')
" | sudo tee -a /etc/squid/htpasswd
Just insert whatever your username and password that you want. Then doing all other necessary configuration to turn it authentication, as per the video, should work as demonstrated.
wait so is a SOCKS proxy just a more safer version of the https
Thanks for watching!
So not necessarily. SOCKS is just a proxy that uses a different network protocol (when compared to HTTPS) to proxy traffic, but also can proxy more than just HTTPS traffic. Squid, as an HTTP(s) proxy can only proxy HTTP based traffic. SOCKS can proxy send not only HTTPS, but also SMTP, FTP, etc, as a Layer 5 proxy.
In my opinion, its benefit is that its a simpler and still secure way of proxying traffic in when compared to a Squid / HTTP(s) proxy. Getting HTTP(s) Proxy to work can be more difficult, since it involves setting up certificates. If you want to do inspection on the traffic, that would involve breaking the HTTPS connection, effectively man in the middle, and that adds another layer of complexity.
So I like to use SOCKS proxies where I can for simplicity, but a HTTP(s) proxy is likely to scale better, especially in larger deployments.
I had the proxy working but after I set the password I started getting 403 authentication errors. I checked the conf file multiple times and I forwarded the ports in my wan setting on my router. I'm also using a windows computer without using putty because after configuring Openssh in ubuntu, I was having problems connecting to the gui version of ubuntu 20.04.
Thanks for watching Jay!
From the sound of it, it seems like you didn't set the username and password on your client so you can authenticate to your proxy. When you set the password, it means that credentials will need to be presented in order for any client to use the proxy. If there are no credentials (or incorrect credentials) provided, then you would get a 403 Unauthorized error, so it seems to line up. I'm not sure where you are trying to use the proxy on your client, but wherever you set the proxy IP / URL and port, just specify the username and password, and that should resolve your issue.
So for Windows, you can set the proxy in your network settings. As for the GUI issues you're having connecting to Ubuntu, i'm not really sure where that is originating from, but it shouldn't have anything to do with Putty or OpenSSH in Ubuntu. That would just really depend on what protocol you are using, to connect to the GUI (like VNC) and if there some issue with its configuration.
I learned the hard way!
1.You can't(apparently) use capital letters in username
2. My server didn't have htpasswd installed, so password authentication didn't work oob. It is part of apache2-utils package (~1MB).
Thanks for watching LPFan4! Learning the hardware is all I do, so I can relate😄
1. I didn't know that, and I don't think I encountered that in my testing, but good to know, so thanks for sharing!
2. Yes, that package is required for htpasswd for password authentication. My ubuntu installation may have had it already by default.
This is definitely an example can can be done better too, so if you want to use other ways of authentication against squid, you certainly can do that.
Hello, I'm having issues connecting to the proxy I created outside of my local network since I'm hosting this on vmware, I've tried my public IP address on another network with no firewall on, correct port and it fails to connect.
Thanks for watching!
Half the battle in setting any networking up is troubleshooting, so hopefully you can figure out the problem with some guidance.
So since this is hosted in the public internet, I’d first do some troubleshooting in your local network’s end. See if you can verify that connection attempts are leaving your computer. In this case, you can use wireshark to test outbound tcp connection attempts to the public IP address that your squid server is listening on, and then make sure it’s the right port. If you’re using the default it should be 3128.
Then if all is well on that side, you can do this same process on the squid server side. Make sure it’s receiving packets from your public IP where the request is originating from, and on the incoming port (or destination port) of your squid server (again, 3128 if the default).
In addition, you can check if squid is listening for incoming tcp connections by running a command like netstat, at least in Linux, and check the interface it’s listening on.
Lastly, I’m not sure if your squid server is behind a NAT, but if so, you’ll want to be sure you have the right port forwarding rule in place for that.
That should provide you with enough guidance to see where the problem resides and hopefully how to resolve it.
Is it possible to create your own random public i.p addresses using this method? Or do you still need to use the i.p address you get from your isp?
Thanks for watching Movie Syndrome.
You can’t create your own random public IP with this process. If that’s what you need, then I’d suggest paying for a rotation proxy service, that with give your random public IP addresses on demand.
Those have to be assigned by your ISP, there’s no way to randomly create your own public IP addresses.
@@DevOdyssey Thans dev, this is exactly the answer I was chasing. Do you know if webshare is a legit provider of proxies? Or do you have any personal recommendations on affordable proxies?
@@moviesynopsis001 you’re welcome! As for webshare, I’m not that familiar with them so I can’t personally recommend then. I have used a proxy service called IPRoyal and they work well for me when I use them. I made a video showcasing how to interact with their proxy, which includes a rotating proxy. You can find that video here.
th-cam.com/video/tjiMyuLrejA/w-d-xo.html
They’re also pretty affordable. I can’t say I’ve shopped around for the cheapest but their prices aren’t bad.
Try IPCola, residential IP proxy, sticky and rotation sessions，100% new, 99% pure
great video man, very informative
Thanks for watching @confusio4207! Appreciate the compliment!
Hi guys, I need config acces to SFTP through Squid Proxy!. "I can't find documentation on how to do it. Can you help with a link? Thank you."
Thanks for watching @rmbringas1!
Sadly, you cannot do SFTP over Squid Proxy. Squid Proxy is an HTTP proxy, at Layer 7 in the OSI network model. SFTP is Secure FTP, which is a different protocol also in Layer 7. You can only send HTTP(s) traffic over the Squid Proxy.
In order to tunnel SFTP traffic over a proxy, you'd need to use SOCKS proxy, which works on the transport Layer (4). So you'd want to follow @11:35 in the video, where you can do dynamic forwarding over SSH.
Otherwise, if you don't want to do this over SOCKS proxy, you can set up a VPN and that would work as well. You just can't use an HTTP proxy for anything else other than HTTP traffic.
i have some issues installing squid, could you maybe help me (the guide in your description doesn't work it tells me to install java apt but when I install java It doesn't work and I can't seem to find a java "apt"
Thanks for watching donquavious III!
I am not sure what you mean by "install java apt". If you are using a base install of Ubuntu, apt is the default package manager. Using apt, you should be able to find the squid "package", which is really just the squid server software. Nor does it seem like java is a dependency of squid.
So I am not sure where you are encountering this, but if you can explain more, I may be able to better assist.
How do you get a proxy server to run all of this on?
Thanks for watching Bradnilious!
I'm not sure what you mean, as the video shows it. The operating system being used is Ubuntu, but any Linux OS should really do, especially that supports SSH. This is what runs the SOCKS proxy.
Squid runs the HTTP(s) proxy which is a program you can install on Ubuntu using apt, though similarly can do that on other Linux OSes. If you can get a little more clearer on your question, I can give you a bette answer.
@@DevOdyssey You answered my question anyways :) I actaully had another question. You mention this being able to access things that were blocked. For example, a school computer. How would I use this for that?
Another question, when I install squid through apt, it doesn't generate a squid.conf file. I do not know what is going wrong.
@@bradnilious Glad I did! So by access things that are blocked, I’m referring to content on the internet, like movies, tv shows, etc. you can’t really access a school computer this way. I’d have to understand how it’s blocked and how you re trying to access it. But if in general you’re on a school computer and something is blocked, there may not be much to circumvent those blocks due to controls they have. I wouldn’t recommend trying it either as you’d likely raise alerts doing so.
I’m not sure why the squid.conf wasn’t generated. Have you checked / searched all directories? Try doing a locate squid.conf or find command on it. should be in the /etc/squid or squid3 directory.
Hello can you make usernames and passwords for socks proxy??
Thanks for watching Swaced!
To my knowledge, for making usernames for SOCKS proxy, that should be as simple as making new users on your Linux distro (Ubuntu), and giving them permission to login over SSH. Then that username, password, or public key (more secure) combination should authenticate users to the OS itself, and give them access to the server as a SOCKS proxy.
Hello, I am having some issues where auth just does not seem to be working for me at all. I have tried yours + many other guides out there, completely reinstalled my squid proxy time and time again but it just never seems to work for me. I'm following your examples exactly as they are but just never seems to work, any reason or help you can give here?
Thanks for watching VanGendt! I’m sorry to hear about the trouble you are having getting authentication to work.
Depending on where you are deploying your squid proxy, and if it’s publicly accessible over the internet, I’d use a different authentication mechanism than the one I did in this video, as it’s for demonstration purpose only. There are plenty of other authentication mechanisms you can use for squid proxy, as you can see here.
wiki.squid-cache.org/Features/Authentication
Without much more detail, or error messages, it would be hard to troubleshoot the issues you are having, or provide any reason why what you’re doing is not working.
If you can’t get squid proxy authentication to work, I’d definitely try setting up a SOCKS5 proxy using dynamic forwarding over SSH as I show in the second half of the video. I’d recommend that over squid since it’s much easier, and if you don’t have a hard requirement of using an HTTP proxy. Combine that with a SSH key and that would be very secure.
How many proxy can be created?
Thanks for watching haispntong1251! When you create this in a cloud environment, say on a VPS, you can have as many proxies as public IP addresses, at least in terms of what makes sense. You can have multiple instances of squid proxy but you really don’t need that unless you have specific use case that requires it. One instance should be able to handle traffic routing through different interfaces with public IPs. It really comes down to how many public IPs / interfaces your VPS has.
Is there any way to create a TCP connection between a 4g phone to server, and server create a http proxy of that connection and use it?
Thanks for watching Kot.
I'm not sure how to answer your question, as I'm a little confused, but I think I know what you're asking for.
If you want to create a TCP connection between a phone and a server, you can do that with the rights tools, pretty easily. Depending on your phone and its abilities, you can create an SOCKS proxy on the server, and connect to it via your phone. Then you'd just need to make sure your phone is set to use that SOCKS proxy in your phone settings. This, in essence, would be a TCP connection, because SSH uses TCP on the transport layer.
Then on your server, you just need to configure it to use an HTTP proxy in its settings, and from there, it should forward any HTTP traffic the server receives, to the HTTP proxy server you're connecting to, even if the traffic originates from a SOCKS proxy.
I think this is what you're asking for but if I'm wrong, let me know.
@@DevOdyssey is there any way I can contact you?
@@KillerKotHD If you'd like to contact me further you can find my email on my channel page. Otherwise, if the troubleshooting can be of value to others who watch this video, we can continue discussing here as well.
@@DevOdyssey ok, i found another question. How can we redirect all http trafic from openvpn client to squid?
i have a openvpnserver set up and a squid proxy setup on my rasberry pi. now how can i merge them? i'm not really good at networking unfortunatly..
@@KillerKotHD So if you have OpenVPN Server and Squid, on the same machine, you can hypothetically set up a proxy client in your Raspberry Pi OS settings, to connect to the proxy service running locally on the raspberry Pi itself. And then any http traffic from OpenVPN clients, that are connected to the OpenVPN server, will have their http traffic proxied through squid.
But, if I may say, this doesn't really make too much sense. Unless the squid proxy service is running on another interface (aka your Raspberry Pi is multi-homed), then I'm not sure what purpose it would serve to proxy your OpenVPN Server http traffic through squid proxy server, when they are running on the same machine.
If you care to elaborate what goal are trying to accomplish, I could suggest a solution / setup for you that would achieve your desired result.
how do i fix this. I tried checking the status of the server, and it says failed result exit:code. How do I fix this I am completely new to this I NEED HELP BADLY
Thanks for watching Vyra!
I am not sure what that error message is referring to. Is it for starting HTTP Proxy (squid)? or is it for the SOCKS proxy (ssh)?
Depending on if its squid, or ssh, there are different logs you can refer to, such as for squid it's likely in the file var/log/squid.log. For SSH, you can use the v flag (ex: -vv) to see the some more messaging and give you an idea of why you are seeing an error.
Otherwise, googling the error code with more detail will likely help too.
@@DevOdyssey I manage to fix my previous issue but when I try to configure socks proxy it says my password is incorrect when I literally copied and pasted
@@zvyraz I am not sure how you are configuring your SOCKS proxy, but in the way that I set up the SOCKS proxy in this video, there is no username and password. While you can set it up that way, I am not too familiar with that.
In this video, I connect to a Ubuntu server running SSH. While connecting over SSH (on port 22), I open up port 40932 locally (aka on my client computer), for the SOCKS proxy. This port sends anything it receives, through the existing SSH connection to the server over port 22. This is referred to as tunneling. Then when the tunneled connection exists the server, it leaves via an arbitrary port on the server, and thats what "dynamic" means in that case.
This "tunnel", is effectively the SOCKS proxy connection, and when setting it up, there is no username and password, just an open port on your computer to use for the SOCKS proxy connection.
Hello can I create a USA Proxy yet am not in US?
Thanks for watching!
Yes, you can create a USA based proxy even if you are not in the US. You'd simply have to stand up a cloud server / VPS, in a US based datacenter with an public IP in the range dedicated to the US. There are many cloud providers you can chose from.
Once you have done this, its a matter of ensuring you have a remote connection to that VPS, i.e. firewall rules that let you into that server, so you can SSH into it, or directly connect over the squid port if you want to expose squid over the public internet.
However, I would caution here as anything you expose over the public internet should have good authentication. For SSH, I'd recommend SSH keys at a minimum (when using a SOCKS tunnel over SSH as shown in the video, rather than setting up your own independent SOCKS server which I didn't cover, but also an option), and for Squid, I'd go beyond setting up Basic Authentication, and ensure you use HTTPS as well. That is definitely going to complicate the setup more, i.e. stronger security like OAUTH, and certificates for HTTPS, and if you want to inspect that traffic, you'll have to set that up as well, and thats additional setup.
So if you simple want to proxy out, I'd suggest using SOCKS over SSH implementation like I did at the end of the video, 11:35.
How to create same vps 100 ipv6 socks 5 thanks 🙏
Thanks for watching Inspire you UP!
So this video does cover the Socks 5 part, but as noted, it does not cover the creating a VPS part. That could be a good video to do in the future, but for now, I can refer you to some documentation on how to create a VPS on a cloud service.
If you used Linode, for example, you can follow their documentation (see below), and specifically, the section on "Log in Using SSH". You'd log in over SSH using the -D flag for dynamic port forwarding (as noted in 11:35), which your local port number of choice, and then using a SOCKS 5 client (such as Foxy Proxy) to connect, and thats basically it. Your traffic will then be tunneled out the public IP of the Linode Server.
You could do this with other providers as well, but Linode comes to mind first and I have heard good things about them. I personally have not tried out Linode, and nor do I have any affiliation with them, but thats probably a VPS provider that I'd try out.
www.linode.com/docs/guides/getting-started/
How do I get to the part where I download squid
Thanks for watching Antonasia!
So after logging into your Ubuntu / Debian based Linux server that you've dedicated for use with Squid via SSH, you download and install Squid by using the command "sudo apt install squid" at 05:12 in the video.
Hello Sir. I'm using a VPS (USA Location) and trying to access some Indian websites. I need to create a proxy server for India Location. I'm from India and I have plenty of Internet for my PC (windows 10). Is it possible to create India proxy using my own PC internet to use the same in the above said USA Machine? I'm very much new to this coding world. All I know is little bit of python. Please help me sir.
Thanks for watching @friend1439!
In order to create an "India based proxy", you'll need an Indian IP address. Whether that come from a VPS, or a VPN provider, you need some sort of machine that gets assigned an Indian IP. This would then indicate to the Indian websites you are visiting, that you area coming from India, even if you aren't physically in India at the time.
Since it sounds like you know a bit about VPS's you can stand up a new VPS and ask to be assigned an Indian IP. How do you do this will vary amongst cloud providers, but the general gist is you want an Indian IP. But as I read your response more, and try to make sense of it, it seems like you don't need to necessarily do this.
If you have a laptop, thats already accessing the internet with an Indian IP, theres nothing you need to do then. You can shut off your proxy connection to access the Indian websites without being proxied, or you can create rules for what websites you do not want to access over the proxy, in that, they're simply accessed via your Indian IP. This is something you'd have to do using split tunneling, but thats technically VPN based, which might be an option for you if you want to stand up a VPN in your VPS. Doing a bit of quick research, I dont think its possible to "split tunnel" between different domains, in that what goes through the proxy, and what does not. There are block lists and allow lists, but I think thats all the domain filtering you can do.
@DevOdyssey Thanks for the response sir. It is like this, I'm in India having a windows 10 laptop with active internet connection and Indian IP obviously. My brother is in USA and he needs India IP for accessing Indian OTT websites. I don't prefer using VPN. I'm thinking to make my personal IP as a HTTP proxy IP for him to use. I read about squid but I'm not completely sure about the process to achieve this in windows system sir.
@@friend1439 Thanks for the additional detail. Now I understand your set up better than I had before. Given that, you have a few ways you can address this.
First, you would need to know if your public IP is one you control, or is CG-NAT. If its one you control, you can simple stand up a http proxy or your own VPN server, and port forward to that service, which your brother can connect to, and use to tunnel his connection out from your computer / public IP, giving him an Indian IP.
If you have a CG-NAT IP, then this process will not work, as you do not control your public IP, and you cannot port forward. Here, I would suggest setting up a VPN server (can't do an HTTP proxy here) on your brothers VPS (or any VPS you control), where your computer, establishes a tunnel to that VPS. Then, you can configure any connections to that VPS, to tunnel our through your tunnel between your computer and the VPS. Then this would make it seem like any traffic would be coming out of your Indian public IP.
I don't have a extremely specific video for this situation, but the best one I'd recommend is the site to site VPN video I made.
th-cam.com/video/2dH-O0crThk/w-d-xo.html
Now, if you end up getting another VPS and you get one with an Indian IP, then you can simply install an http proxy on that VPS.
However, in general, I'd recommend establishing a VPN server on a VPS as that will be more secure, in my opinion. If you do proceed with a public facing HTTP proxy, ensure that all traffic is HTTPS, and it has strong credentials protecting it, using something better than basic authentication. I prefer VPN servers likely because I have done this process many more times, and I find it quite easier than setting up an HTTP proxy.
Sir pls how can I create bulk proxies with your method
Thanks for watching Gog- playz. Could you specify what you mean by bulk proxies? From what I understand, it seems like you want multiple proxy instances with multiple IP addresses. You can certainly do that, and use this method to create multiple cloud instances of Ubuntu with different public IP addresses. The cost of this would increase pretty quickly though with more cloud servers you create. Otherwise you can try and buy your own Public IP address block, which might save some money, but again the cost will add up over time.
Try IPCola, residential IP proxy, sticky and rotation sessions，100% new, 99% pure
can i use proxy from squid without auth? and how to remove auth?
Thanks for watching Nur Amalia!
Yes, you can use the squid proxy without auth no problem at all. Basically you'd complete the step 5:01 to 6:31, and that's it.
Now if you running this locally on your own network, where you only want to access it, I'd say leaving off authentication is not a big deal. However for any larger deployments (larger internal networks with multiple users, or external networks), I'd recommend to have some sort of authentication on for tracking authorized use.
Hello sir I'm confused at ip where can I get ip were you enter on postman and first of the video in terminal like " ssh squid@ip "
So where can I find this ip can u tell me pls
Edit : and when i type ifcongif command on terminal i found "wlan0 and there is ip showing that ip i entered in postman and then i follow ur next "http/ifconfig" so i found ip but is different and ur too different and 3rd step u type in terminal " sudo vim var/log and then i found same IP were i entered in postman but ur ip is different and so also it's work for me ? And where i found my ip last digit like "109.09.09.0/this number
Thanks for watching Tarun!
That IP comes from my ubuntu server I set up as my Squid (HTTP) / SOCKS5 proxy. Doing "ifconfig" or "ip a" on my Ubuntu terminal got me that IP.
I'm not sure i completely understand your edited comment, but I'll try my best. So i would expect to have a different IP than you see, as chances are we have different networks setup with different ranges. I am using an Ubuntu server in my local network as a proxy, and if you are using a server in the cloud, with a public IP, you will definitely have a different IP address. It really comes down to your use case and what you want to set up your proxy for, which will dictate how you set it up, and what parameters / values you see. I don't know your setup, so I really can't comment on things like IP addresses.
If you set it up correctly, using your IP address, you should have no problem getting this working. From the IP you mentioned, it sounds like your interface is a public IP address. If you have Squid (or SSH) listening on that IP address, then that is the IP address you want to use in Postman. You don't want to use your wlan0 IP address, unless, you intend to connect to your proxy via your local wireless network. Without much more detail on how you want to define your setup, this is all I can really comment on.
how do I find out the IP address of my squid server so I can go to postman and insert this? I have an hour trying to figure this out and there's nothing in Google.
Thanks for watching Victor!
If you're running on ubuntu, or another linux distro, you can run the command "ip a" in the terminal and see an output of your server's IP address. That is then what you can use in Postman.
However you'll have to be logged in to begin with in order to run that command, which you'd already most likely know the IP address be then (unless you're running a local VM).
@@DevOdyssey yes, I’m running a local VM, parallel which has Ubuntu 20.04 installed.
Ah that makes sense then. Open up a terminal and running “ip a” should give you an IP address for the Ubuntu machine and as a result the IP squid is running under
@@DevOdyssey awesome I’ll try that! Thanks for the quick response!
@@DevOdyssey I tested and when trying to connect to the squid server it says "connection refused". I check the status and it's active (running). How can I resolve this? Also, should I use a postman inside the VM or outside in my host machine to do the test in postman? Sorry I'm trying to do a project and there's not much info about Squid out there easy to find.
how do you download squid or make a account
Thanks for watching KingzCostz!
To download squid on Ubuntu, you simply open the terminal app, and type the command sudo apt install squid, as you can see at 05:08. This should install the latest version of squid HTTP proxy service. To make an account to use for basic authentication, you can follow along in the video starting at 07:52.
Though, know there are other methods of authentication you can add that I didn’t cover.
Congratulations on your video.
I have a doubt, in case to create several ipv4 and socks5 proxy with individual user and passwords, how would it look?
Thanks for watching Anderson!
If you want to create multiple users and password for a SOCKS5 proxy, you can simply create multiple different Linux users and allow them SSH access (say via sshd_config), set up SSH keys if you'd like, and thats it. Since SOCKS5 works over SSH, and SSH authenticates with the Operating System's users, you'd just have to create those system users. It's pretty simple. For example, this link below shows you how to create users on Ubuntu using the "adduser" command.
www.digitalocean.com/community/tutorials/how-to-add-and-delete-users-on-ubuntu-20-04
hey dev, i have a licensed software ( Minitab ) it has two parts one is the license server( windows ) and the other is the client software(windows and mac). The client can use the software by putting license servers ip and port directly however, i want to restrict access to the clients by mac filtering or user authentication or proxy. Iam totally lost please help how do i accomplish this...
Thanks for watching Raj!
So I'm not 100% how you can accomplish this, but I'll share my thoughts.
If this were possible, you'd want to use a SOCKS proxy, as opposed to an HTTP proxy. I don't know the protocol of the license server (Minitab) and how it checks for license usage, but I'm not going to assume its HTTP. With a SOCKS proxy you should be able to tunnel all traffic through it, regardless of application protocol (ex: all TCP or UDP traffic)
In addition, you'd want the client and the server to be on two different networks. Thats because if they are both on the same network, I don't think the traffic would run through the proxy, it would just reach out to the server directly being on the same network. I won't get into the technical details of this, unless you'd like to know, but it's mostly about communicating over Layer 2 or Layer 3. You'd want to communicate over Layer 3, and above) since the SOCKS proxy operates on higher layers like 4 and 5. Then you'd just configure your clients to use that proxy, and all network traffic would go through the SOCKS proxy.
With regards to mac filtering, I'm not sure how you'd do that with a SOCKS proxy. MAC Filtering happens on Layer 2, and since we want our controls on higher layers, MAC Filtering isn't really an option for restricting access to the server.
The above recommendations should work for you. However, it can also be achieved via firewall and routing rules, a proxy isn't necessary.
@@DevOdyssey i tried a lot of things but couldn't get it to work. I tried creating a socket io nodejs proxy with auth, Sometimes the proxy wont recieve data, sometimes its not able respond back. Can you pls help me with the firewall method ? Like how do i allow only predefined mac ids that can connect to the licensing server
@@rajsaroj4696 With regards to the nodejs proxy, I am not too familiar with nodejs web sockets, though the general concepts of web sockets should apply.
With regards to using a firewall, I suggest researching subnetting and firewalls, as there are plenty of videos / reading materials online that can assist and educate you on these concepts. If you don't have a firewall that supports custom rules, you will have to get one / set one up, in order to achieve that. OpenWrt is a great candidate for firewall software, but there are also others out there like pfSense, OPNSense, etc.
As noted, using a firewall, you cannot do MAC Address filtering, as that is performed on a layer 2, Data link layer, while a firewall operates on layer 3, IP layer.
The method you want to apply / target is subnetting and firewall rules. You want your clients on a different subnet than your license server. Then, you can create firewall block / deny rules, that prevent certain client IP addresses from reaching out to the license server.
This should accomplish the same thing you want via MAC filters, but this approach is generally how you would accomplish your goal.
Hi great video
Do you know how to get a HQ indonesian socks5 proxy please?
Thanks for watching Shopwhat!
If you don't want to create your own proxy, you can purchase access through a proxy service provider that will give you all the connection info you need. If you want to create one, you can purchase a VPS (Virtual Private Server), from one of many cloud providers, and all you have to do is ensure that the VPS resides in Indonesia, or at the very least, has an Indonesian public IP. Then you can follow along in this video and install a proxy server in the cloud, like using ubuntu, set up SSH access via the cloud's firewall management, setup SSH keys, and you should have a socks5 proxy.
*- Very very informative and intrusting TKS FOR THAT !, the problem come from the set up Ubuntu 20.04 LTS...it's very long to start and to detect my personnal material...i can't understand why on my DELL optiplex 3020 it is so long.... is it possible to do the same work on a Centos7 or Centos8 ? or do we have to buy some space disk in the cloud to do it anyway ?
*- Does the setting-up and the using on the cloud is free for few weeks or do we have to pay quickly ?
*- if i understand deeply, the other way is maybe to setup a proxmox server between our router's provider and our computer (more secure)
tks forward++
Thanks for watching david!
That’s odd for the start up time for your Ubuntu 20.04 LTS taking so long. This should be possible using CentOS, though I will offer my two cents in that the project is not being developed anymore so you’ll be stuck with whatever the latest CentOS version is.
You can certainly buy some “space disk” in the cloud, but if you can self host, I encourage that way first!
Setting up a proxmox server can certainly help you do that, to virtualize and servers, including a squid proxy server. But if you also have some old hardware laying around, you can install CentOS onto that and squid to make it your proxy server. Self hosting does provide more control which nice in my opinion, and you save costs from going into cloud environments. It could be argued as more secure by self hosting, but that’s mostly based on if you configure your instance properly, no matter where it’s located (self hosted or cloud)
Anyway, welcome! Glad you enjoyed this video 😊
Can someone explain to me how this is different than vpn ?
Sure @xila8861! So a proxies and VPNs are different networking technologies, but very often used for the same purpose, to act as an intermediary, especially with how VPNs are marketed today.
VPN is a Virtual Private Network, the whole point of the VPN is to create a virtual private network, or that enables you to connect to it remotely. Its basically a network next to (or on top of depending on the tech) another network. This is done at the IP Layer (layer 3).
A proxy is a service that uses transport protocols (layer 4), to enable the forwarding of traffic via an intermediary endpoint. Proxy, inherently, represents an intentional middleman between the source and destination.
Because VPNs can do what proxies do, they are often touted as the solution you need to proxy your internet traffic. But, a proxy can do the same thing. How they accomplish this varies. A VPN (at layer 3) allows you to tunnel any traffic over it, using encryption and encapsulation. A proxy (at layer 4+) uses different network protocols to send your traffic to an intermediary, for example, using an HTTP proxy, or even a SOCKs proxy.
Overall, VPNs can do what proxy does, but proxies can't do what VPNs can (i.e. creating networks). They just achieve the same result in a different manner, and which to use truly depends on your needs and use cases.
@DevOdyssey Thanks a lot for taking the time, DevOdyssey 👌 clear explanation.
@@xila8861 You're welcome! Glad I could clear that up for you 😊
Enjoyed your sound of silence
Thank you for watching Black Bullet!
I’m not sure what specific silent part of the video you enjoyed, but happy to hear you enjoyed it.
Error: tunneling socket could not be established, cause=connect ECONNREFUSED
Thanks for watching Ozumcan!
So it seems like you are having an issue within oostman for connecting to the proxy. Without more details, I can’t really be sure what’s wrong, other than you cannot connect. In this scenario I’d normally assume the port you are establishing the proxy connect on is being blocked. This could be a issue with your firewall, or proxy configuration.
Is this error the result of using a HTTP proxy or a SOCKS5 proxy? Regardless, feel free to share how you configured the proxy in Postman, and then from there, we can backtrack the issue to the proxy server if there is one.
@@DevOdyssey i just installed squid on windows and tested the proxy on that machine and it works. But I can't connect to the machine remotely despite creating an inbound rule for port 3128. I guess it's because ISP is providing a NAT ip which is the most common case I guess?
I used to overcome this issue by using ngrok but you can use it for either http or tcp but I see two possibilities here: proxy protocol is different or the connection must be established directly. If it's the latter, we are back to the original problem of connecting from a remote machine again.
@@ozumcan I'd say you are troubleshooting around the right lines. in this scenario, you'd really have to make sure that your public IP address from your ISP is one you control. If you are getting a CGNAT IP 100[.]64[.]0[.]0 to 100[.]127[.]255[.]255, then its not an IP you control, and any inbound rule wont work, because that CGNAT IP is not your real public ip out on the internet.
I am familiar with ngrok, but I don't have much familiarity using it. Without knowing your network setup, its difficult to provide any further guidance. But if is a CGNAT IP you don't control, you'd basically need a cloud server with an IP you control in order to back into your network remotely, and use it as a proxy.
There are other more technical solutions you can try, such as tailscale, that will help you bypass CGNAT (if thats the case), but thats technically a VPN solution build on top of Wireguard, and not a proxy. though if your sole purpose is to get back to your network and tunnel out from your home network, this may be a solution you want to explore.
hlo sir, i want to make project on proxy server . so pls tell me how i can make project
Hi Ritu, thanks for watching!
I am not sure what you mean make a project on proxy server. If you can elaborate, I may be able to help.
All I can recommend is to refer to the links in the description to get started with Squid, or if you want a simple SOCKS proxy, just create a virtual machine with any flavor of Linux, and so long is has OpenSSH server, you can use it for a SOCKS proxy.
Didn't work. Nothing at all in my log file
Sorry to hear that. If traffic was sent over the proxy and it’s configured to log, you should see entries in your log file. Were you able to do any troubleshooting? Did you observe your http(s) request resolve after you configured your client (Postman, browser, OS), to use the proxy? Did you check the config and make sure squid is running and that the logged daemon was running? Providing these detail can help figure out what may be wrong and resolve it.
Nice and simple explanation
Thank you Rajesh! 😊
Nice explanation 👍🏻👍🏻👍🏻
Thanks @almanduku9043! I appreciate the feedback 😊
Great tutorial!
Thank you Narendra and thanks for watching!
Thanks for the vid very informative,
But I'm faced with a an error. After creating the password file my squid won't restart. I get the error
Job for squid. Service failed because the control process exited with error code
Please what can I do
Hi Tyres Thug,
Thanks for watching! While I haven't encountered this error before, I did a quick search with that error to see what I would find.
It looks like there may be another process running, and you have to stop that PID.
askubuntu.com/questions/898321/can-not-start-squids-service
While I can't say for sure that this is the solution to your problem, as I don't have more log detail, this may be something you are encountering.
I hope it works!
Hello Sir I need Indian 1pv4 HTTP proxy.
daily basis My requirement is 150-200+ Qty.
Can Your Provide me this proxy.
Thanks for watching Nifty Bazar!
This video is focused on creating your own proxy service, so hypothetically, if you're inclined, you can create a server in the cloud, with your choice of the hosting provider (Linode, AWS, Google Cloud, etc) and use your own proxy service for unlimited requests.
However, there are plenty of proxy services available out of the box, and seem like that is what you're looking for. I haven't used too many online proxy services, but one you can check out is ScraperAPI. While their focus is on web scraping, they do act as a proxy as well. Not sure if they have proxies available in India but feel free to take a look. You can also google other proxy providers and I'm sure you will find some reputable ones. I just don't have any I can completely personally recommend since I haven't really used any.
Try IPCola, residential IP proxy, sticky and rotation sessions，100% new, 99% pure
thanks for the vid, very informative
You're welcome! Glad to hear that 😊
how to create mutliple http prxies using squid
Thanks for watching @nsckrreddy1888! Another person has commented asking the same thing actually, which you should be able to find my answer below, but I'll provide the summary here.
To create multiple proxies in the way that we perceive it, you'd need to stand up a virtual private server with multiple public interfaces. Then, you can router your HTTP traffic against those interfaces depending on specific logic, as discussed in this video. This does become cost prohibitive and a bit more complicated. I'm not sure how much additional public interfaces cost, as that probably depends on your cloud platform, but it needs to be considered. As for more complicated, it depends on how / when you want to use different IP addresses, when you want them to be the same / different, etc. I haven't really set that up before, but its certainly possible, given thats exactly what proxy companies are doing. Which they are for a reason, thats the service they sell because setting that up and managing is a lot. So depending on how deep your proxy needs are, it might be worth it to first consider using a proxy service.
Awesome explanation! Thanks for this
You're welcome! Thanks for watching and for the compliment Khayla 😊
None of this worked for me unfortunately, i've done everything to make it happen but no result :( the way you explain is great tho
Thanks for watching Abdelmalek!
I appreciate the compliment, but I'm sorry to hear that you're having trouble getting it working. If you can share more detail about the issue(s) you are having, I may be able to help you get the proxy working, HTTP or SOCKS. Were you having an issue with Squid or with SOCKS? Infrastructure also plays a big part into this as well, so if I can get more detail around your use case, I can likely help you resolve the issue you're having.
@@DevOdyssey thanks for replying, well i did set ubuntu in a virtual machine, downloaded updates and upgrades ... then i followed the steps on the video, when i tested it in Firefox proxy extension it didn't work.
@@abdelmalekait6207 you’re welcome!
Let’s see if we can get a tad more specific. Which proxy are you trying to use, HTTP or SOCKS? If you tried running the Squid proxy service, did you get an error when it started? Can you verify the squid service is running g by using the command “systemctl status squid”?
If you tried the SOCKS proxy, can you verify you were able to SSH into it using the -D flag and port number?
Lastly your settings in foxyproxy will vary depending on the proxy type. So If you use SOCKS, you should set the up address to your loopback IP (127 . 0 . 0 . 1) and the port to the number you gave in the -D flag earlier.
If you are using Squid, just set the IP in foxyproxy to the IP address of the Ubuntu server, and the port number should be the port of the squid service, by default it’s 3128.
One more thing, can you tell me why it’s not working? What information are you using to say that it’s not working?
All this info should be helpful in figuring out your issue.
Unfortunate that it focused on adding authentication to a proxy instead of actually show useful configurations, such as stripping headers, blocking some destination URLs, etc.
Thanks for watching @ralmslb.
I’d certainly consider authentication useful, however there definitely are plenty of other useful features I didn’t cover with squid. Those ideas would be really good for a follow up, however this video was intended to get squid up and running with a barebones configuration.
I appreciate the feedback and thoughts for a future video!
@@DevOdysseyRight, however authentication might be used on a traditional enterprise environment, most modern companies nowadays just use transparent proxies, which don't use authentication :)
@@ralmslb that is a good point. While maybe some immature enterprise would use credentials for proxies, many are transparent. Frankly, if you are authenticated to the network, you’re already authenticated to the proxy.
My intent for the video was for non enterprise users, basically for anyone who’d want to stand up their own proxy in the cloud, where authentication would be useful to single small deployments, especially if it’s exposed to the public internet. But there definitely is way more to Squid than I covered it this video. I only scratched the surface of all what’s possible with Squid proxy.
Nonetheless I appreciate the feedback and for sharing other great features of Squid that would be great to cover!
Alright so i had this idea, and i think its amazing, i like ethical hacking and programming and thinks like this alot and I recently ordered a raspberry pi. And i thought what if i make my raspberry pi my proxy. But i obviously cant just keep that in my own home cause than it would still have my ip, so… I ask my school for a locker which as an outlet, those are used for people with electric bikes to recharge there battery. But if i get my raspberry pi in that locker, connect it to the outlet and wifi (i have a wifi adapter and theres a router in the same room as the lockers) and i than connect to my raspberry pi from home, i have a proxy right? Just imagine, how cool is that! Well i know some about this subject but by far not everything or as much as you, so can someone tell me, isn’t this the best and coolest idea ever??
Thanks for watching Jent!
That sounds like a really interesting idea. I enjoy that as well, and have my roots in programming, and have interest in read team and blue team security. With what you have described to me, you would technically have your own proxy server at the school, which is pretty neat. However, you'd have to be sure that you can actually connect a raspberry pi to the school wireless network, as there could be configurations in place to prevent that. In addition, be cautious of the traffic you'd be proxying through that network, as there are also likely controls in place that would block certain kinds of traffic.
It might not have the best signal sitting in a locker, but nonetheless since there is a an access point in the area, it shouldn't have too much trouble connecting.
Anyway the finish it off, even if you can connect to the WiFi, you'll need a way to actually connect to the Raspberry Pi remotely. Since I'm sure the school wouldn't be opening up their firewall for incoming connections, you'd have to have the Raspberry Pi connect back to your (or a cloud server) in order to actually establish a proxy connection that you can use. You can do this via VPN protocols or SSH, and you'd want this configuration to happen on boot every single time.
Now if you can't connect to the WiFi, you can always add a cell modem to the raspberry pi, and connect to it using cellular networks. You'd also have to set up the Pi to connect out to you as well due to the way cellular connections are set up (usually with CGNAT).
Keep up the creative thinking 😎
@@DevOdyssey Thank you for all the information!! i'll look into it, looks like i still have alot to learn haha,
@@jentkuipers You're welcome! I know its a lot to learn, but you pick up pieces and parts of information here and there. Glad to be one of those pieces of info for you 😊
@@jentkuipers th-cam.com/video/hL3qEu9A06I/w-d-xo.html
Look into
Reverse port forwarding as well
8 character long passwords will be easily cracked :P
Thanks for watching marcello42!
Great observation! By no means do I recommend using an 8 character password for squid proxy. This video definitely wasn't to showcase a "squid in production and externally facing example". I'd certainly recommend a more hardened setup, that probably uses a different authentication mechanism other than basic auth, especially if deploying in a more public facing setup.
Generally, I prefer SOCKS proxies as it's available right out of the box and simple to set up, at least for traffic for one user and not a whole environment of users. Bigger deployments would require a more dedicated setup and specialized configuration.
@@DevOdyssey yes, this wasn't my point. my point is that iirc this is the max char you could use here - which is a big flaw in squid! imo
@@marcello4258 I do see your point now. If this were a squid flaw this would certainly not be good.
However, I was doing a refresher on this video, and during my research I confirmed that the issue here is actually related to the OpenSSL command, and not actually squid itself.
lists.yoctoproject.org/g/yocto/message/47432
IIRC, I did it this way because I didn't want to install additional packages. However you can create a different basic password using htpasswd tool, provided by the apache httpd, or apache2-utils package.
stackoverflow.com/questions/3297196/how-to-set-up-a-squid-proxy-with-basic-username-and-password-authentication
In retrospect, this was an oversight on my end with creating a 8 character limited password.
Now if you want to explore other methods of authentication, I'd refer to the wiki documentation below where they answer a lot of good questions, and discuss using NTLM and digest, which arguable are better.
wiki.squid-cache.org/Features/Authentication#Proxy_Authentication
@@DevOdyssey thanks great service Mister!
@@marcello4258 You're welcome! I appreciate a good conversation 😊
Thank you very much!
Thanks for watching Nate! You're welcome 😊
Great stuff
Thank you @Yalchin403!
Thanks!
You're welcome, thanks for watching Mykola!
awesome!
Thanks Mason!
Wtf bro, you type so fast like there is someone waiting you, and also i followed the steps on my server and didn't work for the proxy
Thanks for watching Boring Channel!
Oh I'm not actually typing that fast, I've sped up portions of the video so that it doesn't become a really long video filled with gaps of typing, waiting for response, and not talking about the process. I do have the steps in the video description that should make it easier follow along with the video.
I'm sorry to hear the steps didn't work. What issue(s) / error(s) in particular were you seeing when following the steps in the video?
@@DevOdyssey it's just work locally :D
@@boringchannel6313 That is correct 😊. Now yes, definitely ideally want this proxy to have a public IP address that is not your own. These same concepts apply for creating a proxy server in the cloud. Once you log into your Linux cloud instance over SSH, you can follow with the video and it should work.
Only thing I would note is making sure the Squid port is open on the cloud instance. That might require changing cloud settings to allow access to that port over the internet, though you'd want to be sure it's well secured so no one tries to brute force it.
And for that reason, I'd recommend doing a SOCKS proxy over SSH with public key authentication, as that its a more secured tunnel thats encrypted over SSH.
Or, you could connect that "local" proxy server to a VPN, and that would accomplish the same thing 😊. As with anything, there's a lot ways to accomplish the same goal.
Bro you talk very fast and type very fast ,as a beganer like me we need to fase some problems for that.
Thanks for watching Kowshick!
I do speed up the video when I'm typing / drawing as to not make the video unnecessarily long. If need be, you can actually slow down the playback of the video in youtube to catch what you may have missed. I also do have an outline of the video in the description that you can use to follow along.