Selenium Python Proxy Authentication

Here i show you how to handle proxy authentication in selenium python, so that you can scrape pages without problems and without the need to whitelist your ip on your proxy provider.

There are multiple ways to handle authentication in selenium python, one way is to add a plugin or extension before launching the selenium web driver or using a python package called pyautogui to automatically fill the username and password during the proxy authentication.

I personally prefer seleniumwire to handle proxy authentication in selenium. It works exactly like the normal selenium webdriver and works with most browsers (chrome, Firefox, edge, safari)

Link of the code on GitHub:

Link of the background music:

If you wish to continue learning about python selenium and web scraping, please checkout my playlist about it.

In there it teach you everything you need to know about Python selenium web scraping among other things.

Feel free to leave a like and subscribe to the channel, for more content like this.

[saltyvlogs]

This was so helpful since selenium doesn’t have built in authentication

[sebtheo]

You need to make more videos! These are very helpful and well explained so thank you a lot

[jorgemendez]

I was trying to test my code but i had no clue how to test it, until i saw your video, thanks you. it was really helpfull

[alexisordazbustillo]

Muchas gracias, llevo dias tratando de que conecte al proxy de mi empresa y gracias a tu video lo pude lograr

[aleemhakim]

That's a great video you simplified it a lot others were giving long codes and i didn't wanted my program to look messy it helped a lot
Thank you

[dannaescu]

Did not try the solution yet, but will try it very soon. But I wanted to thank you for the video :)

[cracotte]

Ty so much ! But now, how can i do if i want to add others options arguments, how can i add in options arguments this proxies options ?

[andremaytorena]

Hey, I have a question, when using selenium wire to do what you showed, can you then go on a website and click buttons and send keys? when I try it I get errors

[yellowtruffles]

hi, how do you use auth proxies from a txt file in the form of "ip:port:username:password" ?

[vkehjme]

Hello. There are some problems that the ip or ip is changed, but any website says there is no internet with strong internet presence

[claytorresgaming]

Hi thanks for the tutorial. I have a question, can you add a custom request header or User-Agent to the seleniumwire_options? If yes, how?

[davidpaley]

Hi, my selenium-wire is very slow, but selenium is too fast, so the same page can load for 1 minute and 3 secs, what should i do to fix this problem?

[taiphy]

thx this video
I get invalid syntax in the no_proxy column
what should i do?

[worldstarlivesport]

can i use the different kind of proxy with the same method, socks4, socks5 and http?

[sabir]

Invalid proxy server credentials supplied

[avinashsah]

great tutorial! Did you find some way to validate the certificate and make it a secure connection? Only seems to affect me while I'm using a proxy. If no proxy then still it says the same thing, but websites don't cause any trouble.

[Rexdrey]

running into issue where No such file or directory:

[dzboss]

how to rotate proxy authentication using seleniumwire please

[toicon]

hello, i have a question, how to set auth proxy in helium

[johannevigouroux]

hey! 🙂Congrat for your videos, they help me a lot to progress. This might be a stupid question, but I would like to know how do we make our program know which technique to use between authenticating and without authentication? Sometimes I use proxies that need authentication and sometimes I don't.I would like to have one single program for both cases. Thanks you for all