Undetectable Automation 4: 'Chrome Devtools Protocol' (with SeleniumBase CDP Mode / Python)

Undetectable Automation 4: "Chrome Devtools Protocol" (with SeleniumBase CDP Mode / Python). Learn how to bypass anti-bot services!

0:00 - Welcome / Intro
0:42 - Meet the CAPTCHAs
3:47 - About the maintainer
5:49 - CDP (origins to stealth)
10:01 - PyAutoGUI and Xvfb
10:58 - The keys to stealthy automation
11:35 - CDP Mode / Discord / Detecting anti-bots
14:23 - Demos, Part 1: Bypassing physical CAPTCHAs
17:05 - Demos, Part 2: Bypassing invisible anti-bot services
24:06 - The anti-bot report card (winners and losers)
25:07 - Microsoft's stance on stealthy CDP
26:30 - GitHub Actions / Residential IPs / Laws
28:48 - SeleniumBase Recorder for code-generation
32:32 - Other repos with stealth abilities
33:18 - SeleniumBase CDP Mode documentation
36:34 - Wrap-up / More demos / Network responses

SeleniumBase CDP Mode examples on GitHub:

Undetectable Automation Playlist:

Videos in the "Undetectable Automation" series:

SeleniumBase Playlist:

#captcha #cdp #webautomation

[rachelw]

Thank you for sharing, Michael! I attended this presentation at Code Camp! Your presentations and videos are always so informative! Keep it up!👍

[TolstyakFree]

I'v been using c# and selenium for years, but on my latest project i use c# with hangfire to do some background tasks and for crawling/parsing i wrote a python micro app (as windows service running by NSSM) with, of course, use the GOAT SeleniumBase framework. Michael, greate programming respect to you!

[kab]

Great work Michael! Thanks for your contribution to the amazing repo SeleniumBase.

[creaor]

Thanks, Michael you always do very user-friendly reviews of otherwise sophisticated automation tools

[ShaneBoiGaming]

i have been blessssed with another banger. thank you for ur work!

[TolstyakFree]

Thanks Michael! You are good storyteller :)

[OculuntO]

Thank you ! SeleniumBase is amazing, great work

[ElvenDen]

from 5.4 k stars in last November to almost 10k now is a very good result.

[sujitbiswas]

The man the myth one and only Michael Mintz <3

[Maxtr]

Thank you so much for your great tool!!! You're a crack

[njorogekamau]

Please don't go and work for Cloudflare if they hire you.

[MrAtomUniverse]

Oh wow it seems like SeleniumBase is heavily maintained

[luisantoniog.]

I’m loving SeleniumBase, It’d be awesome if you could share a Dockerfile to avoid detection with UC mode or CDP mode on Linux without a GUI. I’d love to help spread the word about SeleniumBase in Spanish too!

[TaiNguyen-evlb]

Can anyone help me? When using the UC, the website renders the different HTML elements and I could not get or click any elements. Im so depressed

[dragon]

awesome thanks, so for now google recaptcha and hcaptcha are impossible to bypass by any way ?
Thanks again

[warungku]

Hello sir, i just wanna say this is nice video, i have a questions, even we can bypass bot detection system we still have same fingerprint if launch multithread or multiple browser at same time, can you make undetected chromedriver into exe file so i can input it manually as chromedriver path with different browser version, currently i have desktop app that using selenium, and i input chrome path and chromedriver path manually and also i'm using antidetect browser to create multiple browser profiles, so i can get different browser profiles information, but as you know if we using standard selenium website always can detect the bot, if you can make undetected_chromedriver into exe file and use it with different browser version and also use seleniumbase, i think i can bypass almost all bot detection system, i'm not using standard or original chrome from my pc but i'm using chrome from antidetect browser, if i use undetected chromedriver i always face Compatibily issue between browser version and undetected chromedriver version

[haka]

There seems to be a lot of focus on Github Actions, though isn't it against the TOS to use it for non development workflow purposes ? So any "serious" use outside of a demo would not be something to rely on ?

[royal]

Hi, thank you again for your dedication to this project, I have been following it for some time and I admire your work.
I would like to ask you a question about some code. I have the impression that the sb.open(url) or sb.uc_open_with_reconnect etc... is like a loop which as long as the page has not completely finished loading it does not go through next nah? And if this is the case, is there a way to stop before, for example, when it finds a specific query?

Thanks in advance

[soitk]

Is there any way to use the recorder with the existing profile? Whenever I record, it opens a new profile, and I have to log in again.

[Arthur-Trendex]

Hello @MichaelMintz, thank you for that incredible work. I have a question about CDP, I tried your examples/cdp_mode/raw_gitlab on my local machine (MacOS), this is working fine, but I also tried in docker container (based on seleniumbase image), it wasn't working but I've seen your comment saying docker let fingerprints and can't solve captcha. After this failure, I tried to run the script in Windows / Ubuntu EC2 on AWS but still can't pass the captcha of Gitlab.
Do you have any suggestion or I'm missing something ?
Thank you in advance.