Robots txt Tutorial 2019 - SEO Best Practices Explained

If you set up the robots txt file incorrectly then it could have significant negative consequences to your SEO in the short term. It can be fixed in future but it is best to get it right.

It is a simple file to create, upload and edit and in this robots txt tutorial, you'll know exactly what you should and shouldn't do!

If you liked this video, don’t forget to subscribe and follow me on Twitter & LinkedIn via the below.

[HeyChicoi]

I searched about this robots.txt for hours already and failed to find anything that can help me until you popped up. Thanks for the video.

[vobenglishlearning]

Great information Sir. But it would be more interesting if you show us by practicality.

[mcqueenmedia]

Great Video! very clear and informative. Subscribed!

[MichaelOrtega]

Hey I just came across your channel and I’m not savvy on websites or anything. Have you made any video on how to better manage on artist website or how to engage more with people in hopes that they will buy your product thanks?

[TheBackpackingFamily]

such a good video! really helpful and clear

[samjp]

Great video, thank you, so clearly explained.

[Maltebyte]

How to stop web crawlers from showing my web directory on google?? its not like i just see mywebsite.com on google i also have below that all my file structures on google so i can view images folder, js, html, php etc how do i stop this from happening?? thanks!

[sterlinf]

Why do we get errors in search console saying that a page or an image getting blocked by Robots.txt? I don't understand how is that an error, if we specify certain things to not get crawled and indexed in robots.txt. obviously it's going to block it.

[tut]

Thanks for the great video, do you have any video explaining Schema mark up implementation in detail with examples?

[dinosarac]

HI BIG MARKETER I LOVE YOUR CHANEL I JUST SUBSCRIBED KEEP UP THE GOOD WORK I HAVE A QUESTION DOES ANYONE KNOW IF USING ALTERNATIVE TEXT IN WORDPRESS WILL MAKE ROBOT TXT FILE NOT WORK AS I DONT WANT ALL MY IMAGES APPEARING ON GOOGLE ?

[Sam-ghij]

why don't you show us practicle example? like a step by step process on managing robot txt file.

[olgaycelik]

You are selling a course for 129usd dude we dont live in the UK like you. Most of people here watch your videos from 3rd world countries where the minimum wage equal to the course price. Anyway thanks for the video. Good job