Mediavine co-founder Eric Hochberger explains robots.txt and how it can impact your display advertising revenue.

In this episode of Ask Google Webmasters, John Mueller goes over special files in robots.txt such as *.css, php.ini, and .htaccess, and explains why one does not have to and should not disallow these files from being crawled. The question was submitted by @svperflvid. Thank you!

Send us your questions on Twitter with the hashtag AskGooglebot and your question might be answered!
Google Search Central on Twitter → https://goo.gle/3f4Z0a8

Watch more AskGooglebot episodes → https://goo.gle/2OjWcvS
Subscribe to the Google Search Central Channel → https://goo.gle/SearchCentral

#AskGooglebot

Help the channel grow with a Like, Comment, & Subscribe!
❤️ Support ➡ https://j-h.io/patreon ↔ https://j-h.io/paypal ↔ https://j-h.io/buymeacoffee
Check out the affiliates below for more free or discounted learning!
��️ Zero-Point Security ➡ Certified Red Team Operator https://j-h.io/crto
��Zero-Point Security ➡ C2 Development with C# https://j-h.io/c2dev
����‍��7aSecurity ➡ Hacking Courses & Pentesting https://j-h.io/7asecurity
��Humble Bundle ➡ https://j-h.io/humblebundle
��Snyk ➡ https://j-h.io/snyk

��Follow me! ➡ https://j-h.io/discord ↔ https://j-h.io/twitter ↔ https://j-h.io/linkedin ↔ https://j-h.io/instagram ↔ https://j-h.io/tiktok

��Contact me! (I may be very slow to respond or completely unable to)
��Sponsorship Inquiries ➡ https://j-h.io/sponsorship
�� CTF Hosting Requests ➡ https://j-h.io/ctf
�� Speaking Requests ➡ https://j-h.io/speaking
�� Malware Submission ➡ https://j-h.io/malware
❓ Everything Else ➡ https://j-h.io/etc

Your robots.txt file is something you should always consider when staring and SEO campaign on your website.

in this robots.txt tutorial, I will explain the best practices that will ensure you don’t block the wrong crawlers from accessing and indexing pages of your site.

If you set up the robots txt file incorrectly then it could have significant negative consequences to your SEO in the short term. It can be fixed in future but it is best to get it right.

It is a simple file to create, upload and edit and in this robots txt tutorial, you’ll know exactly what you should and shouldn’t do!

If you liked this video, don’t forget to subscribe and follow me on Twitter & LinkedIn via the below.

And as always, if you have a questions, or want me to cover a particular subject or marketing challenge you’re facing, head over to my website www.thebigmarketer.co.uk and get in touch. I would love to hear from you!

Website: thebigmarketer.co.uk
Twitter: twitter.com/thebigmarketer