Intermediate Technical SEO
Robots.txt
Archivo robots.txt
Definition
Robots.txt is a text file in the site's root directory that instructs search engine bots which pages they can and cannot crawl.
Importance for SEO:
High
Related Terms
Learn More About SEO
Need help with Robots.txt? Our SEO experts will help you implement best practices.
Contact Us