Ask Question Sign In Sign Up

What is the purpose of robot.txt to be put in the root directory?

Member

by talon_jacobson , in category: Local SEO , 2 years ago

What is the purpose of robot.txt to be put in the root directory?

Facebook Twitter LinkedIn Telegram Whatsapp Pocket
purpose directory

1 answer

Member

by cielo , 2 years ago

It is exclusion protocol robot.txt communicate with the crawler and escape the links that not follow.

Related Threads:

What is the purpose of search engine optimization?
What is the purpose of the "role" attribute in HTML?
Where to put the canonical tag?
How to hide robot.txt from visitors?
How to verify robot.txt rules?
Where should you put your Google Analytics code?