What is the purpose of robot.txt to be put in the root directory?

by talon_jacobson , in category: Local SEO , a year ago

What is the purpose of robot.txt to be put in the root directory?

Facebook Twitter LinkedIn Telegram Whatsapp Pocket

1 answer

Member

by cielo , a year ago

It is exclusion protocol robot.txt communicate with the crawler and escape the links that not follow.