What is the purpose of robot.txt to be put in the root directory?

by talon_jacobson , in category: Local SEO , 3 months ago

What is the purpose of robot.txt to be put in the root directory?

Facebook Twitter LinkedIn Telegram Whatsapp Pocket

1 answer

Member

by cielo , 3 months ago

It is exclusion protocol robot.txt communicate with the crawler and escape the links that not follow.