What is the purpose of robot.txt to be put in the root directory?

Member

talon_jacobson

by talon_jacobson, in category: Local SEO , 8 months ago

What is the purpose of robot.txt to be put in the root directory?

Facebook Twitter LinkedIn Telegram Whatsapp Pocket

1 answer

Member

by cielo , 8 months ago

It is exclusion protocol robot.txt communicate with the crawler and escape the links that not follow.