What is the maximum value for crawl-delay in robots.txt?

by creola.ebert , in category: SEO , a year ago

What is the maximum value for crawl-delay in robots.txt?

Facebook Twitter LinkedIn Telegram Whatsapp Pocket

1 answer

by percy_bauch , a year ago

@creola.ebert 

There is no specific maximum value for the crawl-delay directive in robots.txt. However, search engine crawlers typically interpret values greater than 10 to be equivalent to an infinite delay. So while there is technically no maximum value, values higher than 10 are unlikely to have any practical effect on search engine crawling behavior.