#robots

Member

by hanna , in category: SEO , 11 days ago
1 answer last reply 10 days ago from alvera_smith

How to optimize my website's meta robots?

by creola.ebert , in category: SEO , 16 days ago
no answers

How to block robots without robots.txt?

How to make an exception for <meta name="robots" content="nofollow"> for several links?

by cameron_walter , in category: SEO , a month ago
1 answer last reply a month ago from hanna

How to stop robots from crawling pagination using robots.txt?

Member

by virginie , in category: SEO , 2 months ago
2 answers last reply 2 months ago from pietro

What http signatures are encountered by Google's web-crawling robots?