#txt

How to block a certain type of url in robots.txt or .htaccess?

How do I disallow specific pages in robots.txt, but allow everything else?

by naomi_cronin , in category: SEO , 2 years ago
3 answers last reply a year ago from jose_gulgowski

How to hide robots.txt in search engine results?

Member

by vinnie , in category: SEO , 2 years ago
3 answers last reply a year ago from cameron_walter

How to hide robot.txt from visitors?

Member

by maci , in category: SEO , a year ago
1 answer last reply a year ago from jacey.lubowitz

How to add a sitemap in Robots.txt?

Member

by delpha , in category: SEO , a year ago
1 answer last reply a year ago from stephon

How to define robots.txt for angular.js application?

Member

by mike , in category: SEO , a year ago
1 answer last reply a year ago from julio

How fixed blocked by robots.txt in wordpress?

How to disallow part of a string in robots.txt for wordpress?

Member

by arlo , in category: SEO , a year ago
1 answer last reply a year ago from maci

How to add robots.txt in kohana?

by cameron_walter , in category: SEO , a year ago
1 answer last reply a year ago from dorothea

How to configure robots.txt to allow everything?

Member

by virginie , in category: SEO , a year ago
1 answer last reply a year ago from vinnie

Where to put robots.txt in tomcat 7?