#txt

How to block a certain type of url in robots.txt or .htaccess?

How do I disallow specific pages in robots.txt, but allow everything else?

by naomi_cronin , in category: SEO , a year ago
3 answers last reply 3 months ago from jose_gulgowski

How to hide robots.txt in search engine results?

Member

by vinnie , in category: SEO , a year ago
3 answers last reply 3 months ago from cameron_walter

How to hide robot.txt from visitors?

Member

by maci , in category: SEO , 5 months ago
1 answer last reply 4 months ago from jacey.lubowitz

How to add a sitemap in Robots.txt?

Member

by delpha , in category: SEO , 5 months ago
1 answer last reply 5 months ago from stephon

How to define robots.txt for angular.js application?

Member

by mike , in category: SEO , 5 months ago
1 answer last reply 5 months ago from julio

How fixed blocked by robots.txt in wordpress?

by declan_ritchie , in category: SEO , 5 months ago
1 answer last reply 5 months ago from jacey.lubowitz

How to disallow part of a string in robots.txt for wordpress?

Member

by arlo , in category: SEO , 5 months ago
1 answer last reply 5 months ago from maci

How to add robots.txt in kohana?

by cameron_walter , in category: SEO , 5 months ago
1 answer last reply 5 months ago from dorothea

How to configure robots.txt to allow everything?

Member

by virginie , in category: SEO , 5 months ago
1 answer last reply 5 months ago from vinnie

Where to put robots.txt in tomcat 7?