How to ban crawler 360spider with robots.txt or .htaccess?

Member

by arlo , in category: SEO , a year ago

How to ban crawler 360spider with robots.txt or .htaccess?

Facebook Twitter LinkedIn Telegram Whatsapp Pocket

1 answer

by percy_bauch , a year ago

@arlo 

To ban the 360spider crawler using robots.txt, you can add the following lines to your robots.txt file:


User-Agent: 360Spider Disallow: /


This will instruct the 360spider crawler to not crawl any content on your website.


If you want to use .htaccess to block the 360spider crawler, you can add the following lines to your .htaccess file:


SetEnvIfNoCase User-Agent "^360Spider" bad_bot Deny from env=bad_bot


This will deny access to any user agent containing "360Spider" in the User-Agent header.


Remember to always backup your files before making any changes and test to ensure the blocking is working as expected.