How do I tell Google to recognize the mobile-version and full-version of the web?
What http signatures are encountered by Google's web-crawling robots?
What is the best technique for SEO-friendly forwarding multiple domains to one web server?
How do I block web scraping without blocking well-behaved bots?