# robots.txt for http://www.mechtrading.com/ # too many repeated hits, too quick User-agent: litefinder Disallow: / # Yahoo. too many repeated hits, too quick # User-agent: Slurp # Disallow: / # too many repeated hits, too quick User-agent: Baidu Disallow: / User-agent: Yandex Disallow: / User-agent: * Disallow: