# # http://www.vincentarsene.net # User-agent: * Disallow: Crawl-delay: 10 User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: Nutch Disallow: / User-agent: FindLinks Disallow: / User-Agent: OmniExplorer_Bot Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: SurveyBot Disallow: / User-agent: NPBot Disallow: / User-agent: Teoma Disallow: / User-agent: ichiro Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-Agent: MJ12bot Disallow: / User-Agent: Singingfish Disallow: / User-Agent: ZyBorg Disallow: /