User-agent: Exabot Disallow: / User-agent: audioCrawlerBot Disallow: / User-agent: Gigabot Disallow: / User-agent: Accoona-AI-Agent Disallow: / User-agent: Amfibibot Disallow: / User-agent: appie Disallow: / User-agent: Argus Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: BDFetch Disallow: / User-agent: Blogpulse Disallow: / User-agent: bot Disallow: / User-agent: cfetch Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: DataSpearSpiderBot Disallow: / User-agent: Deepindex Disallow: / User-agent: DoCoMo Disallow: / User-agent: envolk[ITS]spider Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: Gaisbot Disallow: / User-agent: gonzo1[D] Disallow: / User-agent: ia_archiver Disallow: / User-agent: ichiro Disallow: / User-agent: IconSurf Disallow: / User-agent: Ipselonbot Disallow: / User-agent: Jakarta Disallow: / User-agent: Jyxobot Disallow: / User-agent: larbin_2.6.3 Disallow: / User-agent: LinkWalker Disallow: / User-agent: MJ12bot Disallow: / User-agent: NaverBot-1.0 Disallow: / User-agent: NG Disallow: / User-agent: NuSearch Disallow: / User-agent: NutchCVS Disallow: / User-agent: oBot Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: PigeonBot1.0 Disallow: / User-agent: Pingo Disallow: / User-agent: PlantyNet_WebRobot_V1.9 Disallow: / User-agent: Pompos Disallow: / User-agent: PrivacyFinder Disallow: / User-agent: psbot Disallow: / User-agent: RSS_READER Disallow: / User-agent: RufusBot Disallow: / User-agent: SBIder Disallow: / User-agent: Sensis Disallow: / User-agent: sohu-search Disallow: / User-agent: SurveyBot Disallow: / User-agent: tbrbot Disallow: / User-agent: Teoma Disallow: / User-agent: TheSuBot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: VSE Disallow: / User-agent: * Crawl-delay: 5 Disallow: /images/ Disallow: /bannerads/ Disallow: 404error.cgi Disallow: 500error.cgi