User-agent: * allow: User-agent: Rogerbot User-agent: Exabot User-agent: Dotbot User-agent: Gigabot User-agent: AhrefsBot User-agent: SemrushBot User-agent: SemrushBot-SA User-agent: Baiduspider User-agent: EasouSpider User-agent: Ezooms User-agent: YandexBot User-agent: MJ12bot User-agent: SiteSucker User-agent: HTTrack Disallow: /