# Robots.txt file # For domain: http://www.musician-center.com/ # All robots will spider the domain User-agent: * Disallow: User-agent: Zao Disallow: / User-agent: Openbot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: grub-client-2.3 Disallow: / User-agent: WebarooBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: GigaBot Disallow: / User-agent: BaiDuSpider Disallow: / User-agent: Walhello Disallow: / User-agent: psBot Disallow: / User-agent: BSpider Disallow: / User-agent: SurveyBot Disallow: / User-agent: Speedy Spider Disallow: /