User-agent: * Disallow: /wp-admin/ User-agent: PetalBot Disallow: / User-agent: dotbot Disallow: / User-agent: dotbot/1.0 Disallow: / User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: AhrefsBot Disallow: /