# General directives for all crawlers User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /trackback/ Disallow: */trackback/ Disallow: */feed/ Disallow: /wp-admin/remote Allow: / # Block Baidu bots User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Baiduspider-video Disallow: / # Block magpie crawler User-agent: magpie-crawler Disallow: / Disallow: *?replytocom User-agent: * Disallow: *?noamp=available Disallow: *?amp Disallow: /20*/ # Blocks all year/month archive pages like /2025/04/