Block AI Crawlers v1.6.2
Adds robots.txt rules blocking AI crawlers and AI bots.
Tags / crawlers
33 WordPress plugins tagged “crawlers”. Every result links to a crawlable PlugIndex profile.
Adds robots.txt rules blocking AI crawlers and AI bots.
Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.
Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
The easiest way to manage meta robots tag.
Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
Serve Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
Serve AI the good version of your content, see which bots really read it, and cap what they cost you. Markdown for crawlers and agents — 95%+ less ban …
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
See which search engines, AI crawlers and other bots visit your site, and what they find. The official plugin for log-hero.com.
Stream front-end request logs from your WordPress origin to Temso so AI-crawler and bot traffic shows up in your dashboard.
Add some directives to your robots.txt file to keep your site safer
Serve your content as clean Markdown to AI agents, publish llms.txt and llms-full.txt, and see which agents actually fetch what.
Reports every AI crawler and bot request on your site to OtterlyAI Agent Analytics. Runs server-side, in the background.
Monitor 135+ known AI crawlers and agents with local analytics, AI referrals, llms.txt, and opt-in robots.txt policy tools.
Give ChatGPT, Claude and other AI crawlers a clean Markdown copy of your posts, pages and products. Nothing changes for your visitors.
Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
See which AI crawlers (GPTBot, ClaudeBot, Perplexity and more) reach your site, and the visitors AI sends you. Verified, and free.
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
See which AI assistants send visitors to your site, and which AI crawlers read it, in your Arbling dashboard.
With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.
Serves every published post and page as Markdown for AI agents and crawlers. No configuration, no API keys. Activate and it works.
Protects the site from external AI attacks by blocking inference providers and selected crawlers.
See every bot that reaches WordPress — search crawlers, AI agents, scrapers, impostors — classified and identity-verified, in one dashboard.