CeeWP Robots.txt Manager v1.0.2
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
Tags / robots-txt
98 WordPress plugins tagged “robots.txt”. Every result links to a crawlable PlugIndex profile.
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
See what search engines and AI crawlers find on your site: titles, meta, H1, schema, sitemap, GPTBot access and llms.txt. No account needed.
Block 30+ AI crawlers in your robots.txt, including GPTBot, ClaudeBot and CCBot, and choose exactly which bots get in.
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
Blocks some Feed and Comment resources in order to avoid spam bots
Connect Claude to your site. See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot) read your pages. Free, runs next to your SEO plugin.
Generates llms.txt, llms-full.txt, JSON-LD and robots.txt discovery files for AI agents and search crawlers, without promising ranking gains.
Stop AI companies scraping your posts to train their chatbots. Block AI crawlers, state your terms, and switch off the AI inside WordPress.
ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
Add some directives to your robots.txt file to keep your site safer
Generate llms.txt, manage robots.txt, control AI crawlers and audit your WordPress site's technical readiness for GEO and AI visibility.
Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
Scan your WordPress site for SEO issues and get actionable fixes. Includes AI Helper, sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analy …
See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.
Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
Control GPTBot, ClaudeBot and PerplexityBot in robots.txt, get alerts when AI search gets blocked, audit posts for AI answers, and manage llms.txt.
Protect your rights by reviewing and blocking AI bots from using your content without compensation.
See how AI assistants and search engines read your site: live checks as you write, titles and descriptions, crawler tools and AI visibility audits.