Crawler Record v1.1.1
Crawler Record tells you the last time each of the most common search/LLM chatbots visited (Google, ChatGPT, etc) and the pages at which they looked.
Tags / robots
robots
61 WordPress plugins tagged “robots”. Every result links to a crawlable PlugIndex profile.
Robots Meta Whiz v1.2.0
Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
410 Delete Pages SEO v0.0.5
Force 410 HTTP Status on listed pages, or just articles/pages that no longer exist.
Noindex by Path v1.0
Ask search engines not to index individual pages by a relative path - which means you can set every url no matter it is a page, category listing or an …
TDMRep: TDM Reservation Protocol v1.0.2
TDM Reservation Protocol. Control how bots and artificial intelligences like ChatGPT, GoogleBot and Bard access your content.
Unblock CSS & JS for Googlebot v1.0
Modifies robots.txt to allow Googlebot access JS and CSS files.
CeeWP Robots.txt Manager v1.0.2
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
Block Common Crawl via robots.txt v1.0.0
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
Block Feed and Comments via robots.txt v1.2.0
Blocks some Feed and Comment resources in order to avoid spam bots
ChatBot Blocker by CellarWeb v2.02
ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
Robots “noindex,follow” meta tag v1.0
Add robots "noindex,follow" meta tags to archives, tag pages and category pages in order to preserve your SEO juju.
Robots.txt Extender v1.0.0
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
RRZE-Robots-Txt v1.3
Ermöglich die Bearbeitung des robots.txt Inhalts um weitere Direktiven hinzuzufügen. Multisite kompatibel.
Seo Crawlytics Data Export & Delete v1.0
Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
Thin Content Manager v1.0.1
See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
U&AI SEO Bridge v0.15.0
Writes SEO title, meta description, canonical, robots and JSON-LD into fields WordPress themes actually render, via a small REST namespace.
WP Robots Log v1.0.1
Log the Search Engine Robots Visits of your Webite. 取得搜索引擎的蜘蛛訪問網站的記錄
AI Readiness Advisor v1.5.6
Audit AI bot access: logs, verification table, robots.txt viewer, quick test, server snippets, and a public REST ping endpoint.
AI-Only Pages v1.3.4
Mark any page as AI-only. Hidden from search engines, optimized for AI crawlers, listed in /llms-index.txt. Includes Token Diet and global settings.
AutomateIndex v0.5.2
Connects WordPress to AutomateIndex for owner-approved AI visibility files and monitoring proof.
Bottoll – AI Crawler Control v1.1.5
Detect AI crawlers, apply access policies, and understand automated access to your WordPress content.
Clownsteins Rogue Agent Defender v1.0.0
Protects the site from external AI attacks by blocking inference providers and selected crawlers.
DY LLMs.txt Tool v6.4
Create and manage an llms.txt file for AI crawlers to improve AEO (Answer Engine Optimization) and provide an authoritative AI index for your site.
EffortLess Custom Meta Tags v1.0.26
Adds a meta description, Open Graph and X (Twitter) tags, Google structured data, robots preview settings, site verification codes and a Content-Secur …