Email Address Encoder v1.0.25
A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.
Tags / crawler
crawler
68 WordPress plugins tagged “crawler”. Every result links to a crawlable PlugIndex profile.
Robots.txt Editor v1.1.4
Robots.txt for WordPress
No-Bot Registration v2.5.1
Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.
Robots.txt rewrite v1.6.1
Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
Marquee image crawler v1.3
Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
Bisteinoff SEO Robots.txt v4.0.3
An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).
Block Archive.org via WordPress robots.txt v1.3.0
Blocks the archive.org bots through the WordPress virtual robots.txt file.
Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, … v1.1.5
Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …
Block Chat GPT via robots.txt v2.0.0
Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file
Block eCommerce Assets via robots.txt v1.2.0
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
bodi0`s Bots visits counter v0.9.0
Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.
Findkit – Site Search v1.7.2
Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.
Warmer – Cache Warmer and Cache Preload Crawler v3.0.2
Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.
Crawl Hunt – Advanced SEO Optimization Tool v1.0.11
A powerful website crawler and monitoring tool for WordPress.
HS3Dev AI Content Index for llms.txt v1.0.1
Generate llms.txt and llms-full.txt with full control over content, SEO integration, multilingual support, and AI crawler analytics.
Azayem Bots Tracker – Bot Visits Logger v1.0.0
A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).
Berq Markdown: Markdown Pages for AI & LLM Crawlers v1.3.2
Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …
Block Common Crawl via robots.txt v1.0.0
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
Block Feed and Comments via robots.txt v1.2.0
Blocks some Feed and Comment resources in order to avoid spam bots
Boring Cache Warmup Lite v0.4.8
A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.
GlobeSign Content Markdown Mirror v1.0.3
Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.
GoBookMart Robots Editor v1.0.2
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
GoVISIBLE AI Bot Tracker v1.0.9
Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.
JaspreetChahal’s wordpress bot detector lite v1.0
This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …