Plugin Tag: robots.txt
-
-
Check Search Engine Visibility on Migration
(1 total ratings)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
AI Deny
(1 total ratings)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Unblock CSS & JS for Googlebot
(0 total ratings)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 total ratings)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Block Common Crawl via robots.txt
(0 total ratings)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Block Feed and Comments via robots.txt
(0 total ratings)Blocks some Feed and Comment resources in order to avoid spam bots
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 total ratings)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
ChatBot Blocker by CellarWeb
(0 total ratings)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
LJPL Armored robots.txt
(0 total ratings)Add some directives to your robots.txt file to keep your site safer
-
ProAI TXT Manager for LLMS and Robots
(1 total ratings)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 total ratings)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
HumanGate
(0 total ratings)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
Thin Content Manager
(1 total ratings)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 total ratings)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
Virtual LLMS.TXT Generator
(0 total ratings)Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.
-
AWP Disallow Root Control
(4 total ratings)Disallow access to the root directory via robots.txt with an option to enable or disable.
-
VDL Search Visibility Scanner – Noindex, Sitemap & SEO Audit
(0 total ratings)Check whether WordPress pages are technically discoverable with noindex, robots.txt, canonical, sitemap, redirect, and status-code checks.
-
AI Rights Protection by SimpleFeed
(1 total ratings)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
GoBookMart Robots Editor
(1 total ratings)A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.