Tag Plugin: robots.txt
-
Block eCommerce Assets via robots.txt
(0 total rating)Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Check Search Engine Visibility on Migration
(1 total rating)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Unblock CSS & JS for Googlebot
(0 total rating)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 total rating)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AI Deny
(1 total rating)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
Block Common Crawl via robots.txt
(0 total rating)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 total rating)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Block Feed and Comments via robots.txt
(0 total rating)Blocks some Feed and Comment resources in order to avoid spam bots
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 total rating)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
ProAI TXT Manager for LLMS and Robots
(1 total rating)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
ChatBot Blocker by CellarWeb
(0 total rating)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
LJPL Armored robots.txt
(0 total rating)Add some directives to your robots.txt file to keep your site safer
-
Thin Content Manager
(1 total rating)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 total rating)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
HumanGate
(0 total rating)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
A3 Robots Warning
(0 total rating)Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.
-
SEO Auditor Tools
(0 total rating)Scan your WordPress site for SEO issues and get actionable fixes. Includes sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analytics, UTM b …
-
Forge AI Bot Log – Block AI Bots, Crawler Detection & Verification
(0 total rating)Detect, verify and block AI crawlers, bots and scrapers. Reverse-DNS checks flag spoofed user agents instead of trusting them.
-
Kandeshop LLMS.txt Generator
(0 total rating)Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.
-
Virtual LLMS.TXT Generator
(0 total rating)Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.