برچسب افزونه: robots.txt
-
Block eCommerce Assets via robots.txt
(0 مجموع امتیازها)Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Block Chat GPT via robots.txt
(1 مجموع امتیازها)Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file
-
Check Search Engine Visibility on Migration
(1 مجموع امتیازها)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Unblock CSS & JS for Googlebot
(0 مجموع امتیازها)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 مجموع امتیازها)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
AI Deny
(1 مجموع امتیازها)Block 30+ AI crawlers in your robots.txt, including GPTBot, ClaudeBot and CCBot, and choose exactly which bots get in.
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 مجموع امتیازها)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Mephivio Robots LLMs
(1 مجموع امتیازها)Generates llms.txt, llms-full.txt, JSON-LD and robots.txt discovery files for AI agents and search crawlers, without promising ranking gains.
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 مجموع امتیازها)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
SEO & AI Readiness Check
(1 مجموع امتیازها)See what search engines and AI crawlers find on your site: titles, meta, H1, schema, sitemap, GPTBot access and llms.txt. No account needed.
-
AI Blackout – Block AI Crawlers & Stop AI Training
(0 مجموع امتیازها)Stop AI companies scraping your posts to train their chatbots. Block AI crawlers, state your terms, and switch off the AI inside WordPress.
-
Block Feed and Comments via robots.txt
(0 مجموع امتیازها)Blocks some Feed and Comment resources in order to avoid spam bots
-
Block Common Crawl via robots.txt
(0 مجموع امتیازها)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
All-IN Crawler & AI Agent Manager – Block AI Bots, Bad Bots & Rate-Limit Crawlers
(0 مجموع امتیازها)Block AI crawlers and bad bots, rate-limit scrapers, manage robots.txt and llms.txt, and stay visible in Google, Bing and AI search answers.
-
Hack The SEO – MCP Server for Claude, AI Bot Tracker, llms.txt, GEO Score & Cannibalization
(2 مجموع امتیازها)Connect Claude to your site. See which AI crawlers (GPTBot, ClaudeBot, PerplexityBot) read your pages. Free, runs next to your SEO plugin.
-
SEO Auditor Tools
(0 مجموع امتیازها)Scan your WordPress site for SEO issues and get actionable fixes. Includes AI Helper, sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analy …
-
HumanGate
(0 مجموع امتیازها)Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
-
LJPL Armored robots.txt
(0 مجموع امتیازها)Add some directives to your robots.txt file to keep your site safer
-
ProAI TXT Manager for LLMS and Robots
(1 مجموع امتیازها)Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
ChatBot Blocker by CellarWeb
(0 مجموع امتیازها)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.