প্লাগিন ট্যাগ: robots.txt
-
VDL Search Visibility Scanner – Noindex, Sitemap & SEO Audit
(0 total ratings)Check whether WordPress pages are technically discoverable with noindex, robots.txt, canonical, sitemap, redirect, and status-code checks.
-
AWP Disallow Root Control
(4 total ratings)Disallow access to the root directory via robots.txt with an option to enable or disable.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
(0 total ratings)Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
AI Rights Protection by SimpleFeed
(1 total ratings)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
GoBookMart Robots Editor
(1 total ratings)A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots
(1 total ratings)Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.
-
Advanced SEO Toolkit
(0 total ratings)Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
-
Block old browser versions and suspicious browsers
(0 total ratings)With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.
-
Check System Details
(0 total ratings)Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.
-
AITooler Bot Analytics – AI Crawler Tracking & Visibility
(0 total ratings)See which AI crawlers visit your site, serve llms.txt automatically, and manage AI bot access. Everything stays in your own database.
-
AI Crawlers Visibility, Analytics & Control
(0 total ratings)AI crawlers monitoring for WordPress — track GPTBot, ClaudeBot, and 68+ bots with analytics, robots.txt rules, PHP blocking, and visibility scoring.
-
LLMs.txt – AI Website Content Crawling
(0 total ratings)Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.
-
Markaevi AI Crawler Control
(0 total ratings)Establish full control over LLM crawlers and optimize your website framework for conversational AI engines.
-
Zulkaif Seo File Manager
(2 total ratings)Generate and control sitemaps, robots.txt, ads.txt, and other essential SEO files with full transparency and no silent automation.
-
Laudia Connect
(0 total ratings)A narrow, auditable connection that lets Laudia publish only the AI-visibility fixes you approve. Nothing else.
-
CiteBoost GEO
(0 total ratings)Optimize your WordPress site for AI search engines like ChatGPT, Claude, Gemini, and Perplexity.
-
Valvai – AI Traffic Control Center
(0 total ratings)Block, log and monetise AI crawlers directly from your WordPress dashboard.