پلگ ان ٹیگ: crawler
-
Email Address Encoder
(کلیں درجہ بندی 160 )A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.
-
-
No-Bot Registration
(کلیں درجہ بندی 28 )Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.
-
Robots.txt rewrite
(کلیں درجہ بندی 2 )Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
Marquee image crawler
(کلیں درجہ بندی 1 )Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
-
Block Archive.org via WordPress robots.txt
(کلیں درجہ بندی 0 )Blocks the archive.org bots through the WordPress virtual robots.txt file.
-
Bisteinoff SEO Robots.txt
(کلیں درجہ بندی 4 )An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).
-
Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …
(کلیں درجہ بندی 4 )Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …
-
Promium AI GEO
(کلیں درجہ بندی 1 )Write a dedicated version of any post or page for AI crawlers such as GPTBot, ClaudeBot and PerplexityBot, and choose which bots may read it.
-
Block eCommerce Assets via robots.txt
(کلیں درجہ بندی 0 )Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
bodi0`s Bots visits counter
(کلیں درجہ بندی 5 )Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.
-
Block Chat GPT via robots.txt
(کلیں درجہ بندی 1 )Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file
-
Warmer – Cache Warmer and Cache Preload Crawler
(کلیں درجہ بندی 8 )Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.
-
HS3Dev AI Content Index for llms.txt
(کلیں درجہ بندی 1 )Generate llms.txt and llms-full.txt with full control over content, SEO integration, multilingual support, and AI crawler analytics.
-
Findkit – Site Search
(کلیں درجہ بندی 0 )Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.
-
Crawl Hunt – Advanced SEO Optimization Tool
(کلیں درجہ بندی 1 )AI-powered SEO audits and fixes for WordPress. Find SEO issues, fix them faster, and optimize your site for search engines and AI search.
-
Berq Markdown: Markdown Pages for AI & LLM Crawlers
(کلیں درجہ بندی 0 )Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …
-
Azayem Bots Tracker – Bot Visits Logger
(کلیں درجہ بندی 0 )A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).
-
Block Feed and Comments via robots.txt
(کلیں درجہ بندی 0 )Blocks some Feed and Comment resources in order to avoid spam bots
-
Block Common Crawl via robots.txt
(کلیں درجہ بندی 0 )Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file