WordPress.org

بلوچی

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Email Address Encoder

    (159 total ratings)

    A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

    Till Krüss 100,000+ active installations Tested with 6.7.2

  • Robots.txt Editor

    (8 total ratings)

    Robots.txt for WordPress

    Processby 10,000+ active installations Tested with 5.6.14

  • WordPress Robots.txt optimizer (+ XML Sitemap) – Boost SEO, Traffic & Rankings

    (102 total ratings)

    All-in-One SEO plugin for Wordpress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, …), Woocommerce booster, Robots.

    Pagup 8,000+ active installations Tested with 6.7.2

  • Spider Analyser – WordPress搜索引擎蜘蛛分析插件

    (1 total ratings)

    Spider Analyser是一款用于跟踪WordPress网站各种搜索引擎蜘蛛爬行日志的插件，并进行详细的蜘蛛爬行数据统计、蜘蛛行为分析、蜘蛛爬取分析及伪蜘蛛拦截等。

    wbolt.com 5,000+ active installations Tested with 6.8

  • Robots.txt rewrite

    (2 total ratings)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1,000+ active installations Tested with 4.7.29

  • Advanced Robots.txt Optimizer & Editor

    (0 total ratings)

    The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management by allowing use …

    aleemiqbal 900+ active installations Tested with 6.7.2

  • Marquee image crawler

    (1 total ratings)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    gopiplus 900+ active installations Tested with 6.1.7

  • Crawl Optimization

    (2 total ratings)

    The Crawl Optimization Plugin is designed to help optimize your website’s crawl rate by removing unnecessary links and information from your HTTP head …

    aleemiqbal 900+ active installations Tested with 6.7.2

  • WordPress Meta Keywords

    (1 total ratings)

    This plugin gives you the ability to set Meta Keywords in WordPress. Under pages it will registrate a separate taxonomy for keywords.

    Philipp Speck 900+ active installations Tested with 3.5.2

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (1 total ratings)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 800+ active installations Tested with 6.7.2

  • WordPress Meta Description

    (3 total ratings)

    With this plugin you can control the text which will be shown as description on the search engine results pages.

    Philipp Speck 800+ active installations Tested with 3.9.40

  • Block Archive.org via WordPress robots.txt

    (0 total ratings)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 500+ active installations Tested with 6.7.2

  • DB Robots.txt

    (3 total ratings)

    DB Robots.txt is an easy-to-use plugin for generating and configuring the file robots.txt that is essential for SEO (search engine optimization).

    Denis Bisteinov 400+ active installations Tested with 6.7.2

  • Stop and Block bots plugin Anti bots

    (1 total ratings)

    Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and avoid server overload and bandwidth.

    Bill Minozzi 300+ active installations Tested with 6.8

  • Block Chat GPT via robots.txt

    (1 total ratings)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    apasionados 100+ active installations Tested with 6.3.5

  • bodi0`s Bots visits counter

    (5 total ratings)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ active installations Tested with 6.1.7

  • Block eCommerce Assets via robots.txt

    (0 total ratings)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ active installations Tested with 6.3.5

  • Findkit – Site Search

    (0 total ratings)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 40+ active installations Tested with 6.7.2

  • Hide Email Address

    (1 total ratings)

    Protect email address from being collected by web crawlers.

    buntegiraffe 30+ active installations Tested with 4.9.26

  • Block Common Crawl via robots.txt

    (0 total ratings)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ active installations Tested with 6.3.5