WordPress.org

Indonesia

Gunakan WordPress
WordPress.org

Plugin Directory

Tag Plugin: crawler

Tag Plugin: crawler

  • Email Address Encoder

    (156 total rating)

    A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

    Till Krüss 100,000+ instalasi aktif Teruji dengan 6.6.2

  • Robots.txt Editor

    (8 total rating)

    Robots.txt for WordPress

    Processby 10,000+ instalasi aktif Teruji dengan 5.6.14

  • WordPress Robots.txt optimizer (+ XML Sitemap) – Boost SEO, Traffic & Rankings

    (102 total rating)

    All-in-One SEO plugin for Wordpress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, …), Woocommerce booster, Robots.

    Pagup 8,000+ instalasi aktif Teruji dengan 6.6.2

  • Robots.txt rewrite

    (2 total rating)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 2,000+ instalasi aktif Teruji dengan 4.7.29

  • WordPress Meta Keywords

    (1 total rating)

    This plugin gives you the ability to set Meta Keywords in WordPress. Under pages it will registrate a separate taxonomy for keywords.

    Typomedia Foundation 1,000+ instalasi aktif Teruji dengan 3.5.2

  • Marquee image crawler

    (1 total rating)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    Gopi Ramasamy 1,000+ instalasi aktif Teruji dengan 6.1.7

  • Crawl Optimization

    (0 total rating)

    The Crawl Optimization Plugin is designed to help optimize your website’s crawl rate by removing unnecessary links and information from your HTTP head …

    Big Techies 800+ instalasi aktif Teruji dengan 6.1.7

  • WordPress Meta Description

    (3 total rating)

    With this plugin you can control the text which will be shown as description on the search engine results pages.

    Typomedia Foundation 800+ instalasi aktif Teruji dengan 3.9.40

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (1 total rating)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 700+ instalasi aktif Teruji dengan 6.6.2

  • Advanced Robots.txt Optimizer & Editor

    (0 total rating)

    The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management by allowing use …

    Big Techies 600+ instalasi aktif Teruji dengan 6.4.5

  • Block Archive.org via WordPress robots.txt

    (0 total rating)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    Apasionados, Apasionados del Marketing 600+ instalasi aktif Teruji dengan 6.3.5

  • DB Robots.txt

    (3 total rating)

    DB Robots.txt is an easy-to-use plugin for generating and configuring the file robots.txt that is essential for SEO (search engine optimization).

    Denis Bisteinov 300+ instalasi aktif Teruji dengan 6.6.2

  • Block Chat GPT via robots.txt

    (1 total rating)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    Apasionados, Apasionados del Marketing 200+ instalasi aktif Teruji dengan 6.3.5

  • Stop and Block bots plugin Anti bots

    (0 total rating)

    Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and avoid server overload and bandwidth.

    Bill Minozzi 100+ instalasi aktif Teruji dengan 6.6.2

  • bodi0`s Bots visits counter

    (5 total rating)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ instalasi aktif Teruji dengan 6.1.7

  • Block eCommerce Assets via robots.txt

    (0 total rating)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    Apasionados, Apasionados del Marketing 100+ instalasi aktif Teruji dengan 6.3.5

  • Block Feed and Comments via robots.txt

    (0 total rating)

    Blocks some Feed and Comment resources in order to avoid spam bots

    Apasionados, Apasionados del Marketing 80+ instalasi aktif Teruji dengan 6.3.5

  • Findkit – Site Search

    (0 total rating)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 40+ instalasi aktif Teruji dengan 6.4.5

  • Hide Email Address

    (1 total rating)

    Protect email address from being collected by web crawlers.

    Bunte Giraffe 40+ instalasi aktif Teruji dengan 4.9.26

  • Block Common Crawl via robots.txt

    (0 total rating)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    Apasionados, Apasionados del Marketing 30+ instalasi aktif Teruji dengan 6.3.5