Robots.txt для WordPress

All-in-One SEO plugin for Wordpress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, ...), Woocommerce booster, Robots.

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Encodes mailto: links and e-mail addresses with JavaScript to stifle webcrawlers. Automatically turns plaintext e-mails into (enkoded) links.

Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

This plugin gives you the ability to set Meta Keywords in WordPress. Under pages it will registrate a separate taxonomy for keywords.

With this plugin you can control the text which will be shown as description on the search engine results pages.

The Crawl Optimization Plugin is designed to help optimize your website’s crawl rate by removing unnecessary links and information from your HTTP head …

Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management by allowing use …

Blocks the archive.org bots through the WordPress virtual robots.txt file.

DB Robots.txt - это простой в использовании плагин для создания и настройки файла robots.txt, который необходим для SEO (поисковой оптимизации).

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

Blocks some Feed and Comment resources in order to avoid spam bots

Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and avoid server overload and bandwidth.

Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

Protect email address from being collected by web crawlers.