Stop Web Crawlers has been developed to block referrer spam attacks on your WordPress website.
Stop Web Crawlers will reduce the likelihood that your site will be crawled by the Referrer spammers like;
> semalt.com , Darodar.com, buttons-for-website, ilovevitaly.co, screentoolkit.com, myftpupload.com, > best-seo-offer.com, Get-Free-Traffic-Now.com, best-seo-solution.com, 4webmasters.org, luxup.ru, > blackhatworth.com, 7makemoneyonline.com, priceg.com, prodvigator.ua, resellerclub.com, savetubevideo.com, > kambasoft.com, socialseet.ru, superiends.org, vodkoved.ru, o-o-8-o-o.ru, iskalko.ru, websocial.me, > ykecwqlixx.ru, slftsdybbg.ru, seoexperimenty.ru, darodar.com, econom.co, edakgfvwql.ru, adcash.com, > adviceforum.info, hulfingtonpost.com, europages.com.ru, gobongo.info, cenoval.ru, cityadspix.com >
In total Stop Web Crawlers protects your site from 1439 known referrer spammers.
If these Crawlers attempt to crawl your website they sent 403 access prohibited error response
The additional functionality planned for this plugin for the future is also to remove Ghost Referrer spammers from accessing your Google Analytics.
There is no need to edit your .htaccess or mess around with robots.txt, all is required is too install the plugin and activate the plugin.
The plugin is currently designed to run unattended and automatically.
There is a settings section, but this is currently only a placeholder for future functionality, which will be activated in future releases of the plugin.
Other bots will be added to the block list over time via updates to this plugin.
- Upload the
stop-web-crawlersfolder to the
- Activate the Stop Web Crawlers plugin through the ‘Plugins’ menu in WordPress
- Configure the plugin by going to the
Stop Web Crawlersmenu that appears in your admin menu
Contributors & Developers
“Stop Web Crawlers” is open source software. The following people have contributed to this plugin.Contributors
Database schema improvements Database upgrade feature Dashboard UI enhancements Crawler Logging feature Enhanced Activation Improved Uninstall Improved crawler list updates
Added submit a feature email Responsive Image in Sidebar Algorithm improvements to Bot detection Updated product description url added version number checker added access to settings on plugin settings
Removed duplicate menu label in admin menu Fixed error to relative paths in views Added Twitter follow icon on dashboard
Improved Dashboard page Added Admin CSS styles Tidied up List Table columns
Code clean up removing deprecated classes
Major refactor of the code base
Fixed Urgent bug caused by deprecated call
Typo fixed in readme file Fixed error in which we were inadvertently linking to a spmmer in readme updated dashboard
Updated the database to include over 1100 known referer spam bots Improve blocking Updated Dashboard Text Tested against WordPress beta 4.7
Added Logo to Admin Dashboard Menu Add New Web Crawler functionality implemented Dashboard View Revamp Additional Refactoring to improve long term support
Updated license header Improved refactoring Added minimum WordPress version check
Added functionality for filter not run for logged in users or admin users
Updated readme text
Fix upgrade bug and patched HTML formatting
Bug fix from a source control merge issue