- Site Template
- WordPress Theme
- Blogging Theme
- CMS Theme
- Marketing Template
- eCommerce Theme
- Forum Theme
- Flash Template
- PSD Web Template
- .NET Script
- PHP Script
- HTML5 Code
- CSS Style
- Edge Animate Template
- Muse Template
- TypeEngine Theme
- Static Site Generator
- Sketch Template
CodeCanyon Smart Robots.txt Tools 8516133
Plugin \ SEO
Robots \ Access \ Sitemap \ Agent \ User \ Deny \ Allow \ Engines \ Custom \ Rules
Plugin - Smart Robots.txt Tools 8516133 by GDragoN @ CodeCanyon
Plugin \ SEO
Smart Robots.txt Tools allows you to improve and customize ‘robots.txt’ file used by search engines and other types of bots when indexing your website. Through this file you can disallow access to some areas of the website for all or only some bots.
This plugin allows you to use improved basic rules in robots.txt file with few extra predefined rules, or you can create your own custom rules that can include any number of bots user agents and rules to allow or disallow access.
When plugin is installed, it will adopt WordPress search engine visibility settings, and if your website is set hidden from search engines (WordPress uses robots file for this), plugin will be set to Deny All. You can change robots content to anything through plugin settings, but as a convenience, WordPress settings are used on installation only.
Fully customized set of rules in robots.txt
Add rules for different bots / search engines or any custom user agent, allowing or disallowing access to parts of the website, setting the URL to one or more sitemaps and setting crawl delay value.
Predefined or custom content for robots.txt
See the status of robots.txt file, availablilty and enable override through this plugin. Specify use of predefined or custom rules, and add some extra set of rules targeting some common search engines.
Create robots.txt rules targeting any search engine or custom user agent
Add rules for any search engine bot from the list or by any user agent string. Add any number of allow/disallow rules, one or more sitemaps and custom crawl delay. Modify rules for all user agents.
Other Plugin Features Included
- Extra panel to reset plugin settings including all custom rules.
- Easy to use export and import for transferring settings from one website to another.
- Support for Multisite WordPress mode, each website can set plugin on it’s own.
- Support for translation and includes POT file.
System and WordPress Requirements
- PHP 5.2.4 or newer
- WordPress 3.5 or newer
Important about Robots.txt
Before you proceed, there is one very important limitation for this file. This limitation is a specification of the ‘robots.txt’ file and it is not related to this plugin. Robots file must be located in the root for a domain or subdomain, it can’t be used if the website is in subdirectory of the main domain or subdomain. So, if you have installed your WordPress website in subdirectory of main website domain, then you can’t use robots.txt for that WordPress installation. Search engines can load robots.txt only from root of the domain, nowhere else.
Plugin contains PDF user guide in the plugin package, inside the ‘docs’ directory. Check out this documentto get information on plugin options, usage and more.
Version 1.0 / 2014.08.07.
- First release
Smart Video Playlists; Smart Sidebars Slider; Smart Tab Drawer; Smart Audio Playlists; Smart AJAX Subscribe: Integration Addon; Simple Conversion Widgets; Smart Posts Tagger.
Keywords: Search engines, allow access, custom rules, deny access, optimization, robots, robots.txt, seo, sitemap, user agent.
Android, Builder, Business, Clean, Corporate, Creative, Design, Email, Fashion, Gallery, Image, Iphone, Jquery, Landing, Magazine, Magento, Marketing, Minimal, Mobile, Modern, Multi, Multipurpose, Online, Parallax, Personal, Photography, Plugin, Portfolio, Product, Responsive, Retina, Simple, Slider, Social, Store, Template, Theme, Video, Woocommerce, Wordpress
Show all tags
Show all tags
- ThemeForest Isamedic Template HTML 19470053
- ThemeForest The Landshaper Gardening Lawn & Landscaping WordPress Theme 18969806
- ThemeForest Pizzaro Fast Food & Restaurant HTML template 19434371
- ThemeForest Craftit WooCommerce Shopping Theme 19389758
- ThemeForest Photty Photo Gallery & Photoblog WordPress Theme 19459425
- ThemeForest Envas Multipurpose WordPress 19448771
- ThemeForest YourCoupon Coupon Code Discount Deal Responsive WordPress Theme 19236893
- ThemeForest Luka Modern Photography Portfolio 19468072
- ThemeForest Bridal Wedding WordPress Theme 19466763
- ThemeForest Finance Hawk Finance and Consulting Business WordPress Theme 19277605