Most web robots, including those used by search engines to seek out new content for inclusion in their directories will obey both a web server's robots.txt file as well as the 'robots' meta tag that may be present in individual pages.
If a website, or portions of that website cannot appear to be submitted successfully to search engines it is possible that the search engine is not accepting that website due to it being marked as non-retrievable in either the robots.txt file or in individual files through the use of the 'robots' meta tag.
This report lists any pages that may not be retrievable due to either robots.txt or 'robots' meta tag restrictions.
The robots.txt file for http://authors.aspalliance.com/brettb/default.asp (http://authors.aspalliance.com//robots.txt) is shown below. For further information about the contents of this file, see the Robots Exclusion Standard specification described at http://www.robotstxt.org/wc/norobots.html.
No pages were restricted by the robots.txt file.
No pages contain a value of 'NoIndex' for the 'Robots' meta tag.
No pages contain a value of 'NoFollow' for the 'Robots' meta tag.
Report generated by The Website Utility 2.8