Resolving The Feed Too Large Error


Filed under Blogging Insights

Just now I reviewed my web crawl errors using Google Webmaster Tools and found two pages were having problems crawled. I took a look at the details and found the URLs were restricted by my robots.txt file. The URLs were “http://www.homebiz.bukiki.com/feed-error-trouble-problem-too-large/” and “http://www.homebiz.bukiki.com/pagerank-update-homebiz-resource-rakes-4-from-na/”. I looked into my robots.txt file and I remembered preventing the indexing [...]