What Search Engine Spiders See
Posted June 15, 2006 at 9:57 AM
I was just posting a Search Engine Optimization question on the House of Fusion CF-Talk list when Nick Tong posted a link to "What Search Engine Spiders See". This page blows my mind. It allows you to enter in a url and get a report back regarding the page content based on how the search engine web spiders/crawlers see your content. It is fantastic for seeing exactly what your page has and perhaps more importantly, what your page is lacking in terms of headers, alt tags, and general content.
Nick posted this saying that he originally got it off of AndyJarret.co.uk.
Link: http://www.dlperry.com/what_search_engine_spiders_see.html
Comments (4) | Post Comment | Ask Ben | Permalink | Print Page
Browser Mouse Gestures FireFox Extension/Plugin
Why NULL Values Should Not Be Used in a Database Unless Required
Reader Comments
Great tool. I always use crawler simulation tools from seochat. This one looks much better and detailed.
Thanks for sharing
Posted by Wong Seoul on Jul 21, 2007 at 10:35 PM
There is one thing which developers forgot about; Comments. I just checked one of my sites which has few comments (HTML tags of course) and it didn't remove the content within comments. Google doesn't consider comments for indexing.
In this sense, comments may contain links, words, whatever... So the tool may give you invalid output in some cases.
Posted by Jan on Sep 6, 2007 at 3:06 AM
Nice tool ...
Check this out too ...
http://www.ranks.nl/tools/spider.html
Posted by Edward Beckett on May 6, 2008 at 10:48 AM
@Edward,
Looks interesting. My pages are too big to use with the free version :)
Posted by Ben Nadel on May 6, 2008 at 1:01 PM
