What Search Engine Spiders See

Posted June 15, 2006 at 9:57 AM

Tags: Search Engine Optimization

I was just posting a Search Engine Optimization question on the House of Fusion CF-Talk list when Nick Tong posted a link to "What Search Engine Spiders See". This page blows my mind. It allows you to enter in a url and get a report back regarding the page content based on how the search engine web spiders/crawlers see your content. It is fantastic for seeing exactly what your page has and perhaps more importantly, what your page is lacking in terms of headers, alt tags, and general content.

Nick posted this saying that he originally got it off of AndyJarret.co.uk.

Link: http://www.dlperry.com/what_search_engine_spiders_see.html

Post Comment  |  Ask Ben  |  Print Page




Reader Comments

Wong Seoul
Jul 21, 2007 at 10:35 PM // reply »
1 Comments
1 Points

Great tool. I always use crawler simulation tools from seochat. This one looks much better and detailed.

Thanks for sharing


Jan
Sep 6, 2007 at 3:06 AM // reply »
6 Comments
1 Points

There is one thing which developers forgot about; Comments. I just checked one of my sites which has few comments (HTML tags of course) and it didn't remove the content within comments. Google doesn't consider comments for indexing.

In this sense, comments may contain links, words, whatever... So the tool may give you invalid output in some cases.


Florida Search Engine Optimization
May 6, 2008 at 10:48 AM // reply »
9 Comments
1 Points

Nice tool ...

Check this out too ...

http://www.ranks.nl/tools/spider.html


Ben Nadel
May 6, 2008 at 1:01 PM // reply »
7,572 Comments
36,838 Points

@Edward,

Looks interesting. My pages are too big to use with the free version :)


ana gomez
May 30, 2008 at 9:49 AM // reply »
2 Comments
1 Points

I could not find that tool on that site. Do i have to regiter to use it?


Post Comment  |  Ask Ben

Recent Blog Comments
John Bliss
Mar 19, 2010 at 12:55 PM
Content Is Not Allowed In Prolog - ColdFusion XML And The Byte-Order-Mark (BOM)
Thank you! Thank you! Thank you! One more additional bit to add to this: in addition to the, "Content is not allowed in Prolog," error solved by Ben's REReplace, I was also getting, "An invalid XML ... read »
Jose Galdamez
Mar 19, 2010 at 12:52 PM
Thoughts And Goals For 2010
@Ben Do bodybuilders from our generation take glucosamine supplements to strengthen joints for this type of exercise? I'm assuming in your early 30s, no? ... read »
Daniel
Mar 19, 2010 at 12:46 PM
Using ColdFusion's CFLocation Tag For Inline Image SRC Attributes
@Ben, Yes, the client reads the headers and if it has a cached version of the file (same ETAG) then shuts down the request and render the cached version. ( I think it is done in the same request/co ... read »
Ben Nadel
Mar 19, 2010 at 12:14 PM
Why NULL Values Should Not Be Used in a Database Unless Required
@Eric, I think we should just agree that there are no cross-the-board rules on this. NULL values are good when they add value. That is highly contextual - there's nothing about NULL values that is ... read »
Ben Nadel
Mar 19, 2010 at 12:12 PM
Why NULL Values Should Not Be Used in a Database Unless Required
@Eric, By all means if you need referential integrity and foreign keys for things like "middle name", then you should use NULL values. In the applications I build, 99% of the time, I there is no ... read »
Eric Howe
Mar 19, 2010 at 12:10 PM
Why NULL Values Should Not Be Used in a Database Unless Required
@Ben Nadel, Are you saying that correct data doesn't have any business value? Nonsense. What about referential integrity and foreign keys? ... read »
Kirk Strobeck
Mar 19, 2010 at 12:00 PM
Using jQuery To Leverage The OnChange Method Of Inputs
Thnx. FYI spelling error in your comment "// Add dirtry flag to the input in" ... read »
bucabay
Mar 19, 2010 at 10:57 AM
Javascript Number.toFixed() Method
It doesn't have a base() method, but it can be put together simply with: Math.base = function(n, to, from) { return parseInt(n, from || 10).toString(to); }; ... read »