What Search Engine Spiders See

Posted June 15, 2006 at 9:57 AM by Ben Nadel

Tags: Search Engine Optimization

I was just posting a Search Engine Optimization question on the House of Fusion CF-Talk list when Nick Tong posted a link to "What Search Engine Spiders See". This page blows my mind. It allows you to enter in a url and get a report back regarding the page content based on how the search engine web spiders/crawlers see your content. It is fantastic for seeing exactly what your page has and perhaps more importantly, what your page is lacking in terms of headers, alt tags, and general content.

Nick posted this saying that he originally got it off of AndyJarret.co.uk.

Link: http://www.dlperry.com/what_search_engine_spiders_see.html



Reader Comments

Wong Seoul
Jul 21, 2007 at 10:35 PM // reply »
1 Comments
1 Points

Great tool. I always use crawler simulation tools from seochat. This one looks much better and detailed.

Thanks for sharing


Jan
Sep 6, 2007 at 3:06 AM // reply »
6 Comments
1 Points

There is one thing which developers forgot about; Comments. I just checked one of my sites which has few comments (HTML tags of course) and it didn't remove the content within comments. Google doesn't consider comments for indexing.

In this sense, comments may contain links, words, whatever... So the tool may give you invalid output in some cases.


Florida Search Engine Optimization
May 6, 2008 at 10:48 AM // reply »
9 Comments
1 Points

Nice tool ...

Check this out too ...

http://www.ranks.nl/tools/spider.html


Ben Nadel
May 6, 2008 at 1:01 PM // reply »
11,246 Comments
75,418 Points

@Edward,

Looks interesting. My pages are too big to use with the free version :)


ana gomez
May 30, 2008 at 9:49 AM // reply »
2 Comments
1 Points

I could not find that tool on that site. Do i have to regiter to use it?


Post A Comment

Comment Etiquette: Please do not post spam. Please keep the comments on-topic. Please do not post unrelated questions or large chunks of code. And, above all, please be nice to each other - we're trying to have a good conversation here.

Please review the following issues:

Author Name:
Author Email:
Author Website:
Comment:
Supported HTML tags for formatting: <strong>bold</strong>   <em>italic</em>   <code>code</code>







  • Help Wanted - Find Your Next ColdFusion Job
Ben Nadel's Company - Epicenter Consulting Recent Blog Comments
Brandon
May 23, 2013 at 9:52 PM
Preventing Links In Standalone iPhone Applications From Opening In Mobile Safari
@Muhmmadibn Did you figure out a solution to launching PDFs? I am running into the same issues myself. There is no way to close the PDF or go back once you launch it. Thanks in advance! ... read »
Dr Amadi
May 23, 2013 at 6:06 PM
The Girl Who Broke My Heart, And Made Me A Better Person
Good day,ladies and gentle men, my name is Dr AMADI the great spell caster in Africa, i have help so many people for different kind of problems,who say there is no solution to problems on earth, that ... read »
Ben Nadel
May 23, 2013 at 4:26 PM
ColdFusion QueryAppend( qOne, qTwo )
@Heather, Glad people are still getting value out of this! ... read »
Ben Nadel
May 23, 2013 at 3:49 PM
Strange Interaction Between DeserializeJson(), ArrayContains(), And Database Values In ColdFusion
@WebManWalking, I meant the code at the bottom (not the video). I did try to experiment with an intermediary variable, like: value = users.id[ i ]; arrayContains( userIDs, value ); ... but t ... read »
WebManWalking
May 23, 2013 at 11:06 AM
Strange Interaction Between DeserializeJson(), ArrayContains(), And Database Values In ColdFusion
@Ben, Are you talking about As Number: YES As String: YES As Java: YES? If so, that's with 3 different ways of referencing the constant 1, not users.id[1]. Query object references(*) are what seem ... read »
Ben Nadel
May 23, 2013 at 9:55 AM
Strange Interaction Between DeserializeJson(), ArrayContains(), And Database Values In ColdFusion
@Dan, According to the CF Admin, I'm running Java "1.6.0_45". As far as the DB column, in the database it's an INT. I'll see if I can dig into what CF sees it as. @WebManWalking, But h ... read »
WebManWalking
May 23, 2013 at 9:49 AM
Strange Interaction Between DeserializeJson(), ArrayContains(), And Database Values In ColdFusion
@Ben, I think the problem is that we're used to loose typing in ColdFusion, like JavaScript. If a value is a number but it's needed in an expression to be a string, noooo problem. I've encountered ... read »
Heather
May 23, 2013 at 9:47 AM
ColdFusion QueryAppend( qOne, qTwo )
You rock! Thank you, thank you, thank you!!! ... read »
InVision App - Prototyping Made Beautiful With Prototyping Tools