Skip to main content
Ben Nadel at TechCrunch Disrupt (New York, NY) with: Mark C. Webster
Ben Nadel at TechCrunch Disrupt (New York, NY) with: Mark C. Webster ( @markcwebster )

What Search Engine Spiders See

By on
Tags:

I was just posting a Search Engine Optimization question on the House of Fusion CF-Talk list when Nick Tong posted a link to "What Search Engine Spiders See". This page blows my mind. It allows you to enter in a url and get a report back regarding the page content based on how the search engine web spiders/crawlers see your content. It is fantastic for seeing exactly what your page has and perhaps more importantly, what your page is lacking in terms of headers, alt tags, and general content.

Nick posted this saying that he originally got it off of AndyJarret.co.uk.

Link: http://www.dlperry.com/what_search_engine_spiders_see.html

Short link: https://bennadel.com/go/86

Reader Comments

6 Comments

There is one thing which developers forgot about; Comments. I just checked one of my sites which has few comments (HTML tags of course) and it didn't remove the content within comments. Google doesn't consider comments for indexing.

In this sense, comments may contain links, words, whatever... So the tool may give you invalid output in some cases.

Oh my chickens, this post is old!
I believe in love. I believe in compassion. I believe in human rights. I believe that we can afford to give more of these gifts to the world around us because it costs us nothing to be decent and kind and understanding. And, I want you to know that when you land on this site, you are accepted for who you are, no matter how you identify, what truths you live, or whatever kind of goofy shit makes you feel alive! Rock on with your bad self!
— Ben Nadel