Search Engine Optimization and Error Catching

Posted April 19, 2006 at 8:43 AM

Tags: ColdFusion, Search Engine Optimization

I have been trying to build this site with good search engine optimization (SEO). The top item on the SEO list is the link hrefs. My site is built on a DAX string (Divide and Qonquer mentality - "daq's") in the form of:

"index.cfm?dax=blog:4.view

However, in order to make the site more SEO, I have retooled the links to be in the form of:

./blog/4-this-is-the-entry-title/view

which essentially gets parsed into the DAX string metioned above. The concern I have here is that this is actually throwing a 404 file not found error. However, I catch this in a custom error handler page and manually set the page status to 202:

<cfheader statuscode="200" statustext="OK" />

When I do a CFHttp to test the status of my pages, it does indeed come back as 200; however, I am seeing in my logs that spiders will hit the home page of my site, but then not hit anything else. I don't know if that is because it can somehow figure out that it's actually hitting a 404 page or what? But then again, even if they had to do a page grab to get the status code, my logs would have that as well.

So, why are search engines not moving past my homepage? More to come....

Post Comment  |  Ask Ben  |  Print Page




Reader Comments

Jul 10, 2007 at 11:15 PM // reply »
4 Comments

Any problem on Google Site Map verification. I am not able to verify some of my site using customized 404 page for not found pages.

Thanks


Jul 11, 2007 at 8:40 AM // reply »
7,538 Comments

What kind of server-side scripting are you using? You should be able to override the 404 by passing custom headers.


Jul 11, 2007 at 11:21 AM // reply »
4 Comments

I have the same issue with 2 custom PHP application, and one Joomla site.

Thanks


Mar 27, 2009 at 4:32 PM // reply »
1 Comments

Technologies: mod_perl php apache xml mysql mssql nt linux java ajax ant solr

Migrated relational data to SOLR for improved search functionality.
Initiated process to standardize AJAX development on Yahoo UI toolkit (involved leading a team to review existing systems, define requirements, identify integration points and impact of adoption, and propose adoption guidelines)
Worked with operations team to maintain and extend functionality of ticket tracking and CRM tools.
Reduced code execution through refactoring, code analysis and database optimization
Kept development blog to increase communication between coasts department structure.
Introduced testing procedures and tools for non-Java projects.
Introduced standard build process for PHP and Perl code using Ant/Java - reduced push time and associated push problems.
Identified stakeholders and managed communication between multiple developers and external stakeholders for multiple projects.


Post Comment  |  Ask Ben

Recent Blog Comments
Mar 17, 2010 at 4:13 PM
Testing For NULL Values In A ColdFusion Query Result Set
To get around the empty strings in an UPDATE statement I pretended the variable was a string by enclosing it in single quotes, CAST it to an integer, let it convert empty strings to zeroes, and used ... read »
Mar 17, 2010 at 4:12 PM
Ask Ben: Environment-Based Application.cfc Settings
Ben, those are valid comments. I posted some code that shows how to "worryfree ;o)" copy code and let the Application.cfc sort it out. http://boncode.blogspot.com/2010/03/cf-dynamically-changing-ap ... read »
Mar 17, 2010 at 3:32 PM
Using Appropriate Status Codes With Each API Response
@Marc, For our project it isn't really a requirement, since most (if not all) of our resources are private and related to the logged in user. Anyway, IIRC google does execute javascript before inde ... read »
Mar 17, 2010 at 3:24 PM
Finally Finished Ayn Rand's Atlas Shrugged Audio Book
Objectivism is a form of positivism, and Quantum Mechanics does not fit positivism. One of the postulates of Quantum Mechanics is the impossibility of separating the object of measurement from the me ... read »
Mar 17, 2010 at 2:52 PM
Ask Ben: Blocking WSDL Access In A ColdFusion Application
<cfif structKeyExists( url, "wsdl" ) and not structKeyExists( url, "x")> should fix that ... read »
Mar 17, 2010 at 2:43 PM
Ask Ben: Blocking WSDL Access In A ColdFusion Application
You are correct. You can use HTTPservice RPC model instead and not worry about the wrapper. Not too much harder to do but not as extensible or fun! I wonder if the Flex app could pass an arg after t ... read »
Mar 17, 2010 at 2:40 PM
Using Appropriate Status Codes With Each API Response
Simon, If you're serving up what is essentially a blank page "template", and then getting the actual content for that page using javascript, how on earth are you getting the search engines to see yo ... read »
Mar 17, 2010 at 2:34 PM
Using Appropriate Status Codes With Each API Response
We have a similar setup as Rocky. We have a backend which only exposes REST services. It doesn't output any html, js, jsp, .. . (We are capable of running jsp, groovy, jsf, ruby, jython, etc.. but w ... read »