REMatchGroups() ColdFusion User Defined Function

Posted November 15, 2007 at 11:30 AM

Tags: ColdFusion

I was reading over on CF-Talk and saw that Jon Clausen was trying to use back references in his REReplace() functions in a non-string context:

 Launch code in new window » Download code as text file »

  • <cfset pageOut = reReplace(
  • pageContent,
  • "<%show:([a-zA-Z0-9_]+)%>",
  • appSettings["\1"],
  • "ALL"
  • )/>

The problem with this is that all of the arguments are evaluated by ColdFusion at the point of initial REReplace() function execution; \1 doesn't mean anything at this point. The only reason \1 means anything when it is in a string is because that string is later evaluated for each regular expression pattern matched.

The easiest way to deal with this, is to use a function that returns the captured groups of the regular expression pattern so that you can deal with them individually. My RELoop.cfc ColdFusion custom tag can do this, but, and I'm sorry if this is ultra repetitive, I figured I would throw together a function that mimicked ColdFusion 8's REMatch() function, but with the twist that it returns the groups, not just the matched string:

 Launch code in new window » Download code as text file »

  • <cffunction
  • name="REMatchGroups"
  • access="public"
  • returntype="array"
  • output="false"
  • hint="Returns the captrued groups for each pattern match.">
  •  
  • <!--- Define arguments. --->
  • <cfargument
  • name="Text"
  • type="string"
  • required="true"
  • hint="The target text in which we are trying to match patterns."
  • />
  •  
  • <cfargument
  • name="Pattern"
  • type="string"
  • required="true"
  • hint="The regular expression patterns that we are matching."
  • />
  •  
  • <cfargument
  • name="Scope"
  • type="string"
  • required="false"
  • default="ALL"
  • hint="The scope of pattern matching (valid is ONE or ALL)."
  • />
  •  
  •  
  • <!--- Define the local scope. --->
  • <cfset var LOCAL = StructNew() />
  •  
  •  
  • <!--- Create an array to hold our matches. --->
  • <cfset LOCAL.Results = ArrayNew( 1 ) />
  •  
  •  
  • <!--- Create the compiled pattern object. --->
  • <cfset LOCAL.Pattern = CreateObject(
  • "java",
  • "java.util.regex.Pattern"
  • ).Compile(
  • JavaCast( "string", ARGUMENTS.Pattern )
  • )
  • />
  •  
  • <!---
  • Create the matcher for our pattern based on
  • the target text.
  • --->
  • <cfset LOCAL.Matcher = LOCAL.Pattern.Matcher(
  • JavaCast( "string", ARGUMENTS.Text )
  • ) />
  •  
  •  
  • <!---
  • Keep looping over the pattern matcher until it can no
  • longer find a match OR the searching scope is satisified.
  • --->
  • <cfloop condition="LOCAL.Matcher.Find()">
  •  
  • <!--- Create a struct to hold our groups. --->
  • <cfset LOCAL.Groups = StructNew() />
  •  
  •  
  • <!---
  • Loop over the captured groups to store each one
  • of them individually.
  • --->
  • <cfloop
  • index="LOCAL.GroupIndex"
  • from="0"
  • to="#LOCAL.Matcher.GroupCount()#"
  • step="1">
  •  
  • <!---
  • Store the captured group. If this group was not
  • captured, then the key will not be valid in the
  • struct (which is fine).
  • --->
  • <cfset LOCAL.Groups[ LOCAL.GroupIndex ] = LOCAL.Matcher.Group(
  • JavaCast( "int", LOCAL.GroupIndex )
  • ) />
  •  
  • </cfloop>
  •  
  •  
  • <!--- Add this group to our results. --->
  • <cfset ArrayAppend( LOCAL.Results, LOCAL.Groups ) />
  •  
  • <!---
  • Check to see if our search scope has been
  • satisified by the number of matches found.
  • --->
  • <cfif (ARGUMENTS.Scope EQ "ONE")>
  •  
  • <!--- We found our one match, so break out. --->
  • <cfbreak />
  •  
  • </cfif>
  •  
  • </cfloop>
  •  
  •  
  • <!--- Return the results. --->
  • <cfreturn LOCAL.Results />
  • </cffunction>

This function takes the text you are working, the regular expression patterns, and then unlike ColdFusion 8's REMatch() function, you have the option to specify match scoping - ALL or ONE (defaults to ALL). Let's take a look at an example:

 Launch code in new window » Download code as text file »

  • <!--- Crate the text that we will search. --->
  • <cfsavecontent variable="strText">
  • Jill: 212-555-1234
  • Sarah: 917.538.0001
  • Maria: 212.538.1234 x14
  • Kim: 212.555.5432 x5435
  • </cfsavecontent>
  •  
  •  
  • <!--- Collect the phone numbers. --->
  • <cfset arrMatches = REMatchGroups(
  • strText,
  • "(\d+)[. \-]?(\d+)[. \-]?(\d+)(?: x(\d+))?"
  • ) />
  •  
  •  
  • <!--- Dump out results. --->
  • <cfdump
  • var="#arrMatches#"
  • label="REMatchGroups() Results Array"
  • />

Here, we have a list of phone numbers that have various patterns. We want to grab all the numeric data, irrelevant of the delimiters, and then return the groups. Of that, we have an optional phone number extension which may or may not be returned. Running the above code, we get the following CFDump output:


 
 
 

 
REMatchGroups() Phone Number Group Output  
 
 
 

Notice that each array item contains a structure of captured groups. The zero group is always the full string match and then each indexed group represents a captured group. Don't get worried that some of the struct keys say "undefined struct element". This is just what happens when you store a Java NULL value (the result of the Matcher's Group() method) into a struct key. Regardless of what the CFDump output looks like, things like StructKeyExists() still work as expected (as you'll see in a second).

Now, let's take that array, returned above, and output the phone numbers:

 Launch code in new window » Download code as text file »

  • <!--- Loop over the phone numbers. --->
  • <cfloop
  • index="intI"
  • from="1"
  • to="#ArrayLen( arrMatches )#"
  • step="1">
  •  
  • <!--- Get the groups. --->
  • <cfset objGroups = arrMatches[ intI ] />
  •  
  • <p>
  • (#objGroups[ 1 ]#) #objGroups[ 2 ]#-#objGroups[ 3 ]#
  •  
  • <!--- Check to see if a phone ext. was found. --->
  • <cfif StructKeyExists( objGroups, "4" )>
  • x#objGroups[ 4 ]#
  • </cfif>
  • </p>
  •  
  • </cfloop>

Notice that we are assuming that groups 1, 2, and 3 exist as they are required for the pattern to match. We are then testing the existence of the 4th group to see if an extension was found. Running the above code, we get the following output:

(212) 555-1234

(917) 538-0001

(212) 538-1234 x14

(212) 555-5432 x5435

Ok, so by now, I think I have covered like every angle of finding patterns, returning groups, and acting on them in an iterative manner. Going forward, I will try to just point people to these examples rather than writing more examples.

Download Code Snippet ZIP File

Post Comment  |  Ask Ben  |  Permalink  |  Other Searches  |  Print Page




Learning ColdFusion 9 - ColdFusion 9 tutorials, samples, examples, demos

Reader Comments

Nov 15, 2007 at 3:03 PM // reply »
1 Comments

Ben,

I posted the following reply on CF-Talk as well, but I figured I'd post it here as well since CF-Talk seems to be running slow today:

<blockquote>
Ben,

Thanks! As always, you rock! I had kind of figured that the method execution order was the issue, but was hoping to find a workaround to "trick" the excution so that the regex backref was captured before the method was called.

Very nice code and potentially very useful! I'm not entirely sure that, in my situation, it's going to be faster than using a loop with reFind() as I have currently, though I'm going to check it out with some timers later today. I'll let you know the results.

What you've written, though could be tremendously useful for parsing the contents of a file and turning into workable data for reuse. In my case I'm simply replacing the user provided shorthand "tokens" so there's no need to retain the information after the token has been replaced.

Nice work!

Jon
</blockquote>

:-)


Nov 15, 2007 at 3:11 PM // reply »
6,515 Comments

@Jon,

Always glad to help. If nothing else, it gives me just one more example to which to point people when possible. Plus, always happy to find new ways in which to make regular expression useful to all programmers.


Aug 26, 2008 at 8:13 PM // reply »
1 Comments

Ben,
I was having trouble referencing values in the structures so I modified it. Trying to call #arrTest2[1].1# results in an error. With the new code I can call #arrTest2[1].key1# to get a value directly. Maybe I was doing something wrong but no matter how I tried to get the value (without looping through all of the results) I got an error.

Also, I modified mine to move the pattern to the first argument (Like your other UDF REMatchGroup and like the OOTB REMatch. I wonder why Adobe didn't make the REReplace functions have the same order as REMatch and REFind.

What do you think?

<!--- OLD Code
<cfset LOCAL.Groups[ LOCAL.GroupIndex ] = LOCAL.Matcher.Group(
JavaCast( "int", LOCAL.GroupIndex )
) /> --->

<cfset GroupIndexName="key"&LOCAL.GroupIndex>
<cfset LOCAL.Groups[ GroupIndexName ] = LOCAL.Matcher.Group(
JavaCast( "int", LOCAL.GroupIndex )
) />

Thanks for an awesome site!


Aug 27, 2008 at 8:11 AM // reply »
6,515 Comments

@John,

Whatever you got working is good. You were probably having trouble referencing the values because you can't use the value "1" as a key in struct notation. "1" is not a valid variable name... but it can be a valid key. The trick is, and you will see this in my demo, is that you have to reference using array notation:

objGroup[ 1 ] (which works)

... vs.

objGroup.1 (which doesn't work)

Glad you are liking the site :)


Jul 20, 2009 at 4:02 PM // reply »
4 Comments

Just came across your UDF and your site - bookmarked it right away! I am having an issue with ReMatchGroups. Here are the 2 lines of code. The arrMatches array dumps out empty, but the ReReplaceNodecase function does the replacement. Any idea why REMatchGroups isn't finding the matches?

<cfset arrMatches = REMatchGroups(strText, "a [^>]*href=""mailto:([^\""]+)\""[^>]*>\s*((\n|.)+?)\s*</a>") />

#ReReplaceNoCase(strText, "<a [^>]*href=""mailto:([^\""]+)\""[^>]*>\s*((\n|.)+?)\s*</a>", "\2", "ALL")#


Jul 20, 2009 at 4:30 PM // reply »
6,515 Comments

@Cory,

Behind the scenes, the reMatchGroups() method is using the Java regular expression engine. reReplaceNoCase() uses the POSIX engine. They are slightly different. My guess is that your use of "." is messing it up. In generic CF regular expressions, "." matches anything, including new line:

http://www.bennadel.com/blog/1412-Dot-Character-Matches-In-ColdFusion-And-Java-Regular-Expressions.htm

What are you trying to match with the "."?


Jul 20, 2009 at 4:34 PM // reply »
4 Comments

Ben,

I am simply trying to find existing mailto links in a string of HTML (coming from the database. I am new to regular expressions, but I think what I currently have is probably overkill for such a simple pattern.


Jul 20, 2009 at 4:43 PM // reply »
6,515 Comments

@Cory,

Try replacing (\n|.) with [\w\W]. I think that might be what you're trying to get at.


Jul 20, 2009 at 4:55 PM // reply »
4 Comments

Ben,

I replaced (\n|.) with [\w\W] in both lines of code, and while the ReReplaceNoCase still works, the dump of the arrMatches variable is still empty?


Jul 20, 2009 at 4:56 PM // reply »
6,515 Comments

@Cory,

Hmmm. When I have some more time, I'll try to do some testing.


Jul 20, 2009 at 5:26 PM // reply »
4 Comments

Ben,

I went with a more simple pattern - without the mailto:

[\w-]+@([\w-]+\.)+[\w-]+

That seems to do the trick! Thank you!


Jul 20, 2009 at 5:28 PM // reply »
6,515 Comments

@Cory,

Oh sweet! Nicely done.


Oct 22, 2009 at 1:28 PM // reply »
1 Comments

Fantastic! I found this very, very useful!

This made regular expressions so much quicker for me.

And indeed, awesome site, thank you!


Oct 31, 2009 at 3:48 PM // reply »
6,515 Comments

@Ryan,

Glad to help - getting access to the regex groups not only makes your patterns easier (since you can return data you don't directly want to access), it makes the returned data more usable.


Post Comment  |  Ask Ben

Recent Blog Comments
Nov 20, 2009 at 5:38 PM
Learning ColdFusion 8: CFImage Part I - Reading And Writing Images
Hi Ben, Great article. I've been looking around to see if ColdFusion image engine can programatically create the following "wrap around" effect: http://www.creativepro.com/article/photoshop-s-she ... read »
Nov 20, 2009 at 5:35 PM
Maintaining ColdFusion Sessions Across SMS Text Message Requests Without Cookies
@Dave: I talked to Gert he suggested: <cfhttp method="get" url="http://{some cf website}" result="stuff" addtoken="yes" /> Note the addition of cfhttp attribute addtoken. That should persist y ... read »
Nov 20, 2009 at 5:23 PM
Maintaining ColdFusion Sessions Across SMS Text Message Requests Without Cookies
@Todd, Ahh, gotcha, yeah that makes sense. ... read »
Nov 20, 2009 at 5:17 PM
Maintaining ColdFusion Sessions Across SMS Text Message Requests Without Cookies
Ben, sorry if I didn't make this clear. You can make it work like that if you want, just put <cfset session.foo = 1> (and <cfset application.foo = 1>) in your OnRequestStart() and it reve ... read »
Nov 20, 2009 at 5:07 PM
Maintaining ColdFusion Sessions Across SMS Text Message Requests Without Cookies
@Todd, I have seen tidbits about the way Railo handles session. I can understand that it lazy-loads sessions, but I also think that I might make some things more complicated. For example, often tim ... read »
Nov 20, 2009 at 4:53 PM
Maintaining ColdFusion Sessions Across SMS Text Message Requests Without Cookies
Ben, you can ramp up the security by turning on J2EE session which gives you a third set of numbers other than CFID/CFTOKEN. There's a reason why ACF put this in place (other than just session replic ... read »
Nov 20, 2009 at 4:52 PM
Maintaining ColdFusion Sessions Across SMS Text Message Requests Without Cookies
Case in point, Ben, you may not be aware of this, but in Railo - OnApplicationStart() & OnSessionStart() act differently than in ACF. ACF does: OnApplicationStart (1st hit) OnSessionStart (1st and e ... read »
Nov 20, 2009 at 4:46 PM
Maintaining ColdFusion Sessions Across SMS Text Message Requests Without Cookies
@Todd, That's understandable. I am not sure if this really leaves any more security holes than the fact that using old cookie-based CFID / CFTOKEN values will create a new session using the old CFI ... read »