Regular Expressions With Repeated Groups

Posted December 14, 2007 at 9:04 AM

Tags: ColdFusion

Last night, on my way to the gym, I was rolling some regular expressions around in my head when suddenly it occurred to me that I have no idea what actually gets captured by a group that is repeated within a single pattern. Let me explain; assume we wanted to match a query string - not just a name-value pair, but the whole string of name-value pairs. To do so, we might use a pattern like this:

((([^=]+=[^&]*)&?)+)

Here we are matching three groups. The first group is the entire match. The second group is the name-value pair followed by an optional amphersand. The third group is the actual name-value pair. Of course, when I say "actual" name-value pair, I am not 100% what that means. See, if we have a string of name-value pairs that get matched by the single pattern, what actually shows up in that name-value matched group?

I did a little testing:

 Launch code in new window » Download code as text file »

  • <!--- Define target string. --->
  • <cfset strQuery = "ben=nice&maria+bello=sexy!&lori+petty=cool" />
  •  
  • <!--- Create pattern object. --->
  • <cfset objPattern = CreateObject(
  • "java",
  • "java.util.regex.Pattern"
  • ) />
  •  
  • <!---
  • Compile regular expression pattern. In this case
  • our pattern consists of one or more name-value pairs
  • separated by the & symbol.
  • --->
  • <cfset objPattern = objPattern.Compile(
  • JavaCast(
  • "string",
  • "((([^=]+=[^&]*)&?)+)"
  • )
  • ) />
  •  
  • <!--- Get matcher for target string with the given pattern. --->
  • <cfset objMatcher = objPattern.Matcher(
  • JavaCast(
  • "string",
  • strQuery
  • )
  • ) />
  •  
  •  
  • <!--- Keep looping over matches. --->
  • <cfloop condition="objMatcher.Find()">
  •  
  • 1) #objMatcher.Group( JavaCast( "int", 1 ) )#<br />
  • 2) #objMatcher.Group( JavaCast( "int", 2 ) )#<br />
  • 3) #objMatcher.Group( JavaCast( "int", 3 ) )#<br />
  • <br />
  •  
  • </cfloop>

Here we create a string of three name-value pairs. We then use the pattern above, which will match the entire string, and loop over the matcher for that pattern (which will loop once since our pattern matches the entire string). Running the above code, we get the following output:

1) ben=nice&maria+bello=sexy!&lori+petty=cool
2) lori+petty=cool
3) lori+petty=cool

Interesting. It looks like the repeated group just captures the last possible group matched as part of the sub-expression. That makes sense, I guess; it's not like it could return an array of matched groups. Not even an issue, since you would never need to access this information. And, if you did, you could just match on individual name-value pairs rather than the entire string.

Download Code Snippet ZIP File

Post Comment  |  Ask Ben  |  Other Searches  |  Print Page




Learning ColdFusion 9 - ColdFusion 9 tutorials, samples, examples, demos

Reader Comments

Dec 14, 2007 at 11:43 AM // reply »
12 Comments

Ben, I like the regex example but more importantly I like the way you used Java to do it. Thanks for posting this.
Cheers.


Dec 14, 2007 at 12:23 PM // reply »
7,488 Comments

@Anuj,

No problem. The regular expression itself does not require Java; however, being able to access the matched groups is only available via the Java Pattern / Matcher as far as I know.


Dec 14, 2007 at 2:00 PM // reply »
41 Comments

"Last night, on my way to the gym, I was rolling some regular expressions around in my head"

I don't now about you, but on the way to yoga class the only thing I thinking about is: "Jesus, I beg of you, please there be a hot chick be front of me tonight."


Dec 14, 2007 at 2:44 PM // reply »
7,488 Comments

Ha ha ha :) There's usually a few hot girls at my gym. I like to wait till I get there, pick one out, and then hope she gives me the time of day :)


Dec 16, 2007 at 5:50 AM // reply »
64 Comments

> being able to access the matched groups is only available via the Java Pattern / Matcher as far as I know

There's the returnsubexpressions option for reFind(). That does what you're suggesting, dunnit? It's not as nice as your approach, that said.

--
Adam


Dec 17, 2007 at 7:57 AM // reply »
7,488 Comments

@Adam,

Thanks for the education! I didn't ever know that sub expressions were captured that way. When it comes to REFind(), I've only ever seen the results with one array element.

Thanks again.

http://www.bennadel.com/index.cfm?dax=blog:1090.view


Dec 31, 2007 at 5:00 PM // reply »
165 Comments

.NET actually gives you access to all the values captured by repeated groups, as does the just-released Perl 5.10 (when using named capture). I wish this feature were more common.


Jan 2, 2008 at 9:51 AM // reply »
64 Comments

Is that like what reMatch() does?

http://livedocs.adobe.com/coldfusion/8/functions_m-r_27.html

--
Adam


Jan 2, 2008 at 6:31 PM // reply »
7,488 Comments

@Adam,

REMatch() just returns an array in which each array index contains the entire pattern match (one array index for each complete pattern match in the target string). I don't believe that it deals with individual captured groups.

You can sort of think of it like this:

REMatch() is to the target string what "captured group" is to the matched pattern.


Jan 4, 2008 at 8:06 PM // reply »
64 Comments

You're dead right, that's exactly what reMatch() does. I misread/mistook "repeated group" for "repeated match".

Cheers for pulling me up on that one... it lead to some interesting reading. Well: as interesting as regexes get, anyways ;-)

Whilst on the subject, I was initially quietly hopeful about the possibilities of reMatch(), expecting it somehow to - as you suggest - capture/extract/return the subexpressions (repeated groups/subexpressions are not something that'd occurred to me one way or the other, to be honest) as well. But unlike reFind(), there is no "returnsubexpressions" switch. This is a significant shortcoming in my view. But it's a start, anyhow.

--
Adam


Jan 5, 2008 at 2:17 PM // reply »
7,488 Comments

@Adam,

I agree. A while back, I fooled around with a ColdFusion custom tag that could loop over regular expressions and return sub expressions:

http://www.bennadel.com/index.cfm?dax=blog:971.view

I thought it was pretty bad ass, but got some push back on it. I still like it :)


Apr 20, 2009 at 8:38 PM // reply »
21 Comments

@Ben: Yet again you saved me a hell of a lot of time with this post! Thanks.


Apr 21, 2009 at 8:14 AM // reply »
7,488 Comments

@Sam,

Not sure how it helped, but awesome!


Jun 8, 2009 at 11:12 PM // reply »
1 Comments

http://www.regular-expressions.info/captureall.html gives a very good explanation of what is going on under the hood while capturing a repeating group.


Jun 9, 2009 at 8:21 AM // reply »
7,488 Comments

@David,

That is a good explanation. Thanks for pointing that out.


Post Comment  |  Ask Ben

Recent Blog Comments
Mar 13, 2010 at 9:14 PM
The Magic Of Thinking Big By David Schwartz (Thanks Clark Valberg!)
Ben, COuld you plz tell me how to find the audio book version of The Magic of Thinking Big by David J. Schwartz, Ph.D Thanks ... read »
sun
Mar 13, 2010 at 6:21 PM
Sending (SMS) Picture Messages With ColdFusion And CFMail
MY BAD! @tmomail.net IS correct ... but, ONLY from pic taken W/ a cell -- NOT as attachment in an email ... (took ~4 min. for it to arrive ... then would NOT DL to my cell) ... read »
sun
Mar 13, 2010 at 6:16 PM
Sending (SMS) Picture Messages With ColdFusion And CFMail
@tmomail.net is NOT correct! IS t-mobile addy ... but, ONLY for a txt msg! ... read »
Mar 12, 2010 at 8:24 PM
Creating UI Elements With Low-Coupling And Conditional Event Handling
@Ben, Yes, that's exactly what's happening. That's the approach YUI has taken with custom events, you subscribe the handler to the Event object itself. I really like the event system in YUI, it's ... read »
Mar 12, 2010 at 7:34 PM
FLV 404 Error On Windows 2003 Server
I spent a good couple of hours on this today. What a pain. On my old server, everything was fine. I migrated the site to a new server, and suddenly, all the files with audio didn't work. Just got ... read »
Mar 12, 2010 at 7:26 PM
Creating UI Elements With Low-Coupling And Conditional Event Handling
@Ryan, I finally got around to reading that YUI blog post you linked (it took me a fews months, but I did it). I wanted to ask you something (rather than on his only cause it is so old), but from w ... read »
Mar 12, 2010 at 2:00 PM
Tim Cracked The GMail - CFMailPart Puzzle!
@Mik Muller, Exactly what I was encountering... complaints of empty emails. I'm really surprised no one else has reported this anywhere. I realize text emails may seem old school but there are a lot ... read »
Mar 12, 2010 at 1:50 PM
Using jQuery's SlideUp() and SlideDown() Methods With Bottom-Positioned Elements
That's exactly the situation that came to my mind the other day. Saved my life there! xoxo ... read »