Regex is PHP library containing lightweight wrappers around regular expression libraries and extensions for day to day use. We try to resolve error related issues those libraries expose and which they handle rather peculiarly. We also gave a shot at unifying API they provide so library is meant to be drop-in replacement for their existing counterparts for most of the usages.
Currently the most popular regular expression library is PCRE with its preg_* functions.
Mbstring extension with its mb_ereg_* functions as an optional extension is not available everywhere.
POSIX Extended implementation with its ereg_* functions is deprecated as of PHP 5.3.0 and should not be used.
Regex library implements wrappers for
- PCRE library via PcreRegex class
- mbstring extension via MbRegex class
Download and install composer from http://www.getcomposer.org/download
Add the following to your project composer.json file
{
"require": {
"gobie/regex": "dev-master"
}
}When you're done just run php composer.phar install and the package is ready to be used.
Regular expression libraries provide variety of functions, but they are not replaceable out of the box. So we tried to unify API across those libraries. There are several methods implemented with basic signature in all wrappers. Pattern signature is different in each driver as PCRE is Perl-like and mbstring can change it on the fly with options.
match($pattern, $subject)get($pattern, $subject)getAll($pattern, $subject)replace($pattern, $replacement, $subject)split($pattern, $subject)grep($pattern, $subject)filter($pattern, $replacement, $subject)
Driver can add another arguments to signature or handle more types.
For instance
PcreRegex::get()adds$flagsand$offsetarguments to create signaturePcreRegex::get($pattern, $subject, $flags, $offset), but the basic arguments remain the same.
To accomplish this API, some methods had to be created in userland code.
For instance mbstring doesn't have corresponding functions for PCRE functions
preg_match_all(),preg_grep()orpreg_filter(), thus methods likeMbRegex::getAll(),MbRegex::grep()andMbRegex::filter()had to be created from scratch using mbstring primitives.
This library solves error handling problems by doing all the heavy lifting in reusable manner.
Every error is handled by exception derived from \Gobie\Regex\RegexException.
use Gobie\Regex\Wrappers\Pcre\PcreRegex;
use Gobie\Regex\Wrappers\Pcre\PcreRegexException;
// matching
if (PcreRegex::match($pattern, $subject)) {
// do something
}
// matching and parsing
if ($matches = PcreRegex::get($pattern, $subject)) {
// do something with $matches
}
// replace with callback
if ($res = PcreRegex::replace($pattern, $callback, $subject)) {
// do something with $res
}
// error handling
try {
// matching and parsing
if ($matches = PcreRegex::getAll($pattern, $subject)) {
// do something with $matches
}
} catch (PcreRegexException $e) {
// handle error
}use Gobie\Regex\Wrappers\Mb\MbRegex;
// greping
if ($res = MbRegex::grep($pattern, $subject)) {
// do something with $res
}
// splitting
if ($res = MbRegex::split($pattern, $subject)) {
// do something with $res
}Once again quite readable with all the error handling you need.
PHP 5.3.3 or above. Unit tests are regularly run against latest 5.3, 5.4, 5.5 and HHVM.
For mb_ereg_replace_callback() and thus for usage of MbRegex::replace() PHP 5.4 and above is required.
Functions preg_filter() and mb_ereg_replace_callback() are not to date supported.
Some error messages have different format, mostly just added pattern which causes unit test error.
Backtracking and recursion error messages are completely different and much more descriptive.
You can find out about these differences in unit test reports on travis-ci.
Why should I care? / What problem does it solve?
Regular expression libraries provide us with set of functions we have to deal with. They are somewhat similar and yet each slightly different in covered functionality and error handling.
Take for instance PCRE library. Common code seen in applications is
if (preg_match($pattern, $subject, $matches)) {
// do something with $matches if used at all
}This code is correct as long as $pattern is not dynamically created and matching can never hit backtracking
or recursion limit and $subject as well as $pattern are well formed UTF-8 strings (if UTF-8 is used).
Two types of errors can happen here. We speak about compilation errors which trigger E_WARNING like input errors.
And runtime errors like hitting backtracking or recursion limit or encoding issues.
We can deal with those using preg_last_error() function.
But only if compilation error didn't happen, otherwise this function is unreliable as it doesn't clear its state.
More robust and less error-prone version:
set_error_handler(function () {
// deal with compilation error
});
if (preg_match($pattern, $subject, $matches)) {
// do something with $matches if used at all
}
restore_error_handler();
if (preg_last_error()) {
// deal with runtime error
}That's a lot of error handling to take care about, but it gets even more complicated.
For instance using preg_replace_callback() naively can make your life harder and put your debugging skills to test.
Usually, you use it the simplest way:
if ($res = preg_replace_callback($pattern, $callback, $subject)) {
// do something with $res
}Lots can happen here, compilation and runtime errors shown above and also errors triggered from within $callback.
We just can't cover it with error handler like above, since errors from within callback should not be caught by regex error handling.
So the correct solution, which would catch compilation and runtime errors, but let the rest come through, could look like this:
set_error_handler(function () {
// deal with compilation error
});
preg_match($pattern, '');
restore_error_handler();
$res = preg_replace_callback($pattern, $callback, $subject);
if ($res === null && preg_last_error()) {
// deal with runtime error
}Not to mention handling more complex cases like array of patterns.
Why is it implemented via static methods instead of nice object oriented way we all use and love?
It is meant to be used as drop-in replacement for current usage of library/extension functions.
I want to use it as dependency in object oriented style, can I?
No problem, for that case we have RegexFacade which just redirects object calls to given wrapper.
$regex = new RegexFacade(RegexFacade::PCRE);
if ($regex->match($pattern, $subject)) {
// do something
}
// is equivalent to
if (PcreRegex::match($pattern, $subject)) {
// do something
}I don't want to use exceptions to handle regex errors. What can I do?
Wrappers are prepared to be extended to overwrite anything the way you want. For instance triggering errors instead of throwing exceptions can be implemented this way:
class MyErrorHandlingPcreRegex extends PcreRegex
{
protected static function setUp($pattern)
{
set_error_handler(function ($_, $errstr) use ($pattern) {
static::tearDown(); // or restore_error_handler() for PHP 5.3
trigger_error($errstr . '; ' . $pattern, E_USER_WARNING);
});
}
protected static function handleError($pattern)
{
if ($error = preg_last_error()) {
trigger_error(PcreRegexException::$messages[$error] . '; ' . $pattern, E_USER_WARNING);
}
}
}I just want to use unified API without the error handling.
Wrappers are easily extensible to accommodate any request.
class NoErrorHandlingPcreRegex extends PcreRegex
{
protected static function setUp($pattern) {}
protected static function tearDown() {}
protected static function handleError($pattern) {}
}Performance is one of the main reasons we try to avoid regular expressions as much as possible.
It is much more efficient to use string function like strpos, substr, str_replace, explode, etc if possible.
But there are times we need regular expressions. So we did a little benchmarking to show you, what does our abstraction take out of performance of using native functions. We think that added functionality and usable error handling quite compensates the lost performance but decide for yourself.
MbBench is missing some native function benchmarks as they don't have native implementation.
StringBench was added for comparison. It could accomplish roughly the same tasks in testing scenarios.
Gobie\Bench\MbBench
Method Name Iterations Average Time Ops/second
---------------------- ------------ -------------- -------------
libraryMatch : [10,000 ] [0.0000252296209] [39,635.95024]
libraryGet : [10,000 ] [0.0000270466089] [36,973.21179]
libraryGetAll : [10,000 ] [0.0000665599585] [15,024.04784]
libraryReplace : [10,000 ] [0.0000590241909] [16,942.20598]
libraryReplaceCallback: [10,000 ] [0.0000805493355] [12,414.75171]
libraryGrep : [10,000 ] [0.0000354112625] [28,239.60314]
libraryFilter : [10,000 ] [0.0000871953726] [11,468.49850]
librarySplit : [10,000 ] [0.0000985779762] [10,144.25370]
nativeMatch : [10,000 ] [0.0000034259081] [291,893.41165]
nativeGet : [10,000 ] [0.0000050207376] [199,173.92027]
nativeReplace : [10,000 ] [0.0000085228920] [117,331.06558]
nativeReplaceCallback : [10,000 ] [0.0000239482880] [ 41,756.63837]
nativeSplit : [10,000 ] [0.0000068708181] [145,543.07506]
Gobie\Bench\PcreBench
Method Name Iterations Average Time Ops/second
---------------------- ------------ -------------- -------------
libraryMatch : [10,000 ] [0.0000344554901] [29,022.95096]
libraryGet : [10,000 ] [0.0000327244282] [30,558.21158]
libraryGetAll : [10,000 ] [0.0000381940365] [26,182.09784]
libraryReplace : [10,000 ] [0.0000430052996] [23,252.94813]
libraryReplaceCallback: [10,000 ] [0.0000728453159] [13,727.71862]
libraryGrep : [10,000 ] [0.0000342110157] [29,230.35109]
libraryFilter : [10,000 ] [0.0000352864027] [28,339.52807]
librarySplit : [10,000 ] [0.0000331200361] [30,193.20378]
nativeMatch : [10,000 ] [0.0000061690331] [162,099.95826]
nativeGet : [10,000 ] [0.0000071261883] [140,327.47395]
nativeGetAll : [10,000 ] [0.0000095671892] [104,523.90743]
nativeReplace : [10,000 ] [0.0000074643373] [133,970.36512]
nativeReplaceCallback : [10,000 ] [0.0000232770443] [ 42,960.78090]
nativeGrep : [10,000 ] [0.0000091099977] [109,769.51120]
nativeFilter : [10,000 ] [0.0000103915691] [ 96,231.85746]
nativeSplit : [10,000 ] [0.0000077021599] [129,833.71098]
Gobie\Bench\StringBench
Method Name Iterations Average Time Ops/second
--------------------- ------------ -------------- -------------
stringMatch : [10,000 ] [0.0000034402609] [290,675.62979]
stringGet : [10,000 ] [0.0000050993204] [196,104.56282]
stringGetAll : [10,000 ] [0.0000067927361] [147,216.08379]
stringReplace : [10,000 ] [0.0000036442518] [274,404.74711]
stringReplaceCallback: [10,000 ] [0.0000126019001] [ 79,353.11279]
stringGrep : [10,000 ] [0.0000082664728] [120,970.57865]
stringFilter : [10,000 ] [0.0000143237352] [ 69,814.19186]
stringSplit : [10,000 ] [0.0000041101217] [243,301.79650]
You can run the benchmark yourself
$ cd project_root
$ composer install
$ php vendor/athletic/athletic/bin/athletic -p tests/Gobie/Bench -b tests/bootstrap.phpContributions are always welcome as well as any questions or issues.
Unit and integration testing is done via phpunit with configuration file tests/complete.phpunit.xml.