Text::tokenize doesn't fully support the left/right bounds being the same character

[bradygp]

This is a (multiple allowed):

• bug

• enhancement

• feature-discussion (RFC)

• CakePHP Version: 3.310.

What you did

$query = 'question "help needed" "garbage" contents of query';
$tokens = Text::tokenize( $query, ' ', '"', '"');

foreach ( $tokens as $index => $token) {
    echo $token . "\n";
}

What happened

question
"help needed"
"garbage" contents of query

What you expected to happen

question
"help needed"
"garbage"
contents
of
query

I orginally posted a question about this on stackoverflow

[cleptric]

PR is open.