Separate quote/escape sequences from main classifier #17
Labels
area: performance
Performance improvements
contribute: simd
Requires SIMD knowledge
type: feature
New feature or request
Milestone
Is your feature request related to a problem? Please describe.
Current classifier has two separate jobs. It first detects quoted sequences, taking escapes into account, and then it classifies structural characters on top of that. Separating those concerns would unlock some perfomrance improvement opportunities.
For example, the part that classifies characters could be swapped during execution, for example to conditionally take commas into account, or to do quick skipping passes like JSONSki does.
Describe the solution you'd like
The concerns of "is this within quotes" and "is this an interesting character" should be separated into two modules.
The text was updated successfully, but these errors were encountered: