-
Notifications
You must be signed in to change notification settings - Fork 56
Open
Labels
enhancementNew feature or requestNew feature or request
Milestone
Description
I have been exploring why the validation is so slow.
jing
jing allows to validation of multiple files with the same schema in parallel. These are the speeds for 64 thread CPU, in seconds:
| # of files | loading schema | validating | total time |
|---|---|---|---|
| 1 | .335 | .751 | 1.086 |
| 112 | .314 | 25.774 | 26.088 |
| 297 | .338 | 59.574 | 59.912 |
| 1149 | .335 | 24.8152 | 248.487 |
We can speed up jing 5 times, but the order of output will be different - not file by file.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request