Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance #98

Merged
merged 7 commits into from
Nov 17, 2021
Merged

Performance #98

merged 7 commits into from
Nov 17, 2021

Conversation

jqnatividad
Copy link
Collaborator

Hi @dsietz ,
Hope you don't mind but I took the liberty of doing a quick pass at improving performance.

I squeezed about 10% better performance from my testing with these tweaks.

BTW, I noticed that you do multi-threading in the library, is that something that can be exposed to the Data Sample Parser? Several qsv commands support multi-threading and have CLI options for it to take advantage of additional processors.

If so, let me know so I can create an enhancement issue for it.

Thanks again!

dsietz and others added 7 commits November 16, 2021 09:12
- move log4rs to dev-dependencies as log4rs has a large dependency tree and is only used for integration tests, and not the library itself
- removed unused config and lazy_static dependencies (per cargo udeps)
- added once_cell for optimizing regex init in mod.rs
as macro uses fully qualified call
@coveralls
Copy link

Pull Request Test Coverage Report for Build 1468958305

  • 15 of 15 (100.0%) changed or added relevant lines in 3 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 92.238%

Totals Coverage Status
Change from base Build 1467360880: 0.0%
Covered Lines: 1937
Relevant Lines: 2100

💛 - Coveralls

@dsietz dsietz changed the base branch from master to development November 16, 2021 23:48
@dsietz dsietz merged commit 2462c16 into dsietz:development Nov 17, 2021
@dsietz
Copy link
Owner

dsietz commented Nov 17, 2021

@jqnatividad Thank you very much for the performance improvements and sharing your code. I'm always open to code contributions and feedback. Your changes make sense and are more eloquent than what I had. Going forward, please make sure to create Pull Requests onto the Development branch so that I can integrate it with my own changes before pushing it up to Master.

Unfortunately, I don't have the time necessary to support continued development (enhancements) on this package, however if you'd like to join as a contributor of this package, you are more than welcome. Just let me know.

@jqnatividad
Copy link
Collaborator Author

Hi @dsietz,
Thanks for your prompt reply and merging my enhancements.

And yes, I'd be more than happy to help maintain and enhance test-data-generation!

It fills an underserved need, and I can imagine several enhancements already.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants