Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve performance #1379

Merged
merged 10 commits into from
Mar 31, 2023
Merged

Improve performance #1379

merged 10 commits into from
Mar 31, 2023

Conversation

kderme
Copy link
Contributor

@kderme kderme commented Mar 16, 2023 •
edited
Loading

Description

#1195
Some features may still be experimental so we won't add them to Changelog for now.

Checklist

  • Commit sequence broadly makes sense
  • Commits have useful messages
  • New tests are added if needed and existing tests are updated
  • Any changes are noted in the changelog
  • Code is formatted with fourmolu (which can be run with scripts/fourmolize.sh
  • Self-reviewed the diff

Migrations

  • The pr causes a breaking change of type a,b or c
  • If there is a breaking change, the pr includes a database migration and/or a fix process for old values, so that upgrade is possible
  • Resyncing and running the migrations provided will result in the same database semantically

No migrations

@kderme kderme changed the title Kderme/performance Improve performance Mar 16, 2023
@kderme kderme force-pushed the kderme/performance branch 3 times, most recently from 84be684 to d34a4f9 Compare March 31, 2023 13:17
kderme added 9 commits March 31, 2023 16:19
@kderme
Insert TxMetadata in bulk per block
5a4bef1 
Instead of inseting them one by one
@kderme
replace ByteString by ShortByteString for Datum hash
76701b5 
This allows it later to be used in cache, where ByteStrings are not allowed
@kderme
Extend the Cache to support Datum
a770fc8
@kderme
Use Cache for Datums
72c2771
@kderme
Insert MaTxMint in bulk per block
1ea3c33 
Instead of inseting them one by one
@kderme
Allow to turn off parts of DBSync schema
1f2198d 
These parts are multi assets, metadata, plutus extra
@kderme
Make it possible to turn off offline data fetching
4208d6d
@kderme
Add top level DBSync options and enable turbo mode
9344ec0 
Turbo mode disables many DBSync functionalities and makes it run faster
@kderme
Change Datum Cache to LRU
9a49838
@kderme kderme force-pushed the kderme/performance branch from d34a4f9 to 9a49838 Compare March 31, 2023 13:19
@kderme kderme marked this pull request as ready for review March 31, 2023 13:21
@kderme kderme merged commit 5a3dfe0 into master Mar 31, 2023
@iohk-bors iohk-bors bot deleted the kderme/performance branch March 31, 2023 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@kderme