Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: buffer decoding of archive file to reduce memory usage #450

Merged
merged 3 commits into from Oct 15, 2023

Conversation

MicaiahReid
Copy link
Collaborator

@MicaiahReid MicaiahReid commented Oct 13, 2023

Fixes #401

Previously, memory usage peaked at 32 GB. Now, I didn't see it go above 8 MB

Copy link
Member

@lgalabru lgalabru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @MicaiahReid!

@MicaiahReid MicaiahReid temporarily deployed to Development-mainnet October 13, 2023 15:32 — with GitHub Actions Inactive
@MicaiahReid MicaiahReid temporarily deployed to Development-testnet October 13, 2023 15:32 — with GitHub Actions Inactive
@MicaiahReid MicaiahReid temporarily deployed to Development-mainnet October 15, 2023 18:34 — with GitHub Actions Inactive
@MicaiahReid MicaiahReid temporarily deployed to Development-testnet October 15, 2023 18:34 — with GitHub Actions Inactive
@MicaiahReid MicaiahReid temporarily deployed to Staging-mainnet October 15, 2023 20:18 — with GitHub Actions Inactive
@MicaiahReid MicaiahReid temporarily deployed to Staging-testnet October 15, 2023 20:18 — with GitHub Actions Inactive
@MicaiahReid MicaiahReid merged commit f1b89f7 into develop Oct 15, 2023
10 checks passed
@MicaiahReid MicaiahReid deleted the fix-tsv-ingestion branch October 15, 2023 20:28
github-actions bot pushed a commit that referenced this pull request Jan 25, 2024
## [1.2.0](v1.1.1...v1.2.0) (2024-01-25)

### Features

* add bad request support ([7abe4f6](7abe4f6))
* add inscription transfer destination schema ([526de7a](526de7a))
* add jubilee support for inscription_revealed schemas ([#470](#470)) ([823f430](823f430))
* add Wallet Descriptor Support for Transaction Indexing ([959da29](959da29))
* broadcast ObserverEvent::BitcoinPredicateTriggered on successful requests ([6407e2c](6407e2c))
* broadcast ObserverEvent::BitcoinPredicateTriggered on successful requests ([a6164ea](a6164ea))
* introduce signet mode ([549c775](549c775))

### Bug Fixes

* address review ([687e2ae](687e2ae))
* broken tests ([0e6359e](0e6359e))
* broken tests ([7a0209b](7a0209b))
* buffer decoding of archive file to reduce memory usage ([#450](#450)) ([f1b89f7](f1b89f7)), closes [#401](#401)
* build error ([88f597e](88f597e))
* enable default features for hiro-system-kit ([867424a](867424a))
* skip empty chunks when decoding gz ([b4ce82f](b4ce82f))
* **stacks-indexer:** prevent subtract with overflow ([#449](#449)) ([d8d9979](d8d9979))
* update ordhook URLs on typescript client ([9462ae3](9462ae3))
* warnings ([126d049](126d049))
Copy link

🎉 This PR is included in version 1.2.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

Optimize memory at boot when ingesting tsv events
2 participants