Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem: there's no compact historical state storage #722

Closed
wants to merge 17 commits into from

Commits on Nov 27, 2022

  1. Problem: there's no compact historical state storage

    Closes: crypto-org-chain#704
    Solution:
    - Integration version store and streaming service.
    
    multiple backends
    
    db size benchmark
    
    support mdbx backend through tm-db
    
    store latest version
    
    support GetLatestVersion
    
    query multistore
    
    test versiondb streamer
    
    fix lint
    
    fix state listener
    
    temp
    
    fix state listening
    
    optimize common case
    
    fix lint
    
    try to fix mdbx build
    
    update cosmos-sdk
    
    fix clone append
    
    add test case
    
    fix subkey problem in history index
    
    revert chunking, hard to work with variable length key
    
    support iterator
    
    check future height
    
    fix lint
    
    new state listener
    
    fix latest state in query
    
    fix integration test
    
    fix prune node test
    
    update dependency
    
    add utility to read from file streamer
    
    Update versiondb/multistore.go
    
    Signed-off-by: yihuang <huang@crypto.com>
    
    add unit test
    
    create common backend test cases
    
    update dependency
    
    update with new file streamer format
    
    Problem: python3.10 is not used in integration tests
    
    Solution:
    - start using python3.10, prepare to later PRs which need the new features
    - update nixpkgs nesserary for the nix stuff to work.
    
    python-roaring64
    
    remove debug log
    
    add test cases, improve coverage
    yihuang committed Nov 27, 2022
    Configuration menu
    Copy the full SHA
    3bcb198 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2022

  1. fix streamer config

    yihuang committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    7d1201a View commit details
    Browse the repository at this point in the history
  2. fix streamer decoding

    yihuang committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    66e50d4 View commit details
    Browse the repository at this point in the history
  3. fix linters

    yihuang committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    850ed66 View commit details
    Browse the repository at this point in the history
  4. home path

    yihuang committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    1f6eebb View commit details
    Browse the repository at this point in the history
  5. fix integration test

    yihuang committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    856b18f View commit details
    Browse the repository at this point in the history
  6. fix unit test

    yihuang committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    7b93785 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2022

  1. fix upgrade test

    yihuang committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    234ad32 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2022

  1. update to upstream

    yihuang committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    14be5b6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3af8413 View commit details
    Browse the repository at this point in the history
  3. fix gravity test

    yihuang committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    b686422 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8e981c4 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2022

  1. revert mdbx from this PR

    yihuang committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    eef8781 View commit details
    Browse the repository at this point in the history
  2. remove FIXME

    yihuang committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    611e2f3 View commit details
    Browse the repository at this point in the history
  3. remove unused functions

    yihuang committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    bde66c1 View commit details
    Browse the repository at this point in the history
  4. Update integration_tests/test_benchmark_storage.py

    Co-authored-by: mmsqe <tqd0800210105@gmail.com>
    Signed-off-by: yihuang <huang@crypto.com>
    yihuang and mmsqe committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    659a562 View commit details
    Browse the repository at this point in the history
  5. remove TODO

    yihuang committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    f46daef View commit details
    Browse the repository at this point in the history