Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

new storage engine #393

Open
67 tasks
lysevi opened this issue May 12, 2017 · 0 comments
Open
67 tasks

new storage engine #393

lysevi opened this issue May 12, 2017 · 0 comments
Assignees
Milestone

Comments

@lysevi
Copy link
Owner

lysevi commented May 12, 2017

  • - mapped file.
  • - COLA:
    • - addLink(address, maxtime)
    • - queryInterval
    • - return links ordered by time.
    • - queryTimepoint
    • - erase value: mark link as removed and dont return as result.
      • - on merge levels?
    • - interface to fsync
    • - COLA fsync updated values.
    • - aggregate values in index?
    • - less allocations
    • - index format: |header| lvlHaders | COLA| ??
  • - Volume:
    • - fixed size
    • - memory mapped file.
    • - |Header| Index1 | Index2 => <= Chunk3 | Chunk2 | Chunk1|
    • - add chunk and update index
    • - query chunk by interval
    • - query chunk to timepoint.
    • - addChunk - status as result:
      • - index region is full
      • - chunk region is full - can owerwrite
      • - success
    • - file flush politics:
      • - max speed
      • - safety
    • - minMaxes of time in header.
    • - readonly mode.
    • - erase value:
      • - from index
      • - mark chunk as removed.
      • - remove empty index?
    • - owerwrite old.
    • - owerwrite chunk with same chunk_id (not filled).
    • - thread safety.
  • - VolumeManager.
    • - common test pass.
    • - thread safety.
    • - integrate to engine.
    • - decrease reads.
    • - check volume header minmaxes when read.
      • - apply_for_each_volume recv. predicate.
    • - open volumes as 'readonly' on read
    • - one or many volumes
    • - owerwrite old value if single volume.
    • - profile
  • - multiporcess mode

  • - remove:
    • - chunk repack
    • - WAL
    • - PAGE
    • - memory storage
    • - manifest?
    • - strategy
    • - dropper
    • - unused options
    • - flag from measurement?

  • - new compression method
    • - oriented to bit (currently to byte).

  • - need update changelog.
  • - need update readme.
  • - need update protocol version.
  • - need update storage version.
  • - need update settings save/load.
  • - need example.
  • - need update papers.
@lysevi lysevi added the storage label May 12, 2017
@lysevi lysevi added this to the storage milestone May 12, 2017
@lysevi lysevi self-assigned this May 12, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant