Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate dag store into mount implementation #565

Merged

Conversation

dirkmc
Copy link
Contributor

@dirkmc dirkmc commented Jul 7, 2021

No description provided.

@dirkmc dirkmc force-pushed the feat/mount-implementation-dagstore branch 7 times, most recently from fea026e to bcc6fc6 Compare July 8, 2021 12:26
@dirkmc dirkmc force-pushed the feat/mount-implementation-dagstore branch 2 times, most recently from db723d7 to d6ed761 Compare July 9, 2021 09:32
@dirkmc dirkmc force-pushed the feat/mount-implementation-dagstore branch from d6ed761 to c61c717 Compare July 9, 2021 09:42
@aarshkshah1992 aarshkshah1992 marked this pull request as ready for review July 9, 2021 11:57
@aarshkshah1992 aarshkshah1992 merged commit 4d88b49 into feat/mount-implementation Jul 9, 2021
@aarshkshah1992 aarshkshah1992 deleted the feat/mount-implementation-dagstore branch July 9, 2021 11:57
aarshkshah1992 added a commit that referenced this pull request Jul 11, 2021
* dagstore lotus mount impl

* refactor: nicer error messages

* mount api tests

* refactor: integrate dag store (#565)

Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>
Comment on lines +56 to +62
// TODO: Can I rely on AcquireShard to return an error if the context times out?
//select {
//case <-ctx.Done():
// return ctx.Err()
//case res := <-resch:
// return nil, res.Error
//}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not yet. If you need this feature we need to prioritise this: filecoin-project/dagstore#39

Comment on lines +91 to +97
// TODO: Can I rely on RegisterShard to return an error if the context times out?
//select {
//case <-ctx.Done():
// return ctx.Err()
//case res := <-resch:
// return res.Error
//}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as above!

dirkmc added a commit that referenced this pull request Jul 13, 2021
* refactor: integrate dag store into retrieval market

* fix all tests and the padding issue

* refactor: move mount from shared testutil to dagstore dir

* refactor: add tests for lazy blockstore

* refactor: code cleanup

* feat: update go-car to latest

* Dagstore lotus mount Implementation with tests (#564)

* dagstore lotus mount impl

* refactor: nicer error messages

* mount api tests

* refactor: integrate dag store (#565)

Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>

* some storage market fixes by aarsh

* fix: better error messages in DAG store wrapper

* refactor: simplify mock dag store wrapper

* fix: TestBounceConnectionDealTransferOngoing

* refactor: remove some commented out code

* refactor: closable blockstore interface to use full blockstore

* fix: TestBounceConnectionDealTransferUnsealing

* refactor: add comment explaining lotus mount template

* test: verify that the lazy blockstore is only initialized once

* fix: comment

* fix: always finalize blockstore before reaching complete state (#567)

Co-authored-by: aarshkshah1992 <aarshkshah1992@gmail.com>
aarshkshah1992 added a commit that referenced this pull request Jul 13, 2021
* dag store lotus mount

* storage client code complete-tests remain

* storage miner first draft

* second draft

* provider state tests are now working

* most unit tests working and more unit tests

* refactor: car store trackers (#559)

* Apply suggestions from code review

Co-authored-by: dirkmc <dirkmdev@gmail.com>

* nits and review

* integration testing changes

* storage test harness changes

* added more TODOs

* fix itests for storage

* get offline deal tests working

* tests work

* more tests

* integration tests

* fix blockstore finalize

* Integrate CARv2 blockstore in the retrieval market (#560)

* refactor: integrate dag store into retrieval market

* fix all tests and the padding issue

* refactor: move mount from shared testutil to dagstore dir

* refactor: add tests for lazy blockstore

* refactor: code cleanup

* feat: update go-car to latest

* Dagstore lotus mount Implementation with tests (#564)

* dagstore lotus mount impl

* refactor: nicer error messages

* mount api tests

* refactor: integrate dag store (#565)

Co-authored-by: Dirk McCormick <dirkmdev@gmail.com>

* some storage market fixes by aarsh

* fix: better error messages in DAG store wrapper

* refactor: simplify mock dag store wrapper

* fix: TestBounceConnectionDealTransferOngoing

* refactor: remove some commented out code

* refactor: closable blockstore interface to use full blockstore

* fix: TestBounceConnectionDealTransferUnsealing

* refactor: add comment explaining lotus mount template

* test: verify that the lazy blockstore is only initialized once

* fix: comment

* fix: always finalize blockstore before reaching complete state (#567)

Co-authored-by: aarshkshah1992 <aarshkshah1992@gmail.com>

Co-authored-by: dirkmc <dirkmdev@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants