Skip to content

/ arkdb

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support more additional formats (i.e. fst, feather, etc?) #3

Open
cboettig opened this issue Jun 27, 2018 · 3 comments
Open

Support more additional formats (i.e. fst, feather, etc?) #3

cboettig opened this issue Jun 27, 2018 · 3 comments

Comments

@cboettig
Copy link
Member

@cboettig cboettig commented Jun 27, 2018 •
edited

  • arkdb currently hardwires write_tsv/read_tsv for I/O. This should be pluggable.

done, now supports readr and base utils table I/O

Would be nice to take advantage of things like faster speed of fst::read_fst /fst::write_fst, but looks like fst does not support the ability to append, making it impossible to stream in chunks.
@cboettig cboettig mentioned this issue Jul 16, 2018
Closed
11 of 19 tasks complete
@richfitz
Copy link
Member

@richfitz richfitz commented Jul 18, 2018

Relevant issue for fst: fstpackage/fst#9
@richfitz
Copy link
Member

@richfitz richfitz commented Jul 18, 2018 •
edited

...and fstpackage/fst#24
fstpackage/fst#153
fstpackage/fst#91
@richfitz richfitz mentioned this issue Jul 18, 2018
Closed
0 of 6 tasks complete
@cboettig cboettig mentioned this issue Jul 21, 2018
Closed
9 of 12 tasks complete
@cboettig cboettig changed the title Support additional formats Support more additional formats (i.e. fst, feather, etc?) Aug 2, 2018
@cboettig
Copy link
Member Author

@cboettig cboettig commented Sep 17, 2020

can also consider supporting non-DBI-based backends! e.g. LMDB, see example in https://github.com/cboettig/taxalight/
@cboettig cboettig closed this Sep 17, 2020
@cboettig cboettig reopened this Sep 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
@cboettig @richfitz
You can’t perform that action at this time.