Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chunked reading with -m plain #40

Open
cfcs opened this issue Nov 7, 2017 · 2 comments
Open

chunked reading with -m plain #40

cfcs opened this issue Nov 7, 2017 · 2 comments

Comments

@cfcs
Copy link

cfcs commented Nov 7, 2017

It would be nice to have a

read_sub : string (** filename *) ->
             ?start:int ->
             int (** length *) -> string

-like function to limit the amount of duplicate memory lying around

@MisterDA
Copy link
Contributor

Is it necessary in the first place to split files in chunks with the plain module? If the chunks aren't directly accessible we're just re-concatenating the files everytime it's accessed. I guess the size limit is just the length of OCaml strings, right?

@cfcs
Copy link
Author

cfcs commented Aug 11, 2022

@MisterDA I believe so, yes - but OCaml strings are pretty small on 32bit machines. For 64bit it's probably not needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants