Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(service): Add service memory read support #121

Merged
merged 5 commits into from
Mar 8, 2022

Conversation

sundy-li
Copy link
Contributor

@sundy-li sundy-li commented Mar 8, 2022

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

Summary about this PR

Which can be used in datafuselabs/databend#3586
We need read whole HTTP stream into memory and use this backend for parquet load.

@Xuanwo
Copy link
Member

Xuanwo commented Mar 8, 2022

Cool, I used to think memory backend is test only

@sundy-li sundy-li marked this pull request as draft March 8, 2022 09:48
@sundy-li
Copy link
Contributor Author

sundy-li commented Mar 8, 2022

Maybe we should use Vec<Bytes> to support multiple Bytes?

src/services/memory.rs Outdated Show resolved Hide resolved
src/services/memory.rs Outdated Show resolved Hide resolved
@Xuanwo
Copy link
Member

Xuanwo commented Mar 8, 2022

Maybe we should use Vec<Bytes> to support multiple Bytes?

I'm afraid that we need to have a HashMap<String, Bytes> here.

@sundy-li sundy-li marked this pull request as ready for review March 8, 2022 10:06
@Xuanwo Xuanwo changed the title feat(service): Add service memory feat(service): Add service memory read support Mar 8, 2022
src/services/memory.rs Outdated Show resolved Hide resolved
@Xuanwo Xuanwo mentioned this pull request Mar 8, 2022
4 tasks
@Xuanwo
Copy link
Member

Xuanwo commented Mar 8, 2022

Nice work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants