Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor gcs part 2 random access file #41592

Conversation

vnghia
Copy link
Contributor

@vnghia vnghia commented Jul 21, 2020

@mihaimaruseac
This PR add stat_cache for NewRandomAccessFile and LoadBufferFromGCS. It also fixes some problems related to TF_OUT_OF_RANGE because the core implementation does not consider TF_OUT_OF_RANGE as an error.

Now we have to wait for the next release of google-cloud-cpp. That release will contain the features needed for compose mode of NewAppendableFile and some gcs filesystem ops ( Stat, GetChildren )

In the mean time, I will send you some PRs to add tests ported from core implementation.

@google-ml-butler google-ml-butler bot added the size:M CL Change Size: Medium label Jul 21, 2020
@gbaned gbaned self-assigned this Jul 21, 2020
@gbaned gbaned added this to Assigned Reviewer in PR Queue via automation Jul 21, 2020
PR Queue automation moved this from Assigned Reviewer to Approved by Reviewer Jul 21, 2020
@google-ml-butler google-ml-butler bot added kokoro:force-run Tests on submitted change ready to pull PR ready for merge process labels Jul 21, 2020
@kokoro-team kokoro-team removed the kokoro:force-run Tests on submitted change label Jul 21, 2020
@tensorflow-copybara tensorflow-copybara merged commit 286e101 into tensorflow:master Jul 21, 2020
PR Queue automation moved this from Approved by Reviewer to Merged Jul 21, 2020
@vnghia vnghia deleted the refactor-gcs-part-2-random-access-file branch July 22, 2020 03:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla: yes ready to pull PR ready for merge process size:M CL Change Size: Medium
Projects
PR Queue
  
Merged
Development

Successfully merging this pull request may close these issues.

None yet

6 participants