Skip to content

Conversation

@yongtang
Copy link
Member

@yongtang yongtang commented Sep 9, 2021

This PR tries to fix the temporary file issue in s3 where temp files are created within the current directory.

This PR maintains the behavior of old s3 file system.

This PR fixes #1519.

Signed-off-by: Yong Tang yong.tang.github@outlook.com

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
kS3FileSystemAllocationTag, nullptr, "_s3_filesystem_XXXXXX",
kS3FileSystemAllocationTag,
#if defined(_MSC_VER)
nullptr,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yongtang where will be the temporary files be created if it is a nullptr?

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
@yongtang
Copy link
Member Author

yongtang commented Sep 9, 2021

@kvignesh1420 The temp file will be on the same directory on Windows. Added a comment in the code which matches:
https://github.com/tensorflow/tensorflow/blob/17774a11b576186e439174298af82b096dcd5582/tensorflow/core/platform/s3/s3_file_system.cc#L52-L58

Copy link
Member

@kvignesh1420 kvignesh1420 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @yongtang

@kvignesh1420 kvignesh1420 merged commit 97b145e into tensorflow:master Sep 10, 2021
@yongtang yongtang deleted the 1519-s3 branch September 10, 2021 03:50
dopiera pushed a commit to Unoperate/tensorflow_io that referenced this pull request Dec 3, 2021
* Fix temporary file issue

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

* Add additional comment for reason of passing nullptr.

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
zheolong pushed a commit to zheolong/io-1 that referenced this pull request Jul 24, 2025
* Fix temporary file issue

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>

* Add additional comment for reason of passing nullptr.

Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

S3 driver creates temporary files in current directory

3 participants