Skip to content

Bump tensorflow to 2.11rc2 #1729

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Nov 20, 2022
Merged

Bump tensorflow to 2.11rc2 #1729

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
2c8f33c
Bump tensorflow to 2.11rc2
yongtang Nov 2, 2022
e8d2060
Update
yongtang Nov 4, 2022
ea36d1f
Bump to 2.11
yongtang Nov 18, 2022
d040843
Disable oss on windows
yongtang Nov 19, 2022
c95b3f1
Add python 3.11
yongtang Nov 20, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
45 changes: 39 additions & 6 deletions .github/workflows/build.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -138,7 +138,7 @@ jobs:
runs-on: macOS-11
strategy:
matrix:
python: ['3.7', '3.8', '3.9', '3.10']
python: ['3.7', '3.8', '3.9', '3.10', '3.11']
steps:
- uses: actions/checkout@v2
- uses: actions/download-artifact@v1
Expand Down Expand Up @@ -252,7 +252,7 @@ jobs:
runs-on: ubuntu-20.04
strategy:
matrix:
python: ['3.7', '3.8', '3.9', '3.10']
python: ['3.7', '3.8', '3.9', '3.10', '3.11']
steps:
- uses: actions/checkout@v2
- uses: actions/download-artifact@v1
Expand Down Expand Up @@ -365,7 +365,7 @@ jobs:
runs-on: windows-latest
strategy:
matrix:
python: ['3.7', '3.8', '3.9', '3.10']
python: ['3.7', '3.8', '3.9', '3.10', '3.11']
steps:
- uses: actions/checkout@v2
- uses: actions/download-artifact@v1
Expand Down Expand Up @@ -468,6 +468,10 @@ jobs:
with:
name: macOS-3.10-wheel
path: macOS-3.10-wheel
- uses: actions/download-artifact@v1
with:
name: macOS-3.11-wheel
path: macOS-3.11-wheel
- uses: actions/download-artifact@v1
with:
name: Linux-3.7-wheel
Expand All @@ -484,6 +488,10 @@ jobs:
with:
name: Linux-3.10-wheel
path: Linux-3.10-wheel
- uses: actions/download-artifact@v1
with:
name: Linux-3.11-wheel
path: Linux-3.11-wheel
- uses: actions/download-artifact@v1
with:
name: Windows-3.7-wheel
Expand All @@ -500,21 +508,28 @@ jobs:
with:
name: Windows-3.10-wheel
path: Windows-3.10-wheel
- uses: actions/download-artifact@v1
with:
name: Windows-3.11-wheel
path: Windows-3.11-wheel
- run: |
set -e -x
mkdir -p wheelhouse
cp macOS-3.7-wheel/*.whl wheelhouse/
cp macOS-3.8-wheel/*.whl wheelhouse/
cp macOS-3.9-wheel/*.whl wheelhouse/
cp macOS-3.10-wheel/*.whl wheelhouse/
cp macOS-3.11-wheel/*.whl wheelhouse/
cp Linux-3.7-wheel/*.whl wheelhouse/
cp Linux-3.8-wheel/*.whl wheelhouse/
cp Linux-3.9-wheel/*.whl wheelhouse/
cp Linux-3.10-wheel/*.whl wheelhouse/
cp Linux-3.11-wheel/*.whl wheelhouse/
cp Windows-3.7-wheel/*.whl wheelhouse/
cp Windows-3.8-wheel/*.whl wheelhouse/
cp Windows-3.9-wheel/*.whl wheelhouse/
cp Windows-3.10-wheel/*.whl wheelhouse/
cp Windows-3.11-wheel/*.whl wheelhouse/
ls -la wheelhouse/
sha256sum wheelhouse/*.whl
- uses: actions/upload-artifact@v2
Expand Down Expand Up @@ -605,7 +620,7 @@ jobs:
runs-on: macOS-11
strategy:
matrix:
python: ['3.7', '3.8', '3.9', '3.10']
python: ['3.7', '3.8', '3.9', '3.10', '3.11']
steps:
- uses: actions/download-artifact@v1
with:
Expand Down Expand Up @@ -652,7 +667,7 @@ jobs:
runs-on: ubuntu-20.04
strategy:
matrix:
python: ['3.7', '3.8', '3.9', '3.10']
python: ['3.7', '3.8', '3.9', '3.10', '3.11']
steps:
- uses: actions/download-artifact@v1
with:
Expand Down Expand Up @@ -692,7 +707,7 @@ jobs:
runs-on: windows-latest
strategy:
matrix:
python: ['3.7', '3.8', '3.9', '3.10']
python: ['3.7', '3.8', '3.9', '3.10', '3.11']
steps:
- uses: actions/download-artifact@v1
with:
Expand Down Expand Up @@ -744,6 +759,10 @@ jobs:
with:
name: macOS-3.10-nightly
path: macOS-3.10-nightly
- uses: actions/download-artifact@v1
with:
name: macOS-3.11-nightly
path: macOS-3.11-nightly
- uses: actions/download-artifact@v1
with:
name: Linux-3.7-nightly
Expand All @@ -760,6 +779,10 @@ jobs:
with:
name: Linux-3.10-nightly
path: Linux-3.10-nightly
- uses: actions/download-artifact@v1
with:
name: Linux-3.11-nightly
path: Linux-3.11-nightly
- uses: actions/download-artifact@v1
with:
name: Windows-3.7-nightly
Expand All @@ -776,21 +799,28 @@ jobs:
with:
name: Windows-3.10-nightly
path: Windows-3.10-nightly
- uses: actions/download-artifact@v1
with:
name: Windows-3.11-nightly
path: Windows-3.11-nightly
- run: |
set -e -x
mkdir -p dist
cp macOS-3.7-nightly/tensorflow_io_nightly*.whl dist/
cp macOS-3.8-nightly/tensorflow_io_nightly*.whl dist/
cp macOS-3.9-nightly/tensorflow_io_nightly*.whl dist/
cp macOS-3.10-nightly/tensorflow_io_nightly*.whl dist/
cp macOS-3.11-nightly/tensorflow_io_nightly*.whl dist/
cp Linux-3.7-nightly/tensorflow_io_nightly*.whl dist/
cp Linux-3.8-nightly/tensorflow_io_nightly*.whl dist/
cp Linux-3.9-nightly/tensorflow_io_nightly*.whl dist/
cp Linux-3.10-nightly/tensorflow_io_nightly*.whl dist/
cp Linux-3.11-nightly/tensorflow_io_nightly*.whl dist/
cp Windows-3.7-nightly/tensorflow_io_nightly*.whl dist/
cp Windows-3.8-nightly/tensorflow_io_nightly*.whl dist/
cp Windows-3.9-nightly/tensorflow_io_nightly*.whl dist/
cp Windows-3.10-nightly/tensorflow_io_nightly*.whl dist/
cp Windows-3.11-nightly/tensorflow_io_nightly*.whl dist/
ls -la dist/
sha256sum dist/*.whl
- uses: pypa/gh-action-pypi-publish@master
Expand All @@ -805,14 +835,17 @@ jobs:
cp macOS-3.8-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp macOS-3.9-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp macOS-3.10-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp macOS-3.11-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Linux-3.7-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Linux-3.8-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Linux-3.9-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Linux-3.10-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Linux-3.11-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Windows-3.7-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Windows-3.8-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Windows-3.9-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Windows-3.10-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
cp Windows-3.11-nightly/tensorflow_io_gcs_filesystem_nightly*.whl dist/
ls -la dist/
sha256sum dist/*.whl
- uses: pypa/gh-action-pypi-publish@master
Expand Down
14 changes: 7 additions & 7 deletions WORKSPACE
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,11 +7,11 @@ http_archive(
name = "zlib",
build_file = "//third_party:zlib.BUILD",
patch_cmds = ["""sed -i.bak '29i\\'$'\\n#include<zconf.h>\\n' contrib/minizip/crypt.h"""],
sha256 = "91844808532e5ce316b3c010929493c0244f3d37593afd6de04f71821d5136d9",
strip_prefix = "zlib-1.2.12",
sha256 = "b3a24de97a8fdbc835b9833169501030b8977031bcb54b3b3ac13740f846ab30",
strip_prefix = "zlib-1.2.13",
urls = [
"https://storage.googleapis.com/mirror.tensorflow.org/zlib.net/zlib-1.2.12.tar.gz",
"https://zlib.net/zlib-1.2.12.tar.gz",
"https://storage.googleapis.com/mirror.tensorflow.org/zlib.net/zlib-1.2.13.tar.gz",
"https://zlib.net/zlib-1.2.13.tar.gz",
],
)

Expand Down Expand Up @@ -115,10 +115,10 @@ pip_install()

http_archive(
name = "org_tensorflow",
sha256 = "b5a1bb04c84b6fe1538377e5a1f649bb5d5f0b2e3625a3c526ff3a8af88633e8",
strip_prefix = "tensorflow-2.10.0",
sha256 = "99c732b92b1b37fc243a559e02f9aef5671771e272758aa4aec7f34dc92dac48",
strip_prefix = "tensorflow-2.11.0",
urls = [
"https://github.com/tensorflow/tensorflow/archive/refs/tags/v2.10.0.tar.gz",
"https://github.com/tensorflow/tensorflow/archive/refs/tags/v2.11.0.tar.gz",
],
)

Expand Down
8 changes: 6 additions & 2 deletions tensorflow_io/core/filesystems/BUILD
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,8 +38,12 @@ cc_library(
"//tensorflow_io/core/filesystems/az",
"//tensorflow_io/core/filesystems/hdfs",
"//tensorflow_io/core/filesystems/http",
"//tensorflow_io/core/filesystems/oss",
"//tensorflow_io/core/filesystems/s3",
],
] + select({
"@bazel_tools//src/conditions:windows": [],
"//conditions:default": [
"//tensorflow_io/core/filesystems/oss",
],
}),
alwayslink = 1,
)
5 changes: 5 additions & 0 deletions tensorflow_io/core/filesystems/filesystem_plugins.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,10 @@ limitations under the License.
TFIO_PLUGIN_EXPORT void TF_InitPlugin(TF_FilesystemPluginInfo* info) {
info->plugin_memory_allocate = tensorflow::io::plugin_memory_allocate;
info->plugin_memory_free = tensorflow::io::plugin_memory_free;
info->num_schemes = 7;
#if !defined(_MSC_VER)
info->num_schemes = 8;
#endif
info->ops = static_cast<TF_FilesystemPluginOps*>(
tensorflow::io::plugin_memory_allocate(info->num_schemes *
sizeof(info->ops[0])));
Expand All @@ -40,5 +43,7 @@ TFIO_PLUGIN_EXPORT void TF_InitPlugin(TF_FilesystemPluginInfo* info) {
tensorflow::io::hdfs::ProvideFilesystemSupportFor(&info->ops[4], "hdfs");
tensorflow::io::hdfs::ProvideFilesystemSupportFor(&info->ops[5], "viewfs");
tensorflow::io::hdfs::ProvideFilesystemSupportFor(&info->ops[6], "har");
#if !defined(_MSC_VER)
tensorflow::io::oss::ProvideFilesystemSupportFor(&info->ops[7], "oss");
#endif
}
2 changes: 1 addition & 1 deletion tensorflow_io/core/kernels/avro/parse_avro_kernels.cc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,9 +18,9 @@ limitations under the License.
#include "tensorflow/core/framework/op_kernel.h"
#include "tensorflow/core/framework/tensor.h"
#include "tensorflow/core/framework/tensor_util.h"
#include "tensorflow/core/lib/core/blocking_counter.h"
#include "tensorflow/core/lib/core/threadpool.h"
#include "tensorflow/core/lib/gtl/array_slice.h"
#include "tensorflow/core/platform/blocking_counter.h"
#include "tensorflow_io/core/kernels/avro/utils/avro_parser_tree.h"

namespace tensorflow {
Expand Down
2 changes: 1 addition & 1 deletion tensorflow_io/python/ops/version_ops.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,4 +15,4 @@
"""version_ops"""

version = "0.27.0"
require = "tensorflow>=2.10.0,<2.11.0"
require = "tensorflow>=2.11.0,<2.12.0"
1 change: 1 addition & 0 deletions third_party/toolchains/tf/BUILD.tpl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ cc_library(
"@com_google_absl//absl/container:flat_hash_map",
"@com_google_absl//absl/container:flat_hash_set",
"@com_google_absl//absl/container:inlined_vector",
"@com_google_absl//absl/status",
"@com_google_absl//absl/strings",
"@com_google_absl//absl/strings:cord",
"@com_google_absl//absl/types:optional",
Expand Down