Skip to content

Intel® Extension for TensorFlow* 2.13.0.0

Compare
Choose a tag to compare
@zhangxiaoli73 zhangxiaoli73 released this 28 Jul 05:44

Major Features and Improvements

Intel® Extension for TensorFlow* extended official TensorFlow capability to run TensorFlow workloads on Intel® Data Center Max GPU, Intel® Data Center GPU Flex Series, Intel® Xeon® Scalable Processors. This release contains following major features and improvement:

  • Intel® Extension for TensorFlow* supported TensorFlow version was successfully upgraded to Google latest released TensorFlow2.13, which is the unique supported TensorFlow version in this release.
  • Refined Intel® Extension for TensorFlow* version to four digits version format v2.13.0.0 based on the three digits from stock TensorFlow v2.13.0 with the last digit incrementing per extension release. This will make it easier for users to understand Intel® Extension for TensorFlow* and stock TensorFlow version mapping relationship.
  • Unified one XPU package to support both CPU and GPU backend and provided flexibility for users on different CPU or GPU hardware platforms.
  • Supported TensorFlow Serving running above Intel® Extension for TensorFlow* to provide serving service in a production environment. Learn more in the TensorFlow Serving Installation Guide.
  • Enabled INT8 quantization by oneDNN Graph API as default solution on GPU in Intel® Extension for TensorFlow* to provide better INT8 user experience together with Intel® Neural Compressor >= 2.2.
  • Add OPs performance optimization
    • Enabled SYCL native BFloat16 data type support.
    • SpaceToBatchND/BatchToSpaceND 1.1x ~ 1.8x improvement compare with last release.
    • SelectOP 1.3x ~ 1.7x improvement compare with last release.
    • LstmEltwiseKernel 1.28x ~ 1.7x improvement compare with last release.
    • BucketizeOp 4x improvement compare with last release.
  • Supported new Ops to cover majority of TensorFlow 2.13.0 Ops.
  • Dynamic loading Intel® Advanced Vector Extensions AVX2 and AVX512 Instructions by adapting to user's hardware to maximize CPU performance.
  • Supported FP16 data type with AMX simulation on 4th Gen Intel® Xeon® Scalable processors (code name Sapphire Rapids).
  • This release started to provide product support for second generation Intel® Xeon® Scalable Processors and newer (such as Cascade Lake, Cooper Lake, Ice Lake and Sapphire Rapids).
  • This release continued to provide experimental support for Intel® Arc™ A-Series GPUs on Windows Subsystem for Linux 2 with Ubuntu Linux installed and native Ubuntu Linux.

Known Issues

  • FP64 is not natively supported by the Intel® Data Center GPU Flex Series platform. If you run any AI workload with FP64 kernel on that platform, the workload will exit with exception as 'XXX' Op uses fp64 data type, while fp64 instructions are not supported on the platform.
  • GLIBC++ version mismatch may cause workload exit with exception Can not found any devices. To check runtime environment on your host, please run itex/tools/env_check.sh. Please try env_check.sh to confirm.

Documents