Add Intel® QuickAssist Technology (Intel® QAT) support as contrib extensions

[ipuustin]

Title:

Add Intel® QuickAssist Technology (Intel® QAT) support as contrib extensions

Description:

Next generation Intel® QAT support with Intel® Xeon® Scalable processors will feature an Intel® QAT cryptography and compression acceleration engine. In order to use it, two new Envoy contrib extensions are proposed:

1. QATzip compression extension. This extension uses QATzip library (https://github.com/intel/QATzip) to implement accelerated HTTP compression. This can have a valid use case in scenarios such as service meshes, where the traffic within the mesh may be compressed without consuming CPU cycles.
2. QAT private key provider. This extension will use qatlib library (https://github.com/intel/qatlib) to accelerate RSA operations in handshakes. The extension will look a bit like the existing cryptomb private key provider. The use case is to move the expensive cryptographic operations away from the CPU to the accelerator device, leaving CPU cycles for other use.

Two new library dependencies would be added: QATzip library for compression and qatlib for accessing the hardware. Support for Intel® QAT is already present in the mainline Linux kernel and in Kubernetes device plugins (to expose the device files to containers). There are previous generations of Intel QAT® hardware devices, but they are not supported by these extensions.

Relevant links:

https://github.com/intel/intel-device-plugins-for-kubernetes/blob/main/cmd/qat_plugin/README.md
https://www.intel.com/content/www/us/en/architecture-and-technology/intel-quick-assist-technology-overview.html
https://www.intel.com/content/www/us/en/developer/topic-technology/open/quick-assist-technology/overview.html

[github-actions]

This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 7 days unless it is tagged "help wanted" or "no stalebot" or other activity occurs. Thank you for your contributions.

[github-actions]

This issue has been automatically closed because it has not had activity in the last 37 days. If this issue is still valid, please ping a maintainer and ask them to label it as "help wanted" or "no stalebot". Thank you for your contributions.

[sjtuzbk]

@ipuustin QAT technology is highly effective in enhancing the performance of Envoy. Could you share a contrib extension of QATzip?

[soulxu]

Hi, @sjtuzbk you can find out qatzip extension at https://github.com/intel/envoy/tree/release-1.19-intel/contrib/qat/compression/qatzip/compressor, you also can reach me on the envoy Slack for your usecase and question.

[sjtuzbk]

Hi, @sjtuzbk you can find out qatzip extension at https://github.com/intel/envoy/tree/release-1.19-intel/contrib/qat/compression/qatzip/compressor, you also can reach me on the envoy Slack for your usecase and question.

Thanks for your reply! I will try it.

[soulxu]

Hi, @sjtuzbk May I get your email? It will be great we can have a talk about the usecase of qatzip. Or you can contact me, my email is soulxu@gmail.com, glad to see we can get contact.