move opensearch provider to new structure

[josix]

related: #46045

• fix unit tests

---

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

[potiuk]

This one will have to be solved differentlly:

  Using Python 3.9.21 environment at: /usr/local
  Uninstalled 4 packages in 400ms
   - aiobotocore==2.19.0
   - opensearch-py==2.8.0
   - s3fs==2024.12.0
   - yandexcloud==0.328.0
  + uv pip install --system --upgrade boto3 botocore 'oss2>=2.14.0' 'cryptography<43.0.0' 'requests!=2.32.*,<3.0.0,>=2.24.0'
  Using Python 3.9.21 environment at: /usr/local
  Resolved 19 packages in 469ms
  Prepared 3 packages in 476ms
  Uninstalled 3 packages in 928ms
  Installed 3 packages in 143ms
   - boto3==1.36.3
   + boto3==1.36.9
   - botocore==1.36.3
   + botocore==1.36.9
   - requests==2.32.3
   + requests==2.31.0
  + set +xe 
  apache-airflow-providers-opensearch 1.6.0 requires opensearch-py, which is not installed.

When installing latest botocore, opensearch-py gets uninstalled and opensearch provider needs it. Once we split it out, right now UV will (correctly) complain that the apache-airflow-providers-opensearch cannot be installed. I will have to think how to solve it (don't know yet) :) .

That's an interesting find.

[potiuk]

This one should be rebased after #46289 -> the latest boto tests removed opensearch, but recent apache.beam releases already removed requests limitation that blocked it.

[josix]

Thank you so much for helping to resolve it 🙇🏻‍♂️