Enable Elasticsearch provider integration tests in CI

[Owen-CH-Leung]

elasticsearch was explicitly listed in DISABLE_TESTABLE_INTEGRATIONS_FROM_CI. This meant the test was never run in CI.

Fix

• Create a proper integration test at providers/elasticsearch/tests/integration/elasticsearch/log/test_es_remote_log_io.py that uses the Breeze ES service (http://elasticsearch:9200) directly - the same pattern used by Mongo
  and Redis providers.
• Move tests that involves IO with elasticsearch to integration test
• Remove the now-unused testcontainers fixture pyproject.toml.
• Remove elasticsearch from DISABLE_TESTABLE_INTEGRATIONS_FROM_CI so the integration test runs as a separate CI job whenever the Elasticsearch provider is affected.

[jason810496]

Thanks Owen for the follow-up!

FAILED tests/test_selective_checks.py::test_expected_output_pull_request_main[All tests should be run when devel-common/ change] - AssertionError: Correct value for 'testable-providers-integrations'
assert "['celery', 'cassandra', 'drill', 'elasticsearch', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']" == "['celery', 'cassandra', 'drill', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']"
  
  - ['celery', 'cassandra', 'drill', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']
  + ['celery', 'cassandra', 'drill', 'elasticsearch', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']
  ?                                 +++++++++++++++++

LGTM overall, the only CI failure comes from:

airflow/dev/breeze/tests/test_selective_checks.py

Line 1124 in da4ce85

"testable-providers-integrations": "['celery', 'cassandra', 'drill', 'tinkerpop', 'kafka', "

[Owen-CH-Leung]

Thanks Owen for the follow-up!

FAILED tests/test_selective_checks.py::test_expected_output_pull_request_main[All tests should be run when devel-common/ change] - AssertionError: Correct value for 'testable-providers-integrations'
assert "['celery', 'cassandra', 'drill', 'elasticsearch', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']" == "['celery', 'cassandra', 'drill', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']"
  
  - ['celery', 'cassandra', 'drill', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']
  + ['celery', 'cassandra', 'drill', 'elasticsearch', 'tinkerpop', 'kafka', 'mongo', 'pinot', 'qdrant', 'redis', 'trino', 'ydb']
  ?                                 +++++++++++++++++

LGTM overall, the only CI failure comes from:

airflow/dev/breeze/tests/test_selective_checks.py

Line 1124 in da4ce85

"testable-providers-integrations": "['celery', 'cassandra', 'drill', 'tinkerpop', 'kafka', "

Thanks Jason. It's fixed now.

[jason810496]

Nice! Thanks for aligning the ES integration test architecture with rest of the integration tests.

[jason810496]

It's test only PR for provider with no dependencies upgrade so we don't need to backport.