Integration tests failing

[letmerecall]

Describe the issue

make integration_tests failing with the following error.

How to reproduce it?

1. Install poetry requirements poetry install -E all
2. Run integration tests make integration_tests

Related issues/PRs

• It might be a result of rm pandas dependency #2102 where we removed pandas from dependency, but we still import it in tests/integration_tests/document_loaders/test_dataframe.py

[sergerdn]

Please note that it is not possible to run many integration tests since they require the execution of certain processes, such as Redis, Elastic Search, and so on. Currently, we do not have any automation in place to initiate all the required processes before running the tests.

As a result, we do not have the necessary feature to run functional tests in the GitHub flow. We are currently only running unit tests.

I have implemented some new feature in #2402 that have dependencies for integration tests:

Include an optional group test_integration in the pyproject.toml file. This group should contain dependencies for integration tests and can be installed using the command poetry install --with test_integration.
Any new dependencies should be added by running poetry add some_new_deps --group "test_integration"

[tool.poetry.group.test_integration]
optional = true

[tool.poetry.group.test_integration.dependencies]
openai = "^0.27.4"
elasticsearch = {extras = ["async"], version = "^8.6.2"}
## add here anything you need to make integration/functional tests running

If my PR will merged, feel free to add any dependencies necessary to run your tests.