Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Groupby tests on MPI are failing #6897

Closed
dchigarev opened this issue Jan 31, 2024 · 0 comments · Fixed by #6898 or #6902
Closed

Groupby tests on MPI are failing #6897

dchigarev opened this issue Jan 31, 2024 · 0 comments · Fixed by #6898 or #6902
Assignees
Labels
P0 Highest priority tasks requiring immediate fix Testing 📈 Issues related to testing unidist Related to unidist backend

Comments

@dchigarev
Copy link
Collaborator

If you would run:

MODIN_ENGINE=unidist MODIN_CPUS=2 mpiexec -n 1 python -m pytest modin/pandas/test/test_groupby.py::test_groupby_sort[True-True] -v

You would get this error:

modin/pandas/test/test_groupby.py::test_groupby_sort[True-True] Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "miniconda3/envs/modinn/lib/python3.9/site-packages/unidist/api.py", line 92, in init
    init_backend()
  File "miniconda3/envs/modinn/lib/python3.9/site-packages/unidist/core/base/utils.py", line 28, in init_backend
    initialize_mpi()
  File "miniconda3/envs/modinn/lib/python3.9/site-packages/unidist/core/backends/mpi/utils.py", line 12, in initialize_mpi
    init()
  File "miniconda3/envs/modinn/lib/python3.9/site-packages/unidist/core/backends/mpi/core/controller/api.py", line 278, in init
    asyncio.run(worker_loop())
  File "miniconda3/envs/modinn/lib/python3.9/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "miniconda3/envs/modinn/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
    return future.result()
  File "miniconda3/envs/modinn/lib/python3.9/site-packages/unidist/core/backends/mpi/core/worker/loop.py", line 111, in worker_loop
    pending_request = task_store.process_task_request(request)
  File "miniconda3/envs/modinn/lib/python3.9/site-packages/unidist/core/backends/mpi/core/worker/task_store.py", line 423, in process_task_request
    task = request["task"]
KeyError: 'task'

@dchigarev dchigarev added Testing 📈 Issues related to testing P0 Highest priority tasks requiring immediate fix labels Jan 31, 2024
@dchigarev dchigarev self-assigned this Jan 31, 2024
dchigarev added a commit to dchigarev/modin that referenced this issue Jan 31, 2024
…ns in groupby

Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
@YarShev YarShev added the unidist Related to unidist backend label Jan 31, 2024
YarShev pushed a commit that referenced this issue Jan 31, 2024
…#6898)

Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
dchigarev added a commit to dchigarev/modin that referenced this issue Feb 1, 2024
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
YarShev pushed a commit that referenced this issue Feb 1, 2024
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P0 Highest priority tasks requiring immediate fix Testing 📈 Issues related to testing unidist Related to unidist backend
Projects
None yet
2 participants