Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Left merge failed with message: ValueError: Length mismatch: Expected axis has 36 elements, new values have 32 elements #7250

Closed
anmyachev opened this issue May 10, 2024 · 0 comments · Fixed by #7251
Assignees
Labels
bug 🦗 Something isn't working P1 Important tasks that we should complete soon

Comments

@anmyachev
Copy link
Collaborator

anmyachev commented May 10, 2024

This is a consequence of faulty optimization: #6665.

Failed on 06699a8.

Reproducer:

import modin.pandas as pd
from time import time
import numpy as np
from modin.utils import execute

np.random.seed(42)

df1 =  pd.DataFrame(np.random.randint(0,100,size=(1000, 64)))
df2 = pd.DataFrame(np.random.randint(0,100,size=(1000, 64)))
execute(df1)
execute(df2)


for _ in range(3):
    start = time()
    result = pd.merge(df1, df2, how="left", on=1)
    execute(result)
    print(f"{result.shape=}")
    print(f"merge time: {time()-start}")
@anmyachev anmyachev added bug 🦗 Something isn't working P1 Important tasks that we should complete soon labels May 10, 2024
@anmyachev anmyachev self-assigned this May 10, 2024
anmyachev added a commit to anmyachev/modin that referenced this issue May 10, 2024
…al reset_index for left merge"

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue May 10, 2024
…al reset_index for left merge"

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue May 10, 2024
…al reset_index for left merge"

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
anmyachev added a commit to anmyachev/modin that referenced this issue May 10, 2024
…al reset_index for left merge"

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
YarShev pushed a commit that referenced this issue May 13, 2024
…rge" (#7251)

Signed-off-by: Anatoly Myachev <anatoly.myachev@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug 🦗 Something isn't working P1 Important tasks that we should complete soon
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant