Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A snapshot that contains join rules looks like empty. #2216

Closed
joohokim1 opened this issue Jun 11, 2019 · 1 comment
Closed

A snapshot that contains join rules looks like empty. #2216

joohokim1 opened this issue Jun 11, 2019 · 1 comment
Assignees
Labels
bug Something isn't working @dataprep Component Name : Data preparation
Milestone

Comments

@joohokim1
Copy link
Contributor

Describe the bug
Join rule works fine in sampling mode, but when I created a snapshot, the result was empty.
As a result of test, it was not the problem of the snapshot detail page.
The dataset became empty, right after applying a join rule.

To Reproduce
Steps to reproduce the behavior:

  1. Import & wrangle :
    auspol2019.small.txt
    location_geocode.csv.txt

  2. Open a edit session with auspol2019 W.DS.

  3. Apply a join rule with geocode W.DS; predicates are user_location, name each.

  4. Generate any type of snapshots. file, hive both are empty.

Expected behavior
Pretty results that are same to samplings.

Screenshots
join like this
result is like this

Desktop (please complete the following information):

  • OS: MacOS
  • Browser: Chrome
  • Version: 68.0.3440.106

Additional context
The empty result was because of the parallel execution.
Accidentally, join has been run parallelly which we shouldn't for any type of aggregations for now.

But after fixing it, a NPE came out when matching the predicates.
I'm on it.

@joohokim1 joohokim1 added bug Something isn't working @dataprep Component Name : Data preparation labels Jun 11, 2019
@joohokim1 joohokim1 added this to the 3.3.0 milestone Jun 11, 2019
@joohokim1 joohokim1 self-assigned this Jun 11, 2019
@joohokim1
Copy link
Contributor Author

Integrated test #1 passed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working @dataprep Component Name : Data preparation
Projects
None yet
Development

No branches or pull requests

1 participant