Skip to content

[SPARK-11597][SQL][WIP] improve performance of array and map encoder #9572

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
cloud-fan wants to merge 1 commit into from
Closed

[SPARK-11597][SQL][WIP] improve performance of array and map encoder #9572

cloud-fan wants to merge 1 commit into from

Conversation

@cloud-fan
Copy link
Contributor

@cloud-fan cloud-fan commented Nov 9, 2015

The overall idea is to split MapObjects into MapArray and MapMap to handle array and map efficient.

@SparkQA
Copy link

SparkQA commented Nov 9, 2015

Test build #45394 has finished for PR 9572 at commit 7c99cf8.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):\n * case class MapCatalystArray(\n

@yhuai
Copy link
Contributor

yhuai commented Jan 13, 2016

@cloud-fan Should we revisit it later?

@cloud-fan cloud-fan closed this Jan 13, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@cloud-fan @SparkQA @yhuai