Davies Liu
davies

Aug 25, 2016
davies commented on pull request apache/spark#14797
Aug 24, 2016
davies opened pull request apache/spark#14797
@davies
[SPARK-17230] [SQL] Should not pass optimized query into QueryExecution in DataFrameWriter
2 commits with 11 additions and 3 deletions
davies created branch fix_writer at davies/spark
Aug 24, 2016
Aug 24, 2016
davies commented on pull request apache/spark#14722
@davies

@petermaxlee The Batch means insert multiple rows into JDBC data source using single query, the context is JDBC data source, not streaming. The SPA…

Aug 24, 2016
davies commented on pull request apache/spark#14722
@davies

@petermaxlee Before this PR, the underlying cause is NOT included in the logging, the description had been corrected.

Aug 23, 2016
@davies
  • @srowen cdaa562
    [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.ap…
  • @lresende 67f025d
    [SPARK-17023][BUILD] Upgrade to Kafka 0.10.0.1 release
  • 109 more commits »
Aug 23, 2016
davies commented on pull request apache/spark#14607
@davies

Changed to 100 to avoid another config, any version of metastore should not OOM for 100 partitions, right?

Aug 23, 2016
@davies
Aug 23, 2016
davies commented on pull request apache/spark#14607
@davies

Copied from HadoopFsRelation

Aug 23, 2016
davies commented on pull request apache/spark#14607
@davies

There are comments on this below

Aug 23, 2016
davies commented on pull request apache/spark#14722
@davies

Merging this into master and 2.0 branch.

Aug 22, 2016
davies commented on pull request apache/spark#14692
@davies

Mostly they have same meaning, but sometimes we forget to set INPUT as null in whole stage codegen (currentVars has higher priority)

Aug 19, 2016
davies commented on pull request apache/spark#14692
@davies

@cloud-fan Could you review this one?

Aug 19, 2016
davies commented on pull request apache/spark#14567
@davies

Where is this file used?

Aug 19, 2016
davies commented on pull request apache/spark#14567
@davies

This file is copied, please ignore it

Aug 19, 2016
davies commented on pull request apache/spark#14567
@davies

This file is copied, please ignore it

Aug 19, 2016
davies commented on pull request apache/spark#14567
@davies

This file is generated by _shared_params_code_gen.py., can we ignore it?

Aug 19, 2016
davies opened pull request apache/spark#14722
@davies
[SPARK-13286] [SQL] add the next expression of SQLException as cause
1 commit with 13 additions and 2 deletions
davies created branch keep_cause at davies/spark
Aug 19, 2016
Aug 19, 2016
davies commented on pull request apache/spark#14693
@davies

Merging this into master and 2.0 and 1.6 (hopefully), thanks

Aug 19, 2016
davies commented on pull request apache/spark#14693
@davies

We can't use inMemIterator here, it's different.

Aug 18, 2016
@davies
Aug 18, 2016
davies commented on pull request apache/spark#14693
@davies

I'm sorry that did not pay enough attension on this part, thanks to the unit test!

Aug 18, 2016
davies commented on pull request apache/spark#14693
@davies

@sitalkedia Your last commit is not correct, which fail this test. upstream is the one used for reading, inMemIterator is the one used for spilling…

Aug 18, 2016
@davies
  • @davies 8a18bf7
    add config, add partition in sequential
Aug 18, 2016
davies commented on pull request apache/spark#14452
@davies

@viirya Had a quick look on this one, It seems that we are trying to make the logical plans looks better, but does not help much for actual physica…

Aug 18, 2016
davies commented on pull request apache/spark#14693
@davies

LGTM

Aug 17, 2016
@davies
  • @davies ad1d83f
    Fix a bug around split expression in whole-stage codegen
Aug 17, 2016
@davies
  • @davies 47dc043
    Fix a bug around split expression in whole-stage codegen
Aug 17, 2016
@davies
  • @davies a42a734
    Update BenchmarkWideTable.scala