[SPARK-14134] [core] [test-maven] Change the package name used for shading classes.#11941
[SPARK-14134] [core] [test-maven] Change the package name used for shading classes.#11941vanzin wants to merge 4 commits intoapache:masterfrom
Conversation
The current package name uses a dash, which is a little weird but seemed to work. That is, until a new test tried to mock a class that references one of those shaded types, and then things started failing. Most changes are just noise to fix the logging configs.
| <test.exclude.tags></test.exclude.tags> | ||
|
|
||
| <!-- Package to use when relocating shaded classes. --> | ||
| <spark.shade.packageName>org.spark_project</spark.shade.packageName> |
There was a problem hiding this comment.
For total avoidance of trouble, is org.sparkproject safer? or are you sure underscores are more OK than hyphens? BTW you could consider this PR as a resolution for SPARK-8815 too.
There was a problem hiding this comment.
Underscores are ok (they're not an operator like - is).
|
retest this please |
|
Test build #54073 has finished for PR 11941 at commit
|
|
Weird error, seems unrelated. retest this please. |
|
Test build #54067 has finished for PR 11941 at commit
|
|
hmm different test failure that also looks unrelated. retest this please |
|
Test build #54083 has finished for PR 11941 at commit
|
|
sql test was stuck. retest this please. |
|
Test build #54099 has finished for PR 11941 at commit
|
|
wtf. retest this please. |
|
Test build #54132 has finished for PR 11941 at commit
|
|
Test build #54137 has finished for PR 11941 at commit
|
|
this is the same flaky test that's failing in other places with maven... let me see if it's easy to fix. |
|
Cool, guess I'll wait for those, thanks. |
|
retest this please |
|
Test build #54242 has finished for PR 11941 at commit
|
This reverts commit 3ae4e02.
|
You also need to update the flume's log4j files as it's moved back now. |
|
Test build #54332 has finished for PR 11941 at commit
|
|
I'm gonna close this for now since #11796 is passing without this patch... no idea how. |
|
Reopened since I'm running into this problem locally, and the fix makes things more correct anyway. |
|
Test build #55138 has finished for PR 11941 at commit
|
|
retest this please |
|
Test build #55141 has finished for PR 11941 at commit
|
|
@JoshRosen these tests are not happy with the build jdk; are you still in the process of fixing things? |
|
Argh, I forgot to do the |
|
Jenkins, retest this please. |
|
Test build #55148 has finished for PR 11941 at commit
|
|
Since this was reviewed / tested before, I'll merge it in the morning unless someone objects (or beats me to it). |
|
LGTM, so I'm going to merge this now into 2.0. Thanks Marcelo! |
The current package name uses a dash, which is a little weird but seemed
to work. That is, until a new test tried to mock a class that references
one of those shaded types, and then things started failing.
Most changes are just noise to fix the logging configs.
For reference, SPARK-8815 also raised this issue, although at the time it
did not cause any issues in Spark, so it was not addressed.