[SPARK-4377] Fixed serialization issue by switching to akka provided serializer.

[ScrapCodes]

... - there is no way around this for deserializing actorRef(s).

[SparkQA]

Test build #23721 has started for PR 3402 at commit 29880da.

• This patch merges cleanly.

[SparkQA]

Test build #23721 has finished for PR 3402 at commit 29880da.

• This patch fails Scala style tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • abstract class StandaloneRecoveryModeFactory(conf: SparkConf, serializer: Serialization)

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23721/
Test FAILed.

[ScrapCodes]

@JoshRosen Please take a look and see if this fix works for us.

[SparkQA]

Test build #23722 has started for PR 3402 at commit 9b35c6e.

• This patch merges cleanly.

[ScrapCodes]

Even after this fix someone can run into same errors if he suppose builds spark with scala 2.10 and runs master first and then try to recover it with spark built with scala 2.11. This is definitely not our case. But just mentioning it since I observed it while testing.

[SparkQA]

Test build #23723 has started for PR 3402 at commit 77233fd.

• This patch merges cleanly.

[SparkQA]

Test build #23722 has finished for PR 3402 at commit 9b35c6e.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • abstract class StandaloneRecoveryModeFactory(conf: SparkConf, serializer: Serialization)

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23722/
Test PASSed.

[SparkQA]

Test build #23723 has finished for PR 3402 at commit 77233fd.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • abstract class StandaloneRecoveryModeFactory(conf: SparkConf, serializer: Serialization)

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/23723/
Test PASSed.

[JoshRosen]

I ran my ZKFaultToleranceSuite and this now passes all tests! Haven't reviewed the actual fix yet, but I can confirm that it fixes the exception reported in the JIRA.

[pwendell]

Okay I reviewed this and it LGTM. Fortunately, these changes are isolated to those using recoverability mechanisms.

[aarondav]

Actually this effectively reverts the changes made to the serializer in #771, which was only merged for 1.2, so this should mean that such people are no more affected than they already were by the upgrade.

[pwendell]

@aarondav did you mean "only merged for 1.3"?

[aarondav]

Oops, that's probably corrector, sorry!