[SPARK-8936][MLlib] OnlineLDA document-topic Dirichlet hyperparameter optimization

[feynmanliang]

Adds alpha (document-topic Dirichlet parameter) hyperparameter optimization to OnlineLDAOptimizer following Huang: Maximum Likelihood Estimation of Dirichlet Distribution Parameters. Also introduces a private setSampleWithReplacement to OnlineLDAOptimizer for unit testing purposes.

[SparkQA]

Test build #39246 has finished for PR 7836 at commit cef5b76.

• This patch fails Scala style tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #39250 has finished for PR 7836 at commit a31b084.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #39259 has finished for PR 7836 at commit 151e859.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class MultilayerPerceptronClassifier(override val uid: String)
  • class KinesisUtils(object):
  • class InitialPositionInStream(object):

[jkbradley]

LGTM pending tests

[SparkQA]

Test build #39286 has finished for PR 7836 at commit 4bef484.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class MultilayerPerceptronClassifier(override val uid: String)
  • class KinesisUtils(object):
  • class InitialPositionInStream(object):

[jkbradley]

@feynmanliang I just noticed: Can you please add the "mllib" tag to the PR title?

[feynmanliang]

@jkbradley Sure

On Fri, Jul 31, 2015 at 5:30 PM jkbradley notifications@github.com wrote:

@feynmanliang https://github.com/feynmanliang I just noticed: Can you
please add the "mllib" tag to the PR title?

—
Reply to this email directly or view it on GitHub
#7836 (comment).