Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: rename mmlspark to SynapseML #1204

Merged
merged 1 commit into from
Oct 15, 2021

Conversation

mhamilton723
Copy link
Collaborator

No description provided.

ClassPath.from(getClass.getClassLoader)
.getResources.asScala.toList
.map(ri => className(ri.getResourceName))
.filter(_.startsWith("com.microsoft.ml"))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
.filter(_.startsWith("com.microsoft.ml"))
.filter(_.startsWith("com.microsoft.synapse.ml"))

@memoryz
Copy link
Contributor

memoryz commented Oct 12, 2021

In AzureSearchWriter.py:

jvm.com.microsoft.ml.spark.cognitive.AzureSearchWriter should be jvm.com.microsoft.synapse.ml.spark.cognitive.AzureSearchWriter

And there are a bunch of similar places. Just search for "jvm.com.microsoft.ml.spark".

|class $testClassName(unittest.TestCase):
| def assert_correspondence(self, model, name, num):
| model.write().overwrite().save(join(test_data_dir, name))
| sc._jvm.com.microsoft.ml.spark.core.utils.ModelEquality.assertEqual(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Namespace wrong.

|spark = (SparkSession.builder
| .master("local[*]")
| .appName("PysparkTests")
| .config("spark.jars.packages", "com.microsoft.ml.spark:mmlspark:" + __spark_package_version__)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here.

val p2 = join(tmpDir.toString, "1_m2.model").toString
m1.write.overwrite().save(p1)
m2.write.overwrite().save(p2)
ModelEquality.assertEqual("com.microsoft.ml.spark.cognitive.TextSentiment", p1, p2)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here.

this match {
case _: Estimator[_] =>
val companionModelImport = companionModelClassName
.replaceAllLiterally("com.microsoft.ml.spark", "mmlspark")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here.


test("Verify stage fitting and transforming") {
val exemptions: Set[String] = Set(
"com.microsoft.ml.spark.cognitive.DocumentTranslator",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here.

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723 mhamilton723 changed the title chore: rename mmlspark to SynapseML WIP: chore: rename mmlspark to SynapseML Oct 13, 2021
@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Comment was made before the most recent commit for PR 1204 in repo microsoft/SynapseML

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723 mhamilton723 changed the title WIP: chore: rename mmlspark to SynapseML chore: rename mmlspark to SynapseML Oct 15, 2021
@mhamilton723
Copy link
Collaborator Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723 mhamilton723 merged commit 383cb95 into microsoft:master Oct 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants