Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: .NET binding support #1156

Merged
merged 176 commits into from Jun 20, 2022

Conversation

serena-ruan
Copy link
Contributor

@serena-ruan serena-ruan commented Aug 9, 2021

AB#1821715

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@codecov
Copy link

codecov bot commented Aug 10, 2021

Codecov Report

Merging #1156 (dfe3388) into master (3ae67ab) will decrease coverage by 0.45%.
The diff coverage is 71.08%.

❗ Current head dfe3388 differs from pull request most recent head 1b05f49. Consider uploading reports for the commit 1b05f49 to get more accurate results
Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1156      +/-   ##
==========================================
- Coverage   83.72%   83.27%   -0.46%     
==========================================
  Files         259      263       +4     
  Lines       12433    12744     +311     
  Branches      630      639       +9     
==========================================
+ Hits        10410    10612     +202     
- Misses       2023     2132     +109     
Impacted Files Coverage Δ
.../com/microsoft/ml/spark/automl/FindBestModel.scala 85.96% <0.00%> (-1.54%) ⬇️
...icrosoft/ml/spark/automl/TuneHyperparameters.scala 78.04% <0.00%> (-0.97%) ⬇️
...g/apache/spark/ml/param/DotnetWrappableParam.scala 0.00% <0.00%> (ø)
...g/apache/spark/ml/param/PythonWrappableParam.scala 75.00% <ø> (ø)
...la/org/apache/spark/ml/param/RWrappableParam.scala 60.00% <ø> (ø)
...la/org/apache/spark/ml/param/TypedArrayParam.scala 0.00% <0.00%> (ø)
...org/apache/spark/ml/param/JsonEncodableParam.scala 36.11% <4.76%> (-43.89%) ⬇️
...m/microsoft/ml/spark/codegen/GenerationUtils.scala 51.61% <6.25%> (-48.39%) ⬇️
...org/apache/spark/ml/param/ArrayParamMapParam.scala 33.33% <20.00%> (-66.67%) ⬇️
...rg/apache/spark/ml/param/EstimatorArrayParam.scala 28.57% <20.00%> (-21.43%) ⬇️
... and 36 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3ae67ab...1b05f49. Read the comment docs.

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

dotnetSetup.sh Outdated Show resolved Hide resolved
dotnetSetup.sh Outdated Show resolved Hide resolved
@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

|}
|""".stripMargin
}
override private[ml] def dotnetGetter(capName: String): String =
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Love that this was able to remove so much code!

@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

Seq("dotnet", "pack", "--output", join(dotnetTestBaseDir, "target").getAbsolutePath),
dotnetTestBaseDir
)
val packagePath = join(dotnetTestBaseDir, "target", s"SynapseML.DotnetE2ETest.0.9.1.nupkg").getAbsolutePath
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this supposed to be 0.9.1? Seems hard-coded for debugging

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I fix this version on purpose, because the only change to the dotnetTestBase is the version of synapseml jar that it depends on. This is only used for our internal tests, so I'm open to either, releasing different snapshot versions is also fine.

serena-ruan and others added 2 commits June 20, 2022 11:34
@serena-ruan
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723 mhamilton723 merged commit 9204586 into microsoft:master Jun 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants