Merge master into release/preview for 0.7#1469
Merged
shauheen merged 161 commits intodotnet:release/previewfrom Oct 31, 2018
shauheen:rc107
Merged
Merge master into release/preview for 0.7#1469shauheen merged 161 commits intodotnet:release/previewfrom shauheen:rc107
shauheen merged 161 commits intodotnet:release/previewfrom
shauheen:rc107
Conversation
* Remove the error tracing when assembly loading fails for Maml. Also adding our native assemblies to the list to skip, so they aren't attempted to be loaded. Fix #1034
Helps the user to relate to the macOS version faster.
* Multiclass logistic Regression tests enabled * threshold providing in tests * defining tolerance as a constant in baseTestBaseline Class * upper case camel for constant and _ for large decimal numbers
…800) * clarifying roadmap to mention current text/NLP features * updated the documentation to fix review comments
* updating documentation of TensorFlowTransform * making some some changes in the description
* move Harness-related code to Harness folder * make sure that we always use recommended config * mention the external dependencies in the README * add nuget.config file so BDN can restore all packages * add comments to the config so I am not the only person who understands it * don't enable MemoryDiagnoser by default, it requires one extra iteration which is expensive for long running benchmarks * don't add nuget.config file, generate it on the fly when needed by BDN * generate a .csproj file that will handle both native dependencies and nuget.config file issue * describe authoring new benchmarks in the docs * add some integration tests that make sure that the benchmarks are not broken * register the right assemblies after recent change of assembly loading, makes all benchmark work again ;) * make Ranking benchmarks work * code review: split Helpers.cs into multiple files, cleanup the code, don't hardcode the dependencies
* Change all uses of System.Linq.Append to System.Linq.Concat. * Address code review comments
* Kmeans to estimator. * Adding the Clustering training context, the clustering Evaluate method, the KMeans extension on the clustering context and a tet for it.
* update ml.scoring to stable version * small change to kick off mac build * small change to kick off build * Kick off build * small change to kick off build
* simple fixe for warning issue in keytovalue transform * changed test file outputs so that they don't include the warnings
* AP xtensions * lbfgs derived classes take more arguments in their public ctors * adding pigstensions for lr, multilr, possion * Ogd static xtensions. * namespace change for pigstensions
Fixes #987 Adds a document describing high-level API concepts, as well as the 'cookbook' with a variety of samples.
* Adding the Ranker TrainContext, the Ranker TrainerEstimatorReconcilier, and an Evaluate method + metrics class to the existing RankerEvaluator. * Adding the FastTree ranking xtension and test. * Grouping the xtensions in classes with more meaningful names, since the docs site displays the methods per class, not file.
Adds project references for OnnxTransform, TensorFlowTransorm, and a NativeAssemblyReference for SymSGD
* Add a workaround for the tests hanging while loading MKL. The workaround is to ensure the MKL library is loaded very early in the test process, so it doesn't cause the deadlock. Workaround #1073 Another deadlock also occurs when running TestAutoInference and TestPipelineSweeper in parallel. Marking these tests to not run in parallel anymore. Workaround #1095 Moving back to the Azure Hosted VS2017 pool to run the tests now that we've narrowed the deadlocks down.
…owUtils.GetModelNodes (#1093)
Add MyGet link
* Enable statically-typed matrix factorization * Address comments 1. Add copyright 2. Try fix mac tolerance 3. Use MLContext with static pipeline * Add another example for in-memory matrix factorization
…1328) * Renaming the namespaces where the transforms live from Runtime.Data.Transforms to ML.Transforms. Addressing PR comments.
* Change TryParse* methods to return false instead of throw. * Make TextLoader throw on bad values * Make TextLoader throw on bad values, and fix unit tests. * Update Release baseline * Fix one more unit test
* Adding the catalog extensions for Concat, CopyColumns, Hash, KeyToVal
* adding airquality, infert datasets. Added samples for Term and KeyToVal estimators. * Adding tests for the NormalizerCatalog and the TextTransformCatalog. Adding samples for the ConcatEstimator, and KeyToValue, Term that will need to get referenced from the respective catalogs when they happen. re-organized the samples based on static-dynamic. Renamed.
…olumnsTransform (#1371) * Removes ChooseColumnsTransform and DropColumnsTransform classes replacing them with SelectColumnsTransform. These changes include: * Updates to SelectColumnsTransform to respect ordering when keeping columns. For example, if the input is ABC and CB is selected, the output will be CB. * Updates to code that used Choose or Drop columns, replacing with SelectColumns. * Updates to baseline output for tests to pass * Re-enabled the SavePipeline tests This fixes #1342 These changes are also related to #754
* more namespace move
* Enhancements to online linear trainers to make them stateless. * Factor stateful logic into a separate internal object. * Remove direct usage of Console.Writeline * Opportunistic fixes of minor issues. * Nuke failing Mac test temporarily
* more reorg and namespace move * renaming the HashEstimator and taking care of consequences
Added a custom mapping transformer/estimator
…ection transforms (#1254)
* adding all extensions for the Text related transformation * adding keyToVector extensions and renaming the estimatorto conform to 1318 * Adding SelectColumns xtensions. Renaming SelectEstimator and Textnormalizer * KeyToBinary extensions * Adding extensions for the Image transforms. Some renaming
Fix an unassigned field for matrix factorization.
# Conflicts: # build/Dependencies.props # src/Microsoft.ML.Data/Evaluators/ClusteringEvaluator.cs # src/Microsoft.ML.Data/Scorers/PredictionTransformer.cs # src/Microsoft.ML.KMeansClustering/KMeansPlusPlusTrainer.cs # src/Microsoft.ML.KMeansClustering/KMeansStatic.cs # src/Microsoft.ML.Legacy/AssemblyRegistration.cs # src/Microsoft.ML.PCA/WrappedPcaTransform.cs # src/Microsoft.ML.StandardLearners/Standard/LogisticRegression/LbfgsPredictorBase.cs # src/Microsoft.ML.StandardLearners/Standard/LogisticRegression/MulticlassLogisticRegression.cs # src/Microsoft.ML.StandardLearners/Standard/Online/AveragedLinear.cs # src/Microsoft.ML.StandardLearners/Standard/Online/AveragedPerceptron.cs # src/Microsoft.ML.StandardLearners/Standard/Online/LinearSvm.cs # src/Microsoft.ML.StandardLearners/Standard/Online/OnlineGradientDescent.cs # src/Microsoft.ML.StandardLearners/Standard/Online/OnlineLearnerStatic.cs # src/Microsoft.ML.StandardLearners/Standard/Online/OnlineLinear.cs # src/Microsoft.ML.TensorFlow/doc.xml # src/Microsoft.ML.Transforms/NAReplaceTransform.cs # src/Microsoft.ML.Transforms/Text/TextTransform.cs # test/Microsoft.ML.StaticPipelineTesting/Training.cs # test/Microsoft.ML.Tests/TrainerEstimators/LbfgsTests.cs # test/Microsoft.ML.Tests/TrainerEstimators/TrainerEstimators.cs
eerhardt
approved these changes
Oct 31, 2018
sfilipi
approved these changes
Oct 31, 2018
ghost
locked as resolved and limited conversation to collaborators
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR merges master into release branch for 0.7