code migration from machinelearning-automl to machinelearning repo feature branch #3324

Dmitry-A · 2019-04-12T23:56:47Z

Shuffle code to conform to ml.net folder structure
Add automl and automl test components to build
Fix issues so it builds

Note this does NOT include running tests or publishing nuget packages, that will come in as a separate PR

…e internal client

Users/dmitrya/ci testing2

…and values; update gitignore; nit rev for Benchmarking.cs (dotnet#5)

…otnet#1983, for now, to run E2E w/o exceptions (dotnet#7)

…otnet#10) * Make validation data param mandatory; remove GetFirstPipeline sample * remove deprecated todo

* Create ISSUE_TEMPLATE.md * Create PULL_REQUEST_TEMPLATE.md

…nternal pipeline; transform clean-up; add back in test proj and fix build; refactor trainer ext name mappings (dotnet#15) * Make validation data param mandatory; remove GetFirstPipeline sample * remove deprecated todo * add estimator extensions / catalog; add ability to go from external to internal pipeline; a lot of transform clean-up; add back in test proj and get it building; refactor trainer ext name mappings

…er; write GetNextPipeline API test; fix public Pipeline object serialization; fix header inferencing bug; write test utils for fetching datasets (dotnet#18)

…s, purpose, type, and name instead of available trainers & transforms (dotnet#19)

…ncrease code coverage (dotnet#21) * fix dataview take util bug, add dataview skip util, add some UTs to increase code coverage * add accuracy threshold on AutoFit test * add null check to best pipeline on autofit result

…ode removal for code coverage (including KDO & associated utils); misc fixes & revs (dotnet#22)

* progressbar * added progressbar and refactoring * reverted * revert sign assembly * added headers and removed exception rethrow * bug fixes and updates to UI * added friendly name printing for metric * formatting * change from task to thread * Update src/mlnet/CodeGenerator/CodeGenerationHelper.cs Co-Authored-By: srsaggam <41802116+srsaggam@users.noreply.github.com>

* Create test.txt * Create test.txt * changes needed for benchmarking * forgot one file * merge conflict fix * fix build break * back out my version of the fix for Label column issue and fix the original fix * bogus file removal * undo SuggestedPipeline change * remove labelCol from pipeline suggester * fix build break * rename AutoML to Microsoft.ML.Auto everywhere and a shot at publishing nuget package (will probably need tweaks once I try to use the pipleline) * tweak queue in vsts-ci.yml * there is still investigation to be done but this fix works and solves memory leak problems * minor refactor

…n API experiment methods into base class (dotnet#287)

…o devdiv stream (dotnet#344)

* formatting of pbar message * Polishing the UI * optimization * rename variable * Update src/mlnet/AutoML/AutoMLEngine.cs Co-Authored-By: srsaggam <41802116+srsaggam@users.noreply.github.com> * Update src/mlnet/CodeGenerator/CodeGenerationHelper.cs Co-Authored-By: srsaggam <41802116+srsaggam@users.noreply.github.com> * new message * changed hhtp to https * added iteration num + 1 * change string name and add color to artifacts * change the message * build errors * added null checks * added exception messsages to log file * added exception messsages to log file

…es (dotnet#346)

* added fix for all platforms progress bar * upgrade nuget * removed args from writeline

* fix few bugs in progressbar and verbosity * removed unused name space

* support for folders with spaces * added support for paths with space * revert file * change name of var * remove spaces

) * added progress bar day display and fix regression metrics * fix formatting * added total time * formatted total time

* change command name and add pbar message * fix tests * added aliases * duplicate alias * added another alias for task

* added formatting changes * added accuracy specifically

* initial changes * Change in project structure * correcting test * change variable name * fix tests * fix tests * fix more tests * fix codegen errors * adde log file message * changed name of args * change variable names * fix test

* Minor telemetry change to log in correct units and make our life easier in the future * Use Ceiling instead of Round

* move test projects to top level test subdir * rename some projects to make naming consistent and make it build again * fix test project refs

jongalloway and others added 30 commits January 4, 2019 13:22

Initial commit

8481317

ci test build

7ba62c4

forgot to save this one file

bf40476

Debug-Intrinsics isn't a valid config, trying windows-x64

233829b

disabled tests for now

d758d72

disable tests attempt 2

1770ff8

initial code push, no history, test project not in the build so is th…

63b3438

…e internal client

battling with warn as err

1e451c2

test build

ae67a1d

test change

6448213

Merge pull request #1 from dotnet/users/dmitrya/ci-testing2

ef3a6b3

Users/dmitrya/ci testing2

make params for MLContext data extensions match ML.NET default names …

e402e14

…and values; update gitignore; nit rev for Benchmarking.cs (dotnet#5)

Create README.md (#2)

d65315f

API folder changes (dotnet#6)

27f5afd

comment out fast forest trainer, per discussion on ML.NET open issue d…

f1e7617

…otnet#1983, for now, to run E2E w/o exceptions (dotnet#7)

Make validation data param mandatory; remove GetFirstPipeline sample (d…

3d9eb10

…otnet#10) * Make validation data param mandatory; remove GetFirstPipeline sample * remove deprecated todo

Create ISSUE_TEMPLATE.md & PULL_REQUEST_TEMPLATE.md (dotnet#12)

030e25a

* Create ISSUE_TEMPLATE.md * Create PULL_REQUEST_TEMPLATE.md

NestedObject For pipeline (dotnet#14)

4e58b0b

corrected the typo in readme (dotnet#16)

181fbe2

make GetNextPipeline API w/ public Pipeline method on PipelineSuggest…

23862a1

…er; write GetNextPipeline API test; fix public Pipeline object serialization; fix header inferencing bug; write test utils for fetching datasets (dotnet#18)

get next pipeline API rev -- refactor API to consume column dimension…

ae423a9

…s, purpose, type, and name instead of available trainers & transforms (dotnet#19)

mark get next pipeline test as ignore for now (dotnet#20)

9f49cf1

unit test additions (including user input validation testing); dead c…

f7e6376

…ode removal for code coverage (including KDO & associated utils); misc fixes & revs (dotnet#22)

add trainer extension tests, & misc fixes (dotnet#23)

3d3567c

add estimator extension tests (dotnet#24)

35099ad

add conversions tests (dotnet#25)

5caf142

fix multiclass runs & add multiclass autofit UT (dotnet#27)

fb6390b

add basic autofit regression test (dotnet#28)

468a1b7

srsaggam and others added 25 commits April 2, 2019 10:15

Upgrade ML.NET package (dotnet#343)

f9d547b

Add cross-validation (CV), and auto-CV for small datasets; push commo…

43fe8b8

…n API experiment methods into base class (dotnet#287)

restore old yml for internal pipeline so we can publish nuget again t…

6b2eca8

…o devdiv stream (dotnet#344)

CLI ML.NET version upgrade (dotnet#345)

cab5809

Sample revs; ColumnInformation property name revs; pre-featurizer fix…

a810d8d

…es (dotnet#346)

CLI -- consume logs from AutoML SDK (dotnet#349)

e89b9a8

Rename RunDetails --> RunDetail (dotnet#350)

b68b8f2

command line api upgrade and progress bar rendering bug (dotnet#366)

ba08a53

* added fix for all platforms progress bar * upgrade nuget * removed args from writeline

change in the version (dotnet#368)

9b6adcd

fix few bugs in progressbar and verbosity (dotnet#374)

4f9dc40

* fix few bugs in progressbar and verbosity * removed unused name space

Fix for folders with space in it while generating project (dotnet#376)

96d2427

* support for folders with spaces * added support for paths with space * revert file * change name of var * remove spaces

SMAC fix for minimizing metrics (dotnet#363)

40496fd

Formatting Regression metrics and progress bar display days. (dotnet#379

9faceb2

) * added progress bar day display and fix regression metrics * fix formatting * added total time * formatted total time

change command name and add pbar message (dotnet#380)

ffd773b

* change command name and add pbar message * fix tests * added aliases * duplicate alias * added another alias for task

UI missing features (dotnet#382)

662a8ea

* added formatting changes * added accuracy specifically

downgrade the codepages (dotnet#384)

e257648

Change in project structure (dotnet#385)

c5ec302

* initial changes * Change in project structure * correcting test * change variable name * fix tests * fix tests * fix more tests * fix codegen errors * adde log file message * changed name of args * change variable names * fix test

FileSizeBuckets in correct units (dotnet#387)

d4b7700

* Minor telemetry change to log in correct units and make our life easier in the future * Use Ceiling instead of Round

changed order (dotnet#388)

5227ee5

prep work to transfer to ml.net (dotnet#389)

553e089

* move test projects to top level test subdir * rename some projects to make naming consistent and make it build again * fix test project refs

moving code and history over from machinelearning-automl

2d32ee0

Add AutoML components to build, fix issues related to that so it builds

013a8d3

Dmitry-A changed the base branch from master to features/automl April 12, 2019 23:59

Dmitry-A merged commit 1702658 into dotnet:features/automl Apr 13, 2019

shauheen added the AutoML.NET Automating various steps of the machine learning process label Apr 21, 2019

Dmitry-A deleted the users/dmitrya/move-to-mlnet branch May 1, 2019 23:13

dotnet locked as resolved and limited conversation to collaborators Mar 22, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

code migration from machinelearning-automl to machinelearning repo feature branch #3324

code migration from machinelearning-automl to machinelearning repo feature branch #3324

Dmitry-A commented Apr 12, 2019

code migration from machinelearning-automl to machinelearning repo feature branch #3324

code migration from machinelearning-automl to machinelearning repo feature branch #3324

Conversation

Dmitry-A commented Apr 12, 2019