Skip to content

Commit

Permalink
Francisco Rivera Valverde: Fix_248 (#263)
Browse files Browse the repository at this point in the history
  • Loading branch information
Github Actions committed Jun 24, 2021
1 parent f08b0b4 commit a3cbc31
Show file tree
Hide file tree
Showing 24 changed files with 606 additions and 372 deletions.
Binary file not shown.
Binary file not shown.
Binary file modified development/_images/sphx_glr_example_visualization_001.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_example_visualization_002.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_example_visualization_thumb.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
Expand Up @@ -85,27 +85,27 @@ Image Classification
Pipeline Random Config:
________________________________________
Configuration:
image_augmenter:GaussianBlur:sigma_min, Value: 1.2308317406823488
image_augmenter:GaussianBlur:sigma_offset, Value: 2.745973527153216
image_augmenter:GaussianBlur:sigma_min, Value: 0.20908525787627186
image_augmenter:GaussianBlur:sigma_offset, Value: 1.0594983119215948
image_augmenter:GaussianBlur:use_augmenter, Value: True
image_augmenter:GaussianNoise:sigma_offset, Value: 0.8698005723626088
image_augmenter:GaussianNoise:sigma_offset, Value: 2.332578136892134
image_augmenter:GaussianNoise:use_augmenter, Value: True
image_augmenter:RandomAffine:rotate, Value: 359
image_augmenter:RandomAffine:scale_offset, Value: 0.21881911068658175
image_augmenter:RandomAffine:shear, Value: 17
image_augmenter:RandomAffine:translate_percent_offset, Value: 0.15493019000449781
image_augmenter:RandomAffine:rotate, Value: 304
image_augmenter:RandomAffine:scale_offset, Value: 0.11742982276455081
image_augmenter:RandomAffine:shear, Value: 29
image_augmenter:RandomAffine:translate_percent_offset, Value: 0.2818176238920318
image_augmenter:RandomAffine:use_augmenter, Value: True
image_augmenter:RandomCutout:use_augmenter, Value: False
image_augmenter:Resize:use_augmenter, Value: True
image_augmenter:ZeroPadAndCrop:percent, Value: 0.07061960693116581
normalizer:__choice__, Value: 'NoNormalizer'
image_augmenter:Resize:use_augmenter, Value: False
image_augmenter:ZeroPadAndCrop:percent, Value: 0.08548217815014147
normalizer:__choice__, Value: 'ImageNormalizer'

Fitting the pipeline...
________________________________________
ImageClassificationPipeline
________________________________________
0-) normalizer:
NoNormalizer
ImageNormalizer

1-) preprocessing:
EarlyPreprocessing
Expand Down Expand Up @@ -177,7 +177,7 @@ Image Classification
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 5.624 seconds)
**Total running time of the script:** ( 0 minutes 8.553 seconds)


.. _sphx_glr_download_examples_20_basics_example_image_classification.py:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,7 @@ Search for an ensemble of machine learning algorithms
.. code-block:: none
<autoPyTorch.api.tabular_classification.TabularClassificationTask object at 0x7fb263a32130>
<autoPyTorch.api.tabular_classification.TabularClassificationTask object at 0x7f8a02b64c10>
Expand Down Expand Up @@ -162,7 +162,7 @@ Print the final ensemble performance

.. code-block:: none
<smac.runhistory.runhistory.RunHistory object at 0x7fb252e6a400> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
<smac.runhistory.runhistory.RunHistory object at 0x7f89f18b7910> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
data_loader:batch_size, Value: 64
encoder:__choice__, Value: 'OneHotEncoder'
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
Expand Down Expand Up @@ -194,7 +194,7 @@ Print the final ensemble performance
scaler:__choice__, Value: 'StandardScaler'
trainer:StandardTrainer:weighted_loss, Value: True
trainer:__choice__, Value: 'StandardTrainer'
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0012660026550292969, budget=0), TrajEntry(train_perf=0.16374269005847952, incumbent_id=1, incumbent=Configuration:
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0012984275817871094, budget=0), TrajEntry(train_perf=0.18128654970760238, incumbent_id=1, incumbent=Configuration:
data_loader:batch_size, Value: 64
encoder:__choice__, Value: 'OneHotEncoder'
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
Expand Down Expand Up @@ -226,31 +226,94 @@ Print the final ensemble performance
scaler:__choice__, Value: 'StandardScaler'
trainer:StandardTrainer:weighted_loss, Value: True
trainer:__choice__, Value: 'StandardTrainer'
, ta_runs=1, ta_time_used=2.014786958694458, wallclock_time=3.222097873687744, budget=5.555555555555555)]
{'accuracy': 0.8786127167630058}
| | Preprocessing | Estimator | Weight |
|---:|:------------------------------------------------------------------|:-------------------------------------------------------------------|---------:|
| 0 | SimpleImputer,NoEncoder,MinMaxScaler,Nystroem | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.44 |
| 1 | SimpleImputer,OneHotEncoder,MinMaxScaler,KernelPCA | no embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
| 2 | SimpleImputer,OneHotEncoder,NoScaler,TruncSVD | embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
| 3 | None | RFLearner | 0.08 |
| 4 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
| 5 | SimpleImputer,OneHotEncoder,MinMaxScaler,KernelPCA | no embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.06 |
| 6 | SimpleImputer,OneHotEncoder,MinMaxScaler,PolynomialFeatures | no embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
| 7 | None | CBLearner | 0.04 |
| 8 | SimpleImputer,OneHotEncoder,NoScaler,PowerTransformer | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
| 9 | None | ETLearner | 0.02 |
| 10 | None | SVMLearner | 0.02 |
| 11 | None | KNNLearner | 0.02 |
| 12 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
, ta_runs=1, ta_time_used=2.5365962982177734, wallclock_time=3.641376495361328, budget=5.555555555555555), TrajEntry(train_perf=0.17543859649122806, incumbent_id=2, incumbent=Configuration:
data_loader:batch_size, Value: 97
encoder:__choice__, Value: 'OneHotEncoder'
feature_preprocessor:KernelPCA:coef0, Value: -0.082773840425306
feature_preprocessor:KernelPCA:degree, Value: 3
feature_preprocessor:KernelPCA:gamma, Value: 0.010805957426054075
feature_preprocessor:KernelPCA:kernel, Value: 'poly'
feature_preprocessor:KernelPCA:n_components, Value: 6
feature_preprocessor:__choice__, Value: 'KernelPCA'
imputer:categorical_strategy, Value: 'most_frequent'
imputer:numerical_strategy, Value: 'constant_zero'
lr_scheduler:ReduceLROnPlateau:factor, Value: 0.8960894617994585
lr_scheduler:ReduceLROnPlateau:mode, Value: 'max'
lr_scheduler:ReduceLROnPlateau:patience, Value: 9
lr_scheduler:__choice__, Value: 'ReduceLROnPlateau'
network_backbone:ShapedResNetBackbone:activation, Value: 'relu'
network_backbone:ShapedResNetBackbone:blocks_per_group, Value: 4
network_backbone:ShapedResNetBackbone:max_units, Value: 633
network_backbone:ShapedResNetBackbone:num_groups, Value: 3
network_backbone:ShapedResNetBackbone:output_dim, Value: 678
network_backbone:ShapedResNetBackbone:resnet_shape, Value: 'stairs'
network_backbone:ShapedResNetBackbone:use_dropout, Value: False
network_backbone:ShapedResNetBackbone:use_shake_drop, Value: False
network_backbone:ShapedResNetBackbone:use_shake_shake, Value: True
network_backbone:__choice__, Value: 'ShapedResNetBackbone'
network_embedding:__choice__, Value: 'NoEmbedding'
network_head:__choice__, Value: 'fully_connected'
network_head:fully_connected:num_layers, Value: 1
network_init:KaimingInit:bias_strategy, Value: 'Normal'
network_init:__choice__, Value: 'KaimingInit'
optimizer:RMSpropOptimizer:alpha, Value: 0.7131796677728146
optimizer:RMSpropOptimizer:lr, Value: 0.0008027152992513552
optimizer:RMSpropOptimizer:momentum, Value: 0.8007535972801767
optimizer:RMSpropOptimizer:weight_decay, Value: 0.05967403229982146
optimizer:__choice__, Value: 'RMSpropOptimizer'
scaler:__choice__, Value: 'MinMaxScaler'
trainer:StandardTrainer:weighted_loss, Value: False
trainer:__choice__, Value: 'StandardTrainer'
, ta_runs=3, ta_time_used=18.902961254119873, wallclock_time=22.37511134147644, budget=5.555555555555555), TrajEntry(train_perf=0.18128654970760238, incumbent_id=3, incumbent=Configuration:
data_loader:batch_size, Value: 64
encoder:__choice__, Value: 'OneHotEncoder'
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
imputer:categorical_strategy, Value: 'most_frequent'
imputer:numerical_strategy, Value: 'mean'
lr_scheduler:ReduceLROnPlateau:factor, Value: 0.1
lr_scheduler:ReduceLROnPlateau:mode, Value: 'min'
lr_scheduler:ReduceLROnPlateau:patience, Value: 10
lr_scheduler:__choice__, Value: 'ReduceLROnPlateau'
network_backbone:ShapedMLPBackbone:activation, Value: 'relu'
network_backbone:ShapedMLPBackbone:max_units, Value: 200
network_backbone:ShapedMLPBackbone:mlp_shape, Value: 'funnel'
network_backbone:ShapedMLPBackbone:num_groups, Value: 5
network_backbone:ShapedMLPBackbone:output_dim, Value: 200
network_backbone:ShapedMLPBackbone:use_dropout, Value: False
network_backbone:__choice__, Value: 'ShapedMLPBackbone'
network_embedding:__choice__, Value: 'NoEmbedding'
network_head:__choice__, Value: 'fully_connected'
network_head:fully_connected:activation, Value: 'relu'
network_head:fully_connected:num_layers, Value: 2
network_head:fully_connected:units_layer_1, Value: 128
network_init:XavierInit:bias_strategy, Value: 'Normal'
network_init:__choice__, Value: 'XavierInit'
optimizer:AdamOptimizer:beta1, Value: 0.9
optimizer:AdamOptimizer:beta2, Value: 0.9
optimizer:AdamOptimizer:lr, Value: 0.01
optimizer:AdamOptimizer:weight_decay, Value: 0.0
optimizer:__choice__, Value: 'AdamOptimizer'
scaler:__choice__, Value: 'StandardScaler'
trainer:StandardTrainer:weighted_loss, Value: True
trainer:__choice__, Value: 'StandardTrainer'
, ta_runs=11, ta_time_used=83.38277745246887, wallclock_time=98.77164840698242, budget=16.666666666666664)]
{'accuracy': 0.8728323699421965}
| | Preprocessing | Estimator | Weight |
|---:|:---------------------------------------------------|:-------------------------------------------------------------------|---------:|
| 0 | None | CBLearner | 0.78 |
| 1 | SimpleImputer,OneHotEncoder,MinMaxScaler,KernelPCA | no embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.14 |
| 2 | SimpleImputer,OneHotEncoder,MinMaxScaler,KernelPCA | no embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
| 3 | SimpleImputer,OneHotEncoder,NoScaler,TruncSVD | embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
| 4 | SimpleImputer,OneHotEncoder,Normalizer,Nystroem | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
| 5 | None | ETLearner | 0.02 |
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 5 minutes 39.134 seconds)
**Total running time of the script:** ( 5 minutes 35.924 seconds)


.. _sphx_glr_download_examples_20_basics_example_tabular_classification.py:
Expand Down

0 comments on commit a3cbc31

Please sign in to comment.