Skip to content
This repository has been archived by the owner on Jun 22, 2022. It is now read-only.

Notebook #5: Example with Keras #41

Merged
merged 2 commits into from
May 17, 2018
Merged

Notebook #5: Example with Keras #41

merged 2 commits into from
May 17, 2018

Conversation

grzes314
Copy link

@grzes314 grzes314 commented May 9, 2018

No description provided.

"metadata": {},
"outputs": [],
"source": [
"class KerasCnn(BaseTransformer):\n",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@grzes314 We already have KerasModelTransformer in steps.keras.models and I would use just that. Also I think (sorry if not communicated properly) that one of the purposes of this notebook is to show that there is a toolkit already with all the boilerplate prepared.

"cell_type": "markdown",
"metadata": {},
"source": [
"Because we do test time augmentation, it makes sense to run prediction phase a few times and average the results.\n",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@grzes314 It wasn't explained anywhere before (I think) that we are augmenting at inference time and hence it actually is tta.

@grzes314
Copy link
Author

I updated the notebook and refactored ClassifierGenerator so that it takes a generator instead of an iterator.

@kamil-kaczmarek kamil-kaczmarek self-assigned this May 16, 2018
Copy link
Member

@kamil-kaczmarek kamil-kaczmarek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok

@kamil-kaczmarek kamil-kaczmarek merged commit 4785256 into dev May 17, 2018
@kamil-kaczmarek kamil-kaczmarek deleted the keras-notebook branch May 17, 2018 12:17
kamil-kaczmarek pushed a commit that referenced this pull request May 23, 2018
* initial

* cleaned up

* updates keras models and callbacks

* added explanation notebook

* renamed notebook

* ran notebook

* transformer loading now to be clicked

* dropped nlp

* fixed typos

* updated whats missing

* updated with dsb and talking data

* added simple pipeline notebook

* imports optimized

* feature_names=None and categorical_features=None

* refactor the way the model parameters are passed

* moved adapters to seperate file, renamed identity/take_first adapters

* Update misc.py

* fit_transform -> transform

* Update base.py

* fixed #10

* fixed typo

* * added: get_upsample_pad, get_downsample_pad
* added: multiclass_segmentation_loss

* *warning added

* Add some user interface messages

* Notebook#3: Adapter for ensembling

* Add example: 1-getting-started.ipynb

* Remove custom adapter; other minor changes after reviewer feedback

* Add example 2-multi-step.ipynb and some minor changes to example 1-getting-started.ipynb

* Cleanup of examples 1 and 2

* Fix a mistake in notebook text

* Add steps/__pycache__ to .gitignore

* Further changes based on Github feedback

* add self.conv_stride parameter in unet definition

* Change steps/__pycache__ to *.pyc in .gitignore

* Changes in Notebook#3 following code review

* train forests on train data and ensembler on ensembling data

* decoupled sklearn preprocessing from text preprocessing with heavy de… (#32)

* decoupled sklearn preprocessing from text preprocessing with heavy dependencies

* fixed import error

* dropped anonymization from text.py, reformatted imports, small refactors

* small refactor for readability

* Change time format (#40)

* Dev docstrings (#33)

* Step halfway done

* Step init args done

* Steps docstrings done

* added docstrings to Step properties

* Step docstring done

* dropped mock transformer addeed docstrings to Base and Dummy Transformers

* base documentation finished, minor refactors

* docstrings added to adapters

* docstrings added

* started refactoring lgbm

* Update base.py

* updated docstrings

* base transformer docstring fix

* fixed logging docstrings

* Notebook #5: Example with Keras (#41)

* Notebook #5: Example with Keras

* Corrected notebook for Keras and necessary refactors in ClassifierGenerator

* Fix issue #28: Unintuitive adapter syntax (#42)

* Write tests for new adapter syntax

* Refactor adapter

* Improve handling of caches and logs in tests

* Fix minor issues mentioned in PR comments

* Rewrite tests in pytest framework

* Move adapting to seperate class, alter behaviour

* Correction: mutable object as default argument in Step initializer

* Issue #16: make_transformer (#50)

* Corrections and tests for Sklearn wrappers

* make_transformer taking arbitrary functions

* fix issues #48 and #49 (#52)

* fix issues #48 and #49

* use of setdefault method

* fix according to Kamil's request

* Fix post merge issues

* Prepare package (#58)

* Remove tutorial notebooks

* Remove modules with heavy dependencies

* Rename steps -> steppy

* Add setup.py

* Tell git to ignore egg files

* Read the docs might output of sphinx-quickstart

* Requirements file

* Try adding sphinx-apidoc output

* Add some requirements

* Add IPython to requirements

* removed intro.ipynb and updated requirements.txt

* corrected setup.py

* refactored NoOperation to IdentityOperation, optimized inputs

* moved misc.py to steppy-toolkit

* simplified ProbabilityCalibation, BaseTransformer small refactor

* prepare setup.py and setup.cfg for PyPI registration

* added install requires to setup.py

* name refactor

* Create README.md
@kamil-kaczmarek kamil-kaczmarek mentioned this pull request May 23, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants