Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tabtransformer #33

Merged
merged 24 commits into from
Feb 11, 2021
Merged

Tabtransformer #33

merged 24 commits into from
Feb 11, 2021

Conversation

jrzaurin
Copy link
Owner

This represents an almost-complete refactor of the previous version and I consider the code in this version well tested and production-ready. The only reason why this release is not v1 is because I want to use it with a few more datasets, but at the same time I want the version to be public to see if others use it. This version is not backwards compatible (at all).

These are some of the structural changes:

  1. Building of the model and training the model and now completely decoupled
  2. Added the TabTransformer as a potential deeptabular component
  3. Renamed many of the parameters so that they are consistent between models
  4. Added the possibility of customising almost every single component: model component, losses, metrics and callbacks
  5. Added R2 metrics for regression problems

…tween a number of implementation (that will of course be credited in the code)
…0 for unseen categories (as padding) for both wide and deeptabular component
…k and fix bug in the History callback. Added multiple tests and increased code coverage to 94 per cent
…ch I really like. Changed the code accordingly. Changed the name of DeepDense and DeepDenseResnet to TabMlp and TabResnet. Change the tests acccordingly
… ones if required. Now I need to think if I want it registered as a child or not. Also, need to test all new implementation
… a Trainer class. All seems easier now. Need to adjust all documentation. Also added a few losses and an R2 metric, as well as the possibiliy of customising virually every single component of the model
… new code structure. Remove partial imports from...everywhere. Updated examples
…ixed some examples of usage. Added FullEmbeddingDropout to TabTransformer. Encapsulate alias in Classes in loss_and_obj_alias module and change some minor style text
…o latest version of numpy (need to look into this. Ready to move on with notebooks
…of callback tests, since it seems to cause some problems at testing time (I think, see what travis has to say)
…hat it really is, FineTune. Alias the corresponding parameters so that the user can use both, finetune and alias params. Modified a few defaults
…tirely diff when built in the locally than with the app, I had to revert back to default themes. This was painful
… beta because I prefer to wait for V1 until I have tried it with more datasets
@jrzaurin jrzaurin merged commit f430864 into master Feb 11, 2021
@jrzaurin jrzaurin deleted the tabtransformer branch April 30, 2021 14:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant