Poc: base classes for deep models and rnn and deepstate with examples #776

martins0n · 2022-06-30T22:42:49Z

Before submitting (must do checklist)

Did you read the contribution guide?
Did you update the docs? We use Numpy format for all the methods and classes.
Did you write any new necessary tests?
Did you update the CHANGELOG?

Proposed Changes

Closing issues

github-actions · 2022-06-30T22:47:30Z

🚀 Deployed on https://deploy-preview-776--etna-docs.netlify.app

martins0n · 2022-07-01T14:17:32Z

https://wandb.ai/martins0n/native_test?workspace=user-martins0n

codecov-commenter · 2022-07-01T14:29:25Z

Codecov Report

Merging #776 (0ed6428) into master (62737e0) will decrease coverage by 34.16%.
The diff coverage is 37.91%.

@@             Coverage Diff             @@
##           master     #776       +/-   ##
===========================================
- Coverage   83.69%   49.52%   -34.17%     
===========================================
  Files         124      125        +1     
  Lines        6959     7193      +234     
===========================================
- Hits         5824     3562     -2262     
- Misses       1135     3631     +2496

Impacted Files	Coverage Δ
etna/models/nn/rnn.py	`31.03% <31.03%> (ø)`
etna/models/base.py	`60.22% <36.44%> (-27.51%)`	⬇️
etna/datasets/tsdataset.py	`66.92% <48.00%> (-23.19%)`	⬇️
etna/datasets/utils.py	`41.66% <57.14%> (-58.34%)`	⬇️
etna/pipeline/pipeline.py	`83.78% <66.66%> (-13.19%)`	⬇️
etna/models/nn/__init__.py	`100.00% <100.00%> (ø)`
etna/commands/__init__.py	`0.00% <0.00%> (-100.00%)`	⬇️
etna/commands/backtest_command.py	`0.00% <0.00%> (-97.06%)`	⬇️
etna/commands/forecast_command.py	`0.00% <0.00%> (-94.88%)`	⬇️
etna/commands/__main__.py	`0.00% <0.00%> (-87.50%)`	⬇️
... and 79 more

📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

etna/datasets/tsdataset.py

etna/models/base.py

Mr-Geekman · 2022-07-04T15:16:03Z

etna/models/base.py

+        pass
+
+
+class DeepBaseModel(LightningModule, FitAbstractModel, DeepBaseAbstractModel, BaseMixin):


Why do we need inheritance from LightningModule here? I thought that in general composition is better than inheritance.

general composition is better than inheritance.

I don't think that passing LightningModule as parameter make any difference in our case because we don't have any coupled logic and deep hierarchy. But we will write a little bit extra code for wrappers with duplicated docs.

What downsides do you think of about?

Am I correctly understand that you decided to make dependency injection here?

etna/datasets/tsdataset.py

etna/models/base.py

etna/models/nn/__init__.py

alex-hse-repository · 2022-07-05T04:44:30Z

Notebook seems to be outdated

alex-hse-repository · 2022-07-11T05:32:32Z

Improve description in the notebook:

pytorch-lightning -> pytorch-forecasting
We'll used -> We'll use

docs/source/conf.py

etna/datasets/tsdataset.py

etna/models/base.py

etna/models/nn/rnn.py

alex-hse-repository · 2022-07-12T05:15:59Z

I guess we need some more tests:

Test for make_future with tails_steps!=0
Tests for tsdataset_idx_slice
Tests for to_torch_dataset
Tests for DeepBaseModel interface
Test for make_samples in RNN
May be tests for forward/step methods, don't know how to create them without pain

tests/test_datasets/test_dataset.py

tests/test_models/test_base.py

alex-hse-repository

Almost done)
There are some unresolved threads left

alex-hse-repository

👍

alex-hse-repository

Waiting for some "little" changes)

etna/datasets/tsdataset.py

github-actions bot temporarily deployed to pull request June 30, 2022 22:53 Inactive

github-actions bot temporarily deployed to pull request July 1, 2022 08:53 Inactive

github-actions bot temporarily deployed to pull request July 1, 2022 12:52 Inactive

github-actions bot temporarily deployed to pull request July 1, 2022 14:24 Inactive

github-actions bot temporarily deployed to pull request July 3, 2022 19:09 Inactive

github-actions bot temporarily deployed to pull request July 3, 2022 19:32 Inactive

Mr-Geekman reviewed Jul 4, 2022

View reviewed changes

etna/datasets/tsdataset.py Outdated Show resolved Hide resolved

Mr-Geekman reviewed Jul 4, 2022

View reviewed changes

etna/models/base.py Outdated Show resolved Hide resolved

Mr-Geekman reviewed Jul 4, 2022

View reviewed changes

alex-hse-repository self-requested a review July 5, 2022 02:58

alex-hse-repository suggested changes Jul 5, 2022

View reviewed changes

martins0n force-pushed the poc-rnn-logic-in-models branch from a6c01e9 to c8df114 Compare July 7, 2022 13:13

github-actions bot temporarily deployed to pull request July 7, 2022 13:16 Inactive

github-actions bot temporarily deployed to pull request July 7, 2022 14:04 Inactive

github-actions bot temporarily deployed to pull request July 7, 2022 14:09 Inactive

martins0n requested review from alex-hse-repository and Mr-Geekman July 7, 2022 14:41

github-actions bot temporarily deployed to pull request July 7, 2022 14:47 Inactive

martins0n added this to the Etna-native neural network models milestone Jul 8, 2022

alex-hse-repository suggested changes Jul 11, 2022

View reviewed changes

github-actions bot temporarily deployed to pull request July 11, 2022 15:28 Inactive

github-actions bot temporarily deployed to pull request July 11, 2022 17:11 Inactive

github-actions bot temporarily deployed to pull request July 11, 2022 17:28 Inactive

martins0n requested a review from alex-hse-repository July 11, 2022 18:06

FIX: changelog

8c83571

martins0n force-pushed the poc-rnn-logic-in-models branch from e86704b to 8c83571 Compare July 14, 2022 13:54

FIX: examples gitignore

2957220

github-actions bot temporarily deployed to pull request July 14, 2022 14:00 Inactive

martins0n requested a review from alex-hse-repository July 14, 2022 15:00

alex-hse-repository suggested changes Jul 15, 2022

View reviewed changes

Mr-Geekman mentioned this pull request Jul 15, 2022

Implement in-sample and out-sample predictions in nn models without exceptions #805

Open

FIX: test cases

797ee81

martins0n requested a review from alex-hse-repository July 18, 2022 17:37

github-actions bot temporarily deployed to pull request July 18, 2022 17:40 Inactive

FIX: mocks

36ba1cf

github-actions bot temporarily deployed to pull request July 18, 2022 17:57 Inactive

alex-hse-repository suggested changes Jul 19, 2022

View reviewed changes

FIX: tests

10c6ea6

martins0n requested a review from alex-hse-repository July 19, 2022 12:36

github-actions bot temporarily deployed to pull request July 19, 2022 12:39 Inactive

alex-hse-repository approved these changes Jul 19, 2022

View reviewed changes

alex-hse-repository self-requested a review July 19, 2022 13:13

alex-hse-repository suggested changes Jul 19, 2022

View reviewed changes

Mr-Geekman reviewed Jul 20, 2022

View reviewed changes

etna/datasets/tsdataset.py Show resolved Hide resolved

Mr-Geekman reviewed Jul 20, 2022

View reviewed changes

etna/datasets/tsdataset.py Outdated Show resolved Hide resolved

martins0n added 2 commits July 21, 2022 11:54

Poc rnn logic in models part1 (#807)

173943e

Merge branch 'master' into poc-rnn-logic-in-models

0ed6428

github-actions bot temporarily deployed to pull request July 21, 2022 08:58 Inactive

alex-hse-repository self-requested a review July 21, 2022 09:19

alex-hse-repository approved these changes Jul 21, 2022

View reviewed changes

martins0n merged commit e475d5d into master Jul 21, 2022

martins0n deleted the poc-rnn-logic-in-models branch July 21, 2022 09:21

martins0n mentioned this pull request Jul 21, 2022

POC: LSTM net and new methods for tsdataset #620

Closed

9 tasks

Mr-Geekman mentioned this pull request Aug 14, 2023

Implement in-sample and out-sample predictions in nn models without exceptions etna-team/etna#17

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Poc: base classes for deep models and rnn and deepstate with examples #776

Poc: base classes for deep models and rnn and deepstate with examples #776

martins0n commented Jun 30, 2022 •

edited

github-actions bot commented Jun 30, 2022 •

edited

martins0n commented Jul 1, 2022

codecov-commenter commented Jul 1, 2022 •

edited

Mr-Geekman Jul 4, 2022

martins0n Jul 4, 2022

Mr-Geekman Jul 12, 2022

martins0n Jul 12, 2022

alex-hse-repository commented Jul 5, 2022

alex-hse-repository commented Jul 11, 2022

alex-hse-repository commented Jul 12, 2022

alex-hse-repository left a comment

alex-hse-repository left a comment

alex-hse-repository left a comment

		pass


		class DeepBaseModel(LightningModule, FitAbstractModel, DeepBaseAbstractModel, BaseMixin):

Poc: base classes for deep models and rnn and deepstate with examples #776

Poc: base classes for deep models and rnn and deepstate with examples #776

Conversation

martins0n commented Jun 30, 2022 • edited

Before submitting (must do checklist)

Proposed Changes

Closing issues

github-actions bot commented Jun 30, 2022 • edited

martins0n commented Jul 1, 2022

codecov-commenter commented Jul 1, 2022 • edited

Codecov Report

Mr-Geekman Jul 4, 2022

Choose a reason for hiding this comment

martins0n Jul 4, 2022

Choose a reason for hiding this comment

Mr-Geekman Jul 12, 2022

Choose a reason for hiding this comment

martins0n Jul 12, 2022

Choose a reason for hiding this comment

alex-hse-repository commented Jul 5, 2022

alex-hse-repository commented Jul 11, 2022

alex-hse-repository commented Jul 12, 2022

alex-hse-repository left a comment

Choose a reason for hiding this comment

alex-hse-repository left a comment

Choose a reason for hiding this comment

alex-hse-repository left a comment

Choose a reason for hiding this comment

martins0n commented Jun 30, 2022 •

edited

github-actions bot commented Jun 30, 2022 •

edited

codecov-commenter commented Jul 1, 2022 •

edited