Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IndexError: list index out of range if segment has NaN #242

Closed
rozetko opened this Issue Nov 13, 2018 · 2 comments

Comments

Projects
None yet
3 participants
@rozetko
Copy link
Member

rozetko commented Nov 13, 2018

If segment has just 1 NaN - it drops from learning
Should be possible to have at least 5% of NaNs in segment

handle_analytic_task exception: 'Traceback (most recent call last):
  File ".\bin\..\analytics\analytic_unit_manager.py", line 35, in handle_analytic_task
    result_payload = await worker.do_learn(payload['segments'], data, payload['cache'])
  File ".\bin\..\analytics\analytic_unit_worker.py", line 19, in do_learn
    return await self.detector.train(data, segments, cache)
  File ".\bin\..\analytics\detectors\pattern_detector.py", line 40, in train
    new_cache = self.model.fit(dataframe, segments, cache)
  File ".\bin\..\analytics\models\model.py", line 34, in fit
    self.do_fit(dataframe, segments)
  File ".\bin\..\analytics\models\peak_model.py", line 57, in do_fit
    labeled_peak = data[self.ipeaks[n] - self.state['WINDOW_SIZE']: self.ipeaks[n] + self.state['WINDOW_SIZE'] + 1]
IndexError: list index out of range
@jonyrock

This comment has been minimized.

Copy link
Contributor

jonyrock commented Dec 6, 2018

@VargBurz what is the status of this one?

@VargBurz

This comment has been minimized.

Copy link
Member

VargBurz commented Jan 20, 2019

10% threshold was added. Meaning that if the segment, that goes into learning has more than 10% of NaN values - this segment is excluded from learning.

@amper43 amper43 closed this in #349 Jan 21, 2019

amper43 added a commit that referenced this issue Jan 21, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.