Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added MASE, sMAPE and MAPE metrics #330

Merged
merged 29 commits into from
Nov 8, 2022
Merged

Conversation

kashif
Copy link
Contributor

@kashif kashif commented Oct 24, 2022

Added 3 time series specific metrics...

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

@lvwerra
Copy link
Member

lvwerra commented Oct 25, 2022

Hi @kashif, thanks for adding this - the implementation looks great! There seems to be an issue with the example in the docstring, maybe rounding the results would help.

Also, could you add a requirements.txt and README.md? You can for example look at metrics/accuracy for how to add those!

Let me know if you need any help!

@kashif
Copy link
Contributor Author

kashif commented Oct 25, 2022

thanks @lvwerra let me fix it!

@kashif kashif changed the title added MAPE metric added sMAPE and MAPE metrics Oct 28, 2022
@kashif
Copy link
Contributor Author

kashif commented Oct 28, 2022

@lvwerra would be happy for another review

@kashif kashif changed the title added sMAPE and MAPE metrics added MASE, sMAPE and MAPE metrics Oct 28, 2022
@kashif
Copy link
Contributor Author

kashif commented Oct 28, 2022

the tests seems to be failing due to something else I believe

metrics/mape/README.md Outdated Show resolved Hide resolved
Copy link
Member

@lvwerra lvwerra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @kashif for this very clean PR! I left two comments on the PR other than that it looks good to go!

metrics/mape/README.md Outdated Show resolved Hide resolved
metrics/smape/smape.py Show resolved Hide resolved
Copy link
Member

@lvwerra lvwerra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, looks good to me!

@kashif
Copy link
Contributor Author

kashif commented Nov 8, 2022

Thank you!

@lvwerra lvwerra merged commit 7e21410 into huggingface:main Nov 8, 2022
@kashif kashif deleted the time-series branch November 8, 2022 17:10
NimaBoscarino pushed a commit to NimaBoscarino/evaluate that referenced this pull request Nov 9, 2022
* added mean_absolute_percentage_error

* fix output

* more decimal places

* added readme and requirements.txt

* added formula

* fix outputs

* grammer

* formatting

* fix tests

* added smape

* formatting

* fix tests

* whitespace

* fix formula

* added mase

* make style

* typo

* added reference_urls

* latest edition

* fix doc

* better Description

* Fix mape range

* cite sklearn api and helpers

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* fix markdown

* new line
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants