Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

implement modified diebold mariano test #22

Merged
merged 16 commits into from
Aug 30, 2023

Conversation

nicholasloveday
Copy link
Collaborator

No description provided.

@nicholasloveday nicholasloveday linked an issue Jul 21, 2023 that may be closed by this pull request
@nicholasloveday
Copy link
Collaborator Author

I've migrated across the DM test stat code that Rob wrote with some small updates to make it consistent with scores.

Note that I've added statsmodel as a required python package.

I still need to write up a tutorial notebook.

@nicholasloveday nicholasloveday marked this pull request as ready for review July 21, 2023 07:42
@nicholasloveday
Copy link
Collaborator Author

Notebook tutorial added.

@nicholasloveday nicholasloveday force-pushed the 21-add-the-modified-diebold-mariano-test-statistic branch from ce3fbae to 1f15b00 Compare July 24, 2023 00:59
@nicholasloveday nicholasloveday force-pushed the 21-add-the-modified-diebold-mariano-test-statistic branch from 1f15b00 to 5a80823 Compare July 25, 2023 23:01
@nicholasloveday nicholasloveday force-pushed the 21-add-the-modified-diebold-mariano-test-statistic branch 2 times, most recently from f5fe3ae to 7fbb5c3 Compare August 23, 2023 01:27
@tennlee tennlee changed the base branch from main to develop August 23, 2023 02:39
@nicholasloveday
Copy link
Collaborator Author

FYI @tennlee , I've updated the Github actions here to also run unit tests on the develop branch (they were only running on main)

@nicholasloveday nicholasloveday force-pushed the 21-add-the-modified-diebold-mariano-test-statistic branch 2 times, most recently from f613f50 to 2b0a6e1 Compare August 23, 2023 23:37
src/scores/stats/confidence_intervals_impl.py Outdated Show resolved Hide resolved
src/scores/stats/confidence_intervals_impl.py Outdated Show resolved Hide resolved
src/scores/stats/confidence_intervals_impl.py Outdated Show resolved Hide resolved
src/scores/stats/confidence_intervals_impl.py Outdated Show resolved Hide resolved
pyproject.toml Outdated Show resolved Hide resolved
src/scores/stats/tests/acovf.py Show resolved Hide resolved
@HCookie
Copy link
Collaborator

HCookie commented Aug 25, 2023

@tennlee Can this be merged?

@nicholasloveday
Copy link
Collaborator Author

@tennlee Can this be merged?

@HCookie , hold off on the merge until I respond to @tennlee's comments above

@nicholasloveday nicholasloveday force-pushed the 21-add-the-modified-diebold-mariano-test-statistic branch from e4d911c to b944d7c Compare August 30, 2023 23:13
@nicholasloveday
Copy link
Collaborator Author

Thanks for that review @tennlee, I've made some updates based on your feedback

@tennlee tennlee merged commit d32a1eb into develop Aug 30, 2023
5 checks passed
@tennlee tennlee deleted the 21-add-the-modified-diebold-mariano-test-statistic branch August 30, 2023 23:59
tennlee added a commit that referenced this pull request Sep 15, 2023
* implement modified diebold mariano test
* added dm test stat tutorial notebook
* Implement  the `acovf` function from `statsmodels`
* updated github actions to run tests on develop branch
* Add copyright from statsmodel
* Improve keyword matching in exclude statements for pyproject.toml
* added warning for dm tests if there are NaNs

---------

Co-authored-by: nicholas loveday <nicholas.loveday@bom.gov.au>
Co-authored-by: Harrison Cook <harrison.cook@bom.gov.au>
Co-authored-by: Tennessee Leeuwenburg <tennessee.leeuwenburg@bom.gov.au>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add the Modified Diebold-Mariano test statistic
3 participants