-
Notifications
You must be signed in to change notification settings - Fork 170
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[enhancement] IncrementalBasicStatistics interface #1630
Conversation
c7a93cd
to
54b9cfc
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please separate BasicStatistics refactoring and IncrementalBasicStatistics addition
done |
/intelci: run |
0bda1b7
to
b993e34
Compare
/intelci: run |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In general LGTM with minor comments
onedal/basic_statistics/tests/test_incremental_basic_statistics.py
Outdated
Show resolved
Hide resolved
onedal/basic_statistics/tests/test_incremental_basic_statistics.py
Outdated
Show resolved
Hide resolved
onedal/basic_statistics/tests/test_incremental_basic_statistics.py
Outdated
Show resolved
Hide resolved
/intelci: run |
1 similar comment
/intelci: run |
4076c36
to
be94582
Compare
Request is addressed. Review is required
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Mostly minor revisions needed here - seems to be close to ready
print(f"Mean:\n{result.mean}") | ||
print(f"Max:\n{result.max}") | ||
print(f"Sum:\n{result.sum}") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can make this more specific: "Mean via automatic splitting via batch size:"
onedal/basic_statistics/tests/test_incremental_basic_statistics.py
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
great coverage here
self._need_to_finalize = False | ||
|
||
def _onedal_partial_fit(self, X, weights, queue): | ||
first_pass = not hasattr(self, "n_samples_seen_") or self.n_samples_seen_ == 0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
are first_pass and n_samples_seen_ needed for incremental basic stats?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
first_pass is used below. and n_samples_seen_ is added for conformance. I admit there can be scenarios where user needs it.
/intelci: run |
/intelci: run |
Changes proposed in this pull request: