New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-2687] Correctly handle read-before-write semantics for user state. #7102
Conversation
608f137
to
6624cad
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
code lgtm, though I'm not familiar with these code-paths; left a few comments on some of the comments 😀
sdks/python/apache_beam/runners/portability/fn_api_runner_test.py
Outdated
Show resolved
Hide resolved
sdks/python/apache_beam/runners/portability/fn_api_runner_test.py
Outdated
Show resolved
Hide resolved
sdks/python/apache_beam/runners/portability/fn_api_runner_test.py
Outdated
Show resolved
Hide resolved
yield buffer | ||
|
||
def is_buffered_correctly(actual): | ||
# Issues pickling closure of self on jenkins. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
some more detail about this might be useful, unless it would be obvious to someone more familiar with the code
self = FnApiRunnerTest('__init__') | ||
# assert sorted(sum((list(b) for b in actual), [])) == elements | ||
# assert max(len(list(buffer)) for buffer in actual) == buffer_size | ||
self.assertEqual(sorted(sum((list(b) for b in actual), [])), elements) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
for my education, what might actual
be here? is it nondeterministic based on timer firings?
Co-Authored-By: robertwb <robertwb@gmail.com>
Co-Authored-By: robertwb <robertwb@gmail.com>
Thanks, PTAL. |
looks good, thanks! |
Follow this checklist to help us incorporate your contribution quickly and easily:
[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.It will help us expedite review of your Pull Request if you tag someone (e.g.
@username
) to look at it.Post-Commit Tests Status (on master branch)