Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional minor memory (and test) refactoring #618

Merged
merged 4 commits into from Nov 10, 2023

Conversation

eddelbuettel
Copy link
Member

This PR tries to ensure we remain on the good side of CRAN with respect to valgrind testing. We do now a small fixed set of 216 bytes being 'lost definitely' when the AWS SDK initializes, this was may be unavoidable. We saw in some tests that a char* holding the arrow format string was not recovered, this PR addresses this.

A somewhat less tractable problem is that R at shutdown and in its garbage collection does not guarentee it will visit all remaining external pointers. So we can observer different test behavior just by moving test blocks in a file, or to a different. And when we started to separate test files so they test in isolation .. we got back to square one because running all may again lead to false positives. So the only viable strategy is to be more careful about which tests run where. This PR keeps the test surface maximal at CI but smaller in other places like CRAN where some arrow related tests may be skipped.

SC 36872

Copy link

This pull request has been linked to Shortcut Story #36872: Additional care for memory checks in the context of arrow.

src/arrowio.cpp Outdated Show resolved Hide resolved
@eddelbuettel eddelbuettel merged commit 2365e53 into master Nov 10, 2023
8 checks passed
@eddelbuettel eddelbuettel deleted the de/sc-36872/additional_memory_test_refactoring branch November 10, 2023 21:27
@eddelbuettel eddelbuettel mentioned this pull request Nov 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants