We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
reduceByKey
The reduceByKey uses only the ghost particles but maybe all of them are kept in memory because of the slice in getting no_ghosts_rdd.
no_ghosts_rdd
Could try something like
def get_ghosts(p): ghosts = p[np.where(p['is_ghost'] != GHOST_PARTICLE_COPY)[0]] del(p) return ghosts
Has to be tested if this actually reduces the memory or not.
The text was updated successfully, but these errors were encountered:
No branches or pull requests
The
reduceByKey
uses only the ghost particles but maybe all of them are kept in memory because of the slice in gettingno_ghosts_rdd
.Could try something like
Has to be tested if this actually reduces the memory or not.
The text was updated successfully, but these errors were encountered: