Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP

Loading…

update element maps in batches #27

Closed
ddale opened this Issue · 1 comment

1 participant

@ddale
Owner

explore the possibility of speeding up IO:

many_results = pool.map(...)

#for each element, maptype:
res = [i for i in many_results if i is calcium]
update(res)

@ddale
Owner

Ended up taking a different approach, using a results proxy to store and update numpy arrays in memory. Those arrays are not written to file until data processing has completed.

@ddale ddale closed this
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.