Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize memory allocations and add multithreading #6

Open
bdrum opened this issue Jun 17, 2020 · 2 comments
Open

Optimize memory allocations and add multithreading #6

bdrum opened this issue Jun 17, 2020 · 2 comments
Assignees
@bdrum
Labels
enhancement New feature or request invalid This doesn't seem right question Further information is requested software Issue dedicated to software

Comments

@bdrum
Copy link
Owner

bdrum commented Jun 17, 2020

Now In case of large set of data e.g. ccup8 or ccup31 scripts works slowly and take all memory.
@bdrum bdrum added enhancement New feature or request invalid This doesn't seem right labels Jun 17, 2020
@bdrum bdrum self-assigned this Jun 17, 2020
@bdrum
Copy link
Owner Author

bdrum commented Jun 18, 2020

Before adding multi threading I have to optimize memory and design functions for data.

Discussion about what use threading or processing in python

@bdrum
Copy link
Owner Author

bdrum commented Jun 19, 2020

For ccup8 it takes 4gb of memory and 45sec.

itsl0 = events.array("HasPointOnITSLayer0")

How to avoid direct allocation and optimize data loading?

@bdrum bdrum added the question Further information is requested label Jun 19, 2020
@bdrum bdrum added the software Issue dedicated to software label Jun 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bdrum bdrum

Labels
enhancement New feature or request invalid This doesn't seem right question Further information is requested software Issue dedicated to software
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@bdrum