Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dataset builder: Step #4: Implmenting async event chunk to image chunk convertor #27

Closed
hmehryar opened this issue May 7, 2022 · 2 comments
Closed

Dataset builder: Step #4: Implmenting async event chunk to image chunk convertor #27

hmehryar opened this issue May 7, 2022 · 2 comments
Assignees
@hmehryar
Labels
enhancement New feature or request
Milestone
ML#2 Building dat...

Comments

@hmehryar
Copy link
Owner

hmehryar commented May 7, 2022 •
edited
Loading

it should

  1. load a chunk of events from a file
  2. convert it to a chunk of images
  3. store it in a chunk of images into files
  4. implement in a way that can be run for different config and pass the parameter thorough shell script
@hmehryar hmehryar added the enhancement New feature or request label May 7, 2022
@hmehryar hmehryar added this to the Post-Meeting 2 Tasks milestone May 7, 2022
@hmehryar hmehryar self-assigned this May 7, 2022
@hmehryar
Copy link
Owner Author

hmehryar commented May 8, 2022

Calculating the running time for 600K according to 1K
method|Events|NumberOfChunks|NumOfEventsInChunk|Elapsed(s)|Elapsed(min)
Storing the the large converting array|1000 | 20|50|0.806|1
600K|40|15000|483.6|8.06
Storing just the chunk array in RAM |1000 | 20|50|0.635|
600K|40|15000|483.6|381|6.35

@hmehryar hmehryar changed the title implmenting async event chunk to image chunk convertor Implmenting async event chunk to image chunk convertor Aug 16, 2022
@hmehryar
Copy link
Owner Author

Modified and Checked for config01 lbt

@hmehryar hmehryar changed the title Implmenting async event chunk to image chunk convertor Dataset builder: Step #4: Implmenting async event chunk to image chunk convertor Oct 4, 2023
hmehryar added a commit that referenced this issue Oct 4, 2023
@hmehryar
dsbuilder step4 resolves #27 @hmehryar
fcf4b6e
@hmehryar hmehryar closed this as completed Oct 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hmehryar hmehryar

Labels
enhancement New feature or request
Projects
None yet
Milestone
ML#2 Building dataset with different ...
Development

No branches or pull requests
1 participant
@hmehryar