New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
File format for saving fluid simulation output #154
Comments
We've followed the Schafer Lab's example and used the HDF5 format. It appears to be a standard format used for scientific data these days. Perhaps you could consider using that. We use the H5PY Python library for file i/o. That said, as long as there is a Python library somewhere that can process the file you create, we should be able to make it work. |
Perhaps @MichaelCurrie https://github.com/MichaelCurrie we should link to On Mon, Dec 16, 2013 at 10:11 AM, Michael Currie
|
HDF5 is a good container, but I'm more thinking about higher-level details On 16 December 2013 18:38, Stephen Larson notifications@github.com wrote:
|
@JimHokanson has detailed the file structure of the HDF5 file created by the Schafer Lab here. It would not be necessary for you to calculate all of the data in this structure: along the Movement Validation pipeline, this is Stage 6. Instead, we could take the simulated input either at Stage 1 (raw video), or Stage 2 (wireframe). The wireframe is "normalized" in Stage 3 into exactly 49 measurements per frame along the worm. For instance, the skeleton (the midline of the worm body) is specified at 49 points from head to tail for each frame of video (at 25 FPS). I'm not sure about particles, elastics connections, etc, as it would not be necessary for our movement validation. But perhaps the worm simulation could output a 25 FPS wireframe of the contour. Our processing pipeline would then take this contour data and generate all measurements, features, and statistics from that. If this would be useful perhaps we could give you an example HDF5 file populated that way. I'm sure @JimHokanson will have some thoughts on this beyond what I've said, however. |
I'm thinking an example HDF5 file would be very helpful. On Mon, Dec 16, 2013 at 1:59 PM, Michael Currie notifications@github.comwrote:
|
I think we can be pretty flexible on the format of the file. The minimum The contour should contain x,y pairs over time and should be ordered,
We have been using 49 points for the skeleton, which with two sides and not Jim On Mon, Dec 16, 2013 at 9:45 PM, Stephen Larson notifications@github.comwrote:
|
@vellamike this ties into what we discussed last time right? |
Guys -- @a-palyanov @gidili @tarelli @JimHokanson @MichaelCurrie -- I'm pretty sure we have determined that this will be the geppetto recording format being developed by @tarelli and @jrieke over here? Closing for now as there are a bunch of other issues related to this. |
We need a standard way to save simulation outputs. (samples in time of particle positions). Sibernetic has some rudimentary support for saving outputs (using the
-l_to
flag when running the executable saves some files to thebuffers
folder, though this is not working properly at the moment).The file format should be shared between Geppetto and Sibernetic (allowing for simulation comparisons and visualisation of saved simulations in both frontends).
Does anyone have any thoughts on this? In particular @a-palyanov @gidili @tarelli @JimHokanson and @MichaelCurrie might have a view on the best way forward.
The text was updated successfully, but these errors were encountered: