Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Events files #11

Closed
qo4on opened this issue Aug 7, 2021 · 5 comments
Closed

Events files #11

qo4on opened this issue Aug 7, 2021 · 5 comments

Comments

@qo4on
Copy link

qo4on commented Aug 7, 2021

You wrote:
A Google Colab notebook is now available here. You can upsample your own video and events from you gdrive.
How to get events files and timestamp.txt for my own video?

@RobertLowe
Copy link

RobertLowe commented Aug 8, 2021

@danielgehrig18 yeah, how did you generate timestamps.txt? And create the .npz files?

Thanks!


Edit: Nevermind find, I found out its from a highspeed camera

@TashaSkyUp
Copy link

would love to know if the model checkpoint can be used to create high fps footage without having the event frames from a high speed camera?

@RobertLowe
Copy link

@TashaSkyUp my bet is probably not, DAIN is probably the best we'll get for now

@Zer0xPoint
Copy link

maybe there is a way to get timestamp file, because it just contains info of how long a frame takes to move to the next frame.

@danielgehrig18
Copy link
Contributor

Hi all, this work uses a complementary event camera (not a high-speed camera), in addition to a standard camera. Instead of recording event frames it records an asynchronous stream of events, as can be observed in the video here: https://youtu.be/dVLyia-ezvo?t=56. For this reason, the method cannot work on images alone. The .npz files record the data that comes from an event camera. Each file contains a list of (x,y,t,p) which denote the position (x,y), time and sign of the brightness change measured by the event camera. Thus we also need to the know the timestamps of the images which are stored in the timestamp.txt file. For a regural video at say 30 FPS they can be calculated as i/30, where i is the frame index.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants