Erro Loading annotation in Videos

[llsantos]

Hi, I'm having this problem:

Could not load video: blob:https://vidat.davidz.cn/c5eb8afc-b3f1-4af7-85a7-41c6425cb582: Failed to open channel

This happens when I load the video annotation.

[DavidZhang73]

Could you provide the video file for me to debug? It seems related to the format of the video.

[llsantos]

Sure, here is the link: https://drive.google.com/drive/folders/1Zl07Br36Ydz1CVv0Usocjexy2aR40Mzl?usp=sharing
The error only happen in vidat2, in vidat1 i can load video and annotation, but i dont know if is right.
note: The annotation were created in vidat2.

[DavidZhang73]

@llsantos Thanks for your feedback. It is a bug, not related to the video format.

Now you should be able to load the annotation file after loading the local video.
The video is really large, and it takes a long time for Vidat to process, some suggestions:

1. set defaultFPS to some small number, like 2. Maybe not, since changing #frame leads frame indexes not match.
2. downscale the size of the video, since you are labelling actions, resolution does not matter, ffmpeg is recommended.
3. set action only mode, i.e. set all three other modes to false.
4. use hot keys.

Please leave comments if it still fails to work, close this issue otherwise.

[llsantos]

Unfortunately, the error remains.

[DavidZhang73]

@llsantos Are you using the Vidat hosted by us? Please use Aliyun Host, it is synced with the latest development version, ANU Host only sync with latest release version.

[llsantos]

I used the vidat2 hosted by you and me, both happen the same error.
In Alyun Host, "happen out of memory".

[DavidZhang73]

@llsantos Aliyun Host is the latest version and unfortunately, limited by the browser and hardwares, out of memory might happen due to the fact that the video is quite large (2560x1440@30fps x 1hour). Vidat needs to cache every single frame (107289 frames in total) and store them in memory. I still recommend

1. set defaultFPS to some small number, like 2. Since you are labelling actions only, change the frames directly in the annotation file can bypass the frame check.
2. downscale the size of the video, since you are labelling actions, resolution does not matter, ffmpeg is recommended.

[llsantos]

II had shortened the video to 30 min, and "out of memory" happens before I set the FPS.(In Aliyun Host)
Is the bug fixed in this latest version?
Is the latest version available for download?

[DavidZhang73]

II had shortened the video to 30 min, and "out of memory" happens before I set the FPS.(In Aliyun Host)

Please change the defaultFPS before load the video, since vidat uses that fps for frame caching. This is because in browser environment, we cannot obtain the real fps of a video, besides, it can be VFR. And it is by design to let user specify a fps to control labelling accuracy.

Is the bug fixed in this latest version?

The original issue is Could not load video: blob:https://vidat.davidz.cn/c5eb8afc-b3f1-4af7-85a7-41c6425cb582: Failed to open channel which has been resolved. The issue we are discussing for now is out of memory, which is beyond my capability.

Is the latest version available for download?

The Vidat version 2 is still in alpha stage, its latest development code stores in main branch. And whenever a new commit is pushed to this repo, a compiled pre-release is provided and named as Development Release v2.x.x-xxx and deployed on Aliyun Host. ANU Host is managed manually, which means it can be of any version.

Whenever we decide to release a new version like (v2.0.1), we will create a release named as Release v2.x.x-xxx and deploy it to ANU Host.

[llsantos]

"The original issue is Could not load video: blob:https://vidat.davidz.cn/c5eb8afc-b3f1-4af7-85a7-41c6425cb582: Failed to open channel which has been resolved."
No, this is only issue. I wrote that i can load the video and annotation in a old vidat 1.0, not in vidat 2.0, even having created the annotations in vidat 2.0.

[DavidZhang73]

I see. I set up an experiment, using the video and annotation Json file provided by you and manually replace the frames in that Json file with 35763.

It takes around 7GB of memory when 51% frames are cached.

I did not run into the out of memory issue.

No, this is only issue. I wrote that i can load the video and annotation in a old vidat 1.0, not in vidat 2.0, even having created the annotations in vidat 2.0.

You can use VideoLoader V1 instead of V2 (in Preferences - Video Decoder), which is used in Vidat version 1.

[llsantos]

Thanks!