Benchmark / Testing : Beta test

[tdurand]

Once the first alpha / beta is ready.. gather a list of testers and build list of devices "tested" with the FPS performance for each of them in a table.

I think Google play has some nice way to do this.. where I just push a new build of the app and it gets distributed to beta tester list which a form to fill with feedback.

[tdurand]

Ok ! Much more rough than expected, not ready to start a real beta yet, but you can at least try an alpha

Still on the old apk sharing, on the todo list to setup the proper google play beta environement

Open this link from your device:

https://filedn.com/lkrqWbAQYllSVUK4ip6g3m0/opendatacam/opendatacam-alpha.apk

150MB app ;-)

First start should ask for permission + take 20-30s to start node.js .. but then if you kill and re-open the app it should be instant

Many known bugs.. canvas bugs for counter, yolo boxes off when device orientation isn't righ + everything is a car + 80% confidence

no need to do a list, just see if it launches and how many fps you get ;-) , next week hopefully will be ready for real beta

[b-g]

Yay! Gave it a try:

• No problems to install it
• Yes it took ~20sec on first run
• Afterwards firing up the app is quick
• No bboxes but a few glitches
• FPS: between 9 - 15 FPS

Questions which came to my mind:

• How to edit the config.json on Android?
• Right side menu: There should be no sticky footer
• App Icon ...

[tdurand]

No bboxes but a few glitches

What do you mean, it didn't detect anything ? No bounding boxes

How to edit the config.json on Android?

No possible without recompiling the app ;-) .. yeah I think it may be time to introduce a settings page in the UI.. also should be possible at some point to process pre-recorded video with Android / Hook to remote video streams

Right side menu: There should be no sticky footer

yep

App Icon ...

yep, todo ;-)

[tdurand]

@b-g ! Happy 🎄 !!

I have a gift right on time, the next alpha version, hopefully the last to share only with you, I'm setuping the broader beta testing system... but need first to make sure it works properly on your device.

Please remove first the old version.. as this one as the same version number etc etc..

https://filedn.com/lkrqWbAQYllSVUK4ip6g3m0/opendatacam/opendatacam-alpha-2.apk

No hurry to test it, I'm taking a few days off I'll be back on the 28th / 29th.

The main thing to test is to see this time you have some detections happening... the rest should be still be very buggy.. I added the app icon though (can't do circle..)

If the detections aren't happening, will need definitely to debug what is happening on your device... I rewrote a part of the Camera API hooking to YOLO, and should be more robust now.

[b-g]

Hi Tibo! Merry Christmas 🎄! Still in Christmas mode. Hence will keep it short: it’s working now, the detections are showing up! Yay! + Very cool that you’ve managed to rewrite it. Glad that this is working and that we can stick wir MIT! All the best, B

[b-g]

[tdurand]

Great !! I didn't rewrite fully yet, but glad it works ! in touch this week with a new version !

[tdurand]

New version up: https://filedn.com/lkrqWbAQYllSVUK4ip6g3m0/opendatacam/opendatacam-beta-2.apk

Changelog:

• fast start on first time
• loading screen

Still the old way with the .apk link , as unfortunately the play store beta test isn't working yet.. I read it can last several days: https://stackoverflow.com/questions/64749306/google-play-console-internal-testing

[tdurand]

Good news, now you should be able to download the beta directly on the play store: https://play.google.com/store/apps/details?id=com.opendatacam&hl=fr&ah=OkdfG0YWSVrpUVSoQZMQz6z205c

We need to work out the screenshot / assets part of the play store and the description -

Also I created a mailing list for the broader beta test registration: opendatacam/opendatacam#365 , tomorrow I will do another round of fixes .. and on tuesday I will add the beta testers subscribed

Will setup a google form with the following questions, feel free to add / remove

• What is your device ( with description on how to get this info)
• Does OpenDataCam work ? yes / no
• FPS you get ?
• Comments

[b-g]

Yay super!

I tweaked the questions a bit:

• What is your device (with description on how to get this info)
• Does the OpenDataCam app work out of the box? yes / no. (Optional: If no please provide a short desc)
• How many Frames per Seconds "FPS" is the app running? (The dancing red number next to the modes buttons)
• Anything else you would like to tell us? (Feedback, suggestions, critique etc.)

[tdurand]

Thanks ! Gonna share the beta with more internal tester tomorrow and link them the form / ask over email .. I collected some emails with the post on the github ( like 6-7 right now) .. will add some friends of mine too

I fixed plenty of small stuff today, UI should be much less prone to bugs and more easy to work with now ( button size, download file name etc etc... + also now collect location data) , 1.0.0-beta.4 is out !

[b-g]

Great! Now I'm just wondering how much feedback we want? I could either ask informally friends and family OR trying to create a bigger wave. My feeling with the later is, that we should wait until we are close to a proper release and see it more as a form of community engagement. OK?

[tdurand]

Yes, keep it "small" for now .. As also it is a "closed" beta, we need to add the emails of people to give them access to the beta.

Then let's try to create a bigger wave later on when feel more confident that the app is not crashing everywhere 😁 + add the in app purchase thing

[b-g]

👍

[tdurand]

I invited people to the internal test group, in order to invite a few friends without asking them to register to the mailing list group, I've sent you an invite to access the google play account.

Once you accept it you should be able to:

• Open google play console: https://play.google.com/console
• Open the "beta test" mailing list: https://play.google.com/console/u/0/developers/5347722965404413549/email-lists/5206671544876565308/update-email-list
• Add the google account email of the person
• Send them the link to get into the internal testing and download the app: https://play.google.com/apps/internaltest/4699530872159416435
• Optional: send them the link to the feedback form: https://forms.gle/3xteLBkeeL6QKBWM9

[b-g]

Thanks! Works! Pinged my brothers and a few other peeps.

[tdurand]

cool, yes I got feedback from some friends and seems to work on different device, Sony , Samsung... so quite confident now that it won't be crashing everywhere