Mongo driver update & less frequent database polls

[sulkaharo]

• Increase debounce for data loads to 15 seconds and trigger a data-loaded event to process local data updates even if the call is debounced.
• Updates the database drivers to latest.
• Removes support for OpenAPS local file storage

Maybe fixes #8024

[bewest]

Nice upgrade to mongodb drivers!

[bewest]

Testing this, and it does something weird in some of my test environments. On some environments it can't bootstrap the connection correctly, but it's not clear if it may be a server misconfiguration issue.

[RickyGrassmuck]

Looking forward to seeing this get merged!

I explored using FerretDB (An alternative to Mongodb that is backed by postgres), which requires using updated mongo driver compatible with Mongodb 6+ to work, as a replacement for Mongodb and early testing looked promising but I didn't have the bandwidth for diving in to fix all the little incompatiblies needed so I had to shelve the idea.

If/when this gets merged, definitely going to be revisiting that project and see if it's truly a viable option to replace Mongodb!

[RickyGrassmuck]

Testing this, and it does something weird in some of my test environments. On some environments it can't bootstrap the connection correctly, but it's not clear if it may be a server misconfiguration issue.

Happy to spin up some test instances and see if I can replicate the connection issues.

[bewest]

Howdy @RickyGrassmuck, this is on track to be merged. I've been ultra-conservative testing scenarios on databases that run in replica set and that have been migrated or have mixed upgrade/migration status or even broken cluster configurations.

[bewest]

Finally catching up on my backlog. Additional testing, and I like this. If the startup boot sequence will more predictably take 15 seconds instead of 5 seconds it might make a nice first-time contribution for someone.
Additionally, this looks ok in node 14, 16, and 18, so thinking about adding node 18 to the compat list.