Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
[V3 Config] Update Mongo document organization to bypass doc size restriction #2536
Description of the changes
This PR reorganizes how the Mongo driver stores data on the database. It will create many more documents than the current implementation but they will each be significantly smaller than the current documents. Because of this reorganization, any existing Mongo data will not be readable by this PR and will need to be migrated using a future tool.
Warning: Breaking Changes
As discussed on red discord server apparently we can't use _id due to the fact that it can't be an array. This is an alternative. https://docs.mongodb.com/master/core/index-unique/
It would help making mongo faster than json, i think next step would allowing cog developers to define unique indexes for their own cogs.
mikeshardmind left a comment
This seems ready to go now.
This is a breaking change. This does remove the ability to convert backend right now (which needs to go onto the 3.1 todo list (updating the conversion for the new organization).