Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
sql,ui: support, test and optimize loads using thousands of databases #28376
A modern multi-tenant and micro services could have thousands of databases. Each database could represent a distinct customer and/or micro-services application. Within each database, a number of tables can be created.
Below is an extremely simple example of creating 10,000 databases with 1 table each and 3 rows per table for initial deployment.
Currently CockroachDB has many problems with a large number of databases:
referenced this issue
Aug 8, 2018
My advice would be to start with an investigation where we run a test cluster with that many databases (and corresponding table workload) and profile / inventory where resource consumption goes throughout the stack.
Agreed! There are some tactical things that are specific to the UI that we can accomplish in 2.2 (and beyond) that will further this goal. Examples include tangentially related issues like better handling of large clusters' time series data (#30286) to more fundamental issues like the one Robert mentioned above around resource consumption and load times for large databases on the databases tab. This is a nice issue to be able to refer to when filing other issues that deal with scaling Cockroach
(thanks for reassigning me!)