🛑 Warnings

Warning on Serialization

To generate a hash for a rule, the library uses the __str__ method of the rule's params and a rule's group (if defined within a GroupDataSuite). If the params are not serializable, then the hash will not be generated and an error will be thrown.

Warning on Fully Parallel Executions

The library allows you to run checks and suites fully parallel by spinning off processes. When suites are run in parallel (i.e. with the --parallel flag), each suite will be run in its own process. Each check of the suite will be run in its own process. Each rule of the check will be run in its own process. When checks are run in parallel (i.e. with the --parallel flag), each check will be run in its own Process. Each rule of the check will be run in its own process. This allows for maximum parallelization and speed. However, there are some caveats to this:

1. This can be very resource intensive. Make sure you have enough resources to run the checks and suites in parallel.
2. Since a database is being used to store suite, check, rule, and execution data, make sure that the database can handle the number of connections (1 per suite, check, and rule).
3. Ensure that the server running the checks and suites has enough resources to handle the number of processes (1 per suite, check, and rule).

Currently there is no way to specify a maximum number of running processes. This is a feature that is in the works.