Documentation: Add a configuration guide

[wajda]

Explain the following:

• How to configure Spline Spark agent
• What properties are available for the DefaultSplineConfigurer
• How and when to use a custom configurer
• How to extend LineageDispatcher or how to decorate HttpLineageDispatcher
• How to capture extra user metadata
• anything else that might be relevant

[wajda]

@Zejnilovic

[azurele]

Hi, It would be great if the documentation could cover how to use Spline on Databricks too. Current documentation doesn't elaborate how to setup Spline with Databricks clusters, particularly Spline UI. Thanks!

[wajda]

Noted. Thanks.

[cerveada]

I think we need special pages for agent, gateway and UI on https://absaoss.github.io/spline/, so we can put artifact specific documentation there. The current page should still stay and have guide how to run everything together and general Spline overview.

[wajda]

Hi, It would be great if the documentation could cover how to use Spline on Databricks too. Current documentation doesn't elaborate how to setup Spline with Databricks clusters, particularly Spline UI. Thanks!

It will be covered in AbsaOSS/spline-getting-started#5