Apache Atlas docker and k8s changes

[cmgrote]

• Configures vanilla Apache Atlas container to tail all log files by default (not only application.log)
• Adds container-external accessibility to embedded Apache Atlas Kafka event bus
• Adds parameters for Apache Atlas container (eg. credentials, endpoints, etc)
• Swaps forked Apache Atlas container as default to the vanilla Apache Atlas container
• Configures Apache Atlas proxy as part of egeria container itself, rather than a separate container

[planetf1]

What level of capability do we now have in the atlas proxy connector compared to the temporary native connector - at least in terms of an integrated deployment

Clearly we will lose the ability to write to atlas (as covered in other issues) but we will have a more strategic environment.

The main use of atlas I've seen from users so far is in terms of UI. The subject area UI is now available, and the type explorer, and other viewers are coming soon - so the only question for me now is whether it's ok to drop atlas writeability before those alternate UIs are in place (and within the chart)

An alternative is to retain use of the old image -- but this does make the scripts more complex

If we do move entirely to the new image

• we can remove the old image from the build process entirely

[planetf1]

From a development perspective it's a good change... I'll float the suggestion with a few people I currently have pulling the charts to check for impact before merging

[planetf1]

I've confirmed at least one user is making use of atlas ui for browsing. Likely terms/glossaries. I noted current UI is failing also so opened up #1129

I suggest we need to hold off merging just yet.

[planetf1]

See comments.
Just adding a request mark whilst we assess/mitigate the impact for any existing users

[cmgrote]

Sure thing -- let's leave open for now. I was under the impression that the forked Atlas build may be broken already, in which case this was at least something. But if not, let's leave as-is for now 👍

[planetf1]

Ok. I will double check if it works now (it was ok), but have a few people confirm they are using it. Obviously if we make it optional then we can merge now. I think the availability of Egeria UIs will allow us to make the change finally as I completely agree in not wanting to prolong the use of forked atlas much longer, and the main use-case for Atlas right now seems to be visualizing the contents of egeria!

[schannamallu]

recheck

[planetf1]

Can confirm 'old' atlas is working propertly, so continuing to wait until new UI is available in lieu of atlas UI for simple search