Covert some of the config testing to baselines for easy validation (#…

…51063)

* Baseline config tests for easy validation

* Refactor

* Fix incorrect pick

* Dont print unnecessary plugin host not implemented msg in logs