Develop plan for instituting AWS ES Cross Cluster Search

[jimmie]

Per discussions, we will have the engineering registry api service employ cross cluster search to other nodes' ES instances to centralize search operations. This ticket intends to develop the plan and strategy to get this ready.

[jordanpadams]

@jimmie does the estimate i added here seem reasonable 👉 ?

[jordanpadams]

simple version implemented on free AWS. will look to document over the next couples days as we continue to work fargate issues

[tloubrieu-jpl]

PDS API works on top of CCS'ed clusters. Still on free AWS

[msbentley]

Just a related question - will the cross cluster search also work with ES instances at node (or IPDA member) sites, or do they all have to be colocated on AWS? I would assume the former, but wanted to check...

[jordanpadams]

@msbentley the current AWS CCS implementation only allows for co-located AWS instances, including the region of the deployed registries. we can work with our IPDA members in the event they would like a registry instance created.

[jordanpadams]

as a note, we can also most likely work with AWS to improve this capability to enable cross-region search if needed. we could also look into ways to mask or proxy other instances if this becomes a major constraint on the system.

[msbentley]

OK, thanks - we're not quite there yet with the PSA, but just thinking ahead

[tloubrieu-jpl]

@jimmie will create a pull request for this ticket very soon (today)