Indexing workflow for external sites

[ahankinson]

For integrating search results in RISM Online, we need to have a way of integrating the search results together, while still keeping the sites "isolated" so that their data can be updated on a separate timeline from the RISM data. Since we reindex RISM data nightly, we need to index the external sites into the "main" core on that same period as well.

After some discussion:

• Index data from external site into a dedicated Solr core, on an as-needed period (day, week, month, year)
• Index data from the dedicated core into the "main" Solr core, on the same period as the "main" RISM indexing.

We will strive to align the data structure on the dedicated cores with the "main" RISM index structure, so that not much mapping happens when doing the second step.

[ahankinson]

A first draft of this has been completed, so I will close this.