Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metadata store -XML/Harvestor #262

Closed
ghost opened this issue Mar 21, 2019 · 1 comment
Closed

Metadata store -XML/Harvestor #262

ghost opened this issue Mar 21, 2019 · 1 comment

Comments

@ghost
Copy link

ghost commented Mar 21, 2019

Essentially I'm trying to figure out how to preserve my metadata store when I shutdown my Geoportal running on AWS.

Related to #9, I'm struggling to figure out where the uploaded metadata is stored (via Catalog and brokers via Harvester). I currently have a AWS EC2/ EFS hosting a docker file that installs Elasticsearch/Tomcat/GeoPortal. I have several metadata files uploaded, and I'm trying to search through the file structure (from root) for anything that resembles "clob", "item", relevant "xml", "index" or, anything resembling the name of the uploaded metadata. Note -only an "index" search comes with anything that even looks worthwhile.

The best I come up with is possible preserving the "nodes" subfolder
image

Otherwise, I'm lost. Any suggestions? When I stop my EC2 all ephemeral data is lost.

@ghost
Copy link
Author

ghost commented Mar 21, 2019

So - I'll just go ahead and answer my own question here. I'm not sure why my first 2 searches for my named metadata didn't come up, but when I uploaded a "SSURGO" metadata file, I was able to find 2 directories with info based on a keyword search:

root@2fbcd74b284e:/# grep -nr 'SSURGO*' .Binary file ./var/lib/elasticsearch/nodes/0/indices/pTtLMnKYRvSYSpCz9m5UEQ/4/translog/translog-3.tlog matchesBinary file ./var/lib/elasticsearch/nodes/0/indices/pTtLMnKYRvSYSpCz9m5UEQ/4/index/_1.cfs matches

When I opened the top file (vim translog/translog-3.tlog), the results looked familiar:
image

So, it looks like entire "node" subfolder needs to be stored and then referenced in the docker file. I'll do some more checking where the Harvester brokers are stored, and bug the Harvester Github if I can't find an answer.

Thanks!

@ghost ghost closed this as completed Mar 21, 2019
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

0 participants