Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/harvest running #369

Merged
merged 8 commits into from
Nov 10, 2021
Merged

Feature/harvest running #369

merged 8 commits into from
Nov 10, 2021

Conversation

jbrown-xentity
Copy link
Contributor

@jbrown-xentity jbrown-xentity commented Oct 27, 2021

Related to GSA/data.gov#2810

The deployment picks up the harvest jobs and runs them.

This is not testable in it's current state; development has some issue connecting with the solr app (and harvests won't work; neither will any data management). Staging and prod don't have the same issue, so I'm going to continue to look at why...

cf logs for proof of working
Showing health and status for app catalog in org gsa-datagov / space development as james.c.brown@gsa.gov...

name:              catalog
requested state:   started
routes:            catalog-dev-datagov.app.cloud.gov
last uploaded:     Wed 27 Oct 15:59:56 MDT 2021
stack:             cflinuxfs3
buildpacks:        
        name                                            version   detect output   buildpack name
        https://github.com/cloudfoundry/apt-buildpack   0.2.8                     apt
        python_buildpack                                1.7.46    python          python

type:           web
sidecars:       
instances:      1/1
memory usage:   512M
     state     since                  cpu    memory           disk         details
#0   running   2021-10-27T22:00:44Z   4.0%   190.1M of 512M   920M of 2G   

type:           harvest-fetch
sidecars:       
instances:      1/1
memory usage:   512M
     state     since                  cpu    memory           disk           details
#0   running   2021-10-27T22:01:07Z   0.4%   101.7M of 512M   917.4M of 1G   

type:           harvest-gather
sidecars:       
instances:      1/1
memory usage:   512M
     state     since                  cpu    memory           disk           details
#0   running   2021-10-27T22:01:08Z   0.5%   100.3M of 512M   917.4M of 1G

@jbrown-xentity jbrown-xentity temporarily deployed to development October 27, 2021 21:55 Inactive
@jbrown-xentity jbrown-xentity temporarily deployed to development October 27, 2021 22:20 Inactive
Add configuration options for harvest jobs per environment
@jbrown-xentity jbrown-xentity temporarily deployed to development October 28, 2021 16:06 Inactive
@jbrown-xentity jbrown-xentity marked this pull request as ready for review October 28, 2021 18:58
@jbrown-xentity jbrown-xentity requested a review from a team October 28, 2021 18:58
@jbrown-xentity jbrown-xentity marked this pull request as draft October 29, 2021 17:31
@jbrown-xentity
Copy link
Contributor Author

jbrown-xentity commented Oct 29, 2021

Waiting on quota limits to be bumped up for more space, otherwise this is ready for merging...
Quota is bumped to 20, should be able to merge these processes all the way through prod...

Will not need to deploy app, service will be utilized
@jbrown-xentity jbrown-xentity temporarily deployed to development November 8, 2021 22:41 Inactive
@jbrown-xentity jbrown-xentity marked this pull request as ready for review November 10, 2021 20:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants