Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add versioning of builds to Jenkinsfile #332

Merged
merged 134 commits into from
Sep 23, 2020

Conversation

justaddcoffee
Copy link
Collaborator

@justaddcoffee justaddcoffee commented Sep 14, 2020

To address #135 and also MS reviewers' request that we provide versioning for our builds

This PR:

  • writes out all files for a build to a timestamped directory eg. 20201231 (including
    • merged graph in TSV format
    • an RDF version of the merged graph
    • the raw/ directory with the data ingested to make build
    • the transformed/ directory containing subgraphs
    • a stats directory with statistics about the build
    • the Jenkinsfile containing that actually ran the build
  • copies this directory to a current/ directory so users can have a URL to retrieve the most current build
  • also adds index.html files to each of the directories mentioned above, to allow browsing/listing of contents for directories

@justaddcoffee justaddcoffee marked this pull request as draft September 15, 2020 18:20
@justaddcoffee
Copy link
Collaborator Author

@kltm I think one remaining item that we need here is to update the Deploy blazegraph stage to point to the blazegraph jnl file here once we have run the master pipeline to completion

@justaddcoffee justaddcoffee marked this pull request as ready for review September 23, 2020 23:20
@justaddcoffee justaddcoffee merged commit e9ff0d5 into master Sep 23, 2020
@justaddcoffee justaddcoffee deleted the add_versioning_of_builds_run_jenkins branch September 23, 2020 23:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants