Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
13 changed files
with
154 additions
and
26 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,62 @@ | ||
import common_job_properties | ||
|
||
// Defines a job. | ||
job('beam_PreCommit_Website_Stage') { | ||
description('Stages the pull requests proposed for the Apache Beam ' + | ||
'website to a temporary location to ease reviews.') | ||
|
||
// Set common parameters. | ||
common_job_properties.setTopLevelWebsiteJobProperties(delegate) | ||
|
||
// Set pull request build trigger. | ||
common_job_properties.setPreCommit( | ||
delegate, | ||
'Jenkins: automatic staging of pull requests', | ||
'\nJenkins built the site at commit id ${ghprbActualCommit} with ' + | ||
'Jekyll and staged it [here](http://apache-beam-website-pull-' + | ||
'requests.storage.googleapis.com/${ghprbPullId}/index.html). ' + | ||
'Happy reviewing.\n\nNote that any previous site has been deleted. ' + | ||
'This staged site will be automatically deleted after its TTL ' + | ||
'expires. Push any commit to the pull request branch or re-trigger ' + | ||
'the build to get it staged again.') | ||
|
||
steps { | ||
// Run the following shell script as a build step. | ||
shell ''' | ||
# Install RVM. | ||
gpg --keyserver hkp://keys.gnupg.net --recv-keys \\ | ||
409B6B1796C275462A1703113804BB82D39DC0E3 | ||
\\curl -sSL https://get.rvm.io | bash | ||
source /home/jenkins/.rvm/scripts/rvm | ||
# Install Ruby. | ||
RUBY_VERSION_NUM=2.3.0 | ||
rvm install ruby $RUBY_VERSION_NUM --autolibs=read-only | ||
# Install Bundler gem | ||
PATH=~/.gem/ruby/$RUBY_VERSION_NUM/bin:$PATH | ||
GEM_PATH=~/.gem/ruby/$RUBY_VERSION_NUM/:$GEM_PATH | ||
gem install bundler --user-install | ||
# Install all needed gems. | ||
bundle install --path ~/.gem/ | ||
# Remove current site if it exists. | ||
GCS_PATH="gs://apache-beam-website-pull-requests/${ghprbPullId}/" | ||
gsutil -m rm -r -f ${GCS_PATH} || true | ||
# Build the new site with the baseurl specified. | ||
rm -fr ./content/ | ||
bundle exec jekyll build --baseurl=/${ghprbPullId} | ||
# Install BeautifulSoup HTML Parser for python. | ||
pip install --user beautifulsoup4 | ||
# Fix links on staged website. | ||
python .jenkins/append_index_html_to_internal_links.py | ||
# Upload the new site. | ||
gsutil -m cp -R ./content/* ${GCS_PATH} | ||
'''.stripIndent().trim() | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,47 @@ | ||
import common_job_properties | ||
|
||
// Defines a job. | ||
job('beam_PreCommit_Website_Test') { | ||
description('Runs tests on the pull requests proposed for the Apache Beam ' + | ||
'website.') | ||
|
||
// Set common parameters. | ||
common_job_properties.setTopLevelWebsiteJobProperties(delegate) | ||
|
||
// Execute concurrent builds. Multiple builds of this project may be executed | ||
// in parallel. This is safe because this build does not require exclusive | ||
// access to any shared resources. | ||
concurrentBuild() | ||
|
||
// Set pull request build trigger. | ||
common_job_properties.setPreCommit( | ||
delegate, | ||
'Jenkins: test website (dead links, etc.)') | ||
|
||
steps { | ||
// Run the following shell script as a build step. | ||
shell ''' | ||
# Install RVM. | ||
gpg --keyserver hkp://keys.gnupg.net --recv-keys \\ | ||
409B6B1796C275462A1703113804BB82D39DC0E3 | ||
\\curl -sSL https://get.rvm.io | bash | ||
source /home/jenkins/.rvm/scripts/rvm | ||
# Install Ruby. | ||
RUBY_VERSION_NUM=2.3.0 | ||
rvm install ruby $RUBY_VERSION_NUM --autolibs=read-only | ||
# Install Bundler gem | ||
PATH=~/.gem/ruby/$RUBY_VERSION_NUM/bin:$PATH | ||
GEM_PATH=~/.gem/ruby/$RUBY_VERSION_NUM/:$GEM_PATH | ||
gem install bundler --user-install | ||
# Install all needed gems. | ||
bundle install --path ~/.gem/ | ||
# Build the new site and test it. | ||
rm -fr ./content/ | ||
bundle exec rake test | ||
'''.stripIndent().trim() | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters