Skip to content
This repository has been archived by the owner on Mar 20, 2023. It is now read-only.

Add support for named placeholders in custom task #375

Open
wants to merge 27 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
2a7b89f
Fix typo in example slurm.yaml config in docs. (#334)
pansapiens Jan 6, 2020
095edd9
Fix list pool detailed error bug
alfpark Jan 6, 2020
4aa08e5
Forbid "default" for elastic slurm partition id
alfpark Jan 6, 2020
8ebf1bb
Remove Python2.7 from CI, docs and scripts
alfpark Jan 9, 2020
4e4edaf
Add CentOS 8 and Debian 10 support
alfpark Jan 17, 2020
b36fb27
Fix merge task conditional output data
alfpark Jan 17, 2020
3026083
Catch AllocationFailed errors
alfpark Feb 18, 2020
744f9f9
Update docs
alfpark Feb 18, 2020
b03966f
Fixup support for Debian 10
alfpark Feb 24, 2020
d71e3ed
Update account images command
alfpark Mar 3, 2020
bf88217
Update VM sizes
alfpark Mar 5, 2020
2291051
Fix singularity multi-instance regression
alfpark Mar 6, 2020
2cfc07d
Catch additional retry on docker image pull
alfpark Mar 6, 2020
1282779
Update CI pipelines
alfpark Apr 19, 2021
e371ac5
Fix standalone VM resources with docker-compose
alfpark Apr 21, 2021
c5439ab
Fix missing blobxfer on Windows on restart
alfpark Apr 21, 2021
a511766
Fix OpenFOAM recipe with autoscratch
alfpark Apr 21, 2021
f6a360f
Fix --recreate flag on jobs add with job schedule
alfpark Apr 21, 2021
87b22b0
Update nVidia drivers
alfpark Apr 22, 2021
3b23665
Pin blobfuse version
alfpark Apr 23, 2021
dc41a19
Update image builds
alfpark Apr 26, 2021
0468bda
Various updates
alfpark Oct 1, 2021
7b7a9a8
Ubuntu 20.04 Support
alfpark Oct 4, 2021
ab1dbe1
Support new GPU SKUs
alfpark Oct 4, 2021
ebf02c3
Update dependencies
alfpark Oct 18, 2021
0f20c7f
Add rust to AppVeyor
alfpark Oct 18, 2021
659fd59
Add support for named placeholders in custom task
May 19, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
20 changes: 0 additions & 20 deletions .travis.yml

This file was deleted.

10 changes: 10 additions & 0 deletions .vsts/pipeline-replicate-singularity.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
name: $(SourceBranch)$(Rev:.r)

jobs:
- job: ReplicateSingularityImages
pool:
vmImage: ubuntu-20.04
steps:
- template: replicate-singularity.yml
parameters:
enabled: True
189 changes: 89 additions & 100 deletions .vsts/pipeline.yml

Large diffs are not rendered by default.

38 changes: 38 additions & 0 deletions .vsts/replicate-singularity.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
parameters:
enabled: false

steps:
- script: |
set -e
set -o pipefail
docker version
docker login "$(docker.servername)" -u="$(docker.username)" -p="$(docker.password)"
export DOCKER_CLI_EXPERIMENTAL=enabled
singularity_version=$(grep -m1 _SINGULARITY_VERSION convoy/misc.py | cut -d "'" -f 2)
echo "Replicating Singularity version $singularity_version images to MCR"
chkImage=mcr.microsoft.com/azure-batch/shipyard:${singularity_version}-singularity-mnt
set +e
if docker manifest inspect "$chkImage"; then
echo "$chkImage exists, skipping replication"
else
set -e
dhImage="alfpark/singularity:${singularity_version}-mnt"
mcrImage="$(docker.servername)/public/azure-batch/shipyard:${singularity_version}-singularity-mnt"
docker pull "$dhImage"
docker tag "$dhImage" "$mcrImage"
docker push "$mcrImage"
fi
chkImage=mcr.microsoft.com/azure-batch/shipyard:${singularity_version}-singularity-mnt-resource
set +e
if docker manifest inspect "$chkImage"; then
echo "$chkImage exists, skipping replication"
else
set -e
dhImage="alfpark/singularity:${singularity_version}-mnt-resource"
mcrImage="$(docker.servername)/public/azure-batch/shipyard:${singularity_version}-singularity-mnt-resource"
docker pull "$dhImage"
docker tag "$dhImage" "$mcrImage"
docker push "$mcrImage"
fi
displayName: Replicate Singularity Container Images
condition: ${{ parameters.enabled }}
39 changes: 39 additions & 0 deletions .vsts/sign-exec.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
parameters:
enabled: false
folder: ./bin
pattern: '*.dll,*.exe'

steps:
- task: SFP.build-tasks.custom-build-task-1.EsrpCodeSigning@1
displayName: "Code Sign - Executables and Libraries"
condition: ${{ parameters.enabled }}
inputs:
ConnectedServiceName: 'ESRP CodeSign'
FolderPath: ${{ parameters.folder }}
Pattern: ${{ parameters.pattern }}
UseMinimatch: false
signConfigType: inlineSignParams
inlineOperation: |
[
{
"KeyCode" : "CP-230012",
"OperationCode" : "SigntoolSign",
"Parameters" : {
"OpusName" : "Microsoft",
"OpusInfo" : "http://www.microsoft.com",
"FileDigest" : "/fd \"SHA256\"",
"PageHash" : "/NPH",
"TimeStamp" : "/tr \"http://rfc3161.gtm.corp.microsoft.com/TSS/HttpTspServer\" /td sha256"
},
"ToolName" : "sign",
"ToolVersion" : "1.0"
},
{
"KeyCode" : "CP-230012",
"OperationCode" : "SigntoolVerify",
"Parameters" : {},
"ToolName" : "sign",
"ToolVersion" : "1.0"
}
]
SessionTimeout: 60
33 changes: 33 additions & 0 deletions .vsts/sign-nuget.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
parameters:
enabled: false
folder: ./bin
pattern: '*.nupkg'

steps:
- task: SFP.build-tasks.custom-build-task-1.EsrpCodeSigning@1
displayName: "Code Sign - Nuget Packages"
condition: ${{ parameters.enabled }}
inputs:
ConnectedServiceName: 'ESRP CodeSign'
FolderPath: ${{ parameters.folder }}
Pattern: ${{ parameters.pattern }}
UseMinimatch: false
signConfigType: inlineSignParams
inlineOperation: |
[
{
"KeyCode" : "CP-401405",
"OperationCode" : "NuGetSign",
"Parameters" : {},
"ToolName" : "sign",
"ToolVersion" : "1.0"
},
{
"KeyCode" : "CP-401405",
"OperationCode" : "NuGetVerify",
"Parameters" : {},
"ToolName" : "sign",
"ToolVersion" : "1.0"
}
]
SessionTimeout: 60
1 change: 0 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
[![Build Status](https://azurebatch.visualstudio.com/batch-shipyard/_apis/build/status/batch-shipyard-CI)](https://azurebatch.visualstudio.com/batch-shipyard/_build/latest?definitionId=11)
[![Build Status](https://travis-ci.org/Azure/batch-shipyard.svg?branch=master)](https://travis-ci.org/Azure/batch-shipyard)
[![Build status](https://ci.appveyor.com/api/projects/status/3a0j0gww57o6nkpw/branch/master?svg=true)](https://ci.appveyor.com/project/alfpark/batch-shipyard)

# Batch Shipyard
Expand Down