Skip to content

Enable parallel jobs in pipeline#10

Merged
uday31in merged 9 commits intoAzure:mainfrom
krowlandson:pipeline-updates
Jun 17, 2020
Merged

Enable parallel jobs in pipeline#10
uday31in merged 9 commits intoAzure:mainfrom
krowlandson:pipeline-updates

Conversation

@krowlandson
Copy link
Copy Markdown
Contributor

To reduce run time, adding ability to run parallel jobs for Pester Tests in Azure Pipelines.

Includes moving build agent configuration to PowerShell script to reduce repetition in ubuntu-latest.yml

@ljtill ljtill added the enhancement New feature or request label Jun 17, 2020
@uday31in
Copy link
Copy Markdown
Member

/azp run

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

Copy link
Copy Markdown
Member

@uday31in uday31in left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

does this file need to be in this folder?

Copy link
Copy Markdown
Contributor Author

@krowlandson krowlandson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

.azure-pipelines/Initialize-AzOpsTestEnvironment.ps1 is now moved to tests/scripts/Initialize-AzOpsTestEnvironment.ps1 and is used to reduce code duplication in .azure-pipelines/ubuntu-latest.yml (DRY principle)

@krowlandson krowlandson requested a review from uday31in June 17, 2020 19:18
@uday31in
Copy link
Copy Markdown
Member

/azp run

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

@uday31in uday31in merged commit 46fc0a7 into Azure:main Jun 17, 2020
@ljtill ljtill added this to the Release - v0.2 milestone Jul 3, 2020
@krowlandson krowlandson deleted the pipeline-updates branch July 8, 2020 06:26
ljtill added a commit that referenced this pull request Jul 16, 2020
* AzOps pipeline

[skip ci]

* Move pipeline

* Merged PR 20: Use ADO APIs

Related work items: #85, #86, #87, #88

* Merged PR 21: Revert 'Use ADO APIs'

Reverts !20

* Ado (#2)

* Reset AzOps pipeline

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update *.parameters.json location (#7)

* Update *.parameters.json location

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Enable parallel jobs in pipeline (#10)

* Update pipeline to allow parallel test runs

* Add variables for important values

* Added dependsOn for 2nd stage jobs

* Update timeoutInMinutes variable

* Remove quotes from PSVersionTable

* Move environment configuration to script

* Move Initialize-AzOpsTestEnvironment to /test/scripts/ folder

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing azops reference folder (#12)

* removing azopsreference

* changing variable name to AzOpsReferenceFolder

* changing Write-Ouput to Write-AzOpsLog

* adding AzOps Log

* Move pipeline

* Reset AzOps pipeline

* AzOps pipeline

[skip ci]

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing stong type from save-azopsmg (#13)

* Update container tag

* Moar variables

* Create ado specific comment

* Add replaceme tags

Co-authored-by: Matt White <mawhi@microsoft.com>
Co-authored-by: Matt White <Matthew.White@microsoft.com>
Co-authored-by: Lyon J Till <158992+ljtill@users.noreply.github.com>
Co-authored-by: Kevin Rowlandson <kevin.rowlandson@monoconsultancy.com>
Co-authored-by: uday31in <14359777+uday31in@users.noreply.github.com>

* AzOps pipeline

[skip ci]

* Move pipeline

* Merged PR 20: Use ADO APIs

Related work items: #85, #86, #87, #88

* Merged PR 21: Revert 'Use ADO APIs'

Reverts !20

* Ado (#2)

* Reset AzOps pipeline

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update *.parameters.json location (#7)

* Update *.parameters.json location

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Enable parallel jobs in pipeline (#10)

* Update pipeline to allow parallel test runs

* Add variables for important values

* Added dependsOn for 2nd stage jobs

* Update timeoutInMinutes variable

* Remove quotes from PSVersionTable

* Move environment configuration to script

* Move Initialize-AzOpsTestEnvironment to /test/scripts/ folder

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing azops reference folder (#12)

* removing azopsreference

* changing variable name to AzOpsReferenceFolder

* changing Write-Ouput to Write-AzOpsLog

* adding AzOps Log

* Move pipeline

* Reset AzOps pipeline

* AzOps pipeline

[skip ci]

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing stong type from save-azopsmg (#13)

* Update container tag

* Moar variables

* Create ado specific comment

* Add replaceme tags

Co-authored-by: Matt White <mawhi@microsoft.com>
Co-authored-by: Matt White <Matthew.White@microsoft.com>
Co-authored-by: Lyon J Till <158992+ljtill@users.noreply.github.com>
Co-authored-by: Kevin Rowlandson <kevin.rowlandson@monoconsultancy.com>
Co-authored-by: uday31in <14359777+uday31in@users.noreply.github.com>

* title & & body for ADO PR

* Remove INPUT prefix from SCMPLATFORM variable name

* Use  $(Build.SourceBranchName) for docker tag

* Updated AzOpsDockerBuild.yml

* Fix env var name

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Add replaceme tags

* Correct GH references

* Remove as this is now included upstream

* Remove explicit -Verbose

* Add Out-Nulls to REST requests

* Remove null redirects

Co-authored-by: Matt White <Matthew.White@microsoft.com>
Co-authored-by: Matt White <mawhi@microsoft.com>
Co-authored-by: Lyon J Till <158992+ljtill@users.noreply.github.com>
Co-authored-by: Kevin Rowlandson <kevin.rowlandson@monoconsultancy.com>
Co-authored-by: uday31in <14359777+uday31in@users.noreply.github.com>
ljtill added a commit that referenced this pull request Aug 6, 2020
* Support Azure DevOps (#19)

* AzOps pipeline

[skip ci]

* Move pipeline

* Merged PR 20: Use ADO APIs

Related work items: #85, #86, #87, #88

* Merged PR 21: Revert 'Use ADO APIs'

Reverts !20

* Ado (#2)

* Reset AzOps pipeline

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update *.parameters.json location (#7)

* Update *.parameters.json location

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Enable parallel jobs in pipeline (#10)

* Update pipeline to allow parallel test runs

* Add variables for important values

* Added dependsOn for 2nd stage jobs

* Update timeoutInMinutes variable

* Remove quotes from PSVersionTable

* Move environment configuration to script

* Move Initialize-AzOpsTestEnvironment to /test/scripts/ folder

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing azops reference folder (#12)

* removing azopsreference

* changing variable name to AzOpsReferenceFolder

* changing Write-Ouput to Write-AzOpsLog

* adding AzOps Log

* Move pipeline

* Reset AzOps pipeline

* AzOps pipeline

[skip ci]

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing stong type from save-azopsmg (#13)

* Update container tag

* Moar variables

* Create ado specific comment

* Add replaceme tags

Co-authored-by: Matt White <mawhi@microsoft.com>
Co-authored-by: Matt White <Matthew.White@microsoft.com>
Co-authored-by: Lyon J Till <158992+ljtill@users.noreply.github.com>
Co-authored-by: Kevin Rowlandson <kevin.rowlandson@monoconsultancy.com>
Co-authored-by: uday31in <14359777+uday31in@users.noreply.github.com>

* AzOps pipeline

[skip ci]

* Move pipeline

* Merged PR 20: Use ADO APIs

Related work items: #85, #86, #87, #88

* Merged PR 21: Revert 'Use ADO APIs'

Reverts !20

* Ado (#2)

* Reset AzOps pipeline

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update *.parameters.json location (#7)

* Update *.parameters.json location

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update ubuntu-latest.yml

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Enable parallel jobs in pipeline (#10)

* Update pipeline to allow parallel test runs

* Add variables for important values

* Added dependsOn for 2nd stage jobs

* Update timeoutInMinutes variable

* Remove quotes from PSVersionTable

* Move environment configuration to script

* Move Initialize-AzOpsTestEnvironment to /test/scripts/ folder

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing azops reference folder (#12)

* removing azopsreference

* changing variable name to AzOpsReferenceFolder

* changing Write-Ouput to Write-AzOpsLog

* adding AzOps Log

* Move pipeline

* Reset AzOps pipeline

* AzOps pipeline

[skip ci]

* Merged PR 18: Support for SCMPlatform

Prepares the ground for working with ADO

Related work items: #85

* Merged PR 19: AzOps-ContainerBuildAndPush

Related work items: #86

* Use ADO APIs to raise PRs/comments/labels

* remove unused var

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Devug azure creds

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Remove debugging

* debugthisshiz

* Update triggers

* debug git

* is git installed?

* moar

* Remove debugging

* Add query params for get PR

* Add verbose output

* Add token output

* Change git merge to git reset

* Add force push

* Move token output outside if block

* Attempt response.count for REST response

* Add active check for PR query

* removing stong type from save-azopsmg (#13)

* Update container tag

* Moar variables

* Create ado specific comment

* Add replaceme tags

Co-authored-by: Matt White <mawhi@microsoft.com>
Co-authored-by: Matt White <Matthew.White@microsoft.com>
Co-authored-by: Lyon J Till <158992+ljtill@users.noreply.github.com>
Co-authored-by: Kevin Rowlandson <kevin.rowlandson@monoconsultancy.com>
Co-authored-by: uday31in <14359777+uday31in@users.noreply.github.com>

* title & & body for ADO PR

* Remove INPUT prefix from SCMPLATFORM variable name

* Use  $(Build.SourceBranchName) for docker tag

* Updated AzOpsDockerBuild.yml

* Fix env var name

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Update AzOpsDockerBuild.yml for Azure Pipelines

* Add replaceme tags

* Correct GH references

* Remove as this is now included upstream

* Remove explicit -Verbose

* Add Out-Nulls to REST requests

* Remove null redirects

Co-authored-by: Matt White <Matthew.White@microsoft.com>
Co-authored-by: Matt White <mawhi@microsoft.com>
Co-authored-by: Lyon J Till <158992+ljtill@users.noreply.github.com>
Co-authored-by: Kevin Rowlandson <kevin.rowlandson@monoconsultancy.com>
Co-authored-by: uday31in <14359777+uday31in@users.noreply.github.com>

* Update public/

* Update guidance/

* Update guidance/

* Move providerfeatures.json & resourceproviders.json

* Update Dockerfile

* Update public/

* Add Azure DevOps support

* Fix export raw templates env var

* Fix auxiliary path

* Update comment formatting

* Add branch name parsing

* Add azure devops global vars

* Add azure devops support

* Update entrypoint.ps1

* Update Invoke-AzOpsGitPull.ps1

* Remove blank space

* Fix parameter name

* Update default scm logic

* Set default scm platform

* Add pull request wait

* Update Invoke-AzOpsGitPush.ps1

* Update Invoke-AzOpsGitPush.ps1

* Update Invoke-AzOpsGitPush.ps1

* Workflow test

* Revert workflow test

* Update push / pull workflow

* Update git push workflow

* Update push workflow

* Workflow test

* Add skip logic

* Fix status variable

* Revert test workflow

Co-authored-by: Matt White <matt.white@microsoft.com>
Co-authored-by: Matt White <Matthew.White@microsoft.com>
Co-authored-by: Matt White <mawhi@microsoft.com>
Co-authored-by: Kevin Rowlandson <kevin.rowlandson@monoconsultancy.com>
Co-authored-by: uday31in <14359777+uday31in@users.noreply.github.com>
@ljtill ljtill removed the enhancement New feature or request label Apr 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants