diff options
author | Egor Chesakov <Egor.Chesakov@microsoft.com> | 2018-12-13 20:05:38 -0800 |
---|---|---|
committer | GitHub <noreply@github.com> | 2018-12-13 20:05:38 -0800 |
commit | ef7afc8e86eb1d8407a1c07ae735158efc5aca75 (patch) | |
tree | a0830eefe8e8fa72f8cd6fa4d730f43ce6b2e283 /azure-pipelines.yml | |
parent | a6403ba4d9187fc19af8e3dc64ec3e9e937d53eb (diff) | |
download | coreclr-ef7afc8e86eb1d8407a1c07ae735158efc5aca75.tar.gz coreclr-ef7afc8e86eb1d8407a1c07ae735158efc5aca75.tar.bz2 coreclr-ef7afc8e86eb1d8407a1c07ae735158efc5aca75.zip |
Running and visualizing tests in AzureDevOps (Part 1) (#21502)
* Enable Azure Pipelines reporter so the test results can be seen at one place (i.e. "Tests" tab) - TestRunNamePrefix should encode all the needed information for a test run to be identifiable.
* Scenarios property should use comma (not semi-colon) to work correctly on non-Windows.
* Specify timeout to test jobs (the numbers are taken from netci.groovy) - we would adjust them as soon as we get this running in each PR.
* Specify timeout for Helix work items (the number is taken from buildpipeline) - same as above.
* Specify helixType and helixRepo properties to the job and use _HelixType and _HelixSource variables in MSBuild project instead of defining them manually.
* Limit Pri0 Checked test jobs to running against pull requests. This also should be limited in the future to "default" build definition name - so when we have PR workload selection feature working we can distinguish between default PR validation and user triggered jobs.
* Remove "Prepare tests for helix" step - instead of archiving Core_Root and tests folders ourselves - directly specify them as correlation payload and work item payload directories and let the archiving be handled by Helix Sdk.
Diffstat (limited to 'azure-pipelines.yml')
-rw-r--r-- | azure-pipelines.yml | 28 |
1 files changed, 20 insertions, 8 deletions
diff --git a/azure-pipelines.yml b/azure-pipelines.yml index 92de971684..8957e23e6b 100644 --- a/azure-pipelines.yml +++ b/azure-pipelines.yml @@ -110,27 +110,28 @@ jobs: # Checked test builds # -# Pri0 (CI) -- ${{ if eq(variables['System.TeamProject'], 'public') }}: +# Pri0 (PullRequest) +- ${{ if and(eq(variables['System.TeamProject'], 'public'), eq(variables['Build.Reason'], 'PullRequest')) }}: - template: eng/platform-matrix.yml parameters: jobTemplate: test-job.yml buildConfig: checked jobParameters: priority: 0 + timeoutInMinutes: 120 # Pri1 (CI) -- ${{ if eq(variables['System.TeamProject'], 'public') }}: +- ${{ if and(eq(variables['System.TeamProject'], 'public'), in(variables['Build.Reason'], 'IndividualCI', 'BatchedCI')) }}: - template: eng/platform-matrix.yml parameters: jobTemplate: test-job.yml buildConfig: checked jobParameters: priority: 1 - scenarios: 'normal;jitstress2' + timeoutInMinutes: 240 # Pri1 crossgen (CI) -- ${{ if eq(variables['System.TeamProject'], 'public') }}: +- ${{ if and(eq(variables['System.TeamProject'], 'public'), in(variables['Build.Reason'], 'IndividualCI', 'BatchedCI')) }}: - template: eng/platform-matrix.yml parameters: jobTemplate: test-job.yml @@ -138,14 +139,25 @@ jobs: jobParameters: priority: 1 crossgen: true - scenarios: 'normal;jitstress2' + timeoutInMinutes: 240 + +# Pri1 (Manual) +- ${{ if and(eq(variables['System.TeamProject'], 'public'), eq(variables['Build.Reason'], 'Manual')) }}: + - template: eng/platform-matrix.yml + parameters: + jobTemplate: test-job.yml + buildConfig: checked + jobParameters: + priority: 1 + scenarios: 'normal,jitstress1,jitstress2,gcstress0x3,gcstress0xc' + timeoutInMinutes: 300 # # Release test builds (Official Build) # # Pri1 -- ${{ if ne(variables['System.TeamProject'], 'public') }}: +- ${{ if and(ne(variables['System.TeamProject'], 'public'), ne(variables['Build.Reason'], 'PullRequest')) }}: - template: eng/platform-matrix.yml parameters: jobTemplate: test-job.yml @@ -154,7 +166,7 @@ jobs: priority: 1 # Pri1 crossgen (Official Build) -- ${{ if eq(variables['System.TeamProject'], 'public') }}: +- ${{ if and(ne(variables['System.TeamProject'], 'public'), ne(variables['Build.Reason'], 'PullRequest')) }}: - template: eng/platform-matrix.yml parameters: jobTemplate: test-job.yml |