summaryrefslogtreecommitdiff
path: root/netci.groovy
AgeCommit message (Collapse)AuthorFilesLines
2019-03-14Archive crossgen comparison job results even if job failsBruce Forstall1-2/+2
2019-03-11Always archive corefx testresults.xml filesBruce Forstall1-7/+6
These were only being archived for successful runs, which is when they are the least interesting. Archive them for all test runs.
2019-03-06Use Microsoft Container Registry for docker images (#23061)Sven Boemer1-2/+2
* Use Microsoft Container Registry for docker images https://github.com/dotnet/dotnet-buildtools-prereqs-docker has been updated to publish docker images to the Microsoft Container Registry. * Also update netci.groovy
2019-02-28Remove sdmaclea from active arm64 users (#22924)Steve MacLean1-1/+0
2019-02-22Adding a missing single-quote (#22809)Tanner Gooding1-1/+1
2019-02-19Adding tannergooding to the arm64Users list. (#22665)Tanner Gooding1-1/+2
2019-02-15Disable arm64 contracts. (#22605)Sergey Andreenko1-15/+0
* Fix ifdef for `g_DbgSuppressAllocationAsserts`. It needs to be defined under `FEATURE_INTEROP_DEBUGGING`. * Unify contracts disabling for UNIX/ARM. It also disables some parts that were disabled for ARM, but not for UNIX. It fixes the difference that we see between ARM32 and ARM64 Unix Checked. * Disable contracts on arm64. FIxes the difference that we see between windows arm32 and arm64 in checked/debug builds. * Revert CoreFX arm64 timeout change. That is no longer necessary. * Reenable arm64 corefx jobs. They should not fail with timeouts anymore. * Don't allow `g_DbgSuppressAllocationAsserts` defnition in release builds. * delete AssertAllocationAllowed
2019-02-08Revert "Revert "Re-point Jenkins to new Ubuntu ARM64 queue""Russ Keldorph1-2/+2
This reverts commit d617f96303c4b65b7b77ff5fa0d7aee38ebc19f8.
2019-02-05Merge pull request #22432 from BruceForstall/DisableWindowsArm64CorefxCronJobsBruce Forstall1-0/+9
Disable Windows arm64 corefx cron jobs
2019-02-05Merge pull request #22425 from BruceForstall/UploadMsbuildLogsBruce Forstall1-4/+4
Configure MSBuild debug path and save any logs
2019-02-05Disable Windows arm64 corefx cron jobsBruce Forstall1-0/+9
These currently all fail with timeout. They also take way too much time to run. We have good Linux/arm64 corefx test coverage already. The issue of these runs being slow is tracked by https://github.com/dotnet/coreclr/issues/21236.
2019-02-05Use Jenkins for Linux/arm32 testing (#22429)Egor Chesakov1-4/+13
2019-02-04Configure MSBuild debug path and save any logsBruce Forstall1-4/+4
We have had many problems in the CI with MSBuild failing, and not capturing the failure logs. See https://github.com/dotnet/coreclr/issues/20236. So, for all msbuild invocations, set MSBUILDDEBUGPATH to a new, distinguished, subdirectory of the bin\Logs directory, named "MsbuildDebugLogs". Change the CI to upload any log files found there.
2019-02-04Always archive build logsBruce Forstall1-2/+11
Even if the build fails. Add archiving in more cases where it was missing.
2019-02-01Revert "Re-point Jenkins to new Ubuntu ARM64 queue"Russ Keldorph1-2/+2
This reverts commit 193d5da27fecb7bf95e7342f1c4b9e2b63ce5313.
2019-01-31Increase arm64 timeout. (#22298)Sergey Andreenko1-0/+6
* increase arm64 debug/checked timeout. * Increase timeout only for corefx jobs.
2019-01-31Re-point Jenkins to new Ubuntu ARM64 queueRuss Keldorph1-2/+2
Move Jenkins off the Ubuntu.1604.Arm64.Open queue so it can be repurposed for Azure DevOps. This "Iron" queue should only be used by Jenkins.
2019-01-23Use Windows.10.Arm64.Open with Jenkins ONLY (#22144)Egor Chesakov1-0/+1
2019-01-18Run Azure DevOps builds against pull requests in coreclr/master (#22051)Egor Chesakov1-19/+5
And disable Windows_NT and Ubuntu arm32 and arm64 default triggers in Jenkins CI
2019-01-14Remove tizen jobs as valid pr jobs (#21982)Jarret Shook1-5/+0
2019-01-10Remove altjit jobs in CIBruce Forstall1-87/+4
We have full native jobs for arm32 and arm64 for all scenarios, which is a superset of everything we've run using altjit. So the altjit jobs are no longer necessary. In addition, the altjit jobs, especially the corefx jobs, have never run cleanly, for reasons that have never been investigated or understood. Since we have full native corefx runs, there is no reason to look into the altjit failures.
2019-01-08Update test reports archivingBruce Forstall1-2/+9
Two things: 1. Turn "echo" back on after runtests.cmd, so we see in the log file the testReports.zip compression. 2. Change the archiving of testReports.zip to not occur even if the test run fails (this is actually the most interesting case), and don't fail if there is nothing to archive.
2019-01-07Collect Windows test run logs into testReports.zip file (#21813)Bruce Forstall1-8/+26
* Collect Windows test run logs into testReports.zip file And upload these to Jenkins, so we can see how the tests ran. * Archive test Reports even if the test run fails * Need to use "call" when invoking runtest.cmd batch file
2018-12-03Remove Hostx86/arm CrossGen from building and Simplify build.sh command line ↵Egor Chesakov1-6/+1
arguments for Linux/arm cross build (Part 2) (#21034) * Stop building and publishing Hostx86/arm crossgen on Linux/arm * Remove -crosscomponent argument and stop using CAC_ROOTFS_DIR environment variable in build.sh * Simplify the related logic in build.sh * Don't need to specify crosscomponent in tests/scripts/run-pmi-diffs.py * Don't set CAC_ROOTFS_DIR in buildpipeline, Jenkins files and in tests/scripts/run-pmi-diffs.py * Adjust documentation
2018-11-15Stop using Hostx86/arm crossgen in crossgen_comparison scenario (#21021)Egor Chesakov1-31/+16
* And also create Linux arm64 crossgen_comparison scenarios in netci.groovy
2018-11-15Combine ExcludeList in AltJit scenarios for both host and altjit archs (#21018)Egor Chesakov1-0/+4
* Add -altjitarch command line argument in tests/runtest.cmd and -altjit_arch in tests/runtest.py * Specify altjitarch in for x86_arm_altjit and x64_arm64_altjit jobs in netci.groovy * Use AltJitArch MSBuild variable in tests/issues.targets to exclude tests based on either BuildArch or AltJitArch since both two JITs are running in altjit scenarios
2018-11-12Simplify build.sh command line arguments for Linux/arm cross build (Part 1) ↵Egor Chesakov1-1/+1
(#20836) * Don't use crosscomponent|-crosscomponent command line args in build.sh * Don't use CROSSCOMPONENT environment variable in build.sh src/pal/tools/gen-buildsys-clang.sh * Remove mentioning -crosscomponent from usage() in build-test.sh * Don't use -crosscomponent in buildpipeline * Don't use -crosscomponent in Groovy files * Remove mentioning crosscomponent in Documentation/building/linux-instructions.md * Stop building Hostx86/armel crossgen in build.sh * Disable CrossGen-ing of System.Private.CoreLib on Linux/armel
2018-11-08Fix more CoreFx 'artifacts' pathsBruce Forstall1-5/+5
2018-11-08Adjust for corefx output directory changeBruce Forstall1-11/+11
The "bin" directory is now under the "artifacts" directory.
2018-11-06Merge pull request #20834 from BruceForstall/FixArmElJobBruce Forstall1-4/+4
Fix corefx folder for Tizen job
2018-11-06Fix corefx folder for Tizen jobBruce Forstall1-4/+4
https://ci.dot.net/job/dotnet_coreclr/job/master/job/armel_cross_checked_tizen_innerloop_prtest/
2018-11-02Need to archive and transfer the Product directory for Linux arm/arm64 PMI diffsBruce Forstall1-1/+7
2018-11-01Fix PMI job triggers for x64 LinuxBruce Forstall1-5/+10
Also, convert asm from ZIP to tar on non-Windows.
2018-11-01Update PMI asm diffs in the CI (#20743)Bruce Forstall1-10/+11
* Respond to PMI asm diffs code review feedback Add some try/finally code to improve robustness. Remove direct invocation of run.cmd. Also, simplify the generated asm directory hierarchy. * Improve PMI script error code Only return non-zero if there is a fatal error. For non-fatal error, such as the existence of asm diffs, return zero. This will allow subsequent "build" steps in netci.groovy to run, namely, the archiving of the asm directory. Later, determine a better way figure out how to deal with the existence of asm diffs. * Update dotnet SDK download links
2018-10-30Disable non-PR triggers in dev/unix_test_workflow branchBruce Forstall1-1/+8
2018-10-16Use build-test.sh script on Linux (#20430)Egor Chesakov1-152/+36
* Use build-test.sh script on Linux (#20333) * Use *.tgz archive format and tar tool on Unix (#20381) * Fix paths to "..\Common\common.csproj" in ilproj (#20407)
2018-10-11Initial work to enable ASM diff generation in CI (#20366)Bruce Forstall1-26/+143
A set of CI jobs is defined to generate assembly diffs: ``` Windows_NT x64 Checked pmi_asm_diffs Windows_NT x86 Checked pmi_asm_diffs Ubuntu arm Cross Checked pmi_asm_diffs Ubuntu16.04 arm64 Cross Checked pmi_asm_diffs Windows_NT x64_arm64_altjit Checked pmi_asm_diffs Windows_NT x86_arm_altjit Checked pmi_asm_diffs ``` Most of the work is in the run-pmi-diffs.py script. This script: 1. Expects a "diff" build to exist. 2. Clones the baseline branch and builds it. 3. Downloads the dotnet CLI and unpacks it. 4. Clones the jitutils tree and builds it. 5. Generates asm with both the "baseline" and "diff" compilers, currently just on System.Private.CoreLib.dll, but that can be easily expanded (and perhaps we could create new jobs that do different sets of diffs, such as frameworks or benchmarks or all tests) 6. Runs jit-analyze. The Linux arm/arm64 jobs do cross-compilation, so much zip and copy the build artifacts to a test machine to run. This has been tested in the dev/unix_test_workflow branch, e.g. #20357 There is still some work to do: 1. Properly figure out the correct baseline commit. 2. Make the Linux arm/arm64 runs work (there are still some problems). 3. Do a better job surfacing the results, e.g., post back to the GitHub PR comments with the jit-analyze results. 4. Enable Linux x64 asm diffs jobs 5. Respond to code review feedback, e.g. (a) make various Python script improvements to handle failure modes, (b) do better temp directory creation, (c) use Tools\dotnetcli and init-tools instead of downloading/unpacking/installing a "live" dotnet CLI, (d) don't invoke run.cmd directly. Maybe use "build-test skipmanaged skipnative" instead?
2018-10-09Move ARM64 Windows boxen to be Helix-provisioned (#20204)Matt Galbraith1-1/+1
2018-10-09Use runtest.cmd for arm(64) windows testing (#20301)Jarret Shook1-142/+97
* Use runtest.cmd for arm(64) windows testing * Correct archival * Address pr feedback * Correct containsKey to containsValue * Change to just use contains
2018-10-02Change the innerloop arm64 Linux jobs to be default triggeredBruce Forstall1-29/+0
The two innerloop jobs had been push triggered, to see how the jobs behave in the system. They have been pretty stable, so change to make them default triggered.
2018-09-28Specify configuration to runtest.sh to make runtest.py use the correct ↵Egor Chesakov1-1/+2
build_type value (#20188)
2018-09-27Enable Ubuntu arm Cross Release crossgen_comparison scenario by default (#20160)Egor Chesakov1-1/+1
2018-09-26Enable Ubuntu arm crossgen_comparison Checked in each PR (#20139)Egor Chesakov1-1/+10
* Run Ubuntu arm crossgen_comparison (Checked | Release) daily * Enable Ubuntu arm Checked crossgen_comparison by default
2018-09-22Improve Linux arm32/arm64 corefx test runs.Bruce Forstall1-4/+2
Add proper parallelism. Prevent per-test output during parallel runs from interleaving by saving output per process and displaying it after the process has completed. Improve summary test/failure output at end of log. Change Linux arm32/arm64 corefx jobs to run tests in parallel. Change Linux/arm64 corefx scheduled jobs to be daily, not weekly, since they are very fast when run in parallel (<20 minutes).
2018-09-22Move run-tests.sh from corefxBruce Forstall1-4/+1
This is the script used by Jenkins to run arm32/arm64 corefx testing in the coreclr repo. Leave the original one around, in case anyone uses it. Name it run-corefx-tests.sh, to more closely model what we have for Windows arm/arm64 corefx testing.
2018-09-20Fix arm/arm64 Jenkins viewsBruce Forstall1-8/+22
Filter out the non-flow jobs, especially the corefx builds that are consumed by corefx flow jobs.
2018-09-20Merge pull request #20069 from dotnet/dev/unix_test_workflowBruce Forstall1-10/+13
Refine Linux arm64 "limited hardware" designation
2018-09-20Exclude Windows from arm64 daily corefx job schedulingBruce Forstall1-1/+1
2018-09-19Refine Linux arm64 "limited hardware" designationBruce Forstall1-10/+13
Add Linux arm64 to the limited hardware category, meaning non-PR jobs only run in the master branch. However, allow non-corefx JIT stress jobs to be scheduled daily, as they are fast. If corefx jobs are changes to run in parallel (and thus are faster), they can also possibly be made to run daily.
2018-09-19Fix arm64 Linux innerloop triggered jobsBruce Forstall1-1/+10
Only trigger flow job, not build job.