summaryrefslogtreecommitdiff
path: root/Documentation/building/unix-test-instructions.md
diff options
context:
space:
mode:
authorAaron Robinson <arobins@microsoft.com>2018-07-20 15:27:28 -0700
committerGitHub <noreply@github.com>2018-07-20 15:27:28 -0700
commit2556ad964c040e6afb849f7a89da426cd7bbe9bf (patch)
treeee6c67f1d0d7de83e981e71c052bb53bed594c2e /Documentation/building/unix-test-instructions.md
parent699028a7a033991f01a72211a88a534ef1360c3a (diff)
downloadcoreclr-2556ad964c040e6afb849f7a89da426cd7bbe9bf.tar.gz
coreclr-2556ad964c040e6afb849f7a89da426cd7bbe9bf.tar.bz2
coreclr-2556ad964c040e6afb849f7a89da426cd7bbe9bf.zip
Update documentation for testing (#19063)
* Update documentation for testing
Diffstat (limited to 'Documentation/building/unix-test-instructions.md')
-rw-r--r--Documentation/building/unix-test-instructions.md71
1 files changed, 31 insertions, 40 deletions
diff --git a/Documentation/building/unix-test-instructions.md b/Documentation/building/unix-test-instructions.md
index bd15f173aa..89fead7aa6 100644
--- a/Documentation/building/unix-test-instructions.md
+++ b/Documentation/building/unix-test-instructions.md
@@ -4,11 +4,11 @@ Building and running tests on Linux, OS X, and FreeBSD
CoreCLR tests
-------------
-**Building**
+## Building
Build CoreCLR on [Unix](https://github.com/dotnet/coreclr/blob/master/Documentation/building/linux-instructions.md).
-**Building the Tests**
+## Building the Tests
DotNet is required to build the tests, this can be done on any platform then copied over if the arch or os does not support DotNet. If DotNet is not supported, [CoreFX](https://github.com/dotnet/corefx/blob/master/Documentation/building/unix-instructions.md) is also required to be built.
@@ -16,27 +16,19 @@ To build the tests on Unix:
> `./build-test.sh`
-To build on Windows:
-
-> `C:\coreclr>build-test.cmd`
-
Please note that this builds the Priority 0 tests. To build priority 1:
> `build-test.sh -priority 1`
+## Building Individual Tests
-**Building Individual Tests**
+During development there are many instances where building an individual test is fast and necessary. All of the necessary tools to build are under `coreclr/Tools`. It is possible to use `coreclr/Tools/MSBuild.dll` as you would normally use MSBuild with a few caveats.
-During development there are many instances where building an individual test is fast and necessary. All of the necessary tools to build are under coreclr/Tools. It is possible to use coreclr/Tools/MSBuild.dll as you would normally use MSBuild with a few caveats.
-
-Note that coreclr/Tools/msbuild.sh exists as well to make the call shorter.
+Note that `coreclr/Tools/msbuild.sh` exists as well to make the call shorter.
**!! Note !! -- Passing /p:__BuildOs=[OSX|Linux] is required.**
->If you omit it you will get the following error: `error MSB4801: The task factory "CodeTaskFactory" could not be loaded because this version of MSBuild does not support it.`
----
-
-**Building an Individual Test Example**
+## Building an Individual Test Example
>`coreclr/Tools/msbuild.sh /maxcpucount coreclr/tests/src/JIT/CodeGenBringUpTests/Array1.csproj /p:__BuildType=Release /p:__BuildOS=OSX`
@@ -44,8 +36,7 @@ Or
>`coreclr/Tools/dotnetcli/dotnet coreclr/Tools/MSBuild.dll /maxcpucount coreclr/tests/src/JIT/CodeGenBringUpTests/Array1.csproj /p:__BuildType=Release /p:__BuildOS=OSX`
-
-**Aarch64/armhf multiarch**
+## Aarch64/armhf multi-arch
For machines that have aarch64/armhf support, all the armhf packages will need to also be downloaded. Please note you will need to enable multiplatform support as well. Check with your distro provider or kernel options to see if this is supported. For simplicity, these instructions relate to aarch64 ubuntu enabling arm32 (hf) coreclr runs.
@@ -67,7 +58,7 @@ Linux tegra-ubuntu 4.4.38-tegra #1 SMP PREEMPT Thu Jul 20 00:41:06 PDT 2017 aarc
[ubuntu:~]: sudo apt-get install libstdc++6:armhf
````
-At this point you should be able to run a 32bit corerun. You can verify this by downloading and running a recently built arm32 coreclr.
+At this point you should be able to run a 32-bit `corerun`. You can verify this by downloading and running a recently built arm32 coreclr.
```
[ubuntu:~]: wget https://ci.dot.net/job/dotnet_coreclr/job/master/job/armlb_cross_checked_ubuntu/lastSuccessfulBuild/artifact/*zip*/archive.zip --no-check-certificate
@@ -85,7 +76,7 @@ Now download the coreclr armhf dependencies.
sudo apt-get install libunwind8:armhf libunwind8-dev:armhf libicu-dev:armhf liblttng-ust-dev:armhf libcurl4-openssl-dev:armhf libicu-dev:armhf libssl-dev libkrb5-dev:armhf
```
-**Running tests**
+## Running Tests
The following instructions assume that on the Unix machine:
- The CoreCLR repo is cloned at `/mnt/coreclr`
@@ -96,7 +87,7 @@ If DotNet is unsupported
The following steps are different if DotNet is supported or not on your arch and os.
-**DotNet is supported**
+### DotNet is supported
build-test.sh will have setup the Core_Root directory correctly after the test build. If this was either skipped or needs to be regenerated use:
@@ -104,50 +95,50 @@ build-test.sh will have setup the Core_Root directory correctly after the test b
To run the tests run with the --coreOverlayDir path
-> ```bash
-> ~/coreclr$ tests/runtest.sh
-> --testRootDir=/mnt/coreclr/bin/tests/Linux.x64.Debug
-> --testNativeBinDir=/mnt/coreclr/bin/obj/Linux.x64.Debug/tests
-> --coreOverlayDir=/mnt/coreclr/bin/tests/Linux.x64.Debug/Tests/Core_Root
-> --copyNativeTestBin
-> ```
+```bash
+~/coreclr$ tests/runtest.sh
+ --testRootDir=/mnt/coreclr/bin/tests/Linux.x64.Debug
+ --testNativeBinDir=/mnt/coreclr/bin/obj/Linux.x64.Debug/tests
+ --coreOverlayDir=/mnt/coreclr/bin/tests/Linux.x64.Debug/Tests/Core_Root
+ --copyNativeTestBin
+```
-**DotNet is not supported**
+### DotNet is not supported
Tests need to be built on another platform and copied over to the Unix machine for testing. Copy the test build over to the Unix machine:
> `cp --recursive /media/coreclr/bin/tests/Windows_NT.x64.Debug /mnt/test/`
-See runtest.sh usage information:
+See `runtest.sh` usage information:
> `/mnt/coreclr$ tests/runtest.sh --help`
Run tests (`Debug` may be replaced with `Release` or `Checked`, depending on which Configuration you've built):
-> ```bash
-> /mnt/coreclr$ tests/runtest.sh
-> --testRootDir=/mnt/test/Windows_NT.x64.Debug
-> --testNativeBinDir=/mnt/coreclr/bin/obj/Linux.x64.Debug/tests
-> --coreClrBinDir=/mnt/coreclr/bin/Product/Linux.x64.Debug
-> --mscorlibDir=/mnt/coreclr/bin/Product/Linux.x64.Debug
-> --coreFxBinDir=/mnt/corefx/bin/runtime/netcoreapp-Linux-Debug-x64
-> ```
+```bash
+/mnt/coreclr$ tests/runtest.sh
+ --testRootDir=/mnt/test/Windows_NT.x64.Debug
+ --testNativeBinDir=/mnt/coreclr/bin/obj/Linux.x64.Debug/tests
+ --coreClrBinDir=/mnt/coreclr/bin/Product/Linux.x64.Debug
+ --mscorlibDir=/mnt/coreclr/bin/Product/Linux.x64.Debug
+ --coreFxBinDir=/mnt/corefx/bin/runtime/netcoreapp-Linux-Debug-x64
+```
The method above will copy dependencies from the set of directories provided to create an 'overlay' directory.
-**Results**
+### Results
Test results will go into:
> `~/test/Windows_NT.x64.Debug/coreclrtests.xml`
-**Unsupported and temporarily disabled tests**
+### Unsupported and temporarily disabled tests
These tests are skipped by default:
- Tests that are not supported outside Windows, are listed in:
->> `~/coreclr/tests/testsUnsupportedOutsideWindows.txt`
+ > `~/coreclr/tests/testsUnsupportedOutsideWindows.txt`
- Tests that are temporarily disabled outside Windows due to unexpected failures (pending investigation), are listed in:
->> `~/coreclr/tests/testsFailingOutsideWindows.txt`
+ > `~/coreclr/tests/testsFailingOutsideWindows.txt`
To run only the set of temporarily disabled tests, pass in the `--runFailingTestsOnly` argument to `runtest.sh`.