Improve CoreCLR test runner outside Windows

CoreCLR tests will need to be built on Windows and copied over to a non-Windows machine. Then, coreclr/tests/runtest.sh along
with some switches can be used to run the tests.

Changes:
- Run tests in parallel by default (use --sequential to force sequential mode)
- Update Windows test build to produce the Windows core overlay that includes test dependencies that are not built
- Add a number of switches (see coreclr/tests/runtest.sh for details) to provide locations of:
  - The Windows test build
  - The CoreCLR native test build
  - Either:
    - This:
      - The core layout (including all of the below)
    - Or:
      - The CoreCLR build
      - mscorlib.dll
      - The CoreFX build
      - The CoreFX native build
- Using information from above, build or use the core layout, and copy native test binaries to the respective test directories
- Add --testDir to specify an inclusive list of test directories to run
- Add text files to exclude tests:
  - coreclr/tests/testsUnsupportedOutsideWindows.txt - Tests that are not supported outside Windows
  - coreclr/tests/testsFailingOutsideWindows.txt - Tests that are known to fail outside Windows and are temporarily disabled while they are investigated
- Add --runFailingTestsOnly to run only the tests listed in coreclr/tests/testsFailingOutsideWindows.txt to verify known failures
- Produce xUnit-style output for the CI, output goes into <Windows test build folder>/coreclrtests.xml

1 files changed, 23 insertions, 0 deletions

diff --git a/tests/buildtest.cmd b/tests/buildtest.cmd
index a73a67fbff..4d97c798e3 100644
--- a/tests/buildtest.cmd
+++ b/tests/buildtest.cmd
@@ -166,6 +166,23 @@ set _buildprefix=
 set _buildpostfix=
 set _buildappend=
 call :build %1
+
+set CORE_ROOT=%__TestBinDir%\Tests\Core_Root
+echo.
+echo Creating test overlay...
+
+:: Log build command line
+set _buildprefix=echo
+set _buildpostfix=^> "%__TestManagedBuildLog%"
+set _buildappend=^>
+call :CreateTestOverlay %1
+
+:: Build
+set _buildprefix=
+set _buildpostfix=
+set _buildappend=
+call :CreateTestOverlay %1
+
 exit /b %ERRORLEVEL%
 
 :build
@@ -174,6 +191,12 @@ exit /b %ERRORLEVEL%
 IF ERRORLEVEL 1 echo Test build failed. Refer to !__TestManagedBuildLog! for details && exit /b 1
 exit /b 0
 
+:CreateTestOverlay
+
+%_buildprefix% %_msbuildexe% "%__ProjectFilesDir%\runtest.proj" /t:CreateTestOverlay /nologo /maxcpucount /verbosity:minimal /nodeReuse:false /fileloggerparameters:Verbosity=normal;LogFile="%__TestManagedBuildLog%";Append %* %_buildpostfix%
+IF ERRORLEVEL 1 echo Failed to create the test overlay. Refer to !__TestManagedBuildLog! for details && exit /b 1
+exit /b 0
+
 :Usage
 echo.
 echo Usage: