Skip to content
Permalink
Branch: master
Find file Copy path
Find file Copy path
10 contributors

Users who have contributed to this file

@Faizan2304 @mayankbansal018 @singhsarab @vagisha-nidhi @smadala @codito @harshjain2 @abhishkk @nnpcYvIVl @jayaranigarg
844 lines (579 sloc) 50.1 KB

Release Notes

16.3.0-preview-20190715-02

Issue Fixed

  • TestPlatform targeting netstandard2.0. #2076
  • Implemented the cancellation of discovery request #2076
  • Generating manifest for publishing to BAR. #2069

Drops

16.2.0

Issue Fixed

  • Updated TestPlatform.ObjectModel.nuspec. #2055
  • Fixed incorrect timeout message when test host crashes #2056
  • Incompatible framework message fix. #2044
  • Cleaned up remaining set of dependencies for source build. #2058

Drops

  • TestPlatform vsix: 16.2.0
  • Microsoft.TestPlatform.ObjectModel : 16.2.0

16.2.0-preview-20190606-02

Issue Fixed

  • Spurious vstest.console process spin up fixed. #2035
  • Test host locking pdb fixed #2029
  • Encoding change from UCS-2 to UTF-8. #2044
  • Unable to find Microsoft.VisualStudio.ArchitectureTools.PEReader fixed. #2008

Drops

16.1.1

Issue Fixed

  • Prevent unnecessary progress indicator refresh to improve test run time. #2024
  • Changes to allow clients to provide environment variable while initializing VsTestConsoleWrapper #2023
  • Fix for the trx classname being wrongly stamped when testname and fullyqualifiedname are same. #2014
  • Search datacollectors in output directory as well. #2015
  • Changes to avoid restoring of packages that are not required for the BuildFromSource scenario. #2017

Drops

  • TestPlatform vsix: 16.1.1
  • Microsoft.TestPlatform.ObjectModel : 16.1.1

16.0.2-Preview-20190502-01

Issue Fixed

  • Improve the cli experience for dotnet test. #1964
  • Improve readability of dotnet test #1960
  • Make testhost.x86 large address aware #1986
  • Vstest.console Should not message to Testhost process if it has exited #1994
  • [Revert] Fix for dotnet test on a multi-target projects logs only the last target #1996
  • [Trxlogger] Fixing the code to preserve newline for adapter logs to stdout #1999

Drops

16.0.1

Issue Fixed

  • Reverted aborting test run when source and target frameworks/architectures are incompatible. #1935

Drops

  • TestPlatform vsix: 16.0.1
  • Microsoft.TestPlatform.ObjectModel : 16.0.1

16.0.0

Issue Fixed

  • Added missing Utilities dependency to netstandard1.5 #1913
  • Add support for xplat vstest console in translationlayer #1893
  • Aborting test run when source and target frameworks/architectures are incompatible. #1789

Drops

  • TestPlatform vsix: 16.0.0
  • Microsoft.TestPlatform.ObjectModel : 16.0.0

16.0.0-preview-20190201-03

Issue Fixed

  • Running NETFramework 3.5 tests in compat mode #1906
  • Make timeouts for translation layer timeout configurable. #1909

Drops

16.0.0-preview-20190124-02

Issue Fixed

  • Downgrade Test.Sdk to net40 #1860
  • Fix xml exception when we are dealing with special chars #1872
  • Fix - dotnet test on a multi-target projects logs only the last target #1877
  • Avoid usage of JsonConvert in test host process #1881
  • Fixing logging error in event sources #1897

Drops

16.0.0-preview-20181205-02

Issue Fixed

  • Stop trying to connect if the test host exits unexpectedly #1853
  • Move warning into a target to fix msbuild error #1856
  • Adding the missing assemblyInfo files and updating the copyrights #1859

Drops

16.0.0-preview-20181128-01

Issue Fixed

  • Allow external use of the TRX Logger #1792
  • Add "!~" operator to test filter #1803
  • Simplify SDK languages support #1804
  • Make Translation Layer connection timeout configurable #1843
  • Fixed issue where proc dump was not getting terminated on no crash #1849

Drops

15.9.0

Issue Fixed

  • Unstable testId for nunit tests #1785
  • Run tests only for test projects #1745
  • Add info log if try to run tests with no IsTestProject prop #1778

Drops

  • TestPlatform vsix: 15.9.0
  • Microsoft.TestPlatform.ObjectModel : 15.9.0

15.9.0-preview-20180924-03

Issue Fixed

  • Fix Video Datacollector errors #1719
  • Show error message on Framework35 #1723
  • Suggest publish for running on an isolated machine#1726
  • Fix UWP tests app socket exception #1728
  • Run tests only for test projects in "dotnet test my.sln" scenario #1745

Drops

15.9.0-preview-20180807-05

Issue Fixed

  • Fix for VSTest to honor /nologo user input from dotnet cli #1717
  • Fixed ISettingsProvider in TestAdapter assembly #1704
  • Added .NETCoreApp,Version=v2.0 example in error message #1714
  • Print start of testhost standard error stacktrace #1708
  • Use of culture specified by user in case it differs with that of OS #1712
  • Added attributes for sequence file generated by blame #1716
  • Trx Logger class name fix for Nunit Data Driven tests #1677
  • Trx Logger Fixed to generate trx file when test run aborts #1710
  • Added trace level for diag argument #1681

New Features introduced

  • Enhancing Blame data collector options to include DumpType and AlwaysCollectDump #1682
  • Procdump arguments enhanced to handle crash scenarios #1700

Drops

15.8.0

Issue Fixed

  • Fix vstest.console.exe grabs exclusive read access to its test container #1660
  • Registring correct property attributes during deserialization #1644
  • Fixed test platform messages on cancellation request #1667
  • Fixed warning messages for scenario when no tests are found matching TestCaseFilter #1656
  • Fixed UWP VC++ unit tests not executing #1649
  • Handling null value deserialization in TestCategory #1640

New Features introduced

  • Auto-generate F# program file. #1664
  • Added support for dotnet test --collect:"Code Coverage" (windows only) #981

Drops

  • TestPlatform vsix: 15.8.0
  • Microsoft.TestPlatform.ObjectModel: 15.8.0

15.8.0-preview-20180610-02

New Features introduced

  • Collect Code coverage with dotnet core sdk on windows. #981

Drops

15.8.0-preview-20180605-02

Issue Fixed

  • Fix Exception thrown while creating framework based on default enums. #1598
  • Deprecate Testplatform\Extensions path for Adapters #1602
  • Update Test Source with Package for Inprogress Tests #1605
  • Use DateTime.UtcNow instead of DateTime.Now for consistency across test reporting data #1612
  • Fixed RecordResult to SendTestCaseEnd if not already for datacollectors to end and get attachments correctly #1615
  • Fix attachment uri in trx if same attachment filename is same #1625
  • Add support to escape/unescape testcase filter strings #1627

New Features introduced

  • Add a tool to migrate testsettings to runsettings #1600

Drops

15.8.0-preview-20180510-03

Issue Fixed

  • Extend FastFilter to support multiple properties. #1523
  • Make all communication timeouts configurable. #1538
  • Honoring cancel and abort request in test platform. #1543
  • FilterOptions serialization issue when running .NET core tests. #1551
  • Telemetry points for legacy settings. #1564
  • Flushing test results even if RecordEnd is not called. #1573
  • Searching adapters in Test Source directory in all scenarios. #1574
  • Filtering non existent adapter paths. #1578

New Features introduced

  • Introduced category attribtue for adapter to specify supported assembly type.#1528, #1529, #1537

Drops

15.7.2

Issue Fixed

  • Code coverage fix for async functions. 242314

Drops

  • TestPlatform vsix: 15.7.2
  • Microsoft.TestPlatform.ObjectModel: 15.7.2

15.7.0

Issue Fixed

  • Code coverage fix for runsettings. #1510
  • Logging fix for UWP.#1508
  • Perf improvements for LUT #1517
  • Fix for preserving CR LF line endings in TRX file. #1521
  • Fix socket exception on datacollection in parallel. #1514

New Features introduced

  • Introduced running UWP test using ".appx" file as input, for CLI.

Drops

  • TestPlatform vsix: 15.7.0
  • Microsoft.TestPlatform.ObjectModel: 15.7.0

15.7.0-preview-20180320-02

Issue Fixed

  • Fixing the tests for string comparison issue. #1462
  • Sync for binarywriter writes.#1470
  • Usability Fixes #1478
  • Fix for Design mode clients hang for errors 1451
  • Fix datacollectors temporary files cleanup 1483

Drops

15.7.0-preview-20180307-01

Issue Fixed

  • Fix CUIT tests fail to run on no VS installed machine. #1450

Drops

15.7.0-preview-20180221-13

Issue Fixed

  • Adding Category to Test Category mapping for ListFullyQualifiedTests. #1369
  • Support escaping "," in Test filter. #1374
  • Generate proper default settings for EnableCodeCoverage. #1390
  • Test run directory fix for loggers. #1399
  • Fixed the normal verbosity level to not log the full information for non-failed tests. #1396
  • Ignore case for targetframework input. #1420
  • Fixed logger to have additonal lines after std output. #1421
  • Fixed the error message. #1422
  • Fix: Logger attachments not coming in vsts test run. #1431
  • Fixed help test to mention default value of verbosity in console logger. #1433
  • Exceptions flow to Translation layer #1434

New Features introduced

  • Logger support in run settings.#1382
  • Added CUIT package in vstest xcopy package. #1394
  • Making Trx Logger Hierarchical for ordered test and data driven tests. #1330

Drops

15.6.2

Issue Fixed

  • Fix socket exception on datacollection in parallel #1505
  • Fix datacollectors temporary files cleanup #1506

Drops

  • TestPlatform vsix: 15.6.2
  • Microsoft.TestPlatform.ObjectModel: v15.6.2

15.6.1

Issue Fixed

  • Synchronize concurrent writes to communication channel #1457

Drops

  • TestPlatform vsix: 15.6.1
  • Microsoft.TestPlatform.ObjectModel: v15.6.1

15.6.0

Issue Fixed

  • Fix for Communication b/w testhost, & datacollector fails causing tests processes to hang. #1406
  • Fix for Cancellation hanging TestExplorer with the unclickable cancelling. #1398

Drops

  • TestPlatform vsix: 15.6.0
  • Microsoft.TestPlatform.ObjectModel: v15.6.0

15.6.0-preview-20180207-05

Issue Fixed

  • Enabling diagnostics for UWP causes app to hang. #1387

Drops

15.6.0-preview-20180109-01

Issue Fixed

  • Make latest ObjectModel API compatible with ObjectModel 11.0.0. #1251
  • Fix no error message in case of invalid runsettings. #1344
  • Fix CodedUI debug broken. #1352
  • Fix debug stop causing 10s or indefinite wait in test explorer. #1358
  • Fix video datacollector assemblies first changes exception while running tests . #1362
  • Fix datacollector initialization failure on slow machines. #1355
  • Fix running fakes and code coverage with embedded testsettings in runsettings. #1364

New Features introduced

  • Support reflection based discovery for UWP C++ Unit tests projects.#1336
  • Add testhost external dependencies for UWP to Microsoft.NET.Test.Sdk. #1351

Drops

15.6.0-preview-20171211-02

Issue Fixed

  • Removed warning for AnyCPU assemblies
  • Fix updating runsettings in dotnet core.
  • Fix exception in Event Log DataCollector. #1288
  • Fix support for multiple paths is TestAdapterPath Argument. #1320
  • Perf: Using Event based communication over sockets using LengthPrefix communication channel. 1294

Drops

15.5.0

Issue Fixed

  • Removed compile time dependency on castle.core.dll. #1246
  • Fix test run for x64 c++ tests. #1269
  • Localization fixes for error scenarios. #1266
  • Fix for FastFilter issue with TestCaseFilter. #1252
  • Updating codecoverage analysis dll's in external package. #1282

Drops

  • TestPlatform vsix: 15.5.0
  • Microsoft.TestPlatform.ObjectModel: 15.5.0

15.5.0-preview-20171031-01

Issue Fixed

  • Add LocalExtensionData property to TestCase Class.
  • Do not crash data collector if extension fails to initialize or set environment variables.
  • Use TPv2 as default for .NET 3.5 test projects.
  • Loading native dll's correctly for UWP release mode.
  • Insertion PR: https://github.com/Microsoft/vstest/pull/1250

Drops

15.5.0-preview-20171012-09

Issue Fixed

  • Fixed Data Collector Attachment issues for legacy TMI test execution workflow.
  • Added error message and help when vstest.console is invoked without arguments.
  • Fixed failure in loading extensions without Identifier Data.
  • Handled Test Host close.
  • TestCase Display Name is displayed instead of FullyQualifiedName.
  • Fixed issues with Static Cover Coverage, Ordered tests through TMI.

New Features introduced

  • Added Telemetry Infra for Design Mode.
  • Supported running .Net Framework v35 in compat mode.
  • Localization changes.
  • Automatically find Platform and Framework if not specified explicitly.
  • Adding object model changes and Telemetry optin status.

A list of all changes since last release are available here.

Drops

15.5.0-preview-20170923-02

Issue Fixed

  • Feature flag for executing net35 tests through TPv2 in compat mode.
  • Removed unnecessary binding redirects from app.configs. More info here
  • Put quotes around TestHost path so in case of spaces in name it starts correctly. More info here
  • Performance Automation Infra.

New Features introduced

  • Added filter support on test case discovery.
  • Added Telemetry Collection Infrastructure.
  • Added support for listing fully qualified test cases.
  • Exposed discovery events to loggers.

A list of all changes since last release are available here.

Drops

15.5.0-preview-20170914-09

Issue Fixed

New Features introduced

  • InProc execution of tests inside vstest.console process. More info here
  • Added Verbosity Level as prefix for loggers. More info here
  • Event Log Data Collector. More info here
  • Introduced /UseVsixExtensions argument in CLI.

A list of all changes since last release are available here.

Drops

15.5.0-preview-20170810-02

Issue Fixed

New Features introduced

  • Added blame data collector support in dotnet test.
  • Add ExecutionThreadApartmentState property in runsettings. More info here
  • Added async APIs support in translationLayer.

A list of all changes since last release are available here.

Drops

15.5.0-preview-20170727-01

Issue Fixed

  • Support for devices: build up the TestHostRuntime APIs
  • Console test runs will not collect File/LineNumber information
  • Several performance improvements
  • Reliability improvements to parallel runs
  • Engineering fixes to build/test

New Features introduced

  • Blame for vstest. Reports the test which crashes a run
  • Response file support for vstest
  • TestSessionTimeout cancels a test run if it exceeds a timeout
  • Mono support for vstest
  • VSTest now runs on .NET 4.5.1 runtime

A list of all changes since last release are available here.

Drops

15.3.0

Issue Fixed

  • Clean testhost before sending discoveryComplete/ExecutionCompltete.
  • Closing VS should also close vstest.console process.

A list of all changes since last release are available here.

Drops

  • TestPlatform vsix: 15.3.0
  • Microsoft.TestPlatform.ObjectModel: 15.3.0

15.3.0-preview-20170618-03

Issue Fixed

A list of all changes since last release are available here.

Drops

15.3.0-preview-20170601-03

  • Monitor data Collector Launch and Exit events, log error in case data collector crashes.
  • Fixed for issue where using environment variables in test results directory path in run settings throws error.
  • Added support to handle CollectSourceInformation flag in runsettings
  • Fixed scenario where testhost crash info is not coming to Testwindow
  • In case of parallel if test host is aborted, add a new one in place of that

Issue Fixed

A list of all changes since last release are available here.

Drops

15.3.0-preview-20170517-02

  • Fakes support.
  • Wait for testhost stderr to be available if connection is broken between vstest.console and testhost.
  • Data collector log message improvements.
  • Extracedt socket implementation to allow experimentation with multiple data interchange formats and ipc. Added concept of framing for messages passed between various processes. TestRequestSender2 uses these concepts and is a replacement for the earlier TestRequestSender.
  • Localized new added string.
  • Code cleanup

Issue Fixed

A list of all changes since last release are available here.

Drops

15.3.0-preview-20170425-07

  • Data collector support enabled
  • Test Host Extensibility enabled
  • ResultsDirectory argument and Runsettings priority order #322
  • Supporting Multiple TestProperty with the same key value #328
  • Allow VSTestConsole path to be specified #325
  • Adding /InIsolation flag for backward compatibility #414
  • Fixed reading test adapter paths from runsettings #455
  • Honor cache timeout for discovery. #470
  • Read asynchronously from test host process #529
  • Fixing nunit inconclusive tests reported as failure #533
  • BatchSize Runsettings #550
  • Make default testcase filter property name FullyQualifiedName #555
  • Logger extensibility #557
  • Update Microsoft.VisualStudio.TestTools.TestPlatform.V2.CLI.vsmanproj #581
  • Add Microsoft.NET.Test.Sdk.props to buildMultiTargeting #580
  • Moving to Netcoreapp 2.0 #603
  • Create config file for test project targeting .NET Framework #642
  • Create new RuntimeProvider to be associated with each ProxyOperationManager #653
  • Inject entry point only for project targeting netcoreapp #665
  • Dotnet test output coloring #641
  • Remove binding redirect of Newtonsoft.Json from testhost config file #663
  • Resolve testhost from source directory if we couldnt resolve it via nuget cache #690
  • Improve testplatform message #691
  • Protocol v2 improvements #672, #698
  • Use "dotnet test --verbosity" arg for console verbosity #735

A list of all changes since last release are available here.

Drops

15.0.0-preview-20170125-04

  • Localization for following nuget packages:
  1. Microsoft.TestPlatform.CLI
  2. Microsoft.TestPlatform
  3. Microsoft.TestPlatform.ObjectModel
  4. Microsoft.TestPlatform.TestHost

A list of all changes since last release are available here.

Drops

15.0.0-preview-20170123.02

  • Allow multiple test properties with same key #239, #358
  • Localization for testplatform vsix package #146
  • Working directory should be set to test source parent directory #311
  • Allow relative source paths to vstest.console #331
  • Stacktrace and error message should be in context of failed test #285

A list of all changes since last release are available here.

Drops

15.0.0-preview-20170106.08

  • First Draft for the Protocol tool. #306
  • Fixed DiaSession issue which showed async methods to be external #307
  • Localized vstest #308
  • Added OutputType to Microsoft.NET.Test.Sdk.target #310
  • Enclosed run settings arguments to handle whitespace #312
  • Converted TestPlatform.vsix from V2 to V3 format #316

A list of all changes since last release are available here.

Drops

15.0.0-preview-20161227.02

  • Add enhancement: trx logger can take logfile parameter #282.
  • Allow TranslationLayer to specify Diag parameters #296.
  • Passing runsettings as command line arguments #297.
  • Localization work #302.
  • Testhost Diag log file name format change #303.
  • Fix for issue where xlftool.exe is not able to update neutral xlf file if we update any existing resource string #305.

A list of all changes since last release are available here.

Drops

15.0.0-preview-20161216.01

  • Migrate to csproj from xproj #217.
  • Translationlayer timeout for CustomHost Launch changed to indefinate #265
  • Added net46 folder in lib of Microsoft.TestPlatform Nuget Package #247.
  • Added license link.
  • Added third party notice to nuget packages #249.
  • Change assembly signing to public #256.
  • Make testhost a project dependency instead of content #264.
  • Several changes to build infrastructure for csproj migration #262 #268.
  • Include microbuild.core as a dependency for signing #267.
  • Make External packages are restored with a separate csproj #273.
  • Add Acceptance tests for netcore1.0 target #259.
  • Add Acceptance tests for netcore1.1 target #270.
  • Added E2E test for RunTestsWithCustomTestHostLauncher.
  • Change testcase gereration id algorithm to SHA1 to be in compat with Associate-WorkItem scenarios #279.
  • Bug fix: Default logger output path should be cmd-line friendly #244.
  • Bug fix: TRX logger Started Time incorrect #253.
  • Update README.md #263.

A list of all changes since last release are available here.

Drops

15.0.0-preview-20161123.03

  • Support for debugging .net core project.
  • Support for parallel discovery and execution.
  • Support to discover and run test from a solution having .net core and desktop project.
  • Support of arguments(output, configuration, framework and noBuild) in dotnet test.
  • Support to run test from project targeting multiple TargetFrameworkMoniker using dotnet test.
  • Support for trx logger in non-windows machine.
  • Added diag argument to enable logging in vstest.console.
  • Acceptance test for test platform.
  • Bug fix: display a message on console when dotnet is not installed on the machine.
  • Bug fix: dotnet test should return a non-0 exit code when any test fails here.
  • Bug fix: dotnet test fails due to missing quotes in the path of vstest.console here.
  • Bug fix: terminate vstest.console if no testhost found here.
  • Bug fix: testCaseFilter argument doesn't filter tests in .net core here.
  • Bug fix: cannot add Microsoft.Net.Test.Sdk as a dependency of net451 projects here.

A list of all changes since last release are available here.

Drops

15.0.0-preview-20160923-03

  • New configuration DisableParallelization in runsettings. This setting may be used by adapters to disable parallel run in certain scenarios, e.g. test profiling or instrumented runs.
  • Support for non-shared test hosts. A non shared test host is exclusive per test source. E.g. .net core tests use a non-shared host.
  • New nuget package: Microsoft.TestPlaform.TestHost. All .net core test apps will refer to this package.
  • Sample performance tests for test platform
  • Bug fix: support for reg free COM in Dia
  • Bug fix: display a message in VS on test host crash
  • Bug fix: in .net core, user may provide relative path to run tests

A list of all changes since last release are available here.

Drops

15.0.0-preview-20160914-02

  • Support for .net core framework
  • New nuget package Microsoft.Testplatform.CLI for dotnet-cli
  • Performance instrumentation of runner, discovery and execution
  • Bug fix: Handle crash of test host
  • Bug fix: Handle paths and arguments on Unix
  • Bug fix: Sign core binaries

Drops

You can’t perform that action at this time.