Can you guess? Another bugfix release!
- minitest won't crash if SimpleCov isn't loaded - aka don't execute SimpleCov code in the minitest plugin if SimpleCov isn't loaded. Thanks to @edariedl for the report of the peculiar problem in #877.
Another small bugfix release
- SimpleCov will run again correctly when used with rspec-rails. The excellent bug report #873 by @odlp perfectly details what went wrong. Thanks to @adam12 for the fix #874.
Small bugfix release. It's especially recommended to upgrade simplecov-html as well because of bugs in the 0.12.0 release.
- Fix a regression related to file encodings as special characters were missing. Furthermore we now respect the magic
# encoding: ...comment and read files in the right encoding. Thanks (@Tietew) - see #866
Minitest.after_runhook to trigger post-run hooks if
Minitestis present. See #756 and #855 thanks (@adam12)
Small release just to allow you to use the new simplecov-html.
- Relax simplecov-html requirement so that you're able to use 0.12.0
Small Bugfix release.
- Just putting
# :nocov:on top of a file or having an uneven number of them in general works again and acts as if ignoring until the end of the file. See #846 and thanks @DannyBen for the report.
Huge release! Highlights are support for branch coverage (Ruby 2.5+) and dropping support for EOL'ed Ruby versions (< 2.4). Please also read the other beta patch notes.
You can run with branch coverage by putting
enable_coverage :branch into your SimpleCov configuration (like the
SimpleCov.start do .. end block)
- You can now define the minimum expected coverage by criterion like
minimum_coverage line: 90, branch: 80
- Memoized some internal data structures that didn't change to reduce SimpleCov overhead
SourceFilenow have a
coveragemethod that returns a hash that points from a coverage criterion to a
CoverageStatisticsobject for uniform access to overall coverage statistics for both line and branch coverage
- we were losing precision by rounding the covered strength early, that has been removed. For Formatters this also means that you may need to round it yourself now.
- Removed an inconsistency in how we treat skipped vs. irrelevant lines (see #565) - SimpleCov's definition of 100% is now "You covered everything that you could" so if coverage is 0/0 that's counted as a 100% no matter if the lines were irrelevant or ignored/skipped
FileListstopped inheriting from Array, it includes Enumerable so if you didn't use Array specific methods on it in formatters you should be fine
- We needed to change an internal file format, which we use for merging across processes, to accommodate branch coverage. Sadly CodeClimate chose to use this file to report test coverage. Until a resolution is found the code climate test reporter won't work with SimpleCov for 0.18+, see this issue on the test reporter.
- Instead of ignoring old
.resultset.jsons that are inside the merge timeout, adapt and respect them
- Remove the constant warning printing if you still have a
.resultset.jsonin pre 0.18 layout that is within your merge timeout
- only turn on the requested coverage criteria (when activating branch coverage before SimpleCov would also instruct Ruby to take Method coverage)
- Change how branch coverage is displayed, now it's
branch_type: hit_countwhich should be more self explanatory. See #830 for an example and feel free to give feedback!
- Allow early running exit tasks and avoid the
at_exithook through the
SimpleCov.run_exit_tasks!method. (thanks @macumber)
- Allow manual collation of result sets through the
SimpleCov.collateentrypoint. See the README for more details (thanks @ticky)
case, even if there is no
elsebranch declared show missing coverage for it (aka no branch of it). See #825
- Stop symbolizing all keys when loading cache (should lead to be faster and consume less memory)
- Cache whether we can use/are using branch coverage (should be slightly faster)
- Fix a crash that happened when an old version of our internal cache file
.resultset.jsonwas still present
This is a huge release highlighted by changing our support for ruby versions to 2.4+ (so things that aren't EOL'ed) and finally adding branch coverage support!
This release is still beta because we'd love for you to test out branch coverage and get your feedback before doing a full release.
- Dropped support for all EOL'ed rubies meaning we only support 2.4+. Simplecov can no longer be installed on older rubies, but older simplecov releases should still work. (thanks @deivid-rodriguez)
- Dropped the
rake simplecovtask that "magically" integreated with rails. It was always undocumented, caused some issues and had some issues. Use the integration as described in the README please :)
- Branch coverage is here! Please try it out and test it! You can activate it with
enable_coverage :branch. See the README for more details. This is thanks to a bunch of people most notably @som4ik, @tycooon, @stepozer, @klyonrad and your humble maintainers also contributed ;)
- If the minimum coverage is set to be greater than 100, a warning will be shown. See #737 (thanks @belfazt)
- Add a configuration option to disable the printing of non-successful exit statuses. See #747 (thanks @JacobEvelyn)
- Calculating 100% coverage is now stricter, so 100% means 100%. See #680 thanks @gleseur
- Add new instance of
MiniTestconstant (with the capital T) will be removed in the next major release of Minitest. See #757 (thanks @adam12)
Bugfix release for problems with ParallelTests.
Maintenance release with nice convenience features and important bugfixes. Notably this will be the last release to support ruby versions that have reached their end of life. Moving forward official CRuby support will be 2.4+ and JRuby support will be 9.2+. Older versions might still work but no guarantees.
- Per default filter hidden files and folders. See #721 (thanks Renuo AG)
- Print the exit status explicitly when it's not a successful build so it's easier figure out SimpleCov failed the build in the output. See #688 (thanks @daemonsy)
- Avoid a premature failure exit code when setting
minimum_coveragein combination with using parallel_tests. See #706 (thanks @f1sherman)
- Project roots with special characters no longer cause crashes. See #717 (thanks @deivid-rodriguez)
- Avoid continously overriding test results with manual
ResultMergere.store_resultsusage. See #674 (thanks @tomeon)
- Include the LICENSE in the distributed gem again (accidentally removed in 0.16.0). (thanks @tas50)
- Relax version constraint on
docile, per SemVer
- exception that occurred on exit is available as
exit_exception! See #639 (thanks @thomas07vt)
- Performance: processing results now runs from 2.5x to 3.75x faster. See #662 (thanks @BMorearty & @eregon)
- Decrease gem size by only shipping lib and docs
- (breaking) Stop handling string filters as regular expressions, use the dedicated regex filter if you need that behaviour. See #616 (thanks @yujinakayama)
- Avoid overwriting the last coverage results on unsuccessful test runs. See #625 (thanks @thomas07vt)
- Don't crash on invalid UTF-8 byte sequences. (thanks @BMorearty)
- Filter directories outside SimpleCov.root that have it as a prefix. See #617 (thanks @jenseng)
- Fix standard rails profile rails filter (didn't work). See #618 (thanks @jenseng again!)
- Ability to use regex filters for removing files from the output. See #589 (thanks @jsteel)
- Fix merging race condition when running tests in parallel and merging them. See #570 (thanks @jenseng)
- Fix relevant lines for unloaded files - comments, skipped code etc. are correctly classified as irrelevant. See #605 (thanks @odlp)
- Allow using simplecov with frozen-string-literals enabled. See #590 (thanks @pat)
- Make sure Array Filter can use all other filter types. See #589 (thanks @jsteel)
- Make sure file names use
Simplecov.rootas base avoiding using full absolute project paths. See #589 (thanks @jsteel)
- Files that were skipped as a whole/had no relevant coverage could lead to Float errors. See #564 (thanks to @stevehanson for the report in #563)
- Officially support JRuby 9.1+ going forward (should also work with previous releases). See #547 (ping @PragTob when encountering issues)
- Add Channel group to Rails profile, when
ActionCableis loaded. See #492 (thanks @BenMorganIO)
extending instances of
Hashduring merging results avoiding problems frozen results while manually merging results. See #558 (thanks @aroben)
- Fix parallel_tests when a thread ends up running no tests. See #533 (thanks @cshaffer)
- Skip the
:nocov:comments along with the code that they skip. See #551 (thanks @ebiven)
- Fix crash when Home environment variable is unset. See #482 (thanks @waldyr)
- Make track_files work again when explicitly setting it to nil. See #463 (thanks @craiglittle)
- Do not overwrite .last_run.json file when refuse_coverage_drop option is enabled and the coverage has dropped (lead to you being able to just rerun tests and everything was fine). See #553 (thanks @Miloshes)
- Faster run times when a very large number of files is loaded into SimpleCov. See #520 (thanks @alyssais)
- Only read in source code files that are actually used (faster when files are ignored etc.). See #540 (thanks @yui-knk)
- Fix merging of resultsets if a file is missing on one side. See #513 (thanks @hanazuki)
- Fix Ruby 2.4 deprecation warnings by using Integer instead of Fixnum. See #523 (thanks @nobu)
- Force Ruby 2 to json 2. See dc7417d50 (thanks @amatsuda)
- Various other gem dependency fixes for different gems on different ruby versions. (thanks @amatsuda)
- Add support for JSON versions 2.x
- Fix coverage rate of the parallel_tests. See #441 (thanks @sinsoku)
- Fix a regression on old rubies that failed to work with the recently introduced frozen VERSION string. See #461 (thanks @leafle)
- Do not globally pollute Array and Hash with
merge_resultsetutility methods. See #449 (thanks @amatsuda)
- Do not
coverage_pathon every access of the method (See #453 (thanks @paddor)
- Fixes a Ruby warning related to the
track_filesconfiguration. See #447 (thanks @craiglittle)
- Add a group for background jobs to default Rails profile. See #442 (thanks @stve)
- Fix root_filter evaluates SimpleCov.root before initialization. See #437 (thanks @tmtm)
- Fixed regression in
MultiFormatter.with multiple arguments. See #431 (thanks @dillondrobena)
SimpleCov.minimum_coverage_by_filefor per-file coverage thresholds. See #392 (thanks @ptashman)
track_filesconfiguration option to specify a glob to always include in coverage results, whether or not those files are required. By default, this is enabled in the Rails profile for common Rails directories. See #422 (thanks @hugopeixoto)
- Speed up
root_filterby an order of magnitude. See #396 (thanks @raszi)
- Fix warning about global variable
$ERROR_INFO. See #400 (thanks @amatsuda)
- Actually recurse upward looking for
.simplecov, as claimed by the documentation, rather than only the working directory. See #423 (thanks @alexdowad)
- Add writeup about using with Spring to README. See #341 (thanks @swrobel and @onebree)
- Add support to pass in an Array when creating filter groups (original PR #104)
/vendor/bundleby default. See #331 (thanks @andyw8)
- Add some helpful singleton methods to the version string.
- Allow array to be passed in a filter. See 375 (thanks @JanStevens)
- Enforce consistent code formatting with RuboCop.
- Fix order dependencies in unit tests. See #376 (thanks @hugopeixoto)
- Only run the at_exit behaviors if the current PID matches the PID that called SimpleCov.start. See #377 (thanks @coderanger)
This is a minor bugfix release for simplecov-html, released as
0.9.0. Due to the tight version constraint in the gemspec
a new release of simplecov had to be shipped to allow using simplecov-html
- The browser back / forward button should now work again. See #36 and #35. Thanks @whatasunnyday and @justinsteele for submitting PRs to fix this.
- Fix "warning: possibly useless use of a variable in void context" See #31. Thanks @cbandy
- Always use binary file format. See #32. Thanks @andy128k
- Avoid slow file output with JRuby/Windows. See #16. Thanks @pschambacher
Other than the release includes a bunch of mostly documentation improvements:
- Update Rails path for Rails 4+. See #336. Thanks @yazinsai
- Encourage use of .simplecov to avoid lost files. See #338. thanks @dankohn
- Specified in the gemspec that simplecov needs ruby 1.8.7. See #343. thanks @iainbeeston
- Fix mispointed link in CHANGELOG.md. See #353. Thanks @dleve123
- Improve command name docs. See #356. Thanks @gtd
- In 0.9.0, we introduced a regression that made SimpleCov no-op mode fail on Ruby 1.8, while dropping 1.8 support altogether is announced only for v1.0. This has been fixed. See #333 (thanks (@sferik)
- New interface to specify multiple formatters. See #317 (thanks @sferik)
- Document in the README how to exclude code from coverage reports, and that the feature shouldn't be abused for skipping untested private code. See #304
- Clarify Ruby version support. See #279 (thanks @deivid-rodriguez)
- Ensure calculations return Floats, not Fixnum or Rational. Fixes segfaults with mathn. See #245 (thanks to @bf4)
Kernel.exitinstead of exit to avoid uncaught throw :IRB_EXIT when exiting irb sessions. See #287 (thanks @wless1) See #285
- Does not look for .simplecov in ~/ when $HOME is not set. See #311 (thanks @lasseebert)
- Exit with code only if it's Numeric > 0. See #302 (thanks @hajder)
- Make default filter case insensitive. See #280 (thanks @ryanatball)
- Improve regexp that matches functional tests. See #276 (thanks @sferik)
- Fix TravisCI #272 #278, #302
- Fix global config load. See #311 (thanks @lasseebert)
- Replaced the locking behaviour via lockfile gem with plain Ruby explicit file locking when merging results. This should make simplecov merging to behave well on Windows again. See #258 and #223 (thanks to @tomykaira)
- Fixed a regression introduced in 0.8.0 - the Forwardable STDLIB module is now required explicitly. See #256 (thanks to @kylev)
Note: Yanked the same day because of the regression that 0.8.1 fixes, see above
It's been way too long since the last official release 0.7.1, but this was partly due to it proving itself quite stable in most circumstances. This release brings various further stability improvements to result set merging (especially when working with parallel_tests), the configuration, source file encodings, and command name guessing.
The 0.8 line is the last one to cooperate with Ruby < 1.9. Starting with 0.9, SimpleCov will assume to be running in Ruby 1.9+, and will not try to detect or bail silently on older Ruby versions. An appropriate deprecation warning has been added.
- Configuration blocks now have access to variables and methods outside of the block's scope. See #238 (thanks to @ms-tg)
- You can now have a global
~/.simplecovconfiguration file. See #195 (thanks to @spagalloco)
- simplecov-html now uses the MIT-licensed colorbox plugin. Some adjustments when viewing source files, including retaining the currently open file on refresh have been added. See simplecov-html #15 (thanks to @chetan)
- Adds support for Rails 4 command guessing, removes default group
vendor/plugins. See #181 and #203 (thanks to @semanticart and @phallstrom)
- You can now load simplecov without the default settings by doing
require 'simplecov/no_defaults'or setting
simplecov/defaultsto see what preconfigurations are getting dropped by using this. See #209 (thanks to @ileitch)
- The result set merging now uses the
lockfilegem to avoid race conditions. See #185 (thanks to @jshraibman-mdsol).
- Automatically detect the usage of parallel_tests and adjust the command name with the test env number accordingly, See #64 and #185 (thanks to @jshraibman-mdsol).
- Rename adapters to "profiles" given that they are bundles of settings. The old adapter methods are deprecated, but remain available for now. See #207 (thanks to @mikerobe)
- Tweaks to the automatic test suite naming. In particular,
rspec/featuresshould now be correctly attributed to RSpec, not Cucumber. See #212 (thanks to @ersatzryan and @betelgeuse)
- MiniTest should now be identified correctly by the command name guesser. See #244 (thanks to @envygeeks)
- Makes SimpleCov resilient to inclusion of mathn library. See #175 and #140 (thanks to @scotje)
- Allow coverage_dir to be an absolute path.
- See #190 (thanks to @jshraibman-mdsol)
- The internal cucumber test suite now uses Capybara 2. See #206 (thanks to @infertux)
- Work-arounds for the Coverage library shipped in JRuby 1.6 to behave in line with MRI. See #174 (thanks to @grddev)
- Fix warning: instance variable @exit_status not initialized. See #242 and #213 (thanks to @sferik and @infertux)
- Correct result calculations for people using :nocov: tags. See #215 (thanks to @aokolish)
- Average hits per line for groups of files is now computed correctly. See #192 and #179 (thanks to @graysonwright)
- Compatibility with BINARY internal encoding. See #194 and #127 (thanks to @justfalter)
- Special characters in
SimpleCov.rootare now correctly escaped before being used as a RegExp. See #204 and #237 (thanks to @rli9)
- [BUGFIX] The gem packages of 0.7.0 (both simplecov and simplecov-html) pushed to Rubygems had some file permission issues, leading to problems when installing SimpleCov in a root/system Rubygems install and then trying to use it as a normal user (see https://github.com/colszowka/simplecov/issues/171, thanks @envygeeks for bringing it up). The gem build process has been changed to always enforce proper permissions before packaging to avoid this issue in the future.
- [FEATURE] The new
minimum_coveragenow allow you to fail your build when the coverage dropped by more than what you allowed or is below a minimum value required. Also,
refuse_coverage_dropdisallows any coverage drops between test runs. See https://github.com/colszowka/simplecov/pull/151, https://github.com/colszowka/simplecov/issues/11, https://github.com/colszowka/simplecov/issues/90, and https://github.com/colszowka/simplecov/issues/96 (thanks to @infertux)
- [FEATURE] SimpleCov now ships with a built-in MultiFormatter which allows the easy usage of multiple result formatters at the same time without the need to write custom wrapper code. See https://github.com/colszowka/simplecov/pull/158 (thanks to @nikitug)
- [BUGFIX] The usage of digits, hyphens and underscores in group names could lead to broken tab navigation in the default simplecov-html reports. See https://github.com/colszowka/simplecov-html/pull/14 (thanks to @ebelgarts)
- [REFACTORING] A few more ruby warnings removed. See https://github.com/colszowka/simplecov/issues/106 and https://github.com/colszowka/simplecov/pull/139. (thanks to @lukejahnke)
- A Pledgie button for those that feel generous :)
- The usual bunch of README fixes and documentation tweaks. Thanks to everyone who contributed those!
- [BUGFIX] Encoding issues with ISO-8859-encoded source files fixed. See https://github.com/colszowka/simplecov/pull/117. (thanks to @Deradon)
- [BUGFIX] Ensure ZeroDivisionErrors won't occur when calculating the coverage result, which previously could happen in certain cases. See https://github.com/colszowka/simplecov/pull/128. (thanks to @japgolly)
- [REFACTORING] Changed a couple instance variable lookups so SimpleCov does not cause a lot of warnings when running ruby at a higher warning level. See https://github.com/colszowka/simplecov/issues/106 and https://github.com/colszowka/simplecov/pull/119. (thanks to @mvz and @gioele)
- [BUGFIX] Modified the API-changes for newer multi_json versions introduced with #122 and v0.6.2 so they are backwards-compatible with older multi_json gems in order to avoid simplecov polluting the multi_json minimum version requirement for entire applications. See https://github.com/colszowka/simplecov/issues/132
- Added appraisal gem to the test setup in order to run the test suite against both 1.0 and 1.3 multi_json gems and ensure the above actually works :)
- [Updated to latest version of MultiJSON and its new API (thanks to @sferik and @ronen). See https://github.com/colszowka/simplecov/pull/122
- [BUGFIX] Don't force-load Railtie on Rails < 3. Fixes regression introduced with #83. See https://github.com/colszowka/simplecov/issues/113
- [FEATURE] Auto-magic
rake simplecovtask for rails (see https://github.com/colszowka/simplecov/pull/83, thanks @sunaku)
- [BUGFIX] Treat source files as UTF-8 to avoid encoding errors (see https://github.com/colszowka/simplecov/pull/103, thanks @joeyates)
- [BUGFIX] Store the invoking terminal command right after loading so they are safe from other libraries tampering with ARGV. Among other makes automatic Rails test suite splitting (Unit/Functional/Integration) work with recent rake versions again (see https://github.com/colszowka/simplecov/issues/110)
- [FEATURE] If guessing command name from the terminal command fails, try guessing from defined constants (see https://github.com/colszowka/simplecov/commit/37afca54ef503c33d888e910f950b3b943cb9a6c)
- Some refactorings and cleanups as usual. Please refer to the github compare view for a full list of changes: https://github.com/colszowka/simplecov/compare/v0.5.4...v0.6.0
- Do not give exit code 0 when there are exceptions prior to tests (see https://github.com/colszowka/simplecov/issues/41, thanks @nbogie)
- The API for building custom filter classes is now more obvious, using #matches? instead of #passes? too. (see https://github.com/colszowka/simplecov/issues/85, thanks @robinroestenburg)
- Mailers are now part of the Rails adapter as their own group (see https://github.com/colszowka/simplecov/issues/79, thanks @geetarista)
- Removed fix for JRuby 1.6 RC1 float bug because it's been fixed (see https://github.com/colszowka/simplecov/issues/86)
- Readme formatted in Markdown :)
Fix for encoding issues that came from the nocov processing mechanism (see https://github.com/colszowka/simplecov/issues/71)
:nocov: lines are now actually being reflected in the HTML report and are marked in yellow.
The Favicon in the HTML report is now determined by the overall coverage and will have the color that the coverage percentage gets as a css class to immediately indicate coverage status on first sight.
Introduced SimpleCov::SourceFile::Line#status method that returns the coverage status as a string for this line - made SimpleCov::HTML use that.
Refactored nocov processing and made it configurable using SimpleCov.ncov_token (or it's alias SimpleCov.skip_token)
- Another fix for a bug in JSON processing introduced with MultiJSON in 0.5.1 (see https://github.com/colszowka/simplecov/pull/75, thanks @sferik)
Note: Yanked 2011-09-12 because the MultiJSON-patch had a crucial bug
Fix for invalid gemspec dependency string (see https://github.com/colszowka/simplecov/pull/70, http://blog.rubygems.org/2011/08/31/shaving-the-yaml-yacc.html, thanks @jspradlin)
Added JSON in the form of the multi_json gem as dependency for those cases when built-in JSON is unavailable (see https://github.com/colszowka/simplecov/issues/72 and https://github.com/colszowka/simplecov/pull/74, thanks @sferik)
Note: Yanked 2011-09-09 because of trouble with the gemspec.
JSON is now used instead of YAML for resultset caching (used for merging). Should resolve a lot of problems people used to have because of YAML parser errors.
There's a new adapter 'test_frameworks'. Use it outside of Rails to remove
autotest/dirs from your coverage reports, either directly with
SimpleCov.start 'test_frameworks'or with
SimpleCov configuration can now be placed centrally in a text file
.simplecov, which will be automatically read on
require 'simplecov'. This makes using custom configuration like groups and filters across your test suites much easier as you only have to specify your config once. Just put the whole
SimpleCov.start (...)code into
Lines can now be skipped by using the :nocov: flag in comments that wrap the code that should be skipped, like in this example (thanks @phillipkoebbe)
#:nocov: def skipped @foo * 2 end #:nocov:
Moved file set coverage analytics from simplecov-html to SimpleCov::FileList, a new subclass of Array that is always returned for SourceFile lists (i.e. in groups) and can now be used in all formatters without the need to roll your own.
The exceptions you used to get after removing some code and re-running your tests because SimpleCov couldn't find the cached source lines should be resolved (thanks @goneflyin)
Coverage strength metric: Average hits/line per source file and result group (thanks @trans)
Finally, SimpleCov has an extensive Cucumber test suite
Full compatibility with Ruby 1.9.3.preview1
- The display of source files has been improved a lot. Weird scrolling trouble, out-of-scope line hit counts and such should be a thing of the past. Also, it is prettier now.
- Source files are now syntax highlighted
- File paths no longer have that annoying './' in front of them