feat(baseline): Allow force creating fresh baseline by richardwerkman · Pull Request #2124 · stryker-mutator/stryker-net

richardwerkman · 2022-08-05T16:05:15Z

resolves #1560
resolves #2823
resolves #2847

Add command for baseline
Add sub command for baseline recreate
Remove the --target option and replace with an extra argument for baseline command

The new commands now work as follows:
dotnet stryker with-baseline main
dotnet stryker with-baseline main recreate
or
dotnet stryker baseline main
dotnet stryker baseline main recreate

…/stryker-net into baseline-command

…references - Full baseline is never generated because since filter marks mutations as ignored due to not being unchanged compared to target #1803 - stryker-mutator/stryker-net#1803 (comment) - feat(baseline): Allow force creating fresh baseline #2124 - stryker-mutator/stryker-net#2124

… into baseline-command

* chore(deps): update dependency buildalyzer to v5.0.1 (#2665) * chore(deps): update dependency buildalyzer to v5.0.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: fix page links for site * fix: Don't fail the test run if restoring test assemblies fails (#2664) * chore(deps): update xunit-dotnet monorepo to v2.5.1 (#2673) * chore(deps): update xunit-dotnet monorepo to v2.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.4.0 (#2677) * chore(deps): update dependency yamldotnet to v13.4.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: F# range math (#2679) * F# range math * Windows x Linux * Up * chore: Passing Stryker options to F# project components (#2680) Co-authored-by: Rouke Broersma <mobrockers@gmail.com> * fix: Use solution file when it's available (#2690) * Use solution file when it's available * fix unit test * sonarqube * chore(compilation): Improve Error and Trace Logging (#2688) Add logs Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: Remove usings from MutantControl (#2694) chore: remove usings from MutantControl Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Code quality improvements (#2696) * Use string builder in loop * Use find & handle other platform newlines * Use find * Fix duplicate message * Add more range tests * Improve range code * docs: add SAS configuration (#2676) (#2701) docs: add SAS configuration * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 (#2702) * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.0 (#2703) * chore(deps): update dependency yamldotnet to v13.5.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.1 (#2704) * chore(deps): update dependency yamldotnet to v13.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.7.0 (#2705) * chore(deps): update dependency yamldotnet to v13.7.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update xunit-dotnet monorepo (#2711) * chore(deps): update xunit-dotnet monorepo * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: Breaking down FilePattern (#2681) * Simplifying DiffIgnoreChangesInput * Update FilePattern.cs * Up * up * Rename the class * up --------- Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Splitting some C# related extensions in a separate file (#2697) Splitting some C# related extensions in a separate file Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: tests for `OpenReportEnabledInput` help text * fix: typo in re(c)reate * add: tests for baseline target input. change: target input default to 'master' to stay consistent with since target input. --------- Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> Co-authored-by: Rouke Broersma <mobrockers@gmail.com> Co-authored-by: Pent Ploompuu <kaalikas@gmail.com> Co-authored-by: Petr <psfinaki@users.noreply.github.com> Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> Co-authored-by: Jack Steel <jacksteel@jacksteel.co.uk> Co-authored-by: Cyrille DUPUYDAUBY <dupdob@gmail.com> Co-authored-by: Max S <max.schwerdtner@gmail.com>

* chore(deps): update dependency buildalyzer to v5.0.1 (#2665) * chore(deps): update dependency buildalyzer to v5.0.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: fix page links for site * fix: Don't fail the test run if restoring test assemblies fails (#2664) * chore(deps): update xunit-dotnet monorepo to v2.5.1 (#2673) * chore(deps): update xunit-dotnet monorepo to v2.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.4.0 (#2677) * chore(deps): update dependency yamldotnet to v13.4.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: F# range math (#2679) * F# range math * Windows x Linux * Up * chore: Passing Stryker options to F# project components (#2680) Co-authored-by: Rouke Broersma <mobrockers@gmail.com> * fix: Use solution file when it's available (#2690) * Use solution file when it's available * fix unit test * sonarqube * chore(compilation): Improve Error and Trace Logging (#2688) Add logs Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: Remove usings from MutantControl (#2694) chore: remove usings from MutantControl Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Code quality improvements (#2696) * Use string builder in loop * Use find & handle other platform newlines * Use find * Fix duplicate message * Add more range tests * Improve range code * docs: add SAS configuration (#2676) (#2701) docs: add SAS configuration * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 (#2702) * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.0 (#2703) * chore(deps): update dependency yamldotnet to v13.5.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.1 (#2704) * chore(deps): update dependency yamldotnet to v13.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.7.0 (#2705) * chore(deps): update dependency yamldotnet to v13.7.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update xunit-dotnet monorepo (#2711) * chore(deps): update xunit-dotnet monorepo * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: Breaking down FilePattern (#2681) * Simplifying DiffIgnoreChangesInput * Update FilePattern.cs * Up * up * Rename the class * up --------- Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Splitting some C# related extensions in a separate file (#2697) Splitting some C# related extensions in a separate file Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: tests for `OpenReportEnabledInput` help text * fix: typo in re(c)reate * add: tests for baseline target input. change: target input default to 'master' to stay consistent with since target input. * fix: cli info text test * also check if WithBaselineInput is true --------- Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> Co-authored-by: Rouke Broersma <mobrockers@gmail.com> Co-authored-by: Pent Ploompuu <kaalikas@gmail.com> Co-authored-by: Petr <psfinaki@users.noreply.github.com> Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> Co-authored-by: Jack Steel <jacksteel@jacksteel.co.uk> Co-authored-by: Cyrille DUPUYDAUBY <dupdob@gmail.com> Co-authored-by: Max S <max.schwerdtner@gmail.com>

…/stryker-net into baseline-command

sonarqubecloud · 2023-10-13T15:18:59Z

Kudos, SonarCloud Quality Gate passed!

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

93.3% Coverage
0.0% Duplication

* fix: tests for `OpenReportEnabledInput` help text * fix: typo in re(c)reate * add: tests for baseline target input. change: target input default to 'master' to stay consistent with since target input. * fix: cli info text test * also check if WithBaselineInput is true * re-add all options to baseline and recreate commands

src/Stryker.Core/Stryker.Core/Mutators/NullCoalescingExpressionMutator.cs

docs/configuration.md

rouke-broersma · 2024-02-16T11:30:01Z

src/Stryker.Core/Stryker.Core/Options/StrykerOptions.cs

+        /// <summary>
+        /// When true, a new baseline should be created.
+        /// </summary>
+        public bool BaselineRecreateEnabled { get; init; }


Suggested change

public bool BaselineRecreateEnabled { get; init; }

public bool RecreateBaseline { get; init; }

…/stryker-net into baseline-command

sonarqubecloud · 2024-03-15T10:15:03Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
95.4% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

rouke-broersma · 2024-03-15T10:55:20Z

docs/configuration.md


-### `baseline` &lt;`command`&gt;
+### `with-baseline` &lt;`committish`&gt;



Why does not still need to be a committish? We are trying to move away from git for baseline.

rouke-broersma · 2024-03-15T10:55:37Z

docs/configuration.md


-If you wish to test only changed sources and tests but would like to have a complete mutation report see [with-baseline](#with-baseline-flag-committish).
+If you wish to test only changed sources and tests but would like to have a complete mutation report see [with-baseline](#with-baseline-committish).



Suggested change

### `with-baseline` <`committish`>

### `baseline` <`target-version`>

rouke-broersma · 2024-03-15T10:57:28Z

docs/configuration.md

+*\* The baseline and since features are mutually exclusive. This feature implicitly enables the [since](#since-flag-committish) feature for now.*

 ### `baseline.fallback-version` &lt;`string`&gt;



Suggested change

When [with-baseline](#with-baseline-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.

When [baseline](#baseline-target-version) is enabled and Stryker cannot find an existing report for the current version the fallback version is used. When Stryker is still unable to find a baseline with either the current version or the fallback version a complete testrun is performed. The complete testrun will then be saved as the new baseline for the next mutation testrun.

rouke-broersma · 2024-03-15T10:59:31Z

docs/configuration.md


 ## Baseline



Suggested change

Default: `false`

Command line: `with-baseline feat-2`

Config file: `"baseline": { }`

Default: `false`

Command: `baseline feat-2`

Command Alias: `with-baseline feat-2`

Config file: `"baseline": { }`

rouke-broersma · 2024-03-15T11:02:35Z

src/Stryker.CLI/Stryker.CLI/CommandLineConfig/CommandLineConfigReader.cs

                RegisterCliInputs(baselineCmd);

+                var committishArg = baselineCmd.Argument("committish", "The committish to compare with the current HEAD. This can be a branch, tag or commit id.");
+                committishArg.IsRequired(true);


Are we not using a default target version anymore?

sonarqubecloud · 2024-06-21T08:56:19Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
95.4% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

StevenAngel-ai · 2025-04-30T13:08:47Z

Is there any update on this PR? These issues are still outstanding it seems and it would be nice to be able to use the baseline feature

Richard Werkman and others added 2 commits August 5, 2022 17:07

init

853cbd9

Merge branch 'master' into baseline-command

dc5686f

richardwerkman closed this Aug 5, 2022

richardwerkman reopened this Aug 5, 2022

richardwerkman marked this pull request as draft August 5, 2022 16:07

Richard Werkman added 2 commits August 5, 2022 18:11

Fix unit tests

e986e68

Merge branch 'baseline-command' of https://github.com/stryker-mutator…

89b9cb6

…/stryker-net into baseline-command

rouke-broersma changed the title ~~feat(Create baseline): Add baseline create command~~ feat(baseline): Allow force creating fresh baseline Aug 5, 2022

Richard Werkman and others added 11 commits May 26, 2023 14:41

Merge branch 'master' of https://github.com/stryker-mutator/stryker-net…

5c7705d

… into baseline-command

Baseline recreate added

68d4e39

merge main

67db04d

fix merge

4871f39

try to enable baseline by command

36a4ce9

Fixed command

e180534

Fix mutation level

f1f6cf3

merged master

7dd8a89

Remove using

e44bb01

merged master

9ebf7f7

Update docs + try to add target option to command

e1b4d14

rouke-broersma mentioned this pull request Oct 13, 2023

dotnet stryker since command #2554

Open

danihengeveld and others added 5 commits October 13, 2023 15:12

fix using

60d6d41

Merge branch 'master' into baseline-command

02193a7

Merge branch 'baseline-command' of https://github.com/stryker-mutator…

938920d

…/stryker-net into baseline-command

danihengeveld mentioned this pull request Oct 14, 2023

Validate since and with-baseline mutually exclusive #2721

Closed

danihengeveld and others added 2 commits October 14, 2023 14:49

merged master

4d5303b

rouke-broersma reviewed Feb 16, 2024

View reviewed changes

src/Stryker.Core/Stryker.Core/Mutators/NullCoalescingExpressionMutator.cs Outdated Show resolved Hide resolved

Richard Werkman added 5 commits February 16, 2024 09:46

Merged master

4f6c3cc

Fix commands

a02f5c9

Reset mutation level

548d06b

Update docs

ef6392f

Remove "with-baseline.enabled"

552c9a3

rouke-broersma reviewed Feb 16, 2024

View reviewed changes

docs/configuration.md Outdated Show resolved Hide resolved

rouke-broersma reviewed Feb 16, 2024

View reviewed changes

Richard Werkman and others added 11 commits February 16, 2024 14:09

Update docs and add help text for commands

0d62dda

Update pipeline docs

e51eebd

merged master

937f26f

.

d0fa85a

Fix tests

d7ac653

Merge branch 'master' into baseline-command

079311a

Fix sonar

e87f5bb

Merge branch 'baseline-command' of https://github.com/stryker-mutator…

4c21604

…/stryker-net into baseline-command

merged master

1202182

Fix docs

0380d09

Fix unit tests

0ba1d08

richardwerkman marked this pull request as ready for review March 15, 2024 10:25

rouke-broersma reviewed Mar 15, 2024

View reviewed changes

merged

0dc89f4

Remove double logging and refactor

20cab04

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(baseline): Allow force creating fresh baseline#2124

feat(baseline): Allow force creating fresh baseline#2124
richardwerkman wants to merge 43 commits intomasterfrom
baseline-command

richardwerkman commented Aug 5, 2022 •

edited by rouke-broersma

Loading

Uh oh!

sonarqubecloud bot commented Oct 13, 2023

Uh oh!

Uh oh!

Uh oh!

rouke-broersma Feb 16, 2024

Uh oh!

sonarqubecloud bot commented Mar 15, 2024

Uh oh!

rouke-broersma Mar 15, 2024

Uh oh!

rouke-broersma Mar 15, 2024 •

edited

Loading

Uh oh!

rouke-broersma Mar 15, 2024 •

edited

Loading

Uh oh!

rouke-broersma Mar 15, 2024 •

edited

Loading

Uh oh!

rouke-broersma Mar 15, 2024 •

edited

Loading

Uh oh!

sonarqubecloud bot commented Jun 21, 2024

Uh oh!

StevenAngel-ai commented Apr 30, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

	public bool BaselineRecreateEnabled { get; init; }
	public bool RecreateBaseline { get; init; }


		### `baseline` <`command`>
		### `with-baseline` <`committish`>


		If you wish to test only changed sources and tests but would like to have a complete mutation report see [with-baseline](#with-baseline-flag-committish).
		If you wish to test only changed sources and tests but would like to have a complete mutation report see [with-baseline](#with-baseline-committish).

	### `with-baseline` <`committish`>
	### `baseline` <`target-version`>

		\ The baseline and since features are mutually exclusive. This feature implicitly enables the [since](#since-flag-committish) feature for now.*

		### `baseline.fallback-version` <`string`>

	When [with-baseline](#with-baseline-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.
	When [baseline](#baseline-target-version) is enabled and Stryker cannot find an existing report for the current version the fallback version is used. When Stryker is still unable to find a baseline with either the current version or the fallback version a complete testrun is performed. The complete testrun will then be saved as the new baseline for the next mutation testrun.

-Default: `false`
-Command line: `with-baseline feat-2`
-Config file: `"baseline": { }`
+Default: `false`
+Command: `baseline feat-2`
+Command Alias: `with-baseline feat-2`
+Config file: `"baseline": { }`

Conversation

richardwerkman commented Aug 5, 2022 • edited by rouke-broersma Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sonarqubecloud bot commented Oct 13, 2023

Uh oh!

Uh oh!

Uh oh!

rouke-broersma Feb 16, 2024

Choose a reason for hiding this comment

Uh oh!

sonarqubecloud bot commented Mar 15, 2024

Quality Gate passed

Uh oh!

rouke-broersma Mar 15, 2024

Choose a reason for hiding this comment

Uh oh!

rouke-broersma Mar 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rouke-broersma Mar 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rouke-broersma Mar 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rouke-broersma Mar 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

sonarqubecloud bot commented Jun 21, 2024

Quality Gate passed

Uh oh!

StevenAngel-ai commented Apr 30, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

richardwerkman commented Aug 5, 2022 •

edited by rouke-broersma

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading