Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix: General handling of special characters in scenario outline inputs, and XUnit failed, if multiple TestResults.xml were used #336

Merged
merged 13 commits into from
May 9, 2016

Conversation

magicmonty
Copy link

If I used multiple SpecFlow projects with XUnit2, then there was a NullReferenceException for the Features of the other Dlls, which lead to an abort of the test generation. Also if an example contained a "*" as input, the generation of the Regex failed

@dirkrombauts
Copy link
Member

Thank you for your contribution! It is thanks to people like you that I can keep Pickles up to date and relevant.

I try to follow a strict test-first policy, so I would like to have all code changes accompanied by unit tests. The Contributing.md file explains how to add unit tests for the code about the test result providers.

With regard to your change to the xUnitExampleSignatureBuilder: I think you are working from an old codebase. A couple of days ago I merged a pull request that deals with special characters. Could you verify that you are using the latest code? (I con't verify right know because I'm on a mac without Visual Studio :-( )

Thank you again for your efforts. If you need more information to continue, please let me know!

@magicmonty
Copy link
Author

Sorry for the missing tests (my bad, will fix that). I will check the version too.

@dirkrombauts
Copy link
Member

Thanks!

@magicmonty
Copy link
Author

magicmonty commented May 6, 2016

Added at least the unit tests for the Regular expression in examples case. I currently don't know how to test the other issue.

Not ready yet, so I changed the title to WIP: ...

@magicmonty magicmonty changed the title Fix: XUnit failed, if multiple TestResults.xml were used WIP: Fix: XUnit failed, if multiple TestResults.xml were used May 6, 2016
@magicmonty
Copy link
Author

Now all other test frameworks are tested also for this issue (except for SpecRun and VSTest, where I cannot derive the name from the example value)

@dirkrombauts
Copy link
Member

hi, there's something weird going on. The CI build passes, but when I download your changes to my computer it does not compile. The WhenParsing*REsultsFileWithIndividualResults.cs files all reference a method in the base class (as it should be) but the base class (StandardTestSuiteForScenarioOutlines) does not have that method.

Could you please double-check on your side?

@dirkrombauts
Copy link
Member

As for testing the NullReference bit when combining multiple specflow projects: I just noticed that there's no tests for that in the test result providers where I fixed that problem in the past. So you don't need to look for a way to test that now. Let's focus on getting the regex stuff tested.

@magicmonty
Copy link
Author

You are right. It seems, I have forgotten to commit and push this one. Will do it on Monday morning, as I'm on the road today

@dirkrombauts
Copy link
Member

Thanks. Still, funny that the CI build passes ...

@magicmonty
Copy link
Author

Found the reason, why the CI build succeeds: The UnitTests for the TestFrameworks were never build nor executed. Added a commit to prove this behaviour

@magicmonty
Copy link
Author

magicmonty commented May 8, 2016

Unfortunately the AppVeyor Build does not break, when the Build of the Test-Project fails. I could not find the .appveyor.yml to fix this.

UPDATE:
see https://ci.appveyor.com/project/dirkrombauts/pickles-715/build/1.0.411#L1237

@magicmonty
Copy link
Author

Added the missing method, but made it fail, to check, if the CI build breaks now...

@magicmonty
Copy link
Author

The tests seems not to be run at CI build (should break with the last commit):

https://ci.appveyor.com/project/dirkrombauts/pickles-715/build/1.0.412

Anyway, this is not the scope of this PR

@magicmonty
Copy link
Author

The last push fixes the (supposedly) breaking build

@dirkrombauts dirkrombauts merged commit 68af1eb into picklesdoc:develop May 9, 2016
@dirkrombauts
Copy link
Member

Thanks again for your contribution, and also a lot of thanks for your diagnostic work. I need to fix the build process!
Dankeschön!

PS: I will release a new version of Pickles tomorrow!

@magicmonty
Copy link
Author

Nice, and Gern geschehen. Keep up the good work.

@dirkrombauts dirkrombauts changed the title WIP: Fix: XUnit failed, if multiple TestResults.xml were used Fix: General handling of special characters in scenario outline inputs, and XUnit failed, if multiple TestResults.xml were used May 10, 2016
@dirkrombauts
Copy link
Member

Released in version 2.6.1.

@magicmonty
Copy link
Author

Thanks, already in production ;)

@magicmonty magicmonty deleted the XUnitFix branch May 10, 2016 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants