Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

option to "keep going" when entry connection fails #1734

Closed
khimaros opened this issue Jul 6, 2023 · 5 comments
Closed

option to "keep going" when entry connection fails #1734

khimaros opened this issue Jul 6, 2023 · 5 comments

Comments

@khimaros
Copy link

khimaros commented Jul 6, 2023

Problem to solve

i'd like to test a number of endpoints from a single hurl file and continue testing other entries when one or more of them have a connection timeout.

Proposal

add a --keep-going flag to the command line or a configuration option which can be specified on a per-entry basis. i see benefits to either, with the former being less work when there are many entries which should run through to the end regardless, and with the latter being a bit more flexible.

Additional context and resources

when a single endpoint times out, i'd still like to see the success report eg. 7/8 entries passed

@khimaros khimaros added the enhancement New feature or request label Jul 6, 2023
@jcamiel
Copy link
Collaborator

jcamiel commented Jul 6, 2023

Hi, we have --fail-at-end option that continue the execution of an Hurl file when there are asserts errors. I don't know what we do in case of timeout but it's worth trying.

@khimaros
Copy link
Author

khimaros commented Jul 6, 2023

@jcamiel that did the trick, thanks!

i interpreted that option to mean "always fail at the end, even if all tests pass" :)

perhaps the flag description in --help could be improved?

@jcamiel
Copy link
Collaborator

jcamiel commented Jul 6, 2023

Agreed, I had to double checked myself

@jcamiel jcamiel closed this as completed Jul 7, 2023
@fabricereix
Copy link
Collaborator

we could maybe have --ignore-assert-error

@jcamiel
Copy link
Collaborator

jcamiel commented Jul 7, 2023

=> agreed on continue-on-error (like GitHub Action), we deprecate --fail-at-end => #1739

@fabricereix fabricereix added help wanted Extra attention is needed and removed enhancement New feature or request labels Sep 21, 2023
@jcamiel jcamiel removed the help wanted Extra attention is needed label Sep 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants