Difference between invoking via shellspec and directly

[zregvart]

Hi all!
I want to test the error handling of my function and I can't wrap my head around this: when I run the script a.sh directly, it immediately exits; but when I try to test for this behavior the it looks like set -e is ignored.

Here is what I have:

a.sh:

#!/bin/env bash

set -euo pipefail

a() {
  local x
  x=$(b)
  echo 'in a(), should not reach this' >&2
  echo -n "Got from b(): $x"
}

b() {
  echo 'erroring in b()' >&2
  echo "in b"
  return 1
}

# When included from shellspec we don't want to invoke a
${__SOURCED__:+return}

a

echo 'in script, should not reach this' >&2

a_spec.sh:

#!/bin/env bash

set -euo pipefail

eval "$(shellspec -)"

Include a.sh

Describe 'a'
    It 'call a'
        When call a
        The status should be failure
        The output should equal ''
        The error should equal 'erroring in b()'
    End
End

Calling directly:

$ ./a.sh 
erroring in b()
$ echo $?
1

Running the tests:

$ shellspec
F

Examples:
  1) a call a
     When call a

     1.1) The status should be failure

            expected: failure (non-zero)
                 got: success (zero) [status: 0]

          # test/a_spec.sh:12

     1.2) The output should equal 

            expected: ""
                 got: "Got from b(): in b"

          # test/a_spec.sh:13

     1.3) The error should equal erroring in b()

            expected: "erroring in b()"
                 got: "erroring in b()
            in a(), should not reach this"

          # test/a_spec.sh:14

Finished in 0.30 seconds (user 0.30 seconds, sys 0.08 seconds)
1 example, 1 failure


Failure examples / Errors: (Listed here affect your suite's status)

shellspec test/a_spec.sh:10 # 1) a call a FAILED

[pointo1d]

Hey @zregvart,

Try changing When call a to When run a - the manual tells us that run runs in a subshell and thus the output & status are captured and (hopefully) your tests pass, whereas the call command runs in the current shell and the whole shooting match blows up if the script under test exits non-zero.

[zregvart]

Thanks for the suggestion, changing call to run yields exactly the same result as with call.