pubsub.SubscriberIT: testSubscriber failed

[flaky-bot]

Note: #260 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.

---

commit: b2b2f86
buildURL: Build Status, Sponge
status: failed

Test output

expected to contain:
    Hello 0
but was:
    [ack_id: "TgQhIT4wPkVTRFAGFixdRkhRNxkIaFEOT14jPzUgKEUSC1MTUVx2G0gQaTNcdQdRDRh1eWMjbFpGUFFCWX9VWwk8aH58dANXDhlwfGdwbl4VBQpAU1b409nBn6CgRx1tNdLI06tASszv-YJ0Zhg9XBJLLD5-NTlFQV5AEkw-DERJUytDCypYEQ"
    message {
      data: "Hello 1"
      attributes {
        key: "author"
        value: "unknown"
      }
      attributes {
        key: "year"
        value: "2020"
      }
      message_id: "1463021654464850"
      publish_time {
        seconds: 1598522745
        nanos: 128000000
      }
    }
    , ack_id: "TgQhIT4wPkVTRFAGFixdRkhRNxkIaFEOT14jPzUgKEUSC1MTUVx2G0gQaTNcdQdRDRh1eWMjbFpGUFFCWX9VWgk8aH58dANXDhlwfGdwbl4VBQpAUlb409nBn6CgRx1tNdLI06tASszv-YJ0Zhg9XBJLLD5-NTlFQV5AEkw-DERJUytDCypYEQ"
    message {
      data: "Hello 2"
      attributes {
        key: "author"
        value: "unknown"
      }
      attributes {
        key: "year"
        value: "2020"
      }
      message_id: "1463021654464851"
      publish_time {
        seconds: 1598522745
        nanos: 128000000
      }
    }
    , ack_id: "TgQhIT4wPkVTRFAGFixdRkhRNxkIaFEOT14jPzUgKEUSC1MTUVx2G0gQaTNcdQdRDRh1eWMjbFpGUFFCWX9VWQk8aH58dANXDhlwfGdwbl4VBQpAUVb409nBn6CgRx1tNdLI06tASszv-YJ0Zhg9XBJLLD5-NTlFQV5AEkw-DERJUytDCypYEQ"
    message {
      data: "Hello 3"
      attributes {
        key: "author"
        value: "unknown"
      }
      attributes {
        key: "year"
        value: "2020"
      }
      message_id: "1463021654464852"
      publish_time {
        seconds: 1598522745
        nanos: 128000000
      }
    }
    , ack_id: "TgQhIT4wPkVTRFAGFixdRkhRNxkIaFEOT14jPzUgKEUSC1MTUVx2G0gQaTNcdQdRDRh1eWMjbFpGUFFCWX9VWAk8aH58dANXDhlwfGdwbl4VBQpAUFb409nBn6CgRx1tNdLI06tASszv-YJ0Zhg9XBJLLD5-NTlFQV5AEkw-DERJUytDCypYEQ"
    message {
      data: "Hello 4"
      attributes {
        key: "author"
        value: "unknown"
      }
      attributes {
        key: "year"
        value: "2020"
      }
      message_id: "1463021654464853"
      publish_time {
        seconds: 1598522745
        nanos: 128000000
      }
    }
    , ack_id: "TgQhIT4wPkVTRFAGFixdRkhRNxkIaFEOT14jPzUgKEUSC1MTUVx2G0gQaTNcdQdRDRh1eWMjbFpGUFFCWX9VXwk8aH58dANXDhlwfGdwbl4VBQpAV1b409nBn6CgRx1tNdLI06tASszv-YJ0Zhg9XBJLLD5-NTlFQV5AEkw-DERJUytDCypYEQ"
    message {
      data: "Hello 5"
      attributes {
        key: "author"
        value: "unknown"
      }
      attributes {
        key: "year"
        value: "2020"
      }
      message_id: "1463021654464854"
      publish_time {
        seconds: 1598522745
        nanos: 128000000
      }
    }
    , ack_id: "TgQhIT4wPkVTRFAGFixdRkhRNxkIaFEOT14jPzUgKEUSC1MTUVx2G0gQaTNcdQdRDRh1eWMjbFpGUFFCWX9VXgk8aH58dANXDhlwfGdwbl4VBQpAVlb409nBn6CgRx1tNdLI06tASszv-YJ0Zhg9XBJLLD5-NTlFQV5AEkw-DERJUytDCypYEQ"
    message {
      data: "Hello 6"
      attributes {
        key: "author"
        value: "unknown"
      }
      attributes {
        key: "year"
        value: "2020"
      }
      message_id: "1463021654464855"
      publish_time {
        seconds: 1598522745
        nanos: 128000000
      }
    }
    ]
at pubsub.SubscriberIT.testSubscriber(SubscriberIT.java:173)

[flaky-bot]

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

---

When run at the same commit (b2b2f86), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).

[hannahrogers-google]

The subscriberIT test is flaky for the Sync examples because we try to pull 10 messages in a single pull request:

SubscribeSyncExample.subscribeSyncExample(projectId, subscriptionId, 10);
for (int i = 0; i < 10; i++) {
  assertThat(bout.toString()).contains("Hello " + i);
}

And we expect that we will receive all 10 messages. But this is not necessarily the case because a pull callable will return a MAX of 10 messages, it might not necessarily return all 10 messages.