Skip to content
This repository was archived by the owner on Dec 21, 2021. It is now read-only.
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
9116953
test(memory): Verify memory after 60k messages or 5min.
timoxley Mar 30, 2021
43c7b67
test(memory): Verify min number of messages were received.
timoxley Mar 30, 2021
98fd22a
test: Replace storage-node-only tests with single-node-only tests.
timoxley Mar 30, 2021
151c433
test: Make multiple client tests more robust.
timoxley Mar 30, 2021
d285d96
test: Make multiple client tests more robust.
timoxley Mar 31, 2021
9a970cf
test: Fix publish abort handling.
timoxley Mar 31, 2021
0a668a8
ci: Explicitly start broker-node-no-storage-1 and broker-node-no-stor…
timoxley Mar 31, 2021
725bce3
test: Adjust publish messages util.
timoxley Mar 31, 2021
c1937be
test: Relax reconnect test.
timoxley Mar 31, 2021
1cad0a3
test: delay disconnection after message, otherwise seems to break bac…
timoxley Mar 31, 2021
1cfbcf7
test: refine disconnection tests.
timoxley Mar 31, 2021
70e7d4a
test: refine disconnection tests.
timoxley Apr 1, 2021
a69052c
test: Remove complicated redundant test.
timoxley Apr 1, 2021
359567d
test: refine disconnection tests.
timoxley Apr 1, 2021
e4b76e3
test: Increase default waitForLast timeout from 5s to 10s.
timoxley Apr 1, 2021
87d7df9
test: Split StreamrClient.test across multiple files for maybe better…
timoxley Apr 1, 2021
905bc57
test: Add temporary logging for CI.
timoxley Apr 1, 2021
357a931
test: Remove unnnecessary wrapper describes.
timoxley Apr 1, 2021
02aae8c
ci: Reduce test workers, increase test timeout.
timoxley Apr 1, 2021
94d8080
ci: Wait a few minutes before running tests.
timoxley Apr 1, 2021
8827311
types: Fix up publishTestMessages types. Add getTestSetTimeout which …
timoxley Apr 5, 2021
62fdc44
types: Fix unsubscribe type to take a stream shape in addition to sub…
timoxley Apr 6, 2021
0bb4aa5
test: Tidy up cross-test state in SubscriberResends.test.ts.
timoxley Apr 6, 2021
65f6ae8
test: Restore disconnect after each test in SubscriberResends.test.
timoxley Apr 8, 2021
9c01634
Revert "ci: Wait a few minutes before running tests."
timoxley Apr 8, 2021
771cda4
types: Remove ts-expect-error for unsubscribe & fix test util types.
timoxley Apr 8, 2021
cfcc772
test: Remove --maxWorkers=1 from integration test scripts.
timoxley Apr 8, 2021
3029a59
test: Try improve MultipleClients test robustness.
timoxley Apr 8, 2021
a2c9bd5
test: Don't fail subsequent Encryption tests if previous test's socke…
timoxley Apr 8, 2021
3549410
test: Add --verbose --useStderr to jest test scripts.
timoxley Apr 8, 2021
df64089
feat: Don't clear msgchains on disconnect.
timoxley Apr 14, 2021
d98ca25
test: Flag multiple clients tests that use resend so they can be filt…
timoxley Apr 16, 2021
22cee63
test: Split realtime/resend browser tests.
timoxley Apr 16, 2021
ff020ab
test: Whitespace.
timoxley Apr 19, 2021
550adae
test: Log missing message.
timoxley Apr 20, 2021
b1301de
ci: Collect docker logs on failure.
timoxley Apr 20, 2021
f4fb388
ci: Increase browser test delays, tidy npm scripts.
timoxley Apr 20, 2021
9b45471
ci: Fix docker-logs artifact name.
timoxley Apr 20, 2021
805e504
test: Add test logging. Temporary only minimal tests to trigger resen…
timoxley Apr 19, 2021
c1920fb
test: Add single failing resend subscribe test.
timoxley Apr 21, 2021
73019a5
test: Split single failing resendSubscribe test into own test file.
timoxley Apr 21, 2021
5e765d7
test: Add comments and try make sequential sub/resend test clearer.
timoxley Apr 21, 2021
a91f5a7
test: Clean up debug logging, rename SequentialSubscribeResend -> Sub…
timoxley Apr 27, 2021
d8fc174
test: Fix bad merge
timoxley Apr 27, 2021
a1ac08c
test: Skip flakey test with coverage elsewhere.
timoxley Apr 27, 2021
bb04d41
deps: Update all dependencies to minor version.
timoxley Apr 28, 2021
89efef1
deps: Update chromedriver 88 -> 90.
timoxley Apr 28, 2021
675087e
test: Add missing addToStorageNode calls.
timoxley Apr 28, 2021
b7b766e
ci: Temporarily disable memleak tests until production resends stable.
timoxley Apr 29, 2021
e9ce2d6
test: Fix browser test.
timoxley Apr 29, 2021
17e64ac
test: Split async tasks across multiple before hooks in resend tests.
timoxley Apr 29, 2021
c98b044
fix: Don't use waitForCondition outside test, doesn't wait for async,…
timoxley Apr 29, 2021
7d11ea3
test: Give browser test more time to add stream to storage.
timoxley Apr 29, 2021
a33501d
test: Add retry to realtime browser tests.
timoxley Apr 29, 2021
9f0b813
test: Add more retry to client-testing.
timoxley Apr 29, 2021
abc84ca
types: Make options & session not internal.
timoxley Apr 29, 2021
ce737a3
test: Add logging when tests to something unnatural, to avoid confusi…
timoxley Apr 29, 2021
52259be
test: Split async tasks across multiple before hooks in resend tests.
timoxley Apr 29, 2021
9447fc2
ci: Use service aliases.
timoxley Apr 29, 2021
dd41a20
ci: Enable debug logging for client-testing jobs.
timoxley Apr 29, 2021
2f5cbf1
ci: Add run_number & run_id to docker-log artifact name.
timoxley Apr 29, 2021
424dd69
ci: Bump streamr-client-testing retries to from 2 to 5.
timoxley Apr 30, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
55 changes: 47 additions & 8 deletions .github/workflows/test-build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -77,8 +77,8 @@ jobs:
- name: npm run test-exports
run: npm run test-exports

browser:
name: Test Browser using Node 14.x
browser-realtime:
name: Test Browser Realtime
runs-on: ubuntu-latest
needs: build
steps:
Expand All @@ -95,15 +95,41 @@ jobs:
- name: Start Streamr Docker Stack
uses: streamr-dev/streamr-docker-dev-action@v1.0.0-alpha.3
with:
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge broker-node-no-storage-1 broker-node-no-storage-2 broker-node-storage-1 nginx smtp"
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge brokers trackers nginx smtp"
- uses: nick-invision/retry@v2
name: Run Realtime Test
with:
max_attempts: 3
timeout_minutes: 3
retry_on: error
command: npm run test-browser-realtime

browser-resend:
name: Test Browser Realtime + Resend
runs-on: ubuntu-latest
needs: build
steps:
- uses: actions/checkout@v2
- uses: actions/setup-node@v2
with:
node-version: "14.x"
- uses: actions/download-artifact@v2
with:
name: build
path: dist
- name: npm ci
run: npm ci
- name: Start Streamr Docker Stack
uses: streamr-dev/streamr-docker-dev-action@v1.0.0-alpha.3
with:
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge brokers trackers nginx smtp"
- uses: nick-invision/retry@v2
name: Run Test
name: Run Resend Test
with:
max_attempts: 3
timeout_minutes: 3
retry_on: error
command: npm run test-browser
command: npm run test-browser-resend

benchmarks:
name: Test Benchmark using Node ${{ matrix.node-version }}
Expand All @@ -125,7 +151,7 @@ jobs:
- name: Start Streamr Docker Stack
uses: streamr-dev/streamr-docker-dev-action@v1.0.0-alpha.3
with:
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge broker-node-no-storage-1 broker-node-no-storage-2 broker-node-storage-1 nginx smtp"
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge brokers trackers nginx smtp"
- name: npm ci
run: npm ci
- name: benchmarks
Expand Down Expand Up @@ -159,6 +185,8 @@ jobs:
NUM_MESSAGES: 20
TEST_NAME: ${{ matrix.test-name }}
CONFIG_NAME: ${{ matrix.config-name }}
LOG_LEVEL_JAVA_CLIENT: 'debug'
LOG_LEVEL_PUBLISHER_JS: 'debug'
steps:
- uses: actions/checkout@v2
- name: Use Node.js 14
Expand All @@ -172,7 +200,7 @@ jobs:
- name: Start Streamr Docker Stack
uses: streamr-dev/streamr-docker-dev-action@v1.0.0-alpha.3
with:
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge broker-node-no-storage-1 broker-node-no-storage-2 broker-node-storage-1 nginx smtp"
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge brokers trackers nginx smtp"
- name: npm ci
run: npm ci
- name: npm link
Expand All @@ -194,7 +222,18 @@ jobs:
- uses: nick-invision/retry@v2
name: run-client-testing
with:
max_attempts: 2
max_attempts: 5
timeout_minutes: 15
retry_on: error
command: cd streamr-client-testing && DEBUG='' java -jar build/libs/client_testing-1.0-SNAPSHOT.jar -s $TEST_NAME -c config/$CONFIG_NAME.conf -n $NUM_MESSAGES
- name: Collect docker logs on failure
if: failure()
uses: jwalton/gh-docker-logs@v1
with:
dest: './logs'
- name: Upload logs to GitHub
if: failure()
uses: actions/upload-artifact@master
with:
name: docker-logs-${{ github.job }}-${{ github.run_number }}-${{ github.run_id }}
path: ./logs
24 changes: 18 additions & 6 deletions .github/workflows/test-code.yml
Original file line number Diff line number Diff line change
Expand Up @@ -85,15 +85,15 @@ jobs:
websocket-url:
- name: "default"
url: ""
- name: "storage-node-only"
url: "ws://localhost:8890/api/v1/ws"
- name: "single-node-only"
url: "ws://localhost:8690/api/v1/ws"

exclude:
# no need to test different ws urls for dataunion tests
- test-name: "test-integration-dataunions"
websocket-url:
- name: "storage-node-only"
- url: "ws://localhost:8890/api/v1/ws"
- name: "single-node-only"
- url: "ws://localhost:8690/api/v1/ws"
env:
TEST_NAME: ${{ matrix.test-name }}
WEBSOCKET_URL: ${{ matrix.websocket-url.url}}
Expand All @@ -109,9 +109,20 @@ jobs:
- name: Start Streamr Docker Stack
uses: streamr-dev/streamr-docker-dev-action@v1.0.0-alpha.3
with:
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge broker-node-no-storage-1 broker-node-no-storage-2 broker-node-storage-1 nginx smtp"
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge brokers trackers nginx smtp"
- name: Run Test
run: npm run $TEST_NAME
- name: Collect docker logs on failure
if: failure()
uses: jwalton/gh-docker-logs@v1
with:
dest: './logs'
- name: Upload logs to GitHub
if: failure()
uses: actions/upload-artifact@master
with:
name: docker-logs-${{ matrix.test-name }}-${{ matrix.websocket-url.name }}-node${{ matrix.node-version }}--${{ github.run_number }}-${{ github.run_id }}
path: ./logs

flakey:
name: Flakey Tests using Node ${{ matrix.node-version }}
Expand All @@ -131,7 +142,7 @@ jobs:
- name: Start Streamr Docker Stack
uses: streamr-dev/streamr-docker-dev-action@v1.0.0-alpha.3
with:
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge broker-node-no-storage-1 broker-node-no-storage-2 broker-node-storage-1 nginx smtp"
services-to-start: "mysql redis core-api cassandra parity-node0 parity-sidechain-node0 bridge brokers trackers nginx smtp"
- uses: nick-invision/retry@v2
name: Run Test
with:
Expand All @@ -143,6 +154,7 @@ jobs:
memory:
name: Memory Tests using Node ${{ matrix.node-version }}
runs-on: ubuntu-latest
if: ${{ false }} # temporarily disable memory test until production resends are stable
strategy:
fail-fast: false
matrix:
Expand Down
Loading