Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add extra checks to make state last_update checks more stable #784

Merged
merged 114 commits into from
Dec 8, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
114 commits
Select commit Hold shift + click to select a range
5207c93
Adding cron tweaks
grafnu Oct 24, 2023
7ea5465
Merge branch 'master' into crony
grafnu Oct 24, 2023
ab273ff
Merge branch 'master' into crony
grafnu Oct 24, 2023
f2e9ce7
Merge branch 'master' into crony
grafnu Oct 27, 2023
ce6d3e0
Merge branch 'master' into crony
grafnu Oct 30, 2023
43eac2c
Merge branch 'master' into crony
grafnu Nov 3, 2023
542c544
Merge branch 'master' into crony
grafnu Nov 4, 2023
9e62b99
Merge branch 'master' into crony
grafnu Nov 6, 2023
9215d3f
Fixing timing maybe
grafnu Nov 6, 2023
bd2d698
Merge branch 'master' into crony
grafnu Nov 6, 2023
99762ef
Merge branch 'master' into crony
grafnu Nov 6, 2023
4442979
Increase test time for stability
grafnu Nov 6, 2023
530dd7c
Revert to maybe flaky interval
grafnu Nov 6, 2023
1c6d6b6
Merge branch 'master' into crony
grafnu Nov 6, 2023
8954f6b
Fix node version
grafnu Nov 8, 2023
182023c
Merge branch 'master' into crony
grafnu Nov 9, 2023
6290ede
Decrease croy
grafnu Nov 9, 2023
efbc1f8
Merge branch 'master' into crony
grafnu Nov 9, 2023
5c1e0a4
Merge branch 'master' into crony
grafnu Nov 10, 2023
b48a522
Merge branch 'master' into crony
grafnu Nov 14, 2023
185ef06
Stagger workload
grafnu Nov 17, 2023
9b7061a
Merge remote-tracking branch 'faucet/master'
grafnu Nov 17, 2023
5286db3
Merge branch 'master' into crony
grafnu Nov 17, 2023
dcd44f5
Merge branch 'master' into crony
grafnu Nov 19, 2023
470c946
Merge branch 'master' into crony
grafnu Nov 21, 2023
d2618b5
Merge branch 'master' into crony
grafnu Nov 23, 2023
9c9ebb6
Merge branch 'master' into crony
grafnu Nov 25, 2023
68c9521
Merge branch 'master' into crony
grafnu Nov 27, 2023
4a52be4
Merge branch 'master' into crony
grafnu Nov 30, 2023
55167f0
Merge branch 'master' into crony
grafnu Dec 2, 2023
1824227
Adding new pubber fail option
grafnu Dec 2, 2023
6a0c3d6
Add dupeState
grafnu Dec 2, 2023
5096f91
Inject racoon
grafnu Dec 2, 2023
8e833c8
Add disallowed state entry checking
grafnu Dec 3, 2023
dda8fc6
Add system filter
grafnu Dec 3, 2023
379b408
Fix anyMatch
grafnu Dec 3, 2023
2799cec
Allow system status changes not above threshold
grafnu Dec 4, 2023
11a129a
Fix error threshold
grafnu Dec 4, 2023
900b197
Don't validate state always
grafnu Dec 4, 2023
7174fc5
Don't always
grafnu Dec 4, 2023
ae42d90
Fix output value
grafnu Dec 4, 2023
201ef9d
Replace always
grafnu Dec 4, 2023
7b12748
Synchronize start state
grafnu Dec 4, 2023
45ea323
Fix startup capabilities
grafnu Dec 4, 2023
3df7e14
Remove default LAST_CONFIG hack
grafnu Dec 4, 2023
9991a0c
Fix linty
grafnu Dec 4, 2023
e51190b
Adding prefix allow
grafnu Dec 4, 2023
1b2e21f
Fix linty
grafnu Dec 4, 2023
b95c673
Fix blobset allowed changes
grafnu Dec 4, 2023
228aa43
Add noLastConfig option
grafnu Dec 4, 2023
b61f983
Adding allowed state changes
grafnu Dec 4, 2023
676e55d
Allowing system restart changes
grafnu Dec 4, 2023
281d167
Fix stupid
grafnu Dec 4, 2023
8b3a22b
Fix some errors
grafnu Dec 4, 2023
9f96e88
Allow +0000 timestamps
grafnu Dec 4, 2023
bcd6e90
Only check validateschema
grafnu Dec 4, 2023
3bcef41
Fix some output tests
grafnu Dec 4, 2023
7807737
Merge branch 'master' into crony
grafnu Dec 4, 2023
86e1821
Merge branch 'master' into subtests
grafnu Dec 4, 2023
beb3c17
Trigger commit
grafnu Dec 4, 2023
610649c
Adding device_state nostate schema out
grafnu Dec 4, 2023
081448e
Update itemized expected out
grafnu Dec 4, 2023
25cc1b7
Fix itemized schema out
grafnu Dec 4, 2023
a7f35f8
Update last_config
grafnu Dec 5, 2023
6f6e19c
Merge branch 'master' into crony
grafnu Dec 5, 2023
4a144b1
Merge branch 'master' into subtests
grafnu Dec 5, 2023
77da802
Fix schema expected out
grafnu Dec 5, 2023
26956b2
Trigger commit
grafnu Dec 5, 2023
03138f3
Adding likely missing things
grafnu Dec 5, 2023
3641481
Trigger commit
grafnu Dec 5, 2023
9673b63
Merge branch 'subtests' into crony
grafnu Dec 5, 2023
098cb19
Every hour
grafnu Dec 5, 2023
e5d6db2
Update to latest
grafnu Dec 5, 2023
9d1a070
REstrict schema validations
grafnu Dec 6, 2023
d6db3c8
Merge branch 'subtests' into crony
grafnu Dec 6, 2023
0c26a39
Dynamically allow some changes
grafnu Dec 6, 2023
f2584a0
Allow all changes
grafnu Dec 6, 2023
d95202e
Fix expected nostate schema out
grafnu Dec 6, 2023
56eb689
Merge branch 'subtests' into crony
grafnu Dec 6, 2023
9dcdabf
Adjusting language
grafnu Dec 6, 2023
2a2ac3f
Merge branch 'subtests' into crony
grafnu Dec 6, 2023
7f27dc9
Fixing expected out
grafnu Dec 6, 2023
dcb19ac
Merge branch 'subtests' into crony
grafnu Dec 6, 2023
45bc98a
Fixing expected out
grafnu Dec 6, 2023
ad9b6ce
Fixing expected out
grafnu Dec 6, 2023
d50df5f
Fixed schema itemized out
grafnu Dec 6, 2023
aa0df8a
Merge branch 'subtests' into crony
grafnu Dec 6, 2023
785be6f
Add better logging
grafnu Dec 6, 2023
5e7a47e
Merge branch 'subtests' into crony
grafnu Dec 6, 2023
0a494f3
Adding synchornized on device reset
grafnu Dec 7, 2023
0efe0d7
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
2130f7c
Fix last expected out
grafnu Dec 7, 2023
8d3b4df
Fix expected out
grafnu Dec 7, 2023
e28f0a8
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
aab9c64
Tweak test ot be more stable
grafnu Dec 7, 2023
f9951e8
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
855bf3b
Fix expected out
grafnu Dec 7, 2023
b86bb34
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
9bd34cd
Fix generated out
grafnu Dec 7, 2023
5dadb73
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
5288c54
Cleanup lingering processes
grafnu Dec 7, 2023
fb10eae
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
22b8249
Add better completion check
grafnu Dec 7, 2023
5d4448c
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
b99c708
Merge branch 'master' into subtests
grafnu Dec 7, 2023
1201bb1
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
0d6f9a3
Out tweaks
grafnu Dec 7, 2023
7071f6b
Merge branch 'subtests' into crony
grafnu Dec 7, 2023
64f87d1
Merge branch 'master' into crony
grafnu Dec 7, 2023
e58e825
Adding more stuffs
grafnu Dec 8, 2023
b7a5827
Adjustiign expectd out
grafnu Dec 8, 2023
8189e18
Add synchronize into system_last_update
grafnu Dec 8, 2023
ed9fc71
Updated generated.md
grafnu Dec 8, 2023
d858195
Reverting
grafnu Dec 8, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions docs/specs/sequences/generated.md
Original file line number Diff line number Diff line change
Expand Up @@ -197,5 +197,10 @@ Check that a device publishes correct software information in state messages
Check that last_update state is correctly set in response to a config update.

1. Wait for state last_config matches first config timestamp
1. Wait for state update complete
1. Force config update to trigger another config update
1. Wait for state last_config matches new config timestamp
1. Wait for state update complete
1. Force config update to trigger another config update
1. Wait for state last_config matches last config timestamp
1. Wait for state update complete
9 changes: 0 additions & 9 deletions validator/sequences/system_last_update/config_system.attr

This file was deleted.

12 changes: 0 additions & 12 deletions validator/sequences/system_last_update/config_system.json

This file was deleted.

9 changes: 5 additions & 4 deletions validator/sequences/system_last_update/config_update.attr

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

16 changes: 8 additions & 8 deletions validator/sequences/system_last_update/config_update.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

9 changes: 5 additions & 4 deletions validator/sequences/system_last_update/event_pointset.attr

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

8 changes: 4 additions & 4 deletions validator/sequences/system_last_update/event_pointset.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

9 changes: 5 additions & 4 deletions validator/sequences/system_last_update/event_system.attr

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

42 changes: 36 additions & 6 deletions validator/sequences/system_last_update/event_system.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 10 additions & 0 deletions validator/sequences/system_last_update/local_localnet.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

16 changes: 16 additions & 0 deletions validator/sequences/system_last_update/local_pointset.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions validator/sequences/system_last_update/local_system.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

8 changes: 4 additions & 4 deletions validator/sequences/system_last_update/local_update.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

5 changes: 5 additions & 0 deletions validator/sequences/system_last_update/sequence.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,5 +4,10 @@
Check that last_update state is correctly set in response to a config update.

1. Wait for state last_config matches first config timestamp
1. Wait for state update complete
1. Force config update to trigger another config update
1. Wait for state last_config matches new config timestamp
1. Wait for state update complete
1. Force config update to trigger another config update
1. Wait for state last_config matches last config timestamp
1. Wait for state update complete
Loading
Loading