Skip to content
This repository was archived by the owner on Feb 6, 2026. It is now read-only.

Switch to the new engine #3113

Merged
si-bors-ng merged 112 commits into from
Mar 4, 2024
Merged

Switch to the new engine #3113

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
112 commits
Select commit Hold shift + click to select a range
f0212d6
Add initial contents of "mostly everything is a node or an edge"
nickgerace Aug 21, 2023
ead3fd8
Add first complex test for graph work and prune existing tests
nickgerace Aug 21, 2023
7c8f948
Ensure vector clocks are updated when updating node content
jhelwig Aug 22, 2023
5a431be
Fix test logic to perform a replace subgraph update
nickgerace Aug 22, 2023
30a8732
Refine helper method for finding the `Ordering` node for a container,…
jhelwig Aug 22, 2023
7c4f932
Initial implementation of ordered child nodes in workspace graph
jhelwig Aug 23, 2023
8322d92
Add working RabbitMQ connection for the Gobbler
nickgerace Aug 22, 2023
d029f5b
Test producer logic for the gobbler
nickgerace Aug 22, 2023
83d8e96
Ensure we can produce messages to RabbitMQ
nickgerace Aug 23, 2023
88c1c06
Refactor consumer for use in the gobbler
nickgerace Aug 23, 2023
6bad95d
Test removing ordered children from ordered containers
jhelwig Aug 24, 2023
39d19e9
Test basic conflict & update detection with ordered containers
jhelwig Aug 24, 2023
ff5f500
Detect conflicting ordering updates for containers with Ordering nodes
jhelwig Aug 25, 2023
863525a
Detect when a workspace snapshot has added an ordered child & rebasin…
jhelwig Aug 25, 2023
0be06c9
Fix gobbler-server compilation by removing Subscription
nickgerace Aug 28, 2023
d6074f7
Add gobbler client/server architecture
nickgerace Aug 24, 2023
86b95b6
Fix "buck2 build //lib/..." for gobbler
nickgerace Sep 6, 2023
7297def
Rename gobbler to rebaser
nickgerace Sep 6, 2023
0729b9d
Initial round trip loop of rebaser using graph logic
nickgerace Sep 7, 2023
1754f6a
Fix buck2 compilation errors by moving rebaser-client tests
nickgerace Sep 19, 2023
48a7e59
Use consistent naming for EdgeWeightKind variants
jhelwig Aug 31, 2023
d4ffe5f
Fix naming of variable & debug text in ContentNodeWeight
jhelwig Aug 31, 2023
85a4996
Clean up use statements in node weights for workspace snapshot graph
jhelwig Aug 31, 2023
6c30595
Initial AttributeView support in WorkspaceSnapshotGraph
jhelwig Sep 19, 2023
ec0ecfa
Expand testing of ordered containers with workspace snapshot attribut…
jhelwig Sep 19, 2023
0962a02
Include information encoded in EdgeWeights in WorkspaceSnapshotGraph …
jhelwig Sep 21, 2023
83461f6
Test view generation for maps in WorkspaceSnapshotGraph
jhelwig Sep 21, 2023
a3fb910
Fix compilation error in rebaser integration test
nickgerace Sep 26, 2023
67eed49
Add content-store and content-store-test crates
nickgerace Sep 26, 2023
50c4271
Add content store to DalContext
nickgerace Oct 2, 2023
6b5f093
Introduce VectorClockId and use it in rebaser-server
nickgerace Oct 6, 2023
3cbbcb2
Add si-cbor and use for WorkspaceSnapshot and ContentPair
nickgerace Oct 13, 2023
9012a9b
Bail on conflicts in rebaser-server
nickgerace Oct 6, 2023
cf1bc25
Perform updates in the rebaser
nickgerace Oct 6, 2023
0ee3090
Fix rebaser-server after si-crypto and si-std refactor
nickgerace Oct 17, 2023
727a80a
Handle signup via a "universal" change set and snapshot
nickgerace Oct 17, 2023
2aad323
feat(*): begin switchover to workspace snapshot and content store
nickgerace Oct 17, 2023
0cdc783
Add rebaser to runtime and harden conflicts and updates detection
zacharyhamm Oct 31, 2023
d5802fb
fix(sdf): fix list-funcs to restore categorization by backend kind
zacharyhamm Nov 8, 2023
d908032
Add fully-featured assets to the new engine and UI
zacharyhamm Nov 8, 2023
0edb2ff
fix(graph): import subgraph should replace all references to copied node
zacharyhamm Dec 11, 2023
7ed718d
feat(graph): remove cleanup in remove edge. actually remove nodes in …
zacharyhamm Dec 7, 2023
7c8b1c5
Fix builds from previous eng-1936-switchover rebase with main
nickgerace Dec 13, 2023
59c0d00
Account for replace subgraph updates when using import subgraph
nickgerace Dec 13, 2023
e8c3971
Merge remote-tracking branch 'origin/main' into eng-1936-perform-swit…
nickgerace Dec 13, 2023
6f7130d
feat(import): finish import of modules
zacharyhamm Dec 14, 2023
544ed3c
Merge remote-tracking branch 'origin/main' into eng-1936-perform-swit…
nickgerace Dec 14, 2023
55aae3c
Restore attribute value insertion and deletion
nickgerace Dec 14, 2023
b0309ef
Restore property editor (read-only)
nickgerace Dec 14, 2023
b12bb21
Merge branch 'main' into eng-1936-perform-switchover
zacharyhamm Dec 18, 2023
78e4d15
feat(sdf,dal): implement update property editor values
zacharyhamm Dec 19, 2023
eec08ab
Wire up "Apply Changes" on the frontend to SDF
jhelwig Dec 20, 2023
02e666f
feat(sdf,web,dal): graph visualization
zacharyhamm Dec 8, 2023
4d6d788
Merge pull request #3069 from systeminit/zack/visualize-graph
zacharyhamm Dec 21, 2023
f885ede
Merge remote-tracking branch 'origin/main' into eng-1936-perform-swit…
nickgerace Dec 21, 2023
44ad02e
feat(dal,sdf): insert property editor values in graph
zacharyhamm Dec 22, 2023
457de22
Merge pull request #3101 from systeminit/zack/insert-property-editor-…
zacharyhamm Dec 22, 2023
9cb19b4
fix(dal): restore replace references in replace subgraph
zacharyhamm Dec 22, 2023
31f4b19
Add the ability to create inter-component edges with the new engine
nickgerace Dec 22, 2023
c7298ae
Create and display edges in the UI with the new engine
nickgerace Dec 22, 2023
57f77d2
Update new engine README to point to PR 3113
nickgerace Jan 3, 2024
f910717
Merge remote-tracking branch 'origin/main' into new-engine
nickgerace Jan 3, 2024
a7fc855
Fix missing cargo workspace members for new engine crates
nickgerace Jan 3, 2024
9928da8
Only prune & write out new workspace snapshot graph if there have bee…
jhelwig Jan 3, 2024
f7664d7
Speed up garbage collection of un-referenced nodes in WorkspaceSnapsh…
jhelwig Jan 4, 2024
b254e7c
Fix RabbitMQ infinite hangs when it isn't ready
nickgerace Jan 4, 2024
04ebd7a
fix(sdf): don't setup api/session twice
zacharyhamm Jan 8, 2024
3030126
Merge branch 'main' into new-engine
zacharyhamm Jan 9, 2024
a6d19e2
Remove internal providers
zacharyhamm Jan 10, 2024
35d1a42
fix(graph,rebaser): Fix replace references, use id->index map lookups
zacharyhamm Jan 12, 2024
c168f9f
Merge pull request #3165 from systeminit/depvalup-spike
zacharyhamm Jan 12, 2024
6284d11
feat(dal): intra-component dependent values update
zacharyhamm Jan 16, 2024
ed050e2
Merge pull request #3207 from systeminit/dependent-value-update
zacharyhamm Jan 24, 2024
95f0260
feat(dal): inter component connections and dependent value updates
zacharyhamm Jan 24, 2024
8d7480f
feat(dal): don't execute values that spawned DependentValuesUpdate
zacharyhamm Jan 25, 2024
8242aa5
fix(graph): touch ordering nodes after children in DFS post-order
zacharyhamm Jan 26, 2024
9c5a66b
fix(dal): support multiple incoming edges
zacharyhamm Jan 26, 2024
aa636bc
feat(dal): use name and color from si tree. fix doc comments
zacharyhamm Jan 26, 2024
0ecefe3
feat(dal): ensure we update independent values on component creation
zacharyhamm Jan 30, 2024
541e8bd
feat(dal): support qualifications and other 'leaf' functions
zacharyhamm Jan 30, 2024
b21f9f9
feat(dal,sdf): list qualifications
zacharyhamm Jan 31, 2024
f10ea12
Merge branch 'main' into new-engine
zacharyhamm Jan 31, 2024
19afa42
backend compiling again after merge
zacharyhamm Feb 1, 2024
3fdaa61
Merge branch 'main' into new-engine
zacharyhamm Feb 1, 2024
00a2a55
fix(*): stabilize frontend after merging in main
zacharyhamm Feb 1, 2024
2a04ee4
Merge remote-tracking branch 'origin/main' into new-engine
nickgerace Feb 2, 2024
7f471e0
Merge remote-tracking branch 'origin' into new-engine
nickgerace Feb 2, 2024
00fb9df
Ensure content store works with TLS config
nickgerace Feb 7, 2024
dd7fe2a
Add ability to attach components to frames in the new engine
nickgerace Feb 7, 2024
3fdfa22
Merge remote-tracking branch 'origin/main' into new-engine
nickgerace Feb 8, 2024
0c28d7d
Remove unused frame sockets and add multiple frames test
nickgerace Feb 8, 2024
e07040e
Use NATS Jetstream for the new engine
nickgerace Feb 12, 2024
dd4cd55
Make rebases non-blocking and use work queue retention policy
nickgerace Feb 16, 2024
669a245
Merge remote-tracking branch 'origin' into new-engine
nickgerace Feb 16, 2024
615fc0e
Update new engine README with step to pull images
nickgerace Feb 16, 2024
ab14ec3
Merge remote-tracking branch 'origin/main' into new-engine
nickgerace Feb 20, 2024
7cf55cb
Convert ephemeral Secret object to graph node in the new engine
nickgerace Feb 22, 2024
5e037f7
Merge remote-tracking branch 'origin/main' into new-engine
nickgerace Feb 22, 2024
568c296
Restore "force new" for change sets in the new engine
nickgerace Feb 22, 2024
79c0104
Restore ability to update and list secrets in the new engine
nickgerace Feb 22, 2024
19a289c
Fix content pair creation races by only writing out
nickgerace Feb 23, 2024
5cb13a0
Fix graph unit tests lacking ordinal edges
nickgerace Feb 23, 2024
613d1b4
Merge remote-tracking branch 'origin/main' into new-engine
nickgerace Feb 27, 2024
beb4bdd
Ack messages when done rebasing in the new engine
nickgerace Feb 27, 2024
2d92270
fix(dal): Show secret creation form correctly
vbustamante Feb 27, 2024
7a15346
feat(dal,sdf): Bring back authentication prototypes
vbustamante Feb 28, 2024
cc630ea
feat(dal): Load before funcs before func execution
vbustamante Feb 29, 2024
4219561
Fix before funcs assembly and add integration test for before funcs
nickgerace Mar 1, 2024
a90213d
Remove override flag and centralized property editor values accessors
nickgerace Mar 1, 2024
422de9c
Refer to old-engine in README for running SI
nickgerace Mar 4, 2024
db4f957
Merge remote-tracking branch 'origin/main' into new-engine
nickgerace Mar 4, 2024
9a055e6
Prepare the "new-engine" branch to become main
nickgerace Mar 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .cargo/config.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,6 @@
[build]
rustflags = [ "--cfg", "tokio_unstable"]

[target.x86_64-unknown-linux-gnu]
rustflags = [
"-C", "link-arg=-fuse-ld=lld",
Expand Down
2 changes: 1 addition & 1 deletion .ci/docker-compose.test-integration.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ services:
- "PGPASSWORD=bugbear"
- "POSTGRES_USER=si_test"
- "POSTGRES_DB=si_test"
- "POSTGRES_MULTIPLE_DBS=si_test_dal,si_test_sdf_server"
- "POSTGRES_MULTIPLE_DBS=si_test_content_store,si_test_dal,si_test_sdf_server"
command:
- "-c"
- "fsync=off"
Expand Down
Loading