Replies: 8 comments 8 replies
-
|
That looks very familiar :-) |
Beta Was this translation helpful? Give feedback.
-
|
Input from Antigravity (Gemini 3.1 Pro):
|
Beta Was this translation helpful? Give feedback.
-
|
@Garrus800-stack Hi Daniel, let me add some human input here. The Neo.mjs project started as an application engine (UI run-time). The approach was JS first (JSON structures) combined with the "off the main thread" concept. A main thread (browser window) is rather tiny. It starts the workers setup, delegates user events to the app worker, and applies delta update patches to the live DOM. Main threads don't know about apps, components, state providers etc. In case we switch to the SharedWorker mode, multi browser windows can connect to the same app worker. This means, that apps of multiple windows live inside the same worker scope. Think of shared state, but also the ability to move entire component trees into different windows. Keeping the same JS instances, just unmounting the vdom representation from one window to another. To get the idea:
Another great example to showcase the performance is: It turned out that both humans and models had a hard time understanding Neo. If you look at: I started with a github workflow MCP server, which syncs tickets, release notes, PR conversations and discussion as md files into the repo. A knowledge base server followed to drop src, tests, guides, blog posts, release notes, tickets into chroma db. This enabled semantic search for models. In a way it also solves software versioning. If all files live inside the repo, we can just use git to move to a legacy version and rebuild the knowledge base on that snapshot. Then I added the memory core. At first 2 chroma tables: memories (turns) and weighted summaries. Also with semantic search for both. At that point fresh sessions were able to query their history and evaluate what went well, and where we need to improve. I added a requirement into the startup workflow to read the latest 5 session summaries. great for continuity, not sufficient for "what to do next?". For this I needed Hybrid RAG, and Gemini 3.1 Pro wrapped up a new Graph DB on top of SQLite. This goes hand in hand with the dream mode. To process it, I am using Gemma4:31B locally (needs advanced hardware though). gemini itself has a For the neural link: this is a bridge architecture where multiple agents and neo apps (app workers) can connect via a WebSocket server. Quite a lot of tool for inspections and mutations. Think of conversational UIs, where agent can apply massive changes at run-time. without changing source code, even without a page reload. Input e.g.: What I am thinking about currently: Gemini can browse through Neo Apps, and interact with them. These interactions persist inside the memory core, so it could wrap them into new whitebox E2E tests. Both, Gemini 3.1 Pro and Opus 4.6 strongly recommend to create a Neo based Multi-Window UI for agents. Quite powerful, since with the Neural Link, models could then modify their own agents UIs too at run-time. I leave the further Agent OS comparisons to Gemini ;) Best regards, |
Beta Was this translation helpful? Give feedback.
-
|
Input from Antigravity (Gemini 3.1 Pro):
|
Beta Was this translation helpful? Give feedback.
-
|
@Garrus800-stack Hi Daniel, here is how I would tackle this: first create a repo fork, since the latest release (v12.1) is already 300 resolved tickets behind. For the next release I still need to wrap up the multi-body grid architecture (locked columns). I always use these in separate terminals:
While MCP servers can start this on their own, ending an agent session would close connections, which might lock out other agents. The easiest way to try it out is most likely Gemini CLI, since it can just pick up https://github.com/neomjs/neo/blob/dev/.gemini/settings.json . I am using Antigravity the most these days. This one has the MCP server config inside the system Users folder, so the configuration gets a little bit more tricky. Explore: https://github.com/neomjs/neo/blob/dev/.github/AI_QUICK_START.md . All Neo MCP servers are build on top of the official modelcontextprotocol SDK, so you are correct, Genesis should be able to pick up NL like any other MCP server => following standard tool definitions. I am using OpenAPI 3 specs (yaml files) to derive MCP tool shapes from them. So if needed, it would be quite simple to spin up a webserver from the specs with the according RESTful endpoints. If we want to deploy NL into the cloud, we should tackle this one first: #9559 => I already implemented authorization for the knowledge base and memory core servers, but NL is still missing out here. Also worth an exploration, since it directly relates: #9889 . As mentioned before, you are very welcome to open new tickets or ask questions if needed. Best regards, |
Beta Was this translation helpful? Give feedback.
-
|
The codebase/documentation gap analysis idea is compelling because it uses memory and GraphRAG to find conflicts across source, tests, guides, and past agent sessions. That can become a lot of repeated model work if it runs continuously. I would split the pipeline into cheap retrieval/diff stages and stronger synthesis stages, with token usage tracked per stage. That makes it easier to decide where caching or cheaper OpenAI-compatible models are enough. I am testing an OpenAI-compatible multi-model API layer, and staged routing is a natural fit for this kind of maintenance workflow. Where do you expect the expensive calls to happen: graph extraction, conflict detection, or final report generation? |
Beta Was this translation helpful? Give feedback.
-
|
In this kind of pipeline the expensive calls are rarely where people expect: extraction and conflict *detection* stay cheap (embeddings, incremental diffs, heavy caching — and much of detection can be fully deterministic, no model at all). The cost concentrates in conflict *adjudication* — deciding whether two statements genuinely contradict or just differ in wording, which needs a strong model with wide context — and in the final report synthesis. So if you're building staged routing, that's the boundary I'd draw.
Genesis itself keeps the detection stage deterministic by design (contract suites and doc-drift gates instead of continuous model passes), and its model path stays local/direct by design as well — I don't route it through external API layers. But the staged-cost framing is sound; good luck with the router.
13. Juli 2026, 07:42 von ***@***.***:
…
The codebase/documentation gap analysis idea is compelling because it uses memory and GraphRAG to find conflicts across source, tests, guides, and past agent sessions. That can become a lot of repeated model work if it runs continuously.
I would split the pipeline into cheap retrieval/diff stages and stronger synthesis stages, with token usage tracked per stage. That makes it easier to decide where caching or cheaper OpenAI-compatible models are enough.
I am testing an OpenAI-compatible multi-model API layer, and staged routing is a natural fit for this kind of maintenance workflow. Where do you expect the expensive calls to happen: graph extraction, conflict detection, or final report generation?
—
Reply to this email directly, > view it on GitHub <#9739?email_source=notifications&email_token=B7G2N3FPIMK33K4CSFB3IOT5ERZEDA5CNFSNUABIM5UWIORPF5TWS5BNNB2WEL2ENFZWG5LTONUW63SDN5WW2ZLOOQXTCNZWGE4DAOBXUZZGKYLTN5XKO3LFNZ2GS33OUVSXMZLOOSWGM33PORSXEX3DNRUWG2Y#discussioncomment-17618087>> , or > unsubscribe <https://github.com/notifications/unsubscribe-auth/B7G2N3FMIPKOFGOIJ7FSI535ERZEDAVCNFSNUABHKJSXA33TNF2G64TZHMZDEMBYGY3TONBYHNCGS43DOVZXG2LPNY5TSOBTGUZTCNVBOYBA>> .
Triage notifications, keep track of coding agent tasks and review pull requests on the go with GitHub Mobile for > iOS <https://github.com/notifications/mobile/ios/B7G2N3ATUCZ4KMLMTK72PHT5ERZEDA5CNFSNUABIM5UWIORPF5TWS5BNNB2WEL2ENFZWG5LTONUW63SDN5WW2ZLOOQXTCNZWGE4DAOBXUZZGKYLTN5XKO3LFNZ2GS33OUVSXMZLOOSVGM33PORSXEX3JN5ZQ>> and > Android <https://github.com/notifications/mobile/android/B7G2N3AKA3IYIFCKJNPH7ML5ERZEDA5CNFSNUABIM5UWIORPF5TWS5BNNB2WEL2ENFZWG5LTONUW63SDN5WW2ZLOOQXTCNZWGE4DAOBXUZZGKYLTN5XKO3LFNZ2GS33OUVSXMZLOOSXGM33PORSXEX3BNZSHE33JMQ>> . Download it today!
You are receiving this because you were mentioned.> Message ID: > <neomjs/neo/repo-discussions/9739/comments/17618087> @> github> .> com>
|
Beta Was this translation helpful? Give feedback.
-
|
Hi @Garrus800-stack and @richardchen874-sys — first, an apology: I missed several nested replies here. Correction after a second architecture challenge: my first update was too compressed. It found valid open boundaries, but it made the replacement sound like a small, flat deterministic gap lookup. That under-described what Neo actually built. The current substrate includes a hierarchical Concept Ontology, automatic concept discovery, a 20k+ discovered concept population, graph-queryable ADRs, and newly-landed concept-neighborhood retrieval. The corrected short verdict is: this Discussion was substantially implemented, then evolved into a more ambitious graph-native architecture. Its original implementation vehicle is superseded. The remaining verified defects now have explicit ticket authorities, so the Discussion can close without pretending every successor is already complete. The full implementation lineage
What that architecture actually isThis is not a flat curated lookup. The trusted ontology is deliberately hierarchical. Neo also built automatic discovery, with provenance separation rather than treating every inferred term as authority:
The scale is real, but the populations must not be conflated. Introduction.md records the team-verified 2026-07-09 measurement: 22,446 Three ADRs now frame the architecture:
And the hierarchy now has a real query consumer, not only a gap detector. PR #14513 added a bounded concept-neighborhood probe, PR #14528 added canonical concept identity and alias-cluster merging, and the just-merged PR #15071 adds opt-in concept-anchored retrieval to both Memory Core and Knowledge Base: flat embedding results are preserved, then augmented by bounded walks through concept-to-concept relationships and authorized source/guide/memory terminals. That consumer is default-off pending its live L3 activation proof, so it is shipped mechanism, not yet a claim that every query uses it. What the deep live audit still falsifiedThe hierarchy exists as architecture and curated data, but I cannot honestly market the current 20k+ live population as one fully projected nested hierarchy. The current JSONL declares 182 ontology edges. The audited SQLite graph contains only 98 exact matching edges: 18/53
There is a second, independent false-clear defect:
Two original #9739 promises also remain only partial:
One documentation drift surfaced too: ADR 0024 §2.7 and Where the expensive calls actually are@richardchen874-sys, your staged-routing instinct is close to the architecture Neo converged on:
We record prompt-size estimates, output caps, and per-phase durations. A normalized actual-token ledger across every provider was not a The replies I owed DanielYour Neural Link question was exactly right: access is not understanding. Neural Link exposes factual live component structure, class/config/state/store relationships, methods, and mutation results. Understanding an unfamiliar application still comes from source/contracts/guides, the Knowledge Base, and now potentially the concept-mediated retrieval path. The useful combination is semantic context plus live runtime truth. Your two Memory Core observations also remain valuable:
Closure disposition — superseded, not “done”The final ticket sweep changes my earlier keep-open recommendation. Every surviving obligation now has a terminal, challengeable disposition:
So the honest classification is superseded, not implemented-as-originally-drawn and not abandoned. The original Per the Discussion lifecycle contract, the mechanical GitHub close reason is RESOLVED because all scope is now terminally dispositioned. That does not claim #15125, #15126, or the remaining GP2 leaves are already complete. And Daniel: if the Genesis ↔ Neural Link experiment is still relevant, the invitation remains open — now with a much more precise statement of where Neo's semantic understanding actually comes from. |
Beta Was this translation helpful? Give feedback.

Uh oh!
There was an error while loading. Please reload this page.
-
Concept: Codebase/Documentation Gap Analysis
Currently, the SQLite Hebbian Memory Integration (Hybrid GraphRAG) pipeline effectively digests episodic memories (our conversational sessions) inside the
.neo-ai-datadirectory and extracts topological conflicts based on past agent dialogue.However, the active source code, tests, and guides are sitting in a secondary dimension to this graph. The proposed enhancement aims to cross-pollinate these pipelines.
The Problem
If agents build massive structural features (e.g. A, B, C) across several sessions, the
Memory Coreknows about it contextually. But what if the team forgets to document it?gemma4doesn't currently detect that the resulting artifacts (the source code or the markdown files inlearn/guides/) are missing the expected depth relative to the active features.Proposed Architecture
During the
runSandman.mjs(REM Extraction) pipeline:MemoryServicecheck the active.neo-ai-data/neo.dbnodes (which holds the context of features built) against the embedded knowledge base (the JSONL chunk output that represents current repository state).gemma4) run a prompt akin to:"Looking at these 5 high-density episodic achievements, do the corresponding markdown/source nodes in the knowledge base accurately reflect this feature? Or is there a documentation/guide deficit?"
gemma4determines a guide is missing, it injects a highly weighted "Documentation Gap" task intosandman_handoff.md(the Golden Path priorities).Example Output:
"Hey guys, you worked on Hybrid RAG recently, but there is no new guide in place yet. This must get a high priority to write it!"
Let's discuss how best to inject the KB context into the dream cycle without overflowing the context limits.
Beta Was this translation helpful? Give feedback.
All reactions