Skip to content

docs: competitive deep-dive vs Joern#260

Merged
carlos-alm merged 3 commits intomainfrom
docs/competitive-joern
Mar 3, 2026
Merged

docs: competitive deep-dive vs Joern#260
carlos-alm merged 3 commits intomainfrom
docs/competitive-joern

Conversation

@carlos-alm
Copy link
Contributor

Summary

  • Move COMPETITIVE_ANALYSIS.md into generated/competitive/ to organize all competitive analysis files in one folder
  • Add comprehensive feature-by-feature comparison against joernio/joern (our Bump actions/setup-node from 4 to 6 #1-ranked competitor, score 4.5 vs our 4.0)
  • Update FOUNDATION.md reference to the new path

The Joern deep-dive covers 9 comparison sections with 100+ individual features:

  • Parsing & language support (18 features)
  • Graph model & analysis depth (17 features)
  • Query language & interface (12 features)
  • Performance & resource usage (15 features)
  • Installation & deployment (9 features)
  • AI agent & MCP integration (10 features)
  • Security analysis (9 features)
  • Developer productivity (17 features)
  • Ecosystem & community (11 features)

Key finding: Joern and codegraph are complements, not substitutes. Joern dominates security analysis (taint, CFG, binary analysis). Codegraph dominates developer productivity (10-10,000x faster rebuilds, 30-100x less memory, 15+ purpose-built commands, first-party MCP). Against FOUNDATION.md principles: Codegraph 6, Joern 0, Tie 2.

Test plan

  • Verify all internal links resolve correctly
  • Verify FOUNDATION.md reference points to new path
  • No code changes — docs only

…folder

Move COMPETITIVE_ANALYSIS.md into generated/competitive/ and add a
comprehensive feature-by-feature comparison against joernio/joern
(our #1-ranked competitor). Covers parsing, graph model, query language,
performance, installation, AI/MCP integration, security analysis,
developer productivity, and ecosystem across 100+ individual features.
Update FOUNDATION.md reference to the new path.
@claude
Copy link

claude bot commented Mar 3, 2026

Claude finished @carlos-alm's task —— View job


PR Review Complete

Reviewing PR #260: "docs: competitive deep-dive vs Joern"

Todo List

  • Phase 1: Root Cause Analysis - Understand problem being solved
  • Phase 2: Configuration Changes - Check for high-risk modifications
  • Phase 3: Test Integrity - Verify test-related changes
  • Phase 4: Code Quality - Review documentation quality
  • Final Assessment - Provide rating and recommendation

Phase 1: Root Cause Analysis ✅

Problem Being Solved: This PR reorganizes competitive analysis documentation by moving the general competitive analysis into a dedicated generated/competitive/ folder and adds a comprehensive 338-line feature-by-feature comparison against Joern (codegraph's #1-ranked competitor, score 4.5 vs 4.0).

Why This Approach:

  • Organizational clarity: All competitive analysis files now centralized in one folder
  • Strategic focus: Deep-dive on the Bump actions/setup-node from 4 to 6 #1 competitor helps identify specific gaps and positioning
  • Content quality: The Joern comparison is comprehensive (9 sections, 100+ individual features) and provides actionable insights

Risk Assessment: Low risk - This is purely documentation with no code changes. The analysis appears well-researched and aligns with the foundation document's competitive positioning.

Phase 2: Configuration Change Detection ✅

No configuration changes detected. Verified that:

  • biome.json - unchanged
  • vitest.config.js - unchanged
  • package.json - unchanged
  • No linting, testing, or build configuration files were modified

This is purely a documentation reorganization with no risk of silencing warnings or relaxing rules.

Phase 3: Test Integrity ✅

No test changes. This PR contains only documentation files:

  • FOUNDATION.md - single line path update
  • generated/competitive/COMPETITIVE_ANALYSIS.md - moved file (no content changes)
  • generated/competitive/joern.md - new documentation file

No test files, assertions, or coverage thresholds were modified.

Phase 4: Documentation Quality Issues ⚠️

BROKEN INTERNAL LINKS DETECTED:

  1. README.md:72 still references generated/COMPETITIVE_ANALYSIS.md (old path)
  2. docs/roadmap/BACKLOG.md:4 still references ../../generated/COMPETITIVE_ANALYSIS.md (old path)
  3. joern.md:5 correctly references ./COMPETITIVE_ANALYSIS.md (new relative path)

Positive aspects:

  • Content quality: The Joern analysis is comprehensive and well-structured with 9 detailed comparison sections
  • Strategic positioning: Correctly identifies Joern as complementary rather than competitive
  • Foundation alignment: Thorough evaluation against FOUNDATION.md principles (Codegraph 6, Joern 0, Tie 2)
  • Technical accuracy: Feature comparisons appear well-researched and honest about both tools' strengths/weaknesses
  • Actionable insights: Clearly explains why the tools serve different use cases and user bases

Root Cause Analysis

Problem Being Solved: Organizing competitive analysis documentation and providing strategic context on the #1 competitor
Why This Approach: Logical file organization + comprehensive competitor analysis
Risk Assessment: Low risk documentation change with high strategic value

Critical Concerns

  • Broken internal links: Two files still reference the old path and will show 404 errors
  • Incomplete migration: The file move wasn't fully completed across all references

Final Recommendation

  • Rating: ⭐⭐⭐☆☆ (3/5)
  • Action: REQUEST CHANGES
  • Reasoning: High-quality content with clear strategic value, but broken internal links must be fixed before merge. This is a straightforward fix that prevents documentation navigation issues.

Required fixes:

  1. Update README.md:72 to use generated/competitive/COMPETITIVE_ANALYSIS.md
  2. Update docs/roadmap/BACKLOG.md:4 to use correct relative path ../generated/competitive/COMPETITIVE_ANALYSIS.md

Once these links are fixed, this will be an excellent addition to the documentation.


@greptile-apps
Copy link

greptile-apps bot commented Mar 3, 2026

Greptile Summary

This PR reorganizes competitive analysis documentation by moving COMPETITIVE_ANALYSIS.md into a dedicated generated/competitive/ folder and adds a comprehensive 338-line deep-dive comparison against Joern (the #1-ranked competitor). The new joern.md provides detailed feature-by-feature analysis across 9 dimensions (parsing, graph model, query interface, performance, installation, AI integration, security, developer productivity, ecosystem) with 100+ individual feature comparisons.

Key changes:

  • Moved COMPETITIVE_ANALYSIS.md from generated/ to generated/competitive/ for better organization
  • Updated all internal references in FOUNDATION.md, README.md, and BACKLOG.md to point to the new path
  • Added comprehensive Joern comparison showing codegraph optimizes for speed/developer productivity (10-10,000x faster rebuilds, 30-100x less memory) while Joern dominates security analysis (taint tracking, CFG, binary analysis)
  • All internal links resolve correctly

Issues found:

Confidence Score: 4/5

  • This documentation-only PR is safe to merge with minor corrections needed
  • Score reflects high-quality documentation work with comprehensive analysis, but two factual inconsistencies need correction in FOUNDATION.md (ranking position and count of superior tools). No code changes, all links verified working, content is well-structured and thorough.
  • FOUNDATION.md requires correction of ranking references (Bump tree-sitter-python from 0.23.6 to 0.25.0 #7feat: Rust core engine via napi-rs (Phase 1) #8 and "Six"→"Seven") before merge

Important Files Changed

Filename Overview
FOUNDATION.md Updated link to COMPETITIVE_ANALYSIS.md to reflect new path (moved to generated/competitive/ folder), but ranking inconsistency remains: states #7 out of 22 while COMPETITIVE_ANALYSIS.md shows #8
README.md Updated link to COMPETITIVE_ANALYSIS.md to reflect new path in generated/competitive/ folder - simple path update, no issues
docs/roadmap/BACKLOG.md Updated relative link to COMPETITIVE_ANALYSIS.md to reflect new path structure - correct relative path from docs/roadmap/
generated/competitive/COMPETITIVE_ANALYSIS.md Moved from generated/ to generated/competitive/ with no content changes - file relocation only to organize competitive analysis docs
generated/competitive/joern.md New comprehensive 338-line feature comparison between codegraph and Joern across 9 dimensions - well-structured, thorough analysis with clear conclusions

Last reviewed commit: d3c4dae

Copy link

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

5 files reviewed, 3 comments

Edit Code Review Agent Settings | Greptile

## Competitive Position

As of February 2026, codegraph is **#7 out of 22** in the code intelligence tool space (see [COMPETITIVE_ANALYSIS.md](./COMPETITIVE_ANALYSIS.md)).
As of February 2026, codegraph is **#7 out of 22** in the code intelligence tool space (see [COMPETITIVE_ANALYSIS.md](./generated/competitive/COMPETITIVE_ANALYSIS.md)).
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ranking inconsistency: This line states codegraph is #7 out of 22, but COMPETITIVE_ANALYSIS.md shows codegraph at position #8 in the ranking table, and the new joern.md also references "#8". Check which is correct and update for consistency.

README.md and docs/roadmap/BACKLOG.md still referenced the old path
at generated/COMPETITIVE_ANALYSIS.md after the file was moved to
generated/competitive/COMPETITIVE_ANALYSIS.md in #260.
@carlos-alm
Copy link
Contributor Author

Fixed both broken internal links in d3c4dae:

  • README.md:72 — updated generated/COMPETITIVE_ANALYSIS.mdgenerated/competitive/COMPETITIVE_ANALYSIS.md
  • docs/roadmap/BACKLOG.md:4 — updated ../../generated/COMPETITIVE_ANALYSIS.md../../generated/competitive/COMPETITIVE_ANALYSIS.md

Verified no remaining references to the old path.

@greptileai

@claude
Copy link

claude bot commented Mar 3, 2026

Claude finished @carlos-alm's task —— View job


Claude finished reviewing PR #260 —— View job


PR Review Complete

Reviewing PR #260: "docs: competitive deep-dive vs Joern"

Todo List

  • Phase 1: Root Cause Analysis - Understand problem being solved
  • Phase 2: Configuration Changes - Check for high-risk modifications
  • Phase 3: Test Integrity - Verify test-related changes
  • Phase 4: Code Quality - Review documentation quality and consistency
  • Verify Link Fixes - Confirm broken links from previous review are resolved
  • Check Ranking Consistency - Address Bump tree-sitter-python from 0.23.6 to 0.25.0 #7 vs feat: Rust core engine via napi-rs (Phase 1) #8 ranking discrepancy
  • Final Assessment - Provide rating and recommendation

Phase 1: Root Cause Analysis ✅

Problem Being Solved: This PR reorganizes competitive analysis documentation by moving the general competitive analysis into a dedicated generated/competitive/ folder and adds a comprehensive 338-line feature-by-feature comparison against Joern (codegraph's #1-ranked competitor, score 4.5 vs 4.0).

Why This Approach:

  • Organizational clarity: All competitive analysis files now centralized in one folder
  • Strategic focus: Deep-dive on the Bump actions/setup-node from 4 to 6 #1 competitor helps identify specific gaps and positioning
  • Content quality: The Joern comparison is comprehensive (9 sections, 100+ individual features) and provides actionable insights

Risk Assessment: Low risk - This is purely documentation with no code changes. The analysis appears well-researched and aligns with the foundation document's competitive positioning.

Phase 2: Configuration Change Detection ✅

No significant configuration changes detected. Verified that:

  • biome.json - unchanged
  • vitest.config.js - unchanged
  • package.json - only minor devDependencies reordering (no functional impact)
  • No linting, testing, or build configuration files were modified

This is purely a documentation reorganization with no risk of silencing warnings or relaxing rules.

Phase 3: Test Integrity ✅

No test changes related to the documentation PR. The core documentation changes (commits ee9f487 and d3c4dae) only touch:

  • FOUNDATION.md - single line path update
  • generated/competitive/COMPETITIVE_ANALYSIS.md - moved file (no content changes)
  • generated/competitive/joern.md - new documentation file
  • README.md and docs/roadmap/BACKLOG.md - path reference fixes

The test file changes visible in the branch diff are from other commits merged from main, not part of this documentation PR.

Phase 4: Documentation Quality Issues ⚠️

RANKING INCONSISTENCY DETECTED:

LINK FIXES CONFIRMED ✅:

  • README.md:72 correctly updated to generated/competitive/COMPETITIVE_ANALYSIS.md
  • docs/roadmap/BACKLOG.md:4 correctly updated to ../../generated/competitive/COMPETITIVE_ANALYSIS.md
  • No remaining references to the old path found

Content Quality Assessment - EXCELLENT ⭐⭐⭐⭐⭐:

  • Comprehensive scope: 338 lines covering 9 dimensions with 100+ feature comparisons
  • Strategic positioning: Correctly identifies Joern and codegraph as complementary rather than competitive
  • Foundation alignment: Thorough principle-by-principle evaluation (Codegraph 6, Joern 0, Tie 2)
  • Technical accuracy: Detailed performance benchmarks, feature comparisons appear well-researched
  • Balanced perspective: Honest about both tools' strengths and weaknesses
  • Actionable insights: Clear positioning statement and competitive analysis
  • Professional quality: Well-structured with consistent formatting and clear tables

Root Cause Analysis

Problem Being Solved: Organizing competitive analysis documentation and providing strategic context on the #1 competitor
Why This Approach: Logical file organization + comprehensive competitor analysis for strategic positioning
Risk Assessment: Low risk documentation change with high strategic value

Critical Concerns

Minor ranking inconsistency: FOUNDATION.md (#7) vs COMPETITIVE_ANALYSIS.md and joern.md (#8)

Final Recommendation

  • Rating: ⭐⭐⭐⭐☆ (4/5)
  • Action: APPROVE WITH CONDITIONS
  • Reasoning: Exceptional documentation quality with comprehensive competitive analysis. The content is strategic, well-researched, and provides valuable insights. Only issue is a minor ranking inconsistency that should be corrected.

Required fix:
Update FOUNDATION.md:136 to change "#7 out of 22" to "#8 out of 22" to match the actual ranking position shown in COMPETITIVE_ANALYSIS.md.

Once this ranking is corrected, this will be an excellent addition to the documentation that provides clear strategic positioning and competitive context.


## Competitive Position

As of February 2026, codegraph is **#7 out of 22** in the code intelligence tool space (see [COMPETITIVE_ANALYSIS.md](./COMPETITIVE_ANALYSIS.md)).
As of February 2026, codegraph is **#7 out of 22** in the code intelligence tool space (see [COMPETITIVE_ANALYSIS.md](./generated/competitive/COMPETITIVE_ANALYSIS.md)).
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ranking mismatch: This states #7 out of 22, but COMPETITIVE_ANALYSIS.md table shows codegraph at position #8, and joern.md:5 also references "#8". Update to #8 for consistency.

As of February 2026, codegraph is **#7 out of 22** in the code intelligence tool space (see [COMPETITIVE_ANALYSIS.md](./COMPETITIVE_ANALYSIS.md)).
As of February 2026, codegraph is **#7 out of 22** in the code intelligence tool space (see [COMPETITIVE_ANALYSIS.md](./generated/competitive/COMPETITIVE_ANALYSIS.md)).

Six tools rank above us on feature breadth and community size. But none of them can answer yes to all three questions:
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Inconsistent with ranking table: States "Six tools rank above us" but COMPETITIVE_ANALYSIS.md shows 7 tools ranked above codegraph (#1-7: joern, narsil-mcp, code-graph-rag, cpg, glimpse, CodeMCP, GitNexus). Update to "Seven tools" or clarify the counting logic.

@carlos-alm carlos-alm merged commit 73744f8 into main Mar 3, 2026
22 checks passed
@carlos-alm carlos-alm deleted the docs/competitive-joern branch March 3, 2026 01:01
@github-actions github-actions bot locked and limited conversation to collaborators Mar 3, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant