Skip to content

Replace dummy dashboard data with real SQLite data#57

Merged
saurabhsharma2u merged 9 commits intomainfrom
feat/real-dashboard-data-110839491162936791
Feb 27, 2026
Merged

Replace dummy dashboard data with real SQLite data#57
saurabhsharma2u merged 9 commits intomainfrom
feat/real-dashboard-data-110839491162936791

Conversation

@saurabhsharma2u
Copy link
Copy Markdown
Contributor

Replaced all hardcoded/dummy dashboard data with real snapshot-backed data from the Crawlith SQLite database. The dashboard now reflects the actual state of the crawl, including health scores, issue counts, page rank metrics, and depth distribution.

Key Changes:

  • Server: Now connects to the SQLite DB and exposes a REST API.
  • CLI: Resolves site and snapshot IDs before launching the UI.
  • Frontend: Consumes the new API endpoints and handles loading/error states.
  • Data Integrity: All queries are scoped by snapshot_id to prevent data leakage.

PR created automatically by Jules for task 110839491162936791 started by @saurabhsharma2u

- Refactored server to use `@crawlith/core` repositories and DB connection.
- Implemented `/api/*` endpoints for context, overview, issues, and metrics.
- Updated CLI `ui` command to resolve site and snapshot from DB.
- Refactored `@crawlith/web` to fetch data from API instead of using static mocks.
- Implemented DashboardContext and data fetching hooks in frontend.
- Removed dummy data.
@google-labs-jules
Copy link
Copy Markdown

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

saurabhsharma2u and others added 7 commits February 26, 2026 22:02
- Updated `plugins/server/tests/server.test.ts` to correctly mock `@crawlith/core` dependencies using function expressions to support `new` keyword instantiation.
- Added dummy context data to mocks to prevent `process.exit(1)` in `startServer`.
- Prefixed unused variables with `_` in:
  - `plugins/web/src/components/Header.tsx`
  - `plugins/web/src/components/Graphs/LinkDistributionChart.tsx`
  - `plugins/server/src/index.ts`
  - `plugins/cli/src/commands/ui.ts`
- Verified tests pass locally.
- Created `docs/cli/` directory.
- Added Mintlify-formatted MDX documentation for `crawl`, `page`, `ui`, `probe`, `sites`, and `clean` commands.
- Documented all user-facing flags with type, default, usage explanation, and SEO impact.
- Avoided exposing internal implementation details (e.g., SimHash, internal file paths).
@saurabhsharma2u saurabhsharma2u marked this pull request as ready for review February 27, 2026 06:06
@saurabhsharma2u saurabhsharma2u merged commit aee4c34 into main Feb 27, 2026
6 checks passed
@saurabhsharma2u saurabhsharma2u deleted the feat/real-dashboard-data-110839491162936791 branch February 27, 2026 06:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant