Skip to content

Add data code hosting ledger#96

Open
kkudumu wants to merge 6 commits into
SCIBASE-AI:mainfrom
kkudumu:kkudumu/data-code-hosting-ledger-14
Open

Add data code hosting ledger#96
kkudumu wants to merge 6 commits into
SCIBASE-AI:mainfrom
kkudumu:kkudumu/data-code-hosting-ledger-14

Conversation

@kkudumu
Copy link
Copy Markdown

@kkudumu kkudumu commented May 14, 2026

@algora-pbc /claim #14

Summary

  • adds a self-contained data-code-hosting-ledger module for scientific data/code artifact hosting
  • supports artifact classification, folder-aware manifests, content hashes, versions, metadata-aware previews, dataset diffs, JSON-LD/DataCite/schema.org metadata, FAIR scoring, Docker runtime planning, and run/reproduce/scheduled triggers
  • includes sample workspace data, dependency-free tests, requirement mapping, CLI demo, SVG source, and demo GIF

Demo

Verification

cd data-code-hosting-ledger
npm run check
npm test
npm run demo

Review Note

Before submission I ran a local code-review pass and corrected the README demo FAIR score to match the verified deterministic output.

AI-Assisted Disclosure

This contribution was produced with AI assistance and manually reviewed/verified before submission.

Closes #14

@kkudumu
Copy link
Copy Markdown
Author

kkudumu commented May 14, 2026

/claim #14

@kkudumu
Copy link
Copy Markdown
Author

kkudumu commented May 14, 2026

Follow-up pushed to strengthen the sandboxed execution part of issue #14:

  • added explicit sandbox policy output for runtime execution plans
  • policy covers Docker isolation, network controls, resource limits, read-only artifact inputs, writable output paths, and blocked privileged actions
  • surfaced the policy in the sample workspace, packet output, demo output, tests, README, and requirement map

Verification after the update:

  • cd data-code-hosting-ledger && npm run check
  • cd data-code-hosting-ledger && npm test
  • cd data-code-hosting-ledger && npm run demo
  • git diff --check

@kkudumu
Copy link
Copy Markdown
Author

kkudumu commented May 14, 2026

Follow-up pushed in 880db80 to strengthen the FAIR preservation/deposit side of issue #14.

What changed:

  • Added buildPreservationPackage() for DataCite DOI registration readiness, repository export, schema.org indexing, required metadata gates, package-file hashes, and persistent access URLs.
  • Hosting packets now include preservation output and the GET /workspaces/:id/preservation-package route contract.
  • Demo output now shows ready deposit targets, package file count, and required gate status.
  • Updated tests, README, and the issue Scientific/Engineering Data & Code Hosting #14 requirement map.

Verification rerun:

  • npm run check
  • npm test
  • npm run demo
  • git diff --check

@kkudumu
Copy link
Copy Markdown
Author

kkudumu commented May 14, 2026

Added a short demo video artifact for Algora/reviewer convenience:

This is the same deterministic demo flow already covered by the local tests and README, now available as an MP4 video artifact.

@kkudumu
Copy link
Copy Markdown
Author

kkudumu commented May 14, 2026

Follow-up for the issue #14 drag-and-drop upload and folder organization scope.

Added commit 5ec5e04 to cover upload behavior that was previously lighter:

  • drag-and-drop upload workflow plan with dataset/code/supplement drop zones
  • accepted extensions for each drop zone
  • folder routing and folder category rules
  • resumable chunk upload routes and complete-upload route contracts
  • expected content hashes, version requirements, and tag validation for datasets/models
  • packet/demo output for uploadWorkflow
  • tests, README, and requirement-map updates

Verified locally:

  • npm run check -> passed
  • npm test -> passed
  • npm run demo -> passed and now prints upload workflow output
  • git diff --check -> passed

This keeps the module self-contained while mapping more directly to the issue requirements for drag-and-drop uploads, folder-based organization, upload validation, and standards-compliant hosting workflows.

@kkudumu
Copy link
Copy Markdown
Author

kkudumu commented May 14, 2026

Updated the existing demo video with narrated voiceover explaining every major change in this PR: artifact classification, folder manifests, FAIR metadata, sandbox policies, preservation packages, drag-and-drop upload workflow plans, resumable chunk route contracts, hashes, versions, and tag validation. The PR's existing demo-video link now points to the narrated MP4.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Scientific/Engineering Data & Code Hosting

1 participant