Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
d66d2f3
feat: add pipeline migration packages and configuration support
ddeboer Feb 5, 2026
cc554dd
fix: update coverage threshold to match actual coverage
ddeboer Feb 5, 2026
605d12c
refactor: enhance distribution-downloader and use sparql-importer types
ddeboer Feb 5, 2026
d891266
chore: add vite config for distribution-downloader tests
ddeboer Feb 5, 2026
861e6e9
chore: add vite config for wait-for-sparql tests
ddeboer Feb 5, 2026
cbd5a32
feat(pipeline-void): add generic analyzers and provenance utility
ddeboer Feb 6, 2026
f7dfd57
refactor: add bindings support to SparqlConstructExecutor and compose…
ddeboer Feb 6, 2026
f6b6ab2
fix: remove vite.config.ts from tsconfig.spec.json include
ddeboer Feb 6, 2026
ec15ae6
refactor(distribution-downloader): replace DownloadLogger with standa…
ddeboer Feb 6, 2026
3f9c124
refactor: wrap SparqlConstructExecutor in pipeline and pipeline-void
ddeboer Feb 6, 2026
421cfb8
refactor(pipeline-void): replace NDE namespace with void-ext ontology
ddeboer Feb 6, 2026
7839c74
chore: add collect() test and update .gitignore
ddeboer Feb 6, 2026
706d051
test: update coverage
ddeboer Feb 6, 2026
9c58756
fix: resolve CI failures after Nx 22 migration
ddeboer Feb 6, 2026
0993feb
refactor(pipeline): move abstract analyzer types from pipeline-void
ddeboer Feb 6, 2026
58ff2c9
refactor(pipeline): reduce duplication between pipeline and pipeline-…
ddeboer Feb 6, 2026
38a0184
chore(pipeline): replace vitest triple-slash reference with import
ddeboer Feb 6, 2026
6926c8a
fix(local-sparql-endpoint): add readiness probe after starting endpoint
ddeboer Feb 7, 2026
9fc0058
fix(local-sparql-endpoint): use wait-for-sparql for data readiness
ddeboer Feb 7, 2026
5b3ba6f
fix(local-sparql-endpoint): remove unnecessary readiness probe
ddeboer Feb 7, 2026
71239b9
refactor: reduce duplication and merge sparql-writer into pipeline
ddeboer Feb 7, 2026
5124b91
fix: restore sparql-qlever to main state and document port allocations
ddeboer Feb 7, 2026
886a8f0
docs: fix order
ddeboer Feb 7, 2026
b271a2c
docs: port conflict
ddeboer Feb 7, 2026
ae0d8f8
refactor: extract shared serializer and replace analyzer subclasses w…
ddeboer Feb 7, 2026
1d0dc75
fix: update package-lock.json to match workspace packages
ddeboer Feb 7, 2026
5061070
fix(sparql-qlever): update coverage thresholds to match actual coverage
ddeboer Feb 7, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -46,4 +46,7 @@ Thumbs.db
test-output

vite.config.*.timestamp*
vitest.config.*.timestamp*
vitest.config.*.timestamp*
tsconfig.tsbuildinfo
vite.base.config.d.ts
vite.base.config.d.ts.map
1 change: 1 addition & 0 deletions AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,7 @@ Each package uses conditional exports with a `development` condition for local d
- Test files use `.test.ts` suffix in `test/` directory
- Fixtures in `test/fixtures/`
- HTTP mocking with Nock
- Tests that start a local SPARQL endpoint (`@lde/local-sparql-endpoint`) must use unique ports across packages to avoid conflicts when Nx runs tests in parallel. Current port allocations: `dataset-registry-client` (3002), `pipeline` sparqlQuery (3001), `pipeline` executor (3003)

### Key Dependencies

Expand Down
11 changes: 6 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,15 +21,16 @@ LDE is an [Nx](https://nx.dev) monorepo that includes the following packages:
- [ ] [@lde/dataset-analyzer-pipeline](packages/dataset-analyzer-pipeline): statistical analysis of datasets
- [x] [@lde/dataset-registry-client](packages/dataset-registry-client): retrieve dataset descriptions from DCAT-AP 3.0 registries
- [x] [@lde/distribution-download](packages/distribution-download): download distributions for processing locally
- [x] [@lde/local-sparql-endpoint](packages/pipeline): quickly start a local SPARQL endpoint for testing and development
- [ ] [@lde/pipeline](packages/pipeline): build pipelines that query, transform and enrich Linked Data
- [x] [@lde/docgen](packages/docgen): generate documentation from RDF such as SHACL shapes
- [x] [@lde/fastify-rdf](packages/fastify-rdf): Fastify plugin for serving RDF data with content negotiation
- [x] [@lde/local-sparql-endpoint](packages/pipeline): quickly start a local SPARQL endpoint for testing and development
- [ ] [@lde/pipeline](packages/pipeline): build pipelines that query, transform and enrich Linked Data
- [x] [@lde/pipeline-void](packages/pipeline-void): VOiD statistical analysis for RDF datasets
- [x] [@lde/sparql-importer](packages/sparql-importer): import data dumps to a local SPARQL endpoint for querying
- [x] [@lde/sparql-monitor](packages/sparql-monitor): monitor SPARQL endpoints with periodic checks
- [x] [@lde/sparql-qlever](packages/sparql-qlever): QLever SPARQL adapter for importing and serving data
- [ ] [@lde/task-runner](packages/task-runner): task runner core classes and interfaces
- [ ] [@lde/task-runner-docker](packages/task-runner-docker): run tasks in Docker containers
- [ ] [@lde/task-runner-native](packages/task-runner-native): run tasks natively on the host system
- [x] [@lde/task-runner](packages/task-runner): task runner core classes and interfaces
- [x] [@lde/task-runner-docker](packages/task-runner-docker): run tasks in Docker containers
- [x] [@lde/task-runner-native](packages/task-runner-native): run tasks natively on the host system
- [ ] [@lde/validator](packages/validator): validate datasets and pipeline outputs against SHACL shapes
- [x] [@lde/wait-for-sparql](packages/wait-for-sparql): wait for a SPARQL endpoint to become available
Loading