Releases: pipewell/jira-ingest
Releases · pipewell/jira-ingest
Release list
v1.0.1
Metadata and documentation improvements. No functional changes.
- Added author field to package metadata
- Added Documentation and Changelog URLs to PyPI project page
- Added
Natural Language :: English,Operating System :: OS Independent, andTopic :: Databaseclassifiers - Fixed documentation links in README to use absolute GitHub URLs so they resolve correctly on PyPI
v1.0.0
First release of jira-ingest under the pipewell organisation.
What it does
An async Python pipeline that fetches data from Jira Cloud and loads it into any SQLAlchemy-compatible database. Supports multiple output sinks including S3, Azure Blob Storage, Google Cloud Storage, and local filesystem.
Features
- Fetches projects, boards, issues (with custom fields), and issue transitions
- Async ingestion via
aiohttpfor high throughput - SQLAlchemy-backed loaders with dialect-aware upsert:
- PostgreSQL and Redshift:
INSERT ... ON CONFLICT DO NOTHING - SQLite:
INSERT OR IGNORE - Other dialects: plain
INSERT
- PostgreSQL and Redshift:
- Redshift fast-path: S3 COPY with
COMPUPDATE OFF STATUPDATE OFFto avoid post-load analysis hangs - fsspec URI abstraction for sink output (S3, Azure, GCS, local)
- Pydantic v2 settings with
JIRA_env prefix - CLI with
--database-url,--sink-uri, and--redshift-iam-roleoptions
Usage
pip install pipewell-jira-ingest[database]
jira-ingest fetch-all \
--jira-url https://yourorg.atlassian.net \
--database-url postgresql://user:pass@host/dbSee the README for full configuration reference and how-to guides.