v0.6.0
What's Changed
- Connectors: Added
file://source and destination adapters that
read and write from/to local CSV / JSONL / Parquet files.
Thanks, @hampsterx. - Connectors: Refactored filesystem internals
- Connectors: Migrated filesystem CSV reader from pandas to Polars
- Filesystem readers: Added support for BSON. Thanks, @hampsterx.
Details
- feat(source): add file:// local filesystem source by @hampsterx in #135
- CI: Stop collapsing walkthrough comment by @amotl in #155
- Documentation: s/RabbitMQ/AMQP/ by @amotl in #154
- Tests: Refactor and bundle stream tests, deduplicate code by @amotl in #158
- connector(filesystem): Refactor and bundle blobstorage, sftp, and utils by @amotl in #156
- Linter: Configure stricter settings for Ruff, and format code by @amotl in #164
- Connectors: Migrate filesystem CSV reader from pandas to Polars by @amotl in #165
- chore(deps): update astral-sh/setup-uv action to v8.3.0 by @renovate[bot] in #167
- CodeRabbit: Toggle
review_statusandpoemby @amotl in #170 - CodeRabbit: Use label to designate PR reviews by @amotl in #171
- connector(filesystem): Refactor
resource_for_readerargs into data class by @amotl in #169 - feat(target): add file:// local filesystem destination by @hampsterx in #166
- Tests: Make table arguments optional in invoke_ingest_command by @hampsterx in #172
- connector(filesystem): Refactoring and naming things by @amotl in #173
- feat(filesystem): add BSON read support by @hampsterx in #174
- Documentation: Improve supported pipeline elements by @amotl in #175
- docs(linkcheck): harden against transient external-link flakes by @hampsterx in #176
Full Changelog: v0.5.0...v0.6.0