Skip to content

Conversation

ghukill
Copy link
Contributor

@ghukill ghukill commented Oct 17, 2025

Purpose and background context

Why these changes are being introduced:

Previously, we had to pin our duckdb version to <1.4 as the 1.4 release had a couple of temporary breaking changes. Once 1.4.1 was released we tried unpinning, but found a new breaking change. This was again determined temporary after some duckdb issues discussions, indicating that a 1.4.2 release will fix this bug.

See this duckdb issue for more context and confirmation that 1.4.2.dev27 works: duckdb/duckdb-python#126 (comment).

In both cases they were bugs with the release. It is believed that the 1.4 release is a big one for duckdb, so a bit more churn that normal.

That said, development is rapid on the TIMDEX ETL pipeline at the moment, and this library, and continuing to work with the newest version of duckdb is desirable. A 1.4.2 release will likely be soon, but we don't know when.

How this addresses that need:

Updates duckdb pinned version to 1.4.2.dev27, which is confirmed to work for us. Once 1.4.2 is released, we can remove this pin.

How can a reviewer manually see the effects of these changes?

Working tests are confirmation that 1.4.2.dev27 is sufficient. Both 1.4.0 and 1.4.1 have different errors that crop up during unit tests.

Includes new or updated dependencies?

YES

Changes expectations for external applications?

NO

What are the relevant tickets?

Why these changes are being introduced:

Previously, we had to pin our duckdb version to <1.4 as the 1.4 release had a couple of temporary
breaking changes.  Once 1.4.1 was released we tried unpinning, but found a new breaking change.
This was again determined temporary after some duckdb issues discussions, indicating that a 1.4.2
release will fix this bug.

In both cases they were bugs with the release.  It is believed that the 1.4 release is a big one
for duckdb, so a bit more churn that normal.

That said, development is rapid on the TIMDEX ETL pipeline at the moment, and this library, and
continuing to work with the newest version of duckdb is desirable.  A 1.4.2 release will likely
be soon, but we don't know when.

How this addresses that need:

Updates duckdb pinned version to 1.4.2.dev27, which is confirmed to work for us.  Once 1.4.2 is
released, we can remove this pin.

Side effects of this change:
* None

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-559
@ghukill ghukill marked this pull request as ready for review October 17, 2025 13:56
@ghukill ghukill requested a review from a team October 17, 2025 13:56
@coveralls
Copy link

Pull Request Test Coverage Report for Build 18594880427

Details

  • 2 of 2 (100.0%) changed or added relevant lines in 2 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.01%) to 93.023%

Totals Coverage Status
Change from base Build 17803314355: 0.01%
Covered Lines: 520
Relevant Lines: 559

💛 - Coveralls

Copy link

@ehanson8 ehanson8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Context in commit message is greatly appreciated!

@ghukill ghukill merged commit 279765b into main Oct 17, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants