Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: update dependencies and remove constraint on pydantic #2841

Merged
merged 13 commits into from
Apr 4, 2024

Conversation

rbiseck3
Copy link
Contributor

@rbiseck3 rbiseck3 commented Apr 3, 2024

Description

  • The consistent-deps.sh was fixed to take into account the ingest dependencies, causing some errors to show up. New constriants were added to make that script pass.
  • Update all requirements without constraint on pydantic, allowing the latest version to be pulled in.
  • pikepdf is causing a conflict but there's a fix on their main branch, just need for the next release to be published. Opened up a question here to see if we can get that out any sooner: Do releases happen on a schedule?. For now added lxml<5 to the constraints.

A couple optimizations:

  • constraints.in renamed to constraints.txt since the whole point is all dependencies are already pinned and the file never gets compiled
  • constraints.txt moved to a requirements/deps directory as this never gets compiled by pip-compile
  • Other dependency files updated to reference the new location of base.in and constraints.txt
  • make file updated since it was originally written to avoid the base.in and constraints.in file

@rbiseck3 rbiseck3 requested a review from qued April 3, 2024 14:14
@rbiseck3 rbiseck3 force-pushed the roman/drop-pydantic-constraint branch from 80464a8 to 7396c16 Compare April 3, 2024 14:19
@rbiseck3 rbiseck3 changed the title feat: drop pydantic constraint feat: update dependencies and remove constraint on pydantic Apr 3, 2024
Copy link
Contributor

@MthwRobinson MthwRobinson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updates look good, just had a question on the consistent-deps.sh update

@rbiseck3 rbiseck3 force-pushed the roman/drop-pydantic-constraint branch from 41b57c3 to 155794d Compare April 4, 2024 18:38
@rbiseck3 rbiseck3 enabled auto-merge April 4, 2024 19:08
@rbiseck3 rbiseck3 added this pull request to the merge queue Apr 4, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Apr 4, 2024
@rbiseck3 rbiseck3 added this pull request to the merge queue Apr 4, 2024
Merged via the queue into main with commit d6f2841 Apr 4, 2024
46 checks passed
@rbiseck3 rbiseck3 deleted the roman/drop-pydantic-constraint branch April 4, 2024 20:31
kaaloo pushed a commit to inclusif/unstructured that referenced this pull request Apr 8, 2024
…ured-IO#2841)

### Description
* The `consistent-deps.sh` was fixed to take into account the ingest
dependencies, causing some errors to show up. New constriants were added
to make that script pass.
* Update all requirements without constraint on pydantic, allowing the
latest version to be pulled in.
* `pikepdf` is causing a conflict but there's a fix on their `main`
branch, just need for the next release to be published. Opened up a
question here to see if we can get that out any sooner: [Do releases
happen on a
schedule?](pikepdf/pikepdf#574). For now
added `lxml<5` to the constraints.

A couple optimizations: 
* `constraints.in` renamed to `constraints.txt` since the whole point is
all dependencies are already pinned and the file never gets compiled
* `constraints.txt` moved to a `requirements/deps` directory as this
never gets compiled by `pip-compile`
* Other dependency files updated to reference the new location of
`base.in` and `constraints.txt`
* make file updated since it was originally written to avoid the
`base.in` and `constraints.in` file
kaaloo pushed a commit to inclusif/unstructured that referenced this pull request Apr 8, 2024
…ured-IO#2841)

### Description
* The `consistent-deps.sh` was fixed to take into account the ingest
dependencies, causing some errors to show up. New constriants were added
to make that script pass.
* Update all requirements without constraint on pydantic, allowing the
latest version to be pulled in.
* `pikepdf` is causing a conflict but there's a fix on their `main`
branch, just need for the next release to be published. Opened up a
question here to see if we can get that out any sooner: [Do releases
happen on a
schedule?](pikepdf/pikepdf#574). For now
added `lxml<5` to the constraints.

A couple optimizations: 
* `constraints.in` renamed to `constraints.txt` since the whole point is
all dependencies are already pinned and the file never gets compiled
* `constraints.txt` moved to a `requirements/deps` directory as this
never gets compiled by `pip-compile`
* Other dependency files updated to reference the new location of
`base.in` and `constraints.txt`
* make file updated since it was originally written to avoid the
`base.in` and `constraints.in` file
@@ -16,5 +16,5 @@ rapidfuzz
backoff
typing-extensions
# NOTE(jennings): pinned due to later versions not supporting api_key_auth in UnstructuredClient
unstructured-client>=0.15.1
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rbiseck3, do you happen to remember why this version was restricted? The newer parameters of the client aren't accessible with this restricted

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants