Skip to content

Conversation

@krishnan-chandra
Copy link
Contributor

@krishnan-chandra krishnan-chandra commented May 5, 2024

Right now, the requirement on the datasets package is "datasets~=2.14.6,<3.0.0". Based on Poetry's specifications for tilde requirements, this means that only 2.14 patch releases can be used for the datasets package (and the <3.0.0 part of the requirement isn't doing anything).

But this is needlessly restrictive, as the datasets package is now up to version 2.19.0. Additionally, restricting datasets to such a low version causes issues with resolution alongside other packages that require datasets as well.

The primary usage of datasets is to call load_dataset, which shouldn't be affected by this version constraint.

Solution: Change the ~=2.14.6 to >=2.14.6 instead, which makes version solving significantly easier.

@arnavsinghvi11 arnavsinghvi11 merged commit abf98a1 into stanfordnlp:main May 5, 2024
@arnavsinghvi11
Copy link
Collaborator

Thanks @krishnan-chandra !

@krishnan-chandra krishnan-chandra deleted the fix-dataset-requirement branch May 5, 2024 22:40
shermansiu added a commit to shermansiu/dspy that referenced this pull request Mar 10, 2025
In May 2024, the following request was made to loosen the versioning requirements: stanfordnlp#971

`datasets` 3 was released later that year in September 2024. Can we increase the upper bound accordingly?
okhat pushed a commit that referenced this pull request Mar 12, 2025
* Remove upper bound on datasets version

In May 2024, the following request was made to loosen the versioning requirements: #971

`datasets` 3 was released later that year in September 2024. Can we increase the upper bound accordingly?

* Update poetry.lock
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants