Skip to content

Memory Efficient Dataset#687

Closed
Logiquo wants to merge 53 commits intosunlabuiuc:masterfrom
Logiquo:mem-7
Closed

Memory Efficient Dataset#687
Logiquo wants to merge 53 commits intosunlabuiuc:masterfrom
Logiquo:mem-7

Conversation

@Logiquo
Copy link
Copy Markdown
Collaborator

@Logiquo Logiquo commented Dec 7, 2025

No description provided.

@Logiquo Logiquo mentioned this pull request Dec 7, 2025
@Logiquo Logiquo added enhancement New feature or request core Core functionality (Patient API, BaseDataset, event stream format, etc.) infra Infrastructure: data loading, caching, pipelines labels Dec 7, 2025
Copy link
Copy Markdown
Collaborator

@jhnwu3 jhnwu3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I also see there's a bunch more dependencies we may need to support, is it possible to add those to our pyproject.toml here?

  1. litdata
  2. pyarrow
  3. platformdirs

@Logiquo Logiquo marked this pull request as ready for review December 8, 2025 01:03
@Logiquo Logiquo requested a review from jhnwu3 December 8, 2025 01:07
@Logiquo
Copy link
Copy Markdown
Collaborator Author

Logiquo commented Dec 8, 2025

Closed in favour of #712

@Logiquo Logiquo closed this Dec 8, 2025
@Logiquo Logiquo deleted the mem-7 branch December 19, 2025 06:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core functionality (Patient API, BaseDataset, event stream format, etc.) enhancement New feature or request infra Infrastructure: data loading, caching, pipelines

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants