Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add DataFrame.from_ray_dataset #722

Merged
merged 1 commit into from
Mar 20, 2023
Merged

Add DataFrame.from_ray_dataset #722

merged 1 commit into from
Mar 20, 2023

Conversation

jaychia
Copy link
Contributor

@jaychia jaychia commented Mar 20, 2023

Adds an API to create a DataFrame from a Ray dataset. This is useful when using Daft together with Ray, to allow for analysis of experimental results (e.g. an output Dataset from running evaluation-during-training).

@codecov
Copy link

codecov bot commented Mar 20, 2023

Codecov Report

Merging #722 (535ce0b) into main (c29f86b) will decrease coverage by 0.04%.
The diff coverage is 96.77%.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #722      +/-   ##
==========================================
- Coverage   86.03%   86.00%   -0.04%     
==========================================
  Files         154      156       +2     
  Lines       12621    12762     +141     
==========================================
+ Hits        10859    10976     +117     
- Misses       1762     1786      +24     
Impacted Files Coverage Δ
daft/runners/ray_runner.py 91.20% <94.73%> (+0.26%) ⬆️
daft/dataframe/dataframe.py 91.11% <100.00%> (+0.20%) ⬆️
daft/types.py 94.17% <100.00%> (+1.03%) ⬆️

... and 9 files with indirect coverage changes

@jaychia jaychia merged commit 0cc3a70 into main Mar 20, 2023
@jaychia jaychia deleted the jay/from-ray-dataset branch March 20, 2023 20:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant