An extension package of 🤗 Datasets that provides support for executing arbitrary SQL queries on HF datasets
-
Updated
Jan 24, 2024 - Python
#
hf-datasets
Here are 3 public repositories matching this topic...
This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Dataflow.
-
Updated
Oct 20, 2022 - Python
A simple toolkit to transform datasource generate by img2dataset from parquet file to Huggingface dataset.
arrow
image-processing
dataset
image-captioning
parquet
datasets
image-downloader
image-caption
pyarrow
hf-datasets
img2dataset
-
Updated
Mar 21, 2023 - Python
Improve this page
Add a description, image, and links to the hf-datasets topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the hf-datasets topic, visit your repo's landing page and select "manage topics."