Datasets: Adding doc for DuckDB CLI integration

[AndreaFrancis]

Following up duckdb/duckdb#11831 for DuckDB CLI integration:

• Authentication for private and gated datasets (Using DuckDB Secrets Manager)
• Query datasets (Some basic SELECT examples, DESCRIBE, SUMMARIZE for stats)
• Perform SQL operations (Text functions and aggregations)
• Combine datasets, export and publish on the Hub
• Perform vector similarity search

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[AndreaFrancis]

I am not sure why the sections for DuckDB don't seem to be working as expected in https://moon-ci-docs.huggingface.co/docs/hub/pr_1297/en/datasets-duckdb

[lhoestq]

I think the tabs on the left are buggy in the preview but work when deployed. The other pages at https://moon-ci-docs.huggingface.co/docs/hub/pr_1297/en/datasets-duckdb are working though.

[lhoestq]

The current section main page is https://moon-ci-docs.huggingface.co/docs/hub/pr_1297/en/datasets-duckdb and shows the old way of using duckdb (register the filesystem), maybe we can set datasets-duckdb-cli as the main section page instead, and add links to the other pages at the end of this file ?

[AndreaFrancis]

The current section main page is https://moon-ci-docs.huggingface.co/docs/hub/pr_1297/en/datasets-duckdb and shows the old way of using duckdb (register the filesystem), maybe we can set datasets-duckdb-cli as the main section page instead, and add links to the other pages at the end of this file ?

Done, I moved to datasets-duckdb-cli instead to be the main section and added the first part of the old file (about what is DuckDB).
I didn't copy the rest because it is already covered (how to upload the results to a new dataset repository).

[severo]

Awesome contents, congrats @AndreaFrancis I learnt a lot.

[lhoestq]

Amazing ! just added one comment:

[polinaeterna]

I've learned some new things, thank you!

i've left a couple of minor comms, feel free to ignore if you think it's not important

[AndreaFrancis]

Thanks for all your feedback, @severo @lhoestq and @polinaeterna; I think it is ready and will merge.

[severo]

live here: https://huggingface.co/docs/hub/datasets-duckdb

[julien-c]

nice work, this is way clearer than before.

Let's now make the integration as visible as possible and keep building on top of it