Example for reading from a delta table

[theelderbeever]

As the title says. Looking for an example on how to read from a deltalake table. Is this even possible yet? I have started with something like below. Do I need to implement my own TableProvider somewhere or does anyone know if one already exists?

    let mut table = match open_table("data/metrics").await {
        Ok(tbl) => tbl,
        Err(_) => {
            let ops = DeltaOps::try_from_uri("data/metrics").await?;
            ops.create()
                .with_table_name("metrics")
                .with_columns(VectorMetric::columns())
                .await?
        }
    };

    let mut ctx = SessionContext::new();

    ctx.register_table("metrics", Arc::new(table)).unwrap();

[simonvandel]

There's an implementation of TableProvider here: https://github.com/delta-io/delta-rs/blob/21e369f309941d069636d8b7c8d50b30e2646ea4/rust/src/delta_datafusion/mod.rs#L428

It's behind the datafusion cargo feature.

[theelderbeever]

I have the datafusion feature added but I still get that the TableProvider trait isn't implemented for DeltaTable. Its also not a pub trait in that file so I can't bring it into scope. Any thoughts?

the trait bound deltalake::DeltaTable: datafusion::datasource::TableProvider is not satisfied
the following other types implement trait datafusion::datasource::TableProvider:
datafusion::datasource::empty::EmptyTable
datafusion::datasource::listing::ListingTable
datafusion::datasource::streaming::StreamingTable
datafusion::datasource::ViewTable
datafusion::test_util::TestTableProvider
datafusion::datasource::MemTable
required for the cast from std::sync::Arc<deltalake::DeltaTable> to std::sync::Arc<(dyn datafusion::datasource::TableProvider + 'static)>

[theelderbeever]

Looks like it was a version issue. Datafusion 32.0.0 isn't compatible with delta-rs 0.16.0.

[AbrarNitk]

Have faced the same issue, It worked for me with the below config.

[dependencies]
tokio = { version = "1.37", features = ["full"] }
deltalake = { version = "0.17", features = ["s3", "datafusion", "datafusion-ext"] }
datafusion = { version = "35.0.0" }