How to use the continuation marker when listing the contents of a data-lake directory?

[abitofhelp]

Hello,

I have been wrangling this issue most of today and have run out of ideas... I have a rust application that uses "azure_storage_datalake" at https://github.com/ Azure/Azure-Sdk-for-rust.

Unfortunately, I have not been able to figure out or find an example of using the continuation token to enumerate the contents of a directory in our data lake. I get the first batch of data successfully, but when using the continuation token, I never get new data.

Here is the relevant code. I'd appreciate any tips. Thank you for your time and interest.

let data_lake_client = DataLakeClient::new(
            self.account_name.to_owned(),
            self.storage_credentials.to_owned(),
        );

        let file_system_client = data_lake_client.file_system_client("clients");
        let directory_client = file_system_client.get_directory_client(".");
        let directory_name = "alm";

        let mut page_cnt = 0;
        let mut cnt = 0;
        let mut continuation: Option<NextMarker> = None;
        loop {
            let mut page = directory_client
                .list_paths()
                .directory("alm")
                .recursive(true)
                .max_results(NonZeroU32::new(paging_size).unwrap())
                .continuation(continuation.clone())
                .into_stream()
                .next()
                .await
                .expect(format!("failed to stream recursive paths from directory '{}'", directory_name).as_str())?;

            // Are there any paths?
            if let Some(path) = page.paths.first() {
                page_cnt += 1;
                cnt += page.paths.len();
                page.paths
                    .iter()
                    .for_each(|b| println!("[{}/{}]: {}", page_cnt, cnt, b.name));
            }

            if page.continuation.is_none() {
                println!("continuation_token is None - exiting");
            } else {
                continuation = page.continuation;
            }
        }

[abitofhelp]

I figured out the issue. Here is the code that works in case someone needs it:

        let data_lake_client = DataLakeClient::new(
            self.account_name.to_owned(),
            self.storage_credentials.to_owned(),
        );

        let file_system_client = data_lake_client.file_system_client(container_name);
        let directory_client = file_system_client.get_directory_client(".");
        let directory_name = "alm";

        let mut page_cnt = 0;
        let mut cnt = 0;
        let mut response = directory_client
            .list_paths()
            .directory(directory_name)
            .recursive(true)
            .max_results(NonZeroU32::new(paging_size).unwrap())
            .into_stream()
            .enumerate();

        loop {
            let page = response.next().await;

            match page {
                Some((_, p)) => match p {
                    Ok(_) => {
                        page_cnt += 1;
                        let paths = p.unwrap().paths;
                        cnt += paths.len();
                        paths
                            .iter()
                            .for_each(|b| println!("[{}/{}]: {}", page_cnt, cnt, b.name));
                    }
                    Err(e) => {
                        println!("{:#?}", e);
                        break;
                    }
                },
                None => {
                    break;
                }
            }
        }