Add runtime config options for list_files_cache_limit and list_files_cache_ttl

[delamarch3]

Which issue does this PR close?

• Closes Add a way to dynamically configure / update the ListFilesCache settings via RuntimeConfiguration #19056

Rationale for this change

Make the list file cache memory limit and TTL configurable via runtime config.

What changes are included in this PR?

• Add ability to SET and RESET list_files_cache_limit and list_files_cache_ttl
• list_files_cache_ttl will expect the duration to look like either 1m30s or 30 (I'm wondering if it would be simpler for it to just accept a single unit?)
• Add update_cache_ttl() to the ListFilesCache trait so we can update it from RuntimeEnvBuilder::build()
• Add config entries

Are these changes tested?

Yes

Are there any user-facing changes?

update_cache_ttl() has been added to the ListFilesCache trait

[delamarch3]

The values for these will not update after running SET, unless the runtime has been configured with a ListFilesCache (it's None by default, so there is nothing to update)

[delamarch3]

Hi @BlakeOrth @alamb, this is ready for review

[BlakeOrth]

This overall looks very nice to me, thanks! Perhaps I'm missing it, but is there anyway to set the TTL back to infinity (None) after it's been set to Some(Duration)?

[BlakeOrth]

Should this method error if the input duration evaluates to 0s?

[delamarch3]

Yeah that would make sense eaff9b5

[delamarch3]

@BlakeOrth Yep, you can run reset datafusion.runtime.list_files_cache_ttl to set it back to None

[BlakeOrth]

My approval doesn't have any real power here, but this all looks good to me. The CI failure seems like it's probably unrelated. I can't imagine this work having any effect on benchmarks.

[alamb]

Thanks @delamarch3 and @BlakeOrth -- I'll try and check this out soon