Managed roll out of filesystem caching support

[mosabua]

We are trying to complete the Alluxio caching support roll out now that Trino 438 is out. Following is the proposed sequence of tasks with status and mention of contributors and others helping.

Initial discussion also happened in https://trinodb.slack.com/archives/CP1MUNEUX/p1706892319598769

Tasks

Beta Give feedback

1. Initial merge of support for Delta Lake Alluxio cache #18719
2. Merge of docs for Delta Lake Add docs for filesystem caching #20300 in progress with @mosabua
3. Create and merge PR to support Iceberg , in progress with @amoghmargoor Extend Alluxio support to Iceberg connector #20602
4. Docs PR for Iceberg, ready to go at Add docs for fs caching with Iceberg #20599
5. Create PR to support Hive, Support embedded alluxio cache in hive #20658
6. Docs PR for Hive, ready to go at Add docs for fs caching with Hive #20600
7. Merge PR for Rubix removal Remove Rubix caching #20102 from @wendigo
8. Create PR to support Hudi - @yihua and @codope
9. Docs PR for Hudi, ready to go at Add docs for fs caching with Hudi #20601
10. Cut 439 release - under control with @martint @mosabua and @colebow
11. Blog about the whole effort (@mosabua) Add blog post about cache support collab trino.io#615
12. Add tracing to the Alluxio caching - Migrate Alluxio cache tests to tracing #20557 @wendigo
13. Remove TrackingFileSystemFactory usage #20610
    cla-signed delta-lake iceberg tests:hive +4
14. Lead discussion about preferred hosts @mosabua

[wendigo]

I'm looking into adding tracing to Alluxio caching

[mosabua]

Started thread to continue the discussion around preferred hosts at https://trinodb.slack.com/archives/CP1MUNEUX/p1707517245306449

[mosabua]

Potentially update deps with #20685

[TinoSM]

AS a very random comment (please ignore if doesnt apply), do not forget to include the dependencies as part of helm chart (if that's planned https://artifacthub.io/packages/helm/trino/trino), tried to add the feature to my system (Delta/Hive connectors) and got

Caused by: java.lang.ClassNotFoundException: io.trino.hdfs.TrinoFileSystemCache$FileSystemKey

Nevermind it got fixed by updating Trino version manually instead of using the chart's default version (I expected chart and trino to be up-to-date, but it seems versions are not linked 1:1).

[mosabua]

@TinoSM .. the feature is part of the docker container so automatically also part of the Helm chart. Please provide more info on what you did in a separate ticket ..

[mosabua]

Blog post went live a while ago - here is the link https://trino.io/blog/2024/03/08/cache-refresh

Also https://www.linkedin.com/feed/update/urn:li:activity:7171977291483299840

[akenO8]

Caused by: java.lang.ClassNotFoundException: io.trino.hdfs.TrinoFileSystemCache$FileSystemKey

After I upgraded to 445, booting reported this error.

[mosabua]

Caused by: java.lang.ClassNotFoundException: io.trino.hdfs.TrinoFileSystemCache$FileSystemKey

After I upgraded to 445, booting reported this error.

Please file a separate issue with details. This is not something that should happen at all .. unless yoy have a modified fork

[akenO8]

Caused by: java.lang.ClassNotFoundException: io.trino.hdfs.TrinoFileSystemCache$FileSystemKey

After I upgraded to 445, booting reported this error.

Sorry, This is an error printed when the startup of the trino-server fails due to other bugs. #21669
Please ignore it.