ZeroFS doesn't cache to S3?

[jfmatth]

Loving this project, thank you.

it's working great but I had a question about caching to S3. does ZeroFS cache writes locally and push them to S3?

I have a pretty good connection to my S3 host, but LARGE (TB+) files do seem to take a while?

thanks

[Barre]

does ZeroFS cache writes locally and push them to S3?

It currently doesn't, it's something that will eventually come but I want to be careful there and going with a solid architecture, so it might take a while.

I have a pretty good connection to my S3 host, but LARGE (TB+) files do seem to take a while?

Please upgrade to the latest version which brings improvements on large writes.

If your workload involves mainly bulk data uploads and few fsyncs, the WAL is pure overhead and you can disable it (see commented out sections in the config file).

[jfmatth]

@Barre Thank you for (an always) quick response.

Given that you don't cache writes, then the local copy is only for reads.? dumb questions, just trying to understand.

My needs are pretty low, just trying to get an understanding.

So far, getting everything working has been easy so thank you for that - Excellent project.

[Barre]

Given that you don't cache writes, then the local copy is only for reads.? dumb questions, just trying to understand.

Yes, the cache is only there for reads. The cache is populated on reads and writes.

So far, getting everything working has been easy so thank you for that - Excellent project.

Thank you!

[jfmatth]

Ill try turning of the WAL and see what it changes. Honestly, I was just copying a large ISO, ill run the same test and see.