"ayafileio: a truly async file I/O library with native IOCP/io_uring/Dispatch I/O support"

[Patchouli-CN]

I saw your team has removed the aiofiles because of fake-async, so, I have a lib who programmed it, called ayafileio, can resolve this problem, it's real-async on win/macos/linux, using IOCP/io_uring/dispatch_io

# can use this to check backend info.
import ayafileio
info = ayafileio.get_backend_info()
print(f"Running on {info['backend']} — truly async: {info['is_truly_async']}")

benchmark data:

dataset add-write test

74694 item/s ayafileio VS 14672 item/s

how about use it on FileSystemStorageClient?

[Patchouli-CN]

attention:

# ⚡ Performance Tip: Reuse the file handle!
# Do NOT do this ❌
for i in range(1000):
    async with ayafileio.open("file.bin", "rb") as f:
        data = await f.read()

# Do this instead ✅
async with ayafileio.open("file.bin", "rb") as f:
    for i in range(1000):
        # await f.seek(0)
        data = await f.read()

Wrong usage can lead to 70x slower performance!

[janbuchar]

Hello @Patchouli-CN and thanks for the idea. Also, nice job on the library, it's great that someone saw the same problems with aiofiles as we did.

Currently, we are planning to replace FileSystemStorageClient internals with a custom Rust-based library, so adopting ayafileio wouldn't make much sense - see #1833

[Patchouli-CN]

So ga, thanks for quick response, now I know about that.