Feature Request: Async Text File Read/Write Support

[DannyyyOnGit]

Hello @RLoris!

First off, I would like to apologize for creating an issue for a feature request.
I wanted post it in the questions section as requested but FAB still didn't add that back.

I'm a big fan of your plugins! I'm currently using 3 of your amazing plugins for my saving system:

• Crypto Helper (Encrypt Save Data)
• Serialization Helper (Manage JSON Save Data)
• File Helper (Read/Write Encrypted Save Data from/to File)

There currently doesn't seem to be a way to asynchronously read/write from/to a text file. Save files can get pretty large and since my save files are encrypted and saved as a string into a text file. I'm unable to use Serialization Helper's asynchronous read feature. From my research there don't seem to be any plugins on FAB that support asynchronously reading/writing from/to file either.

Would it be possible to implement non-blocking, asynchronous ways for text file read/write, in the near future?

Thanks again for the great plugins you provide!
~Danny

[RLoris]

Hello there @DannyyyOnGit

Apologies for my late reply, I'm really busy in this period... Forgot to answer you, my bad.
Yes, fab is still missing that, it's ok to post here now.
Thanks for using my plugins and the kind words !

When you say "asynchronously read/write from/to a text file", do you mean reading only blocks into memory to avoid running out of memory or reading/writing blocks over multiple frames with an async node instead of at once ?

Because the first one is way more challenging due to encryption, the second one is "simply" reading/writing file over multiple frames and the entire file content will be in memory. If that is indeed the request, I can implement that into FileHelper, you will be able to provide the block size to load/write content in/from memory per frame and once it's done, it will trigger node delegate, without blocking or freezing the program !

Let me know, and I can look into it !
Cheers

[DannyyyOnGit]

Hello there @DannyyyOnGit

Apologies for my late reply, I'm really busy in this period... Forgot to answer you, my bad. Yes, fab is still missing that, it's ok to post here now. Thanks for using my plugins and the kind words !

When you say "asynchronously read/write from/to a text file", do you mean reading only blocks into memory to avoid running out of memory or reading/writing blocks over multiple frames with an async node instead of at once ?

Because the first one is way more challenging due to encryption, the second one is "simply" reading/writing file over multiple frames and the entire file content will be in memory. If that is indeed the request, I can implement that into FileHelper, you will be able to provide the block size to load/write content in/from memory per frame and once it's done, it will trigger node delegate, without blocking or freezing the program !

Let me know, and I can look into it ! Cheers

Reading/writing text file over multiple frames is basically my request. It would still have the same functionality as the existing Read/Write nodes but it would happen async over multiple frames, preventing the hitch you may experience right now with large text files.

Here is an example of what I mean:

---

The de/encryption seems to be so lighting fast that I personally don't see a reason to turn those async but if you ever feel like updating the amazing Crypto Helper plugin. Making functions async (run over multiple frames), would be very much appreciated!

Here are the functions I'm talking about for that:

Thanks again for your work!
~Danny

[RLoris]

Got it, thanks for the quick response, this is a reasonable ask, I will implement that during a weekend when I have some free time ! I will keep you updated here @DannyyyOnGit

[DannyyyOnGit]

Got it, thanks for the quick response, this is a reasonable ask, I will implement that during a weekend when I have some free time ! I will keep you updated here @DannyyyOnGit

Again, thank you very much for doing this!

Async (non-blocking) functions are a blessing for certain edge-cases, since Players hate hitches or sometimes even straight up freezes during gameplay. Instead of us Devs being forced to implement complicated workarounds. You're essentially saving us a big headache. Feel free to mention me here for testing out the new update. Unfortunately the place I work for is stuck on UE5.5, so I can only provide testing for that version but I assume this will be easy to back-port without being a big hassle.

The CyptoHelper request is more or less just a suggestion and not a must but every bit of effort is much appreciated! You can take your time with any of these in general. We're all busy and overwhelmed with stuff these days. :)