Rmenziejr/feat async geval 2

[rmenziejr]

Details

• created new method for chain of thought to be async method then swapped that with the sync method in ascore.
• removed reliance on functools cachedproperty due to incompatability with async processes
• created a 'self-managed' cache for both chain of thought methods to store first-run results for reuse

Issues

Resolves #2497

Testing

completed internal testing succesfully no unit tests applicable

Documentation

No change in docs needed

[yaricom]

@rmenziejr Hi!

Thank you for your work on this. We’d prefer not to introduce new dependencies like asyncstdlib into the codebase. Ideally, we should avoid using the @a.cached_property and @cached_property decorators. Instead, let’s store the estimated CoT value in a class field. This approach will allow us to implement caching while keeping the allm_chain_of_thought method asynchronous.

With kind regards,
Iaroslav

[rmenziejr]

Hi @yaricom ! This works for me. I was attempting to replicate the current process as much as possible which required the new packaging, but if we want to refactor the caching process to be a class field instead i can make that update and resubmit!

Thanks for the feedback

[andrescrz]

@rmenziejr

Thank you for your work on this PR! When you have a chance, could you please address the requested changes and submit a new revision? We’ll be happy to review it again once the updates are in. If you have any questions or need clarification, feel free to ask!

[rmenziejr]

Yes I have it on my calendar to tackle this week just been on holiday. Should see something come across today or tomorrow likely

[rmenziejr]

@andrescrz

Hi Andres, new revision is complete. updated the original PR Request to reflect new changes based on feedback.

Thank you!