AutoGen cache using Azure Cosmos DB

[wmwxwa]

Why are these changes needed?

Related issue number

Checks

• I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
• I've added tests (if relevant) corresponding to the changes introduced in this PR.
• I've made sure all auto checks have passed.

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 74.07407% with 21 lines in your changes are missing coverage. Please review.

Project coverage is 33.84%. Comparing base (ded2d61) to head (dd6b1ac).
Report is 6 commits behind head on main.

Files	Patch %	Lines
autogen/cache/cache_factory.py	40.00%	12 Missing ⚠️
autogen/cache/cosmos_db_cache.py	85.41%	6 Missing and 1 partial ⚠️
autogen/cache/cache.py	84.61%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2327      +/-   ##
==========================================
+ Coverage   33.33%   33.84%   +0.50%     
==========================================
  Files          83       82       -1     
  Lines        8636     8787     +151     
  Branches     1835     1863      +28     
==========================================
+ Hits         2879     2974      +95     
- Misses       5516     5563      +47     
- Partials      241      250       +9     

Flag	Coverage Δ
unittests	33.84% <74.07%> (+0.50%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[cheng-tan]

Thank you for the PR.

• Can you add some unit test for this change?
• Also is it possible to add examples for how to use cosmos logger and how to use cosmos db cache in this logging notebook? https://github.com/microsoft/autogen/blob/main/notebook/agentchat_logging.ipynb

[ekzhu]

For using cosmos db cache, we can add to https://github.com/microsoft/autogen/blob/6d2c923424991c95cc9326e76c695d2f4721632e/website/docs/topics/llm-caching.md

[sonichi]

Could you fix https://github.com/microsoft/autogen/actions/runs/8653772822/job/23729679030?pr=2327 ?
You can use pre-commit to help.

[ekzhu]

Thanks for this effort! @wmwxwa We also want to add Cosmos DB to our ecosystem page: https://microsoft.github.io/autogen/docs/ecosystem. It is located in website/docs/ecosystem.

BTW, our vector database module is ready:

autogen/autogen/agentchat/contrib/vectordb/base.py

Line 31 in 689950e

class VectorDB(Protocol):

You can take a look and see if it is easy to add Cosmos DB as a vector database implementation.

[wmwxwa]

Thank you for the PR.

• Can you add some unit test for this change?
• Also is it possible to add examples for how to use cosmos logger and how to use cosmos db cache in this logging notebook? https://github.com/microsoft/autogen/blob/main/notebook/agentchat_logging.ipynb

Is there another notebook on caching?

[ekzhu]

Thanks!

Also is it possible to add examples for how to use cosmos logger and how to use cosmos db cache in this logging notebook? https://github.com/microsoft/autogen/blob/main/notebook/agentchat_logging.ipynb

Is there another notebook on caching?

The documentation is in llm_cache.md.

[sonichi]

This PR is merged prematurely without running openai test. The test failure is under fix by #2490