Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

azure-ai evaluate() shows get_host_creds warning #34006

Open
pamelafox opened this issue Jan 25, 2024 · 2 comments
Open

azure-ai evaluate() shows get_host_creds warning #34006

pamelafox opened this issue Jan 25, 2024 · 2 comments
Labels
AI Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team.

Comments

@pamelafox
Copy link
Member

  • Package Name: azure-ai-generative
  • Package Version: 1.0.0b2
  • Operating System: Mac M1
  • Python Version: 3.11

Describe the bug

When calling evaluate(), we see this in the log:

Fail writing properties '{'_azureml.evaluation_run': 'azure-ai-generative-parent'}' to run history: 'FileStore' object has no attribute 'get_host_creds'

This does not affect the success of the evaluate() call, but leads developers to think there's an error in their code. (I have had multiple reports from devs using ai-rag-chat-evaluator about it).

To Reproduce

Steps to reproduce the behavior:

  1. Checkout https://github.com/Azure-Samples/ai-rag-chat-evaluator/
  2. Run python3 -m scripts evaluate --config=example_config.json

Expected behavior

No spurious warnings
@pamelafox pamelafox mentioned this issue Jan 25, 2024
Closed
@github-actions github-actions bot added customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-triage This is a new issue that needs to be triaged to the appropriate team. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels Jan 25, 2024
@kristapratico kristapratico added Service Attention This issue is responsible by Azure service team. Client This issue points to a problem in the data-plane of the library. AI and removed needs-triage This is a new issue that needs to be triaged to the appropriate team. labels Jan 25, 2024
@kristapratico
Copy link
Member

Tagging @luigiw @needuv @paulshealy1 @singankit to take a look

@github-actions github-actions bot added the needs-team-attention This issue needs attention from Azure service team or SDK team label Jan 25, 2024
@pamelafox
Copy link
Member Author

This is still an issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
AI Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@pamelafox @kristapratico