New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Added openai LLM events. #1857
Conversation
Codecov Report
@@ Coverage Diff @@
## main #1857 +/- ##
==========================================
+ Coverage 96.83% 96.85% +0.01%
==========================================
Files 200 206 +6
Lines 39074 39236 +162
==========================================
+ Hits 37839 38001 +162
Misses 1235 1235
Flags with carried forward coverage won't be shown. Click here to find out more.
📣 Codecov offers a browser extension for seamless coverage viewing on GitHub. Try it in Chrome or Firefox today! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me.
let agent | ||
t.beforeEach(() => { | ||
agent = helper.loadMockedAgent() | ||
}) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As you mentioned in our call, defining agent
this way technically makes it non-deterministic as to which instance is used by the subtests. But they run sequentially, so it's fine. But using t.context
would assure the re-used variable is unique per subtest.
Not a blocker for me.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yea this is a pattern all throughout our code. I guess it's a balance between consistency and correctness. Maybe we file some tech debt to remove saving references and relying on subtest context for passing data like this
3422336
to
1cc98f8
Compare
Description
I was able to confirm the data exists on the given request/responses when using a real openai library. I also removed
api_type
as it is not available. also updated CDD for how to get organizationLinks
Closes #1843