-
Notifications
You must be signed in to change notification settings - Fork 4.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
example: add notebook processing reasoning trace from sqlite artifact #2526
Conversation
samples/tools/autogenbench/scenarios/GAIA/Scripts/demystifying-telemetry-sqlite.ipynb
Outdated
Show resolved
Hide resolved
samples/tools/autogenbench/scenarios/GAIA/Scripts/demystifying-telemetry-sqlite.ipynb
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This file currently lives inside GAIA, maybe move it to WebArena or Autogenbench?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
moved to webarena/
"\n", | ||
"final = merged_and_nested\n", | ||
"\n", | ||
"cookies_events = [event for event in final if event[\"event_name\"] == \"oookies\"]\n", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm getting KeyError: 'event_name' from this line
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
fixed thanks
"# Brief explanation\n", | ||
"\n", | ||
"The logs collected by scenario.py in https://github.com/microsoft/autogen/blob/ct_webarena/samples/tools/autogenbench/scenarios/WebArena/Templates/TwoAgents/scenario.py#L50\n", | ||
"\n", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
not sure if this line is out of date, line 50 of scenario.py is pointing to the task not log_event? Maybe just remove the link?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
outdated, yes
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. I was able to get the notebook up and running in WSL2, without any issues (beyond changing the log path).
Why are these changes needed?
The goal of this notebook is to generate this type of UI [currently work in progress] - emphasis on the next/back buttons:
currentui:
current version:
To explore traces with the relevant screenshots obtained from the sqlite artifact generated by autogen runs.
Related issue number
Checks