[UNIT] Bonus Unit 2 - Agent Observability and Evaluation

[jannikmaierhoefer]

[WIP] Adding the bonus unit 2 on agent observability and evaluation.

cc @davidberenstein1957

[davidberenstein1957]

Looking good! I've got some remarks but the base is solid.

I think this page can benefit from some photos/images of traces/spans. Perhaps we can show a typical span/trace SVG/HTML?

I think there might be some best practices to focus on when implementing the observability of agents. Similarly, what are ways to deal with errors/mistakes?

Are costs too high? > Reduce tokens, cheaper models etc.

Not sure if it applies to everything, but perhaps we can inspire them by providing them with some directions?

Also, would you be able to forward me a directory with images I could upload here: https://huggingface.co/datasets/agents-course/course-images/tree/main/en/unit2. And use the URL reference for images to the images in that dataset?

[burtenshaw]

Hey!

Thanks @jannikmaierhoefer and @davidberenstein1957 for amazing work on this. Let's release on Tuesday 25th. I'll merge on Monday to be sure it passes through CI in time.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.