Project Author: TwoSetAI
Angelina Yang: Linkedin Mehdi Allahyari: Linkedin Github
YouTube Channel: https://www.youtube.com/@TwoSetAI
Blogpost about this topic: https://open.substack.com/pub/mlnotes/p/storm-ai-agents-for-long-form-writing?r=164sm1&utm_campaign=post&utm_medium=web
Writing a well-structured and organized piece of content is crucial for effectively conveying information to readers. One of the key elements in achieving this is the use of top-down approach for writing, i.e, nailing down the outline before writing a single word. They provide a framework that guides the writer in presenting information in a logical and coherent manner.
In this project, we will explore an agentic system called STORM, which stands for Synthesis of Topic Outlines through Retrieval and Multi-perspective Question Asking.
This method is proposed by Stanford researchers and fully described in this paper "Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Models"
STORM is designed to assist in writing long-form articles by creating topic outlines, discovering diverse perspectives and simulating conversations with topic experts.
STORM can enhance the pre-writing stage, resulting in well-structured and comprehensive articles that rival those found on Wikipedia.
Due to time constraints, we implemented the method with Claude API in this notebook but didn't have time to implement a UI. We leverage the framework to write a test article on the following topic: Building A Powerful LinkedIn Presence. The resulted article can be viewed from the markdown files in this repo.
There are more things we can improve for this project such as using function calls to stablize the output for pipeline uses downstream, refining outputs, refining prompts, roles and agents architecture etc.
We also compared result between OpenAI and Claude. Overall, we like the Claude results better in this specific use case.