Skip to content

neural-maze/agentic_patterns

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

50 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

logo

Agentic Patterns

Implementing the agentic patterns using Groq

logo

No LangChain, no LangGraph, no LlamaIndex, no CrewAI. Pure and simple API calls to Groq.

Table of Contents

Introduction

This repository contains an implementation of the 4 agentic patterns as defined by Andrew Ng in his DeepLearning.AI blog article series.

Here’s a description of the four patterns we will be implementing.

The 4 Agentic patterns

Reflection Pattern πŸ€”

logo

A very basic pattern but, despite its simplicity, it provides surprising performance gains for the LLM response.

It allows the LLM to reflect on its results, suggesting modifications, additions, improvements in the writing style, etc.

Want to see how this pattern is implemented? πŸ’»

Take a look at the YouTube video! πŸ‘‡


Tool Pattern πŸ› 

logo

The information stored in the LLM weights is (usually) not enough to give accurate and insightful answers to our questions

That's why we need to provide the LLM with ways to access the outside world 🌍

In practice, you can build tools for whatever you want (at the end of the day they are just functions the LLM can use), from a tool that let's you access Wikipedia, another to analyse the content of YouTube videos or calculate difficult integrals in Wolfram Alpha.

Tools are the secret sauce of agentic applications and the possibilities are endless! πŸ₯«

Want to see how this pattern is implemented? πŸ’»

  • Check the notebook for a step by step explanation
  • Check the ToolAgent for a complete Python implementation
  • Check the Tool for understanding how Tools work under the hood.

Take a look at the YouTube video! πŸ‘‡


Planning Pattern 🧠

logo

So, we've seen agents capable of reflecting and using tools to access the outside world. But ... what about planning, i.e. deciding what sequence of steps to follow to accomplish a large task?

That is exactly what the Planning Pattern provides; ways for the LLM to break a task into smaller, more easily accomplished subgoals without losing track of the end goal.

The most paradigmatic example of the planning pattern is the ReAct technique, displayed in the diagram above.

Want to see how this pattern is implemented? πŸ’»

  • Check the notebook for a step by step explanation
  • Check the ReactAgent for a complete Python implementation

Take a look at the YouTube video! πŸ‘‡


Multiagent Pattern πŸ§‘πŸ½β€πŸ€β€πŸ§‘πŸ»

logo

You may have heard about frameworks like crewAI or AutoGen, which allow you to create multi-agent applications.

These frameworks implement different variations of the multi-agent pattern, in which tasks are divided into smaller subtasks executed by different roles (e.g. one agent can be a software engineer, another a project manager, etc.)

Want to see how this pattern is implemented? πŸ’»

  • Check the notebook for a step by step explanation
  • Check the Agent to see how to implement an Agent, member of the Crew.
  • Check the Crew to see how to implement the Crew

Take a look at the YouTube video! πŸ‘‡


Installation

If you take a look at any of the notebooks in the notebooks/ folder you'll see some helper methods and classes being imported from this library: agentic-patterns.

This is the library implemented in the src/ folder, and contains a full implementation of the 4 patterns and related helper methods.

To install this library, you have two options.

Option 1: Use Poetry:

poetry install

Option 2: Install the PyPi library

pip install -U agentic-patterns

Groq API Key

This project works with Groq as the LLM provider, so you'll need to create an API Key in this platform.

When you have your API Key copy and paste it in an .env file.

The content of this .env file should match the structure of the .env.example I've created in the repo, but instead of an empty string, the GROQ_API_KEY var will contain your API Key.


Usage

Once you have both library installed and the .env file created, you can start playing with the 4 patterns implementation (I'll encourage you to take a look at the code, to fully understand what is happening under the hood).

Let's see an example of how to put the 4 patterns into practise.


Using a Reflection Agent - Reflection Pattern

Here is an example of how to use a Reflection Agent.

from agentic_patterns import ReflectionAgent

agent = ReflectionAgent()

generation_system_prompt = "You are a Python programmer tasked with generating high quality Python code"

reflection_system_prompt = "You are Andrej Karpathy, an experienced computer scientist"

user_msg = "Generate a Python implementation of the Merge Sort algorithm"


final_response = agent.run(
    user_msg=user_msg,
    generation_system_prompt=generation_system_prompt,
    reflection_system_prompt=reflection_system_prompt,
    n_steps=10,
    verbose=1,
)

print(final_response)

Creating and Using Tools - Tool Use Pattern

An example of how to create a custom tool and bind it to a Tool Agent.

First, let's create the tool. In this case, I'll be creating a tool for interacting with Hacker News. To define a tool, we just need to decorate the Python function with the @tooldecorator.

import json
import requests
from agentic_patterns.tool_pattern.tool import tool
from agentic_patterns.tool_pattern.tool_agent import ToolAgent

@tool
def fetch_top_hacker_news_stories(top_n: int):
    """
    Fetch the top stories from Hacker News.

    This function retrieves the top `top_n` stories from Hacker News using the Hacker News API.
    Each story contains the title, URL, score, author, and time of submission. The data is fetched
    from the official Firebase Hacker News API, which returns story details in JSON format.

    Args:
        top_n (int): The number of top stories to retrieve.
    """
    top_stories_url = 'https://hacker-news.firebaseio.com/v0/topstories.json'

    try:
        response = requests.get(top_stories_url)
        response.raise_for_status()  # Check for HTTP errors

        # Get the top story IDs
        top_story_ids = response.json()[:top_n]

        top_stories = []

        # For each story ID, fetch the story details
        for story_id in top_story_ids:
            story_url = f'https://hacker-news.firebaseio.com/v0/item/{story_id}.json'
            story_response = requests.get(story_url)
            story_response.raise_for_status()  # Check for HTTP errors
            story_data = story_response.json()

            # Append the story title and URL (or other relevant info) to the list
            top_stories.append({
                'title': story_data.get('title', 'No title'),
                'url': story_data.get('url', 'No URL available'),
            })

        return json.dumps(top_stories)

    except requests.exceptions.RequestException as e:
        print(f"An error occurred: {e}")
        return []

Next, let's define the Agent.

tool_agent = ToolAgent(tools=[fetch_top_hacker_news_stories])

output = tool_agent.run(user_msg="Tell me the top 5 Hacker News stories right now")

print(output)

Reasoning with a ReAct Agent - Planning Pattern

As a paradigmatic example of the Planning Pattern, agentic-patterns offers an implementation of a ReAct Agent.

The ReactAgent is an evolution of the ToolAgent, extending its planning and reasoning capabilities.

As we did before, we'll begin by defining the tools. In this case, I'll create three.

@tool
def sum_two_elements(a: int, b: int) -> int:
    """
    Computes the sum of two integers.

    Args:
        a (int): The first integer to be summed.
        b (int): The second integer to be summed.

    Returns:
        int: The sum of `a` and `b`.
    """
    return a + b


@tool
def multiply_two_elements(a: int, b: int) -> int:
    """
    Multiplies two integers.

    Args:
        a (int): The first integer to multiply.
        b (int): The second integer to multiply.

    Returns:
        int: The product of `a` and `b`.
    """
    return a * b

@tool
def compute_log(x: int) -> float | str:
    """
    Computes the logarithm of an integer `x` with an optional base.

    Args:
        x (int): The integer value for which the logarithm is computed. Must be greater than 0.

    Returns:
        float: The logarithm of `x` to the specified `base`.
    """
    if x <= 0:
        return "Logarithm is undefined for values less than or equal to 0."

    return math.log(x)

Now, let's create the agent.

from agentic_patterns.planning_pattern.react_agent import ReactAgent

agent = ReactAgent(tools=[sum_two_elements, multiply_two_elements, compute_log])

agent.run(user_msg="I want to calculate the sum of 1234 and 5678 and multiply the result by 5. Then, I want to take the logarithm of this result")

Defining and running a Crew of Agents - MultiAgent Pattern

For the Multiagent Pattern, I decided to use two CrewAI's abstractions: the Agent and the Crew.

Additionally, I've also borrow some ideas from Airflow, defining the dependency between agents using the >> operator.

Let's see an example:

from agentic_patterns.multiagent_pattern.crew import Crew


with Crew() as crew:
    agent_1 = Agent(
        name="Poet Agent",
        backstory="You are a well-known poet, who enjoys creating high quality poetry.",
        task_description="Write a poem about the meaning of life",
        task_expected_output="Just output the poem, without any title or introductory sentences",
    )

    agent_2 = Agent(
        name="Poem Translator Agent",
        backstory="You are an expert translator especially skilled in Spanish",
        task_description="Translate a poem into Spanish",
        task_expected_output="Just output the translated poem and nothing else"
    )

    agent_3 = Agent(
        name="Writer Agent",
        backstory="You are an expert transcriber, that loves writing poems into txt files",
        task_description="You'll receive a Spanish poem in your context. You need to write the poem into './poem.txt' file",
        task_expected_output="A txt file containing the greek poem received from the context",
        tools=write_str_to_txt,
    )

    agent_1 >> agent_2 >> agent_3

We can also plot the Crew, to see the DAG structure, like this:

crew.plot()

For the previous Crew, you should get something like this:

alt text

To run the Crew, simply run:

crew.run()

Recommended Workflow

This is an educational project and not an agentic framework.

The reason I've decided to implement the 4 Agentic Patterns from scratch was to deeply understand their basics and also to teach them to anyone interested.

Given this, this is my recommended learning workflow:

1️⃣ Start with the YouTube video, ideally following my explanations with your own Jupyter Notebook.

2️⃣ Play with the code in the Jupyter Notebook: make changes, modify the prompts, create new examples etc. Get comfortable with the pattern fundamentals and basic concepts.

3️⃣ (Optional) Read through the library implementation of each pattern. This will require more effort and more Python knowledge, but if you take the time, I can assure you you'll benefit a lot from it.

flowchart TD;
    Video --> Notebook;
    Notebook --> Code
    classDef centered text-align:center;
Loading

Star History

Star History Chart