[WIP] Start implementation of Copilot instructions

[Copilot]

Implementation Plan: Safety and Error Handling Improvements

• Make Notion property access safe using .get() instead of direct access
• Add retry/backoff logic for external API calls (OpenAI, Notion)
• Clamp model outputs (priority 1-5, confidence 0-1)
• Set default confidence values when missing
• Improve error reporting with context
• Sanitize strings before using them in API calls
• Add validation for missing properties before updates
• Test changes with existing classifier evaluation
• Run code review and security checks

Original prompt

Start implementation

The user has attached the following file paths as relevant context:

• .github/copilot-instructions.md

[Chronological Review: The conversation began with the user requesting an analysis of the codebase to generate or update `.github/copilot-instructions.md`. The focus was on understanding the architecture, developer workflows, project-specific conventions, and integration points. The user then requested to fix errors in the `classify_and_route.py` file, followed by a request to make Notion property access safe and implement various changes to improve error handling and data validation. The user indicated the start of implementation and requested to include changes related to delegating to a background agent.]

[Intent Mapping:

1. "Analyze this codebase to generate or update .github/copilot-instructions.md" - User wants to create documentation for AI coding agents.
2. "Please fix the errors in the classify file" - User requests error resolution in the specified Python file.
3. "Make Notion property access safe" - User wants to implement safer property access methods in the code.
4. "Start implementation" - User indicates readiness to begin coding changes.
5. "Include Changes: 'Delegate to Background Agent'" - User requests to incorporate specific changes related to background processing.]

[Technical Inventory:

• Python: The primary programming language used in the codebase.
• Notion API: Integration for accessing and updating Notion properties.
• OpenAI API: Used for external calls related to AI processing.
• Error handling patterns: Specific strategies for managing errors and data validation in the codebase.]

[Code Archaeology:

• File: /Users/matthewbernal/ContentOps/social-listening/scripts/classify_and_route.py
• Recent changes discussed include making property access safe, clamping model outputs, setting default confidence values, robust title property lookup, retry/backoff for external calls, better error reporting, respecting missing properties in updates, sanitizing strings, and optional rate-limiting.]

[Progress Assessment:

• Completed Tasks: User has outlined specific changes to be made to the classify_and_route.py file.
• Partially Complete Work: Implementation of the outlined changes is in progress.
• Validated Outcomes: No specific outcomes have been validated yet as the implementation has not been completed.]

[Context Validation: All critical information for continuation is captured, including specific changes to be made and the user's intent to improve the codebase.]

[Recent Commands Analysis:

• Last Agent Commands: User requested to "Start implementation" and "Include Changes: 'Delegate to Background Agent'".
• Tool Results Summary: No specific tool results were returned as the commands were focused on initiating implementation and including changes.
• Pre-Summary State: The agent was actively preparing to implement the requested changes in the classify_and_route.py file when the token budget was exceeded.
• Operation Context: These commands were executed to align the code with user goals of improving error handling and property access in the codebase.]

1. Conversation Overview: - Primary Objectives: - "Analyze this codebase to generate or update `.github/copilot-instructions.md`" - User aims to create documentation for AI agents. - "Please fix the errors in the classify file" - User seeks to resolve errors in the Python file. - "Make Notion property access safe" - User wants to enhance property access methods. - "Start implementation" - User indicates readiness to begin coding. - "Include Changes: 'Delegate to Background Agent'" - User requests specific changes related to background processing. - Session Context: The conversation has transitioned from analysis and error fixing to implementing specific changes in the codebase. - User Intent Evolution: The user has moved from seeking documentation to actively implementing changes in the code.

2. Technical Foundation:

• Python: The primary language for the codebase.
• Notion API: Used for property access and updates.
• OpenAI API: Integrated for AI processing tasks.

3. Codebase Status:

• File Name: classify_and_route.py
• Purpose: Handles classification and routing logic for social listening.
• Current State: User has outlined changes to improve error handling and property access.
• Key Code Segments: Specific changes include using props.get() for safe property access and implementing retry logic for API calls.
• Dependencies: Relies on Notion and OpenAI APIs for functionality.

4. Problem Resolution:

• Issues Encountered: Errors in property access and handling API responses.
• Solutions Implemented: User has proposed changes to improve error handling and data validation.
• Debugging Context: Ongoing efforts to enhance robustness and error reporting.
• Lessons Learned: Importance of safe property access and error handling in API integrations.

5. Prog...

Created from VS Code.

---

💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

[LetsVenture2021]

Copilot's advice

[LetsVenture2021]

@copilot # First, backup the current file
cp scripts/generate_content_draft.py scripts/generate_content_draft.py.backup

Now delete the current one

rm scripts/generate_content_draft.py