feat: migrate traces and artifacts storage to GCP deployed db #28
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
fg-nava
changed the title
fg-nava
commented
Aug 15, 2025
| return mimeTypes[ext] || 'application/octet-stream'; | ||
| } | ||
|
|
||
| private extractIds(fileName: string): { traceId: string | null; threadId: string | null } { |
Collaborator
Author
There was a problem hiding this comment.
Still haven't been able to extract traceId and threadId yet for each artifact written to the table
fg-nava
commented
Aug 15, 2025
| fileType, | ||
| mimeType, | ||
| size: content.length, | ||
| content: Buffer.isBuffer(content) ? content : Buffer.from(content), |
Collaborator
Author
There was a problem hiding this comment.
Still unable to confirm content is safely written to the db
fg-nava
commented
Aug 15, 2025
| const outputDir = path.join(process.cwd(), 'artifacts', sessionId); | ||
|
|
||
| // Start the artifact watcher for this session | ||
| startArtifactWatcher(outputDir, sessionId); |
Collaborator
Author
There was a problem hiding this comment.
Using fs.watch to look for new (expected) or existing (unexpected) files and handles them with artifactStorage.storeArtifact
…icts in web-automation-agent.ts by choosing main branch version
fg-nava
changed the title
KayTV
approved these changes
Aug 19, 2025
Collaborator
KayTV
left a comment
KayTV
left a comment
There was a problem hiding this comment.
I'm approving so we can move forward - I still need to setup mine, but let's get going!
Looks good :)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Ticket
Adds Playwright artifact storage and management capabilities
Changes
PlaywrightArtifactmodel inprisma/schema.prisma; create migrationprisma/migrations/20250814205016_add_playwright_artifacts/migration.sqlwithmastra_artifactstable and indexes.src/mastra/storage-artifacts.tswithArtifactStorageclass for CRUD operations on Playwright artifacts.src/mastra/artifact-watcher.tswithArtifactWatcherclass to monitor output directories and auto-store files with metadata extraction.src/mastra/agents/data-ops-agent.tsto include artifact tools and descriptions; switchsrc/mastra/agents/web-automation-agent.tsmodel from Gemini to Claude.src/mastra/mcp.tsto create unique session-based output directories and start artifact watcher.vertex-ai-credentials.jsonto.gitignore(for future use)Context for reviewers
Implements automatic capture and database storage of Playwright artifacts (screenshots, traces, session data). The watcher monitors output directories in real-time and stores files with extracted trace/thread IDs. Data ops agent can now query and manage these artifacts. Session-based directories prevent file conflicts across concurrent runs.
Test Example
Database viewer showing the PlaywrightArtifa
cts table