Sinking Yachts realtime feed

[jaspermayone]

https://phish.sinking.yachts/docs

[jaspermayone]

So the timestamp would be interesting for you, right? I actually would recommend SinkingYachts Phishing Domain API for the purpose you described:

• You can use GET /v2/all to get a list of all domains once
• Afterwards you can either
  • use the WebSocket API to receive updates to the database instantly or
  • continue using the REST API and fetch GET /v2/recent/{dt} e. g. every 10 minutes ({dt} should be set to a time greater than the time since the last fetch)

You need to set the X-Identity header to identify yourself, but that's it

[jaspermayone]

@claude implement this please

[claude]

Claude finished @jaspermayone's task —— View job • claude/issue-64-20250720-1549 • Create PR ➔

---

I'll implement the Sinking Yachts realtime feed integration. Let me analyze the requirements and current codebase.

Todo List

• Read the provided image for context
• Examine repository structure and CLAUDE.md files
• Understand current project architecture
• Implement WebSocket connection for real-time feed
• Add REST API methods for bulk/recent data
• Integrate feed data into database
• Add background service for continuous monitoring
• Add admin management endpoints
• Test the implementation
• Run linting/testing
• Commit and push changes

Implementation Complete! 🎉

Successfully implemented the SinkingYachts realtime feed integration with the following features:

Enhanced SinkingYahtsService (src/services/SinkingYahts.ts)

• WebSocket Integration: Real-time feed at wss://phish.sinking.yachts/feed
• Bulk Data Import: /v2/all endpoint for initial data loading
• Incremental Updates: /v2/recent/{dt} for catching up on missed data
• Automatic Reconnection: Exponential backoff with configurable retry limits
• Database Integration: Stores all feed data in existing schema

Admin Management Endpoints (src/admin-routes/routes/sinking-yachts.ts)

• POST /admin/sinking-yachts/start-feed - Start monitoring with optional bulk import skip
• POST /admin/sinking-yachts/stop-feed - Stop real-time monitoring
• POST /admin/sinking-yachts/bulk-import - Manual bulk import trigger
• GET /admin/sinking-yachts/recent?since=ISO_DATE - Fetch recent domains

Auto-Start Configuration (src/index.ts)

• Automatically starts feed monitoring on server startup
• Environment variables:
  • ENABLE_SINKING_YACHTS_FEED=false - Disable auto-start
  • SKIP_BULK_IMPORT=true - Skip initial bulk import

Package Dependencies

• Added ws@^8.18.0 and @types/ws@^8.5.13 for WebSocket support

The implementation handles domain additions, removals, and updates in real-time, automatically updating the database and maintaining data consistency with proper error handling and logging.