feat: live-to-bulk migration & new-tip/reorg callbacks & more config fields & fixes

[chris-4chain]

Description of Changes

Provide a brief description of the changes you've made.

Linked Issues / Tickets

Reference any related issues or tickets, e.g. "Closes #123".

Testing Procedure

Describe the tests you've added or any testing steps you've taken.

• I have added new unit tests
• All tests pass locally
• I have tested manually in my local environment

Checklist:

• I have performed a self-review of my own code
• I have made corresponding changes to the documentation
• My changes generate no new warnings
• I have run the linter

[github-actions]

Manual Tests

ℹ️ Remember to ask team members to perform manual tests and to assign tested label after testing.

[Copilot]

Pull request overview

This PR implements live-to-bulk header migration, new tip/reorg event callbacks, additional configuration fields, and various bug fixes for the Chaintracks service.

• Adds a pub/sub event system for broadcasting new chain tip headers and reorganization events to subscribers
• Implements automatic migration of live headers to bulk storage when threshold is exceeded
• Introduces configurable AddLiveRecursionLimit and LiveHeightThreshold parameters to control header synchronization behavior

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated 13 comments.

Show a summary per file

File	Description
pkg/services/chaintracks/models/storage_queries.go	Adds interface methods for querying and deleting live headers by height and IDs
pkg/services/chaintracks/models/reorg_event.go	Defines ReorgEvent model for chain reorganization notifications
pkg/services/chaintracks/internal/pub_sub_events.go	Implements generic pub/sub event system for broadcasting events to multiple subscribers
pkg/services/chaintracks/internal/cacheable_with_ttl.go	Adds Invalidate method to clear cached values on demand
pkg/services/chaintracks/gormstorage/storage_queries.go	Implements database queries for finding and deleting live headers
pkg/services/chaintracks/chaintracks_service.go	Adds live-to-bulk migration logic, reorg/tip event publishing, and uses new config fields
pkg/services/chaintracks/chaintracks_handler.go	Improves error handling by returning 404 for not-found errors
pkg/services/chaintracks/bulk_manager.go	Updates methods to accept liveHeightThreshold parameter and adds MigrateFromLiveHeaders function
pkg/services/chaintracks/bulk_headers_container.go	Changes error handling to return nil instead of error for out-of-bounds header lookups
pkg/defs/chaintracks.go	Adds AddLiveRecursionLimit and LiveHeightThreshold config fields with validation
cmd/chaintracks/main.go	Demonstrates usage of new subscription APIs for tip headers and reorg events

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

[sonarqubecloud]

Quality Gate passed

Issues
4 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud