Skip to content

feat(etl): emit info line per indexed entity-manager row#329

Merged
raymondjacobson merged 1 commit into
mainfrom
etl-entity-manager-indexed-log
Jun 1, 2026
Merged

feat(etl): emit info line per indexed entity-manager row#329
raymondjacobson merged 1 commit into
mainfrom
etl-entity-manager-indexed-log

Conversation

@raymondjacobson
Copy link
Copy Markdown
Contributor

Summary

  • The entity-manager success path in pkg/etl/indexer.go logged at Debug with only type/hash/elapsed, so in production (Info level) there was no per-row signal that an EM transaction indexed successfully.
  • Promote it to an Info line "entity manager indexed" carrying entity_type, action, entity_id, user_id, and block, mirroring the field set of the existing "entity manager validation rejected" (Warn) and "entity manager dispatch error" (Error) logs.
  • A single grep on hash or entity_id now shows the full lifecycle — indexed vs rejected vs errored — of every entity-manager transaction.

Motivation

During the Python → ETL cutover we had no way to confirm from logs that individual EM rows were landing; the only visible signals were failures. This closes that gap so success is observable at the same granularity as failure.

Test plan

  • go build ./... in pkg/etl
  • go vet ./... in pkg/etl
  • Confirm the entity manager indexed line appears at Info in a deployed indexer once released

🤖 Generated with Claude Code

The entity-manager success path logged at Debug with only type/hash/
elapsed, so in production there was no per-row signal that an EM tx
indexed successfully. Promote it to an Info line carrying entity_type,
action, entity_id, user_id, and block, mirroring the field set of the
existing "validation rejected" and "dispatch error" logs. A single grep
on hash or entity_id now shows the full lifecycle (indexed vs rejected
vs errored) of every entity-manager transaction.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@raymondjacobson raymondjacobson changed the title log(etl): emit info line per indexed entity-manager row feat(etl): emit info line per indexed entity-manager row Jun 1, 2026
@raymondjacobson raymondjacobson merged commit f6b56f1 into main Jun 1, 2026
5 of 6 checks passed
@raymondjacobson raymondjacobson deleted the etl-entity-manager-indexed-log branch June 1, 2026 20:08
raymondjacobson added a commit to AudiusProject/api that referenced this pull request Jun 1, 2026
## Summary
Bumps the `go-openaudio` and `go-openaudio/pkg/etl` dependencies from
`4d1c9dfdfb52` to `f6b56f1a737e`, pulling in
[go-openaudio#329](OpenAudio/go-openaudio#329).

That change promotes the entity-manager success path in the ETL indexer
from a **Debug** `"tx indexed"` line (invisible in prod, no entity
fields) to an **Info** `"entity manager indexed"` line carrying
`entity_type`, `action`, `entity_id`, `user_id`, and `block`. It mirrors
the field set of the existing `"entity manager validation rejected"` and
`"entity manager dispatch error"` logs, so a single grep on
`hash`/`entity_id` shows the full lifecycle of every EM transaction.

This is the api-side bump needed to actually capture those logs in the
running ETL indexer.

## Changes
- `go.mod` / `go.sum`: both go-openaudio modules →
`v1.3.1-0.20260601200759-f6b56f1a737e`

## Test plan
- [x] `go mod tidy` stable (pins hold)
- [x] `go build ./...`
- [ ] After deploy, confirm `entity manager indexed` Info lines appear
in the indexer logs

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant