Inbox relay not respecting filters on subscription

[tyiu]

The inbox relay implementation is not respecting filters on subscriptions.

Notice that nak has detected that filter does not match. The filter was requesting for all kind 1 events with a specific q tag, and none of the returned notes have that q tag. Instead, it gave me notes that have that q-tag id value in the e tag, which is incorrect.

./nak-v0.14.2-darwin-amd64 req -k 1 -t q=be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f -l 10 wss://nostr-relay.tyiu.xyz/inbox            
connecting to wss://nostr-relay.tyiu.xyz/inbox... ok.
[nl][info] 2025/06/03 20:32:27 {wss://nostr-relay.tyiu.xyz/inbox} filter does not match: {"kinds":[1],"limit":10,"#q":["be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f"]} ~ {"kind":1,"id":"31bb804a10a73f65494440062d4051f6a52a2e4c6d747abe145f99fc7a1cdbb1","pubkey":"6e75f7972397ca3295e0f4ca0fbc6eb9cc79be85bafdd56bd378220ca8eee74e","created_at":1748986768,"tags":[["e","be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f","wss://Nostr21.Com","root"],["e","ef2e0b5a776022348633f2f4602c11907ea184278a901e93fae31d446b3cdb68","wss://relay.primal.net/","reply","17e2889fba01021d048a13fd0ba108ad31c38326295460c21e69c43fa8fbe515"],["p","2779f3d9f42c7dee17f0e6bcdcf89a8f9d592d19e3b1bbd27ef1cffd1a7f98d1"],["p","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"],["p","c7acabf1fed201a53185e4dc5e0c6bae2bc5db19d73abf840535f305d8f05180"],["p","17e2889fba01021d048a13fd0ba108ad31c38326295460c21e69c43fa8fbe515"]],"content":"localhost is probably the nostr-tray relay","sig":"e6a7f1feebe20b04b165a7fe26fcbcdd3cdcfc0f9187ef99434cbdcb76ea423a0b588e935f1a16d563b05a2ab000b2ade4b17bd36342e7ab79bba5c951305d38"}
[nl][info] 2025/06/03 20:32:27 {wss://nostr-relay.tyiu.xyz/inbox} filter does not match: {"kinds":[1],"limit":10,"#q":["be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f"]} ~ {"kind":1,"id":"2b7b2ec35cf094f48fc983933041072084466805600669f9b47754c790d35d3c","pubkey":"6e75f7972397ca3295e0f4ca0fbc6eb9cc79be85bafdd56bd378220ca8eee74e","created_at":1748986714,"tags":[["e","be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f","wss://relay.snort.social/","root","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"],["e","be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f","wss://relay.snort.social/","reply","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"],["p","2779f3d9f42c7dee17f0e6bcdcf89a8f9d592d19e3b1bbd27ef1cffd1a7f98d1"],["p","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"]],"content":"keep it up Ser and thanks for everything you do.","sig":"36780bc85fcbcbc2cb3c384472e4dfaea4b36d56b7b0c2560a385999fb4c18deea7f12ddad1f10f43a149d0ab30dfc072dddebbbd15636851f27d3df8d813d32"}
[nl][info] 2025/06/03 20:32:27 {wss://nostr-relay.tyiu.xyz/inbox} filter does not match: {"kinds":[1],"limit":10,"#q":["be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f"]} ~ {"kind":1,"id":"ef2e0b5a776022348633f2f4602c11907ea184278a901e93fae31d446b3cdb68","pubkey":"17e2889fba01021d048a13fd0ba108ad31c38326295460c21e69c43fa8fbe515","created_at":1748978438,"tags":[["e","be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f","wss://Nostr21.Com","root"],["e","0e845060e95216ae5e29de7d951a8b84873455d2a160deb2e5e8555b235c73cb","wss://Nostr21.Com","reply"],["p","2779f3d9f42c7dee17f0e6bcdcf89a8f9d592d19e3b1bbd27ef1cffd1a7f98d1"],["p","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"],["p","c7acabf1fed201a53185e4dc5e0c6bae2bc5db19d73abf840535f305d8f05180"],["r","wss://nos.lol/"],["r","wss://relay.angor.io/"],["r","wss://relay.damus.io/"],["r","wss://relay.primal.net/"]],"content":"You have 11 relays defined, one of them is localhost. When I reply to you or send a DM, you expect \"me\" to publish that to all your 10 public available relays?\n\nThere is also an following list with 34 relays that you have published.\n\nWhere should I publish my events for your to see them? Randomly pick perhaps 3 of the 10 relays?","sig":"c9032b44e37774303a7236b83d5bbccf277dca069aacb87ad2f800f500a5272d6f6403b15f616bad8aaec361f3cbe8fbe59aaad9e2e6dd9902661a82f0c660ff"}
[nl][info] 2025/06/03 20:32:27 {wss://nostr-relay.tyiu.xyz/inbox} filter does not match: {"kinds":[1],"limit":10,"#q":["be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f"]} ~ {"kind":1,"id":"fab42ccb0c8da8865fa397da631073485457a1dff115e63ba3cb6d92210a7bbe","pubkey":"17e2889fba01021d048a13fd0ba108ad31c38326295460c21e69c43fa8fbe515","created_at":1748978085,"tags":[["e","be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f","wss://Nostr21.Com","root"],["e","0e845060e95216ae5e29de7d951a8b84873455d2a160deb2e5e8555b235c73cb","wss://Nostr21.Com","reply"],["p","2779f3d9f42c7dee17f0e6bcdcf89a8f9d592d19e3b1bbd27ef1cffd1a7f98d1"],["p","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"],["p","c7acabf1fed201a53185e4dc5e0c6bae2bc5db19d73abf840535f305d8f05180"],["r","wss://nos.lol/"],["r","wss://relay.angor.io/"],["r","wss://relay.primal.net/"],["r","wss://relay.damus.io/"]],"content":"Does your paid relays allow me to write a reply to them? If I use The Outbox Model will I will be able publish to you?","sig":"cfae4c51ed8a2a9eeea290cd05c8b607ae5cab03691243c40f9d019d25fbc7c6e2a1026cb5289bf9d9ac9ea96f24fde2d3c6bd54c992aa9e35424ff386de8fa0"}
[nl][info] 2025/06/03 20:32:27 {wss://nostr-relay.tyiu.xyz/inbox} filter does not match: {"kinds":[1],"limit":10,"#q":["be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f"]} ~ {"kind":1,"id":"e21e28dd8e769d64f0487fa1d5551ac49ad15f7e766a2a3f73d36b3b2efe031f","pubkey":"fd208ee8c8f283780a9552896e4823cc9dc6bfd442063889577106940fd927c1","created_at":1748975926,"tags":[["e","be6229b88699d59ea555a7aa72c6ba60a2aacceff470a5912875ae0c9d7b582f","wss://nostr.wine/","root","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"],["p","2779f3d9f42c7dee17f0e6bcdcf89a8f9d592d19e3b1bbd27ef1cffd1a7f98d1"],["p","52b4a076bcbbbdc3a1aefa3735816cf74993b1b8db202b01c883c58be7fad8bd"],["p","32e1827635450ebb3c5a7d12c1f8e7b2b514439ac10a67eef3d9fd9c5c68e245"]],"content":"Thank you, nostr:npub1yaul8k059377u9lsu67de7y637w4jtgeuwcmh5n7788l6xnlnrgs3tvjmf and nostr:npub12262qa4uhw7u8gdwlgmntqtv7aye8vdcmvszkqwgs0zchel6mz7s6cgrkj for getting us out of the WoT anti-spam gulag.\n\nMake global great again.","sig":"952bf70f4fbbfe370f31aa97fa1f13c81f148a5d2fa19f886e613dc2596b1df5dfa8761ce6df6947242708e1208d2b1edfa74446adc666dba7f5419c60974554"}

[tyiu]

Or is this an issue with khatru? I'm not familiar with how the Haven stack is put together. I'm happy to file an issue over there if that's the case.

[tyiu]

I looked a bit deeper. I'm thinking it could be something with the Badger query implementation.
https://github.com/fiatjaf/eventstore/blob/5b96c0c53f6250d6f8b46b3904482abcc375f19b/badger/query_planner.go#L67-L93

[alltheseas]

@fiatjaf pls fix

[tyiu]

^ cc @fiatjaf on Badger possibly not respecting tags in filters in the query / query planner.

[fiatjaf]

Yes, that is indeed the case. This has to be fixed, it's been on my mind for a while. Someday I'll do it. It's annoying because it has to provide an automated migration that scans through all the database.

[tyiu]

Yes, that is indeed the case. This has to be fixed, it's been on my mind for a while. Someday I'll do it. It's annoying because it has to provide an automated migration that scans through all the database.

Thanks! I've filed an issue on that repo here:
fiatjaf/eventstore#46

[fiatjaf]

Thank you very much.

[aaccioly]

@tyiu , thanks for the report.

Given that so far the issue seems to be only happening with Badger, could you try using lmdb instead and checking if the query works as expected? You will need to reimport your notes as well.

.env

DB_ENGINE="lmdb"

Not a fix of course. Just a possible workaround for now.

[tyiu]

@tyiu , thanks for the report.

Given that so far the issue seems to be only happening with Badger, could you try using lmdb instead and checking if the query works as expected? You will need to reimport your notes as well.

.env

DB_ENGINE="lmdb"

Not a fix of course. Just a possible workaround for now.

I'm not self-hosting. I'm using https://www.eggstr.com/ which doesn't provide that configuration option. I'm guessing the team that manages Eggstr is separate from Bitvora?