expired bounces not removed

[bdijkstra82]

Using OpenSMTPD 6.0.0 on OpenBSD 6.0-stable (up to patch 015).

# date
Mon Nov 14 10:08:37 CET 2016
# mailq
c68a60a392b1f00f|local|mta|auth|@|bounce-262184-332564-198128-452@eoesell.com|bounce-262184-332564-198128-452@eoesell.com|1478766676|1479112276|1478766676|0|inflight|347816|
# date -r 1479112276
Mon Nov 14 09:31:16 CET 2016

So there's an expired envelope in the queue. This happened a few times before, I've seen messages stay in the queue for 7 days and still not get removed. I can remove the envelope manually:

# smtpctl remove c68a60a392b1f00f
1 envelope removed

The queue is empty, but the envelope remains on disk (I hope this is normal):

# mailq
# ls -l /var/spool/smtpd/queue/c6/c68a60a3/
total 24
-rw-------  1 _smtpq  wheel   333 Nov 10 09:31 c68a60a392b1f00f
-rw-------  1 _smtpq  wheel  8753 Nov 10 09:31 message

However, smtpd continues its delivery attempts:

# tail /var/log/maillog
Nov 14 10:16:48 belisama smtpd[60430]: smtp-out: Enabling route [] <-> 133.130.124.77 (v133-130-124-77.a057.g.tyo1.static.cnode.io)
Nov 14 10:17:03 belisama smtpd[60430]: smtp-out: Enabling route [] <-> 23.247.64.199 (host188.hyytxb.com)
Nov 14 10:17:18 belisama smtpd[60430]: 668e74d30f550dee mta event=error reason=Connection timeout
Nov 14 10:17:18 belisama smtpd[60430]: smtp-out: Disabling route [] <-> 104.148.33.38 (host158.hyytxb.com) for 15s
Nov 14 10:17:18 belisama smtpd[60430]: 668e74d913010c41 mta event=connecting address=smtp+tls://138.197.200.238:25 host=138.197.200.238
Nov 14 10:17:18 belisama smtpd[60430]: 668e74d913010c41 mta event=error reason=IO Error: Connection refused
Nov 14 10:17:18 belisama smtpd[60430]: smtp-out: Disabling route [] <-> 138.197.200.238 (138.197.200.238) for 15s
Nov 14 10:17:20 belisama smtpd[60430]: 668e74daf36e27d3 mta event=connecting address=smtp+tls://23.247.64.199:25 host=host188.hyytxb.com
Nov 14 10:17:33 belisama smtpd[60430]: smtp-out: Enabling route [] <-> 104.148.33.38 (host158.hyytxb.com)
Nov 14 10:17:33 belisama smtpd[60430]: smtp-out: Enabling route [] <-> 138.197.200.238 (138.197.200.238)

That is, until I restart it.

# /etc/rc.d/smtpd restart
smtpd(ok)
smtpd(ok)
# ls -l /var/spool/smtpd/queue/c6/c68a60a3/
ls: /var/spool/smtpd/queue/c6/c68a60a3/: No such file or directory
# tail -3 /var/log/maillog
Nov 14 10:18:31 belisama smtpd[44685]: smtpd: setup done
Nov 14 10:18:31 belisama smtpd[6555]: warn: queue: no return path!
Nov 14 10:18:31 belisama smtpd[6555]: relay: Expire for c68a60a392b1f00f: from=<@>, to=<bounce-262184-332564-198128-452@eoesell.com>, rcpt=<->, delay=4d47m15s, stat=Envelope expired

Only at this point it seems to notice the expired envelope (which was deleted!). I haven't tried restarting smtpd without manually deleting such an envelope.

[poolpOrg]

Interesting, I told @ericfaurot that I suspected a bug in the expire of envelopes as I often spot expired envelopes surge when I restart the daemon.

I'll investigate this

[poolpOrg]

This is very likely the same as #793, i'm closing this as your ticket is now referenced in the other one which has been assigned to @ericfaurot