File checkpointing #147
Labels
source: file
Anything `file` source related
type: enhancement
A value-adding code change that enhances its existing functionality.
The ability to persist a file's current read position and resume where left off between restarts.
One approach, which is what Timber used in it's old agent, is to take the first 256 bytes of a file and produce a checksum / finger print as well as the position. The checksum is used to identify the file if it is renamed.
https://github.com/timberio/agent/blob/004e495f9e6b21c3ca2b9cd516e3e498ddec40dc/tailer.go#L144-L162
Open to alternative solutions. Requirements are:
The text was updated successfully, but these errors were encountered: