Skip to content

feat(config): block indexing#1005

Merged
calmh merged 2 commits intomainfrom
jb/fullblockidx
Apr 26, 2026
Merged

feat(config): block indexing#1005
calmh merged 2 commits intomainfrom
jb/fullblockidx

Conversation

@calmh
Copy link
Copy Markdown
Member

@calmh calmh commented Apr 26, 2026

No description provided.

Signed-off-by: Jakob Borg <jakob@kastelo.net>
Signed-off-by: Jakob Borg <jakob@kastelo.net>
calmh added a commit to syncthing/syncthing that referenced this pull request Apr 26, 2026
This adds a new folder-level configuration `FullBlockIndex`. It controls
whether we maintain the block index for a given folder -- currently
that's always true, now it becomes possible to turn off. The block index
is used for lookup of blocks across files and folders. Effectively, when
syncing a change, for each block, we check:

1. Is the block already present in the old version of the file? If so,
we can reuse (copy) it without network transfer. **This check is always
possible.**
2. Is the block already present in any other file in this folder or
other folders? If so we can copy it. **This check is only possible with
the full block index.**
3. We must transfer the block over the network.

Maintaining the full block index is costly in time, I/O and database
size. With this PR, maintaining the full block index becomes the default
for send-receive and receive-only folders only, with it disabled for
send-only and receive-encrypted folders. The block index is never useful
for encrypted folders, as blocks are encrypted separate for each file.
It is also not useful for send-only folders by themselves, though the
data in the send-only folder could be reused by other receive-type
folders if it were enabled.

For very large folders it may make sense to disable the full block index
regardless of folder type and just accept the resulting decrease in data
reuse.

Disabling or enabling the option in the GUI causes the index to be
destroyed or rebuilt accordingly.

syncthing/docs#1005

---------

Signed-off-by: Jakob Borg <jakob@kastelo.net>
@calmh calmh merged commit e44005f into main Apr 26, 2026
4 checks passed
@calmh calmh deleted the jb/fullblockidx branch April 26, 2026 09:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant