Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip files and folders that are unchanged when reindexing #19

Merged
merged 5 commits into from
Mar 31, 2023

Conversation

andrewhong5297
Copy link
Contributor

@andrewhong5297 andrewhong5297 commented Mar 30, 2023

This PR adds a checksum field to every json output of file/folder processing, and then checks against that when estimating/indexing again. This fixes issue #7

I've tested that it definitely works for files - folders are skipped in estimation, but it is the same logic so I don't see why it wouldn't work.

You can see the verbose results of an estimation below, I already reindexed once and then made more edits to just two files. I didn't change the "Proccessing X files..." or folders text because it uses traverseFileSystem instead of processRepository to create a count.

image

@samheutmaker samheutmaker merged commit cedb6ab into context-labs:master Mar 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants