Skip to content

Commit

Permalink
Never use checksums in Gen 3 processing.
Browse files Browse the repository at this point in the history
Checksums greatly slow down repository copying, particularly for
large repositories.
  • Loading branch information
kfindeisen committed Oct 6, 2020
1 parent 67511f7 commit 49500b1
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion python/lsst/ap/verify/dataset.py
Original file line number Diff line number Diff line change
Expand Up @@ -277,7 +277,10 @@ def makeCompatibleRepoGen3(self, repoDir):
"""
# No way to tell makeRepo "create only what's missing"
try:
repoConfig = dafButler.Butler.makeRepo(repoDir)
initConfig = dafButler.Config()
# Checksums greatly slow importing of large repositories
initConfig[".datastore.checksum"] = False
repoConfig = dafButler.Butler.makeRepo(repoDir, config=initConfig)
butler = dafButler.Butler(repoConfig, writeable=True)
butler.import_(directory=self._preloadedRepo, filename=self._preloadedExport,
transfer="auto")
Expand Down

0 comments on commit 49500b1

Please sign in to comment.