Skip to content

Commit

Permalink
fixed RFPDupeFilter persistence
Browse files Browse the repository at this point in the history
  • Loading branch information
kmike committed Jul 28, 2015
1 parent c78e263 commit 836cb84
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions scrapy/dupefilters.py
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ def __init__(self, path=None, debug=False):
self.logger = logging.getLogger(__name__)
if path:
self.file = open(os.path.join(path, 'requests.seen'), 'a+')
self.file.seek(0)
self.fingerprints.update(x.rstrip() for x in self.file)

@classmethod
Expand Down

0 comments on commit 836cb84

Please sign in to comment.