Skip to content
This repository has been archived by the owner on Jun 15, 2018. It is now read-only.

bunch of changes - see details #16

Merged
merged 10 commits into from Jun 28, 2012
Merged

bunch of changes - see details #16

merged 10 commits into from Jun 28, 2012

Conversation

esby
Copy link
Contributor

@esby esby commented Jun 26, 2012

metadir_py:

  • alternate cache structure: by using an md5 hash of the filename of each file downloaded.
  • little improvement to the old cache structure when pulling category member:
    the pagedict won't reload from disk each time a page is pulled.

clicommands.py:

  • quick fix for merge command - I believe files are already in utf8 because they comes from os calls.
  • rewrote throttle: a 10s delay here will mean it will take into account the request time, From my tests, it will take about 11s to commit a file. (3 api access of 3.75s). The next step will be implementing the value in metadir config.
  • more verbose when committing files. date - filename - number of files left
  • implemented continue for category member pulling.
  • do not set api_setup again if it was already done.

If you think the code needs rework to fit needs, just ask.

iliana pushed a commit that referenced this pull request Jun 28, 2012
@iliana iliana merged commit bdcbb38 into iliana:master Jun 28, 2012
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants