e621dl 5.11.1 [bugfix]

There was a bug preventing generation of pool download config and placing files in incorrect pool folder if a post has multiple pools.

e621dl 5.11.0

Pools, optimizations, checks, bugfixes

• New feature: moving/copying files to pools subfolders.
  It could be useful to find what pool you want download
  wholesome

• New feature: downloading all pools found while separating
  with potentially less strict rules.

• Offline db request chunk now hundred times more, leading
  to drastic memory consumption increase with in the mode
  and no less drastic speedup.

• Added checks if all required python modules are available.

• A rare bug fixed, leading to crash if files can't be
  downloaded with max_downloads option enabled.

• A rare (apparently) bug fixed, preventing multiple
  prefilters in offline/db mode to work correctly.

• Some fixes in README.md along with description of some
  new features.

e621dl 5.10.0

Option to not redownload deleted files, new Cloudflare captcha support, NSFW by default and lots of bugfixes

• Cloudflare changed it's captcha to something more
  profitable and more irritating. Since there is no way
  to solve it without Javascript, I can't use my old trick.
  So, instead we solve it in browser in Incognito, but
  we change browser's User-Agent and copy cookies to
  e621dl after we did so

• Detailed instruction for how to solve Cloudflare
  was made, replacing an obsolete one

• New settings option, no_redownload, applied to all
  configs if it's set to true in at least one of them.
  blocks deleted files from being redownloaded.

• Default rating changed to all possible, NSFW included.
  Because honestly, that's what this tool is for.

• During experiments with http headers, new allowed
  compression method was discovered, brotli, and looks like
  e621.net uses it by default. So, to use it, new
  dependency, brotli, are now required
  pip install brotli if you use source code version

• In README.md install instruction was updated.

• Now dictionary of all unique images is created once
  per run, not once per config again. Partial downloads
  are appended to the dict as well as to old_files table.

• Databases are created even if they were deleted after
  e621dl closing during active run. This leads to undefined
  behavior of pruning is used, but at least it will not
  prevent e621dl from running.

• Image regular expression fixed so partial downloads are
  not count. Bug happened when partial downloads were count
  as images in filedict.

• Partial downloads not checked if there is a copy in the
  same folder or if it's in a filedict. Copied directly
  if there is.

• Some minor bugfixes

e621dl 5.9.1 [bugfix]

• API key was being converted to lowercase. Fixed.

• Last post on a page was identified incorrectly if some
  post has are hidden from a page (i.e. url == null).
  Fixed.

• Sometimes initial list of files in cache and downloads
  was incorrect if there was some partial downloads.
  Fixed.

e621dl 5.9.0

New API adaptation and login support

• So, e621.net moved to a new engine. That means
  more tags at a time. Also, it means pain to remake
  all relevant parts. Luckily, posts have internal
  representation that could be mapped to the new API
  leaving most of the logic intact.

• Since some posts are now hidden for the guest users,
  I added simple login and api_key settings to the
  settings section.

e621dl 5.8.1

Bugfixes

• Since recently, wildcard tags (tags with '*')
  are not allowed unless you have an account
  at least for week. So, such tags are removed from
  queries to e621.net but they still works inside the app.

• Cloudflare recognition had a bug, result was all response
  with HTTP code 403 considered Cloudflare. That means
  instead of an HTTP error and termination, e621dl stucked
  in the loop of Cloudflare detection. Fixed.

e621dl 5.8.0

Multiple configs, default subfolder block and bugfixes

• Instead of one config file, configs folder is now used.
  Config files there processed one by one in natural order.
  By default, old config.ini is placed in the folder
  at the start, if no folder exists. Also, minor alteration
  to prune_*, they will be active at the end of all
  downloads if set true in at least one of the configs.

• If, for some reason, you don't want to add default
  subfolders to a section, you can add settings
  blacklist_default_subfolders=true. May be useful if
  you use a subfolder as an intermediate filter.

• Previously, files was pruned, but empty folders remains.
  Fixed.

• Illegal filename characters are more fine grained and
  mapped to similar unicode characters:
  : → ː
  * → ❋
  " → ᐦ
  ? → ʔ
  < → ᐸ
  > → ᐳ
  | → ╎
  \ → ╲
  / → ╱

e621dl 5.7.0

Bugfix, folders pruning, post blacklist

• Default subfolders was added to all sections if
  global section [Blacklist] was used. This was due
  to tags were added to section from blacklist before
  there was check if section has search, that is,
  tags or conditions. Fixed

• Folders can now be pruned from files that are no
  longer needed, be it sections that are removed from
  the config or cached files that have not a single
  copy in downloads. You have to enable it in
  [Settings], prune_downloads = true and
  prune_cache = true

• Post can be blacklisted by just dragging to special
  folder, to_blocked_posts or by manually adding
  ids to blocked_posts.txt, one post id per line

e621dl 5.6.2

Bugfix release

• Number of filtered posts was incorrect. Fixed.

• If there was an error in subfolders options,
  the app freezed without any error. Fixed, now
  it's explicitly stated where exactly is the
  error.

e621dl 5.6.1

Just a bugfix release

• It was impossible to use section without search with
  prefilter, only subfolders worked that way, now it's
  possible to use them as collection for subfolders.

• When using prefilter, if post_countdown was used,
  e621 API thread would continue till forever. Fixed.

• On exit, final statistics was rarely printed. It was
  either outdated or sometimes plain python crash error.
  Fixed

• Finally, section post limit count error 404 posts
  as success toward counter. And old bug that I finally
  understand how to counter