Archive woes #3530
Replies: 2 comments 1 reply
-
DeviantArt uses different archive formats for different subcategories by default. So, whether you download from an individual creator's page, or from your watchlist, from a group, or whatever, gallery-dl can use slightly different settings. ProTip: To make an example, for To make specific changes here, simply modify your config like this (based on your example): {
"extractor": {
"deviantart":
{
"watch":
{
"directory": ["deviantart", "Watched", "{user[id]}"],
"archive-format": "wl_{_username}_{index}.{extension}"
},
"archive": "f:/gallery-dl/archive.sqlite3",
"cookies": ["firefox"],
"include": "gallery",
"client-id": "xxxxx",
"client-secret": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
"refresh-token": "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
"directory": ["deviantart", "{user[id]}"],
"folders": false,
"journals": "none",
"mature": true,
"metadata": true,
"original": "images",
"quality": 100,
"extra": true,
"skip": true,
"wait-min": 0,
"filename": "{author[username]}_{title}.{extension}"
}
}
} We're now using a new archive-id format here ( |
Beta Was this translation helpful? Give feedback.
-
Ok, so made those changes and ran a test with the -E flag:
...Am I right in thinking that it's not picking up on the format change, for whatever reason? |
Beta Was this translation helpful? Give feedback.
-
I recently installed gallery-dl and have been using it to download images from DeviantArt. I've been able to download from individual creators' pages just fine, and have had some limited success with downloading updates from my "watchlist" (https://www.deviantart.com/watch/deviations).
However, I've noticed that when I try to grab updates from my watchlist, all images it finds are skipped, as if the files already exist, or if they're already in my archive file. I've experimented with a number of different settings, but the only thing that reliably works to get my images is telling it to download ALL updates with
--no-skip
or"skip": false
...which kind of defeats the purpose of the archive file, right?(I should note that downloads seem to work correctly when downloading straight from a creator's page.)
Relevant command line and config excerpt below (Windows):
.\gallery-dl.exe -c "F:\gallery-dl\gallery-dl.conf" --download-archive archive.sqlite3 https://www.deviantart.com/watch/deviations
Any suggestions would be appreciated. Thank you!
Beta Was this translation helpful? Give feedback.
All reactions