Please help me configure gallery-dl to extract twitter content like Twitter Media Downloader extension

[rarelygoeshere]

Hello everyone. I'm a newcomer to gallery-dl. Just recently Twitter Media Downloader have announced that they will discontinued the development of their extensions, which includes the aforementioned downloader. As someone who's been using this extension for a long time, it's a devastating blow to my ability to procure twitter content. Now I come to this tool and seek to understand how to use it, but as a newbie to cli and g-dl, it's a daunting task, and I've yet to been able to figure out how to configure it to replicate the features I need from twitter media downloader for g-dl.

Among other things, it can saves the media content as twittername-tweetID and date; along with producing a .csv and .txt of the download, of which I've linked a sample of below this message. It was one of its kind and unfortunately, it is going to be gone for good. I know what I'm asking is a tall order, but I sincerely hope that someone here would lend a hand in these trying times.

I'll be really appreciative and grateful to anyone that volunteers their time to aid me in this matter.

VicegameXD-721460086800052224(20160417_050743)-1318946930748162048(20201021_230707)-media.log

VicegameXD-721460086800052224(20160417_050743)-1318946930748162048(20201021_230707)-media.csv

[fredinno]

Use this format in Powershell after installing gallery-dl: gallery-dl "https://twitter.com/NAME/media" -o skip=true --filter "datetime(2023, 9, 11) <= date"
Then add the config.json in the zip file to the configuration. There are tutorials on how to set this up.

Note with the very end of the Twitter Media Downloader Name in 20220830[030102]-img1 (the section inside []s) is not going to match Twitter Media Downloader.
It just doesn't work for some reason- probably it's time zones being wonky.

config.json

{
    "extractor":{
        "twitter":{
            "users": "https://twitter.com/{legacy[screen_name]}",
            "cookies": ["firefox"],
            "include": "media",
            "text-tweets":false,
            "quoted":false,
            "retweets":false,
            "logout":true,
            "replies":true,
            "pinned":true,
            "syndication":"extended",
            "filename":"{author[name]}-{tweet_id}-{date:%Y%m%d}-{extension}{num}.{extension}",
            "directory":{
                "" : ["output", "twitter"]
            },
            "postprocessors":[
                {"name": "metadata", "event": "post", "filename": "{author[name]}-{tweet_id}-{date:%Y%m%d}.json"}
            ]
        }
    }
}

[mikf]

First, create a config file by running gallery-dl --config-create

Next, add a twitter section and define a filename format string.

    "extractor":{
        "twitter":{
            "filename": "{author[name]}-{author[id]}({author[date]:%Y%m%d_%H%M%S})-{tweet_id}({date:%Y%m%d_%H%M%S}).{extension}"
        }
    }

You'll also need to login, which can be done with username+password or cookies.

Creating .log and .csv files like you posted should also be possible, but there is no pre-defined way of doing so. You'll have to use a metadata post processor and make extensive use of its options to get somewhat close to what twMD produced.

And as input URL, you should use a plain https://twitter.com/USERNAME without any /media etc, unless you know what you're doing. This will use a similar strategy as twMD regarding fetching Tweets.

To update your collection, use -A 5 to stop downloading when it encounters files that were downloaded previously.

[rarelygoeshere]

Hello, I've finally read all the comments here, and I'm pretty stoked that people came to aid me with this issue. Thank you all kindly! I appreciate everyone's input 👍

@mikf I've did all the steps you've instructed me to do and added the relevant login info. However, it seems I'm doing something wrong, as seen in the below screenshot. What does the error I encountered mean, and how can I fix it?

[hrxn]

This means that your configuration file, while found and read by gallery-dl, could not be parsed by the program because it is not syntactically valid JSON.

It even tells you where the problem has been found: line 6, column 15 - or near that position.
You can use any online JSON tool you want to check your config file, or use any reasonable editor you want that has proper JSON support, like VSCode or something.

[rarelygoeshere]

I have examined my json again, and I found that I didn't add a , at the end of the password section. I promptly added it, then tried again with a small account as a test, and it looks like it's working now!

It seems that I've reached the point of replicating the primary feature of Twitter Media Downloader! As for .log and .csv files along with other features of TMD that I like, I'll try and figure things out later. But for now, this should suffice. Thanks a lot for answering my inquiry; I really appreciate all of your help! Might make a throwaway account in case Twitter do something with my main one tho.

[lordbung]

you ever figure out the .log and .csv config? im trying to do a similar setup

[elsenchai]

Bumping an old thread
I believe I've managed to replicate the file format from twMD, but my config was somehow broken, I'm using the browser cookie cmd to bypass the login

This is what my config looks like:

{
"extractor": {
"twitter": {
"username": "",
"password": "",
"filename": "{author[name]}-{tweet_id}-({date:%Y%m%d_%H%M%S})-img{num}.{extension}"
}
}
}

[Wyyvern]

Thanks for this, the {num} part is important since the one above will only save one picture from a tweet if it contains multiple.