[Reddit] Specifying use of "reddit:" extractor with custom config.json API credentials not working

[bijon1111]

Hello,

I'm encountering an issue while trying to use gallery-dl to download images from Reddit. Initially, everything worked fine when I didn't specify the use of the "reddit:" extractor. However, this led to frequent API limit restrictions. To circumvent this issue, I attempted to add my custom API credentials to the config file to avoid the API limit.

When I ran the command gallery-dl oauth:reddit, it consistently used a default Reddit client ID. To force it to use the config file with my custom client ID, I specified the config file path in the command, which made it work as intended (command: gallery-dl --config C:\Users\User\AppData\Local\Programs\Python\Python312\Lib\site-packages\gallery_dl/config.json oauth:reddit). My web browser opened, and I successfully accepted the connection with my Reddit account. However, upon clicking "accept," I received the following error on the webpage (I've omitted any usernames and client-ids):

Remote server reported an error:

{'message': 'Unauthorized', 'error': 401}

In my command prompt, I also received the following error:

C:\Users\User\Pictures\Good` Stuff>gallery-dl --config C:\Users\User\AppData\Local\Programs\Python\Python312\Lib\site-packages\gallery_dl/config.json oauth:reddit
[oauth][info] Using custom reddit client ID (Ni2************)
[oauth][info] Opening URL in :

https://www.reddit.com/api/v1/authorize?client_id=Ni2**********&response_type=code&state=gallery-dl_reddit_******&redirect_uri=http%3A%2F%2Flocalhost%3A6414%2F&duration=permanent&scope=read+history

Waiting for response. (Cancel with Ctrl+c)
Remote server reported an error:

{'message': 'Unauthorized', 'error': `401}

Even though I got the 401 error and never received a refresh token, when I went to https://www.reddit.com/prefs/apps, it showed my specified application as an "authorized app." Despite this, even when attempting to download images from a random user's profile and specifying the config file, I continued to receive the 401 error

C:\Users\User\Pictures\Good Stuff>gallery-dl -v --config C:\Users\User\AppData\Local\Programs\Python\Python312\Lib\site-packages\gallery_dl/config.json https://www.reddit.com/user/{reddit_username}/
[gallery-dl][debug] Version 1.26.0
[gallery-dl][debug] Python 3.12.0 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.31.0 - urllib3 2.0.6
[gallery-dl][debug] Configuration Files ['C:\\Users\\User\\AppData\\Local\\Programs\\Python\\Python312\\Lib\\site-packages\\gallery_dl/config.json']
[gallery-dl][debug] Starting DownloadJob for 'https://www.reddit.com/user/{reddit_username}/'
[reddit][debug] Using RedditUserExtractor for 'https://www.reddit.com/user/{reddit_username}/'
[reddit][debug] Using custom API credentials (client-id Ni2i6*****************)
[reddit][info] Requesting public access token
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.reddit.com:443
[urllib3.connectionpool][debug] https://www.reddit.com:443 "POST /api/v1/access_token HTTP/1.1" 401 41
[reddit][debug] Server response: {'message': 'Unauthorized', 'error': 401}
[reddit][error] AuthenticationError: "401: Unauthorized"

I've attempted this process with two separate Reddit API apps, but I encountered the same issue both times. I've also restarted my computer multiple times and cleared gallery-dl's Reddit cache, all without success. Any assistance would be greatly appreciated.

Here is my config.json file if that helps:

{
    "extractor":
    {
        "reddit":
        {
            "client-id": "Ni2**************",
            "client-secret": "Dl********************",
            "user-agent": "Python:rbd:v1.0 (by /u/{my_reddit_account)",
        }
    }
}

[hrxn]

First of all: I suggest putting your config file in a sane location, so it gets loaded automatically etc.

Where's that "client-secret" in your config.json coming from?
You definitely don't need it for reddit, and configuration.rst does not mention it either.

You just need "client-id" and "user-agent", and then do the oauth:reddit step, which will give you "refresh-token"

[bijon1111]

First of all: I suggest putting your config file in a sane location, so it gets loaded automatically etc.

Where's that "client-secret" in your config.json coming from? You definitely don't need it for reddit, and configuration.rst does not mention it either.

You just need "client-id" and "user-agent", and then do the oauth:reddit step, which will give you "refresh-token"

After reviewing my files, I've come to realize that I initially placed my config file in the incorrect location, as I misunderstood the possible file paths for my config file. I have since rectified this mistake by relocating the config file to its correct location. Additionally, I have simplified my config file to only include the client-id and user-agent. However, despite these adjustments and my efforts to resolve the issue, the same 401 error persists, even after clearing the cache and attempting multiple times.

This is what I see on the webpage:

Remote server reported an error:

{'message': 'Unauthorized', 'error': 401}

This is in the command prompt:

C:\Users\User\Pictures\Good Stuff>gallery-dl -v oauth:reddit
[gallery-dl][debug] Version 1.26.0
[gallery-dl][debug] Python 3.12.0 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.31.0 - urllib3 2.0.6
[gallery-dl][debug] Configuration Files ['%USERPROFILE%\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'oauth:reddit'
[oauth][debug] Using OAuthReddit for 'oauth:reddit'
[oauth][info] Using custom reddit client ID (Ni2**************)
[oauth][info] Opening URL in :

https://www.reddit.com/api/v1/authorize?client_id=Ni2****************&response_type=code&state=gallery-dl_reddit_o********&redirect_uri=http%3A%2F%2Flocalhost%3A6414%2F&duration=permanent&scope=read+history

Waiting for response. (Cancel with Ctrl+c)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.reddit.com:443
[urllib3.connectionpool][debug] https://www.reddit.com:443 "POST /api/v1/access_token HTTP/1.1" 401 41
Remote server reported an error:

{'message': 'Unauthorized', 'error': 401}

[hrxn]

Could you try the following

gallery-dl -o oauth.browser=false -v oauth:reddit

Then copy and paste the link from the terminal into your browser (the same browser (and profile) you signed in with reddit)

[bijon1111]

gallery-dl -o oauth.browser=false -v oauth:reddit

Executing the command gallery-dl -o oauth.browser=false -v oauth:reddit unexpectedly triggers the automatic opening of my signed-in browser for some reason. I did it on both my Laptop and Desktop, and saw the same issue. The 401 error is also encountered on both devices.

[bijon1111]

gallery-dl -o oauth.browser=false

@hrxn I have found a workaround for making it so the browser does not open up. Which was by putting this in my config file:

	"oauth": 
	{
            "browser": false
        },

However, I still continue to receive the 401 remote server error when copy and pasting the URL into the browser I'm signed in on.

[mikf]

Just a guess, but maybe you didn't select "installed app" when registering a new Reddit application.
When doing everything as described here, you should not have gotten a client_secret.

[bijon1111]

@mikf
That resolved the issue. It seems for some reason I misread it and thought the "preferably" applied to both the "installed app" and setting the Redirect UI as "http://localhost:6414/". I apologize for the time wasted.