Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some posts/messages are being skipped #343

Open
yourfavoriteweapon opened this issue Apr 26, 2024 · 10 comments
Open

Some posts/messages are being skipped #343

yourfavoriteweapon opened this issue Apr 26, 2024 · 10 comments

Comments

@yourfavoriteweapon
Copy link

When I initially set this up, everything worked great. Now I've noticed it seems to be skipping content at times. There was a Paid message I unlocked, that was 2 images and a video. The downloader only picked up the first image and the video, not the 2nd one.

I went to another profile and noticed there were a few recent free posts that it didn't download. If i tried to force it to download by choosing single post and putting in that URL, the tool said it had already downloaded that post.

Logs dont have that much in them, is there a known issue going on?

@naodrej
Copy link

naodrej commented Apr 28, 2024

perhaps it's a dupe and the model reposted content.

@jallisan
Copy link

jallisan commented May 2, 2024

I have this exact same issue, there is a creator who has uploaded messages with many videos / photos in but when I try download them it only seems to get the first one that shows up in the browser. Attached my config.json but I've tried to change everything I could think of and still no cigar.
Screenshot from 2024-05-02 10-33-30

@tj961120
Copy link

tj961120 commented May 2, 2024

Following, I'm experiencing the same issues. A lot of pics and vids from messages being skipped for some reason...

@DP9aq
Copy link

DP9aq commented May 4, 2024

Following too.
I get those messages, even after i start whit an empty installation (so there should be no downloaded posts in the database)
image
is that the same Issue ?

@sim0n00ps
Copy link
Owner

I have this exact same issue, there is a creator who has uploaded messages with many videos / photos in but when I try download them it only seems to get the first one that shows up in the browser. Attached my config.json but I've tried to change everything I could think of and still no cigar.
Screenshot from 2024-05-02 10-33-30

Your Filename Formats are not unique enough, essentially using a format like that will mean every file for that post will try to be named the same so they will be overwritten so you're left with 1 file per post. Maybe include the media id which will make each filename unique.

@DP9aq
Copy link

DP9aq commented May 6, 2024

Today i tried to scrap the whole media from one file - there was an error and the OF-DL didn't find any posts. Maybe the issue is related in the mechanism the identification of the single posts are made ?

@jallisan
Copy link

jallisan commented May 6, 2024

I have this exact same issue, there is a creator who has uploaded messages with many videos / photos in but when I try download them it only seems to get the first one that shows up in the browser. Attached my config.json but I've tried to change everything I could think of and still no cigar.
Screenshot from 2024-05-02 10-33-30

Your Filename Formats are not unique enough, essentially using a format like that will mean every file for that post will try to be named the same so they will be overwritten so you're left with 1 file per post. Maybe include the media id which will make each filename unique.

Thanks @sim0n00ps this was my issue, been scratching my head for ages at this, had't occurred to me that when I reset everything I used the same filenames again.

Thanks as well for your hard work on this app, its second to none.

@DP9aq
Copy link

DP9aq commented May 7, 2024

Hey there, im using the following file formats
"PaidPostFileNameFormat": "{postedAt}-{username}_{id}_{text}", "PostFileNameFormat": "{postedAt}-{username}_{id}_{text}",

That should be unique enough or ?
Still getting those 403 Errors
image

@tj961120
Copy link

tj961120 commented May 9, 2024

I left my file format blank though... Any idea what might be causing this issue?

@sim0n00ps cannot thank you enough for this

@DP9aq
Copy link

DP9aq commented May 21, 2024

Just tried again with a blank file format, same Error
Maybe the Log file helps?

`2024-05-20 17:21:04.630 +02:00 [ERR] Auth failed
2024-05-20 17:22:02.853 +02:00 [ERR] Exception caught: Response status code does not indicate success: 403 (Forbidden).

StackTrace: at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at OF_DL.Helpers.APIHelper.GetDRMMPDPSSH(String mpdUrl, String policy, String signature, String kvp, Auth auth)
2024-05-20 17:26:55.664 +02:00 [ERR] Exception caught: Response status code does not indicate success: 403 (Forbidden).

StackTrace: at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at OF_DL.Helpers.APIHelper.GetDRMMPDPSSH(String mpdUrl, String policy, String signature, String kvp, Auth auth)
`

Any Ideas @sim0n00ps ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants
@naodrej @yourfavoriteweapon @jallisan @sim0n00ps @tj961120 @DP9aq and others