[Feature Request]: Automating captcha solver

[acheong08]

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

Use math to solve captcha

Proposed workflow

I'm not a very mathematical person but I remember implementing this a long time ago (but forgot how to)

1. Split the single challenge image into 6 options and 1 pointer
2. Remove background from captcha images
3. Find two points with pixels on the option image furthest away from each other
4. Determine pointing direction based on line between the two points
5. Repeat for pointer image
6. Find image with closest angle

Additional information

Imdumbafandidkhowtodothis

[ItIsRain]

I don't think they only use directional captchas, right?

[acheong08]

For now, yes, they do

[ItIsRain]

For now, yes, they do

Alright, I got an idea, I'll try to apply it and create a pull request.
Perhaps, not sure yet, but I think I can automate this..

[ItIsRain]

It looks good till now..

[acheong08]

Thanks. This might be necessary again. Looks like they picked up on our updated fingerprint

[acheong08]

It looks good till now..

This looks amazing. Any hints on how you're implementing this?

[ItIsRain]

It looks good till now..

This looks amazing. Any hints on how you're implementing this?

Yes it's actually really easy to do. I changed up the system a bit and started using YOLOv8 but it seems like we do have to train it on these kind of pictures.

1 - Use YOLOv8 or any model that can at least understand that the items in the images are objects so we could highlight them.
2 - Enumerate over all the items and use CV2 to draw a rectangle around them.

The issue now is that I've tried multiple ways to actually see how am I supposed to make it calculate the angle of the object. One is that we draw a box over each object, draw a line going from each corner to the other inside the box. Once we're done with that, we then calculate the angle of the lines compared to box and take the sum.

P.S. YOLOv8 can't detect it properly, so we need to find a better model or train YOLOv8..

[acheong08]

The issue now is that I've tried multiple ways to actually see how am I supposed to make it calculate the angle of the object

If you are already putting a rectangle around it, is it possible to simply find the angle of the longest line of the rectangle?

[acheong08]

On another note, it seems the captcha now changes occasionally to other visual challenges. This would become futile

[acheong08]

I'm also tracking the status of my different APIs here: https://stats.churchless.tech/

And it seems I haven't been hitting any captchas since updating the fingerprint

[ItIsRain]

The issue now is that I've tried multiple ways to actually see how am I supposed to make it calculate the angle of the object

If you are already putting a rectangle around it, is it possible to simply find the angle of the longest line of the rectangle?

I actually haven't tried that, but true, this can actually work since this can easily determine if the finger is pointing up or to the side..

On another note, it seems the captcha now changes occasionally to other visual challenges. This would become futile

That is unfortunate, it just means that this system can't work properly anymore..

I'm also tracking the status of my different APIs here: https://stats.churchless.tech/

And it seems I haven't been hitting any captchas since updating the fingerprint

Finally some good news, do you think it'll stay this way?

[acheong08]

Finally some good news, do you think it'll stay this way?

It depends

OpenAI can very easily enforce captcha on every request regardless of fingerprint at the press of a button. @linweiyuan is working on getting the fingerprint and so far it has led to pretty good results

[acheong08]

Here's all the token endpoints I'm monitoring right now. We could have a system to check for the one with the highest ping & success rate and fetch from there

[ItIsRain]

Here's all the token endpoints I'm monitoring right now. We could have a system to check for the one with the highest ping & success rate and fetch from there

Great idea to monitor multiple instances simultaneously..