Skip to content

Add Lobsters (lobste.rs) and Codepen username availability module - #452

Draft
SpiliosDimakopoulos wants to merge 2 commits into
kaifcodec:mainfrom
SpiliosDimakopoulos:add-lobsters-module
Draft

Add Lobsters (lobste.rs) and Codepen username availability module#452
SpiliosDimakopoulos wants to merge 2 commits into
kaifcodec:mainfrom
SpiliosDimakopoulos:add-lobsters-module

Conversation

@SpiliosDimakopoulos

Copy link
Copy Markdown
Contributor

Adds a username availability check for Lobsters (lobste.rs), a tech/OSINT community site currently missing from user_scan/community/.

  • File: user_scanner/user_scan/community/lobsters.py
  • Uses the public, documented JSON endpoint lobste.rs/u/.json
  • Available: HTTP 404
  • Taken: HTTP 200 + parsed JSON, extracts about/karma/created_at/github_username when present
  • Error: any other status code or unparseable body

Tested locally against a known existing username and a random non-existent one; both paths resolve correctly.

show_url = url

def process(response):
if response.status_code == 404:

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@SpiliosDimakopoulos Could you check if the response payload contains any other explicit strings like "user doesn't exist" or "profile not found"? We could use a targeted check like:

if response.status_code == 404 and "profile not found" in response.text:

this removes the risk of any false negatives in future.

@kaifcodec

Copy link
Copy Markdown
Owner

@SpiliosDimakopoulos Another issue I noticed is that the CodePen module is returning a 403 status code on my machine. This could be due to WAF restrictions that require custom headers, cookies, or updated request handling. Could you re-test this module on your end and verify if it requires updated headers?

@kaifcodec kaifcodec added the need-extra-changes Some files or parts of the code may require additional edits or updates for it work properly. label Jul 25, 2026
@kaifcodec kaifcodec added the help wanted Extra attention is needed label Jul 28, 2026
@kaifcodec
kaifcodec marked this pull request as draft July 28, 2026 05:16
@kaifcodec kaifcodec changed the title Add Lobsters (lobste.rs) username availability module (community category) Add Lobsters (lobste.rs) and Codepen username availability module Jul 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

help wanted Extra attention is needed need-extra-changes Some files or parts of the code may require additional edits or updates for it work properly.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants