Skip to content

SewellHub/mobile-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

📱 GameGrip Mobile Game Issue Crawler

Multi-source crawler for mobile game bug reports and player issues. Crawls app store reviews, mobile gaming news, Reddit communities, and game APIs.

Pure Python 3.10+ — zero external dependencies.

Sources (12 modules)

Source Category Key? What it crawls
Google Play Reviews Store Reviews 🆓 1-2 star reviews from Play Store (bug reports)
Google Play Search Store Metadata 🆓 Trending/new mobile game listings
App Store Reviews Store Reviews 🆓 iTunes RSS review feed (newest reviews)
App Store Lookup Store Metadata 🆓 iTunes Search API — game metadata & ratings
Pocket Gamer Mobile News 🆓 RSS feed — mobile game news & reviews
Touch Arcade Mobile News 🆓 RSS feed — iOS game coverage
Pocket Tactics Mobile News 🆓 RSS feed — mobile & Switch guides
Droid Gamers Mobile News 🆓 RSS feed — Android gaming news
Gamezebo Mobile News 🆓 RSS feed — mobile game reviews
PocketGamer.biz Mobile News 🆓 RSS feed — mobile industry news
Reddit Mobile Gaming Forums 🆓 14 mobile gaming subreddits
Supercell API Game API 🔑 CoC, Clash Royale, Brawl Stars server status

10 of 12 sources work without any API keys.

Quick Start

python crawl.py                              # Full crawl
python crawl.py --source app_store_reviews   # App Store reviews only
python crawl.py --source google_play_reviews # Google Play reviews only
python crawl.py --category mobile_news       # News sites only
python crawl.py --source reddit_mobile       # Reddit only
python crawl.py --game "Clash of Clans"      # Single game
python crawl.py --bugs-only                  # Only bug reports
python crawl.py --list-sources               # Show all sources

Output

JSON reports saved to output/crawl_YYYY-MM-DD_HHMMSS.json with:

  • Issues — Clustered bug reports with severity, platform, device info, estimated report counts
  • Reviews — Raw store reviews from Google Play & App Store
  • News — Mobile gaming news articles (bug-relevance scored)
  • Forum posts — Reddit threads from mobile gaming communities
  • Store listings — Game metadata and ratings

Issue Categories (Mobile-Specific)

Category Severity Examples
crash Critical Force close, app stopped, CTD
save_data Critical Lost progress, cloud save fail
login Critical Can't login, account lost
freeze High Frozen, not responding, stuck
performance High FPS drops, lag, stutter
network High Server issues, disconnect, timeout
iap High Missing purchase, billing errors
battery Medium Battery drain, overheating
update Medium Update broke the game
device_compat Medium Won't install, black screen
loading Medium Infinite load, won't launch
ads Low Too many ads, unskippable
storage Low Takes too much space

Configuration

Edit config/settings.json to:

  • Add/remove games from the crawl list (needs play_id and/or apple_id)
  • Add/remove Reddit subreddits
  • Set report threshold (minimum reports for an issue to surface)
  • Add API keys for Supercell, Reddit OAuth

Games Covered (Default)

20 top mobile games pre-configured: Genshin Impact, PUBG Mobile, Call of Duty Mobile, Clash of Clans, Clash Royale, Brawl Stars, Roblox, Candy Crush Saga, Among Us, Mobile Legends, Pokemon GO, Subway Surfers, Honkai: Star Rail, Diablo Immortal, Stumble Guys, Monopoly GO!, Royal Match, AFK Journey, Fortnite, Minecraft

Adding Games

Add entries to mobile_games in config/settings.json:

{
  "name": "Your Game",
  "play_id": "com.developer.gameid",
  "apple_id": "123456789"
}

Find the Play ID from the Google Play URL and the Apple ID from the App Store URL.

Architecture

GameGrip Architecture Map

About

GameGrip Mobile Crawler — multi-source crawler for mobile game bug reports. App store reviews, Reddit, gaming news. Pure Python, zero dependencies.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors