Multi-source crawler for mobile game bug reports and player issues. Crawls app store reviews, mobile gaming news, Reddit communities, and game APIs.
Pure Python 3.10+ — zero external dependencies.
| Source | Category | Key? | What it crawls |
|---|---|---|---|
| Google Play Reviews | Store Reviews | 🆓 | 1-2 star reviews from Play Store (bug reports) |
| Google Play Search | Store Metadata | 🆓 | Trending/new mobile game listings |
| App Store Reviews | Store Reviews | 🆓 | iTunes RSS review feed (newest reviews) |
| App Store Lookup | Store Metadata | 🆓 | iTunes Search API — game metadata & ratings |
| Pocket Gamer | Mobile News | 🆓 | RSS feed — mobile game news & reviews |
| Touch Arcade | Mobile News | 🆓 | RSS feed — iOS game coverage |
| Pocket Tactics | Mobile News | 🆓 | RSS feed — mobile & Switch guides |
| Droid Gamers | Mobile News | 🆓 | RSS feed — Android gaming news |
| Gamezebo | Mobile News | 🆓 | RSS feed — mobile game reviews |
| PocketGamer.biz | Mobile News | 🆓 | RSS feed — mobile industry news |
| Reddit Mobile Gaming | Forums | 🆓 | 14 mobile gaming subreddits |
| Supercell API | Game API | 🔑 | CoC, Clash Royale, Brawl Stars server status |
10 of 12 sources work without any API keys.
python crawl.py # Full crawl
python crawl.py --source app_store_reviews # App Store reviews only
python crawl.py --source google_play_reviews # Google Play reviews only
python crawl.py --category mobile_news # News sites only
python crawl.py --source reddit_mobile # Reddit only
python crawl.py --game "Clash of Clans" # Single game
python crawl.py --bugs-only # Only bug reports
python crawl.py --list-sources # Show all sourcesJSON reports saved to output/crawl_YYYY-MM-DD_HHMMSS.json with:
- Issues — Clustered bug reports with severity, platform, device info, estimated report counts
- Reviews — Raw store reviews from Google Play & App Store
- News — Mobile gaming news articles (bug-relevance scored)
- Forum posts — Reddit threads from mobile gaming communities
- Store listings — Game metadata and ratings
| Category | Severity | Examples |
|---|---|---|
| crash | Critical | Force close, app stopped, CTD |
| save_data | Critical | Lost progress, cloud save fail |
| login | Critical | Can't login, account lost |
| freeze | High | Frozen, not responding, stuck |
| performance | High | FPS drops, lag, stutter |
| network | High | Server issues, disconnect, timeout |
| iap | High | Missing purchase, billing errors |
| battery | Medium | Battery drain, overheating |
| update | Medium | Update broke the game |
| device_compat | Medium | Won't install, black screen |
| loading | Medium | Infinite load, won't launch |
| ads | Low | Too many ads, unskippable |
| storage | Low | Takes too much space |
Edit config/settings.json to:
- Add/remove games from the crawl list (needs
play_idand/orapple_id) - Add/remove Reddit subreddits
- Set report threshold (minimum reports for an issue to surface)
- Add API keys for Supercell, Reddit OAuth
20 top mobile games pre-configured: Genshin Impact, PUBG Mobile, Call of Duty Mobile, Clash of Clans, Clash Royale, Brawl Stars, Roblox, Candy Crush Saga, Among Us, Mobile Legends, Pokemon GO, Subway Surfers, Honkai: Star Rail, Diablo Immortal, Stumble Guys, Monopoly GO!, Royal Match, AFK Journey, Fortnite, Minecraft
Add entries to mobile_games in config/settings.json:
{
"name": "Your Game",
"play_id": "com.developer.gameid",
"apple_id": "123456789"
}Find the Play ID from the Google Play URL and the Apple ID from the App Store URL.
