Skip to content

Noctem/Monocle

Repository files navigation

Monocle

Build Status

Monocle is the distinguished Pokémon Go scanner capable of scanning large areas for spawns. Features spawnpoint scanning, Twitter and PushBullet notifications, accurate expiration times and estimates based on historical data, pokestop and gym collection, a CAPTCHA solving script, and more.

A demonstration of the Twitter notifications can be viewed here.

Distinguished Pokemon

How does it work?

It uses a database table of spawnpoints and expiration times to visit points soon after Pokemon spawn. For each point it determines which eligible worker can reach the point with the lowest speed, or tries again if all workers would be over the configurable speed limit. This method scans very efficiently and finds Pokemon very soon after they spawn, and also leads to unpredictable worker movements that look less robotic. The spawnpoint database continually expands as Pokemon are discovered. If you don't have enough accounts to keep up with the number of spawns in your database, it will automatically skip points that are unreachable within the speed limit or points that it has already seen spawn that cycle from other nearby points.

If you don't have an existing database of spawn points it will spread your workers out over the area you specify in config and collect the locations of spawn points from GetMapObjects requests. It will then visit those points whenever it doesn't have a known spawn (with its expiration time) to visit soon. So it will gradually learn the expiration times of more and more spawn points as you use it.

There's also a simple interface that displays active Pokemon on a map, and can generate nice-looking reports.

Since it uses Leaflet for mapping, the appearance and data source can easily be configured to match any of these with the MAP_PROVIDER_URL config option.

Features

  • accurate timestamp information whenever possible with historical data
  • Twitter, PushBullet, and Telegram notifications
    • references nearest landmark from your own list
  • IV/moves detection, storage, notification, and display
    • produces nice image of Pokémon with stats for Twitter
    • can configure to get IVs for all Pokémon or only those eligible for notification
  • stores Pokémon, gyms, and pokestops in database
  • spawnpoint scanning with or without an existing database of spawns
  • automatic account swapping for CAPTCHAs and other problems
  • pickle storage to improve speed and reduce database queries
  • manual CAPTCHA solving that instantly puts accounts back in rotation
  • closely emulates the client to reduce CAPTCHAs and bans
  • automatic device_info generation and retention
  • aims at being very stable for long-term runs
  • able to map entire city (or larger area)
  • reports for gathered data
  • asyncio coroutines
  • support for Bossland's hashing server
    • displays key usage stats in real time

Setting up

  1. Install Python 3.5 or later (3.6 is recommended)
  2. git clone --recursive https://github.com/Noctem/Monocle.git
  • Optionally install a custom icon package from elsewhere
  1. Copy config.example.py to monocle/config.py and customize it with your location, database information, and any other relevant settings. The comments in the config example provide some information about the options.
  2. Fill in accounts.example.csv with your own accounts and save it as accounts.csv.
  • You only need to fill in the usernames and passwords, the other columns will be generated for you if left blank.
  1. pip3 install -r requirements.txt
  • Optionally pip3 install additional packages listed in optional-requirements
    • asyncpushbullet is required for PushBullet notifications
    • peony-twitter is required for Twitter notifications
    • gpsoauth is required for logging in to Google accounts
    • shapely is required for landmarks or boundary polygons
    • selenium (and ChromeDriver) are required for manually solving CAPTCHAs
    • uvloop provides better event loop performance
    • pycairo is required for generating IV/move images
    • mysqlclient is required for using a MySQL database
    • psycopg2 is required for using a PostgreSQL database
    • aiosocks is required for using SOCKS proxies
    • cchardet and aiodns provide better performance with aiohttp
    • sanic and asyncpg (and a Postgres DB) are required for web_sanic
    • ujson for better JSON encoding and decoding performance
  1. Run python3 scripts/create_db.py from the command line
  2. Run python3 scan.py
  • Optionally run the live map interface and reporting system: python3 web.py

Note: Monocle works with Python 3.5 or later only. Python 2.7 is not supported and is not compatible at all since I moved from threads to coroutines. Seriously, it's 2017, Python 2.7 hasn't been developed for 6 years, why don't you upgrade already?

Note that if you want more than 10 workers simultaneously running, SQLite is likely not the best choice. I personally use and recommend PostgreSQL, but MySQL and SQLite should also work.

Reports

There are three reports, all available as web pages on the same server as the live map:

  1. Overall report, available at /report
  2. Single species report, available at /report/<pokemon_id>
  3. Gym statistics page, available by running gyms.py

The workers' live locations and stats can be viewed from the main map by enabling the workers layer, or at /workers (communicates directly with the worker process and requires no DB queries).

The gyms statistics server is in a separate file, because it's intended to be shared publicly as a webpage.

gyms

Getting Started Tips & FAQs

Visit our Wiki for more info.

License

See LICENSE.

This project is based on the coroutines branch of pokeminer (now discontinued). Pokeminer was originally based on an early version of PokemonGo-Map, but no longer shares any code with it. It uses aiopogo, my fork of pgoapi which uses aiohttp for asynchronous network requests.

The excellent image near the top of this README was painted by darkestnight.