Skip to content

Commit

Permalink
Added logging facility, ColorStreamHandler, and updated .gitignore
Browse files Browse the repository at this point in the history
  • Loading branch information
WilHall committed Nov 27, 2011
1 parent 5db8daf commit d9ed584
Showing 1 changed file with 9 additions and 2 deletions.
11 changes: 9 additions & 2 deletions README.md
Original file line number Original file line Diff line number Diff line change
Expand Up @@ -4,15 +4,22 @@ Setup
- DATABASE_ENGINE can either be "mysql" or "sqlite" - DATABASE_ENGINE can either be "mysql" or "sqlite"
- For sqlite only DATABASE_HOST is used, and it should begin with a '/' - For sqlite only DATABASE_HOST is used, and it should begin with a '/'
- All other DATABASE_* settings are required for mysql - All other DATABASE_* settings are required for mysql
- VERBOSE mode causes the crawler to output some stats that are generated as it goes - DEBUG mode causes the crawler to output some stats that are generated as it goes, and other debug messages
- LOGGING is a dictConfig dictionary to log output to the console and a rotating file, and works out-of-the-box, but can be modified




Current State Current State
============= =============
- mysql engine untested - mysql engine untested
- Lots of debug prints
- Issue in some situations where the database is locked and queries cannot execute. Presumably an issue only with sqlite's file-based approach - Issue in some situations where the database is locked and queries cannot execute. Presumably an issue only with sqlite's file-based approach


Logging
=======
- DEBUG+ level messages are logged to the console, and INFO+ level messages are logged to a file.
- By default, the file for logging uses a TimedRotatingFileHandler that rolls over at midnight
- Setting DEBUG in the settings toggles wether or not DEBUG level messages are output at all
- Setting USE_COLORS in the settings toggles whether or not messages output to the console use colors depending on the level.

Misc Misc
==== ====
- Designed to be able to run on multiple machines and work together to collect info in central DB - Designed to be able to run on multiple machines and work together to collect info in central DB
Expand Down

0 comments on commit d9ed584

Please sign in to comment.