Contents

• 1   Python Arsenal
  • 1.1   Database
    • 1.1.1   PostgreSQL
    • 1.1.2   Redis
    • 1.1.3   Other
    • 1.1.4   Sqlite
    • 1.1.5   MongoDB
    • 1.1.6   MySQL
    • 1.1.7   MicroSoft SQL
  • 1.2   Restful API
  • 1.3   Cache
  • 1.4   Test
  • 1.5   Python
  • 1.6   Cryptography
  • 1.7   Data Structure
    • 1.7.1   Tree
    • 1.7.2   Queue
  • 1.8   Cralwer
  • 1.9   Natural Language Process
    • 1.9.1   Chinese
  • 1.10   Funtional Programming
  • 1.11   Document
    • 1.11.1   Sphinx
  • 1.12   Library Improvement
  • 1.13   Search Engine
  • 1.14   Data Science
    • 1.14.1   Machine Learning
    • 1.14.2   Visualization
    • 1.14.3   Core
    • 1.14.4   Statistic
  • 1.15   Data IO
    • 1.15.1   XML
    • 1.15.2   JSON
    • 1.15.3   CSV
    • 1.15.4   YAML
  • 1.16   Profiler
  • 1.17   String
  • 1.18   ORM
    • 1.18.1   MongoDB ORM
    • 1.18.2   SQL
  • 1.19   Data Validation
  • 1.20   PostScript
  • 1.21   Date Time
  • 1.22   Logging
  • 1.23   ASCII Table

1   Python Arsenal

List of stable, actively maintained, rich featured, fully tested, documented Python Package.

Organized by usage.

1.1   Database

• dataset - Toolkit for Python-based database access.
• sqlalchemy - Database Abstraction Library
• sqlalchemy_mate - A library extend sqlalchemy module, makes CRUD easier.

1.1.1   PostgreSQL

PostgreSQL driver.

• pygresql - Python PostgreSQL Interfaces
• pysqlite - DB-API 2.0 interface for SQLite 3.x

1.1.2   Redis

Redis driver.

• redis - Python client for Redis database and key-value store

1.1.3   Other

Other database implementation or driver.

• tinydb - TinyDB is a tiny, document oriented database optimized for your happiness :)
• ZODB - ZODB, a Python object-oriented database

1.1.4   Sqlite

Sqlite driver.

• pysqlite - DB-API 2.0 interface for SQLite 3.x

1.1.5   MongoDB

• mongomock - Fake pymongo stub for testing simple MongoDB-dependent code
• pymongo - Python driver for MongoDB <http://www.mongodb.org>
• pymongo_mate - A library extend pymongo module, makes CRUD easier, and more.

1.1.6   MySQL

• PyMySQL - Pure Python MySQL Driver

1.1.7   MicroSoft SQL

MSSQL driver.

• pymssql - DB-API interface to Microsoft SQL Server for Python. (new Cython-based version)

1.2   Restful API

Framework to build database restful API

• eve - Python REST API for Humans.
• Flask-Restless - A Flask extension for easy ReSTful API generation

1.3   Cache

• beaker - A Session and Caching library with WSGI Middleware
• cachetools - Extensible memoizing collections and decorators
• diskcache - Disk Cache -- Disk and file backed persistent cache.
• lru-dict - An Dict like LRU container.
• pylru - A least recently used (LRU) cache implementation

1.4   Test

• codecov - Hosted coverage reports for GitHub, Bitbucket and Gitlab
• mock - Rolling backport of unittest.mock for all Pythons
• pytest - pytest: simple powerful testing with Python
• pytest-cov - Pytest plugin for measuring coverage.
• tox - tox is a generic virtualenv management and test command line tool

1.5   Python

Python programming related.

• autopep8 - A tool that automatically formats Python code to conform to the PEP 8 style guide
• six - Python 2 and 3 compatibility utilities

1.6   Cryptography

• bcrypt - Modern password hashing for your software and your servers
• cryptography - cryptography is a package which provides cryptographic recipes and primitives to Python developers.
• rsa - Pure-Python RSA implementation
• windtalker - Super easy-to-use encryption and decryption tool

1.7   Data Structure

• attrdict - A dict with attribute-style access
• collections-extended - Extra Python Collections - bags (multisets) and setlists (ordered sets)
• cyordereddict - Cython implementation of Python's collections.OrderedDict
• ordered-set - A set that remembers its order, and allows looking up its items by their index in that order.
• orderedset - An Ordered Set implementation in Cython.
• simhash - A Python implementation of Simhash Algorithm
• sortedcontainers - Sorted Containers -- Sorted List, Sorted Dict, Sorted Set

1.7.1   Tree

• BTrees - Scalable persistent object containers

1.7.2   Queue

• queuelib - Collection of persistent (disk-based) and non-persistent (memory-based) queues
• rq - RQ is a simple, lightweight, library for creating background jobs, and processing them.

1.8   Cralwer

• apipool - Multiple API Key Manager
• beautifulsoup4 - Screen-scraping library
• crawlib - tool set for crawler project.
• pytq - A Task Queue Scheduler Framework.
• requests - Python HTTP for Humans.
• scrapy - A high-level Web Crawling and Web Scraping framework
• selenium -

1.9   Natural Language Process

• gensim - Python framework for fast Vector Space Modelling
• nltk - Natural Language Toolkit
• spacy - Industrial-strength Natural Language Processing (NLP) in Python
• textblob - Simple, Pythonic text processing. Sentiment analysis, part-of-speech tagging, noun phrase parsing, and more.

1.9.1   Chinese

• jieba - Chinese Words Segmentation Utilities
• pinyin - Translate chinese chars to pinyin based on Mandarin.dat

1.10   Funtional Programming

• cytoolz - Cython implementation of Toolz: High performance functional utilities
• toolz - List processing tools and functional utilities

1.11   Document

1.11.1   Sphinx

• cloud_sptheme - a nice sphinx theme named 'Cloud', and some related extensions
• docfly - A utility tool to help you build better sphinx documents.
• sphinx - Python documentation generator
• sphinx_bootstrap_theme - Sphinx Bootstrap Theme.
• sphinx_rtd_theme - Read the Docs theme for Sphinx

1.12   Library Improvement

Package that make other package easier to use / more powerful.

• attrs_mate - A plugin extends power of attrs library.
• inspect_mate - Extend the inspect standard library.
• mongoengine_mate - Utility methods for MongoDB ORM, built on top of mongoengine.
• pandas_mate - Provide utility method for pandas.
• pathlib_mate - An extended and more powerful pathlib.
• pymongo_mate - A library extend pymongo module, makes CRUD easier, and more.
• sqlalchemy_mate - A library extend sqlalchemy module, makes CRUD easier.

1.13   Search Engine

• whoosh - Fast, pure-Python full text indexing, search, and spell checking library.

1.14   Data Science

1.14.1   Machine Learning

• orange - Orange, a component-based data mining framework.
• scikit-learn - A set of python modules for machine learning and data mining

1.14.2   Visualization

• bokeh - Interactive plots and applications in the browser from Python
• folium - Make beautiful maps with Leaflet.js & Python
• matplotlib - Python plotting package
• seaborn - seaborn: statistical data visualization

1.14.3   Core

• numpy - NumPy is the fundamental package for array computing with Python.
• pandas - Powerful data structures for data analysis, time series, and statistics
• scipy - SciPy: Scientific Library for Python

1.14.4   Statistic

• statistics - A Python 2.* port of 3.4 Statistics Module
• statsmodels - Statistical computations and models for Python

1.15   Data IO

1.15.1   XML

• lxml - Powerful and Pythonic XML processing library combining libxml2/libxslt with the ElementTree API.

1.15.2   JSON

• json_tricks - Extra features for Python's JSON: comments, order, numpy, pandas, datetimes, and many more! Simple but customizable.
• jsonpickle - Python library for serializing any arbitrary object graph into JSON
• superjson - Extendable json encode/decode library.
• ujson - Ultra fast JSON encoder and decoder for Python

1.15.3   CSV

• tablib - Format agnostic tabular data library (XLS, JSON, YAML, CSV)

1.15.4   YAML

• PyYAML - YAML parser and emitter for Python

1.16   Profiler

profiling is a form of dynamic program analysis that measures, for example, the space (memory) or time complexity of a program, the usage of particular instructions, or the frequency and duration of function calls. Most commonly, profiling information serves to aid program optimization.

• line_profiler - Line-by-line profiler.
• memory_profiler - A module for monitoring memory usage of a python program
• Performance Profiler
• psutil - Cross-platform lib for process and system monitoring in Python.

1.17   String

• fuzzywuzzy - Fuzzy string matching in python
• parse - parse() is the opposite of format()
• python-Levenshtein - Python extension for computing string edit distances and similarities.

1.18   ORM

Object-Relational Mapper

1.18.1   MongoDB ORM

• Ming - Bringing order to Mongo since 2009
• mongoengine - MongoEngine is a Python Object-Document Mapper for working with MongoDB.

1.18.2   SQL

Relational Database System ORM.

• peewee - a little orm
• pony - Pony Object-Relational Mapper
• sqlalchemy - Database Abstraction Library

1.19   Data Validation

• attrs - Classes Without Boilerplate
• cerberus - Lightweight, extensible schema and data validation tool for Python dictionaries.
• marshmallow - A lightweight library for converting complex datatypes to and from native Python datatypes.

1.20   PostScript

Unlike Awesome Python, it just include the package I personally like, and tried.

1.21   Date Time

Date time, manipulation and time zone.

• python-dateutil - Extensions to the standard Python datetime module
• pytz - World timezone definitions, modern and historical
• rolex - An elegant datetime library.

1.22   Logging

Libraries for generating and working with logs.

• daiquiri - Library to configure Python logging easily
• Logbook - A logging replacement for Python
• loggerFactory - Provide several commonly used logger.
• pygogo - A Python logging library with super powers

1.23   ASCII Table

• prettypandas - Pandas Styler for Report Quality Tables.
• PTable - A simple Python library for easily displaying tabular data in a visually appealing ASCII table format
• tabulate - Pretty-print tabular data