Skip to content

Commit

Permalink
Add actual README.md contents. Heh.
Browse files Browse the repository at this point in the history
  • Loading branch information
jeremycole committed Apr 9, 2012
1 parent cf6e010 commit 6ac7738
Showing 1 changed file with 34 additions and 4 deletions.
38 changes: 34 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,37 @@
Twitter MySQL 5.5
=================
# Twitter MySQL 5.5 #

This is Twitter's MySQL development branch, which is based on MySQL 5.5 as published by Oracle on [https://launchpad.net/mysql-server](MySQL on Launchpad).
This is [http://twitter.com/](Twitter)'s MySQL development branch, which is based on MySQL 5.5 as published by Oracle on [https://launchpad.net/mysql-server](MySQL on Launchpad).

This repository is published in order to share code and information and is *not intended to be used directly* outside of Twitter. We provide no guarantees of maintenance, compatibility, or suitability for any user outside of Twitter.
This repository is published in order to share code and information and is *not intended to be used directly outside of Twitter*. We provide no guarantees of bug fixes, ongoing maintenance, compatibility, or suitability for any user outside of Twitter.

The original README file provided with the upstream MySQL release can be found at [README-MySQL](README-MySQL).

# Features in Twitter MySQL #

## Additional status variables ##

Additional status variables have been added, particularly from the internals of InnoDB. This allows us to monitor our systems more effectively and understand their behavior better when handling production workloads. The variables added are:

* The number of InnoDB files and tablespace files opened, closed, and currently open. This information was previously not exposed by InnoDB.
* The number of deadlocks encountered. This information was previously not exposed by InnoDB.
* The current log sequence number (LSN) as well as the LSN flushed up to and checkpointed up to. This information has previously been available in `SHOW ENGINE INNODB STATUS`.

## Optimization of memory allocation under NUMA ##

On most recent multi-processor systems, a [http://en.wikipedia.org/wiki/Non-Uniform_Memory_Access](non-uniform memory access NUMA) (NUMA) architecture is in use, which divides the total system memory across multiple NUMA "nodes". When allocating large amounts of memory to InnoDB's buffer pool, as is typical, some inefficiencies as well as serious problems can be encountered. More details about the The following changes have been made to optimize and improve this:

* An option has been added to forcibly pre-allocate the entire buffer pool during startup. This is primarily intended to force the system to decide which pages to allocate, and on which NUMA node to allocate them. If the buffer pool can't be fully allocated for any reason, InnoDB will abort during startup.
* An option has been added to `mysqld_safe` to wrap the start of `mysqld` with `numactl --interleave=all` to interleave memory allocation between all NUMA nodes available. This ensures that no NUMA node is favored for any allocation, so that memory usage will remain even over time between multiple NUMA nodes.
* An option has been added to `mysqld_safe` to flush the operating system buffer caches before startup (on Linux only). Linux will normally not evict optional caches to make new allocations unless the system is under memory pressure, which can cause supposedly evenly interleaved memory allocations to still be done unevenly, favoring the node with less data cached before startup. Flushing the caches before startup ensures that no large cache allocations are present in the system before InnoDB allocates its buffer pool.

## Server-side query timeout ##

* Reduced unnecessary work through improved server-side statement timeout support. This allows the server to proactively cancel queries that run longer than a millisecond-granularity timeout.

## Buffer pool export and restore by pre-fetch ##

* Export and restore InnoDB buffer pool in using a safe and lightweight method. This enables us to build tools to support rolling restarts of our services with minimal pain.

## Optimization for solid-state drives (SSDs) ##

* Optimize MySQL for SSD-based machines, including page-flushing behavior and reduction in writes to disk to improve lifespan.

0 comments on commit 6ac7738

Please sign in to comment.