Skip to content


Subversion checkout URL

You can clone with
Download ZIP
Commits on Dec 11, 2014
  1. @cmumford

    Add benchmark that measures cost of repeatedly opening the database.

    Sanjay Ghemawat authored cmumford committed
  2. @cmumford
  3. @cmumford

    Clean up layering of storage/leveldb/...

    cmumford authored
    With these changes, this package should be properly cleaned up and not require
    any further changes.
  4. @cmumford

    Added a new fault injection test.

    cmumford authored
    This test is intended to ensure leveldb properly detects and recovers from
    faults - specifically unwritten file data lost as a result of a system reset.
Commits on Sep 16, 2014
  1. @cmumford

    Release 1.18

    cmumford authored
    Changes are:
    * Update version number to 1.18
    * Replace the basic fprintf call with a call to fwrite in order to
      work around the apparent compiler optimization/rewrite failure that we are
      seeing with the new toolchain/iOS SDKs provided with Xcode6 and iOS8.
    * Fix ALL the header guards.
    * Createed a with the LevelDB project description.
    * A new CONTRIBUTING file.
    * Don't implicitly convert uint64_t to size_t or int.  Either preserve it as
      uint64_t, or explicitly cast. This fixes MSVC warnings about possible value
      truncation when compiling this code in Chromium.
    * Added a DumpFile() library function that encapsulates the guts of the
      "leveldbutil dump" command. This will allow clients to dump
      data to their log files instead of stdout. It will also allow clients to
      supply their own environment.
    * leveldb: Remove unused function 'ConsumeChar'.
    * leveldbutil: Remove unused member variables from WriteBatchItemPrinter.
    * OpenBSD, NetBSD and DragonflyBSD have _LITTLE_ENDIAN, so define
      PLATFORM_IS_LITTLE_ENDIAN like on FreeBSD. This fixes:
       * issue #143
       * issue #198
       * issue #249
    * Switch from <cstdatomic> to <atomic>. The former never made it into the
      standard and doesn't exist in modern gcc versions at all.  The later contains
      everything that leveldb was using from the former.
      This problem was noticed when porting to Portable Native Client where no memory
      barrier is defined.  The fact that <cstdatomic> is missing normally goes
      unnoticed since memory barriers are defined for most architectures.
    * Make Hash() treat its input as unsigned.  Before this change LevelDB files
      from platforms with different signedness of char were not compatible. This
      change fixes: issue #243
    * Verify checksums of index/meta/filter blocks when paranoid_checks set.
    * Invoke all tools for iOS with xcrun. (This was causing problems with the new
      XCode 5.1.1 image on pulse.)
    * include <sys/stat.h> only once, and fix the following linter warning:
      "Found C system header after C++ system header"
    * When encountering a corrupted table file, return Status::Corruption instead of
    * Support cygwin as build platform, patch is from
    * Fix typo, merge patch from
    * Fix typos and comments, and address the following two issues:
      * issue #166
      * issue #241
    * Add missing db synchronize after "fillseq" in the benchmark.
    * Removed unused variable in SeekRandom: value (issue #201)
Commits on May 1, 2014
  1. @cmumford

    Release LevelDB 1.17

    cmumford authored
    - Cleanup: delete unused IntSetToString
      It was added in http://cr/19491949 (and was referenced at the time).
      The last reference was removed in http://cr/19507363.
      This fixes warning/error with pre-release crosstoolv18:
        'std::string leveldb::{anonymous}::IntSetToString(const std::set<long unsigned int>&)' defined but not used [-Werror=unused-function]
    - Added arm64 and and armv7s to IOS build as suggested on leveldb mailing list.
    - Changed local variable type from int to size_t
      This eliminates compiler warning/error and resolves
Commits on Feb 10, 2014
  1. Release LevelDB 1.16

    David Grogan authored
    - Make Log::Reader not report a corruption when the last record in a
      log file is truncated.
    - Fix issue 224: variable created but not utilized.
    - Remove comment that referenced a removed feature.
Commits on Dec 10, 2013
  1. Release LevelDB 1.15

    David Grogan authored
    - switched from mmap based writing to simpler stdio based writing. Has a
      minor impact (0.5 microseconds) on microbenchmarks for asynchronous
      writes. Synchronous writes speed up from 30ms to 10ms on linux/ext4.
      Should be much more reliable on diverse platforms.
    - compaction errors now immediately put the database into a read-only
      mode (until it is re-opened). As a downside, a disk going out of
      space and then space being created will require a re-open to recover
      from, whereas previously that would happen automatically. On the
      plus side, many corruption possibilities go away.
    - force the DB to enter an error-state so that all future writes fail
      when a synchronous log write succeeds but the sync fails.
    - repair now regenerates sstables that exhibit problems
    - fix issue 218 - Use native memory barriers on OSX
    - fix issue 212 - QNX build is broken
    - fix build on iOS with xcode 5
    - make tests compile and pass on windows
Commits on Sep 19, 2013
  1. Release LevelDB 1.14

    David Grogan authored
    Fix issues 200, 201
    * Fix link to bigtable paper in docs.
    * New sstables will have the file extension .ldb. .sst files will
    continue to be recognized.
    * When building for iOS, use xcrun to execute the compiler. This may
    affect issue 177.
Commits on Aug 21, 2013
  1. LevelDB 1.13

    David Grogan authored
    Fix issues 77, 87, 182, 190.
    Additionally, fix the bug described in
    where a large contiguous keyspace of deleted data was not getting
    Also fix a bug where options.max_open_files was not getting clamped
Commits on Jun 13, 2013
  1. Release leveldb 1.11

    David Grogan authored
    Fixes issues
    As well as the issue reported by about
    MissingSSTFile unit test failing on windows.
Commits on May 15, 2013
  1. Release leveldb 1.10

    David Grogan authored
    Fixes issues
    147 - thanks feniksgordonfreeman
    * Remove calls to exit(1).
    * Fix unused-variable warnings from clang.
    * Fix possible overflow error related to num_restart value >= (2^32/4).
    * Add leveldbutil to .gitignore.
    * Add better log messages when Write is stalled on a compaction.
Commits on Feb 7, 2013
  1. Make DB::Open fail if sst files are missing.

    David Grogan authored
    Also, cleanup for Clang's -Wimplicit-fallthrough warning.
Commits on Jan 7, 2013
Commits on Dec 27, 2012
  1. added utility to dump leveldb files

    Sanjay Ghemawat authored
Commits on Oct 16, 2012
  1. Small fixes.

    Sanjay Ghemawat authored
    * Fix shared library building.
    * Reorganize linking commands so flags like --as-needed can be passed.
    * C binding exports version numbers.
    * Fix small typos in documention.
Commits on Oct 12, 2012
  1. Update to leveldb 1.6

    David Grogan authored
    Mmap at most 1000 files on Posix to improve performance for large databases.
    Support for more architectures (thanks to Alexander K.)
    Building and porting
    HP/UX support (issue 126)
    AtomicPointer for ia64 (issue 123)
    Sparc v9 support (issue 124)
    Atomic ops for powerpc
    Use -fno-builtin-memcmp only when using g++
    Simplify IOS build rules (issue 114)
    Use CXXFLAGS instead of CFLAGS when invoking C++ compiler (issue 118)
    Fix snappy shared library problem (issue 94)
    Fix shared library installation path regression
    Endian-ness detection tweak for FreeBSD
    Bug fixes
    Stop ignoring FLAGS_open_files in db_bench
    Make bloom test behavior agnostic to endian-ness
    Limit number of mmapped files to 1000 to improve perf for large dbs
    Do not delay for 1 second on shutdown path (issue 125)
    Make InMemoryEnv return a no-op logger
    C binding now has a wrapper for free (issue 117)
    Add thread-safety annotations
    Added an in-process lock table (issue 120)
    Make RandomAccessFile and SequentialFile non-copyable
Commits on May 30, 2012
  1. Remove static initializer; fix endian-ness detection; fix build on

    Sanjay Ghemawat authored
    various platforms; improve android port speed.
    Avoid static initializer by using a new portability interface for
    thread-safe lazy initialization.  Custom ports will need to be
    extended to implement InitOnce/OnceType/LEVELDB_ONCE_INIT.
    Fix endian-ness detection (fixes Powerpc builds).
    Build related fixes:
    - Support platforms that have unversioned shared libraries.
    - Fix IOS build rules.
    Android improvements
    - Speed up atomic pointers
    - Share more code with port_posix.
    Do not spin in a tight loop attempting compactions if the file system
    is inaccessible (e.g., if kerberos tickets have expired or if it is out
    of space).
Commits on Apr 17, 2012
  1. Added bloom filter support.

    Sanjay Ghemawat authored
    In particular, we add a new FilterPolicy class.  An instance
    of this class can be supplied in Options when opening a
    database.  If supplied, the instance is used to generate
    summaries of keys (e.g., a bloom filter) which are placed in
    sstables.  These summaries are consulted by DB::Get() so we
    can avoid reading sstable blocks that are guaranteed to not
    contain the key we are looking for.
    This change provides one implementation of FilterPolicy
    based on bloom filters.
    Other changes:
    - Updated version number to 1.4.
    - Some build tweaks.
    - C binding for CompactRange.
    - A few more benchmarks: deleteseq, deleterandom, readmissing, seekrandom.
    - Minor .gitignore update.
Commits on Mar 30, 2012
Commits on Mar 9, 2012
  1. fix LOCK file deletion to prevent crash on windows

    Sanjay Ghemawat authored
  2. added group commit; drastically speeds up mult-threaded synchronous w…

    Sanjay Ghemawat authored
    …rite workloads
Commits on Feb 2, 2012
  1. avoid very large compactions; fix build on Linux

    Sanjay Ghemawat authored
Commits on Jan 25, 2012
  1. fixed issues 66 (leaking files on disk error) and 68 (no sync of CURR…

    Sanjay Ghemawat authored
    …ENT file)
Commits on Nov 14, 2011
  1. Pass system's CFLAGS, remove exit time destructor, sstable bug fix.

    Hans Wennborg authored
    - Pass system's values of CFLAGS,LDFLAGS.
      Don't override OPT if it's already set.
      Original patch by Alessio Treglia <>:
    - Remove 1 exit time destructor from leveldb.
    - Fix problem where sstable building code would pass an
      internal key to the user comparator.
    (Sync with uptream at 25436817.)
Commits on Oct 31, 2011
  1. A number of fixes:

    Hans Wennborg authored
    - Replace raw slice comparison with a call to user comparator.
      Added test for custom comparators.
    - Fix end of namespace comments.
    - Fixed bug in picking inputs for a level-0 compaction.
      When finding overlapping files, the covered range may expand
      as files are added to the input set.  We now correctly expand
      the range when this happens instead of continuing to use the
      old range.  For example, suppose L0 contains files with the
      following ranges:
          F1: a .. d
          F2:    c .. g
          F3:       f .. j
      and the initial compaction target is F3.  We used to search
      for range f..j which yielded {F2,F3}.  However we now expand
      the range as soon as another file is added.  In this case,
      when F2 is added, we expand the range to c..j and restart the
      search.  That picks up file F1 as well.
      This change fixes a bug related to deleted keys showing up
      incorrectly after a compaction as described in Issue 44.
    (Sync with upstream @2507295)
Commits on Oct 5, 2011
  1. A number of bugfixes:

    Gabor Cselle authored
    - Added DB::CompactRange() method.
      Changed manual compaction code so it breaks up compactions of
      big ranges into smaller compactions.
      Changed the code that pushes the output of memtable compactions
      to higher levels to obey the grandparent constraint: i.e., we
      must never have a single file in level L that overlaps too
      much data in level L+1 (to avoid very expensive L-1 compactions).
      Added code to pretty-print internal keys.
    - Fixed bug where we would not detect overlap with files in
      level-0 because we were incorrectly using binary search
      on an array of files with overlapping ranges.
      Added "leveldb.sstables" property that can be used to dump
      all of the sstables and ranges that make up the db state.
    - Removing post_write_snapshot support.  Email to leveldb mailing
      list brought up no users, just confusion from one person about
      what it meant.
    - Fixing static_cast char to unsigned on BIG_ENDIAN platforms.
      Fixes	Issue 35 and Issue 36.
    - Comment clarification to address leveldb Issue 37.
    - Change license in posix_logger.h to match other files.
    - A build problem where uint32 was used instead of uint32_t.
    Sync with upstream @2440862
Commits on Sep 1, 2011
  1. Bugfixes: for Get(), don't hold mutex while writing log. authored
    - Fix bug in Get: when it triggers a compaction, it could sometimes
      mark the compaction with the wrong level (if there was a gap
      in the set of levels examined for the Get).
    - Do not hold mutex while writing to the log file or to the
      MANIFEST file.
      Added a new benchmark that runs a writer thread concurrently with
      reader threads.
      micros/op: avg  median 99   99.9  99.99  99.999 max
      before:    42   38     110  225   32000  42000  48000
      after:     24   20     55   65    130    1100   7000
    - Fixed race in optimized Get.  It should have been using the
      pinned memtables, not the current memtables.
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Commits on Aug 22, 2011
  1. Bugfix for issue 33; reduce lock contention in Get(), parallel benchm… authored
    - Fix for issue 33 (non-null-terminated result from
    - Support for running multiple instances of a benchmark in parallel.
    - Reduce lock contention on Get():
      (1) Do not hold the lock while searching memtables.
      (2) Shard block and table caches 16-ways.
      Benchmark for evaluating this change:
      $ db_bench --benchmarks=fillseq1,readrandom --threads=$n
      (fillseq1 is a small hack to make sure fillseq runs once regardless
      of number of threads specified on the command line).
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Commits on Aug 16, 2011
  1. Bugfixes for iterator and documentation. authored
    - Fix bug in Iterator::Prev where it would return the wrong key.
      Fixes issues 29 and 30.
    - Added a tweak to testharness to allow running just some tests.
    - Fixing two minor documentation errors based on issues 28 and 25.
    - Cleanup; fix namespaces of export-to-C code.
      Also fix one "const char*" vs "char*" mismatch.
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Commits on Aug 6, 2011
  1. @2302312 authored
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Commits on Aug 5, 2011
  1. C binding for leveldb, better readseq benchmark for SQLite. authored
    - Added a C binding for LevelDB.
      May be useful as a stable ABI that can be used by 
      programs that keep leveldb in a shared library, 
      or for JNI API.
    - Replaced SQLite's readseq benchmark to a more efficient version. 
      SQLite readseq speeds increased by about a factor of 2x 
      from the previous version. Also updated benchmark page to
      reflect readseq speed up.
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Commits on Jul 21, 2011
  1. Speed up Snappy uncompression, new Logger interface. authored
    - Removed one copy of an uncompressed block contents changing
      the signature of Snappy_Uncompress() so it uncompresses into a
      flat array instead of a std::string.
      Speeds up readrandom ~10%.
    - Instead of a combination of Env/WritableFile, we now have a
      Logger interface that can be easily overridden applications
      that want to supply their own logging.
    - Separated out the gcc and Sun Studio parts of atomic_pointer.h
      so we can use 'asm', 'volatile' keywords for Sun Studio.
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Commits on Jul 19, 2011
  1. Sun Studio support, and fix for test related memory fixes. authored
    - LevelDB patch for Sun Studio
      Based on a patch submitted by Theo Schlossnagle - thanks!
      This fixes Issue 17.
    - Fix a couple of test related memory leaks.
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Commits on Jul 15, 2011
  1. Small tweaks and bugfixes for Issue 18 and 19. authored
    Slight tweak to the no-overlap optimization: only push to
    level 2 to reduce the amount of wasted space when the same
    small key range is being repeatedly overwritten.
    Fix for Issue 18: Avoid failure on Windows by avoiding
    deletion of lock file until the end of DestroyDB().
    Fix for Issue 19: Disregard sequence numbers when checking for 
    overlap in sstable ranges. This fixes issue 19: when writing 
    the same key over and over again, we would generate a sequence 
    of sstables that were never merged together since their sequence
    numbers were disjoint.
    Don't ignore map/unmap error checks.
    Miscellaneous fixes for small problems Sanjay found while diagnosing
    issue/9 and issue/16 (corruption_testr failures).
    - log::Reader reports the record type when it finds an unexpected type.
    - log::Reader no longer reports an error when it encounters an expected
      zero record regardless of the setting of the "checksum" flag.
    - Added a missing forward declaration.
    - Documented a side-effects of larger write buffer sizes
      (longer recovery time).
    git-svn-id: 62dab493-f737-651d-591e-8d6aee1b9529
Something went wrong with that request. Please try again.