Skip to content
/ LRU-C Public
forked from LeeBohyun/LRU-C

LRU-C: Parallelizing Database I/Os for Flash SSDs (VLDB 2023)

License

Notifications You must be signed in to change notification settings

FlashSQL/LRU-C

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LRU-C

LRU-C: Parallelizing Database I/Os for Flash SSDs

Publication

  • Bohyun Lee, Mijin An, and Sangwon Lee, "LRU-C: Parallelizing Database I/Os for Flash SSDs", VLDB'23 (to appear)

Abstract

The conventional database buffer managers have two inherent sources of I/O serialization: read stall and mutex conflict. The serialized I/O makes storage and CPU under-utilized, limiting transaction throughput and latency. Such harm stands out on flash SSDs with asymmetric read-write speed and abundant I/O parallelism.

To make database I/Os parallel and thus leverage the parallelism in flash SSDs, we propose a novel approach to database buffering, the LRU-C method. It introduces the LRU-C pointer that points to the least-recently-used-clean page in the LRU list. Upon a page miss, LRU-C selects the current LRU-clean page as a victim and adjusts the pointer to the next LRU-clean one in the LRU list. This way, LRU-C can avoid the I/O serialization of read stalls. The LRU-C pointer enables two further optimizations for higher I/O throughput: dynamic-batch-write and parallel LRU-list manipulation. The former allows to flush more dirty pages at a time, while the latter does to mitigate two mutex-induced I/O serializations. Experiment result from running OLTP workloads using MySQL-based LRU-C prototype on flash SSDs shows that it improves transaction throughput over the vanilla MySQL and the state-of-the-art solution by 3x and 2x, respectively, and also cut the tail latency drastically. Though LRU-C might compromise the hit ratio slightly, its increased I/O throughput far offsets the reduced hit ratio.

Link to slides

The pdf file summarizes the main concept of LRU-C. I hope you can better understand our paper with this slide.

Modified files

Modified parts in files are marked with For LRU-C with comments in the source code. Modifications are made only in the following files in LRU-C/storage/innobase/buf and LRU-C/storage/innobase/include.

  • buf0lru.cc
  • buf0flu.cc
  • buf0buf.cc
  • buf0lru.h
  • buf0buf.h

How to run TPC-C@MySQL with LRU-C

  1. Download the LRU-C source code and unzip the file.
$ wget https://github.com/LeeBohyun/LRU-C/archive/refs/heads/main.zip
$ unzip main.zip
  1. Build and initialize MySQL. Conider LRU-C-main as mysql-5.6.26 from the installation guide link.
  1. Run TPC-C and check out the result!

About

LRU-C: Parallelizing Database I/Os for Flash SSDs (VLDB 2023)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 56.9%
  • C 32.1%
  • Java 4.2%
  • Perl 2.5%
  • NASL 0.8%
  • Yacc 0.7%
  • Other 2.8%