Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
tree: 8c716709b4
Fetching contributors…

Cannot retrieve contributors at this time

39 lines (37 sloc) 2.407 kb
---
layout: page
title: Distributed Large Storage
group: Databases
slug: distributed-large-storage
---
<tr>
<td>
<ul>
<li>Hadoop</li>
<li>HBase, Cassandra</li>
<li>Redis NoSQL</li>
</ul>
</td>
<td>
<ul>
<li>Google MapReduce</li>
<li>Google BigTable</li>
</ul>
</td>
<td>
<ul>
<li>Hadoop is the leading platform for petabyte scale distributed data storage and processing. It is designed to detect and manage failures in commodity compute nodes, thus not relying on expensive high-availability hardware. Compatible with MapReduce APIs.</li>
<li>During 2001, several commercial offering provide support around Hadoop components, or Hadoop-like components, including from EMC, Oracle and IBM.</li>
<li>HBase is modelled after Google’s distributed database BigTable.</li>
<li>Cassandra developed and open sourced by Facebook provides faster large storage balanced by “eventual consistency”. It follows the NoSQL concept. The multi-master architecture has no single points of failure, and zero-downtime failed node replacement. Designed for highly consistent durable storage through data centre failures.</li>
<li>Redis NoSQL store is governed by VMWare</li>
</ul>
</td>
<td>
<ul>
<li>Hadoop is used by leading large scale operations including Amazon/A9 product search, Adobe, AOL, Baidu at 3000TB/week, Ebay 532 node cluster and 5.3PB, Facebook 1100-node cluster 12PB data, Hulu media service, IBM Blue Cloud Computing, Last.fm, LinkedIn, New York Times, Microsoft Powerset, Rackspace, Twitter, Yahoo with more than 40,000 nodes.<sup><a href="http://wiki.apache.org/hadoop/PoweredBy" title="PowerdBy Hadoop Wiki">ref</a></sup></li>
<li>Adobe, Powerset, Stumbleupon, Yahoo!, Twitter, and Facebook use HBase.<sup><a href="http://wiki.apache.org/hadoop/Hbase/PoweredBy" title="PowerdBy Hbase Wiki">ref</a></sup></li>
<li>Users of Cassandra for large data stores include Cisco WebEX, Digg, Facebook, Rackspace, Twitter.<sup><a href="http://en.wikipedia.org/wiki/Cassandra_(database)#Prominent_users" title="Prominent Casandra Users">ref</a> and <a href="http://cassandra.apache.org/" title="The Apache Casandra Project">ref</a></sup></li>
</ul>
</td>
</tr>
Jump to Line
Something went wrong with that request. Please try again.