Permalink
Browse files

Fix incorrect link. Fix projects page. Add job listing.

  • Loading branch information...
1 parent 0e274b9 commit 348995ba061aa98a15690a2b4d1b1514201c6dad @jkreps jkreps committed Apr 26, 2009
Showing with 11 additions and 92 deletions.
  1. +1 −1 www/design.php
  2. +5 −0 www/index.php
  3. +1 −91 www/projects.php
  4. +4 −0 www/style.css
View
@@ -86,7 +86,7 @@
</p>
<p>
-<a href="http://en.wikipedia.org/wiki/Two-phase_commit_protocol">Consistent hashing</a> is a technique that avoids these problems, and we use it to compute the location of each key on the cluster. Using this technique voldemort has the property that when a server fails load will distribute equally over all remaining servers in the cluster. Likewise when a new server is added to a cluster of <i>S</i> servers, only 1/(<i>S</i>+1) values must be moved to the new machine.
+<a href="http://en.wikipedia.org/wiki/Consistent_hashing">Consistent hashing</a> is a technique that avoids these problems, and we use it to compute the location of each key on the cluster. Using this technique voldemort has the property that when a server fails load will distribute equally over all remaining servers in the cluster. Likewise when a new server is added to a cluster of <i>S</i> servers, only 1/(<i>S</i>+1) values must be moved to the new machine.
</p>
<p>
View
@@ -1,5 +1,10 @@
<?php require "includes/header.inc" ?>
+<div class="advert-message">
+ Interested in this project? LinkedIn is looking for outstanding engineers to work on Project Voldemort, Hadoop, and other pieces of our data infrastructure.
+ See the job description <a href="http://www.linkedin.com/jobs?viewJob=&jobId=674770">here</a> for more info.
+</div>
+
<h3>Voldemort is a distributed key-value storage system</h3>
<ul>
<li>Data is automatically replicated over multiple servers.</li>
View
@@ -3,11 +3,7 @@
<h2>Fun Projects</h2>
<p>
-This is a list of fun project ideas created for the Google Summer of Code application, but of course this is open source so the ideas are open to everyone. The useful skills section is meant as a guide, no one ever knows everything they need, so this could be taken as the skills you would gain by doing the project.
-</p>
-
-<p>
-If you think you might be interested in one of these projects, or if you want to discuss which might be a good fit for you, contact jay.kreps@{google email host name}.com.
+This is a list of fun project ideas that no one is currently working on.
</p>
<h3>1. Views</h3>
@@ -28,18 +24,6 @@
A more powerful implementation would provide a dynamic interface for creating and removing views via providing a simple transformation function in JVM-based language such as Scala or javascript.
</p>
-<p>
-<b>Useful Skills</b>: Java, Scala (or other JVM-based scriptable language), Java reflection
-</p>
-
-<p>
-<b>Difficulty</b>: Medium
-</p>
-
-<p>
-<b>Project Contact</b>: Jay
-</p>
-
<h3>2. Publish/Subscribe API</h3>
<p>Storage systems have become much more specialized in recent years with each system providing expertise in certain areas--Hadoop and proprietary data warehouses provide batch processing capabilities, Search indexes provide support for complex ranked text queries, and a variety of distributed databases have sprung up. Voldemort is a specialized key-value system, but the same data stored in Voldemort may need to be indexed by search, churned over in hadoop, or otherwise processed by another system. Each of these systems needs the ability to subscribe to the changes happening in Voldemort and get a stream of such changes that they can process in their own specialized way.
@@ -51,14 +35,6 @@
<p>The api that would be provided would be something like getAllChangesSince(int changeNumber), and this api would provide the latest change for each key.
-<p><b>Useful Skills</b>: Java, Distributed Systems</p>
-
-<p><b>Difficulty</b>: Hard</p>
-
-<p>
-<b>Project Mentor</b>: Anmol
-</p>
-
<h3>3. New Clients</h3>
<p>
@@ -73,18 +49,6 @@
The network protocol is pluggable so a slightly more difficult implementation could add both a network protocol and a client (say in a language not well supported by protocol buffers).
</p>
-<p>
-<b>Useful Skills</b>: Interface design, protocol buffers, first-rate knowledge of a non-java programming language, at least passing familiarity with Java
-</p>
-
-<p>
-<b>Difficulty</b>: Low to medium
-</p>
-
-<p>
-<b>Project Contact</b>: Bhupesh
-</p>
-
<h3>4. Geographical Data Distribution</h3>
<p>
@@ -99,36 +63,12 @@
A full implementation would come with tests that add artificial timeouts and test correct routing decisions. An excellent implementation would also come with an Amazon EC2 test that ran in multiple EC2 availability regions (i.e. in actual geographically distributed data centers).
</p>
-<p>
-<b>Useful Skills</b>: Java, distributed systems
-</p>
-
-<p>
-<b>Difficulty</b>: Medium
-</p>
-
-<p>
-<b>Project Contact</b>: Bhupesh
-</p>
-
<h3>5. NIO based server</h3>
<p>
The socket server uses a single-thread per connection. This approach is very efficient, but becomes less efficient for scaling beyond hundreds of connections. An NIO socket server could be plugged in for better support for very large clusters. The deliverable would be a NIO-based connector that could be plugged in in place of the existing approach when appropriate.
</p>
-<p>
-<b>Useful Skills</b>: Java, network programming
-</p>
-
-<p>
-<b>Difficulty</b>: Medium
-</p>
-
-<p>
-<b>Project Contact</b>: Jay
-</p>
-
<h3>6. Operational Interface</h3>
<p>
@@ -139,18 +79,6 @@
Part of this project would be providing remote access to the administrative functionality that the GUI can invoke. Some of the basic administrative functionality could be shared with the Scala shell project.
</p>
-<p>
-<b>Useful Skills</b>: Java, HTML, CSS, web programming
-</p>
-
-<p>
-<b>Difficulty</b>: Low to medium depending on the level of functionality targeted.
-</p>
-
-<p>
-<b>Project Contact</b>: Jay
-</p>
-
<h3>7. Scala Voldemort Shell</h3>
<p>
@@ -161,18 +89,6 @@
Part of this project would be providing the administrative commands that the shell could invoke. Some of the basic administrative functionality could be shared with the Operational Interface project.
</p>
-<p>
-<b>Useful Skills</b>: Scala, Java, Interface Design
-</p>
-
-<p>
-<b>Difficulty</b>: Low
-</p>
-
-<p>
-<b>Project Contact</b>: Jay
-</p>
-
<h3>8. Export Data to Hadoop</h3>
<p>
@@ -184,11 +100,5 @@
<p>
Since Voldemort is an online system it is important that the streaming data transfer does not impact the performance of the system too severely (it may need some throttling).
</p>
-<p>
-<b>Useful Skills</b>: Hadoop, Java
-</p>
-<p>
-<b>Project Contact</b>: Bhupesh
-</p>
<?php require "includes/footer.inc" ?>
View
@@ -70,4 +70,8 @@ a {
.data-table th {
background-color: #ccc;
font-weight: bold;
+}
+.advert-message {
+ border: 3px solid #8b0000;
+ padding: 15px;
}

0 comments on commit 348995b

Please sign in to comment.