Skip to content
This repository

Oct 19, 2012

  1. release version

    Thilee Subramaniam authored
  2. Java access: fix typo

    Thilee Subramaniam authored
  3. QFS Java components: (a) Java access JAR source path changed, JAR ren…

    …amed to qfs-access-<ver>.jar, (b) Hadoop QFS plugin is now built and tested in QFS codebase, (c) Maven2 is used to build java components (instead of Apache Ant); it also pulls hadoop dependencies. Minor modifications to build version detection script.
    Thilee authored
  4. Mike Ovsiannikov

    Qfs access java: make all public methods of input and output channels…

    … synchronized. Fix potential spurious close() invocations from finalize() in the case where kfs_close raised exception in channel close method, and the file descriptor did not get invalidated / reset. Reset the channel file descriptor before invoking kfs_close. With the file descriptor numbers re-use not resetting file descriptor could potentially cause close of the valid file descriptor. Ensure that finalize methods do not invoke synchronized methods.
    mikeov authored

Oct 16, 2012

  1. Mike Ovsiannikov

    Qfs client: better logging of file table entries transitions to facil…

    …itate debugging.
    mikeov authored

Oct 15, 2012

  1. Mike Ovsiannikov

    Qfs client: do not attempt to queue empty read request, in order to f…

    …ix close() status code where protocol worker effectively had no requests to process.
    mikeov authored

Oct 13, 2012

  1. Mike Ovsiannikov

    Qfs client: display chunk id, version and chunk servers in chunk allo…

    …cation rpc Show() method to facilitate debugging.
    
    Meta server: display "parent" chunk allocation rpc from chunk allocation rpc method Show() to facilitate debugging. Ensure that all chunk servers that chunk allocation rpc have already successfully completed the chunk allocation or version change op are still operational before declaring chunk replica lost due to (other) chunk server allocation rpc timeout, or discarding non stable chunk replica on chunk server re-connect. This is needed to handle the case where chunk server(s) go(es) down and possibly re-connect while chunk allocation is still in-flight (waiting for replies from the other remaining chunk servers).
    mikeov authored

Oct 12, 2012

  1. Mike Ovsiannikov

    Chunk server: implement "available chunks" logic. Scan chunk director…

    …y content in "dir checker" and report available chunks to the chunk manager, which in turn reports the chunks that became available to the meta server. Declare the newly available chunk stale in the case when the chunk replica already exists. Handle meta server disconnect by re-queuing the available chunks that were part of the corresponding "available chunks" rpc in flight. Fix potential memory leak the meta server state machine with "no reply" rcp (presently only corrupt chunk) with non empty pending ops queue, by queuing "no reply" ops completion invocation into a temporary queue, and running the queue before the ops dispatch method returns. Make "isBeingReplicated" flag private and create and use the corresponding access methods.
    mikeov authored

Oct 09, 2012

  1. Mike Ovsiannikov

    Chunk server: minor code cleanup.

    mikeov authored
  2. Mike Ovsiannikov

    Merge branch 'master' of github.com:/quantcast/qfs

    mikeov authored
  3. Mike Ovsiannikov

    Qfs shell: fix help / usage messages for chmod, chgrp, and chown.

    mikeov authored

Oct 08, 2012

  1. fix formatting issues with README.md

    Thilee authored
  2. Merge branch 'readme-md' of https://github.com/maxrabin/qfs into maxr…

    …abin-readme-md
    Thilee authored
  3. Mike Ovsiannikov

    Meta server web ui: remove extraneous symbol in the copyright header.

    mikeov authored
  4. Mike Ovsiannikov

    Meta server web ui: more changes to make it work with python 2.4.

    mikeov authored
  5. Mike Ovsiannikov

    Chunk server: fix chunk lists order in the chunk server hello.

    mikeov authored
  6. Mike Ovsiannikov

    Chunk server: create interface to pass back the chunk file informatio…

    …n from chunk directories checker to chunk manager. Fix chunk size calculation in "restore" with the "trimmed" chunk files.
    mikeov authored
  7. Mike Ovsiannikov

    Meta server web ui: make it work with python 2.4

    mikeov authored
  8. Mike Ovsiannikov

    Chunk server: fix include file name.

    mikeov authored
  9. Mike Ovsiannikov

    Meta server: eliminate compiler warning.

    mikeov authored
  10. Mike Ovsiannikov

    Chunk server: cleanup and optimize chunk building chunk lists in chun…

    …k server hello by immediately writing chunk information directly into the corresponding io buffers, and then move io buffers into the connection's output buffer. Separate startup chunk file validation logic into IsValidChunkFile() method. This would allow to use the same method in both chunk server startup logic and chunk directory re-use logic in DirChecker.
    mikeov authored
  11. Mike Ovsiannikov

    Sample setup web ui configuration: add chunk server location to the l…

    …ist of the columns displayed by default on chunk servers status page.
    mikeov authored

Oct 07, 2012

  1. Mike Ovsiannikov

    Python module: fix to compile on mac os.

    mikeov authored
  2. Mike Ovsiannikov

    Chunk server: implement chunk "available chunk" rpc.

    mikeov authored
  3. Mike Ovsiannikov

    Meta server: schedule replication check after adding "available" chun…

    …k only in the case where the number of replicas doesn't match the file replication.
    mikeov authored
  4. Mike Ovsiannikov

    Meta server: do not use chunk that became available, unless chunk blo…

    …ck has one or less recovery chunks available.
    mikeov authored

Oct 06, 2012

  1. Mike Ovsiannikov

    Merge branch 'master' of github.com:/quantcast/qfs

    mikeov authored
  2. Mike Ovsiannikov

    Meta server side logic for "chunk available" rpc. The rpc to be used …

    …to convey to the meta server that certail chunk have become
    
    available. The general idea is that these chunk should be used by the meta server as of last resort.
    mikeov authored

Oct 05, 2012

  1. update the patch file with fixes to some hadoop test issues

    Thilee authored

Oct 04, 2012

  1. Mike Ovsiannikov

    Web ui: add copyright header.

    mikeov authored
  2. Mike Ovsiannikov

    Merge branch 'master' of github.com:/quantcast/qfs

    mikeov authored
  3. fix wording

    Thilee authored
  4. Mike Ovsiannikov

    Qfs tool: start on copy implementation.

    mikeov authored
  5. Mike Ovsiannikov

    Qfs tool: implement -mkdir. Fix name / url path in the error reporter.

    mikeov authored

Oct 03, 2012

  1. update benchmark link in README

    Thilee authored
Something went wrong with that request. Please try again.