Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Commits on Mar 26, 2009
  1. don't wake a replicator on repl enqueue

    dormando authored
    job_master makes this redundant. it wakes up about once per second and batches
    through everything, which is less latent in a lot of situations, just not in
    the "everything is idle" situation. So for now, this'll reduce chatter.
    
    could be reduced by further optimisations to the job_master algorithms.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1295 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Mar 25, 2009
  1. committed the wrong patch before, sorry :(

    dormando authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1294 f67b2e87-0811-0410-a7e0-dd94e48410d6
  2. Leave notes as to where locking might be implemented in SQLite.

    robbat2 authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1293 f67b2e87-0811-0410-a7e0-dd94e48410d6
  3. Document the column_type hack for SQLite.

    robbat2 authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1292 f67b2e87-0811-0410-a7e0-dd94e48410d6
  4. Add indices for schema versions 11 and 12.

    robbat2 authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1291 f67b2e87-0811-0410-a7e0-dd94e48410d6
  5. The regex to cut out INDEX clauses missed named indicess.

    robbat2 authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1290 f67b2e87-0811-0410-a7e0-dd94e48410d6
  6. column_type is used during schema upgrades.

    robbat2 authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1289 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Mar 19, 2009
  1. bugfix: fids weren't being dequeued from delete

    dormando authored
    ... until the second time they were loaded from the queue.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1288 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Mar 2, 2009
  1. Remove bad cut'n'paste comment

    ask authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1287 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Feb 28, 2009
  1. Empty files work now

    hachi authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1286 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Jan 16, 2009
  1. Update CHANGES for mogstored pidfile.

    robbat2 authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1285 f67b2e87-0811-0410-a7e0-dd94e48410d6
  2. Include a pidfile in mogstored finally, abusing the pidfile functiona…

    robbat2 authored
    …lity of perlbal.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1284 f67b2e87-0811-0410-a7e0-dd94e48410d6
  3. New FSCK work and error for BCNT for bad devcount values (they would …

    robbat2 authored
    …not otherwise be caught unless the triggered another fix).
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1283 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Jan 15, 2009
  1. If the testcases were being run with default mysql (eg empty password…

    robbat2 authored
    … for root), they tried to call mogdbsetup ... --dbpassword= ..., which mogdbsetup (Getopt::Long actually) promptly complained about. Make the password fields take an optional argument to prevent this.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1282 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Jan 12, 2009
  1. Checking in changes prior to tagging of version 2.30. Changelog diff is:

    dormando authored
    Index: CHANGES
    ===================================================================
    --- CHANGES	(revision 1279)
    +++ CHANGES	(working copy)
    @@ -1,3 +1,5 @@
    +2009-01-12: Release version 2.30
    +
             * fsck will now fix broken 'devcount' cols.
     
             * schema version bump to 12, and new delete worker code to use the new
    
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1280 f67b2e87-0811-0410-a7e0-dd94e48410d6
  2. add job master to MANIFEST

    dormando authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1279 f67b2e87-0811-0410-a7e0-dd94e48410d6
  3. Checking in changes prior to tagging of version 2.14. Changelog diff is:

    dormando authored
    Index: Changes
    ===================================================================
    --- Changes	(revision 1276)
    +++ Changes	(working copy)
    @@ -1,3 +1,7 @@
    +2.14 -- 2009-01-12
    +
    +  * Add --nobigfile option to skip bigfile parsing on large files. (dormando)
    +
       * Allow "listkey" on all files, not good for big dbs (Ask Bjoern Hansen)
     
       * Make mogtool prefer command line settings over configuration file
    
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1277 f67b2e87-0811-0410-a7e0-dd94e48410d6
  4. more changelog updates.

    dormando authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1276 f67b2e87-0811-0410-a7e0-dd94e48410d6
  5. add a generic server_setting_cached handler

    dormando authored
    I think we'd use server settings more if they were easily cached. So lets
    start. Use it for a fsck injector rate limiter.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1275 f67b2e87-0811-0410-a7e0-dd94e48410d6
  6. use new queue system for delete worker.

    dormando authored
    phase out the old queue instead of requiring an import...
    ... eventually nearly-exclusively query file_to_delete2 via job_master worker.
    
    now uses appropriate backoff for errors.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1274 f67b2e87-0811-0410-a7e0-dd94e48410d6
  7. sorry, tests were broken.

    dormando authored
    add missing ',' - had a bug in my test script, which ran the old code...
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1273 f67b2e87-0811-0410-a7e0-dd94e48410d6
  8. wrong primary key on file_to_queue

    dormando authored
    should be okay since this is between release... I'll probably add the
    necessary ALTER's anyway.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1272 f67b2e87-0811-0410-a7e0-dd94e48410d6
  9. note why file_to_queue exists.

    dormando authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1271 f67b2e87-0811-0410-a7e0-dd94e48410d6
  10. add a backoff for the old delete queue check.

    dormando authored
    prepwork for adding a new-style delete queue... we don't want to check the old
    style one once it's been drained, but as cleanly as possible.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1270 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Jan 11, 2009
  1. flip the queue algorithm, to lighten fetch reqs.

    dormando authored
    if the workers are consuming jobs super fast, the transactions can get kinda
    huge and hold up the DB a bit. Cap them at 1k for now, need to watch the
    current algo in usage before tuning further.
    
    Refill queue if less than 70% full now, so it'll work more aggressively. This
    limits job efficiency to 1k per job type per tracker per second, at most.
    
    This should be relaxed in future releases, but I'd be impressed if your
    tracker could execute 1k replication jobs per second :)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1269 f67b2e87-0811-0410-a7e0-dd94e48410d6
  2. update internal queue system to use arbitrary jobs

    dormando authored
    more like gearman's can(), a worker can state it's bored for different types
    of work, and it will then get such different types of work.
    
    also updated JobMaster so it sends a single command to fetch queue depths,
    which should simplify and speed things up a bit.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1268 f67b2e87-0811-0410-a7e0-dd94e48410d6
  3. Verify cached devcount with fsck.

    dormando authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1267 f67b2e87-0811-0410-a7e0-dd94e48410d6
  4. update changelog.

    dormando authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1266 f67b2e87-0811-0410-a7e0-dd94e48410d6
  5. fix rebalance to not weaken fids

    dormando authored
    ... if there are no writable devices, but > 1 available copy, rebalance would
    delete one of the available copies, and not reschedule for replication.
    
    I guess extra paranoia could check the device count for the fid, but this
    should be good. Note that having no writable devices now causes rebalance to
    *spin like crazy*, which is a step up from mass-deleting copies of your files.
    
    Thanks to Robbie for the bug report.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1265 f67b2e87-0811-0410-a7e0-dd94e48410d6
  6. allow overriding test db DSN info.

    dormando authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1264 f67b2e87-0811-0410-a7e0-dd94e48410d6
Commits on Jan 9, 2009
  1. Now that filter_create_sql is fixed, we do not need to duplicate this…

    robbat2 authored
    … table definition.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1263 f67b2e87-0811-0410-a7e0-dd94e48410d6
  2. Use explicit variable for test IP.

    robbat2 authored
    Make it very explicit what IP we are using to test, and avoid specifying
    it multiple times if it needs to be changed (eg the address is already
    in use.)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1262 f67b2e87-0811-0410-a7e0-dd94e48410d6
  3. Improve filter_create_sql for indices.

    robbat2 authored
    We need to allow both forms of MySQL INDEX inside a CREATE TABLE block
    when we are filtering it out. This fixes the file_to_queue issue
    properly.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1261 f67b2e87-0811-0410-a7e0-dd94e48410d6
  4. Need a slight delay on the startup and shutdown testcase for faster m…

    robbat2 authored
    …achines, otherwise it hasn't started listening in time!
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1260 f67b2e87-0811-0410-a7e0-dd94e48410d6
  5. use string comparision in postgres for errors.

    robbat2 authored
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1259 f67b2e87-0811-0410-a7e0-dd94e48410d6
Something went wrong with that request. Please try again.