Permalink
Commits on Aug 13, 2010
  1. Checking in changes prior to tagging of version 2.37.

    Changelog diff is:
    
    Index: CHANGES
    ===================================================================
    --- CHANGES	(revision 1464)
    +++ CHANGES	(working copy)
    @@ -1,3 +1,5 @@
    +2010-08-13: Release version 2.37
    +
             * Make HTTP DELETE's work reliably
     
             * Fix obscure crashes related to "unknown devices"
    
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1465 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Aug 13, 2010
  2. bump version requirement for perlbal.

    ensure people are running a version which won't leak memory for mogstored :/
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1464 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Aug 13, 2010
  3. remove socket caching for HTTP DELETE operations

    HTTPFile's delete routine was reusing the socket cache from the 'sizes'
    function, which was setting sockets to nonblock. The delete code is both
    unable to fully parse HTTP responses and also relies on the socket being in
    blocking mode.
    
    For now, lets stop caching sockets used for delete, and later replace that
    whole chunk of code with LWP.
    
    Thanks to Kiall Mac Innes for the bug report and help troubleshooting.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1462 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Aug 13, 2010
Commits on Jun 20, 2010
  1. forgot the changelog again.

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1459 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Jun 20, 2010
  2. fix potential crashes from unknown devices

    Reported and researched by John Berthels.
    
    This fixes an issue where if a monitor process can't keep up with its test
    reads and writes, it causes iostat data to back up and potentially missread
    concatenated lines.
    
    This commit fixes:
    - Monitor worker can no longer propagate devices unknown to the database.
    - Monitor worker sleeps at least 2.5 seconds between runs now.
    - mogstored flushes the read pipe for the iostat worker on death
    - Stop pushing old iostat data onto a listener socket if it's not picking it
      up.
    
    ... which all put together, fixes the bug.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1458 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Jun 20, 2010
Commits on Jun 17, 2010
  1. don't crash as easily with bad slave settings

    (tomas doran)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1457 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Jun 17, 2010
  2. Configurable connection timeouts for trackers

    (tomas doran)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1455 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Jun 17, 2010
Commits on Jun 16, 2010
  1. update_class command support

    (tomas doran)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1454 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Jun 16, 2010
  2. Distribution metadata for search.cpan.org

    (tomas doran)
    
    Some of these will change, but now I know what to edit when they do :P
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1452 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Jun 16, 2010
Commits on Apr 16, 2010
  1. Checking in changes prior to tagging of version 2.36.

    Changelog diff is:
    
    Index: CHANGES
    ===================================================================
    --- CHANGES	(revision 1449)
    +++ CHANGES	(working copy)
    @@ -1,3 +1,7 @@
    +2010-04-16: Release version 2.36
    +
    +        * Bump required version of perlbal for mogstored.
    +
             * Critical bug fix for creating files.
               If you have many dead devices, poor filter ordering could cause
               MogileFS to not consider any alive devices for new files.
    
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1450 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 16, 2010
  2. Bump version requirement for perlbal

    perlbal got a fix that makes it work a lot better with mogstored.
    
    convince people to upgrade via this.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1449 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 16, 2010
  3. Fix nasty no_devices on create_open bug.

    If you have many dead devices, it was not filtering them out.
    
    Had assumed that either fetching all devices or checking to see
    if it existed would notice if the device was dead. It does not.
    
    This also means that it used to weight all dead devices every time.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1448 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 16, 2010
Commits on Apr 8, 2010
  1. Update server rpm spec to use vendorlib

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1447 f67b2e87-0811-0410-a7e0-dd94e48410d6
    hachi committed Apr 8, 2010
Commits on Apr 7, 2010
  1. dist marker in server rpm specfile

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1444 f67b2e87-0811-0410-a7e0-dd94e48410d6
    hachi committed Apr 7, 2010
Commits on Apr 3, 2010
  1. Actually default to BIGINT for MySQL now...

    A bug resulted in this always defaulting to INT with new dbs
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1440 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 3, 2010
Commits on Apr 2, 2010
  1. Checking in changes prior to tagging of version 2.35. Changelog diff is:

    Index: CHANGES
    ===================================================================
    --- CHANGES	(revision 1437)
    +++ CHANGES	(working copy)
    @@ -1,3 +1,5 @@
    +2010-04-02: Release version 2.35
    +
             * Nuke ancient mogilefs 1.1 replication code.
               no_unreachable_tracking and old_repl_compat variables are gone.
               (dormando)
    
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1438 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 2, 2010
  2. Wipe out old replication code.

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1432 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 2, 2010
  3. Allow modifying class replpolicy strings.

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1431 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 2, 2010
Commits on Apr 1, 2010
  1. Fix a warning in the fsck status code.

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1426 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 1, 2010
  2. Better fsck logging

    Print fidid and devid when fsck fails to fix something.
    
    (Tomas Doran)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1425 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Apr 1, 2010
Commits on Mar 31, 2010
  1. dumb changelog.

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1422 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 31, 2010
  2. Fix warnings when rebalancing FIDs on busy network

    When you have rebalance working across a busy network, then the size check of
    all the copies of the fid can fail, causing a warning to be issued.
    
    (Tomas Doran)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1421 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 31, 2010
Commits on Mar 30, 2010
  1. make list_keys work with a prefix of '0'

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1419 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 30, 2010
  2. have to stop forgetting to update CHANGES

    When we're on git it'll be generated at release from commits ;)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1417 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 30, 2010
  3. Avoid interpolation errors and improve messages

    Ensure variables are initialized before printing (Tomas Doran)
    Add the full $url to the error output (Dormando)
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1416 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 30, 2010
  4. Date Mgd::log lines when being sent to STDOUT.

    Original patch/idea from Tomas Doran
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1415 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 30, 2010
Commits on Mar 29, 2010
  1. don't chew CPU on clusters with many devices.

    weighted_list gets real slow when you pass it a lot of devices.
    Ideally it should be an iterator, which we'd only end up hitting
    a few times. It'd still slow down with many devs but not as badly.
    
    However I want to rework the algorithm to scale against free space
    better (probably just throw a log() in there), so lets rework that
    later. This change focues writes on the top 20 emptiest devices,
    which tends to be what people expect it to to do anyway.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1412 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 29, 2010
  2. Flatten the grab_* routines.

    Work around a bug in DBI/DBD::mysql where RaiseError doesn't
    properly bomb out on deadlock errors. Instead it clears the error,
    and bombs on missing columns for the internal fetchall_hashref.
    Also properly runs ROLLBACK on errors.
    
    This cleans up some bizarre crashes.
    
    Also cleaned up the whole routine while I was in there.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1411 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 29, 2010
Commits on Mar 24, 2010
  1. Dependencies patch from Tomas Doran

    Note from dormando: I removed the 'DBD::mysql' dep again.
    
    Technically it requires "a" database. Not sure how to properly
    have the tests whine about that offhand, but it should be a
    separate patch.
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1410 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Mar 24, 2010
Commits on Jan 8, 2010
  1. Update CHANGES

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1407 f67b2e87-0811-0410-a7e0-dd94e48410d6
    ask committed Jan 8, 2010
  2. Allow list_key searches with a '0' prefix

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1406 f67b2e87-0811-0410-a7e0-dd94e48410d6
    ask committed Jan 8, 2010
Commits on Dec 31, 2009
  1. sorry, put the parent_ping in the wrong place.

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1404 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Dec 31, 2009
  2. reaper was badly tuned...

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1403 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Dec 31, 2009
Commits on Dec 6, 2009
  1. Checking in changes prior to tagging of version 2.34. Changelog diff is:

    Index: CHANGES
    ===================================================================
    --- CHANGES	(revision 1396)
    +++ CHANGES	(working copy)
    @@ -1,3 +1,5 @@
    +2009-12-05: Release version 2.34
    +
             * Fix bug in new copycount reduction code. If it was more than off by
               one it wouldn't reduce the count properly.
     
    
    
    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1397 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Dec 6, 2009
  2. Add TESTING to manifest

    git-svn-id: http://code.sixapart.com/svn/mogilefs/trunk@1396 f67b2e87-0811-0410-a7e0-dd94e48410d6
    dormando committed Dec 6, 2009