Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
branch: dynamic_buf_si…
Commits on Oct 29, 2013
  1. @ferd

    shrinking of HTTP drains

    ferd authored
    Inactive drains (disconnected for too long) get shrunk down, and resized
    when going back online.
Commits on Oct 25, 2013
  1. @ferd

    Force shrinking on never-connected drains

    ferd authored
    Only a successful connection will grow the drain size.
  2. @ferd

    Add tests for TCP drain resizing

    ferd authored
  3. @ferd
  4. @ferd

    Fix buffer resizing bug

    ferd authored
    When a buffer gets resized and needs to drop data, the data is dropped,
    but the maximal value of the buffer is never brought down. This patch
    makes it so the function works as expected.
    
    This fix also removes all the unused conversion functions that were used
    in a past deploy.
Commits on Oct 24, 2013
  1. @ferd

    Dynamic resize

    ferd authored
    If a buffer is inactive for too long, its size gets shrunk to 10 instead
    of 1024, and gets re-established when reconnecting.
Commits on Oct 23, 2013
  1. @ferd

    upgrade procedure for v69.8

    ferd authored
Commits on Oct 21, 2013
  1. @ferd

    Merge branch 'v69.7'

    ferd authored
  2. @archaelus

    Merge pull request #61 from heroku/disable-api

    archaelus authored
    Adding read-only & disabled mode for Logplex API
  3. @ferd

    Adding read-only & disabled mode for Logplex API

    ferd authored
    The Disabled mode entirely shuts down access to the web API at all
    levels, including for healthchecks. Use with extreme care.
    
    The read-only mode forbids all non-GET operations outside of what v2
    canaries are allowed to do.
Commits on Oct 8, 2013
  1. @archaelus

    Merge pull request #57 from heroku/no_tail_warning

    archaelus authored
    Adds L20 - tail session forbidden message.
  2. @archaelus
  3. @archaelus
Commits on Sep 24, 2013
  1. @ferd

    Making logplex go on R16B02

    ferd authored
Commits on Sep 23, 2013
  1. @ferd

    Upgrade path for v69.5->v69.6

    ferd authored
Commits on Sep 19, 2013
  1. @ferd

    Merge pull request #58 from heroku/update-l2met-format

    ferd authored
    stop using obsolete l2met format
  2. @ferd

    Merge pull request #55 from heroku/m_equal_logplex_stats

    ferd authored
    Add m= in front of logplex_stats logging so it's easier to group in splunk
Commits on Sep 18, 2013
  1. @mikehale
Commits on Sep 16, 2013
  1. @archaelus
  2. @archaelus
Commits on Sep 5, 2013
  1. @ferd

    Changing memory allocation settings for binaries

    ferd authored
    Changing the allocator strategy for binary_alloc to do aobf rather than
    bf (+MBas aobf). Depending on how all of the binaries are allocated,
    this could make new allocations favor the same carrier. This will only
    add a small cpu overhead when allocating new binaries. This could
    however worsen our utilization even more if we are unlucky, it will
    however make allocations faster and more in the same area in the
    expected case, which should reduce fragmentation and untraceable leaks.
    
    We're also decreasing the size of our mbcs. Right now we have smbcs set
    to 256 kb and lmbcs at 5 MB (rounded up to 8MB as ERTS only allocates
    multiples of 2) and an average multi-block carrier size of 7.78 MB. We
    try to set +MBlmbcs 512 so that we get many more carriers and
    thus increase the chance that it can be returned to the OS.
    
    These two options have been recommended by members of the Erlang/OTP
    team to reduce the passive memory leaks due to allocation patterns
    compared to our peculiar use cases for log messages.
  2. @ferd
Commits on Sep 3, 2013
  1. @ferd

    Basic batchio inclusion, replaces lager macros

    ferd authored
    batches io:format calls into a buffer process to reduce the number
    of calls required and also do overload protection automatically.
    
    Experimental material to see if it helps with performance, given the
    buffering and load shedding allow to go asynchronous on log messages
    without loosing too much data.
  2. update readme with redgrid redis url env var

    Tristan Sloughter authored
Commits on Aug 29, 2013
  1. @freeformz
  2. must read in redgrid redis url from keys file, it will not be in the …

    Tristan Sloughter authored
    …os env
  3. add upgrade script for using new redgrid redis slot

    Tristan Sloughter authored
  4. use logplex_redgrid_redis config

    Tristan Sloughter authored
Commits on Aug 28, 2013
  1. @ferd
Commits on Aug 26, 2013
  1. @ferd

    v69.2 to v69.3 actually good upgrade path

    ferd authored
    Was missing a path addition for backoff to be loaded, causing a node
    failure.
Commits on Aug 23, 2013
  1. @ferd

    v69.2 to v69.2 upgrade path

    ferd authored
  2. @ferd

    Upgrade to redgrid 1.0.3

    ferd authored
    Redgrid 1.0.3 adds tolerance for DNS disconnections and configuration
    reloading.
  3. @ferd

    Raising send timeout to 5s on HTTP(s) drains

    ferd authored
    When network or drains show bad behaviour temporarily, low timeouts we
    currently have (1 second) ends up killing connections and raising the
    retry count of frames. When massive losses are seen, it makes it
    difficult to put the blame on logplex's speed at sending logs, or the
    drains consumption (or network).
    
    By raising the timeout a bit, we should reduce the reconnection rate and
    at the same time make it harder to blame logplex (as an individual node)
    for the problems.
    
    This should not have a super significant impact on the drop rate,
    however, but possibly a noticeable one.
  4. @ferd

    More reliable tests for log transmission

    ferd authored
    Log messages can land in non-sequential order due to be the receive/send
    routine. this fix makes it so we reorder all the messages received to
    verify them first.
Commits on Aug 16, 2013
  1. @ferd

    log-token inspection function

    ferd authored
    This escript allows to fetch app ids (for now) based on a given log
    token, assuming access to the local host.
Something went wrong with that request. Please try again.