Skip to content

ring buffer that manages memory in chunks to support large capacity for data bursts with low overhead when small

License

Notifications You must be signed in to change notification settings

toolbuilder/dynamic-ring-buffer

Repository files navigation

DynamicRingBuffer

DynamicRingBuffer implements classic fixed length ring buffer, or circular queue. Memory is dynamically allocated and deallocated in chunks as the buffer grows and shrinks. This allows the buffer to have a large capacity to handle data bursts, while minimizing memory use during normal operation.

When the buffer length reaches capacity, the oldest values are quietly thrown away. The methods match the Array signature for push, pop, unshift, and shift. For buffer operation either use push/shift together, or unshift/pop together.

DynamicRingBuffer is a minimal implementation developed for use with Await-For-It iterable queues.

There are two related buffers:

  • RingBuffer ring buffer with fixed maximum size - faster than Array as a buffer.
  • PriorityBuffer that uses your comparator to buffer items in priority order.

There are lots of ring buffer implementations on NPM. This implementation:

  • Dynamically allocates and deallocates in chunks to reduce memory use when not needed.
  • Drop in replacement for Array to convert a buffer to a ring buffer.
  • Defines exports and module properties in package.json pointing to the ES source for bundlers.
  • Dual module that provides both ES and CommonJS entry points.
  • Provides Symbol.iterator generator.

Installation

npm install --save @toolbuilder/dynamic-ring-buffer

Getting Started

The API documentation is here. This is a quick example to get you started.

import { DynamicRingBuffer } from '@toolbuilder/dynamic-ring-buffer'
const log = console.log

const ringBuffer = new DynamicRingBuffer(100, 10000) // max length 10000 in chunks of 100
log(ringBuffer.length) // prints 0

['A', 'B', 'C'].forEach(x => ringBuffer.push(x))
log(ringBuffer.length) // prints 3
log(ringBuffer.front()) // prints 'A'
log(ringBuffer.back()) // prints 'C'
log(ringBuffer.shift()) // pulls 'A' off front and prints 'A'
log(ringBuffer.length) // prints 2
log([...ringBuffer]) // prints ['B', 'C']
log(ringBuffer.length) // prints 2

Alternatives

There are lots of alternatives on npm.

Contributing

Contributions are welcome. Please create a pull request.

  • I use pnpm instead of npm.
  • Run the unit tests with pnpm test
  • Package verification requires pnpm to be installed globally.
    • npm install -g pnpm
    • pnpm install
    • pnpm test to run unit tests
    • pnpm run check:packfile to test the pack file against Node ES and CommonJS projects, as well as Electron.
    • pnpm run check to validate the package is ready for commit

Issues

This project uses Github issues.

License

MIT

About

ring buffer that manages memory in chunks to support large capacity for data bursts with low overhead when small

Resources

License

Stars

Watchers

Forks

Packages

No packages published