[C++] Add traceable general purpose queue(s)

[asfimport]

There are a few places we queue data/jobs today (e.g. readahead, thread pool).   In order to reduce complexity (single responsibility) and add traceability (so we can tell where queues are filling up)  we should create general purpose queues (e.g. the boost lockfree one) and add some basic performance counters/events (queue size, queue full, queue starved).

We will need multiple queue implementations.  Some places will need a spsc lock free queue and others will need a multi-producer / multi-consumer queue with proper waits (and potentially more queues than that).

Reporter: Weston Pace / @westonpace
Assignee: Weston Pace / @westonpace

Subtasks:

• [C++] Add vendored version of folly's spsc queue

Related issues:

• [C++] Move CSV background generator to IO thread pool (Dependent)

_{Note: This issue was originally created as ARROW-11588. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
Sounds good to me. On a general basis, we try to minimize the Boost dependencies, but that's only a guideline (especially if header-only).

[asfimport]

Weston Pace / @westonpace:
Cleaning up my issues.  General queues seems to be more of a pipe dream.  Different operators have had different queuing needs and so we are likely to have multiple types.  David has already made good work on tracing and I feel this issue could probably be better served by a "execution graph tracing" issue.