Oximeter: Improve field lookup performance

[jmcarp]

Here's a query that should be fast, but isn't:

get switch_data_link:pcs_invalid_errors | filter timestamp > @now() - 15m | last 1

We're looking up the latest value of each series for the switch_data_link:pcs_invalid_errors metric. There are <100 series on dogfood, and we only want one sample per series, so how long could it possibly take?

joshcarp@j0sh ~/c/o/oximeter (jmcarp/clickhouse-part-log)> time oxide --profile r2 api -X POST /v1/system/timeseries/query --field query='get switch_data_link:pcs_invalid_errors | filter timestamp > @now() - 15m | last 1' > /dev/null

________________________________________________________
Executed in    2.58 secs      fish           external
   usr time   20.00 millis    0.27 millis   19.73 millis
   sys time   23.23 millis    2.42 millis   20.81 millis

Let's figure out which clickhouse queries are taking time here:

joshcarp@j0sh ~/c/o/oximeter (jmcarp/clickhouse-part-log)> time oxide --profile r2 api -X POST /v1/system/timeseries/query --field query='get switch_data_link:pcs_invalid_errors | filter timestamp > @now() - 15m | last 1' --field include_summaries=true | jq '.query_summaries'
[
  {
    "elapsed_ms": 1304,
    "id": "4a2eb72e-86e5-4d23-b499-ee7a8046f803",
    "io_summary": {
      "read": {
        "bytes": 26322808,
        "rows": 373001
      },
      "written": {
        "bytes": 0,
        "rows": 0
      }
    },
    "query": "SELECT filter_on_asic_fab.timeseries_key AS timeseries_key, filter_on_asic_fab.field_value AS asic_fab, filter_on_asic_lot.field_value AS asic_lot, filter_on_asic_wafer.field_value AS asic_wafer, filter_on_asic_wafer_loc_x.field_value AS asic_wafer_loc_x, filter_on_asic_wafer_loc_y.field_value AS asic_wafer_loc_y, filter_on_kind.field_value AS kind, filter_on_link_id.field_value AS link_id, filter_on_model.field_value AS model, filter_on_network.field_value AS network, filter_on_port_id.field_value AS port_id, filter_on_rack_id.field_value AS rack_id, filter_on_sled_id.field_value AS sled_id, filter_on_sled_model.field_value AS sled_model, filter_on_sled_revision.field_value AS sled_revision, filter_on_sled_serial.field_value AS sled_serial, filter_on_switch_id.field_value AS switch_id, filter_on_switch_model.field_value AS switch_model, filter_on_switch_revision.field_value AS switch_revision, filter_on_switch_serial.field_value AS switch_serial, filter_on_switch_slot.field_value AS switch_slot FROM (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'asic_fab' ) AS filter_on_asic_fab INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'asic_lot' ) AS filter_on_asic_lot ON filter_on_asic_lot.timeseries_key = filter_on_asic_fab.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_u8 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'asic_wafer' ) AS filter_on_asic_wafer ON filter_on_asic_wafer.timeseries_key = filter_on_asic_lot.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i16 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'asic_wafer_loc_x' ) AS filter_on_asic_wafer_loc_x ON filter_on_asic_wafer_loc_x.timeseries_key = filter_on_asic_wafer.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_i16 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'asic_wafer_loc_y' ) AS filter_on_asic_wafer_loc_y ON filter_on_asic_wafer_loc_y.timeseries_key = filter_on_asic_wafer_loc_x.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'kind' ) AS filter_on_kind ON filter_on_kind.timeseries_key = filter_on_asic_wafer_loc_y.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_u8 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'link_id' ) AS filter_on_link_id ON filter_on_link_id.timeseries_key = filter_on_kind.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'model' ) AS filter_on_model ON filter_on_model.timeseries_key = filter_on_link_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'network' ) AS filter_on_network ON filter_on_network.timeseries_key = filter_on_model.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'port_id' ) AS filter_on_port_id ON filter_on_port_id.timeseries_key = filter_on_network.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'rack_id' ) AS filter_on_rack_id ON filter_on_rack_id.timeseries_key = filter_on_port_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'sled_id' ) AS filter_on_sled_id ON filter_on_sled_id.timeseries_key = filter_on_rack_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'sled_model' ) AS filter_on_sled_model ON filter_on_sled_model.timeseries_key = filter_on_sled_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_u32 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'sled_revision' ) AS filter_on_sled_revision ON filter_on_sled_revision.timeseries_key = filter_on_sled_model.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'sled_serial' ) AS filter_on_sled_serial ON filter_on_sled_serial.timeseries_key = filter_on_sled_revision.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_uuid WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'switch_id' ) AS filter_on_switch_id ON filter_on_switch_id.timeseries_key = filter_on_sled_serial.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'switch_model' ) AS filter_on_switch_model ON filter_on_switch_model.timeseries_key = filter_on_switch_id.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_u32 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'switch_revision' ) AS filter_on_switch_revision ON filter_on_switch_revision.timeseries_key = filter_on_switch_model.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_string WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'switch_serial' ) AS filter_on_switch_serial ON filter_on_switch_serial.timeseries_key = filter_on_switch_revision.timeseries_key INNER JOIN (SELECT DISTINCT timeseries_key, field_value FROM oximeter.fields_u16 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND field_name = 'switch_slot' ) AS filter_on_switch_slot ON filter_on_switch_slot.timeseries_key = filter_on_switch_serial.timeseries_key"
  },
  {
    "elapsed_ms": 27,
    "id": "f87045b5-6d8d-46f6-b869-c28546c9683f",
    "io_summary": {
      "read": {
        "bytes": 38452785,
        "rows": 4734976
      },
      "written": {
        "bytes": 0,
        "rows": 0
      }
    },
    "query": "WITH another_sort_bites_the_dust AS (SELECT timeseries_key, start_time, timestamp, datum FROM oximeter.measurements_cumulativeu64 WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors' AND ((greater(timestamp, '2025-10-18 02:23:13.568113428') AND timeseries_key IN (756097590731240185,1103678389185180213,1114318808045492183,2778933048436799581,2854864349868441750,2880055957681953789,2988357157493497291,3431400205349850520,4197624739596116631,4482317240533975040,4523730516240309666,4546337385136722914,4730845005745019941,5051034547903499618,5214763097398691070,5531446474934082220,5914094962255628952,6296741838962653061,6500850491531141289,6547455214936556723,6801096096785608471,6840059004777660900,6956768772222382044,7845955728345151377,8079285099772927279,8371638504720300988,8685222285163140992,8895081521639637420,9021094672032217726,9076816697852073085,9183890932061987237,9847120510806684081,9989711210244049645,10002743743499159209,10023093142870887259,10043270192420610430,10444555488425996914,10773026991683650248,10905986825036860523,11007200161122304200,11394909356247832469,12464387133381661438,12543560225616984746,12744659831664932266,12911136620986716246,12958578737857061770,13254999271480575466,13627503505782314272,13652221451308349941,13678933375858933474,13683736416652084102,13846398855017622740,14059609743711840178,14385675600390572247,15070769942095295940,15435437835838139192,15493658260864888608,15563854730682873276,15788168535646315722,15834530069215973581,16123362320570486376,16146958724618824409,16510965828585083258,16652066512748240246,16666885187928053436,16941864685879894581,17138776637522959523,17625682851552006998,17820117293304220522,17975557493162096426))) ORDER BY timeseries_key, timestamp DESC LIMIT 1 BY timeseries_key) SELECT * FROM another_sort_bites_the_dust ORDER BY timeseries_key, timestamp LIMIT 1000001"
  }
]

We're running two queries: one to look up field labels and values for the relevant timeseries in the fields_* tables, and a second to look up the metric values in measurements_cumulativeu64. For this particular run, the former query took 1304ms, and the latter took 27ms. We're spending a lot more time looking up labels than data points! And there aren't many unique timeseries or labels, so intuitively, we should be able to do much better.

[jmcarp]

Let's run this query on dogfood directly:

SELECT
    filter_on_asic_fab.timeseries_key AS timeseries_key,
    filter_on_asic_fab.field_value AS asic_fab,
    filter_on_asic_lot.field_value AS asic_lot,
    filter_on_asic_wafer.field_value AS asic_wafer,
    filter_on_asic_wafer_loc_x.field_value AS asic_wafer_loc_x,
    filter_on_asic_wafer_loc_y.field_value AS asic_wafer_loc_y,
    filter_on_kind.field_value AS kind,
    filter_on_link_id.field_value AS link_id,
    filter_on_model.field_value AS model,
    filter_on_network.field_value AS network,
    filter_on_port_id.field_value AS port_id,
    filter_on_rack_id.field_value AS rack_id,
    filter_on_sled_id.field_value AS sled_id,
    filter_on_sled_model.field_value AS sled_model,
    filter_on_sled_revision.field_value AS sled_revision,
    filter_on_sled_serial.field_value AS sled_serial,
    filter_on_switch_id.field_value AS switch_id,
    filter_on_switch_model.field_value AS switch_model,
    filter_on_switch_revision.field_value AS switch_revision,
    filter_on_switch_serial.field_value AS switch_serial,
    filter_on_switch_slot.field_value AS switch_slot
FROM
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_fab')
) AS filter_on_asic_fab
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_lot')
) AS filter_on_asic_lot ON filter_on_asic_lot.timeseries_key = filter_on_asic_fab.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u8
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_wafer')
) AS filter_on_asic_wafer ON filter_on_asic_wafer.timeseries_key = filter_on_asic_lot.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_i16
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_wafer_loc_x')
) AS filter_on_asic_wafer_loc_x ON filter_on_asic_wafer_loc_x.timeseries_key = filter_on_asic_wafer.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_i16
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_wafer_loc_y')
) AS filter_on_asic_wafer_loc_y ON filter_on_asic_wafer_loc_y.timeseries_key = filter_on_asic_wafer_loc_x.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'kind')
) AS filter_on_kind ON filter_on_kind.timeseries_key = filter_on_asic_wafer_loc_y.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u8
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'link_id')
) AS filter_on_link_id ON filter_on_link_id.timeseries_key = filter_on_kind.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'model')
) AS filter_on_model ON filter_on_model.timeseries_key = filter_on_link_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'network')
) AS filter_on_network ON filter_on_network.timeseries_key = filter_on_model.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'port_id')
) AS filter_on_port_id ON filter_on_port_id.timeseries_key = filter_on_network.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_uuid
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'rack_id')
) AS filter_on_rack_id ON filter_on_rack_id.timeseries_key = filter_on_port_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_uuid
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_id')
) AS filter_on_sled_id ON filter_on_sled_id.timeseries_key = filter_on_rack_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_model')
) AS filter_on_sled_model ON filter_on_sled_model.timeseries_key = filter_on_sled_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u32
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_revision')
) AS filter_on_sled_revision ON filter_on_sled_revision.timeseries_key = filter_on_sled_model.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_serial')
) AS filter_on_sled_serial ON filter_on_sled_serial.timeseries_key = filter_on_sled_revision.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_uuid
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_id')
) AS filter_on_switch_id ON filter_on_switch_id.timeseries_key = filter_on_sled_serial.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_model')
) AS filter_on_switch_model ON filter_on_switch_model.timeseries_key = filter_on_switch_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u32
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_revision')
) AS filter_on_switch_revision ON filter_on_switch_revision.timeseries_key = filter_on_switch_model.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_serial')
) AS filter_on_switch_serial ON filter_on_switch_serial.timeseries_key = filter_on_switch_revision.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u16
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_slot')
) AS filter_on_switch_slot ON filter_on_switch_slot.timeseries_key = filter_on_switch_serial.timeseries_key

Query id: d4b2df0b-1cab-4952-9148-c08b4557d860

┌───────timeseries_key─┬─asic_fab─┬─asic_lot─┬─asic_wafer─┬─asic_wafer_loc_x─┬─asic_wafer_loc_y─┬─kind────────┬─link_id─┬─model─┬─network──────┬─port_id─┬─rack_id──────────────────────────────┬─sled_id──────────────────────────────┬─sled_model──┬─sled_revision─┬─sled_serial─┬─switch_id────────────────────────────┬─switch_model─┬─switch_revision─┬─switch_serial─┬─switch_slot─┐
│   756097590731240185 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear9   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  1103678389185180213 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear24  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  1114318808045492183 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear25  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  2778933048436799581 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear22  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  2854864349868441750 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  2880055957681953789 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear29  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  2988357157493497291 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear28  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  3431400205349850520 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear13  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  4197624739596116631 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ qsfp26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  4482317240533975040 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear5   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  4523730516240309666 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear8   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  4546337385136722914 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear21  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  4730845005745019941 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear11  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  5051034547903499618 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  5214763097398691070 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear2   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  5531446474934082220 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear15  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  5914094962255628952 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear10  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  6296741838962653061 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear12  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  6500850491531141289 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear0   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  6547455214936556723 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ qsfp18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  6801096096785608471 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear7   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  6840059004777660900 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear15  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  6956768772222382044 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ int0    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  7845955728345151377 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear2   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  8079285099772927279 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear23  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  8371638504720300988 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear22  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  8685222285163140992 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear5   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  8895081521639637420 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear27  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  9021094672032217726 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear10  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  9076816697852073085 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear28  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│  9183890932061987237 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear31  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  9847120510806684081 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear14  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│  9989711210244049645 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear9   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 10002743743499159209 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear17  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 10023093142870887259 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear30  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 10043270192420610430 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear23  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 10444555488425996914 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear24  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 10773026991683650248 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear21  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 10905986825036860523 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear14  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 11007200161122304200 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear6   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 11394909356247832469 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear19  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 12464387133381661438 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear19  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 12543560225616984746 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear3   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 12744659831664932266 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ qsfp26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 12911136620986716246 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear12  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 12958578737857061770 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ qsfp18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 13254999271480575466 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear0   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 13627503505782314272 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear30  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 13652221451308349941 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 13678933375858933474 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear4   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 13683736416652084102 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear13  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 13846398855017622740 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear7   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 14059609743711840178 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear25  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 14385675600390572247 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear4   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 15070769942095295940 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ int0    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 15435437835838139192 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear11  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 15493658260864888608 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear17  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 15563854730682873276 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear16  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 15788168535646315722 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear20  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 15834530069215973581 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear31  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 16123362320570486376 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear27  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 16146958724618824409 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear20  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 16510965828585083258 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear6   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 16652066512748240246 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear29  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 16666885187928053436 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear16  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 16941864685879894581 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear3   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 17138776637522959523 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear1   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
│ 17625682851552006998 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear8   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 17820117293304220522 │ T        │ C        │         14 │               -1 │                7 │ switch-port │       0 │ TF2   │ primary-data │ rear1   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │             6 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006  │               4 │ BRM44220012   │           0 │
│ 17975557493162096426 │ T        │ C        │         15 │               -1 │                2 │ switch-port │       0 │ TF2   │ primary-data │ rear26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │             6 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006  │               4 │ BRM44220008   │           1 │
└──────────────────────┴──────────┴──────────┴────────────┴──────────────────┴──────────────────┴─────────────┴─────────┴───────┴──────────────┴─────────┴──────────────────────────────────────┴──────────────────────────────────────┴─────────────┴───────────────┴─────────────┴──────────────────────────────────────┴──────────────┴─────────────────┴───────────────┴─────────────┘

70 rows in set. Elapsed: 1.198 sec. Processed 478.51 thousand rows, 33.58 MB (399.58 thousand rows/s., 28.04 MB/s.)
Peak memory usage: 1.70 MiB.

And let's explain it:

EXPLAIN
SELECT
    filter_on_asic_fab.timeseries_key AS timeseries_key,
    filter_on_asic_fab.field_value AS asic_fab,
    filter_on_asic_lot.field_value AS asic_lot,
    filter_on_asic_wafer.field_value AS asic_wafer,
    filter_on_asic_wafer_loc_x.field_value AS asic_wafer_loc_x,
    filter_on_asic_wafer_loc_y.field_value AS asic_wafer_loc_y,
    filter_on_kind.field_value AS kind,
    filter_on_link_id.field_value AS link_id,
    filter_on_model.field_value AS model,
    filter_on_network.field_value AS network,
    filter_on_port_id.field_value AS port_id,
    filter_on_rack_id.field_value AS rack_id,
    filter_on_sled_id.field_value AS sled_id,
    filter_on_sled_model.field_value AS sled_model,
    filter_on_sled_revision.field_value AS sled_revision,
    filter_on_sled_serial.field_value AS sled_serial,
    filter_on_switch_id.field_value AS switch_id,
    filter_on_switch_model.field_value AS switch_model,
    filter_on_switch_revision.field_value AS switch_revision,
    filter_on_switch_serial.field_value AS switch_serial,
    filter_on_switch_slot.field_value AS switch_slot
FROM
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_fab')
) AS filter_on_asic_fab
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_lot')
) AS filter_on_asic_lot ON filter_on_asic_lot.timeseries_key = filter_on_asic_fab.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u8
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_wafer')
) AS filter_on_asic_wafer ON filter_on_asic_wafer.timeseries_key = filter_on_asic_lot.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_i16
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_wafer_loc_x')
) AS filter_on_asic_wafer_loc_x ON filter_on_asic_wafer_loc_x.timeseries_key = filter_on_asic_wafer.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_i16
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'asic_wafer_loc_y')
) AS filter_on_asic_wafer_loc_y ON filter_on_asic_wafer_loc_y.timeseries_key = filter_on_asic_wafer_loc_x.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'kind')
) AS filter_on_kind ON filter_on_kind.timeseries_key = filter_on_asic_wafer_loc_y.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u8
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'link_id')
) AS filter_on_link_id ON filter_on_link_id.timeseries_key = filter_on_kind.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'model')
) AS filter_on_model ON filter_on_model.timeseries_key = filter_on_link_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'network')
) AS filter_on_network ON filter_on_network.timeseries_key = filter_on_model.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'port_id')
) AS filter_on_port_id ON filter_on_port_id.timeseries_key = filter_on_network.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_uuid
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'rack_id')
) AS filter_on_rack_id ON filter_on_rack_id.timeseries_key = filter_on_port_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_uuid
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_id')
) AS filter_on_sled_id ON filter_on_sled_id.timeseries_key = filter_on_rack_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_model')
) AS filter_on_sled_model ON filter_on_sled_model.timeseries_key = filter_on_sled_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u32
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_revision')
) AS filter_on_sled_revision ON filter_on_sled_revision.timeseries_key = filter_on_sled_model.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'sled_serial')
) AS filter_on_sled_serial ON filter_on_sled_serial.timeseries_key = filter_on_sled_revision.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_uuid
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_id')
) AS filter_on_switch_id ON filter_on_switch_id.timeseries_key = filter_on_sled_serial.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_model')
) AS filter_on_switch_model ON filter_on_switch_model.timeseries_key = filter_on_switch_id.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u32
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_revision')
) AS filter_on_switch_revision ON filter_on_switch_revision.timeseries_key = filter_on_switch_model.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_string
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_serial')
) AS filter_on_switch_serial ON filter_on_switch_serial.timeseries_key = filter_on_switch_revision.timeseries_key
INNER JOIN
(
    SELECT DISTINCT
        timeseries_key,
        field_value
    FROM oximeter.fields_u16
    WHERE (timeseries_name = 'switch_data_link:pcs_invalid_errors') AND (field_name = 'switch_slot')
) AS filter_on_switch_slot ON filter_on_switch_slot.timeseries_key = filter_on_switch_serial.timeseries_key

Query id: 5ff5a1bf-472f-4f09-9fa3-f75e7bd2699f

┌─explain───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Expression ((Projection + Before ORDER BY))                                                                                                           │
│   Join (JOIN FillRightFirst)                                                                                                                          │
│     Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                                                       │
│       Join (JOIN FillRightFirst)                                                                                                                      │
│         Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                                                   │
│           Join (JOIN FillRightFirst)                                                                                                                  │
│             Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                                               │
│               Join (JOIN FillRightFirst)                                                                                                              │
│                 Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                                           │
│                   Join (JOIN FillRightFirst)                                                                                                          │
│                     Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                                       │
│                       Join (JOIN FillRightFirst)                                                                                                      │
│                         Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                                   │
│                           Join (JOIN FillRightFirst)                                                                                                  │
│                             Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                               │
│                               Join (JOIN FillRightFirst)                                                                                              │
│                                 Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                           │
│                                   Join (JOIN FillRightFirst)                                                                                          │
│                                     Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                       │
│                                       Join (JOIN FillRightFirst)                                                                                      │
│                                         Expression ((Before JOIN + (Projection + Before ORDER BY)))                                                   │
│                                           Join (JOIN FillRightFirst)                                                                                  │
│                                             Expression ((Before JOIN + (Projection + Before ORDER BY)))                                               │
│                                               Join (JOIN FillRightFirst)                                                                              │
│                                                 Expression ((Before JOIN + (Projection + Before ORDER BY)))                                           │
│                                                   Join (JOIN FillRightFirst)                                                                          │
│                                                     Expression ((Before JOIN + (Projection + Before ORDER BY)))                                       │
│                                                       Join (JOIN FillRightFirst)                                                                      │
│                                                         Expression ((Before JOIN + (Projection + Before ORDER BY)))                                   │
│                                                           Join (JOIN FillRightFirst)                                                                  │
│                                                             Expression ((Before JOIN + (Projection + Before ORDER BY)))                               │
│                                                               Join (JOIN FillRightFirst)                                                              │
│                                                                 Expression ((Before JOIN + (Projection + Before ORDER BY)))                           │
│                                                                   Join (JOIN FillRightFirst)                                                          │
│                                                                     Expression ((Before JOIN + (Projection + Before ORDER BY)))                       │
│                                                                       Join (JOIN FillRightFirst)                                                      │
│                                                                         Expression ((Before JOIN + (Projection + Before ORDER BY)))                   │
│                                                                           Join (JOIN FillRightFirst)                                                  │
│                                                                             Expression ((Before JOIN + Projection))                                   │
│                                                                               Distinct                                                                │
│                                                                                 Distinct (Preliminary DISTINCT)                                       │
│                                                                                   Expression (Before ORDER BY)                                        │
│                                                                                     ReadFromMergeTree (oximeter.fields_string_local)                  │
│                                                                             Expression ((Joined actions + (Rename joined columns + ( + Projection)))) │
│                                                                               Distinct                                                                │
│                                                                                 Distinct (Preliminary DISTINCT)                                       │
│                                                                                   Expression (Before ORDER BY)                                        │
│                                                                                     ReadFromMergeTree (oximeter.fields_string_local)                  │
│                                                                         Expression ((Joined actions + (Rename joined columns + )))                    │
│                                                                           ReadFromRemote (Read from remote replica)                                   │
│                                                                     Expression ((Joined actions + (Rename joined columns + ( + Projection))))         │
│                                                                       Distinct                                                                        │
│                                                                         Distinct (Preliminary DISTINCT)                                               │
│                                                                           Expression (Before ORDER BY)                                                │
│                                                                             ReadFromMergeTree (oximeter.fields_i16_local)                             │
│                                                                 Expression ((Joined actions + (Rename joined columns + ( + Projection))))             │
│                                                                   Distinct                                                                            │
│                                                                     Distinct (Preliminary DISTINCT)                                                   │
│                                                                       Expression (Before ORDER BY)                                                    │
│                                                                         ReadFromMergeTree (oximeter.fields_i16_local)                                 │
│                                                             Expression ((Joined actions + (Rename joined columns + ( + Projection))))                 │
│                                                               Distinct                                                                                │
│                                                                 Distinct (Preliminary DISTINCT)                                                       │
│                                                                   Expression (Before ORDER BY)                                                        │
│                                                                     ReadFromMergeTree (oximeter.fields_string_local)                                  │
│                                                         Expression ((Joined actions + (Rename joined columns + )))                                    │
│                                                           ReadFromRemote (Read from remote replica)                                                   │
│                                                     Expression ((Joined actions + (Rename joined columns + ( + Projection))))                         │
│                                                       Distinct                                                                                        │
│                                                         Distinct (Preliminary DISTINCT)                                                               │
│                                                           Expression (Before ORDER BY)                                                                │
│                                                             ReadFromMergeTree (oximeter.fields_string_local)                                          │
│                                                 Expression ((Joined actions + (Rename joined columns + ( + Projection))))                             │
│                                                   Distinct                                                                                            │
│                                                     Distinct (Preliminary DISTINCT)                                                                   │
│                                                       Expression (Before ORDER BY)                                                                    │
│                                                         ReadFromMergeTree (oximeter.fields_string_local)                                              │
│                                             Expression ((Joined actions + (Rename joined columns + ( + Projection))))                                 │
│                                               Distinct                                                                                                │
│                                                 Distinct (Preliminary DISTINCT)                                                                       │
│                                                   Expression (Before ORDER BY)                                                                        │
│                                                     ReadFromMergeTree (oximeter.fields_string_local)                                                  │
│                                         Expression ((Joined actions + (Rename joined columns + )))                                                    │
│                                           ReadFromRemote (Read from remote replica)                                                                   │
│                                     Expression ((Joined actions + (Rename joined columns + )))                                                        │
│                                       ReadFromRemote (Read from remote replica)                                                                       │
│                                 Expression ((Joined actions + (Rename joined columns + ( + Projection))))                                             │
│                                   Distinct                                                                                                            │
│                                     Distinct (Preliminary DISTINCT)                                                                                   │
│                                       Expression (Before ORDER BY)                                                                                    │
│                                         ReadFromMergeTree (oximeter.fields_string_local)                                                              │
│                             Expression ((Joined actions + (Rename joined columns + )))                                                                │
│                               ReadFromRemote (Read from remote replica)                                                                               │
│                         Expression ((Joined actions + (Rename joined columns + ( + Projection))))                                                     │
│                           Distinct                                                                                                                    │
│                             Distinct (Preliminary DISTINCT)                                                                                           │
│                               Expression (Before ORDER BY)                                                                                            │
│                                 ReadFromMergeTree (oximeter.fields_string_local)                                                                      │
│                     Expression ((Joined actions + (Rename joined columns + )))                                                                        │
│                       ReadFromRemote (Read from remote replica)                                                                                       │
│                 Expression ((Joined actions + (Rename joined columns + ( + Projection))))                                                             │
│                   Distinct                                                                                                                            │
│                     Distinct (Preliminary DISTINCT)                                                                                                   │
│                       Expression (Before ORDER BY)                                                                                                    │
│                         ReadFromMergeTree (oximeter.fields_string_local)                                                                              │
│             Expression ((Joined actions + (Rename joined columns + )))                                                                                │
│               ReadFromRemote (Read from remote replica)                                                                                               │
│         Expression ((Joined actions + (Rename joined columns + ( + Projection))))                                                                     │
│           Distinct                                                                                                                                    │
│             Distinct (Preliminary DISTINCT)                                                                                                           │
│               Expression (Before ORDER BY)                                                                                                            │
│                 ReadFromMergeTree (oximeter.fields_string_local)                                                                                      │
│     Expression ((Joined actions + (Rename joined columns + )))                                                                                        │
│       ReadFromRemote (Read from remote replica)                                                                                                       │
└───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

114 rows in set. Elapsed: 0.888 sec.

This is an intense query plan! We're scanning multiple fields_* tables, some of them several times, and joining the results of all the scans.

I don't know much about optimizing clickhouse queries, so I spent some time going back and forth with Claude on it, and wound up with this:

WITH
    string_agg AS
    (
        SELECT
            timeseries_key,
            anyIf(field_value, field_name = 'asic_fab') AS asic_fab,
            anyIf(field_value, field_name = 'asic_lot') AS asic_lot,
            anyIf(field_value, field_name = 'kind') AS kind,
            anyIf(field_value, field_name = 'model') AS model,
            anyIf(field_value, field_name = 'network') AS network,
            anyIf(field_value, field_name = 'port_id') AS port_id,
            anyIf(field_value, field_name = 'sled_model') AS sled_model,
            anyIf(field_value, field_name = 'sled_serial') AS sled_serial,
            anyIf(field_value, field_name = 'switch_model') AS switch_model,
            anyIf(field_value, field_name = 'switch_serial') AS switch_serial
        FROM oximeter.fields_string
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY timeseries_key
    ),
    i16_agg AS
    (
        SELECT
            timeseries_key,
            anyIf(field_value, field_name = 'asic_wafer_loc_x') AS asic_wafer_loc_x,
            anyIf(field_value, field_name = 'asic_wafer_loc_y') AS asic_wafer_loc_y
        FROM oximeter.fields_i16
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY timeseries_key
    ),
    u8_agg AS
    (
        SELECT
            timeseries_key,
            anyIf(field_value, field_name = 'asic_wafer') AS asic_wafer,
            anyIf(field_value, field_name = 'link_id') AS link_id
        FROM oximeter.fields_u8
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY timeseries_key
    ),
    u16_agg AS
    (
        SELECT
            timeseries_key,
            anyIf(field_value, field_name = 'switch_slot') AS switch_slot
        FROM oximeter.fields_u16
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY timeseries_key
    ),
    u32_agg AS
    (
        SELECT
            timeseries_key,
            anyIf(field_value, field_name = 'sled_revision') AS sled_revision,
            anyIf(field_value, field_name = 'switch_revision') AS switch_revision
        FROM oximeter.fields_u32
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY timeseries_key
    ),
    uid_agg AS
    (
        SELECT
            timeseries_key,
            anyIf(field_value, field_name = 'rack_id') AS rack_id,
            anyIf(field_value, field_name = 'sled_id') AS sled_id,
            anyIf(field_value, field_name = 'switch_id') AS switch_id
        FROM oximeter.fields_uuid
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY timeseries_key
    )
SELECT
    s.timeseries_key,
    s.asic_fab,
    s.asic_lot,
    u8.asic_wafer,
    i16.asic_wafer_loc_x,
    i16.asic_wafer_loc_y,
    s.kind,
    u8.link_id,
    s.model,
    s.network,
    s.port_id,
    uid.rack_id,
    uid.sled_id,
    s.sled_model,
    u32.sled_revision,
    s.sled_serial,
    uid.switch_id,
    s.switch_model,
    u32.switch_revision,
    s.switch_serial,
    u16.switch_slot
FROM string_agg AS s
LEFT JOIN i16_agg AS i16 ON i16.timeseries_key = s.timeseries_key
LEFT JOIN u8_agg AS u8 ON u8.timeseries_key = s.timeseries_key
LEFT JOIN u16_agg AS u16 ON u16.timeseries_key = s.timeseries_key
LEFT JOIN u32_agg AS u32 ON u32.timeseries_key = s.timeseries_key
LEFT JOIN uid_agg AS uid ON uid.timeseries_key = s.timeseries_key

Query id: 825d5040-7d45-487a-94e9-a936ed8866ec

┌─────s.timeseries_key─┬─s.asic_fab─┬─s.asic_lot─┬─u8.asic_wafer─┬─i16.asic_wafer_loc_x─┬─i16.asic_wafer_loc_y─┬─s.kind──────┬─u8.link_id─┬─s.model─┬─s.network────┬─s.port_id─┬─uid.rack_id──────────────────────────┬─uid.sled_id──────────────────────────┬─s.sled_model─┬─u32.sled_revision─┬─s.sled_serial─┬─uid.switch_id────────────────────────┬─s.switch_model─┬─u32.switch_revision─┬─s.switch_serial─┬─u16.switch_slot─┐
│ 16941864685879894581 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear3     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 14385675600390572247 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear4     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  6547455214936556723 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ qsfp18    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 17138776637522959523 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear1     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 16652066512748240246 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear29    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 13627503505782314272 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear30    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  4546337385136722914 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear21    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 12744659831664932266 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ qsfp26    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 15493658260864888608 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear17    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  1114318808045492183 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear25    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  2778933048436799581 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear22    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  5051034547903499618 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear26    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  4523730516240309666 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear8     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  5214763097398691070 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear2     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  8685222285163140992 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear5     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 14059609743711840178 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear25    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  5531446474934082220 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear15    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  6500850491531141289 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear0     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 15563854730682873276 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear16    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 13846398855017622740 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear7     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  7845955728345151377 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear2     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 16510965828585083258 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear6     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  6956768772222382044 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ int0      │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 10444555488425996914 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear24    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 13254999271480575466 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear0     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  9076816697852073085 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear28    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 15435437835838139192 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear11    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  8079285099772927279 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear23    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 10023093142870887259 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear30    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 16123362320570486376 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear27    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  1103678389185180213 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear24    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  4730845005745019941 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear11    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  4197624739596116631 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ qsfp26    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 10773026991683650248 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear21    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  9847120510806684081 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear14    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  5914094962255628952 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear10    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 12911136620986716246 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear12    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  2988357157493497291 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear28    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 11394909356247832469 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear19    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 13683736416652084102 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear13    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  9021094672032217726 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear10    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 13652221451308349941 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear18    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 17975557493162096426 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear26    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  6801096096785608471 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear7     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 10002743743499159209 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear17    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  8371638504720300988 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear22    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 16146958724618824409 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear20    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 17820117293304220522 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear1     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  4482317240533975040 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear5     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  6296741838962653061 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear12    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 13678933375858933474 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear4     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 10905986825036860523 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear14    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  9183890932061987237 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear31    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 10043270192420610430 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear23    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 12464387133381661438 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear19    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│   756097590731240185 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear9     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  3431400205349850520 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear13    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 17625682851552006998 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear8     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 12543560225616984746 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear3     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 15834530069215973581 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear31    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 15788168535646315722 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear20    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 12958578737857061770 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ qsfp18    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│ 11007200161122304200 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear6     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  2880055957681953789 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ rear29    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  9989711210244049645 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear9     │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  6840059004777660900 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear15    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 15070769942095295940 │ T          │ C          │            15 │                   -1 │                    2 │ switch-port │          0 │ TF2     │ primary-data │ int0      │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019  │                 6 │ BRM42220014   │ 00000000-0000-0000-0201-bda398f0e1d4 │ 913-0000006    │                   4 │ BRM44220008     │               1 │
│  2854864349868441750 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear18    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│ 16666885187928053436 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear16    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
│  8895081521639637420 │ T          │ C          │            14 │                   -1 │                    7 │ switch-port │          0 │ TF2     │ primary-data │ rear27    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019  │                 6 │ BRM42220051   │ 00000000-0000-0000-0701-b9a398f0e1d4 │ 913-0000006    │                   4 │ BRM44220012     │               0 │
└──────────────────────┴────────────┴────────────┴───────────────┴──────────────────────┴──────────────────────┴─────────────┴────────────┴─────────┴──────────────┴───────────┴──────────────────────────────────────┴──────────────────────────────────────┴──────────────┴───────────────────┴───────────────┴──────────────────────────────────────┴────────────────┴─────────────────────┴─────────────────┴─────────────────┘

70 rows in set. Elapsed: 0.196 sec. Processed 108.72 thousand rows, 7.60 MB (555.80 thousand rows/s., 38.87 MB/s.)
Peak memory usage: 1.72 MiB.

The idea is to pivot each fields_* table separately, using anyIf and GROUP BY. We scan each relevant field table once, pivoting all relevant fields in a single scan. Then we join the results together. This drops the query time from ~1.2s to ~0.2s, which is much better. Not that it matters, since these queries are generated in code, but the query isn't any harder to read, either.

But 200ms to look up fields for 70 timeseries still seems excessive. Let's keep digging:

[jmcarp]

Looking at this closer, I believe we're spending much of our time on the joins. Can we express this query without them? One helpful clickhouse feature I learned about today is the merge function, which can query multiple tables with the same structure—even if some of the columns have different data types across tables. Something like this should work:

select * from merge('oximeter', 'fields_.+') where timeseries_name = 'switch_data_link:pcs_invalid_errors'

Using this query, field_value should be a Variant(Int8, Int16, ..., String, IPv6), and we should be able to look up fields from all relevant tables in parallel, with no joins. However, clickhouse doesn't like it:

Received exception from server (version 23.8.7):
Code: 467. DB::Exception: Received from a1336084-d8df-4730-a805-4cf420a5bc06.host.control-plane.oxide.internal:9000. DB::Exception: Cannot parse boolean value here: 'C', should be 'true' or 'false' controlled by setting bool_true_representation and bool_false_representation or one of True/False/T/F/Y/N/Yes/No/On/Off/Enable/Disable/Enabled/Disabled/1/0: while converting source column field_value to destination column field_value: while executing 'FUNCTION _CAST(field_value :: 3, Bool :: 4) -> _CAST(field_value, Bool) Bool : 5'. (CANNOT_PARSE_BOOL)

By trial and error, it appears that clickhouse gets tripped up trying to merge columns of number-ish types and text-ish types. But we can work around that by splitting the merge into two subqueries and joining.

WITH
    int_fields AS
    (
        SELECT
            timeseries_name,
            timeseries_key,
            mapFromArrays(groupArray(field_name), groupArray(field_value)) AS int_map
        FROM merge('oximeter', 'fields_(i16|u8|u16|u32)')
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY
            timeseries_name,
            timeseries_key
    ),
    text_fields AS
    (
        SELECT
            timeseries_name,
            timeseries_key,
            mapFromArrays(groupArray(field_name), groupArray(field_value)) AS text_map
        FROM merge('oximeter', 'fields_(string|uuid)')
        WHERE timeseries_name = 'switch_data_link:pcs_invalid_errors'
        GROUP BY
            timeseries_name,
            timeseries_key
    )
SELECT
    int_fields.timeseries_name,
    int_fields.timeseries_key,
    text_fields.text_map['asic_fab'] AS asic_fab,
    text_fields.text_map['asic_lot'] AS asic_lot,
    text_fields.text_map['kind'] AS kind,
    text_fields.text_map['model'] AS model,
    text_fields.text_map['network'] AS network,
    text_fields.text_map['port_id'] AS port_id,
    text_fields.text_map['rack_id'] AS rack_id,
    text_fields.text_map['sled_id'] AS sled_id,
    text_fields.text_map['sled_model'] AS sled_model,
    text_fields.text_map['sled_serial'] AS sled_serial,
    text_fields.text_map['switch_id'] AS switch_id,
    text_fields.text_map['switch_serial'] AS switch_serial,
    text_fields.text_map['switch_model'] AS switch_model,
    int_fields.int_map['link_id'] AS link_id,
    int_fields.int_map['asic_wafer_loc_x'] AS asic_wafer_loc_x,
    int_fields.int_map['asic_wafer_loc_y'] AS asic_wafer_loc_y,
    int_fields.int_map['asic_wafer'] AS asic_wafer,
    int_fields.int_map['switch_slot'] AS switch_slot,
    int_fields.int_map['sled_revision'] AS sled_revision,
    int_fields.int_map['switch_revision'] AS switch_revision
FROM int_fields
INNER JOIN text_fields USING (timeseries_key)

Query id: b7c121ed-d68f-4cdb-ac88-2f1f9e44bcb8

┌─timeseries_name─────────────────────┬───────timeseries_key─┬─asic_fab─┬─asic_lot─┬─kind────────┬─model─┬─network──────┬─port_id─┬─rack_id──────────────────────────────┬─sled_id──────────────────────────────┬─sled_model──┬─sled_serial─┬─switch_id────────────────────────────┬─switch_serial─┬─switch_model─┬─link_id─┬─asic_wafer_loc_x─┬─asic_wafer_loc_y─┬─asic_wafer─┬─switch_slot─┬─sled_revision─┬─switch_revision─┐
│ switch_data_link:pcs_invalid_errors │  6801096096785608471 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear7   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 17625682851552006998 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear8   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 14385675600390572247 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear4   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 17138776637522959523 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear1   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 17975557493162096426 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 10905986825036860523 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear14  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  8895081521639637420 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear27  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 12464387133381661438 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear19  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  2880055957681953789 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear29  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  9183890932061987237 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear31  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  8371638504720300988 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear22  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 10002743743499159209 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear17  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  4523730516240309666 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear8   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 15435437835838139192 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear11  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │   756097590731240185 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear9   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 12911136620986716246 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear12  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 15834530069215973581 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear31  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  2778933048436799581 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear22  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  3431400205349850520 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear13  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 13683736416652084102 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear13  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 14059609743711840178 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear25  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  2988357157493497291 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear28  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 16146958724618824409 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear20  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 11007200161122304200 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear6   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  8079285099772927279 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear23  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 11394909356247832469 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear19  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 16666885187928053436 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear16  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  6956768772222382044 │ T        │ C        │ switch-port │ TF2   │ primary-data │ int0    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 10773026991683650248 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear21  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 17820117293304220522 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear1   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  6840059004777660900 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear15  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  4546337385136722914 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear21  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  4730845005745019941 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear11  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  4197624739596116631 │ T        │ C        │ switch-port │ TF2   │ primary-data │ qsfp26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  6500850491531141289 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear0   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  4482317240533975040 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear5   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 15788168535646315722 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear20  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  5051034547903499618 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 10444555488425996914 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear24  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 13678933375858933474 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear4   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 10043270192420610430 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear23  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 16941864685879894581 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear3   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 16123362320570486376 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear27  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 12958578737857061770 │ T        │ C        │ switch-port │ TF2   │ primary-data │ qsfp18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 13652221451308349941 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 13627503505782314272 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear30  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  9847120510806684081 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear14  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 12744659831664932266 │ T        │ C        │ switch-port │ TF2   │ primary-data │ qsfp26  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 13254999271480575466 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear0   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 12543560225616984746 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear3   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  9021094672032217726 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear10  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  5214763097398691070 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear2   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 16652066512748240246 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear29  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  2854864349868441750 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  5914094962255628952 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear10  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 16510965828585083258 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear6   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  6547455214936556723 │ T        │ C        │ switch-port │ TF2   │ primary-data │ qsfp18  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  7845955728345151377 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear2   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 13846398855017622740 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear7   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  8685222285163140992 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear5   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 10023093142870887259 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear30  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 15493658260864888608 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear17  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  1114318808045492183 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear25  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 15563854730682873276 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear16  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  6296741838962653061 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear12  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  5531446474934082220 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear15  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  1103678389185180213 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear24  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  9076816697852073085 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear28  │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │ 15070769942095295940 │ T        │ C        │ switch-port │ TF2   │ primary-data │ int0    │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 87c2c4fc-b0c7-4fef-a305-78f0ed265bbc │ 913-0000019 │ BRM42220014 │ 00000000-0000-0000-0201-bda398f0e1d4 │ BRM44220008   │ 913-0000006  │       0 │               -1 │                2 │         15 │           1 │             6 │               4 │
│ switch_data_link:pcs_invalid_errors │  9989711210244049645 │ T        │ C        │ switch-port │ TF2   │ primary-data │ rear9   │ de608e01-b8e4-4d93-b972-a7dbed36dd22 │ 71def415-55ad-46b4-ba88-3ca55d7fb287 │ 913-0000019 │ BRM42220051 │ 00000000-0000-0000-0701-b9a398f0e1d4 │ BRM44220012   │ 913-0000006  │       0 │               -1 │                7 │         14 │           0 │             6 │               4 │
└─────────────────────────────────────┴──────────────────────┴──────────┴──────────┴─────────────┴───────┴──────────────┴─────────┴──────────────────────────────────────┴──────────────────────────────────────┴─────────────┴─────────────┴──────────────────────────────────────┴───────────────┴──────────────┴─────────┴──────────────────┴──────────────────┴────────────┴─────────────┴───────────────┴─────────────────┘

70 rows in set. Elapsed: 0.055 sec. Processed 110.55 thousand rows, 6.80 MB (1.99 million rows/s., 122.49 MB/s.)
Peak memory usage: 8.30 MiB.

This is looking pretty good. We've dropped query latency from ~1200ms to ~55ms. And not that it matters much, since the sql is written for machines by machines, but the new query is shorter and easier to read than the original. If future clickhouse versions allow us to merge all field tables in a single statement and skip the join, that should improve performance further.

Intuitively, we should be able to go faster with a cache or materialized view. For example, we could imagine storing the map of fields for a given timeseries as a Map(String, Variant(String, Int8, Int16, ...)) in a separate table or view, and keeping it up to date with an incremental materialized view or in the application. But I think refactoring the existing query without introducing views or more application logic gives us a pretty good speedup with minimal effort, so I propose that we start there and defer a more complicated refactor until/unless we find that we need to go faster.

Does that sound all right @bnaecker?

[bnaecker]

That all sounds good, thanks for digging in! Just a head's up that I don't think we've implemented support for Map data types in the low-level protocol we use to talk to ClickHouse. I don't think that should be a ton of work, but we've just never needed it until now.