Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[bug] cannot parse route-views5 recent rib file #67

Closed
digizeph opened this issue Aug 4, 2022 · 1 comment · Fixed by #68
Closed

[bug] cannot parse route-views5 recent rib file #67

digizeph opened this issue Aug 4, 2022 · 1 comment · Fixed by #68
Labels
bug Something isn't working

Comments

@digizeph
Copy link
Member

digizeph commented Aug 4, 2022 •
edited

bgpkit-parse (monocle parse) and bgpreader cannot read the recent rib files, but bgpdump works fine (seemingly).

Example:
http://archive.routeviews.org/route-views5/bgpdata/2022.08/RIBS/rib.20220801.0000.bz2

monocle --debug parse rib.20220801.0000.bz2

2022-08-04T18:16:09.581900Z  WARN bgpkit_parser::parser::bgp::attributes: PARTIAL: Error: unsupported attribute type: RESERVED
A|1659312000|185.156.96.227|207934|1.6.166.0/24|207934 3292 6453 4755 9583|IGP|185.156.96.227|0|0|3292:1100 3292:24901 65000:100|NAG||
A|1659312000|103.247.3.36|58511|1.6.166.0/24|58511 3491 6453 4755 9583|IGP|103.247.3.36|0|0||NAG||
A|1659312000|170.39.196.252|33185|1.6.166.0/24|33185 174 6453 4755 9583|IGP|170.39.196.252|0|0||NAG||
A|1659312000|91.216.79.0|41666|1.6.166.0/24|41666 58299 6830 6453 4755 9583|IGP|91.216.79.0|0|0|6453:2000 6453:2100 6453:2104 6453:10001 6453:10002 6830:17000 6830:17457 6830:23001 6830:33104 41666:1000 58299:1000|NAG||
A|1659312000|87.239.48.250|211398|1.6.166.0/24|211398 34854 3257 6453 4755 9583|IGP|87.239.48.250|0|0|3257:8052 3257:30110 3257:50001 3257:54900 3257:54901 34854:3005 lg:211398:255:100 lg:211398:555:555 lg:211398:2760255:34854|NAG||
A|1659312000|23.159.240.61|40864|1.6.166.0/24|40864 6461 6453 4755 9583|IGP|23.159.240.61|0|0|6461:5997|NAG||
A|1659312000|87.239.48.250|211398|1.6.166.0/24|211398 34927 174 6453 4755 9583|IGP|87.239.48.250|0|0|174:21100 174:22010 34927:710 34927:747 lg:211398:252:100 lg:211398:5280252:34927|NAG||
A|1659312000|87.239.48.250|211398|1.6.166.0/24|211398 34854 3257 6453 4755 9583|IGP|87.239.48.250|0|0|3257:8052 3257:30110 3257:50001 3257:54900 3257:54901 34854:3005 lg:211398:245:100 lg:211398:2760245:34854|NAG||
A|1659312000|87.239.48.250|211398|1.6.166.0/24|211398 57695 60068 174 6453 4755 9583|IGP|87.239.48.250|0|0|174:21100 174:22012 57695:13000 60068:203 60068:2000 60068:2010 60068:7040 lg:211398:250:100 lg:211398:8260250:57695|NAG||
A|1659312000|103.247.3.142|58511|1.6.166.0/24|58511 1299 6453 4755 9583|IGP|103.247.3.142|0|0|58511:100 58511:9005|NAG||
A|1659312000|170.39.196.252|33185|1.6.218.0/24|33185 174 6453 4755 9583|INCOMPLETE|170.39.196.252|0|0||NAG||
A|1659312000|103.247.3.142|58511|1.6.218.0/24|58511 3491 6453 4755 9583|IGP|103.247.3.142|0|0|58511:100 58511:9005|NAG||
A|1659312000|87.239.48.250|211398|1.6.218.0/24|211398 34854 3257 6453 4755 9583|INCOMPLETE|87.239.48.250|0|0|3257:8052 3257:30110 3257:50001 3257:54900 3257:54901 34854:3005 lg:211398:255:100 lg:211398:555:555 lg:211398:2760255:34854|NAG||
A|1659312000|103.247.3.36|58511|1.6.218.0/24|58511 3491 6453 4755 9583|IGP|103.247.3.36|0|0||NAG||
A|1659312000|91.216.79.0|41666|1.6.218.0/24|41666 58299 6830 6453 4755 9583|INCOMPLETE|91.216.79.0|0|0|6453:2000 6453:2100 6453:2104 6453:10001 6453:10002 6830:17000 6830:17457 6830:23001 6830:33104 41666:1000 58299:1000|NAG||
A|1659312000|23.159.240.61|40864|1.6.218.0/24|40864 6461 6453 4755 9583|INCOMPLETE|23.159.240.61|0|0|6461:5997|NAG||
A|1659312000|87.239.48.250|211398|1.6.218.0/24|211398 57695 60068 174 6453 4755 9583|INCOMPLETE|87.239.48.250|0|0|174:21100 174:22012 57695:13000 60068:203 60068:2000 60068:2010 60068:7040 lg:211398:250:100 lg:211398:8260250:57695|NAG||
A|1659312000|87.239.48.250|211398|1.6.218.0/24|211398 48646 50629 3356 6453 4755 9583|IGP|87.239.48.250|0|0|3356:2 3356:86 3356:501 3356:666 3356:901 3356:2065 6453:2000 6453:2100 6453:2104 6453:10001 6453:10002 50629:180 50629:306 50629:1000 50629:10001 50629:10104 50629:10208 lg:48646:0:101 lg:211398:245:100 lg:211398:2760245:48646|NAG||
A|1659312000|87.239.48.250|211398|1.6.218.0/24|211398 34927 174 6453 4755 9583|INCOMPLETE|87.239.48.250|0|0|174:21100 174:22010 34927:710 34927:747 lg:211398:252:100 lg:211398:5280252:34927|NAG||
A|1659312000|185.156.96.227|207934|1.6.218.0/24|207934 3292 6453 4755 9583|INCOMPLETE|185.156.96.227|0|0|3292:1100 3292:24901 65000:100|NAG||
A|1659312000|170.39.196.252|33185|1.7.141.0/24|33185 174 6453 4755 9583|IGP|170.39.196.252|0|0||NAG||
A|1659312000|103.247.3.142|58511|1.7.141.0/24|58511 1299 6453 4755 9583|IGP|103.247.3.142|0|0|58511:100 58511:9005|NAG||
A|1659312000|87.239.48.250|211398|1.7.141.0/24|211398 34854 3257 6453 4755 9583|IGP|87.239.48.250|0|0|3257:8052 3257:30110 3257:50001 3257:54900 3257:54901 34854:3005 lg:211398:255:100 lg:211398:555:555 lg:211398:2760255:34854|NAG||
A|1659312000|103.247.3.36|58511|1.7.141.0/24|58511 3491 6453 4755 9583|IGP|103.247.3.36|0|0||NAG||
A|1659312000|91.216.79.0|41666|1.7.141.0/24|41666 58299 6830 6453 4755 9583|IGP|91.216.79.0|0|0|6453:2000 6453:2100 6453:2104 6453:10001 6453:10002 6830:17000 6830:17457 6830:23001 6830:33104 41666:1000 58299:1000|NAG||
A|1659312000|23.159.240.61|40864|1.7.141.0/24|40864 6461 6453 4755 9583|IGP|23.159.240.61|0|0|6461:5997|NAG||
A|1659312000|87.239.48.250|211398|1.7.141.0/24|211398 34854 3257 6453 4755 9583|IGP|87.239.48.250|0|0|3257:8052 3257:30110 3257:50001 3257:54900 3257:54901 34854:3005 lg:211398:245:100 lg:211398:2760245:34854|NAG||
A|1659312000|87.239.48.250|211398|1.7.141.0/24|211398 34927 174 6453 4755 9583|IGP|87.239.48.250|0|0|174:21100 174:22010 34927:710 34927:747 lg:211398:252:100 lg:211398:5280252:34927|NAG||
A|1659312000|87.239.48.250|211398|1.7.141.0/24|211398 57695 60068 174 6453 4755 9583|IGP|87.239.48.250|0|0|174:21100 174:22012 57695:13000 60068:203 60068:2000 60068:2010 60068:7040 lg:211398:250:100 lg:211398:8260250:57695|NAG||
A|1659312000|185.156.96.227|207934|1.7.141.0/24|207934 3292 6453 4755 9583|IGP|185.156.96.227|0|0|3292:1100 3292:24901 65000:100|NAG||
2022-08-04T18:16:09.583772Z  WARN bgpkit_parser::parser::bgp::attributes: PARTIAL: Error: unsupported attribute type: RESERVED
2022-08-04T18:16:09.583779Z  WARN bgpkit_parser::parser::bgp::attributes: Error: unsupported attribute type: TUNNEL_ENCAPSULATION
2022-08-04T18:16:09.584581Z  WARN bgpkit_parser::parser::bgp::attributes: PARTIAL: Error: unsupported attribute type: RESERVED
2022-08-04T18:16:09.584589Z  WARN bgpkit_parser::parser::bgp::attributes: Error: unsupported attribute type: RESERVED
2022-08-04T18:16:09.584591Z  WARN bgpkit_parser::parser::bgp::attributes: Error: unsupported attribute type: BFD_DISCRIMINATOR
2022-08-04T18:16:09.586025Z  WARN bgpkit_parser::parser::bgp::attributes: Error: unsupported attribute type: RESERVED

bgpreader -d singlefile -o rib-file=http://archive.routeviews.org/route-views5/bgpdata/2022.08/RIBS/rib.20220801.0000.bz2

WARN: No time window specified, defaulting to all available data
2022-08-04 11:16:39 29593: bgpstream_parsebgp_common.c:601: ERROR: Failed to parse message from 'http://archive.routeviews.org/route-views5/bgpdata/2022.08/RIBS/rib.20220801.0000.bz2' (-2:Invalid Message)

The first few messages from bgpdump results:

TIME: 08/01/22 00:00:00
TYPE: TABLE_DUMP_V2/IPV4_UNICAST_ADDPATH
PREFIX: 1.0.0.0/24 PATH_ID: 27
SEQUENCE: 0
FROM: 87.239.48.250 AS211398
ORIGINATED: 07/31/22 22:10:52
ORIGIN: IGP
ASPATH: 211398 34854 3257 13335
NEXT_HOP: 87.239.48.250
AGGREGATOR: AS13335 162.158.84.50
COMMUNITY: 3257:4000 3257:8794 3257:50001 3257:50110 3257:54900 3257:54901 34854:3005 65000:4134 65001:3320 65002:5511
LARGE_COMMUNITY: 211398:255:100 211398:555:555 211398:2760255:34854

TIME: 08/01/22 00:00:00
TYPE: TABLE_DUMP_V2/IPV4_UNICAST_ADDPATH
PREFIX: 1.0.0.0/24 PATH_ID: 0
SEQUENCE: 0
FROM: 91.216.79.0 AS41666
ORIGINATED: 07/28/22 20:05:54
ORIGIN: IGP
ASPATH: 41666 13335
NEXT_HOP: 91.216.79.0
AGGREGATOR: AS13335 141.101.65.254
COMMUNITY: 13335:10020 13335:19020 13335:20050 13335:20500 13335:20530

TIME: 08/01/22 00:00:00
TYPE: TABLE_DUMP_V2/IPV4_UNICAST_ADDPATH
PREFIX: 1.0.0.0/24 PATH_ID: 0
SEQUENCE: 0
FROM: 23.159.240.61 AS40864
ORIGINATED: 07/26/22 11:44:55
ORIGIN: IGP
ASPATH: 40864 6461 13335
NEXT_HOP: 23.159.240.61
AGGREGATOR: AS13335 108.162.239.1
COMMUNITY: 6461:5997

TIME: 08/01/22 00:00:00
TYPE: TABLE_DUMP_V2/IPV4_UNICAST_ADDPATH
PREFIX: 1.0.0.0/24 PATH_ID: 23
SEQUENCE: 0
FROM: 87.239.48.250 AS211398
ORIGINATED: 07/31/22 06:39:27
ORIGIN: IGP
ASPATH: 211398 48646 50629 13335
NEXT_HOP: 87.239.48.250
AGGREGATOR: AS13335 162.158.200.1
COMMUNITY: 13335:10075 13335:19020 13335:20050 13335:20500 13335:20530 50629:200 50629:201 50629:334 50629:1000 50629:10001 50629:10102 50629:10205
LARGE_COMMUNITY: 48646:0:101 211398:245:100 211398:2760245:48646

TIME: 08/01/22 00:00:00
TYPE: TABLE_DUMP_V2/IPV4_UNICAST_ADDPATH
PREFIX: 1.0.0.0/24 PATH_ID: 21
SEQUENCE: 0
FROM: 87.239.48.250 AS211398
ORIGINATED: 07/27/22 13:26:51
ORIGIN: IGP
ASPATH: 211398 34927 13335
NEXT_HOP: 87.239.48.250
AGGREGATOR: AS13335 141.101.65.254
COMMUNITY: 13335:10020 13335:19020 13335:20050 13335:20500 13335:20530 34927:130 34927:153 34927:730 34927:732
LARGE_COMMUNITY: 211398:252:100 211398:5280252:34927

TIME: 08/01/22 00:00:00
TYPE: TABLE_DUMP_V2/IPV4_UNICAST_ADDPATH
PREFIX: 1.0.0.0/24 PATH_ID: 0
SEQUENCE: 0
FROM: 185.156.96.227 AS207934
ORIGINATED: 07/29/22 12:31:33
ORIGIN: IGP
ASPATH: 207934 13335
NEXT_HOP: 185.156.96.227
AGGREGATOR: AS13335 162.158.132.1
COMMUNITY: 13335:10065 13335:19020 13335:20050 13335:20500 13335:20530 65000:200 65001:26301
@digizeph digizeph added the bug Something isn't working label Aug 4, 2022
@digizeph digizeph mentioned this issue Aug 6, 2022
Merged
@digizeph digizeph linked a pull request Aug 6, 2022 that will close this issue
fix parsing add_path rib dump entry #68
Merged
@digizeph
Copy link
Member Author

digizeph commented Aug 6, 2022

This issue is fixed in #68. Please see that pull request for more details.

@digizeph digizeph mentioned this issue Aug 6, 2022
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix parsing add_path rib dump entry bgpkit/bgpkit-parser
1 participant
@digizeph