`fetch` and `apply`: use lookup tables #231

jqnatividad · 2022-04-03T18:17:48Z

to support fetch --url-template and apply dynfmt respectively
vec backed lookup tables for dynamic formatting of these features are faster and cheaper

also simplify iter in safe_header_names

- faster and cheaper - also simplified censor_check and censor addl custom profanity loop - use regex_once_cell macro from util

- with repeating columns

rather than BTreeMap, its faster and cheaper

as integration tests run in parallel, we need to use serial_test for `fetch` testing, as we have two tests that start a test webserver, so we want to make sure they run serially as they are listening on the same port and run async

that uses the test web server. Note that we have the `#[serial]` hint on the tests that run a web server to ensure they do not run in parallel (as they cannot, since they listen on the same port)

- along with `serial_test`, `jql` and `zip` were bumped

jqnatividad added 7 commits April 3, 2022 14:05

add regex_once_cell to util.rs

202e5dd

also simplify iter in safe_header_names

apply: use vec lookup tables rather than hashmap for dynfmt

72d59b8

- faster and cheaper - also simplified censor_check and censor addl custom profanity loop - use regex_once_cell macro from util

apply: make dynfmt tests more complex

7946832

- with repeating columns

fetch: refactor --url-template processing to use vec table lookup

2b29d2b

rather than BTreeMap, its faster and cheaper

Add serial_test to dev_dependencies

2519149

as integration tests run in parallel, we need to use serial_test for `fetch` testing, as we have two tests that start a test webserver, so we want to make sure they run serially as they are listening on the same port and run async

fetch: add more complex --url-template test

1d05850

that uses the test web server. Note that we have the `#[serial]` hint on the tests that run a web server to ensure they do not run in parallel (as they cannot, since they listen on the same port)

cargo update bump

6a6ecb8

- along with `serial_test`, `jql` and `zip` were bumped

jqnatividad merged commit 7246c69 into master Apr 3, 2022

jqnatividad deleted the dynfmt-lookup-tables branch April 12, 2022 15:04

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

`fetch` and `apply`: use lookup tables #231

`fetch` and `apply`: use lookup tables #231

jqnatividad commented Apr 3, 2022

fetch and apply: use lookup tables #231

fetch and apply: use lookup tables #231

Conversation

jqnatividad commented Apr 3, 2022

`fetch` and `apply`: use lookup tables #231

`fetch` and `apply`: use lookup tables #231