feat: Support text arrays

[rebasedming]

Ticket(s) Closed

• Closes Support text arrays #504

What

With this PR, Postgres text[] and varchar[] columns are properly recognized and indexed as Tantivy multivalue fields.

Usage:

CREATE TABLE example_table (
    id SERIAL PRIMARY KEY,
    text_array TEXT[]
);

INSERT INTO example_table (text_array) VALUES 
('{"text1", "text2", "text3"}'),
('{"another", "array", "of", "texts"}'),
('{"single element"}');

CREATE INDEX ON example_table
USING bm25 ((example_table.*))
WITH (text_fields='{text_array: {}}');

SELECT * FROM example_table WHERE example_table @@@ 'text_array:text1';
 id |     text_array
----+---------------------
  1 | {text1,text2,text3}
(1 row)

Why

How

Tests

Added an additional regression test

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
paradedb	⬜️ Ignored (Inspect)	Visit Preview		Nov 26, 2023 8:21pm

[codecov]

Codecov Report

Merging #570 (d7c9254) into dev (83fd5d5) will increase coverage by 6.21%.
The diff coverage is 42.59%.

Additional details and impacted files

@@            Coverage Diff             @@
##              dev     #570      +/-   ##
==========================================
+ Coverage   60.14%   66.36%   +6.21%     
==========================================
  Files          42       27      -15     
  Lines        3475     2720     -755     
==========================================
- Hits         2090     1805     -285     
+ Misses       1385      915     -470     

Files	Coverage Δ
pg_bm25/src/parade_index/index.rs	71.61% <80.00%> (+0.03%)	⬆️
pg_bm25/src/json/builder.rs	24.03% <0.00%> (-2.28%)	⬇️
pg_bm25/src/index_access/utils.rs	61.82% <47.50%> (-5.46%)	⬇️

... and 15 files with indirect coverage changes

[philippemnoel]

pushed a fix for Codecov