[proposal] Vectorizer select and exclude properties – in one place

[sebawita]

Describe your feature request

Hi team,

With the latest update to the named vectors, Weaviate added source_properties under the vectorizer configuration, which is GREAT 😄

Can we move the skip_vectorization from the collection property schema to the vectorizer config (just like this was done with source_properties)? We could call it exclude_properties.

This way, we could deprecate skip_vectorization from the property schema.

Scenarios

Here are a few scenarios (I will provide the examples in Python):

Default – use all relevant properties (existing syntax)

When source_properties or exclude_properties are not provided, Weaviate should use all relevant properties for vectorization.

client.collections.create(
    "Article",
    vectorizer_config=Configure.NamedVectors.text2vec_x(
        name="content",
    ),
    ...
)

Selective (existing syntax)

Use properties provided in source_properties for vectorization

client.collections.create(
    "Article",
    vectorizer_config=Configure.NamedVectors.text2vec_x(
        name="content",
        source_properties=["title", "description"]
    ),
    ...
)

Exclusive (the new syntax)

Use all relevant properties except for the ones provided in exclude_properties

Note. exclude should only take an array of strings, as we don't need to specify extra properties like: vectorize_property_name=True

client.collections.create(
    "Article",
    vectorizer_config=Configure.NamedVectors.text2vec_x(
        name="content",
        exclude_properties=["author_name", "url"]
    ),
    ...
)

Mixed Error

We shouldn't mix source_properties with exclude_properties.
The following should throw an error.

client.collections.create(
    "Article",
    vectorizer_config=Configure.NamedVectors.text2vec_x(
        name="content",
        source_properties=["title", "description"]    # throw an error
        exclude_properties=["author_name", "url"] # throw an error
    ),
    ...
)

Multiple Vectors

Each vectorizer can use a different set of property selectors

client.collections.create(
    "Article",
    vectorizer_config=[Configure.NamedVectors.text2vec_x(
            name="title",
            source_properties=["title"]
        ),
    vectorizer_config=[Configure.NamedVectors.text2vec_x(
            name="content",
            exclude_properties=["author_name", "url"]
        ),
    ]
    ...
)

Code of Conduct

• I have read and agree to the Weaviate's Contributor Guide and Code of Conduct