Skip to content

Add S3VectorsCreateIndexOperator#66121

Merged
vincbeck merged 1 commit intoapache:mainfrom
john-jac:add-s3vectors-create-index
May 4, 2026
Merged

Add S3VectorsCreateIndexOperator#66121
vincbeck merged 1 commit intoapache:mainfrom
john-jac:add-s3vectors-create-index

Conversation

@john-jac
Copy link
Copy Markdown
Contributor

What

Add S3VectorsCreateIndexOperator to create indexes in Amazon S3 Vectors vector buckets.

Why

Indexes are the core resource for storing and querying vectors within a vector bucket. The hierarchy is: vector bucket → index → vectors. S3VectorsCreateVectorBucketOperator (#65968) already exists, but there was no operator to create indexes within a bucket.

What was done

  • Operator: S3VectorsCreateIndexOperator with if_exists idempotency, prune_dict, support for data_type, dimension, distance_metric, and metadata_configuration. Added to existing s3_vectors.py.
  • Unit tests: Added to existing test_s3_vectors.py — happy path, metadata config, skip-existing, fail-on-conflict, template fields
  • System test: Updated example_s3_vectors.py — creates index after bucket, with @task teardown for delete (future S3VectorsDeleteIndexOperator)
  • Docs: Updated s3_vectors.rst with new section, fixed heading hierarchy (dashes for sections, Reference last)

No provider.yaml or get_provider_info.py changes needed — S3 Vectors integration already registered.

@john-jac john-jac requested a review from o-nikolas as a code owner April 29, 2026 18:40
@john-jac john-jac force-pushed the add-s3vectors-create-index branch from cb96056 to 34512bc Compare April 29, 2026 18:54
@john-jac john-jac force-pushed the add-s3vectors-create-index branch from 34512bc to b5bdd83 Compare April 29, 2026 23:30
Comment thread providers/amazon/tests/system/amazon/aws/example_s3_vectors.py Outdated
@john-jac john-jac force-pushed the add-s3vectors-create-index branch 4 times, most recently from 3306731 to 47d7a79 Compare May 1, 2026 04:17
@john-jac john-jac force-pushed the add-s3vectors-create-index branch from 47d7a79 to d6ce9de Compare May 1, 2026 21:41
@vincbeck vincbeck merged commit 1a83f11 into apache:main May 4, 2026
94 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants