Making Postgres and Elasticsearch work together like it's 2021
🚨 Note 🚨
This is ZomboDB 3000.0.0-alpha4. This represents a year-long rewrite of ZomboDB to Rust.
It is expected that the alpha/beta phase will continue through January 2021. That said, please get started with it today. Report Issues, provide feedback, and also sponsors our work!
ZomboDB brings powerful text-search and analytics features to Postgres by using Elasticsearch as an index type. Its comprehensive query language and SQL functions enable new and creative ways to query your relational data.
From a technical perspective, ZomboDB is a 100% native Postgres extension that implements Postgres' Index Access Method API. As a native Postgres index type, ZomboDB allows you to
CREATE INDEX ... USING zombodb on your existing Postgres tables. At that point, ZomboDB takes over and fully manages the remote Elasticsearch index and guarantees transactionally-correct text-search query results.
ZomboDB is fully compatible with all of Postgres' query plan types and most SQL commands such as
It doesn’t matter if you’re using an Elasticsearch cloud provider or managing your own cluster -- ZomboDB communicates with Elasticsearch via its RESTful APIs so you’re covered either way.
ZomboDB allows you to use the power and scalability of Elasticsearch directly from Postgres. You don’t have to manage transactions between Postgres and Elasticsearch, asynchronous indexing pipelines, complex reindexing processes, or multiple data-access code paths -- ZomboDB does it all for you.
- Installation from Binaries (sponsors only)
- Installation from Source (everyone)
- Getting Started Tutorial
- Important Things to Know
- Creating Indexes
- Query DSL
- Aggregations, Scoring and Highlighting
- SQL Functions
- Configuration Settings, Index Managment
- Type Mapping
- Elasticsearch _cat API
- VACUUM Support
- MVCC-correct text-search and aggregation results
- Managed and queried via standard SQL
- Works with current Elasticsearch releases (no plugins required)
- Query using
- Scoring and Highlighting Support
- Support for all Elasticsearch aggregations
- Automatic Elasticsearch Mapping Generation
- Hot-Standby compatible
- Support for indexing & searching PostGIS
- Only one ZomboDB index per table
- ZomboDB indexes with predicates (ie, partial indexes) are not supported
CREATE INDEX CONCURRENTLYis not supported
- Partitioned Tables are not properly supported. This will be resolved in a near-future version (Issue #630)
These limitations may be addressed in future versions of ZomboDB.
|Postgres||10.x, 11.x, 12.x, 13.x|
Sponsorship and Downloads
Please see https://github.com/sponsors/eeeebbbbrrrr for sponsorship details. Your sponsorship at any tier is greatly appreciated and helps keep ZomboDB moving forward.
Note that ZomboDB is only available in binary form for certain sponsor tiers.
When you become a sponsor at a tier that provides binary downloads, please request a download key from https://www.zombodb.com/services/. Please do the same if you sponsor a tier that provides access to ZomboDB's private Discord server.
Note that this is just a quick overview. Please read the getting started tutorial for more details.
Create the extension:
CREATE EXTENSION zombodb;
Create a table:
CREATE TABLE products ( id SERIAL8 NOT NULL PRIMARY KEY, name text NOT NULL, keywords varchar(64), short_summary text, long_description zdb.fulltext, price bigint, inventory_count integer, discontinued boolean default false, availability_date date ); -- insert some data
Create a ZomboDB index:
CREATE INDEX idxproducts ON products USING zombodb ((products.*)) WITH (url='localhost:9200/');
SELECT * FROM products WHERE products ==> '(keywords:(sports OR box) OR long_description:"wooden away"~5) AND price:[1000 TO 20000]';
- Google Group: firstname.lastname@example.org
- Twitter: @zombodb
- via Github Issues and Pull Requests
- https://www.zombodb.com/services/ or email@example.com for commercial support
ZomboDB 3000 supports Postgres 10, 11, 12, 13 and doesn't require an Elasticsearch plugin.
Previous versions that support Postgres various versions of Postgres are are still available in source form, from these branches:
- Support for Elasticsearch 6.x (unsupported)
- Support for Elasticsearch 5.6 (unsupported)
- Support for Elasticsearch 2.4 (unsupported)
- Support for Elasticsearch 1.7 (unsupported)
Commercial support for all versions of ZomboDB is available by contacting ZomboDB, LLC.
The name is an homage to zombo.com and its long history of continuous self-affirmation.
Historically, ZomboDB began in 2013 by Technology Concepts & Design, Inc as a closed-source effort to provide transaction safe text-search on top of Postgres tables. While Postgres' "tsearch" features are useful, they're not necessarily adequate for 200 column-wide tables with 100M rows, each containing large text content.
Initially designed on-top of Postgres' Foreign Data Wrapper API, ZomboDB quickly evolved into an index type so that queries are MVCC-safe and standard SQL can be used to query and manage indices.
Elasticsearch was chosen as the backing search index because of its horizontal scaling abilities, performance, and general ease of use.
ZomboDB was open-sourced in July 2015 and has since been used in numerous production systems of various sizes and complexity.
Copyright 2018-2021 ZomboDB, LLC
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.