[WishList] Support more sources

[fulmicoton]

Comment here if you need/want support for

• Pulsar
• Google PubSub
• Microsoft EventHub
• RedPanda
• Fluvio
• etc.

Ideally, make it clear whether you already have such a message queue in production or not.

[splix]

Hi. I'm not quite sure it's a right place to vote, but I'd like to see a better support for Google Cloud services, because we're building on it. So PubSub and I guess Storage also. Thank you.

[fulmicoton]

In the main branch, (but not in Quickwit 0.2) we already support custom endpoint for storage. All S3 compatible storage are -in theory- supported. I have not tested that with Google Cloud storage specifically however.

For Google PubSub, it is more complicated story.
I opened an issue here: #1107

If you can share more about your use case, I'd love to hear about it. (If you can share it, but prefer to do it privately, my email is paul at quickwit.io)

[BrutalSimplicity]

This is an awesome project. I've been wanting a serverless search engine solution for years. Really happy to see the support this has gained.

I'm an AWS geek right now - GCP next! Given that, I would love to get this up and running against an AWS Kinesis stream.
So there's my vote! Thanks for all the hard work!

[galactus009]

I would like to see support for NATS

[fulmicoton]

I did not know about nats.
https://github.com/nats-io/nats.rs
https://docs.nats.io/nats-concepts/overview

[fulmicoton]

@BrutalSimplicity Thanks for your message! Kinesis is on our task list, so it should happen very fast.
You can check the progress one this issue #1157

[fmassot]

+1 for NATS as Nuclia is using it.

[juan-riveros]

Redis Streams and Redis Pub/Sub!

I love having a small, selfhosted stack, so minio/ceph/garage+redis+quickwit seems like a dream for most of my projects.

[calvin2021y]

scylladb/cassandra

[miton18]

+1 on Pulsar, already running in production on our side

[jorda95225]

+1 on Pulsar, already running in production on our side

[fulmicoton]

@jorda95225 @miton18 Stay tuned, it will be released with quickwit 0.5, available in the next few weeks.

[blablacio]

+1 for Scylla/Cassandra, which is already used in our production systems for our chat service.

[drusellers]

+1 for RabbitMQ (Queue or Stream)

[olivierboudet]

Hi, I would like to have rabbitmq support also which is already running in production.