Skip to content

[Feature Request]: IO connector for Salesforce Pub/Sub API #22573

@bquinart

Description

@bquinart

What would you like to happen?

Consider building a connector for the Salesforce Pub/Sub API.
Salesforce is ubiquitous and such a connector would add value to the Beam community.

Salesforce has a number of API's (batch and 'event driven'), but has recently introduced a modern API based on gRPC and branded as "Pub/Sub API".
Documentation is here and blog here.
There is some samples available here.
I think a source is most relevant but the same API can be used as sink.
Not clear to me if it would be possible to parallelise the source.

Such a connector would allow a number of architectures, for example when operational Salesforce data needs to be integrated in real-time with a data & AI platform.

I posted this based on Beam Summit 2022 video from Ken in which he mentions the ambition to grow the number of connectors.

Note that I previously also made a feature request to add a similar connector to Google Datastream (here). However Beam would be a lot more flexible and allow for a lot more specific scenarios.

Issue Priority

Priority: 2

Issue Component

Component: io-ideas

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions