Skip to content

Latest commit

 

History

History
50 lines (31 loc) · 2.14 KB

tech-stack.md

File metadata and controls

50 lines (31 loc) · 2.14 KB

Technical Stack

Airbyte Core Backend

Connectors

Connectors can be written in any language. However the most common languages are:

Frontend

Additional Tools

FAQ

Why do we write most destination/database connectors in Java?

JDBC makes writing reusable database connector frameworks fairly easy, saving us a lot of development time.

Why are most REST API connectors written in Python?

Most contributors felt comfortable writing in Python, so we created a Python CDK to accelerate this development. You can write a connector from scratch in any language as long as it follows the Airbyte Specification.

Why did we choose to build the server with Java?

Simply put, the team has more experience writing production Java code.

Why do we use Temporal for orchestration?

Temporal solves the two major hurdles that exist in orchestrating hundreds to thousands of jobs simultaneously: scaling state management and proper queue management. Temporal solves this by offering primitives that allow serialising the jobs' current runtime memory into a DB. Since a job's entire state is stored, it's trivial to recover from failures, and it's easy to determine if a job was assigned correctly.