🎉 New Source: Merge [Low code CDK] #25342

btkcodedev · 2023-04-19T20:07:23Z

What

Developing a new connector for the source: Merge

Resolves:
Merge
Part of hackathon week

How

Developed using (Configuration Based Source) low-code CDK

Tests

Integration & Acceptance

Full Test Results

🚨 User Impact 🚨

No breaking changes, Just addition of new source

New Connector: Source Merge

Community member or Airbyter

btkcodedev · 2023-04-19T20:14:49Z

PS for the reviewers:
Source Merge is actually pulling data from other linked platforms. It is currently in the beta stages.
Thus most of the endpoints cannot be seeded with the sandbox account. (See screenshot of POST result)

Thus the implemented endpoints will give basic information about the merge and its integrated account.
All response-giving endpoints are added.
Please ping via Slack for sharing credentials for testing :)

marcosmarxm

There are others endpoints. Are you planning to add them too? Left some comments of missing features.

airbyte-integrations/connectors/source-merge/source_merge/manifest.yaml

…ents

btkcodedev · 2023-04-20T14:52:52Z

Seeding the endpoints through POST required paid plan, thus adding other streams as empty.

…s, jobs, job-interview-stages

btkcodedev · 2023-04-20T15:24:24Z

Here are the credentials:
{
"account_token": "kVpI78bNtlks9zhDXtaMtyYcpZquh07R2zdpRyHvurnc-JebX5fDcQ",
"api_token": "ZqZvk2yty0ooFNKID8TBsEB13cFjtBFuXBbB0wwq6gV0Tr_Gihxy5g",
"start_date": "2022-03-01T00:00:00.000Z"
}

No worries, Completely made up of temp email creds.

btkcodedev · 2023-04-20T15:26:18Z

The pagination feature added and other stream schemas are updated.
I couldn't seed the endpoints as it requires paid plan, Tests are passing.
Results below:

marcosmarxm · 2023-04-20T20:54:37Z

airbyte-integrations/connectors/source-merge/source_merge/manifest.yaml

+    retriever:
+      $ref: "#/definitions/retriever"
+
+  account_details_stream:


Why you're not adding the /accounts endpoint?

The /accounts is for Accounting Base, the issue was based only for ATS URL
See https://docs.merge.dev/ats/overview/

All the endpoints inside Merge ATS is added :)

btkcodedev · 2023-04-25T02:30:26Z

@marcosmarxm Bump here :)

marcosmarxm · 2023-04-25T21:38:38Z

/test connector=connectors/source-merge

🕑 connectors/source-merge https://github.com/airbytehq/airbyte/actions/runs/4802449368
✅ connectors/source-merge https://github.com/airbytehq/airbyte/actions/runs/4802449368
No Python unittests run

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: This connector does not implement incremental sync
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:103: The previous connector image could not be retrieved.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:581: The previous connector image could not be retrieved.
======================== 35 passed, 3 skipped in 42.73s ========================

marcosmarxm · 2023-04-25T21:48:01Z

/publish connector=connectors/source-merge

🕑 Publishing the following connectors:
connectors/source-merge
https://github.com/airbytehq/airbyte/actions/runs/4802505622

Connector	Version	Did it publish?	Were definitions generated?
connectors/source-merge	0.1.0	❌	❌

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

btkcodedev · 2023-04-26T01:55:38Z

@marcosmarxm Please add hackathon-developer-week label

marcosmarxm

Thanks @btkcodedev I'm having problems publishing the connector. Request help from our connector ops team. All your tasks are done!

btkcodedev · 2023-04-26T21:15:02Z

Thank you for your continued support & efforts @marcosmarxm

marcosmarxm · 2023-05-01T17:15:07Z

/publish connector=connectors/source-merge

🕑 Publishing the following connectors:
connectors/source-merge
https://github.com/airbytehq/airbyte/actions/runs/4853198559

Connector	Version	Did it publish?	Were definitions generated?
connectors/source-merge	0.1.0	✅	✅

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

marcosmarxm

Thanks @btkcodedev

* Initial commit * add pagination * add streams activites, applications, attachments, candidates, departments * add schemas and stream manifest for eeocs, interviews, offers, offices, jobs, job-interview-stages * Update spec.yaml * fix test * add uuid for merge connector * update job interview stages * remove seed files unused * auto-bump connector version --------- Co-authored-by: marcosmarxm <marcosmarxm@gmail.com> Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

Initial commit

cd99812

octavia-squidington-iii added area/connectors Connector related issues area/documentation Improvements or additions to documentation bounty community connectors/source/merge labels Apr 19, 2023

Merge branch 'master' into merge

8f087b1

marcosmarxm requested changes Apr 19, 2023

View reviewed changes

airbyte-integrations/connectors/source-merge/source_merge/manifest.yaml Show resolved Hide resolved

airbyte-integrations/connectors/source-merge/source_merge/manifest.yaml Outdated Show resolved Hide resolved

btkcodedev added 4 commits April 20, 2023 19:33

add pagination

57d1dd6

Merge branch 'merge' of https://github.com/btkcodedev/airbyte into merge

763c0d1

add streams activites, applications, attachments, candidates, departm…

ff1d87d

…ents

Merge branch 'master' into merge

8bbbec6

btkcodedev added 2 commits April 20, 2023 20:52

add schemas and stream manifest for eeocs, interviews, offers, office…

b2d3c45

…s, jobs, job-interview-stages

Merge branch 'merge' of https://github.com/btkcodedev/airbyte into merge

8040945

Update spec.yaml

b1051d4

marcosmarxm requested changes Apr 20, 2023

View reviewed changes

btkcodedev requested a review from marcosmarxm April 22, 2023 17:00

marcosmarxm and others added 4 commits April 25, 2023 18:09

fix test

64a4ea7

add uuid for merge connector

34ea5fa

update job interview stages

e4ebe66

Merge branch 'master' into merge

ea76795

remove seed files unused

1a3a447

marcosmarxm added the hackthon-developer-week label Apr 26, 2023

marcosmarxm approved these changes Apr 26, 2023

View reviewed changes

Merge branch 'master' into merge

5dd46da

auto-bump connector version

9b58447

marcosmarxm approved these changes May 1, 2023

View reviewed changes

marcosmarxm merged commit 0f476cf into airbytehq:master May 1, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

🎉 New Source: Merge [Low code CDK] #25342

🎉 New Source: Merge [Low code CDK] #25342

btkcodedev commented Apr 19, 2023

btkcodedev commented Apr 19, 2023 •

edited

Loading

marcosmarxm left a comment

btkcodedev commented Apr 20, 2023

btkcodedev commented Apr 20, 2023

btkcodedev commented Apr 20, 2023 •

edited

Loading

marcosmarxm Apr 20, 2023

btkcodedev Apr 21, 2023 •

edited

Loading

btkcodedev commented Apr 25, 2023

marcosmarxm commented Apr 25, 2023 •

edited by github-actions bot

Loading

marcosmarxm commented Apr 25, 2023 •

edited by github-actions bot

Loading

btkcodedev commented Apr 26, 2023

marcosmarxm left a comment

btkcodedev commented Apr 26, 2023

marcosmarxm commented May 1, 2023 •

edited by github-actions bot

Loading

marcosmarxm left a comment

🎉 New Source: Merge [Low code CDK] #25342

🎉 New Source: Merge [Low code CDK] #25342

Conversation

btkcodedev commented Apr 19, 2023

What

How

Recommended reading order

Tests

🚨 User Impact 🚨

Community member or Airbyter

btkcodedev commented Apr 19, 2023 • edited Loading

marcosmarxm left a comment

Choose a reason for hiding this comment

btkcodedev commented Apr 20, 2023

btkcodedev commented Apr 20, 2023

btkcodedev commented Apr 20, 2023 • edited Loading

marcosmarxm Apr 20, 2023

Choose a reason for hiding this comment

btkcodedev Apr 21, 2023 • edited Loading

Choose a reason for hiding this comment

btkcodedev commented Apr 25, 2023

marcosmarxm commented Apr 25, 2023 • edited by github-actions bot Loading

Build Passed

marcosmarxm commented Apr 25, 2023 • edited by github-actions bot Loading

btkcodedev commented Apr 26, 2023

marcosmarxm left a comment

Choose a reason for hiding this comment

btkcodedev commented Apr 26, 2023

marcosmarxm commented May 1, 2023 • edited by github-actions bot Loading

marcosmarxm left a comment

Choose a reason for hiding this comment

btkcodedev commented Apr 19, 2023 •

edited

Loading

btkcodedev commented Apr 20, 2023 •

edited

Loading

btkcodedev Apr 21, 2023 •

edited

Loading

marcosmarxm commented Apr 25, 2023 •

edited by github-actions bot

Loading

marcosmarxm commented Apr 25, 2023 •

edited by github-actions bot

Loading

marcosmarxm commented May 1, 2023 •

edited by github-actions bot

Loading