🎉 New Source: Marketo

[lazebnyi]

What

#5240 - New Source: Marketo

How

Using CDK and custom methods implemented the connector logic for Marketo as a source for Airbyte.

Recommended reading order

1. x.java
2. y.python

Pre-merge Checklist

New Connector

Community member or Airbyter

• Community member? Grant edit access to maintainers (instructions)
• Secrets in the connector's spec are annotated with airbyte_secret
• Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
• Code reviews completed
• Documentation updated
  • Connector's README.md
  • Connector's bootstrap.md. See description and examples
  • docs/SUMMARY.md
  • docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
  • docs/integrations/README.md
  • airbyte-integrations/builds.md
• PR name follows PR naming conventions
• Connector added to connector index like described here

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

• Create a non-forked branch based on this PR and test the below items on it
• Build is successful
• Credentials added to Github CI. Instructions.
• /test connector=connectors/<name> command is passing.
• New Connector version released on Dockerhub by running the /publish command described here

[antixar]

Please remove your local test logs airbyte-integrations/connectors/source-marketo/acceptance_tests_logs

[bazarnov]

Small corrections are needed.

[davinchia]

nice!

did you also manage to run the /test command? I don't see this on the PR.

[lazebnyi]

/test connector=connectors/source-marketo

🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265365630
❌ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265365630

[lazebnyi]

/test connector=connectors/source-marketo

🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265405591
❌ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265405591
🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265405591
❌ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265405591

[lazebnyi]

/test connector=connectors/source-marketo

🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265482638
❌ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265482638
🐛 https://gradle.com/s/g5mlyoamdlqko

[lazebnyi]

/test connector=connectors/source-marketo

🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265691945
✅ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265691945
Python tests coverage:

	 ---------- coverage: platform linux, python 3.8.10-final-0 -----------
	 Name                                                 Stmts   Miss  Cover
	 ------------------------------------------------------------------------
	 source_acceptance_test/__init__.py                       2      0   100%
	 source_acceptance_test/base.py                          10      4    60%
	 source_acceptance_test/config.py                        74      8    89%
	 source_acceptance_test/conftest.py                     108    108     0%
	 source_acceptance_test/plugin.py                        45     45     0%
	 source_acceptance_test/tests/__init__.py                 4      0   100%
	 source_acceptance_test/tests/test_core.py              158    109    31%
	 source_acceptance_test/tests/test_full_refresh.py       18     11    39%
	 source_acceptance_test/tests/test_incremental.py        69     38    45%
	 source_acceptance_test/utils/__init__.py                 6      0   100%
	 source_acceptance_test/utils/asserts.py                 37      2    95%
	 source_acceptance_test/utils/common.py                  41     25    39%
	 source_acceptance_test/utils/compare.py                 47     20    57%
	 source_acceptance_test/utils/connector_runner.py        82     49    40%
	 source_acceptance_test/utils/json_schema_helper.py      75     11    85%
	 ------------------------------------------------------------------------
	 TOTAL                                                  776    430    45%
	 ---------- coverage: platform linux, python 3.8.10-final-0 -----------
	 Name                         Stmts   Miss  Cover
	 ------------------------------------------------
	 source_marketo/__init__.py       2      0   100%
	 source_marketo/source.py       237    151    36%
	 source_marketo/utils.py         31      8    74%
	 ------------------------------------------------
	 TOTAL                          270    159    41%

Already approved by airbyte

[lazebnyi]

/publish connector=connectors/source-marketo

🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265848852
❌ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265848852
🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265848852
❌ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1265848852

[lazebnyi]

/publish connector=connectors/source-marketo

🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1266187684
❌ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1266187684

[lazebnyi]

/publish connector=connectors/source-marketo

🕑 connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1266334840
✅ connectors/source-marketo https://github.com/airbytehq/airbyte/actions/runs/1266334840