🎉 JDBC source: adjust fetch size based on max memory and max row size

[tuliren]

What

• Relate to https://github.com/airbytehq/alpha-beta-issues/issues/107.
• Relate to Database sources: use native JDBC adaptive fetch size #13299.

How

• Allocate 50% of max heap as JDBC buffer.
• Calculate fetch size based on the max row size to be safer.

🚨 User Impact 🚨

• So far, this update is only published for MS SQL.
• This PR should reduce the possibility of OOME.
• The fetch size will continue to go down in one sync. This could theoretically slow down Postgres sync.
  • This is mitigated by a total buffer size that can grow with the max heap.
  • The ultimate change we can do to mitigate the impact is to checkpoint the states more frequently, and replace a big and long sync with shorter syncs.

[tuliren]

/test connector=connectors/source-postgres

🕑 connectors/source-postgres https://github.com/airbytehq/airbyte/actions/runs/2452338970
❌ connectors/source-postgres https://github.com/airbytehq/airbyte/actions/runs/2452338970
🐛 https://gradle.com/s/sbljyjk46lx5g

Build Failed

Test summary info:

Could not find result summary

[tuliren]

/test connector=connectors/source-mysql

🕑 connectors/source-mysql https://github.com/airbytehq/airbyte/actions/runs/2452339435
❌ connectors/source-mysql https://github.com/airbytehq/airbyte/actions/runs/2452339435
🐛 https://gradle.com/s/seg54tg2jmade

Build Failed

Test summary info:

Could not find result summary

🕑 connectors/source-mysql https://github.com/airbytehq/airbyte/actions/runs/2452339435
❌ connectors/source-mysql https://github.com/airbytehq/airbyte/actions/runs/2452339435
🐛 https://gradle.com/s/35heq4p4do6qw

Build Failed

Test summary info:

Could not find result summary

---

Oh, MySQL source CDC integration test has been broken for a while.

[tuliren]

/test connector=connectors/source-mssql

🕑 connectors/source-mssql https://github.com/airbytehq/airbyte/actions/runs/2452339717
✅ connectors/source-mssql https://github.com/airbytehq/airbyte/actions/runs/2452339717
No Python unittests run

Build Passed

Test summary info:

All Passed

[tuliren]

/test connector=connectors/source-postgres

🕑 connectors/source-postgres https://github.com/airbytehq/airbyte/actions/runs/2452948350
✅ connectors/source-postgres https://github.com/airbytehq/airbyte/actions/runs/2452948350
No Python unittests run

Build Passed

Test summary info:

All Passed

[tuliren]

/publish connector=connectors/source-postgres

🕑 connectors/source-postgres https://github.com/airbytehq/airbyte/actions/runs/2456712527
❌ Failed to publish connectors/source-postgres
❌ Couldn't auto-bump version for connectors/source-postgres

[tuliren]

/publish connector=connectors/source-mssql

🕑 connectors/source-mssql https://github.com/airbytehq/airbyte/actions/runs/2456713626
🚀 Successfully published connectors/source-mssql
🚀 Auto-bumped version for connectors/source-mssql
✅ connectors/source-mssql https://github.com/airbytehq/airbyte/actions/runs/2456713626

[tuliren]

/publish connector=connectors/source-mssql-strict-encrypt

🕑 connectors/source-mssql-strict-encrypt https://github.com/airbytehq/airbyte/actions/runs/2457458497
🚀 Successfully published connectors/source-mssql-strict-encrypt
❌ Couldn't auto-bump version for connectors/source-mssql-strict-encrypt

[tuliren]

Postgres will be published in a follow-up PR.