refactor(base-driver): Lazy loading for SDKs (improve memory usage + …

[ovr]

So, I've figured out that we load all SDKs at start of the program, more interesting, these SDKs can be unused for a lot of deployments.

The biggest problem, that it slow down the startup time (especially in the cloud, because it has overlay-fs as protection to allow only readonly operations). On another size, $1 is $1, 10mb is 10mb.

So, first I've make Azure lazy:

39mb compiled code -> 35mb (azure lazy)
27mb strings -> 22,8 mb (azure lazy)

AWS lazy:

35mb compiled code -> 32,6 (aws sdk)
22,8mb strings -> 21,6 (aws sdk)

And finally Google CS:

32,6mb compiled -> 30,1 mb (gcs)
21,6mb strings -> 19,58mb (gcs)

Before

1,8mb

1mb

and a lot of other strings + deps.

After

[KSDaemon]

🚀 Awesome!

[codecov]

Codecov Report

❌ Patch coverage is 0% with 63 lines in your changes missing coverage. Please review.
✅ Project coverage is 54.57%. Comparing base (b7b6318) to head (50a85e4).
⚠️ Report is 5 commits behind head on master.

Files with missing lines	Patch %	Lines
...ages/cubejs-base-driver/src/storage-fs/azure.fs.ts	0.00%	34 Missing ⚠️
...ckages/cubejs-base-driver/src/storage-fs/aws.fs.ts	0.00%	14 Missing ⚠️
...ckages/cubejs-base-driver/src/storage-fs/gcs.fs.ts	0.00%	12 Missing ⚠️
packages/cubejs-base-driver/src/BaseDriver.ts	0.00%	3 Missing ⚠️

❗ There is a different number of reports uploaded between BASE (b7b6318) and HEAD (50a85e4). Click for more details.

HEAD has 1 upload less than BASE

Flag	BASE (b7b6318)	HEAD (50a85e4)
cubesql	1	0

Additional details and impacted files

@@             Coverage Diff             @@
##           master   #10190       +/-   ##
===========================================
- Coverage   83.27%   54.57%   -28.70%     
===========================================
  Files         244      217       -27     
  Lines       74223    17018    -57205     
  Branches        0     3475     +3475     
===========================================
- Hits        61811     9288    -52523     
+ Misses      12412     7229     -5183     
- Partials        0      501      +501     

Flag	Coverage Δ
cube-backend	54.57% <0.00%> (?)
cubesql	?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.