support static_index.html docs

[dwreeves]

Description

• Support static_index.html for dbt docs.
• Refactor remote filesystem access functions in anticipation of moving them out of cosmos/plugins/__init__.py. Refactoring is designed to make them behave a little more predictably, and to make them look a little more like Airflow 2.8+'s ObjectStoragePath class. Of course, this is far, far from complete.

Related Issue(s)

• Main: Support docs generated with dbt docs generate --static #986
• Related: Support caching remotely #927

Breaking Change?

No breaking changes as far as the high level API is concerned.

Checklist

• I have made corresponding changes to the documentation (if required)
• I have added tests that prove my fix is effective or that my feature works

[netlify]

✅ Deploy Preview for sunny-pastelito-5ecb04 canceled.

Name	Link
🔨 Latest commit	9eb3b82
🔍 Latest deploy log	https://app.netlify.com/sites/sunny-pastelito-5ecb04/deploys/6665c7e53358e1000826b11b

[tatiana]

@dwreeves, thanks for these improvements!
I just noticed some tests are failing. Would you like us to review the code before the tests pass, or is this PR still in draft?

[dwreeves]

Sorry, for a long time I had issues with pre-commit due to a strange error. So for a while I'd never had pre-commit turned on for the repo.

I only recently fixed the issue and just forgot to pre-commit install. 😅 That is what is failing.

[dwreeves]

I added packaging to dependencies because it's explicitly used in one of the Cosmos modules.

Even though apache-airflow also depends on it, it's best practice to explicitly define what is depended on.

[dwreeves]

@tatiana Tests are stuck for some odd reason, but otherwise passing, so this is ready for review.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.81%. Comparing base (bbe4e86) to head (9eb3b82).
Report is 6 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #999      +/-   ##
==========================================
+ Coverage   95.75%   95.81%   +0.06%     
==========================================
  Files          62       62              
  Lines        2965     3009      +44     
==========================================
+ Hits         2839     2883      +44     
  Misses        126      126              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[tatiana]

@dwreeves I think we're super close to get this change merged, do you by any chance have bandwith to improve a bit the test coverage? Codecov gave some feedback.
We'll release this in 1.5

[dwreeves]

@tatiana When are you intending on releasing 1.5? I can try to get this done over the weekend but not until then.

[tatiana]

@tatiana When are you intending on releasing 1.5? I can try to get this done over the weekend but not until then.

The current plan is the 24 June 2024, and we can have alphas/release candidates with the change beforehand:
https://github.com/astronomer/astronomer-cosmos/milestone/19

[tatiana]

Thanks, @dwreeves , it looks great!