feat: Postgres supported as Registry, Online store, and Offline store

[nossrannug]

Signed-off-by: Gunnar Sv Sigurbjörnsson gunnar.sigurbjornsson@gmail.com

What this PR does / why we need it:
Adds support for postgres as Registry, and Online and Offline stores.

[felixwang9817]

@nossrannug looking good overall! left some comments for you (no rush at all)

would also suggest that you add in a template so that users can easily initialize a postgres-based feature repo with feast init -t postgres, see https://github.com/feast-dev/feast/pull/2349/files for an example of Spark PR adding in a template

would also recommend adding some docs so folks know how to use postgres properly! once again see Spark PR for how to add docs

[achals]

Hi @nossrannug, are you still planning on working on this PR? Is there anything we can do to help?

[nossrannug]

Hi @nossrannug, are you still planning on working on this PR? Is there anything we can do to help?

Yes, I would like to see this PR completed. Real life stuff and lack of motivation have been my biggest blockers. I'll take a stab at it today and see how it goes.

[achals]

Hi @nossrannug, are you still planning on working on this PR? Is there anything we can do to help?

Yes, I would like to see this PR completed. Real life stuff and lack of motivation have been my biggest blockers. I'll take a stab at it today and see how it goes.

Totally understand - let us know if there's anything we can do to help!

[nossrannug]

Thanks, @achals, I greatly appreciate it.

I took a quick look at it over easter. I'm able to run:

feast init -t postgres random_folder
cd random_folder
feast apply
feast materialize-incremental $(date -u +"%Y-%m-%dT%H:%M:%S")
python test.py

I can also run make test-python-universal-postgres. Although I'm intentionally skipping some tests like persisting a tmp table for the results because I haven't implemented that functionality.

I think the main thing left now is to update the version lock files. I'll see if I can get that done later today and then I don't know if there is much left. I'll give you and @felixwang9817 a ping when I think I've covered everything to ask for your review.

[kevjumba]

@nossrannug let me see if I can get the unit test builds to work really quickly.

[codecov-commenter]

Codecov Report

Merging #2401 (3522e23) into master (f372981) will decrease coverage by 1.45%.
The diff coverage is 38.74%.

@@            Coverage Diff             @@
##           master    #2401      +/-   ##
==========================================
- Coverage   83.68%   82.23%   -1.46%     
==========================================
  Files         147      154       +7     
  Lines       12353    12735     +382     
==========================================
+ Hits        10338    10473     +135     
- Misses       2015     2262     +247     

Flag	Coverage Δ
integrationtests	72.52% <25.00%> (-0.56%)	⬇️
unittests	59.82% <38.74%> (-0.66%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
sdk/python/feast/cli.py	38.20% <ø> (ø)
sdk/python/feast/registry.py	82.18% <ø> (ø)
sdk/python/feast/repo_config.py	89.52% <ø> (ø)
sdk/python/feast/type_map.py	63.07% <25.00%> (-4.36%)	⬇️
...thon/feast/infra/online_stores/contrib/postgres.py	30.00% <30.00%> (ø)
..._stores/contrib/postgres_offline_store/postgres.py	33.33% <33.33%> (ø)
...hon/feast/infra/utils/postgres/connection_utils.py	48.00% <48.00%> (ø)
.../contrib/postgres_offline_store/postgres_source.py	48.07% <48.07%> (ø)
...n/feature_repos/universal/data_sources/postgres.py	53.57% <53.57%> (ø)
...line_stores/contrib/postgres_repo_configuration.py	100.00% <100.00%> (ø)
... and 6 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f372981...3522e23. Read the comment docs.

[kevjumba]

@nossrannug let me see if I can get the unit test builds to work really quickly.

Unit tests should be working now.

[achals]

/lgtm

[feast-ci-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: achals, nossrannug

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [achals]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment