Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add ability to switch off/on creation of parquet dwh #1074

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

mozzy11
Copy link
Collaborator

@mozzy11 mozzy11 commented May 29, 2024

Fixes #1073

Add ability to switch of creation of a parquet DWH in case of syncying betwen FHIR servers

Added a flag to the createParquetDwh to the controller to switch off/on creation of parquet DWH

E2E test

Adedd e2e tests for synching from a hapi fhir sever to another using the pipeline controller for both FULL and INCREMENTAL modes while swtching on/off creation of parquet DWH

TESTED:
Testes Locally syncying between FHIR server while the parquet DWH is switched off/on

Checklist: I completed these to help reviewers :)

  • I have read and will follow the review process.

  • I am familiar with Google Style Guides for the language I have coded in.

    No? Please take some time and review Java and Python style guides.

  • My IDE is configured to follow the Google code styles.

    No? Unsure? -> configure your IDE.

  • I have added tests to cover my changes. (If you refactored existing code that was well tested you do not have to add tests)

  • I ran mvn clean package right before creating this pull request and added all formatting changes to my commit.

  • All new and existing tests passed.

  • My pull request is based on the latest changes of the master branch.

    No? Unsure? -> execute command git pull --rebase upstream master

@codecov-commenter
Copy link

codecov-commenter commented May 29, 2024

Codecov Report

Attention: Patch coverage is 33.33333% with 6 lines in your changes missing coverage. Please review.

Project coverage is 50.48%. Comparing base (9bfd5d9) to head (f2da0ea).

Files Patch % Lines
...java/com/google/fhir/analytics/DataProperties.java 33.33% 2 Missing and 2 partials ⚠️
...a/com/google/fhir/analytics/ConvertResourceFn.java 0.00% 0 Missing and 1 partial ⚠️
...a/com/google/fhir/analytics/FetchSearchPageFn.java 50.00% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master    #1074      +/-   ##
============================================
- Coverage     50.49%   50.48%   -0.01%     
  Complexity      674      674              
============================================
  Files            91       91              
  Lines          5519     5526       +7     
  Branches        709      711       +2     
============================================
+ Hits           2787     2790       +3     
- Misses         2470     2472       +2     
- Partials        262      264       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@mozzy11
Copy link
Collaborator Author

mozzy11 commented May 30, 2024

cc @bashir2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add ability to turn on /off parquet file generation in case of syncying fhir to fhir server
2 participants