Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump faker version to test M1 Connector builds #13235

Merged
merged 13 commits into from
May 27, 2022
Merged

Conversation

evantahler
Copy link
Contributor

No actual changes to the connector other than the version number. This is a test of #13004

@evantahler evantahler marked this pull request as ready for review May 26, 2022 18:39
@github-actions github-actions bot added area/connectors Connector related issues area/documentation Improvements or additions to documentation labels May 26, 2022
@evantahler
Copy link
Contributor Author

evantahler commented May 26, 2022

/test connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2392466828
❌ connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2392466828
🐛 https://gradle.com/s/rvrjc24lqxw2m

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestBasicRead::test_read[inputs0] - AssertionError: Stre...
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/plugin.py:56: Skipping TestIncremental.test_two_sequential_reads because not found in the config
=================== 1 failed, 20 passed, 1 skipped in 16.38s ===================

@codecov
Copy link

codecov bot commented May 26, 2022

Codecov Report

❗ No coverage uploaded for pull request base (master@65f79d2). Click here to learn what that means.
The diff coverage is n/a.

❗ Current head 6bd7833 differs from pull request most recent head 9509bcf. Consider uploading reports for the commit 9509bcf to get more accurate results

@@            Coverage Diff            @@
##             master   #13235   +/-   ##
=========================================
  Coverage          ?   96.07%           
=========================================
  Files             ?        2           
  Lines             ?       51           
  Branches          ?        0           
=========================================
  Hits              ?       49           
  Misses            ?        2           
  Partials          ?        0           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 65f79d2...9509bcf. Read the comment docs.

@evantahler
Copy link
Contributor Author

evantahler commented May 26, 2022

/test connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2392581462
✅ connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2392581462
Python tests coverage:

Name                                                 Stmts   Miss  Cover
------------------------------------------------------------------------
source_acceptance_test/utils/__init__.py                 6      0   100%
source_acceptance_test/tests/__init__.py                 4      0   100%
source_acceptance_test/__init__.py                       2      0   100%
source_acceptance_test/tests/test_full_refresh.py       52      2    96%
source_acceptance_test/utils/asserts.py                 37      2    95%
source_acceptance_test/config.py                        77      6    92%
source_acceptance_test/utils/json_schema_helper.py     105     13    88%
source_acceptance_test/tests/test_incremental.py       121     25    79%
source_acceptance_test/utils/common.py                  80     17    79%
source_acceptance_test/tests/test_core.py              294    106    64%
source_acceptance_test/utils/compare.py                 62     23    63%
source_acceptance_test/base.py                          10      4    60%
source_acceptance_test/utils/connector_runner.py       110     48    56%
------------------------------------------------------------------------
TOTAL                                                  960    246    74%
Name                       Stmts   Miss  Cover
----------------------------------------------
source_faker/__init__.py       2      0   100%
source_faker/source.py        49      2    96%
----------------------------------------------
TOTAL                         51      2    96%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/plugin.py:56: Skipping TestIncremental.test_two_sequential_reads because not found in the config
======================== 21 passed, 1 skipped in 16.47s ========================

@evantahler
Copy link
Contributor Author

Soar Scan seems like a buggy test reporter... I don't think that failure should prevent this PR merge

@evantahler
Copy link
Contributor Author

evantahler commented May 26, 2022

/publish connector=connectors/source-faker

❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@sherifnada
Copy link
Contributor

sherifnada commented May 26, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2393210381
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler
Copy link
Contributor Author

evantahler commented May 26, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2393726888
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler
Copy link
Contributor Author

evantahler commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2393867916
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler
Copy link
Contributor Author

evantahler commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2393926478
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler
Copy link
Contributor Author

evantahler commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2393972665
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler
Copy link
Contributor Author

evantahler commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2394250957
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler evantahler temporarily deployed to more-secrets May 27, 2022 02:44 Inactive
@davinchia
Copy link
Contributor

davinchia commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2396090972
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@davinchia
Copy link
Contributor

@evantahler I confirmed this is still using the old AMI: https://github.com/airbytehq/airbyte/runs/6624320419?check_suite_focus=true#step:3:59

I believe we can test this by explicitly setting the AMI here. If this works, we modify the workflow to default to the previous AMI in a follow up PR.

@davinchia
Copy link
Contributor

davinchia commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2396121986
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@davinchia davinchia temporarily deployed to more-secrets May 27, 2022 11:05 Inactive
@davinchia
Copy link
Contributor

Looks like that isn't working and we have to merge from master.

@davinchia
Copy link
Contributor

davinchia commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2397382697
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler
Copy link
Contributor Author

evantahler commented May 27, 2022

Making progress with the default image:

+ echo '--- docker info ---'
+ docker --version
--- docker info ---
Docker version 20.10.2, build 20.10.2-0ubuntu1~20.04.2
+ docker buildx version
github.com/docker/buildx v0.8.2 6224def4dd2c3d347eee19db595348c50d7cb491

Now the build is failing building the normalization image:

+ docker buildx build -t airbyte/integration-base-java:dev --platform linux/arm64 --load airbyte-integrations/bases/base-java

...

#6 [stage-2 1/7] WORKDIR /airbyte/integration_code
#6 DONE 0.2s

#7 [builder 2/4] RUN apk --no-cache upgrade     && pip install --upgrade pip     && apk --no-cache add tzdata build-base
#7 0.281 standard_init_linux.go:219: exec user process caused: exec format error
#7 ERROR: executor failed running [/bin/sh -c apk --no-cache upgrade     && pip install --upgrade pip     && apk --no-cache add tzdata build-base]: exit code: 1
------
 > [builder 2/4] RUN apk --no-cache upgrade     && pip install --upgrade pip     && apk --no-cache add tzdata build-base:
#7 0.281 standard_init_linux.go:219: exec user process caused: exec format error
------
error: failed to solve: executor failed running [/bin/sh -c apk --no-cache upgrade     && pip install --upgrade pip     && apk --no-cache add tzdata build-base]: exit code: 1
Error: Process completed with exit code 1.
##[debug]Finishing: Publish connectors/source-faker

Likely missing something needed for emulation...

@evantahler
Copy link
Contributor Author

evantahler commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2397691897
❌ Failed to publish connectors/source-faker
❌ Couldn't auto-bump version for connectors/source-faker

@evantahler
Copy link
Contributor Author

evantahler commented May 27, 2022

/publish connector=connectors/source-faker

🕑 connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2397782400
🚀 Successfully published connectors/source-faker
🚀 Auto-bumped version for connectors/source-faker
✅ connectors/source-faker https://github.com/airbytehq/airbyte/actions/runs/2397782400

@evantahler evantahler temporarily deployed to more-secrets May 27, 2022 17:04 Inactive
@grubberr
Copy link
Contributor

$ cat Dockerfile
FROM alpine
RUN apk --no-cache upgrade

docker build .
Successfully built 20ad4fd30c56

docker buildx build .
[+] Building 0.9s (6/6) FINISHED

docker buildx build --platform linux/arm64 .
#5 0.278 standard_init_linux.go:228: exec user process caused: exec format error

@octavia-squidington-iii octavia-squidington-iii temporarily deployed to more-secrets May 27, 2022 17:22 Inactive
@evantahler evantahler merged commit e3cb566 into master May 27, 2022
@evantahler evantahler deleted the evan/faker-m1 branch May 27, 2022 17:36
jscottpolevault pushed a commit to jscottpolevault/airbyte that referenced this pull request Jun 1, 2022
* Bump faker version to test M1 Connector builds

* add PR link to changelog

* Remove birhtday, it  doesn't obey seed

* bump readme

* more birthday to remove

* remove image specificity in publish-command

* Set AMI for testing.

* test with including buildx emulators

* auto-bump connector version

* add TODO comment

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants