Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windoze/211 maven submission #334

Merged
merged 4 commits into from
Jun 13, 2022
Merged

Windoze/211 maven submission #334

merged 4 commits into from
Jun 13, 2022

Conversation

windoze
Copy link
Member

@windoze windoze commented Jun 9, 2022

#211 Fix, enable submitting Feathr JAR from Maven.

@xiaoyongzhu
Copy link
Member

Overall look good to me. Seems like the test failure is irrelevant.

@xiaoyongzhu xiaoyongzhu linked an issue Jun 9, 2022 that may be closed by this pull request
@xiaoyongzhu
Copy link
Member

Can we also add a bit test case to cover this?

@windoze windoze added the safe to test Tag to execute build pipeline for a PR from forked repo label Jun 10, 2022
@xiaoyongzhu
Copy link
Member

Pasting some background info for this PR:

Since Feathr is on Maven now (https://search.maven.org/artifact/com.linkedin.feathr/feathr_2.12), we should consider using Maven as the source to submit Spark jobs,rather than using the public wasb path, since it's a bit hard to maintain and doesn't distribute well (like don't have mirrors etc., and will be slow).

@jainr
Copy link
Collaborator

jainr commented Jun 13, 2022

+1 to adding tests to cover this. Looks good to me.

@windoze
Copy link
Member Author

windoze commented Jun 13, 2022

E2E test was added in the latest commit.

@windoze windoze merged commit 7f105d5 into main Jun 13, 2022
@windoze windoze deleted the windoze/211-maven-submission branch June 13, 2022 14:33
hangfei pushed a commit that referenced this pull request Jun 13, 2022
* #211 Enable using maven package

* #211 Enable using maven package

* Print Maven package artifact id when using it

* Add e2e test for Maven job submission
hangfei pushed a commit that referenced this pull request Jun 13, 2022
* #211 Enable using maven package

* #211 Enable using maven package

* Print Maven package artifact id when using it

* Add e2e test for Maven job submission
bozhonghu pushed a commit that referenced this pull request Jun 15, 2022
* main:
  Fixing purview test issues and improve performance (#350)
  [feathr] Add product_recommendation advanced sample (#348)
  obejectId query cmd update (#360)
  add license, release, docs, python api ref badges with shields img (#357)
  quick fix the 404 not found in read me link (#355)
  Python SQL Registry (#311)
  enable JWT token param in frontend API calls (#337)
  Optimize environment variable behavior (#333)
  Adding better warning message to let user know that config file is missing and they need to set env parameters. (#347)
  Feature Monitoring (#330)
  Windoze/211 maven submission (#334)
  Windoze/211 maven submission (#334)
  Windoze/211 maven submission (#334)
  Fix Synapse quickstart link (#346)
  Show feature details when click feature in lineage graph (#339)
  Update pull_request_push_test.yml
  Update UI README for how to create overrides for local development (#335)
  Update databricks quick start experience (#217)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
safe to test Tag to execute build pipeline for a PR from forked repo
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Consider using Maven based spark job submission
3 participants