Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(elasticsearch): Elasticsearch improvements #6894

Merged
merged 59 commits into from Feb 1, 2023

Conversation

david-leifker
Copy link
Collaborator

@david-leifker david-leifker commented Dec 29, 2022

  • Stemming
  • Synonyms
  • URN (full or partial) search
  • Autocomplete improvements
  • Quoted search analyzer for exact & prefix match
  • Adds test fixture for search tests
  • Indices cleanup
  • Reindexing improvements and system update process
  • Updates ES to 7.10 from 7.9

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

* Stemming
* Synonyms
* URN (full or partial) search
* Autocomplete improvements
* Adds test fixture for search tests
* Updates ES to 7.10 from 7.9
@github-actions github-actions bot added devops PR or Issue related to DataHub backend & deployment ingestion PR or Issue related to the ingestion of metadata product PR or Issue related to the DataHub UI/UX labels Dec 29, 2022
@david-leifker david-leifker marked this pull request as draft December 31, 2022 06:20
@david-leifker david-leifker marked this pull request as ready for review January 3, 2023 18:22
david-leifker and others added 22 commits January 9, 2023 09:54
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Yang Jiandan <succeedin2010@163.com>
Co-authored-by: yangjd33 <yangjd33@chinaunicom.cn>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Rajasekhar-Vuppala <122261609+Rajasekhar-Vuppala@users.noreply.github.com>
Co-authored-by: Vishal <vishal.k@simplify3x.com>
Co-authored-by: VISHAL KUMAR <110387730+vishalkSimplify@users.noreply.github.com>
Co-authored-by: Dmitry Bryazgin <58312247+bda618@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: jx2lee <63435794+jx2lee@users.noreply.github.com>
Co-authored-by: jj.lee <jj.lee@coinone.com>
Co-authored-by: Amanda Ng <10681923+ngamanda@users.noreply.github.com>
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: Aditya Radhakrishnan <aditya.radhakrish@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Teppo Naakka <teppo.naakka@gmail.com>
Co-authored-by: Remi <salmon.remi@gmail.com>
Co-authored-by: Tim <50115603+bossenti@users.noreply.github.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: David Schmidt <DSchmidtDev@outlook.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: Peter Szalai <szalaipeti.vagyok@gmail.com>
Co-authored-by: ruedigerblock <ruediger.block@gmx.de>
Co-authored-by: J Feldman <8128360+feljen@users.noreply.github.com>
Co-authored-by: seoju <wngus606@gmail.com>
Co-authored-by: tony csoka <tony.csoka@gmail.com>
Co-authored-by: Nate Bryant <nmbryant94@gmail.com>
Co-authored-by: Fully <ssilb4@gmail.com>
Co-authored-by: Mert Tunç <mert.tunc@udemy.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Felix Lüdin <13187726+Masterchen09@users.noreply.github.com>
Co-authored-by: Paul Logan <101486603+laulpogan@users.noreply.github.com>
Co-authored-by: (((((Al))))) <38097966+tinolyu@users.noreply.github.com>
Co-authored-by: Tino Lyu <tinol@ziprecruiter.com>
Co-authored-by: kdongho <55538847+kdongho@users.noreply.github.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
@david-leifker david-leifker merged commit 39920bb into master Feb 1, 2023
@david-leifker david-leifker deleted the feat/elasticsearch-optimization-ext branch February 1, 2023 00:44
danielcmessias pushed a commit to danielcmessias/datahub that referenced this pull request Feb 1, 2023
hsheth2 added a commit to hsheth2/datahub that referenced this pull request Feb 1, 2023


@Slf4j
public class SystemUpdate implements Upgrade {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pretty cool how we are adding these into here....

ericyomi pushed a commit to ericyomi/datahub that referenced this pull request Feb 8, 2023
oleg-ruban pushed a commit to RChygir/datahub that referenced this pull request Feb 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops PR or Issue related to DataHub backend & deployment ingestion PR or Issue related to the ingestion of metadata product PR or Issue related to the DataHub UI/UX
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants