[BD-19] Transition to the Elasticsearch 7.8.0 version

[Golub-Sergey]

Description: transition from es1.5 to es7. Replaces index courseware_index with doc_types courseware_content and course_info to indexes courseware_content and course_info

Was done:

• check code coverage and tests passing;
• update code base;
• update make file;
• update travis ci.

Code coverage: 99%

Notes:

• Changes to the edx-platform which apply edx-search updates

[openedx-webhooks]

Thanks for the pull request, @Golub-Sergey! I've created BLENDED-532 to keep track of it in Jira. More details are on the BD-19 project page.

When this pull request is ready, tag your edX technical lead.

[stvstnfrd]

@Golub-Sergey I'm trying to run this locally for testing but having difficulty (CC: @dianakhuang).

Would you mind including a write-up of the steps you used to configure this to run in your devstack?

I think I'm running the right code/config everywhere (see below), but first, never got results for any queries and now, after some more manual fiddling, get errors.

I'm using this devstack branch [1] to run this version of search [2] via this version of platform [3].
Is there anything in particular that jumps our re:misconfiguration?
I've tried relying on publish-based index, manually re-indexed, used existing courses, created new courses, but still no luck.

• [1] https://github.com/edx/devstack/pull/607
• [2] [BD-19] Transition to the Elasticsearch 7.8.0 version #104
• [3] https://github.com/edx/edx-platform/pull/24967

[Golub-Sergey]

@Golub-Sergey I'm trying to run this locally for testing but having difficulty (CC: @dianakhuang).

Would you mind including a write-up of the steps you used to configure this to run in your devstack?

I think I'm running the right code/config everywhere (see below), but first, never got results for any queries and now, after some more manual fiddling, get errors.

I'm using this devstack branch [1] to run this version of search [2] via this version of platform [3].
Is there anything in particular that jumps our re:misconfiguration?
I've tried relying on publish-based index, manually re-indexed, used existing courses, created new courses, but still no luck.

• [1] edx/devstack#607
• [2] [BD-19] Transition to the Elasticsearch 7.8.0 version #104
• [3] edx/edx-platform#24967

Hello, @stvstnfrd . Can you please use this version of the edx-platform. I tested locally this changes and it works and searches correctly. This branch was forked from #104 branch. Current version of edx-search lib without platform changes produces errors.

[stvstnfrd]

@Golub-Sergey A few questions/suggestions, but I have this running successfully in my devstack now :)

[stvstnfrd]

Hrmm, is there any way to (easily) keep this in sync w/ the value listed in the requirements file(s) below?
Otherwise, this will probably fall out of step.

I'm not sure how/if this is handled elsewhere in the ecosystem...

Not a deal-breaker, just curious...

[Golub-Sergey]

@stvstnfrd Hello, I recreated pr to platfrom which applies edx-search lib changes to the edx-platform
https://github.com/edx/edx-platform/pull/25081
Can you, please, restart ci

[timmc-edx]

You can see the latest CI results over here: https://github.com/edx/edx-platform/pull/24995

Direct link to quality failure: https://build.testeng.edx.org/job/edx-platform-quality-pipeline-pr/19985/Diff_20Quality_20Report/

[stvstnfrd]

@Golub-Sergey Okay, this looks good to me. Before merge, we'll want to bump the version number in setup.py. Given these breaking changes, we should probably bump up to a 2.0.0 release. Thoughts?

[Golub-Sergey]

@Golub-Sergey Okay, this looks good to me. Before merge, we'll want to bump the version number in setup.py. Given these breaking changes, we should probably bump up to a 2.0.0 release. Thoughts?

Thats a good idea. Done.