You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The reports generated (and other files/functions) need to be tested using data fetched from elasticsearch.
Right now, the functions in manuscripts2 are tested on git data from grimoirelab-perceval repository which is fetched at the time of testing. This is causing the tests to fail after some time when more commits are added in grimoirelab-perceval. Example
The other approach that is being used is to take the raw data for the data sources --> upload it to ES --> enrich that raw data --> upload that data again to ES.
This approach works but it is slow and using raw data is unnecessary as the enriched data can be directly used.
This issue is to solve the problem regarding the tests. We have to find out a good way to get frozen (which is stored locally) enriched data --> upload it to elasticsearch --> query the data for results.
We are looking for a solution which provides us with the enriched data easily and which is capable of generating that enriched data again if something goes wrong. It should also be able to upload the data into elasticsearch with proper mappings for the data.
The text was updated successfully, but these errors were encountered:
The reports generated (and other files/functions) need to be tested using data fetched from elasticsearch.
Right now, the functions in manuscripts2 are tested on
git
data fromgrimoirelab-perceval
repository which is fetched at the time of testing. This is causing the tests to fail after some time when more commits are added ingrimoirelab-perceval
. ExampleThe other approach that is being used is to take the raw data for the data sources --> upload it to ES --> enrich that raw data --> upload that data again to ES.
This approach works but it is slow and using raw data is unnecessary as the enriched data can be directly used.
This issue is to solve the problem regarding the tests. We have to find out a good way to get frozen (which is stored locally) enriched data --> upload it to elasticsearch --> query the data for results.
We are looking for a solution which provides us with the enriched data easily and which is capable of generating that enriched data again if something goes wrong. It should also be able to upload the data into elasticsearch with proper mappings for the data.
The text was updated successfully, but these errors were encountered: