Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Live stream element dependency containers resolution fetching improvement #6374

Closed
richard-julien opened this issue Mar 15, 2024 · 0 comments
Assignees
Labels
bug use for describing something not working as expected solved use to identify issue that has been solved (must be linked to the solving PR)
Milestone

Comments

@richard-julien
Copy link
Member

richard-julien commented Mar 15, 2024

Description

In a specific case of magic resolution in live stream, volume of reports can sometimes be to large to be correctly fetch by elastic.
This situation leads to read failure and stream consumption stop.

Hints

Let explain a bit why this "magic" is needed.
Assuming you want to share containers inside a live stream, you will create for example a live stream with filters configuration like this : Entity type = Report and Label = Sharing.
With this kind of configuration you expect to also share everything related the the container. But you also need to detect a change inside a element of the report to be able to share it into the stream to update the remove platform. However this element is not container and have no label. To handle this the platform needs to auto detect this behavior to let this element be pushed in the stream. For this we need to list reports connected to this element, resolve them and try to use the configured filters on it. This issue aims to improve this algorithm to fetch less data.

Todo

Change the approach to forge the correct filters to directly count the potential result
If count > 0 publication must be done

@richard-julien richard-julien added the bug use for describing something not working as expected label Mar 15, 2024
@richard-julien richard-julien self-assigned this Mar 15, 2024
@richard-julien richard-julien changed the title Live stream element dependency containers resolution fetching improvment Live stream element dependency containers resolution fetching improvement Mar 15, 2024
@Jipegien Jipegien added this to the Release 6.0.8 milestone Mar 18, 2024
richard-julien added a commit that referenced this issue Mar 18, 2024
@Kedae Kedae closed this as completed Mar 19, 2024
@Kedae Kedae added the solved use to identify issue that has been solved (must be linked to the solving PR) label Mar 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug use for describing something not working as expected solved use to identify issue that has been solved (must be linked to the solving PR)
Projects
None yet
Development

No branches or pull requests

3 participants