Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incomplete JSON export of reports #6499

Closed
yassine-ouaamou opened this issue Mar 27, 2024 · 12 comments
Closed

Incomplete JSON export of reports #6499

yassine-ouaamou opened this issue Mar 27, 2024 · 12 comments
Labels
bug use for describing something not working as expected solved use to identify issue that has been solved (must be linked to the solving PR)
Milestone

Comments

@yassine-ouaamou
Copy link
Member

Description

When exporting a report from the reports list, if it contains many entities, some of them are not included in the generated bundle

Environment

Testing (6.0.8)

Reproducible Steps

Steps to create the smallest reproducible scenario:

  1. Create a report
  2. Include arount 50 entities and a PDF in it
  3. Go to the reports list
  4. Select the created report and click on the export button
  5. Generate an export (JSON, full export, no marking)
  6. Download the generated JSON

Expected Output

The bundle contains the pdf and all the included entities

Actual Output

Many entities are missing

Additional information

Here is the report I used to reproduce: https://testing.octi.staging.filigran.io/dashboard/analyses/reports/86ec8fd0-9b66-4971-9348-8828d4ce1c74

Screenshots (optional)

@yassine-ouaamou yassine-ouaamou added bug use for describing something not working as expected needs triage use to identify issue needing triage from Filigran Product team labels Mar 27, 2024
@nino-filigran
Copy link

potentially linked with: #5798

@AlexSanchezN
Copy link

Should that be solved on 6.0.10?
I'm in 6.0.10, and we have reports with many entities as seen on the first image
That only show a few of the objects in knowledge (second image)
And only export a few objects from the Data tab -->
2024-04-19T14 40 41.122Z_TLP ALL_(ExportFileStix)_Report-Sensor sensor1792.etic.security (Week 16)_full.json

many

imatge

@SamuelHassine SamuelHassine reopened this Apr 19, 2024
@SamuelHassine
Copy link
Member

To be qualified.

@SamuelHassine SamuelHassine added needs triage use to identify issue needing triage from Filigran Product team and removed solved use to identify issue that has been solved (must be linked to the solving PR) labels Apr 19, 2024
@marieflorescontact marieflorescontact removed their assignment Apr 24, 2024
@jborozco
Copy link
Member

@AlexSanchezN according to your graph, there might be a filter still active, could you try to clear your local storage and retry ?

@jborozco jborozco added needs more info Intel needed about the use case and removed needs triage use to identify issue needing triage from Filigran Product team labels Apr 25, 2024
@AlexSanchezN
Copy link

Hi @jborozco , thanks for your help.

It happens in different browsers, different computers and in incognito mode. I've reseted cookies, and cleared data and the problem persists. In fact nothing is shown in the knowledge window in this case.
The images are from a different computer and in incognito mode
I know for sure that the bundle used to create those reports, includes notes, vulnerabilities and relations. But none of those appear either in knowledge.
Although as it can be seen in the 3rd image below there are 3.600 entities counted but are not shown in the entities list.
Is it possible that Note type is not shown on the entities list?. There should be a lot of notes there with vulnerabilities and its relations to ipv4 observables.

image

image

image

@jborozco
Copy link
Member

Notes should present in entities in theory
image

@richard-julien @Kedae I can't reproduce, but something seems off, do you have an idea of where the problem could come from ?

@AlexSanchezN
Copy link

Maybe the attached video explains better the situation with notes inside a report.

SCUD.CTI.Mozilla.Firefox.2024-04-26.13-02-23.mp4

As you can see, it looks like notes are not shown in lists.
And we see no vulnerabilities either.

@AlexSanchezN
Copy link

Notes should present in entities in theory image

@richard-julien @Kedae I can't reproduce, but something seems off, do you have an idea of where the problem could come from ?

By the way. You have two notes in that report, but they are not counted... it says 0 entities in the upper right counter

@jborozco
Copy link
Member

I just didnt refresh the page after adding entity, when I do I see the right number.

image

@jborozco jborozco removed the needs more info Intel needed about the use case label Apr 29, 2024
@jborozco
Copy link
Member

The issue seems to be that report can't handle big number of entities

@AlexSanchezN
Copy link

Glad there is a clue.
It used to work a few versions ago. Provably in version 5.x.x

@jborozco
Copy link
Member

As discussed with @yassine-ouaamou , I'm creating a new issue here #6839 and closing this one to keep issues separated.

@SamuelHassine SamuelHassine added the solved use to identify issue that has been solved (must be linked to the solving PR) label Apr 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug use for describing something not working as expected solved use to identify issue that has been solved (must be linked to the solving PR)
Projects
None yet
Development

No branches or pull requests

6 participants