Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Timelines import successfully but no entries are showing up #3084

Open
Kamforka opened this issue May 3, 2024 · 5 comments
Open

Timelines import successfully but no entries are showing up #3084

Kamforka opened this issue May 3, 2024 · 5 comments
Assignees
Labels

Comments

@Kamforka
Copy link

Kamforka commented May 3, 2024

Describe the bug
I'm deploying a fresh instance of timesketch for local testing. According to the service logs everything is running as expected.
Then I create a sketch and import a timeline csv. The upload is successful, the import is successful, but no entries show up in the timeline UI and the timeline's badge shows 0 entries. However when I check the data sources information of the timeline it correctly displays the number of entries originally contained in the csv:
image

It's happening everytime with all the sketches and with all the timeline files, let them be small or large.

Can you please help me figure out what I'm doing wrong? We have an older deployment (from 2021) which is working perfectly fine, and now I'm migrating to the latest version but for some reason I cannot make a fresh deployment work even with the simplest setup.

Expected behavior
After the successful upload and import the timeline entries should show up.

Desktop (please complete the following information):

  • OS: Windows
  • Browser: Firefox
  • Version [e.g. 22]

Deployment information:

  • OS: Ubuntu 22.04
  • Timesketch: 20240207
  • OpenSearch: 2.9.0
  • Postgres: 12.15
  • Redis: 6.2.15
@Kamforka Kamforka added the Bug label May 3, 2024
@jkppr
Copy link
Collaborator

jkppr commented May 3, 2024

Hi @Kamforka , thanks for bringing this to our attention. In general, the number of events (counter) next to the timeline displays how many events are found for your current search. Given you are using a deployment from 2021, this is probably still with the old UI and the behaviour of the counter could have been different back then.

Let's check the low hanging fruits first:

  • Does the sketch return any events if you click any of the data_types in the left panel or if you search for * (star)?
  • If you do an upgrade for the instance, have you run the database migration?
  • Are there any errors in the webserver logs (timesketch/logs/wsgi_error.log on a prod deployment)?

@jkppr jkppr self-assigned this May 3, 2024
@Kamforka
Copy link
Author

Kamforka commented May 3, 2024

Hi @jkppr and thanks for the quick reply!

No database migration yet as this is a brand new instance without any legacy data.

Oh well, searching for * did the trick:

image

I have a couple of weird observations though, first being the datetime values, look like broken. Then I cannot click on any data_types in the left panel as it's showing 0 for some reason. Is that a possible misconfiguration or normal?

@jkppr
Copy link
Collaborator

jkppr commented May 7, 2024

You mentioned above that you are uploading CSV files. Does your CSV entries have a field called data_type to begin with? Is this information also missing, when you upload a Plaso file?

@jkppr jkppr added Support and removed Bug labels May 7, 2024
@Kamforka
Copy link
Author

Kamforka commented May 8, 2024

Hi @jkppr yeah indeed we don't have the data_type field in our input. Is that also the reason for the cryptic datetime display?

I've successfully migrated our deployment to the latest timesketch version with the opensearch backend, and I've imported a timeline today but I still don't know what's causing this datetime bug:

image

As you can see the row's datetime column displays the weird value of +056316-01-27T04:00:00.000Z while the actual timeline entry has a proper datetime value of 2024-05-06T11:51:36+00:00, also the timestamp value of 1714996296 is looking okay to me.

Any guesses what can cause this bug?

@Kamforka
Copy link
Author

Kamforka commented May 8, 2024

I did some research and looks like the past version of timesketch accepted timestamps up to the second precision but now only microsecond precision works.

Is this something that can be configured or should I change our timeline generator tool to produce microsecond precision timestamps?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants