Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Mapper not found: [linux] #432

Closed
paasi6666 opened this issue May 10, 2023 · 13 comments
Closed

[BUG] Mapper not found: [linux] #432

paasi6666 opened this issue May 10, 2023 · 13 comments
Labels
bug Something isn't working

Comments

@paasi6666
Copy link

What is the bug?
When defining a new detector and selecting the "System Logs" type, the "Configure field mapping" are empty.

How can one reproduce the bug?
Steps to reproduce the behavior:

  1. Go to Security Analytics>Detectors>Create detector
  2. Select any index
  3. Click on 'System logs':

image

  1. See that 'Configure field mapping' is empty
  2. When following the link (mappings/view?indexName=index_*&ruleTopic=linux), following message is displayed:

{"ok":false,"error":"[illegal_argument_exception] Mapper not found: [linux]"}

What is the expected behavior?
Like the other types (Azure logs for example):

image

Also, when following the link:
{"ok":true,"response":{"properties":{},"unmapped_index_fields":

What is your host/environment?

  • OS: Centos7
  • Opensearch Version: 2.7.0
  • Opensearch-Dashboards Version: 2.7.0
@paasi6666 paasi6666 added bug Something isn't working untriaged labels May 10, 2023
@sbcd90
Copy link
Collaborator

sbcd90 commented May 11, 2023

will look into it.

@sbcd90
Copy link
Collaborator

sbcd90 commented May 11, 2023

thanks for creating the issue. created a pr to fix it.

@Aloush-ha
Copy link

Aloush-ha commented May 26, 2023

Hi @sbcd90
I used opensearch as Container by using Image 2.7.0, and it still has the same Problem

"version": {
"distribution": "opensearch",
"number": "2.7.0",
"build_type": "tar",
"build_hash": "b7a6e09e492b1e965d827525f7863b366ef0e304",
"build_date": "2023-04-27T21:43:09.523336706Z",
"build_snapshot": false,
"lucene_version": "9.5.0",
"minimum_wire_compatibility_version": "7.10.0",
"minimum_index_compatibility_version": "7.0.0"
}
can you help me with that
Thank you

@dsek
Copy link

dsek commented May 30, 2023

this is the same problem as described weeks ago via #320

@Aloush-ha
Copy link

Hi @dsek
we are all together having the same problem, but how can we push to solve it.
I saw that your PR is not merged until know

@dsek
Copy link

dsek commented May 30, 2023

yeah ... i've no idea ... maybe somebody of the security-analytics team may take care of it.

// sarcasm:on
i do really understand that handling this really complicated pull request takes so much time ...
// sarcasm:off

@sbcd90
Copy link
Collaborator

sbcd90 commented May 30, 2023

hi @paasi6666 , @dsek , @Aloush-ha , i'm extremely sorry if this issue caused any inconveniences to you. This issue will be fixed in 2.8 release of OpenSearch which is scheduled to be released this week.

@dsek
Copy link

dsek commented May 30, 2023

sounds good! 👍

@Aloush-ha
Copy link

thank you @sbcd90

@paasi6666
Copy link
Author

Thanks @sbcd90

@getsaurabh02
Copy link
Member

Fix is available in 2.8 release

@Aloush-ha
Copy link

Hi @sbcd90
I checked the new Version 2.8, and I realized something, maybe you can explain it to us.
Screenshot 2023-06-26 120416

As you can see, in System logs there is audit field, and some fields that not compatible with Linux syslog
can you explain to me, which field in Linux syslog can pointed to rsa-web-remote_domain or process-working_directory !?
Which field is the message ?

should I open another Issue for that?

thank you

@paasi6666
Copy link
Author

Hi @Aloush-ha

I think you should open a new issue since this one is closed.

riysaxen-amzn pushed a commit to riysaxen-amzn/security-analytics that referenced this issue Feb 20, 2024
* [FEATURE] Detector must have at least one alert set opensearch-project#288

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [BUG] Create detector | Interval field can be empty opensearch-project#378

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Adjust styling for Finding details flyout opensearch-project#369

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* detector unit tests

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Feature/update vertical domain #372

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Unit tests for public components opensearch-project#383

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Unit tests for public components opensearch-project#383

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Unit tests for public components opensearch-project#383

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Unit tests for public components opensearch-project#383

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Unit tests for public components opensearch-project#383
[BUG] Detector Edit | Custom rule are not selected on update rules opensearch-project#406

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Unit tests for public components opensearch-project#383
[BUG] Detector Edit | Custom rule are not selected on update rules opensearch-project#406

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* PR code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* PR code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* PR code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* [FEATURE] Create detector | Make data source multi-select field opensearch-project#419

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* unit tests fix

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* Code review

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

* snapshot fix

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>

---------

Signed-off-by: Jovan Cvetkovic <jovanca.cvetkovic@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

5 participants