Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Netskope event collector rewrite #28941

Merged
merged 47 commits into from Aug 25, 2023
Merged

Conversation

ShahafBenYakir
Copy link
Contributor

@ShahafBenYakir ShahafBenYakir commented Aug 14, 2023

Status

  • In Progress
  • Ready
  • In Hold - (Reason for hold)

Jira ticket

fixes: https://jira-hq.paloaltonetworks.local/browse/CIAC-7622

Description

This is the mew implementation of Netskope event collector using the v2 dataexport

ShahafBenYakir and others added 30 commits February 19, 2023 19:07
Core, DemistoRESTAPI, FiltersAndTransformers, Palo_Alto_Networks_WildFire, rasterize
…sto/content into add_packs_to_update_core_packs_list
# Conflicts:
#	Packs/Netskope/Integrations/NetskopeEventCollector/NetskopeEventCollector.yml
…ent_collector_rewrite

# Conflicts:
#	Tests/Marketplace/core_packs_xpanse_list.json
# Conflicts:
#	Packs/Base/Scripts/CommonServerPython/CommonServerPython.py
@ShahafBenYakir ShahafBenYakir marked this pull request as ready for review August 20, 2023 16:22
Copy link
Contributor

@Shellyber Shellyber left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great Work!

| Trust any certificate (not secure) | | False |
| Use system proxy settings | | False |
| First fetch timestamp (<number> <time unit>, e.g., 12 hours, 7 days) | | False |
| Max events per fetch | The maximum amount of events to retrieve \(up to 30000 events\). | False |
| Max events per fetch | The maximum amount of events to retrieve per each event type. For more information about event types see the help section. | False |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't you want to add the limitations also to the readme?
Under the known limitation section?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My bad - Missed that.
Do we want to add also the API limitation regarding indexation?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Waiting for the Netskope team investigation resolution on this

- Added types to perform_data_export parameters
- Removed unused code
@dantavori dantavori removed their request for review August 24, 2023 15:10
@ShahafBenYakir
Copy link
Contributor Author

Validation fails on removed parameters, this is by design as the first fetch is not relevant anymore

@ShahafBenYakir ShahafBenYakir merged commit cda7019 into master Aug 25, 2023
12 of 15 checks passed
@ShahafBenYakir ShahafBenYakir deleted the Netskope_event_collector_rewrite branch August 25, 2023 10:35
xsoar-bot pushed a commit to xsoar-contrib/content that referenced this pull request Oct 5, 2023
* Temporarily added the following packs to the update_core_packs_list:
Core, DemistoRESTAPI, FiltersAndTransformers, Palo_Alto_Networks_WildFire, rasterize

* Added all packs to update core list

* Added al core packs to update_core_packs_list

* Added new API endpoint

* Added testing copies

* changes from testing

* changes from testing

* changes from testing

* Changed default first fecth

* Added slipping for no wait time

* First code change

* Fixed description and log

* UT fixes + mypy

* UT fixes + mypy

* Bumped Docker image and added rn

* Formatting and typos

* Fixed honor_rate_limit and added ut

* Flake 8 fix

* Added more UT

* revert core list change

* Enhanced docs

* Small UT fixes

* Removed is_command variable

* Added docs
Fixed UT

* changes rn version

* - Removed first_fetch param
- Added types to perform_data_export parameters
- Removed unused code

* lint fixes

* lint fixes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants