Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/report any query #12

Merged
merged 61 commits into from
Feb 2, 2024
Merged

Feature/report any query #12

merged 61 commits into from
Feb 2, 2024

Conversation

asllop
Copy link
Contributor

@asllop asllop commented Dec 12, 2023 •
edited
Loading

Goals

  • Accept arbitrary event log queries.
  • Accept queries of any type of event, not only event logs.
  • Read credentials from env vars.
  • Implement Redis cache for events.
  • Configurable timestamp attribute.
  • Improve NR API interaction.
  • Fix multiple issues.
  • Build a docker image to run the integration.
  • Improve documentation.

@asllop
Downgrade PyYAML to 5.3.1 because 5.4.1 fails installing pip deps.
60ca94e 
yaml/pyyaml#724
@asllop
Run arbitrary EventLogFile queries.
6264267
@asllop
Update time range after generating all queries.
71c49ac
@asllop
Refactor fetch_logs method.
96bb30f
@asllop
Support any request, not only event log files.
18f0ed4
@asllop
Fix NR Log API model format.
4b2bdf4
@asllop
Fix NR Log API format for generic events.
e920343
@asllop
Generate a timestamp from event CreateDate if available.
b9ae818
@asllop
Generate a log model with all rows from query response.
341f68a
@asllop
Slice CSV into smaller chunks.
0586cc1
@asllop
Use datetime to parse CreatedDate instead of external dependency date…
5263e37 
…util.
@asllop
Slice any request into smaller chunks. Generate better log message.
a2b56c4
@asllop
Fix Event API path.
ae98035
@asllop
Escape request string.
ca67370
@asllop
Unscape hardcoded requests.
55bf5d7
@asllop
Read credentials from env vars, when not present in config file.
d55b767
@asllop
Implement a prefix system for credentials with multiple instances.
8127d77
@asllop
Use env vars for NR credentials.
8a5874a
@asllop
Create a docker image to run the integration.
0fb51dc
@asllop
Update vulnerable dependencies.
a0cfc24
@asllop
Update README.md
9d271be
@asllop
Fix README format.
9851b05
@asllop
Fix bug setting timeout for generic events.
2c699e2
@asllop
Update docs.
68a1a1c
@asllop
Custom timestamp attribute.
c8df601
@asllop
Add event type for Nr Event API.
2bc2662
@asllop
Show exit message.
997782d
@asllop
Fix redis connection config.
4e30925
@asllop
Implement redis cache for any event. Improve redis docs. Set up expir…
8f8daca 
…e time from config yml.
@asllop asllop self-assigned this Dec 20, 2023
@asllop
Deepcopy query dictionary.
28e918e
@asllop
Move cache code to a different class.
4efa368
@asllop
Persist cache only after requests to NR returned OK.
cb17f61
@asllop
Remove testing code.
59ded4c
@asllop
Check that redis object exists before trying to process any data.
3251d0d
@asllop
Implement generic env vars for queries.
0befcbf
@asllop
Build a compound ID with a combination of attributes.
9226a0b
@asllop
Improve error handling for id key and data empty check.
3468f14
@asllop
Generate telemetry.
76d404d
@asllop
Create CHANGELOG.md
4f7d21d
@asllop
Read cron_interval_minutes from env var if not defined in the config …
2d6d747 
…yaml.
@asllop
Add query env doc.
995bc9f
@asllop
Read token_url from the OS env.
169c1ba
@asllop
Rename sample config file.
c23bf31
@asllop
Only download CSV if record ID is not in the cache.
5bb1f01
@asllop
Only skip downloading CSV if logs interval is Hourly.
a059d9f
@asllop
Add note.
012c039
@asllop
Fix crash when cache not enabled.
826d622
@asllop
Implement default api_ver.
0e44619
@asllop
Update README.md
575b887
@asllop
Load query config from multiple files.
b935c8e
@asllop
Fix issue with access to NR APIs. Turn console logs into actual logs.
e2d992c
@asllop
Turn telemetry logs into console logs.
afa4348
@asllop
Add timestamp to console logs.
dd346e4
@asllop
Update changelog.
a25b0cf
@asllop
Add instrumentation attributes to each data point.
43d9985
@asllop
Update docs.
c98b1f2
@asllop asllop marked this pull request as ready for review February 2, 2024 11:35
@asllop asllop merged commit dfb2aa1 into main Feb 2, 2024
2 checks passed
@asllop asllop deleted the feature/report_any_query branch February 2, 2024 11:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@asllop asllop

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

is it possible to incorporate Salesforce setupaudittrail in the same integration?
1 participant
@asllop