New layer indexing for 3.0.0 and additional indexes/cmprs for ival min/max/duration (SYN-6002) #3404
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov ReportAttention:
Additional details and impacted files@@ Coverage Diff @@
## synapse-3xx #3404 +/- ##
===============================================
+ Coverage 96.95% 97.03% +0.07%
===============================================
Files 234 234
Lines 48687 49334 +647
===============================================
+ Hits 47206 47870 +664
+ Misses 1481 1464 -17
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
invisig0th
reviewed
Nov 6, 2023
Cisphyx
changed the title
commit 66ad247 Merge: 113a324 46aacd1 Author: Cisphyx <cisphyx@vertex.link> Date: Tue Feb 20 09:33:48 2024 -0500 Merge branch 'master' into synapse-3xx commit 46aacd1 Author: mikemoritz <57907149+mikemoritz@users.noreply.github.com> Date: Tue Feb 20 04:54:03 2024 -0800 Support mTLS in HTTP requests (SYN-5896) (#3566) commit b63a63c Author: Cisphyx <cisphyx@vertex.link> Date: Tue Feb 20 07:53:13 2024 -0500 Deprecate $lib.bytes (SYN-6861) (#3570) commit aba2a37 Author: blackout <blackout@vertex.link> Date: Fri Feb 16 09:14:16 2024 -0500 Update CI for rerunning failed tests only (#3569) Update circleci.yaml to use `circleci tests run` instead of `circleci tests split` so the new(-ish) "rerun failed tests" feature works. This should hopefully save us a bunch of time (and $$$) by not having to rerun the entire test suite when one or two flaky tests fail. --------- Co-authored-by: Cisphyx <cisphyx@vertex.link> commit 4f4fa04 Author: epiphyte <epiphyte@vertex.link> Date: Fri Feb 16 02:20:41 2024 +0000 Bump version: 2.161.0 → 2.162.0 commit d00a7e5 Author: vEpiphyte <epiphyte@vertex.link> Date: Thu Feb 15 20:40:03 2024 -0500 Changelog for v2.162.0 (#3572) Co-authored-by: invisig0th <visi@vertex.link> Co-authored-by: Cisphyx <cisphyx@vertex.link> commit 0d46f09 Author: Cisphyx <cisphyx@vertex.link> Date: Thu Feb 15 12:10:49 2024 -0500 Include vars from the current and parent scopes when resolving STIX properties and relationships (#3571) Co-authored-by: invisig0th <visi@vertex.link> commit 33ea54d Author: Cisphyx <cisphyx@vertex.link> Date: Thu Feb 15 11:59:04 2024 -0500 Adjust tag permissions check during merges (SYN-6830) (#3545) commit 8569761 Author: invisig0th <visi@vertex.link> Date: Thu Feb 15 11:54:06 2024 -0500 Fix bug where users may vote for their own merge (#3565) commit 7487841 Author: mikemoritz <57907149+mikemoritz@users.noreply.github.com> Date: Thu Feb 15 08:23:08 2024 -0800 Add rstorm onload waiters (SYN-6871) (#3567) commit 2a80656 Author: Cisphyx <cisphyx@vertex.link> Date: Wed Feb 14 16:34:04 2024 -0500 Add perm checks with default=True to $lib.bytes (SYN-6859) (#3563) Co-authored-by: invisig0th <visi@vertex.link> commit ad1dc70 Author: invisig0th <visi@vertex.link> Date: Wed Feb 14 16:24:59 2024 -0500 Add received:from:ipv4/ipv6/fqdn to inet:email:message (#3564) commit 113a324 Merge: 687a09e 977c8c7 Author: Cisphyx <cisphyx@vertex.link> Date: Wed Feb 14 15:36:30 2024 -0500 Merge branch 'master' into synapse-3xx commit 977c8c7 Author: therealsilence <therealsilence@users.noreply.github.com> Date: Wed Feb 14 10:15:22 2024 -0800 Storm update (Part 1) (#3560) Update Storm lift and filter documentation to add: - Wildcard lifts and filters - Interface lifts and filters - Minor clarification to subqueries page --------- Co-authored-by: Cisphyx <cisphyx@vertex.link> commit f700eaf Author: Cisphyx <cisphyx@vertex.link> Date: Wed Feb 14 09:35:20 2024 -0500 Deprecate upstream/mirror layer opts (SYN-6839) (#3562) commit 949e3c1 Author: invisig0th <visi@vertex.link> Date: Mon Feb 12 12:57:35 2024 -0500 Model updates 2024-02-08 (#3551) Co-authored-by: blackout <blackout@vertex.link> commit 93e9eef Author: blackout <blackout@vertex.link> Date: Mon Feb 12 11:44:35 2024 -0500 SYN-6798: add aha info to tele:syn response (#3552) feat: Add aha service name to the tele:syn message from the server if present. commit 344a667 Author: blackout <blackout@vertex.link> Date: Fri Feb 9 11:04:27 2024 -0500 SYN-6848: :url added to ou:id:type (#3549) feat: Added ``:url`` secondary property to ``ou:id:type``. commit 158f366 Author: vEpiphyte <epiphyte@vertex.link> Date: Fri Feb 9 11:04:02 2024 -0500 Fix use of updateHttpSessInfo by cells that haven't loaded a sess into memory (#3556) commit 36c50e3 Author: blackout <blackout@vertex.link> Date: Fri Feb 9 09:31:57 2024 -0500 SYN-6814: Add note about Synapse not a data lake (#3553) Updated the introduction page with a note about Synapse not being a data lake. Preview:  --------- Co-authored-by: invisig0th <visi@vertex.link> commit cc8df69 Author: blackout <blackout@vertex.link> Date: Fri Feb 9 09:29:20 2024 -0500 SYN-6763: $str.json() (#3555) feat: Add ``.json()`` method to storm strings. commit fcc5ead Author: vEpiphyte <epiphyte@vertex.link> Date: Fri Feb 9 09:28:34 2024 -0500 Update trove classifiers (SYN-6809) (#3557) commit c37e54c Author: vEpiphyte <epiphyte@vertex.link> Date: Wed Feb 7 17:42:53 2024 -0500 benchmark_cortex.py, change eval -> storm (#3550) commit 1497e59 Author: therealsilence <therealsilence@users.noreply.github.com> Date: Wed Feb 7 11:03:03 2024 -0800 Update Synapse User Guide "Automation" docs (#3547) - Revise, update, and organize docs - Add discussion of impact on automation of views & layers, scope, and permissions - Add details and example for edge:add / edge:del triggers - Add details and examples for modifying macro permissions - Update examples and provide additional detail on example Storm - Incidental corrections / additions to other docs --------- Co-authored-by: Cisphyx <cisphyx@vertex.link> commit a3b57b7 Author: blackout <blackout@vertex.link> Date: Wed Feb 7 11:13:45 2024 -0500 SYN-6400: $lib.dict.keys() and friends (#3548) deprecated: `$lib.dict()` feat: Added ``$lib.dict.has()``, ``$lib.dict.keys()``, ``$lib.dict.pop()``, ``$lib.dict.update()``, and ``$lib.dict.values()`` library functions. --------- Co-authored-by: epiphyte <epiphyte@vertex.link> commit 75088cc Author: epiphyte <epiphyte@vertex.link> Date: Tue Feb 6 17:42:18 2024 +0000 Bump version: 2.160.0 → 2.161.0 commit 914c41b Author: epiphyte <epiphyte@vertex.link> Date: Tue Feb 6 17:42:14 2024 +0000 Fix an RST error in the changelog. commit c3b02d9 Author: vEpiphyte <epiphyte@vertex.link> Date: Tue Feb 6 12:27:25 2024 -0500 Changelog for v2.161.0 (#3536) Co-authored-by: Cisphyx <cisphyx@vertex.link> Co-authored-by: blackout <blackout@vertex.link> commit 494b64a Author: vEpiphyte <epiphyte@vertex.link> Date: Mon Feb 5 14:47:14 2024 -0500 Make quorum tests a little more robust (#3546) Co-authored-by: Cisphyx <cisphyx@vertex.link> commit 01928f8 Author: vEpiphyte <epiphyte@vertex.link> Date: Mon Feb 5 13:22:48 2024 -0500 Add a method to the http session to do a bulk value set (#3544) Co-authored-by: invisig0th <visi@vertex.link> commit 1ae99f7 Author: invisig0th <visi@vertex.link> Date: Mon Feb 5 12:07:34 2024 -0500 Add getMergeRequest() and getMergeRequestSummary() to storm view object (#3541) commit 687a09e Author: Cisphyx <cisphyx@vertex.link> Date: Mon Feb 5 11:02:31 2024 -0500 Clean up IndxBy in layer (#3543) commit 64b303d Author: mikemoritz <57907149+mikemoritz@users.noreply.github.com> Date: Fri Feb 2 12:09:46 2024 -0800 Add gen command for it:av:scan:result (SYN-6661) (#3516) Co-authored-by: Cisphyx <cisphyx@vertex.link> Co-authored-by: epiphyte <epiphyte@vertex.link> commit e1de8d7 Author: Cisphyx <cisphyx@vertex.link> Date: Fri Feb 2 13:55:40 2024 -0500 Fix AHA pool replay test inconsistency (#3539) Co-authored-by: epiphyte <epiphyte@vertex.link> commit 178d478 Author: vEpiphyte <epiphyte@vertex.link> Date: Fri Feb 2 10:02:21 2024 -0500 Feat dep updates (#3540) vertexproject/vtx-base-image#578 vertexproject/vtx-base-image#559 commit f6e5386 Author: cisphyx <cisphyx@vertex.link> Date: Fri Feb 2 08:40:49 2024 -0500 update test commit 94d2b5f Merge: e6f9b9e 8f511ae Author: Cisphyx <cisphyx@vertex.link> Date: Fri Feb 2 08:26:53 2024 -0500 Merge branch 'master' into synapse-3xx commit e6f9b9e Author: Cisphyx <cisphyx@vertex.link> Date: Fri Feb 2 08:25:37 2024 -0500 Remove upstream/mirror layers (#3537) commit 8f511ae Author: James Gross <45212823+rakuy0@users.noreply.github.com> Date: Thu Feb 1 15:12:37 2024 -0500 Back out trigger setting created time (#3538) commit 6fd753e Author: James Gross <45212823+rakuy0@users.noreply.github.com> Date: Thu Feb 1 14:23:04 2024 -0500 Add some more created timestamps around, part of SYN-6358 (#3521) commit da6a412 Author: cisphyx <cisphyx@vertex.link> Date: Thu Feb 1 13:31:24 2024 -0500 fixes from merge commit 5d07c34 Merge: 7bc092f f0b9e0f Author: Cisphyx <cisphyx@vertex.link> Date: Thu Feb 1 13:01:32 2024 -0500 Merge branch 'master' into synapse-3xx commit f0b9e0f Author: vEpiphyte <epiphyte@vertex.link> Date: Thu Feb 1 10:31:55 2024 -0500 Add aha information to getCellInfo (SYN-6764) (#3519) Add an aha dict to cell information, populated with name, leader, and network information. commit dca9836 Author: therealsilence <therealsilence@users.noreply.github.com> Date: Thu Feb 1 07:14:54 2024 -0800 Update Synapse User Guide - data model docs (#3523) - Add information on interfaces - Add information on extended forms and extended properties - Clarify "edge forms" - Minor updates / revisions --------- Co-authored-by: Cisphyx <cisphyx@vertex.link> Co-authored-by: invisig0th <visi@vertex.link> commit 19a99c9 Author: vEpiphyte <epiphyte@vertex.link> Date: Thu Feb 1 09:10:42 2024 -0500 Set aha logs to info level (SYN-6519) (#3534) commit 58efa7b Author: Cisphyx <cisphyx@vertex.link> Date: Wed Jan 31 17:12:33 2024 -0500 Pass edited nodes to snap._applyNodeEdits (#3520) commit fa2a0b6 Author: vEpiphyte <epiphyte@vertex.link> Date: Tue Jan 30 23:03:03 2024 -0500 Fix pkg onload test race (#3533) commit c7c7530 Author: Cisphyx <cisphyx@vertex.link> Date: Tue Jan 30 13:32:33 2024 -0500 Ensure Nexus events written to the log are always applied (SYN-6807) (#3518) commit f9bce5a Author: blackout <blackout@vertex.link> Date: Tue Jan 30 13:18:53 2024 -0500 SYN-6727: more context for easy perm auth deny (#3532) commit 761a90d Author: James Gross <45212823+rakuy0@users.noreply.github.com> Date: Mon Jan 29 14:38:52 2024 -0500 Fix some bad names in graph projection, part of OP-3028 (#3531) commit 7f7bbfc Author: vEpiphyte <epiphyte@vertex.link> Date: Mon Jan 29 12:49:52 2024 -0500 CI: Update cache keys to be consistent, replace CIRCLE_STAGE with CIRCLE_JOB (#3528) commit d11dc2f Author: Cisphyx <cisphyx@vertex.link> Date: Mon Jan 29 12:36:43 2024 -0500 Update EmbedQuery to grab vars from parent scopes (#3529) Co-authored-by: vEpiphyte <epiphyte@vertex.link> commit 1049735 Author: Cisphyx <cisphyx@vertex.link> Date: Mon Jan 29 12:24:28 2024 -0500 Delete pool entry from leader in query offload test (#3530) commit d808662 Author: vEpiphyte <epiphyte@vertex.link> Date: Mon Jan 29 11:24:05 2024 -0500 Fix missing fstring (#3525) commit 996fa30 Author: vEpiphyte <epiphyte@vertex.link> Date: Mon Jan 29 11:23:29 2024 -0500 Bug: Fix websocket connect ssl handling (SYN-6812) (#3527) Issue exposed by aio-libs/aiohttp#7698 commit 43fb572 Author: blackout <blackout@vertex.link> Date: Fri Jan 26 09:13:16 2024 -0500 SYN-6658: docs on ext props updated to note the need to delete values before removing them (#3510) docs: Update admin guide with additional info about updating extended model elements. commit d269eda Author: vEpiphyte <epiphyte@vertex.link> Date: Thu Jan 25 15:35:26 2024 -0500 Bug: Fix flakey test in test_lib_storm_basics (SYN-6804) (#3517) Co-authored-by: Cisphyx <cisphyx@vertex.link> commit a0885db Author: epiphyte <epiphyte@vertex.link> Date: Wed Jan 24 22:32:29 2024 +0000 Add inet:ipv6 update to the changelog. commit 26159d5 Author: epiphyte <epiphyte@vertex.link> Date: Wed Jan 24 22:28:32 2024 +0000 Bump version: 2.159.0 → 2.160.0 commit b7c57d0 Author: epiphyte <epiphyte@vertex.link> Date: Wed Jan 24 22:21:43 2024 +0000 Add missing migration to the changelog commit 9456d3b Author: vEpiphyte <epiphyte@vertex.link> Date: Wed Jan 24 17:08:39 2024 -0500 Changelog for v2.160.0 (#3511) Co-authored-by: Cisphyx <cisphyx@vertex.link> Co-authored-by: blackout <blackout@vertex.link> commit af5c3c0 Author: vEpiphyte <epiphyte@vertex.link> Date: Wed Jan 24 16:34:42 2024 -0500 Revert "SYN-6716: `it:sec:cpe` issues when converting from 2.2->2.3 and 2.3->2.2 (#3491)" (#3514) This reverts commit 4c98bc6. commit 149e25b Author: Cisphyx <cisphyx@vertex.link> Date: Wed Jan 24 15:15:12 2024 -0500 Add query offloading to count/exportStorm (SYN-6802) (#3513) commit 79dab62 Author: Cisphyx <cisphyx@vertex.link> Date: Wed Jan 24 13:00:57 2024 -0500 Add query offload mirrors (SYN-6046) (#3452) commit 6510252 Author: Cisphyx <cisphyx@vertex.link> Date: Wed Jan 24 12:54:03 2024 -0500 Use dict instead of list for prop type maps (#3512) commit 20fd23a Author: vEpiphyte <epiphyte@vertex.link> Date: Wed Jan 24 09:44:19 2024 -0500 Make layer pulls / push configurations tunable (#3480) commit ff60cb2 Author: invisig0th <visi@vertex.link> Date: Wed Jan 24 09:00:04 2024 -0500 Adds node.set.<form>.<prop> perms convention ( backward compatible ) (#3505) commit 4240ca2 Author: blackout <blackout@vertex.link> Date: Tue Jan 23 16:24:31 2024 -0500 Revert CPE migration code and test (#3508) commit d0a2434 Author: blackout <blackout@vertex.link> Date: Tue Jan 23 15:44:11 2024 -0500 SYN-6363: `edges.del --n2` command can't delete edges with a missing N1 and the edge data sticks around (#3506) commit ba1ca2e Author: invisig0th <visi@vertex.link> Date: Tue Jan 23 12:41:13 2024 -0500 Add IPv6 :type and :scope (#3498) Co-authored-by: blackout <blackout@vertex.link> commit 4c98bc6 Author: blackout <blackout@vertex.link> Date: Tue Jan 23 12:34:34 2024 -0500 SYN-6716: `it:sec:cpe` issues when converting from 2.2->2.3 and 2.3->2.2 (#3491) bugfix: Updated CPE code to support better conversions from 2.2->2.3 and vice versa --------- Co-authored-by: epiphyte <epiphyte@vertex.link> commit 0283588 Author: vEpiphyte <epiphyte@vertex.link> Date: Tue Jan 23 11:08:13 2024 -0500 Bug: Storm cli completion (#3507) Support older cortex without coreinfov2 update Ensure that tag completion runs in the current view commit e4621cb Author: blackout <blackout@vertex.link> Date: Mon Jan 22 19:29:50 2024 -0500 SYN-6652: --deledges option to delnode (#3503) commit 0e162b1 Author: blackout <blackout@vertex.link> Date: Mon Jan 22 19:07:36 2024 -0500 SYN-6647: tab completion in storm CLI (#3493) feat: Add tab completion in Storm CLI. Completes forms, properties, libs and tags. commit 98af04d Author: blackout <blackout@vertex.link> Date: Mon Jan 22 15:44:48 2024 -0500 SYN-6690: Update `it:exec:*` to inherit the `it:host:activity` interface (#3501) feat: Update `it:exec:*` forms to inherit the `it:host:activity` interface. --------- Co-authored-by: invisig0th <visi@vertex.link> commit 7bc092f Merge: b7aaf2f 7d41562 Author: Cisphyx <cisphyx@vertex.link> Date: Mon Jan 22 15:41:15 2024 -0500 Merge branch 'master' into synapse-3xx commit b7aaf2f Author: cisphyx <cisphyx@vertex.link> Date: Mon Jan 22 15:41:00 2024 -0500 grab 3.0.0 bylayer fix commit 7d41562 Author: invisig0th <visi@vertex.link> Date: Mon Jan 22 15:33:26 2024 -0500 Add :priority and :severity to risk:vuln (#3504) …:vuln convention. commit dc536a4 Author: cisphyx <cisphyx@vertex.link> Date: Mon Jan 22 15:26:17 2024 -0500 fix merge commit 27a6c70 Merge: cc747d2 a2a7e5b Author: Cisphyx <cisphyx@vertex.link> Date: Mon Jan 22 14:58:47 2024 -0500 Merge branch 'master' into synapse-3xx commit a2a7e5b Author: vEpiphyte <epiphyte@vertex.link> Date: Thu Jan 18 08:55:58 2024 -0500 Add Cell.hasHttpSess(iden) (#3485) commit 916adce Author: Cisphyx <cisphyx@vertex.link> Date: Thu Jan 18 08:51:24 2024 -0500 Fix node.bylayer data for tagprops (SYN-6743) (#3500) commit e07b15b Author: therealsilence <therealsilence@users.noreply.github.com> Date: Wed Jan 17 13:25:15 2024 -0800 Update Storm "filter" docs (#3489) - Add documentation for tag glob filtering - Add expression filter example for calculating intervals that fall *within* intervals - Reorganize / better structure docs - General editorial pass (update examples for current tag and model elements, overall cleanup) commit 4b78652 Author: mikemoritz <57907149+mikemoritz@users.noreply.github.com> Date: Wed Jan 17 08:14:11 2024 -0800 Fire an event when a pkg onload completes (SYN-6752) (#3497) commit 1d8f9bb Author: Cisphyx <cisphyx@vertex.link> Date: Wed Jan 17 10:57:09 2024 -0500 Remove dataname index entries when wiping nodedata (SYN-6683) (#3499) Co-authored-by: invisig0th <visi@vertex.link> commit e6b7281 Author: epiphyte <epiphyte@vertex.link> Date: Tue Jan 16 21:40:02 2024 +0000 Bump version: 2.158.0 → 2.159.0 commit b9c5c2d Author: vEpiphyte <epiphyte@vertex.link> Date: Tue Jan 16 16:26:35 2024 -0500 Changelog for v2.159.0 (#3496) Co-authored-by: Cisphyx <cisphyx@vertex.link> Co-authored-by: invisig0th <visi@vertex.link> commit 2a2fd05 Author: vEpiphyte <epiphyte@vertex.link> Date: Tue Jan 16 14:25:51 2024 -0500 BUG: $lib.stix.import.ingest missing toprim on bundle (SYN-6749) (#3495) commit 340996a Author: mikemoritz <57907149+mikemoritz@users.noreply.github.com> Date: Tue Jan 16 08:41:01 2024 -0800 Update vault permissions to always check for asroot (SYN-6726) (#3492) commit 9aa5d57 Author: James Gross <45212823+rakuy0@users.noreply.github.com> Date: Fri Jan 12 12:43:57 2024 -0500 `$lib.axon.urlfile` was missing a perms check for adding the nodes, part of SYN-6660 (#3490) commit 197bc8f Author: therealsilence <therealsilence@users.noreply.github.com> Date: Thu Jan 11 08:43:23 2024 -0800 Update Storm "lift" docs (#3487) - Add documentation for 'reverse' keyword - Reorganize / better structure docs - Clarify use of "try" operator - General editorial pass (update examples for current tag and model elements, overall cleanup) commit 29a59a7 Author: blackout <blackout@vertex.link> Date: Wed Jan 10 11:24:56 2024 -0500 SYN-6612: lark doesn't parse correctly with python 3.11.7 (#3488) - Update lark to 1.1.9 which has python 3.11.7 fix - Unpin CI images from 3.11.6 back to 3.11 commit 05b6bb7 Author: Cisphyx <cisphyx@vertex.link> Date: Thu Jan 4 16:17:23 2024 -0500 Prevent re-adding extended model elements in nexus handlers (#3486)
This reverts commit 933b68b.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.