Skip to content
This repository has been archived by the owner on Nov 3, 2021. It is now read-only.

Add test examples for geomodel alerts #1462

Merged
merged 56 commits into from
Oct 3, 2019
Merged

Add test examples for geomodel alerts #1462

merged 56 commits into from
Oct 3, 2019

Commits on Sep 20, 2019

  1. Add test example for duplicate geomodel alerts

    @pwnbus
    pwnbus committed Sep 20, 2019
    Configuration menu
    Copy the full SHA
    c7fdd17 View commit details
    Browse the repository at this point in the history

  2. Resolve the issue of geomodel alerts triggering because state updates… 

    … invalidate old data
    @arcrose
    arcrose committed Sep 20, 2019
    Configuration menu
    Copy the full SHA
    bb85d15 View commit details
    Browse the repository at this point in the history

  3. Fixup pep8 formatting errors

    @pwnbus
    pwnbus committed Sep 20, 2019
    Configuration menu
    Copy the full SHA
    9d46bf9 View commit details
    Browse the repository at this point in the history

  4. Convert geomodel test to similar geomodel test

    @pwnbus
    pwnbus committed Sep 20, 2019
    Configuration menu
    Copy the full SHA
    5cf17a7 View commit details
    Browse the repository at this point in the history

  5. Update alert() fn tests according to new signature

    @arcrose
    arcrose committed Sep 20, 2019
    Configuration menu
    Copy the full SHA
    eb624f4 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2019

  1. Add geomodel alert test for one previous locality state

    @pwnbus
    pwnbus committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    1ae3cfb View commit details
    Browse the repository at this point in the history

  2. Add geomodel alert test for flipping between localities

    @pwnbus
    pwnbus committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    0a9f0e1 View commit details
    Browse the repository at this point in the history

  3. Add geomodel test case with same cities but different geopoints

    @pwnbus
    pwnbus committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    3d7a37b View commit details
    Browse the repository at this point in the history

  4. Update summary in geomodel alert test

    @pwnbus
    pwnbus committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    c4820c6 View commit details
    Browse the repository at this point in the history

  5. After fixing code, determined this alert should NOT fire

    @arcrose
    arcrose committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    c65341a View commit details
    Browse the repository at this point in the history

  6. Consider localities the same if they are close; do math using m/s ins… 

    …tead of km/h for better accuracy
    @arcrose
    arcrose committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    de8af4f View commit details
    Browse the repository at this point in the history

  7. Merge branch 'fixup_duplicates_geomodel' of github.com:mozilla/MozDef… 

    … into fixup_duplicates_geomodel
    @arcrose
    arcrose committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    f16472a View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2019

  1. remove confusing flat_map method

    @arcrose
    arcrose committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    43c2629 View commit details
    Browse the repository at this point in the history

  2. remove outdated localities before trying to alert so that doing so af… 

    …ter doesn't cause problems
    @arcrose
    arcrose committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    70ee3a9 View commit details
    Browse the repository at this point in the history

  3. Resolve lint errors

    @arcrose
    arcrose committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    8483234 View commit details
    Browse the repository at this point in the history

  4. Removed test that is no longer relevant

    @arcrose
    arcrose committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    2dd2851 View commit details
    Browse the repository at this point in the history

  5. Add logic for checking if exceptions need to get exposed in alert tests

    @pwnbus
    pwnbus committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    9cb5a33 View commit details
    Browse the repository at this point in the history

  6. Fix the time comparison in _travel_possible

    @arcrose
    arcrose committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    e64495c View commit details
    Browse the repository at this point in the history

  7. Fix the time comparison in _travel_possible

    @arcrose
    arcrose committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    c392c5b View commit details
    Browse the repository at this point in the history

  8. Add geomodel test for multiple events in same window

    @pwnbus
    pwnbus committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    8407bba View commit details
    Browse the repository at this point in the history

  9. Update geomodel to sort incoming events

    @pwnbus
    pwnbus committed Sep 24, 2019
    Configuration menu
    Copy the full SHA
    b309045 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2019

  1. Add a few more test cases to geomodel alert test

    @pwnbus
    pwnbus committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    ec5d2d0 View commit details
    Browse the repository at this point in the history

  2. Ensure sorted locations when creating alert summary

    @pwnbus
    pwnbus committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    a717c8a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'fixup_duplicates_geomodel' of github.com:mozilla/MozDef… 

    … into fixup_duplicates_geomodel
    @arcrose
    arcrose committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    956deee View commit details
    Browse the repository at this point in the history

  4. Updating tests in preparation for replacement with Alert origin with … 

    …hops
    @arcrose
    arcrose committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    c4f3752 View commit details
    Browse the repository at this point in the history

  5. Adjust test for moved NamedTuple field

    @arcrose
    arcrose committed Sep 25, 2019
    Configuration menu
    Copy the full SHA
    a0e8233 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2019

  1. First pass at refactoring to record 'hops' from one location to anoth… 

    …er in alerts
    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    c0f2e93 View commit details
    Browse the repository at this point in the history

  2. Fixed a typo

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    c79ef44 View commit details
    Browse the repository at this point in the history

  3. Intermediate commit; trying to understand why events are being droppe… 

    …d if I modify timestamps
    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    04ce21c View commit details
    Browse the repository at this point in the history

  4. Remove debugger

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    f5b8d94 View commit details
    Browse the repository at this point in the history

  5. Order events correctly and add a setup and teardown

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    4253f8a View commit details
    Browse the repository at this point in the history

  6. Add information about hops to tests

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    5b0de0c View commit details
    Browse the repository at this point in the history

  7. Separate localities from events from those from ES so we can handle t… 

    …he latter correctly
    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    0a41d58 View commit details
    Browse the repository at this point in the history

  8. Call alert correctly

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    672bb09 View commit details
    Browse the repository at this point in the history

  9. Appease the Linter gods

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    5692d01 View commit details
    Browse the repository at this point in the history

  10. Replace double quotes with single quotes

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    b359e01 View commit details
    Browse the repository at this point in the history

  11. Describe alerts as tracking hops between locations and not just probl… 

    …ematic origins
    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    739fa77 View commit details
    Browse the repository at this point in the history

  12. Fixed syntax error

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    782c96e View commit details
    Browse the repository at this point in the history

  13. Trying to recreate problematic scenario

    @arcrose
    arcrose committed Sep 26, 2019
    Configuration menu
    Copy the full SHA
    b765b6a View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2019

  1. Add geomodel test case where incoming events are older than recorded … 

    …state
    @pwnbus
    pwnbus committed Sep 30, 2019
    Configuration menu
    Copy the full SHA
    de2f19a View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2019

  1. Only consider events that haven't already been processed

    @arcrose
    arcrose committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    071b417 View commit details
    Browse the repository at this point in the history

  2. Only allow one query to be configured. 

    When there are multiple queries, GeoModel will try to avoid processing
events that it may have already processed in previous iterations.
Rather than building a tagging system to track this internally, we will
restrict the number of queries that can be run so that this condition is
impossible.  Queries against multiple sources can be written using OR,
such as in "tags:auth0 OR tags:duo"
    @arcrose
    arcrose committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    8655acc View commit details
    Browse the repository at this point in the history

  3. Parse lastaction from receivedtimestamp in from_events because we exp… 

    …ect it to be more accurate
    @arcrose
    arcrose committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    07cfd7f View commit details
    Browse the repository at this point in the history

  4. Collapse geomodel alert code and remove unused _process function

    @pwnbus
    pwnbus committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    5e4b398 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2019

  1. Reassign lastaction to utctimestamp for locality geomodel

    @pwnbus
    pwnbus committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    a9dbb45 View commit details
    Browse the repository at this point in the history

  2. Modify search window to be dynamic based on last alert execution

    @pwnbus
    pwnbus committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    d94dc49 View commit details
    Browse the repository at this point in the history

  3. Add test case for dynamic search window

    @pwnbus
    pwnbus committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    77a75fb View commit details
    Browse the repository at this point in the history

  4. Creating an abstraction for alert execution time states

    @arcrose
    arcrose committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    07bc4d9 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'fixup_duplicates_geomodel' of github.com:mozilla/MozDef… 

    … into fixup_duplicates_geomodel
    @arcrose
    arcrose committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    c6cd733 View commit details
    Browse the repository at this point in the history

  6. Add missing imports. Format long line

    @arcrose
    arcrose committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    c640ffc View commit details
    Browse the repository at this point in the history

  7. Refactor test to use execution module

    @arcrose
    arcrose committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    e05330a View commit details
    Browse the repository at this point in the history

  8. Use execution module to set up alert

    @arcrose
    arcrose committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    8260353 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2019

  1. Cleaning up to get tests to run

    @arcrose
    arcrose committed Oct 3, 2019
    Configuration menu
    Copy the full SHA
    0c9c145 View commit details
    Browse the repository at this point in the history

  2. Minor tweak to function call order

    @arcrose
    arcrose committed Oct 3, 2019
    Configuration menu
    Copy the full SHA
    6778a28 View commit details
    Browse the repository at this point in the history

  3. Add type_ field back

    @arcrose
    arcrose committed Oct 3, 2019
    Configuration menu
    Copy the full SHA
    a356a0d View commit details
    Browse the repository at this point in the history

  4. Fixing linting errors

    @arcrose
    arcrose committed Oct 3, 2019
    Configuration menu
    Copy the full SHA
    7e9e6de View commit details
    Browse the repository at this point in the history