Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Influxdb - Draft v0.4.0 #222

Merged
merged 87 commits into from
May 9, 2022
Merged

Influxdb - Draft v0.4.0 #222

merged 87 commits into from
May 9, 2022

Commits on Jun 27, 2021

  1. !!!!WIP!!!! 

    adding InfluxDB

- influxdb added to dockerfile
- influxdb s6 service
- influxdb config
- adding defaults to config
- creating a DeviceRepo interface (multiple db backends)
- implemented DeviceRepo interface as ScruitnyRepository
    @AnalogJ
    AnalogJ committed Jun 27, 2021
    Configuration menu
    Copy the full SHA
    8a46931 View commit details
    Browse the repository at this point in the history

  2. fixing history.

    @AnalogJ
    AnalogJ committed Jun 27, 2021
    Configuration menu
    Copy the full SHA
    694fc74 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2021

  1. adding docker build -> ghcr.io

    @AnalogJ
    AnalogJ committed Jul 25, 2021
    Configuration menu
    Copy the full SHA
    5c614c5 View commit details
    Browse the repository at this point in the history

  2. tagging.

    @AnalogJ
    AnalogJ committed Jul 25, 2021
    Configuration menu
    Copy the full SHA
    ef01415 View commit details
    Browse the repository at this point in the history

  3. setting the image type as suffix.

    @AnalogJ
    AnalogJ committed Jul 25, 2021
    Configuration menu
    Copy the full SHA
    967a927 View commit details
    Browse the repository at this point in the history

  4. retest

    @AnalogJ
    AnalogJ committed Jul 25, 2021
    Configuration menu
    Copy the full SHA
    1fc910f View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2021

  1. validate thresholds whenever SMART data is recieved.

    @AnalogJ
    AnalogJ committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    80f4660 View commit details
    Browse the repository at this point in the history

  2. make sure data is persisted to DB.

    @AnalogJ
    AnalogJ committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    bd19230 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2021

  1. fixing mocked data

    @AnalogJ
    AnalogJ committed Aug 1, 2021
    Configuration menu
    Copy the full SHA
    a60edff View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2021

  1. creating influxdb config file during startup.

    @AnalogJ
    AnalogJ committed Aug 7, 2021
    Configuration menu
    Copy the full SHA
    abe7a16 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2021

  1. WIP downsample scripts.

    @AnalogJ
    AnalogJ committed Oct 23, 2021
    Configuration menu
    Copy the full SHA
    975c034 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2021

  1. adding aggregation code

    @AnalogJ
    AnalogJ committed Oct 24, 2021
    Configuration menu
    Copy the full SHA
    9878985 View commit details
    Browse the repository at this point in the history

  2. ensure that all buckets are created during init. Remove all reference… 

    …s to "name" field for attributes (shoudl come from metadata instead). Status is now an int64 (0 is passing).
    @AnalogJ
    AnalogJ committed Oct 24, 2021
    Configuration menu
    Copy the full SHA
    31b5dfa View commit details
    Browse the repository at this point in the history

  3. update timestamps for testing.

    @AnalogJ
    AnalogJ committed Oct 24, 2021
    Configuration menu
    Copy the full SHA
    deba21f View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2021

  1. make sure the status is always exposed in the json data. make sure di… 

    …splay_name for metadata is included. Update mocked test data for frontend.
    @AnalogJ
    AnalogJ committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    5789c83 View commit details
    Browse the repository at this point in the history

  2. fixing test.

    @AnalogJ
    AnalogJ committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    7b7b4fe View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2021

  1. fixes for Scrutiny end-to-end testing.

    @AnalogJ
    AnalogJ committed Oct 28, 2021
    Configuration menu
    Copy the full SHA
    ce032c5 View commit details
    Browse the repository at this point in the history

  2. fixes for Scrutiny end-to-end testing.

    @AnalogJ
    AnalogJ committed Oct 28, 2021
    Configuration menu
    Copy the full SHA
    8fb5859 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2021

  1. tweaking retention policy code so we can test downsampling scripts.

    @AnalogJ
    AnalogJ committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    b776fb8 View commit details
    Browse the repository at this point in the history

  2. find the temp history for the last week (by default). Smooth out data… 

    … using aggregate window for hourly numbers. Better temp casting during influx data inflating.
    @AnalogJ
    AnalogJ committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    772063a View commit details
    Browse the repository at this point in the history

  3. changing the duration dropdown for temp history data. adding an /api/… 

    …summary/temp endpoint
    @AnalogJ
    AnalogJ committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    03bfdd3 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2021

  1. query temp data across multiple buckets

    @AnalogJ
    AnalogJ committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    bff83de View commit details
    Browse the repository at this point in the history

  2. using constant vars for duration key magic strings. Fixing Errorf cal… 

    …ls to correctly have template data.
    @AnalogJ
    AnalogJ committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    47e8595 View commit details
    Browse the repository at this point in the history

  3. fixes for tests.

    @AnalogJ
    AnalogJ committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    0872da5 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2021

  1. fixes for tests.

    @AnalogJ
    AnalogJ committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    903d571 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2022

  1. [BROKEN COMMIT] 

    This code leverages the new `types.isType` functionality introduced in the flux language (influxdata/flux#2159)

This code will fix #22 and all related issues.

Unfortunately this code is broken because the influxdb go client library does not correctly handle import statments in the task defintion.

blocked by
influxdata/influxdb-client-go#322
    @AnalogJ
    AnalogJ committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    f569ab6 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2022

  1. broke scrutiny_repository.go into multiple files for easier explorati… 

    …on & maintenance.
    @AnalogJ
    AnalogJ committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    7a77719 View commit details
    Browse the repository at this point in the history

  2. broke scrutiny_repository.go into multiple files for easier explorati… 

    …on & maintenance.
    @AnalogJ
    AnalogJ committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    f60636a View commit details
    Browse the repository at this point in the history

  3. adding duration key to smart attributes api endpoint

    @AnalogJ
    AnalogJ committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    0a9d364 View commit details
    Browse the repository at this point in the history

  4. fixes for aggregation.

    @AnalogJ
    AnalogJ committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    bd39b2c View commit details
    Browse the repository at this point in the history

  5. update the influxdb version in the standalone container.

    @AnalogJ
    AnalogJ committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    7cd828e View commit details
    Browse the repository at this point in the history

  6. make sure we can pull config from env variables.

    @AnalogJ
    AnalogJ committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    00bc6ec View commit details
    Browse the repository at this point in the history

  7. if running test iin github actions, use influxdb service for testing.

    @AnalogJ
    AnalogJ committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    702c7cd View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2022

  1. waiting for influxdb before starting scrutiny app.

    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    8462d21 View commit details
    Browse the repository at this point in the history

  2. tweak the wait script.

    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    9a5c667 View commit details
    Browse the repository at this point in the history

  3. information about downsampling.

    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    88a99a1 View commit details
    Browse the repository at this point in the history

  4. information about downsampling.

    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    9ebf252 View commit details
    Browse the repository at this point in the history

  5. if we're completing the InfluxDB setup via automation, attempt to sto… 

    …re the token in the config file automatically.
    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    5fb5b9a View commit details
    Browse the repository at this point in the history

  6. started writing a TROUBLESHOOTING guide for the device collector.

    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    5a1e390 View commit details
    Browse the repository at this point in the history

  7. started writing a TROUBLESHOOTING guide for the device collector.

    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    9ee2674 View commit details
    Browse the repository at this point in the history

  8. Document NVMe block device vs device controller binding. 

    Fixes #209.
    @AnalogJ
    AnalogJ committed Apr 30, 2022
    Configuration menu
    Copy the full SHA
    e243d55 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2022

  1. adding more docs.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    5a4bcda View commit details
    Browse the repository at this point in the history

  2. fix WriteConfig interface.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    d42faf3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into influxdb

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    0dba9f8 View commit details
    Browse the repository at this point in the history

  4. build darwin/amd64 and darwin/arm64 binaries.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    62e5a71 View commit details
    Browse the repository at this point in the history

  5. install tzdata package everywhere. 

    fixes #78
fixes
    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    cfe77c9 View commit details
    Browse the repository at this point in the history

  6. update the bug report template

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    8d052f0 View commit details
    Browse the repository at this point in the history

  7. remove darwin builds.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    ccbb922 View commit details
    Browse the repository at this point in the history

  8. adding codecov coverage support.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    84f3327 View commit details
    Browse the repository at this point in the history

  9. adding name for coverage step.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    20411af View commit details
    Browse the repository at this point in the history

  10. referencing Github container registry for all images.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    035c946 View commit details
    Browse the repository at this point in the history

  11. using environmental variable in files path.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    36617c8 View commit details
    Browse the repository at this point in the history

  12. using environmental variable in files path.

    @AnalogJ
    AnalogJ committed May 1, 2022
    Configuration menu
    Copy the full SHA
    08f2471 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2022

  1. using github container registry images. 

    update documentation to enable persistence by default
update docs to include influxdb
    @AnalogJ
    AnalogJ committed May 2, 2022
    Configuration menu
    Copy the full SHA
    ae99ffd View commit details
    Browse the repository at this point in the history

  2. fixing local persistent dir for influxdb in omnibus.

    @AnalogJ
    AnalogJ committed May 2, 2022
    Configuration menu
    Copy the full SHA
    49c1ef6 View commit details
    Browse the repository at this point in the history

  3. addign ability to customize the scrutiny collector cron schedule usin… 

    …g SCRUTINY_COLLECTOR_CRON_SCHEDULE env variable.

similar to linuxserver/docker-scrutiny#19

fixes linuxserver/docker-scrutiny#17
fixes #161
fixes #66
fixes #202
fixes #121
    @AnalogJ
    AnalogJ committed May 2, 2022
    Configuration menu
    Copy the full SHA
    75de6eb View commit details
    Browse the repository at this point in the history

  4. instructions in readme for how to override cron schedule.

    @AnalogJ
    AnalogJ committed May 2, 2022
    Configuration menu
    Copy the full SHA
    ce3d45e View commit details
    Browse the repository at this point in the history

  5. change the environmental variable to COLLECTOR_CRON_SCHEDULE

    @AnalogJ
    AnalogJ committed May 2, 2022
    Configuration menu
    Copy the full SHA
    646d0ef View commit details
    Browse the repository at this point in the history

  6. adding documetnation for smartctl exit codes and addl test.

    @AnalogJ
    AnalogJ committed May 2, 2022
    Configuration menu
    Copy the full SHA
    97f6564 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2022

  1. started working on migration code.

    @AnalogJ
    AnalogJ committed May 3, 2022
    Configuration menu
    Copy the full SHA
    9d85920 View commit details
    Browse the repository at this point in the history

  2. call out deprecated structs so they are not accidentally used via aut… 

    …ocomplete.
    @AnalogJ
    AnalogJ committed May 3, 2022
    Configuration menu
    Copy the full SHA
    2750cce View commit details
    Browse the repository at this point in the history

  3. writing pseudocode algorithm for data migration.

    @AnalogJ
    AnalogJ committed May 3, 2022
    Configuration menu
    Copy the full SHA
    7d963c9 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2022

  1. partially working. Some datapoints are failing with panic and are sil… 

    …ently ignored.

TODO must fix.
    @AnalogJ
    AnalogJ committed May 4, 2022
    Configuration menu
    Copy the full SHA
    8fe0dbe View commit details
    Browse the repository at this point in the history

Commits on May 5, 2022

  1. fixed device processing in details page. Summary query is still broken.

    @AnalogJ
    AnalogJ committed May 5, 2022
    Configuration menu
    Copy the full SHA
    fc5a9ba View commit details
    Browse the repository at this point in the history

  2. fixed summary query.

    @AnalogJ
    AnalogJ committed May 5, 2022
    Configuration menu
    Copy the full SHA
    7025185 View commit details
    Browse the repository at this point in the history

  3. enable final migration cleanup.

    @AnalogJ
    AnalogJ committed May 5, 2022
    Configuration menu
    Copy the full SHA
    5f12fbb View commit details
    Browse the repository at this point in the history

  4. cleanup log messages.

    @AnalogJ
    AnalogJ committed May 5, 2022
    Configuration menu
    Copy the full SHA
    1ced219 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #224 from AnalogJ/influx_migrations

    @AnalogJ
    AnalogJ committed May 5, 2022
    Configuration menu
    Copy the full SHA
    3dbe597 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2022

  1. handle case where WWN not detected for a device (print error messages… 

    …, but skip device collection & uploading).
    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    fabc629 View commit details
    Browse the repository at this point in the history

  2. make sure we can correctly save the config file if onboarding influx.

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    5bab9ac View commit details
    Browse the repository at this point in the history

  3. build multi arch controller image.

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    57c0f89 View commit details
    Browse the repository at this point in the history

  4. build multi arch images

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    d48d0b9 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #228 from AnalogJ/multiarch_builds

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    6fbe710 View commit details
    Browse the repository at this point in the history

  6. fix multi-arch builds.

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    a893d2d View commit details
    Browse the repository at this point in the history

  7. fix multi-arch builds.

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    2350c13 View commit details
    Browse the repository at this point in the history

  8. fixing download command (using curl).

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    77da0f5 View commit details
    Browse the repository at this point in the history

  9. fixing download command (using curl).

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    d26e452 View commit details
    Browse the repository at this point in the history

  10. fixing download command (using curl).

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    8ea194b View commit details
    Browse the repository at this point in the history

  11. better message for what's services we're currently waiting for.

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    87ba8ff View commit details
    Browse the repository at this point in the history

  12. by default show all temp data.

    @AnalogJ
    AnalogJ committed May 6, 2022
    Configuration menu
    Copy the full SHA
    f39628e View commit details
    Browse the repository at this point in the history

Commits on May 7, 2022

  1. highlight last updated dates when more than 2 weeks or 1 month.

    @AnalogJ
    AnalogJ committed May 7, 2022
    Configuration menu
    Copy the full SHA
    0cee744 View commit details
    Browse the repository at this point in the history

  2. make sure we print the overall device status in the details page.

    @AnalogJ
    AnalogJ committed May 7, 2022
    Configuration menu
    Copy the full SHA
    786e7d0 View commit details
    Browse the repository at this point in the history

  3. simple rename.

    @AnalogJ
    AnalogJ committed May 7, 2022
    Configuration menu
    Copy the full SHA
    2214feb View commit details
    Browse the repository at this point in the history

  4. adding tests for Detect struct in collector. Adding ability to mock o… 

    …ut exec.Command calls.
    @AnalogJ
    AnalogJ committed May 7, 2022
    Configuration menu
    Copy the full SHA
    21d07a0 View commit details
    Browse the repository at this point in the history

  5. update the codecov action version.

    @AnalogJ
    AnalogJ committed May 7, 2022
    Configuration menu
    Copy the full SHA
    2b5c864 View commit details
    Browse the repository at this point in the history

  6. adding tests for Smart and parser.

    @AnalogJ
    AnalogJ committed May 7, 2022
    Configuration menu
    Copy the full SHA
    5ed69d7 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2022

  1. make sure that we set the config path when ReadConfig is called.

    @AnalogJ
    AnalogJ committed May 8, 2022
    Configuration menu
    Copy the full SHA
    2967b6c View commit details
    Browse the repository at this point in the history