Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Influxdb - Draft v0.4.0 #222

Merged
merged 87 commits into from May 9, 2022
Merged

Influxdb - Draft v0.4.0 #222

merged 87 commits into from May 9, 2022

Conversation

AnalogJ
Copy link
Owner

@AnalogJ AnalogJ commented Apr 29, 2022 •
edited

@AnalogJ
!!!!WIP!!!!
8a46931 
adding InfluxDB

- influxdb added to dockerfile
- influxdb s6 service
- influxdb config
- adding defaults to config
- creating a DeviceRepo interface (multiple db backends)
- implemented DeviceRepo interface as ScruitnyRepository
@AnalogJ
fixing history.
694fc74
@AnalogJ
adding docker build -> ghcr.io
5c614c5
@AnalogJ
tagging.
ef01415
@AnalogJ
setting the image type as suffix.
967a927
@AnalogJ
retest
1fc910f
@AnalogJ
validate thresholds whenever SMART data is recieved.
80f4660
@AnalogJ
make sure data is persisted to DB.
bd19230
@AnalogJ
fixing mocked data
a60edff
@AnalogJ
creating influxdb config file during startup.
abe7a16
@AnalogJ
WIP downsample scripts.
975c034
@AnalogJ
adding aggregation code
9878985
@AnalogJ
ensure that all buckets are created during init. Remove all reference…
31b5dfa 
…s to "name" field for attributes (shoudl come from metadata instead). Status is now an int64 (0 is passing).
@AnalogJ
update timestamps for testing.
deba21f
@AnalogJ
make sure the status is always exposed in the json data. make sure di…
5789c83 
…splay_name for metadata is included. Update mocked test data for frontend.
@AnalogJ
fixing test.
7b7b4fe
@AnalogJ
fixes for Scrutiny end-to-end testing.
ce032c5
@AnalogJ
fixes for Scrutiny end-to-end testing.
8fb5859
@AnalogJ
tweaking retention policy code so we can test downsampling scripts.
b776fb8
@AnalogJ
find the temp history for the last week (by default). Smooth out data…
772063a 
… using aggregate window for hourly numbers. Better temp casting during influx data inflating.
@AnalogJ
changing the duration dropdown for temp history data. adding an /api/…
03bfdd3 
…summary/temp endpoint
@AnalogJ
query temp data across multiple buckets
bff83de
@AnalogJ
using constant vars for duration key magic strings. Fixing Errorf cal…
47e8595 
…ls to correctly have template data.
@AnalogJ
fixes for tests.
0872da5
@AnalogJ
fixes for tests.
903d571
@AnalogJ
[BROKEN COMMIT]
f569ab6 
This code leverages the new `types.isType` functionality introduced in the flux language (influxdata/flux#2159)

This code will fix #22 and all related issues.

Unfortunately this code is broken because the influxdb go client library does not correctly handle import statments in the task defintion.

blocked by
influxdata/influxdb-client-go#322
@AnalogJ
broke scrutiny_repository.go into multiple files for easier explorati…
7a77719 
…on & maintenance.
@AnalogJ
broke scrutiny_repository.go into multiple files for easier explorati…
f60636a 
…on & maintenance.
@AnalogJ
adding duration key to smart attributes api endpoint
0a9d364
@AnalogJ
fixes for aggregation.
bd39b2c
AnalogJ added 22 commits May 4, 2022 20:40
@AnalogJ
fixed summary query.
7025185
@AnalogJ
enable final migration cleanup.
5f12fbb
@AnalogJ
cleanup log messages.
1ced219
@AnalogJ
Merge pull request #224 from AnalogJ/influx_migrations
3dbe597
@AnalogJ
handle case where WWN not detected for a device (print error messages…
fabc629 
…, but skip device collection & uploading).
@AnalogJ
make sure we can correctly save the config file if onboarding influx.
5bab9ac
@AnalogJ
build multi arch controller image.
57c0f89
@AnalogJ
build multi arch images
d48d0b9
@AnalogJ
Merge pull request #228 from AnalogJ/multiarch_builds
6fbe710
@AnalogJ
fix multi-arch builds.
a893d2d
@AnalogJ
fix multi-arch builds.
2350c13
@AnalogJ
fixing download command (using curl).
77da0f5
@AnalogJ
fixing download command (using curl).
d26e452
@AnalogJ
fixing download command (using curl).
8ea194b
@AnalogJ
better message for what's services we're currently waiting for.
87ba8ff
@AnalogJ
by default show all temp data.
f39628e
@AnalogJ
highlight last updated dates when more than 2 weeks or 1 month.
0cee744
@AnalogJ
make sure we print the overall device status in the details page.
786e7d0
@AnalogJ
simple rename.
2214feb
@AnalogJ
adding tests for Detect struct in collector. Adding ability to mock o…
21d07a0 
…ut exec.Command calls.
@AnalogJ
update the codecov action version.
2b5c864
@AnalogJ
adding tests for Smart and parser.
5ed69d7
@AnalogJ AnalogJ changed the title Influxdb Influxdb - Draft v0.4.0 May 7, 2022
@AnalogJ AnalogJ mentioned this pull request May 8, 2022
Closed
@AnalogJ AnalogJ marked this pull request as ready for review May 9, 2022 15:45
@AnalogJ AnalogJ merged commit 6a9db6a into master May 9, 2022
@AnalogJ AnalogJ deleted the influxdb branch May 9, 2022 15:45
@tandy-1000
Copy link

How would I migrate from SQLite to InfluxDB?

@AnalogJ
Copy link
Owner Author

AnalogJ commented May 10, 2022

Scrutiny will automatically migrate the database from sqlite to influxdb during startup.
Sqlite is still used, but it just stores metadata, no metrics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@AnalogJ @codecov-commenter @tandy-1000