Adding alternative downsampling examples - Using Quix#5451

Merged

sanderson merged 53 commits intoinfluxdata:masterfrom

May 16, 2024

Contributor

SteveRosam commented Apr 30, 2024

Adding alternative downsampling examples - Using Quix.

This PR includes changes to:

Dedicated
Cloud(TSM)
OSS
Clustered

Quix is collaborating with Influxdata to act as a pure Python alternative to Kapacitor+Flux.

The audience is folks who:

Know Python already and/or don't want to learn a DSL, and possibly those who want to process data more "Pythonically" rather than mixing SQL syntax and Python.
FYI: Quix is both a runtime platform (Quix Cloud) and data processor (Quix Streams Python library). The aim of the articles is to show how downsampling can be done in a continuous real-time process using pure Python.

[x] Signed the InfluxData CLA
(if necessary)
[x] Rebased/mergeable

steverosam and others added 16 commits

April 25, 2024 19:08


          Downsampling InfluxDB2 data with Quix

c155064


          Minor updates

3c86bf5


          Merge pull request #1 from quixio/task/add-flux-quix-downsampling

c22316e

Downsampling InfluxDB v2 data with Quix


This is an alternative to the existing downsampling article that uses Flux.

Quix is collaborating with Influxdata to act as a pure Python alternative to Kapacitor+Flux.

The audience is folks who:

know Python already and/or don't want to learn a DSL, and
possibly those who want to process data more "Pythonically" rather than mixing SQL syntax and Python.
FYI: Quix is both a runtime platform (Quix Cloud) and data processor (Quix Streams python library). The aim of the article is to show how downsampling can be done in a continuous real-time process using pure Python rather than Flux.

Note that I have proposed updating the menu to be:

Process data
Common tasks
Downsample data - Flux
Downsample data - Quix
[ x] Signed the InfluxData CLA
(if necessary)
[ x] Rebased/mergeable


          Merge branch 'master' into master

caf419c


          Merge branch 'master' into master

6416a26


          Adjust weight

61f0f46


          WIP - Added downsample with Quix

b8fbc10


          Update menu

5f4e31c


          Update menu for v2 downsampling with Flux and Quix

8dd4944


          Merge branch 'task/add-flux-quix-downsampling' into task/add-quix-exa…

0cba95e

…mple-to-influxdb-cloud-dedicated


          v2 downsampling page ordering

2b2460d


          Add Quix downsample example to clustered

5cc84c5


          Add Quix downsample example to cloud


          Merge pull request #2 from quixio/task/add-quix-example-to-influxdb-c…

e5ae416

…loud-dedicated

Add Quix downsample example to Cloud, Serverless, OSS and Clustered docs


          Merge branch 'master' into master

6a4b9b1


          Merge branch 'master' into master

e21a922

sanderson requested changes

View reviewed changes

Collaborator

sanderson left a comment •

edited

Loading

There are subtle differences between all the different versions of InfluxDB. I tried to point them out in my review. I think, overall, these are good additions. To summarize what I think needs to change:

Correct terminology in v3 products (InfluxDB Cloud Dedicated and Clustered)
Focus on specific workflows. The content seems to mix downsampling with migrating from v2 to v3. I think you could create the following docs:
- Use Quix to migrate from InfluxDB v2 to v3
- Use Quix to downsample data in InfluxDB
  But these two topics shouldn't be intermingled
When it comes to using Quix with v2 products (InfluxDB OSS v2 and InfluxDB Cloud (TSM)), Quix should be positioned as an alternative to Flux tasks.

content/influxdb/cloud-dedicated/process-data/downsample/downsample-quix.md Outdated

content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md Outdated

content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md Outdated

content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data.md Outdated

content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data.md Outdated

content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md Outdated

content/influxdb/cloud/process-data/common-tasks/downsample/downsample-data-quix.md Outdated

content/influxdb/clustered/process-data/downsample/client-libraries.md

content/influxdb/v2/process-data/common-tasks/downsample/downsample-data-quix.md Outdated

content/influxdb/v2/process-data/common-tasks/downsample/downsample-data.md

SteveRosam and others added 10 commits

May 8, 2024 08:01


          Update content/influxdb/cloud-dedicated/process-data/downsample/downs…

6b00636

…ample-quix.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud/process-data/common-tasks/downsample/do…

09c80d8

…wnsample-data-quix.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud/process-data/common-tasks/downsample/do…

9112b9b

…wnsample-data.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud/process-data/common-tasks/downsample/do…

cb0e171

…wnsample-data.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud/process-data/common-tasks/downsample/do…

138077c

…wnsample-data-quix.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud/process-data/common-tasks/downsample/do…

c59398a

…wnsample-data-quix.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/clustered/process-data/downsample/_index.md

15a990a

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Apply suggestions from code review

4c59793

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Updates based on review comments

98a33c1


          Update Cloud downsampling with Quix page title

1e40b3d

SteveRosam marked this pull request as draft

May 8, 2024 15:55

SteveRosam added 2 commits

May 13, 2024 16:54


          Merge branch 'influxdata:master' into master

f41d87c


          Task/influx quix updates (#3)

d441190

Adding alternative downsampling examples - Using Quix.

This PR includes changes to:

Dedicated
Cloud(TSM)
OSS
Clustered
Quix is collaborating with Influxdata to act as a pure Python alternative to Kapacitor+Flux.

The audience is folks who:

Know Python already and/or don't want to learn a DSL, and possibly those who want to process data more "Pythonically" rather than mixing SQL syntax and Python.
FYI: Quix is both a runtime platform (Quix Cloud) and data processor (Quix Streams Python library). The aim of the articles is to show how downsampling can be done in a continuous real-time process using pure Python.

[x] Signed the InfluxData CLA
(if necessary)
[x] Rebased/mergeableAdding alternative downsampling examples - Using Quix.


          Merge branch 'influxdata:master' into master

137b585

SteveRosam marked this pull request as ready for review

May 14, 2024 14:36


          Merge branch 'master' into master

aa6e977

sanderson requested changes

View reviewed changes

Collaborator

sanderson left a comment

Thanks @SteveRosam. I've made a few suggestions, but this is great stuff!

content/influxdb/cloud-dedicated/process-data/downsample/downsample-quix.md Outdated

content/influxdb/cloud-dedicated/process-data/downsample/downsample.md

content/influxdb/cloud-serverless/process-data/downsample/quix.md Outdated

content/influxdb/cloud-dedicated/process-data/downsample/downsample.md Outdated

content/influxdb/cloud-serverless/process-data/downsample/quix.md Outdated

layouts/shortcodes/html-diagram/influxdb-v2-quix-downsample-pipeline.html

layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html Outdated

layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html Outdated

layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html Outdated

layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pipeline.html Outdated

SteveRosam and others added 23 commits

May 16, 2024 16:58


          Update content/influxdb/cloud-serverless/process-data/downsample/quix.md

43709e5

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud-dedicated/process-data/downsample/downs…

4438d84

…ample.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud-serverless/process-data/downsample/quix.md

aa164f1

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pi…

7b6213d

…peline.html

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pi…

67cbe05

…peline.html

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update layouts/shortcodes/html-diagram/influxdb-v3-quix-downsample-pi…

b8e93da

…peline.html

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Review updates (#4)

85d9114

Updates from review. thanks.


          Update content/influxdb/cloud-dedicated/process-data/downsample/downs…

1a60dd7

…ample-quix.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/v2/tools/downsample-data-quix.md

1e7b4f2

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/v2/tools/downsample-data-quix.md

03eaf2f

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/v2/tools/downsample-data-quix.md

667e64a

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/v2/tools/downsample-data-quix.md

02a343a

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/v2/tools/downsample-data-quix.md

be1c716

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/v2/tools/downsample-data-quix.md

318f17a

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/clustered/process-data/downsample/quix.md

2e04630

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/clustered/process-data/downsample/quix.md

8a410b3

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/clustered/process-data/downsample/client-libr…

cc9d236

…aries.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud-serverless/process-data/downsample/quix.md

e4ad0a7

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud/process-data/common-tasks/downsample-da…

8aa6a10

…ta-quix.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Update content/influxdb/cloud/process-data/common-tasks/downsample-da…

15984a4

…ta-quix.md

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Apply suggestions from code review

3d7e48b

Co-authored-by: Scott Anderson <sanderson@users.noreply.github.com>


          Updates from review (#5)

55bcc66

Updates from review


          Merge branch 'master' into master

116b2ca

Contributor Author

SteveRosam commented May 16, 2024

@sanderson thank you. That must have taken some considerable time to go though. I have implemented all your suggestions. Should be good to go now.

sanderson approved these changes

View reviewed changes

Collaborator

sanderson left a comment

Looks great! Thanks @SteveRosam!

sanderson merged commit 64b2023 into influxdata:master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet