feat: add events stream and refactor stream organization

[KevinJoiner]

• Add new events stream processing pipeline with Kafka input and ClickHouse output
• Reorganize stream files into dedicated streams/ directory for better organization
• Update database migration processors with new naming conventions
• Add new eventstoslice processor for converting events to slice format
• Update signalstoslice processor with new naming convention
• Refactor Helm chart templates to dynamically mount stream files
• Update environment variables and configuration for unified database naming
• Update Makefile linting paths to reflect new stream organization
• Add new Kafka topic configuration for device events

[linear]

EX-3771 Add Events Ingest in DPS

[KevinJoiner]

makes this consistent with our other services.

[Copilot]

Pull Request Overview

This PR adds a new events stream processing pipeline with Kafka input and ClickHouse output while reorganizing the codebase for better maintainability. The changes introduce a dedicated events processor alongside existing signal processing and unify the database naming conventions.

• Add new events stream processing pipeline with Kafka input and ClickHouse output
• Reorganize stream files into dedicated streams/ directory structure
• Update database migration processors and environment variables with unified naming conventions

Reviewed Changes

Copilot reviewed 13 out of 15 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
main.go	Import new eventstoslice processor package
internal/processors/signalstoslice/signaltoslice.go	Fix package name and update processor registration name
internal/processors/eventstoslice/eventstoslice.go	Add new processor for converting events to slice format
internal/processors/dbmigration/processors.go	Update processor names with new naming conventions
go.mod	Update dependencies to newer versions
charts/dps/values.yaml	Add events topic configuration and unify database environment variables
charts/dps/templates/deployment.yaml	Dynamically mount stream files from streams directory
charts/dps/templates/configmap.yaml	Include streams directory in config map
charts/dps/files/streams/*.yaml	Update processor names and database references to use new conventions
Makefile	Update linting paths to reflect new stream organization

Comments suppressed due to low confidence (1)

internal/processors/signalstoslice/signaltoslice.go:1

• The package name 'signaltoslice' should be 'signalstoslice' to match the directory name and be consistent with the plural naming convention used in 'eventstoslice'.

package signaltoslice