Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Inlong-5722][Agent] Support Redis Source #5779

Closed
wants to merge 12 commits into from
Closed

[Inlong-5722][Agent] Support Redis Source #5779

wants to merge 12 commits into from

Conversation

iamsee123
Copy link
Contributor

Prepare a Pull Request

Motivation

make agent module support redis source

Modifications

  • add RedisSource and RedisReader
  • add unit test for redisReader

Verifying this change

(Please pick either of the following options)

  • This change is a trivial rework/code cleanup without any test coverage.

  • This change is already covered by existing tests, such as:
    (please describe tests)

  • This change added tests and can be verified as follows:

    • TestRedisReader

pocozh and others added 12 commits August 23, 2022 16:25
@pocozh @dockerzhang
[INLONG-5437][SDK] Support initializing SDK(cpp) by ClientConfig obje…
05a94af 
…ct (apache#5641)
@yunqingmoswu @dockerzhang
[INLONG-5637][Sort] Fix kafka load node npe error (apache#5638)
98a1368 
* [INLONG-5637][Sort] Fix kafka load node npe error

* [INLONG-5637][Sort] Fix kafka load node npe error
@healchow @dockerzhang
[INLONG-5650][Manager] Remove the non-null check of the Pulsar adminU…
38dfe73 
…RL (apache#5651)
@EMsnap
[INLONG-5655][Release] Change version from 1.3.0-SNAPSHOT to 1.3.0 (a…
4e672de 
…pache#5656)
@woofyzhao @healchow
[INLONG-5658][DataProxy] Fix incorrect docker script (apache#5660)
13c1937
@leezng @EMsnap
[INLONG-5648][Dashboard] Optimize the create logic, support specifyin…
9b8a0c3 
…g specific types (apache#5649)
@lucaspeng12138 @EMsnap
[INLONG-5652][Docker] Fix push aarch64 images script (apache#5653)
5c6f52f
@GanfengTan @EMsnap
[INLONG-5663][Agent] To update data structure for k8s log (apache#5664)
f1346a6
@iamsee123
Merge remote-tracking branch 'upstream/master'
3d338b2 
# Conflicts:
#	inlong-agent/agent-common/pom.xml
#	inlong-agent/agent-core/pom.xml
#	inlong-agent/agent-docker/pom.xml
#	inlong-agent/agent-plugins/pom.xml
#	inlong-agent/agent-release/pom.xml
#	inlong-agent/pom.xml
#	inlong-audit/audit-common/pom.xml
#	inlong-audit/audit-docker/pom.xml
#	inlong-audit/audit-proxy/pom.xml
#	inlong-audit/audit-release/pom.xml
#	inlong-audit/audit-sdk/pom.xml
#	inlong-audit/audit-store/pom.xml
#	inlong-audit/pom.xml
#	inlong-common/pom.xml
#	inlong-dashboard/pom.xml
#	inlong-dataproxy/dataproxy-dist/pom.xml
#	inlong-dataproxy/dataproxy-docker/pom.xml
#	inlong-dataproxy/dataproxy-source/pom.xml
#	inlong-dataproxy/pom.xml
#	inlong-distribution/pom.xml
#	inlong-manager/manager-client-examples/pom.xml
#	inlong-manager/manager-client-tools/pom.xml
#	inlong-manager/manager-client/pom.xml
#	inlong-manager/manager-common/pom.xml
#	inlong-manager/manager-dao/pom.xml
#	inlong-manager/manager-docker/pom.xml
#	inlong-manager/manager-plugins/pom.xml
#	inlong-manager/manager-pojo/pom.xml
#	inlong-manager/manager-service/pom.xml
#	inlong-manager/manager-test/pom.xml
#	inlong-manager/manager-web/pom.xml
#	inlong-manager/manager-workflow/pom.xml
#	inlong-manager/pom.xml
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/README.md
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/release/inc/client_config.h
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/release/inc/tc_api.h
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/src/base/client_config.cc
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/src/base/logger.h
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/src/base/sdk_constant.h
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/src/base/sdk_core.cc
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/src/net/buffer_pool.cc
#	inlong-sdk/dataproxy-sdk-twins/dataproxy-sdk-cpp/test/base/client_config_test.cc
#	inlong-sdk/dataproxy-sdk/pom.xml
#	inlong-sdk/pom.xml
#	inlong-sdk/sdk-common/pom.xml
#	inlong-sdk/sort-sdk/pom.xml
#	inlong-sort-standalone/pom.xml
#	inlong-sort-standalone/sort-standalone-common/pom.xml
#	inlong-sort-standalone/sort-standalone-dist/pom.xml
#	inlong-sort-standalone/sort-standalone-source/pom.xml
#	inlong-sort/pom.xml
#	inlong-sort/sort-api/pom.xml
#	inlong-sort/sort-common/pom.xml
#	inlong-sort/sort-connectors/base/pom.xml
#	inlong-sort/sort-connectors/doris/pom.xml
#	inlong-sort/sort-connectors/elasticsearch-6/pom.xml
#	inlong-sort/sort-connectors/elasticsearch-7/pom.xml
#	inlong-sort/sort-connectors/elasticsearch-base/pom.xml
#	inlong-sort/sort-connectors/filesystem/pom.xml
#	inlong-sort/sort-connectors/hbase/pom.xml
#	inlong-sort/sort-connectors/hive/pom.xml
#	inlong-sort/sort-connectors/iceberg-dlc/pom.xml
#	inlong-sort/sort-connectors/iceberg/pom.xml
#	inlong-sort/sort-connectors/jdbc/pom.xml
#	inlong-sort/sort-connectors/kafka/pom.xml
#	inlong-sort/sort-connectors/mongodb-cdc/pom.xml
#	inlong-sort/sort-connectors/mysql-cdc/pom.xml
#	inlong-sort/sort-connectors/oracle-cdc/pom.xml
#	inlong-sort/sort-connectors/pom.xml
#	inlong-sort/sort-connectors/postgres-cdc/pom.xml
#	inlong-sort/sort-connectors/pulsar/pom.xml
#	inlong-sort/sort-connectors/redis/pom.xml
#	inlong-sort/sort-connectors/sqlserver-cdc/pom.xml
#	inlong-sort/sort-connectors/tubemq/pom.xml
#	inlong-sort/sort-core/pom.xml
#	inlong-sort/sort-dist/pom.xml
#	inlong-sort/sort-end-to-end-tests/pom.xml
#	inlong-sort/sort-formats/format-base/pom.xml
#	inlong-sort/sort-formats/format-common/pom.xml
#	inlong-sort/sort-formats/format-csv/pom.xml
#	inlong-sort/sort-formats/format-inlongmsg-base/pom.xml
#	inlong-sort/sort-formats/format-inlongmsg-csv/pom.xml
#	inlong-sort/sort-formats/format-inlongmsg-pb/pom.xml
#	inlong-sort/sort-formats/format-json/pom.xml
#	inlong-sort/sort-formats/format-kv/pom.xml
#	inlong-sort/sort-formats/pom.xml
#	inlong-tubemq/pom.xml
#	inlong-tubemq/tubemq-client/pom.xml
#	inlong-tubemq/tubemq-connectors/pom.xml
#	inlong-tubemq/tubemq-connectors/tubemq-connector-flink/pom.xml
#	inlong-tubemq/tubemq-connectors/tubemq-connector-flume/pom.xml
#	inlong-tubemq/tubemq-connectors/tubemq-connector-spark/pom.xml
#	inlong-tubemq/tubemq-core/pom.xml
#	inlong-tubemq/tubemq-docker/pom.xml
#	inlong-tubemq/tubemq-docker/tubemq-all/pom.xml
#	inlong-tubemq/tubemq-docker/tubemq-build/pom.xml
#	inlong-tubemq/tubemq-docker/tubemq-cpp/pom.xml
#	inlong-tubemq/tubemq-docker/tubemq-manager/pom.xml
#	inlong-tubemq/tubemq-example/pom.xml
#	inlong-tubemq/tubemq-manager/pom.xml
#	inlong-tubemq/tubemq-server/pom.xml
#	pom.xml
@iamsee123
[INLONG-5722] add redis agent plugin
6f7f9c3
@iamsee123
[INLONG-5722] adjust codeStyle
2a95901
@iamsee123
[INLONG-5722] add license and fix checkstyle problems
7e77185
@iamsee123 iamsee123 changed the title [Inlong-5722][Agent]Support Redis Source [Inlong-5722][Agent] Support Redis Source Sep 5, 2022
@iamsee123 iamsee123 marked this pull request as draft September 5, 2022 06:58
@iamsee123 iamsee123 closed this Sep 5, 2022
@iamsee123 iamsee123 deleted the INLONG-5722 branch September 5, 2022 07:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
component/agent component/sdk
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Feature][Agent] Support Redis Source
9 participants
@iamsee123 @pocozh @yunqingmoswu @healchow @EMsnap @woofyzhao @leezng @lucaspeng12138 @GanfengTan