🐛 Source Kafka - Add missing record_count increment for JSON (#18648)

* add missing record_count increment * bump version * Update kafka.md * update version * auto-bump connector version Co-authored-by: Vincent Koc <vincentkoc@ieee.org> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> Co-authored-by: Sajarin <sajarindider@gmail.com>
airbytehq · Nov 7, 2022 · 3365660 · 3365660
1 parent d815fb9
commit 3365660
Show file tree

Hide file tree

Showing 5 changed files with 6 additions and 3 deletions.
diff --git a/airbyte-config/init/src/main/resources/seed/source_definitions.yaml b/airbyte-config/init/src/main/resources/seed/source_definitions.yaml
@@ -635,7 +635,7 @@
 - name: Kafka
   sourceDefinitionId: d917a47b-8537-4d0d-8c10-36a9928d4265
   dockerRepository: airbyte/source-kafka
-  dockerImageTag: 0.2.0
+  dockerImageTag: 0.2.2
   documentationUrl: https://docs.airbyte.com/integrations/sources/kafka
   icon: kafka.svg
   sourceType: database

diff --git a/airbyte-config/init/src/main/resources/seed/source_specs.yaml b/airbyte-config/init/src/main/resources/seed/source_specs.yaml
@@ -5806,7 +5806,7 @@
     supportsNormalization: false
     supportsDBT: false
     supported_destination_sync_modes: []
-- dockerImage: "airbyte/source-kafka:0.2.0"
+- dockerImage: "airbyte/source-kafka:0.2.2"
   spec:
     documentationUrl: "https://docs.airbyte.com/integrations/sources/kafka"
     connectionSpecification:

diff --git a/airbyte-integrations/connectors/source-kafka/Dockerfile b/airbyte-integrations/connectors/source-kafka/Dockerfile
@@ -16,5 +16,5 @@ ENV APPLICATION source-kafka
 
 COPY --from=build /airbyte /airbyte
 
-LABEL io.airbyte.version=0.2.0
+LABEL io.airbyte.version=0.2.2
 LABEL io.airbyte.name=airbyte/source-kafka
diff --git a/...rs/source-kafka/src/main/java/io/airbyte/integrations/source/kafka/format/JsonFormat.java b/...rs/source-kafka/src/main/java/io/airbyte/integrations/source/kafka/format/JsonFormat.java
@@ -127,6 +127,7 @@ public AutoCloseableIterator<AirbyteMessage> read() {
       }
 
       consumerRecords.forEach(record -> {
+        record_count.getAndIncrement();
         recordsList.add(record);
       });
       consumer.commitAsync();

diff --git a/docs/integrations/sources/kafka.md b/docs/integrations/sources/kafka.md
@@ -50,6 +50,8 @@ The Kafka source connector supports the following [sync modes](https://docs.airb
 
 | Version | Date       | Pull Request                                           | Subject                                   |
 | :------ | :--------  | :------------------------------------------------------| :---------------------------------------- |
+| 0.2.2 | 2022-11-04 | [18648](https://github.com/airbytehq/airbyte/pull/18648) | Add missing record_count increment for JSON|
+| 0.2.1 | 2022-11-04 | This version was the same as 0.2.0 and was committed so using 0.2.2 next to keep versions in order|
 | 0.2.0 | 2022-08-22 | [13864](https://github.com/airbytehq/airbyte/pull/13864) | Added AVRO format support and Support for maximum records to process|
 | 0.1.7 | 2022-06-17 | [13864](https://github.com/airbytehq/airbyte/pull/13864) | Updated stacktrace format for any trace message errors |
 | 0.1.6   | 2022-05-29 | [12903](https://github.com/airbytehq/airbyte/pull/12903) | Add Polling Time to Specification (default 100 ms) |