Skip to content
This repository has been archived by the owner on May 12, 2021. It is now read-only.

TAJO-1480: Kafka Consumer for kafka strage. #1041

Closed
wants to merge 12 commits into from

Conversation

combineads
Copy link
Contributor

@combineads combineads commented Jul 27, 2016

Scanner of kafka storage needs to implement a Kafka Consumer for to fetch data from kafka.
The Kafka Consumer have methods like this,

  • getPartitions(): Get partition id list from specific topic.
  • poll(): Fetch data from kafka.
  • getEarliestOffset(): Get earliest offset from specific partition.
  • getLatestOffset(): Get latest offset from specific partition.
  • etc..

static final String TEST_JSON_DATA = "{\"col1\":1, \"col2\":\"abc\", \"col3\":0.2}";
static final int DEFAULT_TEST_PARTITION_NUM = 3;

static void sendTestData(Producer<String, String> producer, String topic) throws Exception {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This class name is constants but you defined method in the class.

@jinossy
Copy link
Member

jinossy commented Aug 17, 2016

Thanks you for your contribution! I left trivial comment

@@ -0,0 +1,195 @@
<?xml version="1.0" encoding="UTF-8"?>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You should add tajo-storage-kafk module to tajo-storage and add module copy-script in prepare-package

Cause TestConstants class has the methods even Constants class.
@combineads combineads force-pushed the TAJO-1480 branch 2 times, most recently from 221e084 to 6b0ea6a Compare August 28, 2016 02:42
@combineads
Copy link
Contributor Author

@jinossy Thanks for your reviews. I modified sources.
Please, check again.
Thanks.

@jinossy
Copy link
Member

jinossy commented Aug 28, 2016

+1 Looks great to me!
Thank you for contribution!

@asfgit asfgit closed this in d5ffbe6 Aug 28, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
2 participants