Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
storm-kafka-client 1.1.1 lag still is 1 #2388
when i use storm-kafka-client kafkaspout to consume message,
* expose option to register IEventLogger similar to metrics consumer * change the interface of IEventLogger slightly * allow argument * the change is technically not backward compatible but in real we can treat it's OK * cause we don't provide a chance to implement custom IEventLogger and plug to topology * Fix EventInfo to contain origin type of values instead of String-converted values * open possibility to extend FileBasedEventLogger and provide different format of log message * document the change * address review comments
…pervisor.launchDaemon() accessible This commit fixes the storm-mesos integration for the interaction between the Storm core's Supervisor daemon and the MesosSupervisor that implements the ISupervisor interface.
Make TridentKafkaState a template class to eliminate warning messages in eclipse, and a minor optimization that use StringBuilder.append instead of string concat operation.
…to Kafka When First Poll Strategy Set to EARLIEST - Check if commits to Kafka were committed by this topology to correctly enforce FirstPollOffsetStrategy - Cache if OffsetManager has committed to avoid JSON deserialization for every tuple and speedup lookups - CommitMetadata includes topology id, and task id and threadName - Update FirstPollOffsetStrategy javadoc - Refactor and add unit tests
* extract local variable 'scheduler' to one of fields * gracefully shutdown the scheduler * address review comments * wait once, and call shutdownNow, don't wait afterwards * set daemon to true
…arious issues including ZOOKEEPER-2184 that prevents ZooKeeper Java clients working in dynamic IP (container / cloud) environment.