Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Kafka Consumer Step Question #18
When I open the Kafka Consumer step and try to add a parameter, the changes do not persist after I close the step. This is on PDI 7, with the latest version of the steps. Is this by design? If not, is this a bug? I noticed the same issue with the Kafka Producer Step.
Can you see any exceptions in the log file?
I reinstalled the marketplace plugin using the GUI. I did see a ConcurrentModification exception there, and it seemed to occur when I installed the plugin from the marketplace, but I've not yet had a chance to replicate. I will work on that and will report back.
I have a video that shows the error if you need it. I can upload it if you are interested, please let me know. Here are the replication steps:
So, it seems that the user cannot update the parameter. My main question for you is whether this behavior is by design or not. The Kafka Producer step shows the same behavior.
Here are the logs:
C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration>"C:\Pentaho\Pentaho_70Wiz_GA\java\bin\java.exe" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" "-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=admin" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" -jar launcher\pentaho-application-launcher-126.96.36.199-25.jar -lib ..\libswt\win64 /level:Debug
*** Karaf Instance Number: 2 at C:\Pentaho\Pentaho_70Wiz_GA\design-tools\da ***
Nov 16, 2016 9:05:55 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired
CONCURRENT MODIFICATION ISSUE
Please note that I am working on replicating this to verify whether this is directly related to the two Kafka plugins. I will report back as soon as I have more information.
INFO: Setting the server's publish address to be /det/pdi/publish
NOTE: I made a quick change to the title since my questions focus on the Kafka Consumer step. (The replication path does as well.) But this same behavior seems to be in the Kafka Producer step as well.
Also, the concurrent modification issue was not related to your plugin. Please disregard that error message.
Finally, the video that shows how this was set up, etc. is here: https://github.com/cbrathwaite/cbrathwaite.