New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka Consumer Step Question #18

Closed
cbrathwaite opened this Issue Nov 15, 2016 · 3 comments

Comments

Projects
None yet
2 participants
@cbrathwaite

cbrathwaite commented Nov 15, 2016

When I open the Kafka Consumer step and try to add a parameter, the changes do not persist after I close the step. This is on PDI 7, with the latest version of the steps. Is this by design? If not, is this a bug? I noticed the same issue with the Kafka Producer Step.

@spektom

This comment has been minimized.

Show comment
Hide comment
@spektom

spektom Nov 16, 2016

Member

Can you see any exceptions in the log file?
On Wed, Nov 16, 2016 at 00:38 Chantel Brathwaite notifications@github.com
wrote:

When I open either the Kafka Consumer or Producer steps and try to add a
parameter, the changes do not persist after I close the step. This is on
PDI 7, with the latest version of the steps. Is this by design? If not, is
this a bug?


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#18,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAJpO0NBzO90U7qyN2ZRp79s-VUkTUf8ks5q-jRrgaJpZM4KzHJt
.

Member

spektom commented Nov 16, 2016

Can you see any exceptions in the log file?
On Wed, Nov 16, 2016 at 00:38 Chantel Brathwaite notifications@github.com
wrote:

When I open either the Kafka Consumer or Producer steps and try to add a
parameter, the changes do not persist after I close the step. This is on
PDI 7, with the latest version of the steps. Is this by design? If not, is
this a bug?


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#18,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAJpO0NBzO90U7qyN2ZRp79s-VUkTUf8ks5q-jRrgaJpZM4KzHJt
.

@cbrathwaite

This comment has been minimized.

Show comment
Hide comment
@cbrathwaite

cbrathwaite Nov 16, 2016

Hi!
Thanks for your response. The log looks pretty clean aside from non-kafka related errors and warnings. I'm including the log file at the end of this message so you have context. In this log, I had a transformation open that contained the Kafka Consumer step; I tried to add a new parameter and also to delete one. The changes did not persist when I closed the step and opened it again.

I reinstalled the marketplace plugin using the GUI. I did see a ConcurrentModification exception there, and it seemed to occur when I installed the plugin from the marketplace, but I've not yet had a chance to replicate. I will work on that and will report back.

I have a video that shows the error if you need it. I can upload it if you are interested, please let me know. Here are the replication steps:

  1. Start Spoon.
  2. Open a transformation.
  3. Add the Kafka Consumer step.
  4. Open the step and add a new parameter.
  5. Click OK to close the step.
  6. Reopen the step. Note that the new parameter does not appear.
  7. Delete a parameter.
  8. Click OK to close the step.
  9. Reopen the step. Note that the deleted parameter reappears.
  10. Edit one of the existing values.
  11. Close the step.
  12. Reopen the step. Note that the edited value persists.

So, it seems that the user cannot update the parameter. My main question for you is whether this behavior is by design or not. The Kafka Producer step shows the same behavior.

Here are the logs:


CLEAN LOG

C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration>"C:\Pentaho\Pentaho_70Wiz_GA\java\bin\java.exe" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" "-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=admin" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" -jar launcher\pentaho-application-launcher-7.0.0.0-25.jar -lib ..\libswt\win64 /level:Debug
09:05:47,530 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled
09:05:50,711 INFO [KarafInstance]


*** Karaf Instance Number: 2 at C:\Pentaho\Pentaho_70Wiz_GA\design-tools\da ***
*** ta-integration.\system\karaf\caches\spoon\data-1 ***
*** Karaf Port:8803 ***
*** OSGI Service Port:9052 ***


Nov 16, 2016 9:05:55 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2016/11/16 09:06:00 - General - Logging plugin type found with ID: CheckpointLogTable
2016/11/16 09:06:01 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
2016-11-16 09:06:04 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
2016-11-16 09:06:06 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2016-11-16 09:06:06 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2016-11-16 09:06:06 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
2016-11-16 09:06:09.904:INFO:oejs.Server:jetty-8.1.15.v20140411
2016-11-16 09:06:10.792:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9052
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (180) [org.apache.cxf.management.InstrumentationManager]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (183) [org.apache.cxf.wsdl.WSDLManager]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (185) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (186) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (187) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (204) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (189) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (200) [org.apache.cxf.transport.local.LocalTransportFactory]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (201) [org.apache.cxf.binding.object.ObjectBindingFactory]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig#
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-securitypolicy/200702
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (221) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (223) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (225) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (226) [org.apache.cxf.javascript.JavascriptServerListener]
Nov 16, 2016 9:06:23 AM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess
INFO: New Caching Service registered
2016-11-16 09:06:30 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
2016-11-16 09:06:33 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2016-11-16 09:06:33 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2016-11-16 09:06:33 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
2016-11-16 09:06:40 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/C:/Pentaho/Pentaho_70Wiz_GA/design-tools/data-integration/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/C:/Pentaho/Pentaho_70Wiz_GA/design-tools/data-integration/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2016-11-16 09:06:44 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2016-11-16 09:06:44 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2016-11-16 09:06:44 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
Nov 16, 2016 9:06:48 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /lineage
Nov 16, 2016 9:06:50 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /i18n
Nov 16, 2016 9:06:53 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /marketplace
2016/11/16 09:06:56 - RepositoriesMeta - Reading repositories XML file: C:\Users\Administrator.kettle\repositories.xml
2016/11/16 09:06:57 - Spoon - Logging is at level : Debug
2016/11/16 09:07:04 - RepositoriesMeta - Reading repositories XML file: C:\Users\Administrator.kettle\repositories.xml
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/core/data
Graphics2D from BufferedImage lacks BUFFERED_IMAGE hint
Graphics2D from BufferedImage lacks BUFFERED_IMAGE hint
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/pdi/navigation
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/pdi/repository
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/pdi/publish
Attempting to load ESAPI.properties via file I/O.
Attempting to load ESAPI.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration\ESAPI.properties
Not found in SystemResource Directory/resourceDirectory: .esapi\ESAPI.properties
Not found in 'user.home' (C:\Users\Administrator) directory: C:\Users\Administrator\esapi\ESAPI.properties
Loading ESAPI.properties via file I/O failed. Exception was: java.io.FileNotFoundException
Attempting to load ESAPI.properties via the classpath.
SUCCESSFULLY LOADED ESAPI.properties via the CLASSPATH from '/ (root)' using current thread context class loader!
SecurityConfiguration for Validator.ConfigurationFile not found in ESAPI.properties. Using default: validation.properties
Attempting to load validation.properties via file I/O.
Attempting to load validation.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration\validation.properties
Not found in SystemResource Directory/resourceDirectory: .esapi\validation.properties
Not found in 'user.home' (C:\Users\Administrator) directory: C:\Users\Administrator\esapi\validation.properties
Loading validation.properties via file I/O failed.
Attempting to load validation.properties via the classpath.
validation.properties could not be loaded by any means. fail. Exception was: java.lang.IllegalArgumentException: Failed to load ESAPI.properties as a classloader resource.
SecurityConfiguration for Logger.LogServerIP not either "true" or "false" in ESAPI.properties. Using default: true
2016/11/16 09:08:37 - Spoon - Spoon has ended.
stopping
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0


CONCURRENT MODIFICATION ISSUE

Please note that I am working on replicating this to verify whether this is directly related to the two Kafka plugins. I will report back as soon as I have more information.

INFO: Setting the server's publish address to be /det/pdi/publish
2016/11/16 08:51:25 - General - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : Error initializing transformation
2016/11/16 08:51:25 - General - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : java.util.ConcurrentModificationException
2016/11/16 08:51:25 - General - at java.util.ArrayList$Itr.checkForComodification(Unknown Source)
2016/11/16 08:51:25 - General - at java.util.ArrayList$Itr.next(Unknown Source)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.SpoonPluginManager.applyPluginsForContainer(SpoonPluginManager.java:130)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.init(Spoon.java:870)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.createContents(Spoon.java:9256)
2016/11/16 08:51:25 - General - at org.eclipse.jface.window.Window.create(Window.java:426)
2016/11/16 08:51:25 - General - at org.eclipse.jface.window.Window.open(Window.java:785)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9287)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685)
2016/11/16 08:51:25 - General - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016/11/16 08:51:25 - General - at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
2016/11/16 08:51:25 - General - at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
2016/11/16 08:51:25 - General - at java.lang.reflect.Method.invoke(Unknown Source)
2016/11/16 08:51:25 - General - at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
2016/11/16 08:51:49 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
08:53:50,468 ERROR [AbstractXulDomContainer] Error invoking method: spoon.newTransFile()
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106)
at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1359)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7990)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9290)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.lang.NullPointerException
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.unloadPerspective(SpoonPerspectiveManager.java:265)
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.activatePerspective(SpoonPerspectiveManager.java:298)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1029)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1021)
at org.pentaho.di.ui.spoon.Spoon.newTransFile(Spoon.java:4760)
... 27 more
08:53:50,480 ERROR [AbstractXulComponent] Error calling oncommand event
org.pentaho.ui.xul.XulException: Error invoking method: spoon.newTransFile()
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:317)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106)
at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1359)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7990)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9290)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)
... 22 more
Caused by: java.lang.NullPointerException
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.unloadPerspective(SpoonPerspectiveManager.java:265)
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.activatePerspective(SpoonPerspectiveManager.java:298)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1029)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1021)
at org.pentaho.di.ui.spoon.Spoon.newTransFile(Spoon.java:4760)
... 27 more
2016/11/16 08:54:05 - Spoon - Spoon has ended.

cbrathwaite commented Nov 16, 2016

Hi!
Thanks for your response. The log looks pretty clean aside from non-kafka related errors and warnings. I'm including the log file at the end of this message so you have context. In this log, I had a transformation open that contained the Kafka Consumer step; I tried to add a new parameter and also to delete one. The changes did not persist when I closed the step and opened it again.

I reinstalled the marketplace plugin using the GUI. I did see a ConcurrentModification exception there, and it seemed to occur when I installed the plugin from the marketplace, but I've not yet had a chance to replicate. I will work on that and will report back.

I have a video that shows the error if you need it. I can upload it if you are interested, please let me know. Here are the replication steps:

  1. Start Spoon.
  2. Open a transformation.
  3. Add the Kafka Consumer step.
  4. Open the step and add a new parameter.
  5. Click OK to close the step.
  6. Reopen the step. Note that the new parameter does not appear.
  7. Delete a parameter.
  8. Click OK to close the step.
  9. Reopen the step. Note that the deleted parameter reappears.
  10. Edit one of the existing values.
  11. Close the step.
  12. Reopen the step. Note that the edited value persists.

So, it seems that the user cannot update the parameter. My main question for you is whether this behavior is by design or not. The Kafka Producer step shows the same behavior.

Here are the logs:


CLEAN LOG

C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration>"C:\Pentaho\Pentaho_70Wiz_GA\java\bin\java.exe" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" "-Xms1024m" "-Xmx2048m" "-XX:MaxPermSize=256m" "-Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2" "-Djava.library.path=libswt\win64" "-DKETTLE_HOME=" "-DKETTLE_REPOSITORY=" "-DKETTLE_USER=admin" "-DKETTLE_PASSWORD=" "-DKETTLE_PLUGIN_PACKAGES=" "-DKETTLE_LOG_SIZE_LIMIT=" "-DKETTLE_JNDI_ROOT=" "-Dpentaho.installed.licenses.file=C:\Pentaho\Pentaho_70Wiz_GA.installedLicenses.xml" -jar launcher\pentaho-application-launcher-7.0.0.0-25.jar -lib ..\libswt\win64 /level:Debug
09:05:47,530 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled
09:05:50,711 INFO [KarafInstance]


*** Karaf Instance Number: 2 at C:\Pentaho\Pentaho_70Wiz_GA\design-tools\da ***
*** ta-integration.\system\karaf\caches\spoon\data-1 ***
*** Karaf Port:8803 ***
*** OSGI Service Port:9052 ***


Nov 16, 2016 9:05:55 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2016/11/16 09:06:00 - General - Logging plugin type found with ID: CheckpointLogTable
2016/11/16 09:06:01 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
2016-11-16 09:06:04 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
2016-11-16 09:06:06 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2016-11-16 09:06:06 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2016-11-16 09:06:06 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
2016-11-16 09:06:09.904:INFO:oejs.Server:jetty-8.1.15.v20140411
2016-11-16 09:06:10.792:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9052
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing
Nov 16, 2016 9:06:18 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (180) [org.apache.cxf.management.InstrumentationManager]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (183) [org.apache.cxf.wsdl.WSDLManager]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (185) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (186) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (187) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (204) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (189) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver]
Nov 16, 2016 9:06:19 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (200) [org.apache.cxf.transport.local.LocalTransportFactory]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (201) [org.apache.cxf.binding.object.ObjectBindingFactory]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig#
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-securitypolicy/200702
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (221) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (223) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (225) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader]
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy
Nov 16, 2016 9:06:20 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (226) [org.apache.cxf.javascript.JavascriptServerListener]
Nov 16, 2016 9:06:23 AM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess
INFO: New Caching Service registered
2016-11-16 09:06:30 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
2016-11-16 09:06:33 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2016-11-16 09:06:33 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2016-11-16 09:06:33 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
2016-11-16 09:06:40 weka.gui.GenericObjectEditor registerEditors
INFO: ---Registering Weka Editors---
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/C:/Pentaho/Pentaho_70Wiz_GA/design-tools/data-integration/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/C:/Pentaho/Pentaho_70Wiz_GA/design-tools/data-integration/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2016-11-16 09:06:44 weka.experiment.DatabaseUtils initialize
WARNING: Trying to add database driver (JDBC): jdbc.idbDriver - Warning, not in CLASSPATH?
2016-11-16 09:06:44 weka.gui.beans.BeansProperties loadProperties
INFO: [KnowledgeFlow] Loading properties and plugins...
2016-11-16 09:06:44 weka.gui.beans.KnowledgeFlowApp init
INFO: [KnowledgeFlow] Initializing KF...
Nov 16, 2016 9:06:48 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /lineage
Nov 16, 2016 9:06:50 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /i18n
Nov 16, 2016 9:06:53 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /marketplace
2016/11/16 09:06:56 - RepositoriesMeta - Reading repositories XML file: C:\Users\Administrator.kettle\repositories.xml
2016/11/16 09:06:57 - Spoon - Logging is at level : Debug
2016/11/16 09:07:04 - RepositoriesMeta - Reading repositories XML file: C:\Users\Administrator.kettle\repositories.xml
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/core/data
Graphics2D from BufferedImage lacks BUFFERED_IMAGE hint
Graphics2D from BufferedImage lacks BUFFERED_IMAGE hint
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/pdi/navigation
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/pdi/repository
Nov 16, 2016 9:07:05 AM org.apache.cxf.endpoint.ServerImpl initDestination
INFO: Setting the server's publish address to be /det/pdi/publish
Attempting to load ESAPI.properties via file I/O.
Attempting to load ESAPI.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration\ESAPI.properties
Not found in SystemResource Directory/resourceDirectory: .esapi\ESAPI.properties
Not found in 'user.home' (C:\Users\Administrator) directory: C:\Users\Administrator\esapi\ESAPI.properties
Loading ESAPI.properties via file I/O failed. Exception was: java.io.FileNotFoundException
Attempting to load ESAPI.properties via the classpath.
SUCCESSFULLY LOADED ESAPI.properties via the CLASSPATH from '/ (root)' using current thread context class loader!
SecurityConfiguration for Validator.ConfigurationFile not found in ESAPI.properties. Using default: validation.properties
Attempting to load validation.properties via file I/O.
Attempting to load validation.properties as resource file via file I/O.
Not found in 'org.owasp.esapi.resources' directory or file not readable: C:\Pentaho\Pentaho_70Wiz_GA\design-tools\data-integration\validation.properties
Not found in SystemResource Directory/resourceDirectory: .esapi\validation.properties
Not found in 'user.home' (C:\Users\Administrator) directory: C:\Users\Administrator\esapi\validation.properties
Loading validation.properties via file I/O failed.
Attempting to load validation.properties via the classpath.
validation.properties could not be loaded by any means. fail. Exception was: java.lang.IllegalArgumentException: Failed to load ESAPI.properties as a classloader resource.
SecurityConfiguration for Logger.LogServerIP not either "true" or "false" in ESAPI.properties. Using default: true
2016/11/16 09:08:37 - Spoon - Spoon has ended.
stopping
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0


CONCURRENT MODIFICATION ISSUE

Please note that I am working on replicating this to verify whether this is directly related to the two Kafka plugins. I will report back as soon as I have more information.

INFO: Setting the server's publish address to be /det/pdi/publish
2016/11/16 08:51:25 - General - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : Error initializing transformation
2016/11/16 08:51:25 - General - ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : java.util.ConcurrentModificationException
2016/11/16 08:51:25 - General - at java.util.ArrayList$Itr.checkForComodification(Unknown Source)
2016/11/16 08:51:25 - General - at java.util.ArrayList$Itr.next(Unknown Source)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.SpoonPluginManager.applyPluginsForContainer(SpoonPluginManager.java:130)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.init(Spoon.java:870)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.createContents(Spoon.java:9256)
2016/11/16 08:51:25 - General - at org.eclipse.jface.window.Window.create(Window.java:426)
2016/11/16 08:51:25 - General - at org.eclipse.jface.window.Window.open(Window.java:785)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9287)
2016/11/16 08:51:25 - General - at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685)
2016/11/16 08:51:25 - General - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016/11/16 08:51:25 - General - at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
2016/11/16 08:51:25 - General - at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
2016/11/16 08:51:25 - General - at java.lang.reflect.Method.invoke(Unknown Source)
2016/11/16 08:51:25 - General - at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
2016/11/16 08:51:49 - cfgbuilder - Warning: The configuration parameter [org] is not supported by the default configuration builder for scheme: sftp
08:53:50,468 ERROR [AbstractXulDomContainer] Error invoking method: spoon.newTransFile()
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106)
at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1359)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7990)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9290)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.lang.NullPointerException
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.unloadPerspective(SpoonPerspectiveManager.java:265)
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.activatePerspective(SpoonPerspectiveManager.java:298)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1029)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1021)
at org.pentaho.di.ui.spoon.Spoon.newTransFile(Spoon.java:4760)
... 27 more
08:53:50,480 ERROR [AbstractXulComponent] Error calling oncommand event
org.pentaho.ui.xul.XulException: Error invoking method: spoon.newTransFile()
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:317)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)
at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43)
at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106)
at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)
at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)
at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)
at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)
at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)
at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)
at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1359)
at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7990)
at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9290)
at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:685)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)
... 22 more
Caused by: java.lang.NullPointerException
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.unloadPerspective(SpoonPerspectiveManager.java:265)
at org.pentaho.di.ui.spoon.SpoonPerspectiveManager.activatePerspective(SpoonPerspectiveManager.java:298)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1029)
at org.pentaho.di.ui.spoon.Spoon.loadPerspective(Spoon.java:1021)
at org.pentaho.di.ui.spoon.Spoon.newTransFile(Spoon.java:4760)
... 27 more
2016/11/16 08:54:05 - Spoon - Spoon has ended.

@cbrathwaite cbrathwaite changed the title from Kafka Consumer and Producer Question to Kafka Consumer Step Question Nov 16, 2016

@cbrathwaite

This comment has been minimized.

Show comment
Hide comment
@cbrathwaite

cbrathwaite Nov 16, 2016

NOTE: I made a quick change to the title since my questions focus on the Kafka Consumer step. (The replication path does as well.) But this same behavior seems to be in the Kafka Producer step as well.

Also, the concurrent modification issue was not related to your plugin. Please disregard that error message.

Finally, the video that shows how this was set up, etc. is here: https://github.com/cbrathwaite/cbrathwaite.

Thanks!

Chantel

cbrathwaite commented Nov 16, 2016

NOTE: I made a quick change to the title since my questions focus on the Kafka Consumer step. (The replication path does as well.) But this same behavior seems to be in the Kafka Producer step as well.

Also, the concurrent modification issue was not related to your plugin. Please disregard that error message.

Finally, the video that shows how this was set up, etc. is here: https://github.com/cbrathwaite/cbrathwaite.

Thanks!

Chantel

@spektom spektom closed this in 97aeb26 Jan 5, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment