{"action":"created","issue":{"url":"https://api.github.com/repos/HiromuHota/pentaho-kettle/issues/110","repository_url":"https://api.github.com/repos/HiromuHota/pentaho-kettle","labels_url":"https://api.github.com/repos/HiromuHota/pentaho-kettle/issues/110/labels{/name}","comments_url":"https://api.github.com/repos/HiromuHota/pentaho-kettle/issues/110/comments","events_url":"https://api.github.com/repos/HiromuHota/pentaho-kettle/issues/110/events","html_url":"https://github.com/HiromuHota/pentaho-kettle/issues/110","id":348313266,"node_id":"MDU6SXNzdWUzNDgzMTMyNjY=","number":110,"title":"Kafka Consumer not working on multiple sessions","user":{"login":"cdel2","id":32610165,"node_id":"MDQ6VXNlcjMyNjEwMTY1","avatar_url":"https://avatars0.githubusercontent.com/u/32610165?v=4","gravatar_id":"","url":"https://api.github.com/users/cdel2","html_url":"https://github.com/cdel2","followers_url":"https://api.github.com/users/cdel2/followers","following_url":"https://api.github.com/users/cdel2/following{/other_user}","gists_url":"https://api.github.com/users/cdel2/gists{/gist_id}","starred_url":"https://api.github.com/users/cdel2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cdel2/subscriptions","organizations_url":"https://api.github.com/users/cdel2/orgs","repos_url":"https://api.github.com/users/cdel2/repos","events_url":"https://api.github.com/users/cdel2/events{/privacy}","received_events_url":"https://api.github.com/users/cdel2/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-07T13:07:38Z","updated_at":"2018-08-08T23:56:18Z","closed_at":null,"author_association":"NONE","body":"The error comes when I try to get records from stream in PDI with Kafka Consumer while different users are accessing the webspoon instance. \r\n\r\n## Expected Behavior\r\nKafka Consumer step consumes Kafka topic properly and the Get Records from Stream step in the \"T_STREAM_JOB_GENERAL\" transformation fetches the messages from the topic consumed.\r\n\r\n## Actual Behavior\r\n07-Aug-2018 12:48:05.509 WARNING [RxCachedThreadScheduler-1] org.pentaho.osgi.kettle.repository.locator.impl.spoon.SpoonRepositoryProvider.getRepository Invalid thread access\r\n2018/08/07 12:48:05 - T_STREAM_JOB_GENERAL - Dispatching started for transformation [T_STREAM_JOB_GENERAL]\r\n2018/08/07 12:48:05 - Get records from stream.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)\r\n2018/08/07 12:48:05 - JSON Input.0 - Finished processing (I=1, O=0, R=1, W=1, U=0, E=0)\r\n2018/08/07 12:48:05 - Text file output.0 - Finished processing (I=0, O=1, R=1, W=1, U=0, E=0)\r\n07-Aug-2018 12:48:05.598 WARNING [T_STREAM_JOB_GENERAL - Text file output] org.pentaho.osgi.kettle.repository.locator.impl.spoon.SpoonRepositoryProvider.getRepository Invalid thread access\r\n\r\n## Steps to Reproduce the Problem\r\n  1. Create a Kafka Consumer step in webspoon\r\n  2. Create a Get Records from Stream step in another transformation\r\n  3. Use the webspoon instance on different machines\r\n\r\n## Specifications\r\n\r\n### Server\r\n  - webSpoon(latest)\r\n  - Docker(latest)\r\n  - Kafka Consumer uses a direct connection to Kafka bootstrap server.\r\n\r\n### Client"},"comment":{"url":"https://api.github.com/repos/HiromuHota/pentaho-kettle/issues/comments/411591653","html_url":"https://github.com/HiromuHota/pentaho-kettle/issues/110#issuecomment-411591653","issue_url":"https://api.github.com/repos/HiromuHota/pentaho-kettle/issues/110","id":411591653,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMTU5MTY1Mw==","user":{"login":"HiromuHota","id":20668349,"node_id":"MDQ6VXNlcjIwNjY4MzQ5","avatar_url":"https://avatars1.githubusercontent.com/u/20668349?v=4","gravatar_id":"","url":"https://api.github.com/users/HiromuHota","html_url":"https://github.com/HiromuHota","followers_url":"https://api.github.com/users/HiromuHota/followers","following_url":"https://api.github.com/users/HiromuHota/following{/other_user}","gists_url":"https://api.github.com/users/HiromuHota/gists{/gist_id}","starred_url":"https://api.github.com/users/HiromuHota/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/HiromuHota/subscriptions","organizations_url":"https://api.github.com/users/HiromuHota/orgs","repos_url":"https://api.github.com/users/HiromuHota/repos","events_url":"https://api.github.com/users/HiromuHota/events{/privacy}","received_events_url":"https://api.github.com/users/HiromuHota/received_events","type":"User","site_admin":false},"created_at":"2018-08-08T23:56:18Z","updated_at":"2018-08-08T23:56:18Z","author_association":"OWNER","body":"Thanks for reporting this issue. I was able to reproduce it.\r\nMy observations are:\r\n1. Kafka Consumer only works on one user session (more precisely on one running Transformation) at a time.\r\n1. Kafka Consumer in the Transformation that starts most earliest among others only works. In other words, the first one takes and exclusively uses it. If the first one finishes, the second one can take it.\r\n\r\nMy hunch is that there is a singleton around Kafka consumer (and producer too) that can be used by one Transformation at a time.\r\nPlease bear with it until it is fixed."}}
{"actor":{"display_login":"HiromuHota"}}