{"action":"created","issue":{"url":"https://api.github.com/repos/LigaData/Kamanja/issues/1080","repository_url":"https://api.github.com/repos/LigaData/Kamanja","labels_url":"https://api.github.com/repos/LigaData/Kamanja/issues/1080/labels{/name}","comments_url":"https://api.github.com/repos/LigaData/Kamanja/issues/1080/comments","events_url":"https://api.github.com/repos/LigaData/Kamanja/issues/1080/events","html_url":"https://github.com/LigaData/Kamanja/issues/1080","id":152013885,"number":1080,"title":"Remove binding that produced results; add binding new ser format to different adapter same msg","user":{"login":"ligadata-rich","id":8701850,"avatar_url":"https://avatars.githubusercontent.com/u/8701850?v=3","gravatar_id":"","url":"https://api.github.com/users/ligadata-rich","html_url":"https://github.com/ligadata-rich","followers_url":"https://api.github.com/users/ligadata-rich/followers","following_url":"https://api.github.com/users/ligadata-rich/following{/other_user}","gists_url":"https://api.github.com/users/ligadata-rich/gists{/gist_id}","starred_url":"https://api.github.com/users/ligadata-rich/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ligadata-rich/subscriptions","organizations_url":"https://api.github.com/users/ligadata-rich/orgs","repos_url":"https://api.github.com/users/ligadata-rich/repos","events_url":"https://api.github.com/users/ligadata-rich/events{/privacy}","received_events_url":"https://api.github.com/users/ligadata-rich/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/LigaData/Kamanja/labels/Bug","name":"Bug","color":"fc2929"},{"url":"https://api.github.com/repos/LigaData/Kamanja/labels/P1","name":"P1","color":"eb6420"},{"url":"https://api.github.com/repos/LigaData/Kamanja/labels/Verify","name":"Verify","color":"009800"}],"state":"closed","locked":false,"assignee":{"login":"ligadata-rich","id":8701850,"avatar_url":"https://avatars.githubusercontent.com/u/8701850?v=3","gravatar_id":"","url":"https://api.github.com/users/ligadata-rich","html_url":"https://github.com/ligadata-rich","followers_url":"https://api.github.com/users/ligadata-rich/followers","following_url":"https://api.github.com/users/ligadata-rich/following{/other_user}","gists_url":"https://api.github.com/users/ligadata-rich/gists{/gist_id}","starred_url":"https://api.github.com/users/ligadata-rich/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ligadata-rich/subscriptions","organizations_url":"https://api.github.com/users/ligadata-rich/orgs","repos_url":"https://api.github.com/users/ligadata-rich/repos","events_url":"https://api.github.com/users/ligadata-rich/events{/privacy}","received_events_url":"https://api.github.com/users/ligadata-rich/received_events","type":"User","site_admin":false},"milestone":null,"comments":4,"created_at":"2016-04-30T06:40:56Z","updated_at":"2016-05-04T20:44:44Z","closed_at":"2016-05-04T20:44:44Z","body":"*Scenario:*\r\n\r\nAn output adapter message binding has been configured for csv on adapter \"TestOut_1\".  The customer has changed his mind, desiring json serialization. To fix, it is decided to use an unused adapter, \"TestOut_2\" with a new kafka topic \"testout_2\".\r\n\r\n*Problem:*\r\n\r\nThe initial configuration produces data in csv.  The change is made to json and bound to the unused adapter.  Nothing is produced on subsequent data pushes.\r\n\r\n**Steps to reproduce**\r\n\r\n1.  start zookeeper, kafka, hbase (or cassandra), set variables, and _build config files with cassandra references.  Change parameter the storeType value to hbase if desired._\r\n\r\nexport KAMANJA_HOME=/tmp/drdigital/Kamanja-1.4.0_2.11\r\nexport KAMANJA_SRCDIR=~/github/dev/1.4.0.Base/kamanja/trunk\r\nexport TestBin=$KAMANJA_SRCDIR/MetadataAPI/src/test/resources/bin\r\nexport MetadataDir=$KAMANJA_SRCDIR/MetadataAPI/src/test/resources/Metadata\r\nexport apiConfigProperties=$KAMANJA_HOME/config/MetadataAPIConfig.properties\r\n\r\n\r\n_Configure the cluster configuration json file with cassandra storage values... **NOTE: THE CURRENT ClusterConfig.json is overwritten**_\r\n\r\n    setPathsFor.scala --installDir $KAMANJA_HOME --templateFile $MetadataDir/templates/ClusterConfig.1.4.0_Template.json --scalaHome $SCALA_HOME --javaHome $JAVA_HOME --storeType cassandra --schemaName testdata --schemaLocation localhost > $KAMANJA_HOME/config/ClusterConfig.json\r\n\r\n_Configure the metadata api config file to use... cassandra in this case.  **NOTE: THE CURRENT MetadataAPIConfig.properties is overwritten**_\r\n\r\n    setPathsFor.scala --installDir $KAMANJA_HOME --templateFile $MetadataDir/templates/Cassandra_MetadataAPIConfig_Template.properties --scalaHome $SCALA_HOME --javaHome $JAVA_HOME --storeType cassandra --schemaName metadata --schemaLocation localhost > $KAMANJA_HOME/config/MetadataAPIConfig.properties\r\n\r\n_Configure the engine config file to use.  In this case, the cassandra values are used. **NOTE: THE CURRENT Engine1Config.properties is overwritten**_\r\n\r\n    setPathsFor.scala --installDir $KAMANJA_HOME --templateFile $MetadataDir/templates/Engine1Config_Template.properties --scalaHome $SCALA_HOME --javaHome $JAVA_HOME --storeType cassandra --schemaName metadata --schemaLocation localhost > $KAMANJA_HOME/config/Engine1Config.properties\r\n\r\n2. cluster config modifications\r\n  a. add new output adapter below to the generated cluster config from prior step :\r\n    \r\n    {\r\n      \"Name\": \"TestOut_2\",\r\n      \"TypeString\": \"Output\",\r\n      \"TenantId\": \"tenant1\",\r\n      \"ClassName\": \"com.ligadata.OutputAdapters.KafkaProducer$\",\r\n      \"JarName\": \"KamanjaInternalDeps_2.11-1.4.0.jar\",\r\n      \"DependencyJars\": [\r\n        \"ExtDependencyLibs_2.11-1.4.0.jar\",\r\n        \"ExtDependencyLibs2_2.11-1.4.0.jar\"\r\n      ],\r\n      \"AdapterSpecificCfg\": {\r\n        \"HostList\": \"localhost:9092\",\r\n        \"TopicName\": \"testout_2\"\r\n      }\r\n    }, \r\n\r\n\r\n  b. Set the NOTIFY_ENGINE=YES in $KAMANJA_HOME/config/MetadataAPIConfig.properties\r\n\r\n  c. initialize cluster configuration\r\n\r\n    $KAMANJA_HOME/bin/kamanja $apiConfigProperties upload cluster config $KAMANJA_HOME/config/ClusterConfig.json \r\n\r\n3. Start the engine in another console\r\n\r\n    $KAMANJA_HOME/bin/kamanja start -v\r\n\r\n4. Check kamanja manger, kafka, zk, and db are running\r\n\r\n    jps\r\n\r\n5. Install standard Helloworld metadata\r\n\r\n    $KAMANJA_HOME/input/SampleApplications/bin/HelloWorldApp.sh\r\n    \r\n6. List the adapter message configurations if desired\r\n\r\n    $KAMANJA_HOME/bin/kamanja $apiConfigProperties list adaptermessagebindings\r\n\r\n7. Start the WatchOutputQueue in another console window.\r\n\r\n    $KAMANJA_HOME/bin/WatchOutputQueue.sh\r\n\r\n8. Push the hello world data\r\n\r\n    $KAMANJA_HOME/input/SampleApplications/bin/PushSampleDataToKafka_HelloWorld.sh \r\n\r\n    Expectation: data in the WatchOutputQueue window (2 lines)\r\n\r\n    This data was processed by testout_1 adapter.\r\n\r\n9. Remove the old binding for outmsg1 on testout_1\r\n\r\n    $KAMANJA_HOME/bin/kamanja $apiConfigProperties remove adaptermessagebinding KEY \"testout_1,com.ligadata.kamanja.samples.messages.outmsg1,com.ligadata.kamanja.serializer.csvserdeser\"\r\n\r\n10. Create a new binding for \"outmsg1\" on the second (_unused_) adapter, \"TestOut_2\"  that was added in step 1 above.  This time generate json.\r\n\r\n    $KAMANJA_HOME/bin/kamanja $apiConfigProperties add adaptermessagebinding FROMSTRING ' { \"AdapterName\": \"TestOut_2\", \"MessageNames\": [ \"com.ligadata.kamanja.samples.messages.outmsg1\" ], \"Serializer\": \"com.ligadata.kamanja.serializer.JsonSerDeser\" }'\r\n\r\n11. Push the hello world data again.\r\n\r\n    $KAMANJA_HOME/input/SampleApplications/bin/PushSampleDataToKafka_HelloWorld.sh \r\n\r\n    Expectation: data in the WatchOutputQueue window (2 lines) formatted in json\r\n\r\n    Actual: No data \r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/LigaData/Kamanja/issues/comments/216997134","html_url":"https://github.com/LigaData/Kamanja/issues/1080#issuecomment-216997134","issue_url":"https://api.github.com/repos/LigaData/Kamanja/issues/1080","id":216997134,"user":{"login":"ligadata-rich","id":8701850,"avatar_url":"https://avatars.githubusercontent.com/u/8701850?v=3","gravatar_id":"","url":"https://api.github.com/users/ligadata-rich","html_url":"https://github.com/ligadata-rich","followers_url":"https://api.github.com/users/ligadata-rich/followers","following_url":"https://api.github.com/users/ligadata-rich/following{/other_user}","gists_url":"https://api.github.com/users/ligadata-rich/gists{/gist_id}","starred_url":"https://api.github.com/users/ligadata-rich/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ligadata-rich/subscriptions","organizations_url":"https://api.github.com/users/ligadata-rich/orgs","repos_url":"https://api.github.com/users/ligadata-rich/repos","events_url":"https://api.github.com/users/ligadata-rich/events{/privacy}","received_events_url":"https://api.github.com/users/ligadata-rich/received_events","type":"User","site_admin":false},"created_at":"2016-05-04T20:44:44Z","updated_at":"2016-05-04T20:44:44Z","body":"This now works."}}