{"action":"created","issue":{"url":"https://api.github.com/repos/scylladb/scylla/issues/851","repository_url":"https://api.github.com/repos/scylladb/scylla","labels_url":"https://api.github.com/repos/scylladb/scylla/issues/851/labels{/name}","comments_url":"https://api.github.com/repos/scylladb/scylla/issues/851/comments","events_url":"https://api.github.com/repos/scylladb/scylla/issues/851/events","html_url":"https://github.com/scylladb/scylla/issues/851","id":129159690,"number":851,"title":"Repair -local not using correct dc info","user":{"login":"slivne","id":3465480,"avatar_url":"https://avatars.githubusercontent.com/u/3465480?v=3","gravatar_id":"","url":"https://api.github.com/users/slivne","html_url":"https://github.com/slivne","followers_url":"https://api.github.com/users/slivne/followers","following_url":"https://api.github.com/users/slivne/following{/other_user}","gists_url":"https://api.github.com/users/slivne/gists{/gist_id}","starred_url":"https://api.github.com/users/slivne/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/slivne/subscriptions","organizations_url":"https://api.github.com/users/slivne/orgs","repos_url":"https://api.github.com/users/slivne/repos","events_url":"https://api.github.com/users/slivne/events{/privacy}","received_events_url":"https://api.github.com/users/slivne/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/scylladb/scylla/labels/bug","name":"bug","color":"eb6420"},{"url":"https://api.github.com/repos/scylladb/scylla/labels/high","name":"high","color":"d4c5f9"}],"state":"open","locked":false,"assignee":{"login":"amnonh","id":2118079,"avatar_url":"https://avatars.githubusercontent.com/u/2118079?v=3","gravatar_id":"","url":"https://api.github.com/users/amnonh","html_url":"https://github.com/amnonh","followers_url":"https://api.github.com/users/amnonh/followers","following_url":"https://api.github.com/users/amnonh/following{/other_user}","gists_url":"https://api.github.com/users/amnonh/gists{/gist_id}","starred_url":"https://api.github.com/users/amnonh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amnonh/subscriptions","organizations_url":"https://api.github.com/users/amnonh/orgs","repos_url":"https://api.github.com/users/amnonh/repos","events_url":"https://api.github.com/users/amnonh/events{/privacy}","received_events_url":"https://api.github.com/users/amnonh/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/scylladb/scylla/milestones/13","html_url":"https://github.com/scylladb/scylla/milestones/1.2","labels_url":"https://api.github.com/repos/scylladb/scylla/milestones/13/labels","id":1741419,"number":13,"title":"1.2","description":"","creator":{"login":"tzach","id":170200,"avatar_url":"https://avatars.githubusercontent.com/u/170200?v=3","gravatar_id":"","url":"https://api.github.com/users/tzach","html_url":"https://github.com/tzach","followers_url":"https://api.github.com/users/tzach/followers","following_url":"https://api.github.com/users/tzach/following{/other_user}","gists_url":"https://api.github.com/users/tzach/gists{/gist_id}","starred_url":"https://api.github.com/users/tzach/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tzach/subscriptions","organizations_url":"https://api.github.com/users/tzach/orgs","repos_url":"https://api.github.com/users/tzach/repos","events_url":"https://api.github.com/users/tzach/events{/privacy}","received_events_url":"https://api.github.com/users/tzach/received_events","type":"User","site_admin":false},"open_issues":49,"closed_issues":7,"state":"open","created_at":"2016-05-02T07:50:14Z","updated_at":"2016-05-23T07:21:37Z","due_on":"2016-05-30T21:00:00Z","closed_at":null},"comments":14,"created_at":"2016-01-27T14:29:20Z","updated_at":"2016-05-23T08:10:44Z","closed_at":null,"body":"export CASSANDRA_DIR=/home/shlomi/scylla; nosetests -v -s repair_additional_test.py:RepairAdditionalTest.repair_option_dc_test\r\n\r\nit fails on monster (jenkins)\r\n\r\n```\r\n\r\n======================================================================\r\nERROR: repair_option_dc_test (repair_additional_test.RepairAdditionalTest)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/home/shlomi/urchin-dtest/repair_additional_test.py\", line 803, in repair_option_dc_test\r\n    info=node1.repair(['-local', 'ks'])\r\n  File \"/home/shlomi/urchin-ccm/ccmlib/node.py\", line 1171, in repair\r\n    return self.nodetool(cmd, **kwargs)\r\n  File \"/home/shlomi/urchin-ccm/ccmlib/node.py\", line 693, in nodetool\r\n    raise NodetoolError(\" \".join(args), exit_status, stdout, stderr)\r\nNodetoolError: Nodetool command '/home/shlomi/scylla/resources/cassandra/bin/nodetool -h localhost -p 7100 repair -local ks' failed; exit status: 2; stdout: [2016-01-27 14:57:33,056] Starting repair command #1, repairing 1 ranges for keyspace ks (parallelism=SEQUENTIAL, full=true)\r\n[2016-01-27 14:57:33,167] Repair session 1 failed\r\n[2016-01-27 14:57:33,167] Repair session 1 finished\r\n; stderr: error: nodetool failed, check server logs\r\n-- StackTrace --\r\njava.lang.RuntimeException: nodetool failed, check server logs\r\n\tat org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:290)\r\n\tat org.apache.cassandra.tools.NodeTool.main(NodeTool.java:202)\r\n\r\n\r\n-------------------- >> begin captured logging << --------------------\r\n```\r\n\r\nchecking node1 log\r\n\r\n```\r\nINFO  [shard 0] rpc - client 127.0.0.4: client connection dropped: Connection refused\r\nINFO  [shard 0] rpc - client 127.0.0.4: client connection dropped: Connection refused\r\nINFO  [shard 0] rpc - client 127.0.0.4: client connection dropped: Connection refused\r\nINFO  [shard 0] rpc - client 127.0.0.4: client connection dropped: Connection refused\r\nINFO  [shard 0] gossip - Node 127.0.0.4 has restarted, now UP\r\nINFO  [shard 0] gossip - InetAddress 127.0.0.4 is now UP\r\nINFO  [shard 0] storage_service - Node 127.0.0.4 state jump to normal\r\nINFO  [shard 0] gossip - do_gossip_to_live_member: Favor newly added node 127.0.0.4\r\nINFO  [shard 0] repair - starting user-requested repair for keyspace ks, repair id 1, options {dataCenters=dc2, incremental=false, parallelism=0, primaryRange=false}\r\nINFO  [shard 0] repair - repair 1 failed - std::runtime_error (The current host must be part of the repair)\r\n```\r\n\r\nit seems that repair --local did not use the correct dc info of node1 which is dc1 (according to the logs it used dc2)\r\n\r\nscylla\r\n\r\ncommit c4dafe24f5de5ab276906d955d0ffda9c881bb88\r\nAuthor: Pekka Enberg <penberg@scylladb.com>\r\nDate:   Wed Jan 27 13:29:01 2016 +0200\r\n\r\n    Update scylla-ami submodule\r\n    \r\n    * dist/ami/files/scylla-ami 77cde04...e284bcd (2):\r\n      > Run scylla.yaml construction only once\r\n      > Revert \"Run scylla.yaml construction only once\"\r\n\r\n\r\nscylla-jmx\r\n\r\ncommit 3e1a8961a2e05809c221f9473159e87027ff18e3\r\nAuthor: Amnon Heiman <amnon@scylladb.com>\r\nDate:   Thu Jan 21 11:10:12 2016 +0200\r\n\r\n    StorageService: setLoggingLevel\r\n    \r\n    This patch uses the system api to set log level.\r\n    After this patch the nodetool setloglevel would support modifying a log\r\n    level of a log object.\r\n    \r\n    Signed-off-by: Amnon Heiman <amnon@scylladb.com>\r\n    Message-Id: <1453367412-29722-1-git-send-email-amnon@scylladb.com>\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/scylladb/scylla/issues/comments/220913937","html_url":"https://github.com/scylladb/scylla/issues/851#issuecomment-220913937","issue_url":"https://api.github.com/repos/scylladb/scylla/issues/851","id":220913937,"user":{"login":"amnonh","id":2118079,"avatar_url":"https://avatars.githubusercontent.com/u/2118079?v=3","gravatar_id":"","url":"https://api.github.com/users/amnonh","html_url":"https://github.com/amnonh","followers_url":"https://api.github.com/users/amnonh/followers","following_url":"https://api.github.com/users/amnonh/following{/other_user}","gists_url":"https://api.github.com/users/amnonh/gists{/gist_id}","starred_url":"https://api.github.com/users/amnonh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amnonh/subscriptions","organizations_url":"https://api.github.com/users/amnonh/orgs","repos_url":"https://api.github.com/users/amnonh/repos","events_url":"https://api.github.com/users/amnonh/events{/privacy}","received_events_url":"https://api.github.com/users/amnonh/received_events","type":"User","site_admin":false},"created_at":"2016-05-23T08:10:43Z","updated_at":"2016-05-23T08:10:43Z","body":"I can't reproduce, here are some examples:\r\n./bin/nodetool -p 7100 repair -local -- keyspace1 standard1\r\n[2016-05-23 11:08:14,823] Starting repair command #2, repairing 1 ranges for keyspace keyspace1 (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:08:14,929] Repair session 2 finished\r\n[amnon@localhost cassandra (master)]$ ./bin/nodetool -p 7100 repair -local --\r\n[2016-05-23 11:08:26,883] Starting repair command #3, repairing 1 ranges for keyspace OpsCenter (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:08:26,989] Repair session 3 finished\r\n[2016-05-23 11:08:27,095] Starting repair command #4, repairing 1 ranges for keyspace keyspace1 (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:08:27,203] Repair session 4 finished\r\n[2016-05-23 11:08:27,318] Starting repair command #5, repairing 1 ranges for keyspace amnon (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:08:27,423] Repair session 5 finished\r\n[2016-05-23 11:08:27,621] Repair session 6 finished\r\n[amnon@localhost cassandra (master)]$ ./bin/nodetool -p 7100 repair --in-local-dc --\r\n[2016-05-23 11:09:28,706] Starting repair command #7, repairing 1 ranges for keyspace OpsCenter (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:09:28,814] Repair session 7 finished\r\n[2016-05-23 11:09:28,908] Starting repair command #8, repairing 1 ranges for keyspace keyspace1 (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:09:29,014] Repair session 8 finished\r\n[2016-05-23 11:09:29,114] Starting repair command #9, repairing 1 ranges for keyspace amnon (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:09:29,221] Repair session 9 finished\r\n[2016-05-23 11:09:29,299] Starting repair command #10, repairing 1 ranges for keyspace system (parallelism=SEQUENTIAL, full=true)\r\n[2016-05-23 11:09:29,403] Repair session 10 finished\r\n\r\n\r\nCan you please add more details on how to reproduce the issue?"}}
{"actor":{"display_login":"amnonh"}}