{"action":"created","issue":{"url":"https://api.github.com/repos/scylladb/scylla/issues/455","repository_url":"https://api.github.com/repos/scylladb/scylla","labels_url":"https://api.github.com/repos/scylladb/scylla/issues/455/labels{/name}","comments_url":"https://api.github.com/repos/scylladb/scylla/issues/455/comments","events_url":"https://api.github.com/repos/scylladb/scylla/issues/455/events","html_url":"https://github.com/scylladb/scylla/issues/455","id":111241989,"number":455,"title":"Compaction error: compaction failed: read exception: std::runtime_error (compressed chunk failed checksum)","user":{"login":"slivne","id":3465480,"avatar_url":"https://avatars.githubusercontent.com/u/3465480?v=3","gravatar_id":"","url":"https://api.github.com/users/slivne","html_url":"https://github.com/slivne","followers_url":"https://api.github.com/users/slivne/followers","following_url":"https://api.github.com/users/slivne/following{/other_user}","gists_url":"https://api.github.com/users/slivne/gists{/gist_id}","starred_url":"https://api.github.com/users/slivne/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/slivne/subscriptions","organizations_url":"https://api.github.com/users/slivne/orgs","repos_url":"https://api.github.com/users/slivne/repos","events_url":"https://api.github.com/users/slivne/events{/privacy}","received_events_url":"https://api.github.com/users/slivne/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/scylladb/scylla/labels/bug","name":"bug","color":"eb6420"},{"url":"https://api.github.com/repos/scylladb/scylla/labels/high","name":"high","color":"d4c5f9"}],"state":"closed","locked":false,"assignee":{"login":"slivne","id":3465480,"avatar_url":"https://avatars.githubusercontent.com/u/3465480?v=3","gravatar_id":"","url":"https://api.github.com/users/slivne","html_url":"https://github.com/slivne","followers_url":"https://api.github.com/users/slivne/followers","following_url":"https://api.github.com/users/slivne/following{/other_user}","gists_url":"https://api.github.com/users/slivne/gists{/gist_id}","starred_url":"https://api.github.com/users/slivne/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/slivne/subscriptions","organizations_url":"https://api.github.com/users/slivne/orgs","repos_url":"https://api.github.com/users/slivne/repos","events_url":"https://api.github.com/users/slivne/events{/privacy}","received_events_url":"https://api.github.com/users/slivne/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/scylladb/scylla/milestones/12","html_url":"https://github.com/scylladb/scylla/milestones/1.1","labels_url":"https://api.github.com/repos/scylladb/scylla/milestones/12/labels","id":1661891,"number":12,"title":"1.1","description":"","creator":{"login":"tzach","id":170200,"avatar_url":"https://avatars.githubusercontent.com/u/170200?v=3","gravatar_id":"","url":"https://api.github.com/users/tzach","html_url":"https://github.com/tzach","followers_url":"https://api.github.com/users/tzach/followers","following_url":"https://api.github.com/users/tzach/following{/other_user}","gists_url":"https://api.github.com/users/tzach/gists{/gist_id}","starred_url":"https://api.github.com/users/tzach/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tzach/subscriptions","organizations_url":"https://api.github.com/users/tzach/orgs","repos_url":"https://api.github.com/users/tzach/repos","events_url":"https://api.github.com/users/tzach/events{/privacy}","received_events_url":"https://api.github.com/users/tzach/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":82,"state":"open","created_at":"2016-03-23T13:18:57Z","updated_at":"2016-06-23T08:28:37Z","due_on":null,"closed_at":null},"comments":2,"created_at":"2015-10-13T18:38:02Z","updated_at":"2016-06-23T08:28:37Z","closed_at":"2016-06-23T08:28:37Z","body":"Using branch-0.10 rpms on a load on mosnter with godzilla I  get the following errors\r\n\r\n```\r\nERROR [shard 12] compaction_manager - compaction failed: read exception: std::runtime_error (compressed chunk failed checksum)\r\n```\r\nmonster\r\n```\r\n /usr/bin/scylla --log-to-syslog 0 --log-to-stdout 1 --default-log-level info --options-file /var/lib/scylla/conf/scylla.yaml --network-stack posix --memory 48G\r\n```\r\n\r\ngodzilla\r\n```\r\nsudo ifconfig enp2s0f0 192.168.10.185\r\nsleep 4\r\ntaskset -c 1,17 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 2,18 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 3,19 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 4,20 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 5,21 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 6,22 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 7,23 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 8,24 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 10,25 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 11,26 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 12,27 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\ntaskset -c 13,28 ~/cassandra/tools/bin/cassandra-stress user duration=200m profile=./urchin-qa-internal/simple_test_soak.yaml 'ops(insert=10,single=1)' -mode cql3 native -pop seq=1..16000000 -rate threads=16 -node 192.168.10.101 &\r\nsleep 4\r\n```\r\n\r\n```\r\n-sh-4.3$ cat urchin-qa-internal/simple_test_soak.yaml \r\n### DML ###\r\n \r\n# Keyspace Name\r\nkeyspace: keyspace2\r\n \r\n# The CQL for creating a keyspace (optional if it already exists)\r\nkeyspace_definition: |\r\n  CREATE KEYSPACE keyspace2 WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 2};\r\n\r\n# Table name\r\ntable: standard1\r\n \r\n# The CQL for creating a table you wish to stress (optional if it already exists)\r\ntable_definition: |\r\n  CREATE TABLE standard1 (\r\n      key blob PRIMARY KEY,\r\n      c0 blob,\r\n      c1 blob,\r\n      c2 blob,\r\n      c3 blob,\r\n      c4 blob\r\n  ) with \r\n   compression = { 'sstable_compression' : 'LZ4Compressor'};\r\n\r\n### Column Distribution Specifications ###\r\n \r\ncolumnspec:\r\n  - name: key\r\n    size: fixed(3)\r\n\r\n  - name: c0\r\n    size: fixed(34)\r\n\r\n  - name: c1\r\n    size: fixed(34)\r\n\r\n  - name: c2\r\n    size: fixed(34)\r\n\r\n  - name: c3\r\n    size: fixed(34)\r\n\r\n  - name: c4\r\n    size: fixed(34)\r\n\r\n\r\n### Batch Ratio Distribution Specifications ###\r\n \r\ninsert:\r\n  partitions: fixed(1)\r\n  select:    fixed(1)/1000\r\n  batchtype: UNLOGGED\r\n\r\nqueries:\r\n  single:\r\n    cql: select * from standard1 where key = ? LIMIT 1\r\n```\r\n\r\nI think we need to test compaction under load using compression algo's.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/scylladb/scylla/issues/comments/227983400","html_url":"https://github.com/scylladb/scylla/issues/455#issuecomment-227983400","issue_url":"https://api.github.com/repos/scylladb/scylla/issues/455","id":227983400,"user":{"login":"slivne","id":3465480,"avatar_url":"https://avatars.githubusercontent.com/u/3465480?v=3","gravatar_id":"","url":"https://api.github.com/users/slivne","html_url":"https://github.com/slivne","followers_url":"https://api.github.com/users/slivne/followers","following_url":"https://api.github.com/users/slivne/following{/other_user}","gists_url":"https://api.github.com/users/slivne/gists{/gist_id}","starred_url":"https://api.github.com/users/slivne/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/slivne/subscriptions","organizations_url":"https://api.github.com/users/slivne/orgs","repos_url":"https://api.github.com/users/slivne/repos","events_url":"https://api.github.com/users/slivne/events{/privacy}","received_events_url":"https://api.github.com/users/slivne/received_events","type":"User","site_admin":false},"created_at":"2016-06-23T08:28:37Z","updated_at":"2016-06-23T08:28:37Z","body":"closing it does not reproduce with bcba45f546bb4a63ee90c02b8ead163113189402"}}
{"actor":{"display_login":"slivne"}}