title: Restore not restoring data all the time
body: <p>I have cassandra 3.7 installed in container and managed by kubernetes
  I created a keyspace cathy1 with replication factor 3 </p>
  
  <p>Inside the cassandra container on node1, I have created a keyspace <em>cathy1</em> as following:</p>
  
  <pre><code>CREATE KEYSPACE cathy1  WITH replication = {'class':'SimpleStrategy', 'replication_factor' : 3};
  
  CREATE TABLE cathy1.employees(emp_id int PRIMARY KEY,emp_name text);
  INSERT INTO cathy1.employees(emp_id,emp_name) VALUES (1,'cathy');
  INSERT INTO cathy1.employees(emp_id,emp_name) VALUES (2,'jon');
  </code></pre>
  
  <p>so each node owns 100% of the data</p>
  
  <p>I run a <code>cqlsh -f list_tables</code> on each node:<br></p>
  
  <pre><code> emp_id | emp_name
  --------+----------
        1 |    cathy 
        2 |      jon 
  (2 rows)
  </code></pre>
  
  <p>I run on node 2 :<br></p>
  
  <pre><code>nodetool snapshot -t mycathy1-node2 cathy1
  </code></pre>
  
  <p>I see a directory <code>mycathy1-node2</code> under <code>cassandra/data/cathy1/employees* /snapshots</code> containing this:</p>
  
  <pre><code>-rw-r--r--  1 root root   32 Oct 18 20:27 manifest.json
  -rw-r--r--  2 root root   43 Oct 18 20:22 mb-12-big-CompressionInfo.db 
  -rw-r--r--  2 root root   96 Oct 18 20:22 mb-12-big-Data.db
  -rw-r--r--  2 root root    9 Oct 18 20:22 mb-12-big-Digest.crc32 
  -rw-r--r--  2 root root   16 Oct 18 20:22 mb-12-big-Filter.db 
  -rw-r--r--  2 root root   32 Oct 18 20:22 mb-12-big-Index.db 
  -rw-r--r--  2 root root 4610 Oct 18 20:23 mb-12-big-Statistics.db 
  -rw-r--r--  2 root root   56 Oct 18 20:22 mb-12-big-Summary.db 
  -rw-r--r--  2 root root   92 Oct 18 20:22 mb-12-big-TOC.txt 
  </code></pre>
  
  <p>Then I truncate the table <br></p>
  
  <pre><code>cqlsh -e "truncate cathy1.employees"
  </code></pre>
  
  <p>At that moment there are no files under <code>cassandra/data/cathy1/employees*</code> on any nodes  <br>
  Only the snapshots directory remains <br></p>
  
  <p>I run a <code>cqlsh -f list_tables</code> on each node: <br></p>
  
  <pre><code> emp_id | emp_name 
  --------+---------- 
  (0 rows) 
  </code></pre>
  
  <p>I run a repair on node 2:</p>
  
  <pre><code>nodetool repair cathy1 
  </code></pre>
  
  <p>it finishes successfully <br>
  then still on node 2 <br></p>
  
  <pre><code>cd cassandra/data/employees* 
  cp ./snapshots/mycathy1-node2/* . 
  
  -rw-r--r--  1 root root   32 Oct 18 20:34 manifest.json 
  -rw-r--r--  1 root root   43 Oct 18 20:34 mb-12-big-CompressionInfo.db  
  -rw-r--r--  1 root root   96 Oct 18 20:34 mb-12-big-Data.db 
  -rw-r--r--  1 root root    9 Oct 18 20:34 mb-12-big-Digest.crc32 
  -rw-r--r--  1 root root   16 Oct 18 20:34 mb-12-big-Filter.db 
  -rw-r--r--  1 root root   32 Oct 18 20:34 mb-12-big-Index.db 
  -rw-r--r--  1 root root 4610 Oct 18 20:34 mb-12-big-Statistics.db 
  -rw-r--r--  1 root root   56 Oct 18 20:34 mb-12-big-Summary.db 
  -rw-r--r--  1 root root   92 Oct 18 20:34 mb-12-big-TOC.txt 
  drwxr-xr-x 16 root root 4096 Oct 18 20:29 snapshots 
  </code></pre>
  
  <p>Then I run <code>nodetool refresh employees</code> <br>
  I run a <code>cqlsh -f list_tables</code> on each node: <br></p>
  
  <pre><code> emp_id | emp_name
  --------+----------
  (0 rows)
  </code></pre>
  
  <p>I run <code>nodetool repair cathy1</code> <br>
   <br>
  and there is still no data visible !!!!! <br></p>
  
  <pre><code>    Pending Flushes: 0 &lt;br&gt;
              Table: employees &lt;br&gt;
              Space used (live): 4954 &lt;br&gt;
              Space used (total): 4954 &lt;br&gt;
              Space used by snapshots (total): 59873 &lt;br&gt;
              Off heap memory used (total): 32 &lt;br&gt;
              SSTable Compression Ratio: 0.75 &lt;br&gt;
              **Number of keys (estimate): 4** &lt;br&gt;
  </code></pre>
  
  <p>Even if statistics says there are 4 keys in table <code>cathy1.employees</code> <br></p>
  
  <pre><code>nodetool flush cathy1
  </code></pre>
  
  <p>still no data visible with cqlsh <br></p>
  
  <p>Why is that ?  <br></p>