title: Should I use fp16 tensors to utilize tensor core?
body: <p>I am trying to utilize the V100 machine on AWS. The official site says that it provides over 100TFLOPS for machine learning application, but it seems not working that faster than the 1080ti I have been used.</p>
  
  <p>Recentely, I found an article that says tensor core operates on fp16 tensor.</p>
  
  <p>So, should I specify the dtype for tensor, like</p>
  
  <p><code>tensor_a = torch.tensor([1.,2.,3.], dtype=torch.float16)</code></p>
  
  <p>instead of:</p>
  
  <p><code>tensor_a = torch.tensor([1.,2.,3])</code>?</p>