title: GPU usage shows zero when CUDA with PyTorch using on Windows
body: <p>I have pytorch script.</p>
  
  <pre><code>import torch
  
  torch.cuda.is_available() 
  # True
  
  device=torch.device('cuda:0') 
  # I moved my tensors to device
  </code></pre>
  
  <p>But Windows Task Manager shows zero GPU (NVIDIA GTX 1050TI) usage when pytorch script running
  Speed of my script is fine and if I had changing torch.device to CPU instead GPU a speed become slower, therefore cuda (GPU) is working. Why Windows Task Manager doesn't show GPU usage?</p>
  
  <p>Sample of my code:</p>
  
  <pre><code>device=torch.device("cuda:0")
  model=torch.load('mymodel.pth', map_location=torch.device(device))
  image=Image.open('picture.png').convert('RGB')
  transform=transforms.Compose([
              transforms.Resize(224),
              transforms.CenterCrop(224),
              transforms.ToTensor(),
              transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225])
          ])
  input=transform(image)
  input=torch.unsqueeze(input, 0)
  input=input.to(device)
  output=model(input)
  </code></pre>