Spaces:

Jiaqi-hkust
/

hawk

Running on Zero

Jiaqi-hkust commited on 27 days ago

Commit

78e208d

verified ·

1 Parent(s): 9f10ae1

Update hawk/models/video_llama.py

Files changed (1) hide show

hawk/models/video_llama.py CHANGED Viewed

@@ -412,7 +412,7 @@ class VideoLLAMA(Blip2Base):
             with self.maybe_autocast():
                 # embed image features with blip2, out: (b t) q h
-                image_embeds = self.ln_vision(self.visual_encoder(image).to(device)
                 image_atts = torch.ones(image_embeds.size()[:-1], dtype=torch.long).to(device)

             with self.maybe_autocast():
                 # embed image features with blip2, out: (b t) q h
+                image_embeds = self.ln_vision(self.visual_encoder(image)).to(device)
                 image_atts = torch.ones(image_embeds.size()[:-1], dtype=torch.long).to(device)