Spaces:
Running
on
Zero
Running
on
Zero
John Ho
commited on
Commit
·
c697b34
1
Parent(s):
8edc124
added low_cpu_mem_usage and move input to device also
Browse files
app.py
CHANGED
@@ -128,7 +128,7 @@ def inference(
|
|
128 |
return_tensors="pt",
|
129 |
**video_kwargs,
|
130 |
)
|
131 |
-
inputs = inputs.to(
|
132 |
|
133 |
# Inference
|
134 |
generated_ids = model.generate(**inputs, max_new_tokens=128)
|
|
|
128 |
return_tensors="pt",
|
129 |
**video_kwargs,
|
130 |
)
|
131 |
+
inputs = inputs.to("cuda")
|
132 |
|
133 |
# Inference
|
134 |
generated_ids = model.generate(**inputs, max_new_tokens=128)
|