The generated character shots are all in slow motion.

#20
by houuse78 - opened

Thank you for your work. I tried several times with the same prompt and found that, compared to the original model, the scenes showing character movements are all in slow motion after using this Lora.

Hi, thank you for your feedback. The T2V lora slows the motion down, we are currently finding a way to solve this.

The I2V lora is better than the T2V lora, still worse than the 40-step base model though.

On the native, use 3 ksamplers, with the first step at cfg 3.5 without light. On the wrapper, you need to insert a variable value on the first cfg sampler.

On the native, use 3 ksamplers, with the first step at cfg 3.5 without light. On the wrapper, you need to insert a variable value on the first cfg sampler.

A very interesting recommendation pls let me know how exactly to set up the ksamplers? 2 samplers for high noise 1st sanpler 1step cfg 3.5, 2nd sampler 2 steps with lora and 1 sampler for low....2 steps?

If this is about the new Seko lora, I have the same issue with I2V. The videos are all in slow motion. I am using native ComfyUI components together with sageattention.

3ksampler
1 ksampler cfg 3.5 no lora (1-4 steps) HIGH
2 ksampler cfg 1 (1-4 steps) ltrx x2 HIGH
3 ksampler cfg 1 (1-4 steps) ltrx 0,7 LOW

Its an issue with resolutions somehow! My test: res 1280x720 normal speed, 960x544 a bit slower. 832x480 slow motion ..even though 832x480 is 1 of the recommended resolutions.
Prompt from the creators of the loras: In a warmly lit living room, an elderly man with gray hair sits in a wooden armchair adorned with a blue cushion. He wears a gray cardigan over a white shirt, engrossed in reading a book. As he turns the pages, he subtly adjusts his posture, ensuring his glasses stay in place. He then removes his glasses, holding them in his hand, and turns his head to the right, maintaining his grip on the book. The soft glow of a bedside lamp bathes the scene, creating a calm and serene atmosphere, with gentle shadows enhancing the intimate setting.

having the same issue, everything in slow motion

Bump for visibility.
Here some samples with base settings:

4 steps = 2 high, 2 low = using lighting T2V LoRAs
CFG 4.0 on high, CFG 2.5 on low
Same CFG Skimming settings for both samplers

1:

2:

3:

Wonderful! Do you have a workflow that I can test?

Wonderful! Do you have a workflow that I can test?

gimme sec, i will make PR with new addictions and i will add WF in git comment

edit:
done - https://github.com/kijai/ComfyUI-WanVideoWrapper/pull/1122

Wonderful! Do you have a workflow that I can test?

gimme sec, i will make PR with new addictions and i will add WF in git comment

edit:
done - https://github.com/kijai/ComfyUI-WanVideoWrapper/pull/1122

This might be a dumb question, but oh well... Are you Kijai but with a different name? Or do you just offer excellent additions to his nodes? Do you have any idea when this CFG Skimming will be available in his main branch? I don't usually like to jump to non-main branches, but I would love to give this a try.

Wonderful! Do you have a workflow that I can test?

gimme sec, i will make PR with new addictions and i will add WF in git comment

edit:
done - https://github.com/kijai/ComfyUI-WanVideoWrapper/pull/1122

This might be a dumb question, but oh well... Are you Kijai but with a different name? Or do you just offer excellent additions to his nodes? Do you have any idea when this CFG Skimming will be available in his main branch? I don't usually like to jump to non-main branches, but I would love to give this a try.

hehe nop - im only myself XD
no clue about merging tho, u need to ask kijai about it. He seems to be busy with recent s2v now.
i will try to separate all guiding logic in his code to make things simpler and easier to maintain.

In my repo https://github.com/Mu5hr00moO/ComfyUI-WanVideoWrapper/tree/CFG_Skimming is merged with kijai main
and https://github.com/Mu5hr00moO/ComfyUI-WanVideoWrapper/tree/CFG_Dev with his s2v branch

edit: because im using both of my branches i will keep them updated with main

hehe nop - im only myself XD
no clue about merging tho, u need to ask kijai about it. He seems to be busy with recent s2v now.
i will try to separate all guiding logic in his code to make things simpler and easier to maintain.

In my repo https://github.com/Mu5hr00moO/ComfyUI-WanVideoWrapper/tree/CFG_Skimming is merged with kijai main
and https://github.com/Mu5hr00moO/ComfyUI-WanVideoWrapper/tree/CFG_Dev with his s2v branch

edit: because im using both of my branches i will keep them updated with main

I'm new to trying forked code. So, do I JUST use your code and disable Kijai's WanWrapper nodes?

I'm new to trying forked code. So, do I JUST use your code and disable Kijai's WanWrapper nodes?

better way is to use git:
(from custom_nodes folder if you dont have it downloaded)
git clone https://github.com/kijai/ComfyUI-WanVideoWrapper.git

(go inside WVW folder):
cd ComfyUI-WanVideoWrapper

(add my branch as upstream):
git remote add upstream https://github.com/Mu5hr00moO/ComfyUI-WanVideoWrapper.git

(get all branches from kijai and me):
git fetch --all

after that (inside ComfyUI-WanVideoWrapper):
if want Kijai main:
git checkout main

if mine CFG_Skimming:
git checkout upstream/CFG_Skimming

remember to refresh comfy and browser after swapping

Bump for visibility.
Here some samples with base settings:

4 steps = 2 high, 2 low = using lighting T2V LoRAs
CFG 4.0 on high, CFG 2.5 on low
Same CFG Skimming settings for both samplers

And what was the other settings? I am getting the same slowmo :( with your settings + Linear Dual Scale in WVW WF

Sign up or log in to comment