RTX 5090 not compatible with Replae/Animate Example
Tried on 2080 and 5090, still same issue
for v in inference_state["frames_tracked_per_obj"].values():
KeyError: 'frames_tracked_per_obj'
does anyone know what is this ?
can't even use any of the examples...
python ./wan/modules/animate/preprocess/preprocess_data.py --ckpt_path ./Wan2.2-Animate-14B/process_checkpoint --video_path ./examples/wan_animate/animate/video.mp4 --refer_path ./examples/wan_animate/animate/image.jpeg --save_path ./examples/wan_animate/animate/process_results --resolution_area 1280 720 --retarget_flag --use_flux
ValueError: The provided pretrained_model_name_or_path "./Wan2.2-Animate-14B/process_checkpoint/FLUX.1-Kontext-dev" is neither a valid local path nor a valid repo id. Please check the parameter.
I can't see what's even going on, had to install bunch of missing dependencies that could have been included into requirements file, and at the end nothing works
great!
can't even use any of the examples...
python ./wan/modules/animate/preprocess/preprocess_data.py --ckpt_path ./Wan2.2-Animate-14B/process_checkpoint --video_path ./examples/wan_animate/animate/video.mp4 --refer_path ./examples/wan_animate/animate/image.jpeg --save_path ./examples/wan_animate/animate/process_results --resolution_area 1280 720 --retarget_flag --use_flux
ValueError: The provided pretrained_model_name_or_path "./Wan2.2-Animate-14B/process_checkpoint/FLUX.1-Kontext-dev" is neither a valid local path nor a valid repo id. Please check the parameter.
I cant speak for the devs, but I create a "FLUX.1-Kontext-dev" folder under ./Wan2.2-Animate-14B/process_checkpoint
And I cloned these files inside: https://huggingface.co/black-forest-labs/FLUX.1-Kontext-dev
can't even use any of the examples...
python ./wan/modules/animate/preprocess/preprocess_data.py --ckpt_path ./Wan2.2-Animate-14B/process_checkpoint --video_path ./examples/wan_animate/animate/video.mp4 --refer_path ./examples/wan_animate/animate/image.jpeg --save_path ./examples/wan_animate/animate/process_results --resolution_area 1280 720 --retarget_flag --use_flux
ValueError: The provided pretrained_model_name_or_path "./Wan2.2-Animate-14B/process_checkpoint/FLUX.1-Kontext-dev" is neither a valid local path nor a valid repo id. Please check the parameter.
I cant speak for the devs, but I create a "FLUX.1-Kontext-dev" folder under ./Wan2.2-Animate-14B/process_checkpoint
And I cloned these files inside: https://huggingface.co/black-forest-labs/FLUX.1-Kontext-dev
are u using different model instead of Wan2 or I am not follwing?
Tried on 2080 and 5090, still same issue
for v in inference_state["frames_tracked_per_obj"].values():
KeyError: 'frames_tracked_per_obj'does anyone know what is this ?
modify wan/modules/animate/preprocess/video_predictor.py, add content 'inference_state["frames_tracked_per_obj"] = {}' after line 84 and line 154 then you are good to go.
@qrz ,thanks that worked! but 2080 ti and 5090 RTX shows killed on python replace and animate command, processing goes fine. do i need to modify the command ?
requires around 80gb vram.