no find 0002.bin,how can I get it

[lmpeng12]

Hello, I have encountered the same problem and cannot find the relevant bin file. My Ebsynth is running normally. I can find the output images in out_1 folder, and there are also npy files in tmp. How can I modify it??
python video_blend.py result/pexels-koolshooters-7322716 --beg 1 --end 101 --itv 10 --key keys --output result/pexels-koolshooters-7322716/blend.mp4 --fps 25.0 --n_proc 4 -ps
/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
ebsynth: 113.05732083320618
Traceback (most recent call last):
File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 330, in
main(args)
File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 268, in main
process_seq(video_sequence, i, blend_histogram, blend_gradient)
File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 199, in process_seq
dist1s.append(load_error(bin_a, img_shape))
File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 159, in load_error
with open(bin_path, 'rb') as fp:
FileNotFoundError: [Errno 2] No such file or directory: 'result/pexels-koolshooters-7322716/out_1/0002.bin'
Traceback (most recent call last):
File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/routes.py", line 437, in run_predict
output = await app.get_blocks().process_api(
File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/blocks.py", line 1355, in process_api
data = self.postprocess_data(fn_index, result["prediction"], state)
File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/blocks.py", line 1289, in postprocess_data
prediction_value = block.postprocess(prediction_value)
File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/video.py", line 249, in postprocess
processed_files = (self._format_video(y), None)
File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/video.py", line 313, in _format_video
video = self.make_temp_copy_if_needed(video)
File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/base.py", line 223, in make_temp_copy_if_needed
temp_dir = self.hash_file(file_path)
File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/base.py", line 187, in hash_file
with open(file_path, "rb") as f:
FileNotFoundError: [Errno 2] No such file or directory: 'result/pexels-koolshooters-7322716/blend.mp4'

[williamyang1991]

#18 (comment)

Your path /home/ai-tets/ contains -
You can change it to /home/ai_tets/

[curlysasha]

same problem

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s]
Global seed set to 96470270
Data shape for DDIM sampling is (1, 4, 112, 64), eta 0.0
Running DDIM Sampling with 20 timesteps
DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s]
python video_blend.py result/test111 --beg 1 --end 31 --itv 10 --key keys --output result/test111/blend.mp4 --fps 30.0 --n_proc 4 -ps
/home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
/home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
/home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
[ WARN:0@3.201] global loadsave.cpp:248 findDecoder imread('result/test111/out_21/0022.jpg'): can't open/read file: check file path/integrity
Process Process-3:
Traceback (most recent call last):
File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap
self.run()
File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run
self.target(*self.args, **self.kwargs)
File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences
process_one_sequence(i, video_sequence)
File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence
cmd += ' ' + g.get_cmd(j, w)
File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd
warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp
if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'
[ WARN:0@3.309] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap
self.run()
File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run
self.target(*self.args, **self.kwargs)
File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences
process_one_sequence(i, video_sequence)
File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence
cmd += ' ' + g.get_cmd(j, w)
File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd
warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp
if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'
[ WARN:0@3.482] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0012.jpg'): can't open/read file: check file path/integrity
Process Process-2:
Traceback (most recent call last):
File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap
self.run()
File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run
self.target(*self.args, **self.kwargs)
File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences
process_one_sequence(i, video_sequence)
File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence
cmd += ' ' + g.get_cmd(j, w)
File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd
warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp
if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'
ebsynth: 3.9767417907714844
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0003.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0004.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0005.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0006.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0007.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0008.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0009.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0010.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0002.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0003.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0004.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0005.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0006.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0007.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0008.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0009.jpg'): can't open/read file: check file path/integrity
[ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0010.jpg'): can't open/read file: check file path/integrity
Traceback (most recent call last):
File "/home/sd/Rerender_A_Video/video_blend.py", line 318, in
main(args)
File "/home/sd/Rerender_A_Video/video_blend.py", line 267, in main
process_seq(video_sequence, i, blend_histogram, blend_gradient)
File "/home/sd/Rerender_A_Video/video_blend.py", line 198, in process_seq
dist1s.append(load_error(bin_a, img_shape))
File "/home/sd/Rerender_A_Video/video_blend.py", line 159, in load_error
with open(bin_path, 'rb') as fp:
FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/out_1/0002.bin'
Traceback (most recent call last):
File "/home/sd/.local/lib/python3.10/site-packages/gradio/queueing.py", line 388, in call_prediction
output = await route_utils.call_process_api(
File "/home/sd/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 219, in call_process_api
output = await app.get_blocks().process_api(
File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1440, in process_api
data = self.postprocess_data(fn_index, result["prediction"], state)
File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1341, in postprocess_data
prediction_value = block.postprocess(prediction_value)
File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 281, in postprocess
processed_files = (self._format_video(y), None)
File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 355, in _format_video
video = self.make_temp_copy_if_needed(video)
File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 226, in make_temp_copy_if_needed
temp_dir = self.hash_file(file_path)
File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 190, in hash_file
with open(file_path, "rb") as f:
FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/blend.mp4'

[curlysasha]

switched to windows, first time was ok
second video:

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████| 20/20 [00:10<00:00, 1.95it/s]
python video_blend.py result\input2 --beg 1 --end 281 --itv 10 --key keys --output result\input2\blend.mp4 --fps 30.0 --n_proc 4 -ps
C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor').
dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats)
C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor').
dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats)
C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor').
dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats)
C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor').
dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats)
C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
Process Process-3:
Traceback (most recent call last):
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap
self.run()
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences
process_one_sequence(i, video_sequence)
File "C:\Rerender_A_Video\video_blend.py", line 76, in process_one_sequence
flow_calc.get_flow(i1, i2, flow_seq[j])
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "C:\Rerender_A_Video\flow\flow_utils.py", line 182, in get_flow
np.save(save_path, flow_np)
File "<array_function internals>", line 180, in save
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\npyio.py", line 502, in save
format.write_array(fid, arr, allow_pickle=allow_pickle,
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\format.py", line 689, in write_array
array.tofile(fp)
OSError: 917504 requested and 0 written
Process Process-4:
Traceback (most recent call last):
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap
self.run()
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences
process_one_sequence(i, video_sequence)
File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence
cmd += ' ' + g.get_cmd(j, w)
File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd
warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp
if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'
Process Process-2:
Traceback (most recent call last):
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap
self.run()
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences
process_one_sequence(i, video_sequence)
File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence
cmd += ' ' + g.get_cmd(j, w)
File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd
warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp
if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'
Process Process-1:
Traceback (most recent call last):
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap
self.run()
File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences
process_one_sequence(i, video_sequence)
File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence
cmd += ' ' + g.get_cmd(j, w)
File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd
warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp
if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'
ebsynth: 47.178515911102295
Traceback (most recent call last):
File "video_blend.py", line 318, in
main(args)
File "video_blend.py", line 267, in main
process_seq(video_sequence, i, blend_histogram, blend_gradient)
File "video_blend.py", line 199, in process_seq
dist2s.append(load_error(bin_b, img_shape))
File "video_blend.py", line 159, in load_error
with open(bin_path, 'rb') as fp:
FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\out_11\0010.bin'
Traceback (most recent call last):
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\queueing.py", line 388, in call_prediction
output = await route_utils.call_process_api(
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api
output = await app.get_blocks().process_api(
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1440, in process_api
data = self.postprocess_data(fn_index, result["prediction"], state)
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1341, in postprocess_data
prediction_value = block.postprocess(prediction_value)
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 281, in postprocess
processed_files = (self._format_video(y), None)
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video)
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 226, in make_temp_copy_if_needed
temp_dir = self.hash_file(file_path)
File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 190, in hash_file
with open(file_path, "rb") as f:
FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\blend.mp4'

[curlysasha]

first video was 2 seconds
second 9 seconds

maybe length is a problem?

[lmpeng12]

switched to windows, first time was ok second video:

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████| 20/20 [00:10<00:00, 1.95it/s] python video_blend.py result\input2 --beg 1 --end 281 --itv 10 --key keys --output result\input2\blend.mp4 --fps 30.0 --n_proc 4 -ps C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats) C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats) C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats) C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature ** (2 * (dim_t // 2) / self.num_pos_feats) C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] Process Process-3: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, **self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 76, in process_one_sequence flow_calc.get_flow(i1, i2, flow_seq[j]) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context return func(*args, **kwargs) File "C:\Rerender_A_Video\flow\flow_utils.py", line 182, in get_flow np.save(save_path, flow_np) File "<array_function internals>", line 180, in save File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\npyio.py", line 502, in save format.write_array(fid, arr, allow_pickle=allow_pickle, File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\format.py", line 689, in write_array array.tofile(fp) OSError: 917504 requested and 0 written Process Process-4: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, **self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' Process Process-2: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, **self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' Process Process-1: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, **self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 47.178515911102295 Traceback (most recent call last): File "video_blend.py", line 318, in main(args) File "video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "video_blend.py", line 199, in process_seq dist2s.append(load_error(bin_b, img_shape)) File "video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\out_11\0010.bin' Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\blend.mp4'

Can you find the file 'result\input2\out_1\0002.bin'?I can't find this file.

[williamyang1991]

first video was 2 seconds second 9 seconds

maybe length is a problem?

Is it in your case, some images are generated but somes are not, rather than missing all images? If so, Ebsynth fails on some sub Processes.
I'm not sure the exact reason. But when the workload is heavy or GPU is nearly out of usage, we observed similar cases occasionally. Since we are not the developer of Ebsynth, we don't know how to fix Ebsynth.

• I think one solution is to use less multiprogress, like setting --n_proc 2 or --n_proc 1 or using smaller image resolution.
• Another naive solution is to manually run Ebsynth on the interval where images are missing. For example, if you find 0002 missing, you can run:

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 1 --end 11 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

likewise, if you find 0012 missing, you can run:

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 11 --end 21 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

And finally merge all results together into a single video.

[curlysasha]

first video was 2 seconds second 9 seconds
maybe length is a problem?

Is it in your case, some images are generated but somes are not, rather than missing all images? If so, Ebsynth fails on some sub Processes. I'm not sure the exact reason. But when the workload is heavy or GPU is nearly out of usage, we observed similar cases occasionally. Since we are not the developer of Ebsynth, we don't know how to fix Ebsynth.

• I think one solution is to use less multiprogress, like setting --n_proc 2 or --n_proc 1 or using smaller image resolution.
• Another naive solution is to manually run Ebsynth on the interval where images are missing. For example, if you find 0002 missing, you can run:

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 1 --end 11 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

likewise, if you find 0012 missing, you can run:

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 11 --end 21 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

And finally merge all results together into a single video.

Thank you, if I'm change input video resolution will it help?

I have 4090 and 5950x, input video was 1080x1920

[williamyang1991]

Thank you, if I'm change input video resolution will it help?

I have 4090 and 5950x, input video was 1080x1920

Maybe, you can try.
Our method will crop the frame and resize its short side to Frame Resolution (default 512).
You can lower the Frame Resolution or crop your video into a more square shape

[Laidawang]

@williamyang1991 i found in /deps/gmflow/gmflow/utils.py line21, The length and width of the input video must be at least a multiple of 16. when i change 1920 *1080 to 1936 *1088 and it works

[williamyang1991]

@Laidawang
In our code, we have the code to preprocess the input video to ensure its length and width to be a multiple of 64.
I think your 1920 * 1080 will be preprocessed to 896 * 512, so there should be no problem with gmflow?

Rerender_A_Video/webUI.py

Lines 645 to 649 in b2dd970

	image_resolution = gr.Slider(label='Frame resolution',
	minimum=256,
	maximum=768,
	value=512,
	step=64)

Rerender_A_Video/src/video_util.py

Lines 80 to 81 in b2dd970

	H = int(np.round(H / 64.0)) * 64
	W = int(np.round(W / 64.0)) * 64

[Laidawang]

@Laidawang In our code, we have the code to preprocess the input video to ensure its length and width to be a multiple of 64. I think your 1920 * 1080 will be preprocessed to 896 * 512, so there should be no problem with gmflow?

Rerender_A_Video/webUI.py

Lines 645 to 649 in b2dd970

	image_resolution = gr.Slider(label='Frame resolution',
	minimum=256,
	maximum=768,
	value=512,
	step=64)

Rerender_A_Video/src/video_util.py

Lines 80 to 81 in b2dd970

	H = int(np.round(H / 64.0)) * 64
	W = int(np.round(W / 64.0)) * 64

yes, i think this happens when just use video_blend.py.

[williamyang1991]

@Laidawang Oh, I understand. We will solve it.

[SingleZombie]

@Laidawang Hi, thanks for the bug report. GMFlow offers a padder to ensure the sidelength of image is valid. Could you try to change the 8 to 16 in the following line and input 1920 * 1080 video again? If it works, we will update the codes.

Rerender_A_Video/flow/flow_utils.py

Line 170 in b2dd970

padder = InputPadder(image1.shape, padding_factor=8)

[lmpeng12]

第一个视频时长 2 秒，第二个视频时长 9 秒
也许长度是一个问题？

在您的情况下，是否生成了一些图像，但有些图像没有生成，而不是丢失所有图像？如果是这样，Ebsynth 在某些子进程上会失败。 我不确定确切的原因。但当工作量很大或者GPU几乎用完时，我们偶尔会观察到类似的情况。由于我们不是 Ebsynth 的开发者，因此我们不知道如何修复 Ebsynth。

• 我认为一种解决方案是使用较少的多重进度，例如设置--n_proc 2或--n_proc 1或使用较小的图像分辨率。
• 另一个简单的解决方案是在图像丢失的时间间隔手动运行 Ebsynth。例如，如果您发现 0002 丢失，您可以运行：

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 1 --end 11 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

同样，如果您发现 0012 丢失，您可以运行：

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 11 --end 21 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

最后将所有结果合并到一个视频中。

OK, thanks for your help, I can run it now.

[zhaoxin111]

same problem

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] Global seed set to 96470270 Data shape for DDIM sampling is (1, 4, 112, 64), eta 0.0 Running DDIM Sampling with 20 timesteps DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] python video_blend.py result/test111 --beg 1 --end 31 --itv 10 --key keys --output result/test111/blend.mp4 --fps 30.0 --n_proc 4 -ps /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] [ WARN:0@3.201] global loadsave.cpp:248 findDecoder imread('result/test111/out_21/0022.jpg'): can't open/read file: check file path/integrity Process Process-3: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self.target(*self.args, **self.kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.309] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity Process Process-1: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self.target(*self.args, **self.kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.482] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0012.jpg'): can't open/read file: check file path/integrity Process Process-2: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self.target(*self.args, **self.kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 3.9767417907714844 [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0010.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0010.jpg'): can't open/read file: check file path/integrity Traceback (most recent call last): File "/home/sd/Rerender_A_Video/video_blend.py", line 318, in main(args) File "/home/sd/Rerender_A_Video/video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "/home/sd/Rerender_A_Video/video_blend.py", line 198, in process_seq dist1s.append(load_error(bin_a, img_shape)) File "/home/sd/Rerender_A_Video/video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/out_1/0002.bin' Traceback (most recent call last): File "/home/sd/.local/lib/python3.10/site-packages/gradio/queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/blend.mp4'

I encountered the same problem, how did you solve it?

[lmpeng12]

same problem
DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] Global seed set to 96470270 Data shape for DDIM sampling is (1, 4, 112, 64), eta 0.0 Running DDIM Sampling with 20 timesteps DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] python video_blend.py result/test111 --beg 1 --end 31 --itv 10 --key keys --output result/test111/blend.mp4 --fps 30.0 --n_proc 4 -ps /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] [ WARN:0@3.201] global loadsave.cpp:248 findDecoder imread('result/test111/out_21/0022.jpg'): can't open/read file: check file path/integrity Process Process-3: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self.target(*self.args, **self.kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.309] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity Process Process-1: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self.target(*self.args, **self.kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.482] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0012.jpg'): can't open/read file: check file path/integrity Process Process-2: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self.target(*self.args, **self.kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 3.9767417907714844 [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0010.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread_('result/test111/out_11/0010.jpg'): can't open/read file: check file path/integrity Traceback (most recent call last): File "/home/sd/Rerender_A_Video/video_blend.py", line 318, in main(args) File "/home/sd/Rerender_A_Video/video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "/home/sd/Rerender_A_Video/video_blend.py", line 198, in process_seq dist1s.append(load_error(bin_a, img_shape)) File "/home/sd/Rerender_A_Video/video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/out_1/0002.bin' Traceback (most recent call last): File "/home/sd/.local/lib/python3.10/site-packages/gradio/queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/blend.mp4'

I encountered the same problem, how did you solve it?

Hello, I suggest you download ebsynth from this website https://github.com/SingleZombie/ebsynth .Then, run the sh/bat to build the ebsynth file in ./deps/ebsynth. Maybe, you can try.

[343195246]

Please move the ebsynth.exe file and the ebsynth.dll file to . \\\deps\\\\\\ebsynth\\\\bin\\\ path.