Unable to find Mediapipe Model File on Build

[matttidridge]

MediaPipe4U Version

2022.0.1

UE Version

5.1.x

UnrealEngine Type

Install From Epic Games Launcher

Platform

Windows

What happened?

MediaPipe working fine in editor, but after packaging a Windows build, it is unable to find the .tflite model files, causing MediaPipe not to run.

[2023.11.03-04.46.52:172][695]LogGStreamer: Display: Gstreamer initialization start...
 decklinkvideosrc connection=sdi mode=1080p24 video-format=1 ! videoflip method=horizontal-flip ! videoconvert ! video/x-raw,format=RGBA ! appsink name=mediapipe4u_sink
[2023.11.03-04.46.52:172][695]LogGStreamer: Display: GstPipeline: Init <MediaPipe4U>
[2023.11.03-04.46.52:178][695]LogGStreamer: Display: GstPipeline: Start <MediaPipe4U>
[2023.11.03-04.46.52:178][695]LogMediaPipeGStreamer: Display: GStreamer is started.
decklinkvideosrc connection=sdi mode=1080p24 video-format=1 ! videoflip method=horizontal-flip ! videoconvert ! video/x-raw,format=RGBA ! appsink name=mediapipe4u_sink
[2023.11.03-04.46.52:178][695]LogMediaPipe: Display: [MediaPipa API] MediaPipe builtin graph used (CPU).
[2023.11.03-04.46.52:178][695]LogMediaPipe: Display: [MediaPipa API] MediaPipe pipeline stopping...
[2023.11.03-04.46.52:178][695]LogMediaPipe: Display: [MediaPipa API] UmpPipeline::Shutdown OK
[2023.11.03-04.46.52:178][695]LogMediaPipe: Display: [MediaPipa API] MediaPipe pipeline stopped.
[2023.11.03-04.46.52:178][695]LogMediaPipe: Display: [MediaPipa API] MediaPipe graph nodes: 4

[2023.11.03-04.46.52:178][695]LogMediaPipe: Display: [MediaPipa API] Run mediapipe graph...
[2023.11.03-04.46.52:200][698]LogMediaPipe: Display: [MediaPipa API] Configure mediapipe graph succeed.
[2023.11.03-04.46.52:200][698]LogMediaPipe: Display: [MediaPipa API] Graph is ready (pollers: 0, observers: 5).
[2023.11.03-04.46.52:200][698]LogMediaPipe: Display: [MediaPipa API] enable_segmentation : bool
input_flip_horizontally : bool
input_flip_vertically : bool
input_rotation_degrees : int
model_complexity : int
refine_face_landmarks : bool
smooth_landmarks : bool
smooth_segmentation : bool
use_prev_landmarks : bool

[2023.11.03-04.46.52:200][698]LogMediaPipe: Display: [MediaPipa API] MediaPipe graph is launched.
🔥🔥🔥🔥🔥 
[2023.11.03-04.46.52:201][698]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/pose_detection/pose_detection.tflite
[2023.11.03-04.46.52:201][698]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/face_landmark/face_landmark.tflite
[2023.11.03-04.46.52:201][698]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
[2023.11.03-04.46.52:202][698]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/pose_landmark/pose_landmark_full.tflite
[2023.11.03-04.46.52:202][698]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/hand_landmark/hand_landmark_full.tflite
[2023.11.03-04.46.52:202][698]LogMediaPipe: Error: Unable to find mediapipe model file: mediapipe/modules/pose_detection/pose_detection.tflite
🔥🔥🔥🔥🔥 
.
.
.
[2023.11.03-04.46.52:202][698]LogMediaPipe: Error: [MediaPipa API] Failed to run mediapipe graph.
😢 

[matttidridge]

UPDATE:

Works great when I manually add all of the .tflite files to [PROJECT]/Binaries/Win64/modules in the build folder.

I'm not sure why Unreal is not including them when I package the game.

[endink]

Oh......its a package bug....

[endink]

As a temporary solution:

Find the file Plugins/MediaPipe4U/Source/ThirdParty/mediapipe/MediapipeAPILibrary.Build.cs and modify line 40:

if (Target.Type != TargetType.Editor && Target.Platform == UnrealTargetPlatform.Android)
{
	AddDepFolder(MPDataDir);
}

change to:

if (Target.Type != TargetType.Editor)
{
	AddDepFolder(MPDataDir);
}

I haven't tested it yet, but I believe this will solve this issue.

[github-actions]

This issue is stale because it has been open for 15 days with no activity.

[endink]

same as #147

[github-actions]

This issue is stale because it has been open for 15 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.

[Amjid1234]

hi, i cant make a build. it gives unknown error.

kindly tell me how can i remove the error

[Amjid1234]

I have to present it ASAP. please let me know about the solution

[endink]

As a temporary solution:

Find the file Plugins/MediaPipe4U/Source/ThirdParty/mediapipe/MediapipeAPILibrary.Build.cs and modify line 40:

if (Target.Type != TargetType.Editor && Target.Platform == UnrealTargetPlatform.Android)
{
	AddDepFolder(MPDataDir);
}

change to:

if (Target.Type != TargetType.Editor)
{
	AddDepFolder(MPDataDir);
}

I haven't tested it yet, but I believe this will solve this issue.

After modified the Build.cs file, package the game again, issue will be solved.

[Amjid1234]

thanks for the solution. anothercounter question please dont mind.
do you have any idea that how can i upload the new model to it with having same rig and naming? will it work if i upload any model at runtime?

[endink]

thanks for the solution. anothercounter question please dont mind.
do you have any idea that how can i upload the new model to it with having same rig and naming? will it work if i upload any model at runtime?

@Amjid1234 open a new issue to discuss this.