Open Camera Slowly on Android.

[NguyenTrongThinh]

Symptoms
Camera opens slowly in android studio project. Please see attached image below

Environment

• Android 12
• Oppo Reno 4 ( 8GB/128GB)
• Mediapipe latest version.

Time measurement
The screen is black for about 2 seconds before showing camera frames.
This is logcat of measurement while running application

2022-09-16 10:29:40.555 19250-19250/com.thinhnguyen.xface D/ObjectRecordsViewModel: setupStreamingPipeline takse: 1791671822 ns

The function setupStreamingPipeline in code snip below.

Code snip

Full class: https://pastebin.com/pE1QdjbR

Some of code related to setup stream pipeline:

private val faceDetectionPreview by lazy {
        FaceDetection(
            activity, FaceDetectionOptions
                .builder()
                .setStaticImageMode(false)
                .setModelSelection(0) //short range model
                .build()
        )
    }

override fun onResume() {
        super.onResume()
        // objectRecordsViewModel.fetchObjectRecords() and objectRecordsViewModel.runTestFace() do background job in coroutine. 
        objectRecordsViewModel.fetchObjectRecords()
        objectRecordsViewModel.runTestFace()
        if (allPermissionsGranted()) {
            getAvailableLensFacing()
            val elaspe = measureNanoTime {
                setupStreamingPipeline()
            }
            Timber.d("setupStreamingPipeline takse: $elaspe ns")
        } else {
            requestPermissionLauncher.launch(REQUIRED_PERMISSIONS)
        }
    }

private fun setupStreamingPipeline() {

        faceDetectionPreview.setErrorListener { message, e ->
            Timber.e(TAG,"setupStreamingPipeline: $message -- ${e.message}"
            )
        }
        cameraInput = CameraInput(activity)
        cameraInput?.setNewFrameListener { textureFrame ->
            faceDetectionPreview.send(textureFrame)
        }
        glSurfaceView = SolutionGlSurfaceView(
            activity, faceDetectionPreview.glContext,
            faceDetectionPreview.glMajorVersion
        )
        glSurfaceView?.setSolutionResultRenderer(FaceDetectionResultGlRenderer())
        glSurfaceView?.setRenderInputImage(true)
        faceDetectionPreview.setResultListener { faceDetectionResult ->
            setupFaceDetectionResults(faceDetectionResult)
        }
        glSurfaceView?.post { starCamera() }
        binding.glSurface.removeAllViews()
        binding.glSurface.addView(glSurfaceView)
        glSurfaceView?.visibility = View.VISIBLE
        binding.glSurface.requestLayout()
    }

    private fun starCamera() {
        cameraInput?.start(activity,
        faceDetectionPreview.glContext,
        if (viewModel.getCurrentCameraId() == CameraSelector.LENS_FACING_FRONT) CameraInput.CameraFacing.FRONT else CameraInput.CameraFacing.BACK,
        glSurfaceView!!.width,
        glSurfaceView!!.height)
    }

Is it possible to make it faster? Please correct me if any wrong usage?

[kuaashish]

Hi @NguyenTrongThinh,
We have similar closed issue #3384 and comment(3384), which will give you the better understanding for you query. Thank you!

[NguyenTrongThinh]

Hi @kuaashish, thank you for your answer.

[kuaashish]

Hi @NguyenTrongThinh, Currently MediaPipe has limited resources for new features and needs improvement in the model performance. We will update if there is any specific update on this issue. Thank you!

[NguyenTrongThinh]

Hi @kuaashish, sure! Thanks and hope for a new release with some improvement in model performance.