Feature request: Real-time Preview Processing

[kayazinc]

Expected behaviour

Use-case

While in camera preview mode, it is able to detect object such as "Rectangle" or "Facial" and draw a rectangle around the object.

Is it possible to achieve the use-case in javascript, such as having a new onPreivew() method that returns the image and then perform the detection algorithm on the image?

Thanks, any advice are welomed.

[dotnetprofessional]

I'd like to add to this - I'm currently attempting to add an event that returns the preview image so that additional processing can be done. Taking captures is just too slow on Android (iOS is fairly quick). On Android this looks to be fairly straightforward as the byte[] is available, but for iOS its seems a bit more involved. Though any pointers are welcome, as Obj-C isn't a language I know :)

[npomfret]

@dotnetprofessional Have you tried master? There are some changes which may improve capture performance on android that I don't think have been released yet.

The iOS version of the android byte[] is here i think.

[dotnetprofessional]

@npomfret Thanks for the details - I've not tried master. I took a look at the iOS link you gave me, but that's if you do a capture. I'm looking at getting the byte[] from a preview so that its really fast. My scenario (which is odd I'll admit) is to capture the video preview and save the image as a JPG so that a webview can keep refreshing it. The idea is to provide a pysdo stream within a webview ie a web page. We can use WebRTC on Android but iOS doesn't support that.

[barron9]

please take a look at anyline ocr react-native demo for this

[dotnetprofessional]

@barron9 Thanks but the pricing model would bankrupt us given our product.

[npomfret]

What are the rules regarding plugging commercial products on here?

[barron9]

no just take the idea, their custom camera draws rectangles around objects words etc in every 10 or 20 ms. to recognize cam refreshes itself so processes while on preview

[cesarve77]

+1

[sibelius]

@dbishai is this dbishai@75553a6 performa performatic?

[dbishai]

@sibelius, what does "performa performatic" mean?

[ducpt2]

+1.

[IssueHuntBot]

@issuehuntfest has funded $40.00 to this issue. See it on IssueHunt

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You may also mark this issue as a "discussion" and i will leave this open.

[stale]

Closing this issue after a prolonged period of inactivity. Fell free to reopen this issue, if this still affecting you.

[rafaelcavalcante]

This should be reopened

Related: #2984