Image recognition in real-time on android phone. Record and recognize applications.
Java
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.idea
app
gradle/wrapper
.gitignore
LICENSE
README.md
build.gradle
gradle.properties
gradlew
gradlew.bat
settings.gradle

README.md

Classifai recognition app

An android app for real time object classification. This code can be freely extended for your special use-case.

Please see http://michal.sustr.sk/classifai for more information.

There are two flavors: recognize and record

License

Noncommercial license. You may not use this work for commercial purposes.

If you want to use it for commercial purposes, please let me know.

Commercial users should use the whole Classifai package.

https://creativecommons.org/licenses/by-nc-sa/4.0/

TODO

Recognize:

  • setup camera UI
  • save a frame from the stream
  • interface with caffe
  • initialize - find what is optimal FPS processing
  • recognition in progress indicator
  • multiframe recognition using avg over scores
  • calculate probability with bayes using prior probability of labels
  • splash loading screen
  • use accelerometer to find when it is appropriate to do processing
  • direct loading of captured file by caffe, not via storing to sd card
  • storing snapshots with probabilities
  • caffe using GPU? (probably not going to happen)

Record:

  • save snapshots to sd card for different labels
  • make optimizations to get up to 20FPS
  • use accelerometer for recording
  • add clock for recording
  • check for available space before recording

Both:

  • allow turning light on/off
  • touch to focus camera
  • create install procedure which checks for available space (needed to store snapshots and models)
  • multi model support

Future:

  • API calls for finding available models
  • QR code reading for getting record/model info
  • GPS localization to get models automatically?