Optical Character Recognition Integrating Language Translation
The Idea for this app came from my interaction with newly arriving refugee families to the U.S. One of the struggles they face is reading documentation they recieve through mail; whether bills, court documents or financial assitance documents, they struggle to read and understand them.
This is a Mobile App built in React-Native that implements the Camera functionality to allow the user to take a picture of a document. It is then posted to the Google Cloud Vision API where the Optical Character Recognition functionality of the API is used to read the document and returns the text of that document.
The user can then select a language they wish to translate the document into. Another post is made to the Google Cloud Translation API where it is translated and returned to be displayed to the user in the language they chose.
I have also incorporated text messaging functionality. Because the share functionality allows the user to send a text message with the translated text, I wanted to build out a way to write a text message, translate it, and then be able to send that text all within one application.
You will need to get a google cloud api key, as mine is not available on this repo. Once you have gotten an api key, create a key.js file in your root and export that key from the file.
-
Clone this repo
in your terminal run these commands
git clone git@github.com:jbexx/DocSwap.gitcd DocSwapnpm install -
you will need to have xcode installed on your machine or some other simulator to run the app
to download xcode go to this page
you will need to login with your Apple ID and Password
once you have this installed, then in your terminal run
react-native startto run the local server
-
then run...
react-native run-ios...and this will open your simulator and run the app in it
