New Project: Air-Math Project. #3
Madacool01
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
So, after finishing the Job Scraper project, I decided to come up with a new idea for a new project. Because I enjoy Computer Vision, I wanted to do something related to hands. I wanted to build an app in which I am able to draw mathematical equations or formulas in the air using my fingers and turn them into either actual LaTeX or actual answers for the equations. My idea for the pipeline of the project right now is:
Use MediaPipe to capture the hand coordinates in OpenCV to draw where my finger goes into a virtual canvas.
I was going to train a CNN model on Google Colab because of its NVIDIA GPU using a math symbol dataset that I'll probably be able to find on the internet, maybe from Kaggle or somewhere.
I'll be able to export the model and deploy it into my own machine.
After that, I'll be able to draw the symbols using OpenCV, pass the symbols to the CNN model to predict the characters, and then send this new string to maybe SymPy or Wolfram Alpha API, to be able to solve for the equation.
Here is an attempt of me trying to write out$\int x^{2}dx$ with my starting logic:
All reactions