An open sourced web application built on Flask that uses computer vision to take inventory of a fictional business. This project was built at HackDFW 21 and their sponsor McKesson's challenge of "using technology to tackle supply-chain issues". Winning first place! Here's a demonstration.
Both Oscar (the other creator) and I have worked grueling manual labor jobs where inventory checking was main task. This takes hours, prone to human error, and is mind-numbingly boring. A.R.I. is here to accomplish this task that no one really wants to do.
- Grab video feed input frame by frame
- Inspect the frame for any Aruco Tags
- There are two types of Aruco tags inventory and bay markers. Inventory is the actual products we are counting and bay markers are localize the position of a bay in the warehouse
- Check to see if the Aruco Tag's ID matches that of an inventory item
- When an inventory item is found, we use this function to calculate it's distance from the camera
- Since most bays in a warehouse are a standard size as is boxes, we can calculate the amount of boxes behind the first one
- Paint the border of the Aruco Tag onto the webstream and its distance from the camera
- Display a livestream of the inventory on screen (future plans would be to store in a database periodically)