Skip to content

TeamLimb/Intelligent_Arm_Project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

OpenArms_Research_Project

image1

image2

OPENARMS MK.2

This product has a tiny camera in the center of the palm. The camera's purpose is that recognize object and grab it which already defined optimized movement. We received a 2nd award at 2017 Wearable Computer Contest (WCC) hosted by KAIST.

Requirements

Hardware

  • Raspberry Pi 3 (Ubuntu Mate 16.04)
  • Arduino nano (Arduino Uno also fine)
  • Adafruit 16-Channel 12-bit PWM/Servo Driver - I2C interface - PCA9685
  • Servo Motor (Gotech-SER0011 x 9ea)
  • Li-Po Battery 2 cells(7.4V) 1300mAh
  • spy camera for Pi
  • Rotary Switch (DFRobot-SEN0156)

Software

Components

Sources Explanation
arduino/ Arduino code directory.
rospy/openarms_percepton/ detection package with model and pretrained weights.

Installation

Step 1 : Copy openarms_perception package in rospy directory to your catkin workspace src directory.

Step 2 : Upload openarms_control.ino code to your Arduino.

Please contact to design head if you need prosthetic arm design assets.

Quick Start

Step 1 : Execute roscore.

roscore

Step 2 : Launch ros module.

roslaunch openarms_perception detection.launch

After 1-2 minutes, ready message are going to print out on your screen.

Step 3 : Start ros serial communication!

rosrun rosserial_python serial_node.py /port/you/connected

Default setting of port/you/connected might be /dev/ttyUSB0.

rosrun rosserial_python serial_node.py /dev/ttyUSB0

Detection Model

Our approach is using deep learning so we chose Tiny Yolo which has lighter and faster than any other yolo model.

Detection

  • We use tiny yolo trained by ms coco dataset.
  • Model is for Keras framework. (backend tensorflow)
  • Detection procedure takes about 2.7 seconds.

Why Tiny Yolo?

  • RAM size of Raspberry Pi3 is only 1 GB.

  • We need fastest detection model.

Weights are transformed from official site of yolo.

Model mAP FLOPS keras_weights
Tiny YOLO 23.7 5.41 Bn weights

Contact to Team LIMB

Anthony Kim : artit.anthony@gmail.com - Perception Lead

Ethan Kim : 4artit@gmail.com - Team Leader

WonJae Ji : jiwi1005@gmail.com(Head of Design)