The Kromophone is a Color-to-Sound sensory substitution device created with tasks such as navigation, environment, and object recognition in mind.
C++ QML C QMake Ruby Inno Setup Other
Switch branches/tags
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
CuteLogger
Resources
android
kromophone-ui
packaging
video
.gitignore
.hgignore
.hgtags
ArgParser.cpp
ArgParser.h
AudioEngine.cpp
AudioEngine.h
AudioGenerator.cpp
AudioGenerator.h
Camera.cpp
Camera.h
CameraFactory.cpp
CameraFactory.h
Color.cpp
Color.h
ColorPreviewWidget.cpp
ColorPreviewWidget.h
ColorSource.cpp
ColorSource.h
DesktopImageSource.cpp
DesktopImageSource.h
DroidWidget.cpp
DroidWidget.h
DroidWidget.ui
GPIOWatcher.cpp
GPIOWatcher.h
HealthCheck.cpp
HealthCheck.h
ImageColorSource.cpp
ImageColorSource.h
ImageSourceWidget.cpp
ImageSourceWidget.h
ImageSourceWidget.ui
KeyboardFilter.cpp
KeyboardFilter.h
Kromophone-bitrock.xml
Kromophone.cpp
Kromophone.h
Kromophone.iss
Kromophone.pro
KromophoneApp.cpp
KromophoneApp.h
LICENSE
LiveImageColorSource.cpp
LiveImageColorSource.h
MainWindow.cpp
MainWindow.h
MainWindow.ui
MessageProcessor.cpp
MessageProcessor.h
OpenCVImageSource.cpp
OpenCVImageSource.h
Platform.cpp
Platform.h
PreviewImageProvider.cpp
PreviewImageProvider.h
QmlCameraSource.cpp
QmlCameraSource.h
QtCameraSource.cpp
QtCameraSource.h
README.md
RemoteController.cpp
RemoteController.h
S30kromophone
Settings.cpp
Settings.h
Sound.cpp
Sound.h
SoundEffect.cpp
SoundEffect.h
SoundEffectGenerator.cpp
SoundEffectGenerator.h
SoundOut.cpp
SoundOut.h
StaticImageColorSource.cpp
StaticImageColorSource.h
Timbre.cpp
Timbre.h
Transform.cpp
Transform.h
V4L2ImageSource.cpp
V4L2ImageSource.h
WebSocketServer.cpp
WebSocketServer.h
WiiBluetoothConnector.cpp
WiiBluetoothConnector.h
WiiMote.cpp
WiiMote.h
WiiMoteInputController.cpp
WiiMoteInputController.h
audio.pri
functovect.rb
icon.rc
kromophone-start.sh
main.cpp
package_for_windows.bat
playtimbre.m
resources.qrc
sources.pri
v4lcamera_raw.c
v4lcamera_raw.h
version.h

README.md

Kromophone

http://kromophone.com

This program is licesned under the GPL v. 3. See LICENSE for more info.

Installation and Setup

Dependencies

The required dependencies are:

Compiling

Windows, Linux, or Mac

Just like any other Qt project, run

qmake -r Kromophone.pro
make

or use QtCreator to build it.

Android

  1. Make sure you have Qt for Android installed
  2. Open Kromophone.pro with QtCreator, and configure the project for the Android target.

Alternatively, you can find a prebuilt version on the Google Play Store.

Raspberry Pi

Building everything for the raspberry pi is a little tricky, but can be done!

  1. Start with a Raspbian Jesse Lite image
  2. Follow the guide RaspberryPi2EGLFS guide on the Qt Wiki for cross compiling Qt for raspberry pi
  3. Also build and deploy the following QT submodules: qtmultimedia, qtquickcontrols2, qtdeclarative, qtquickcontrols, qtwebsockets
  4. Use the qmake from step 2 to build Kromophone.pro

Caveats for Raspberry Pi:

  • The Kromophone on Raspberry pi uses a hacky V4L capture module, which only supports USB UVC cameras. YMMV
  • The Kromophone sounds awful with the on board sound card. Get a USB sound card and use the --audioDevice plughw:CARD=Device,DEV=0 option.

If you are interested in purchasing a made Raspberry Pi sdcard pre-loaded with the Kromophone software, please contact us.

Running

Unix:

./Kromophone

Windows:

Double click Kromophone.exe

Issues

THIS IS ALPHA SOFTWARE.

If it doesn't work, you can let us know by submitting an issue at: https://github.com/zach-capalbo/Kromophone/issues