Realtime piano learning and accompaniment from a Pi-powered AI 🎹
Switch branches/tags
Nothing to show
Clone or download
Latest commit 84ebade Nov 11, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
ai Update name Sep 4, 2017
ai2 Vendoring Oct 3, 2017
music Another bug fix to prevent two improvisations Sep 4, 2017
piano Update name Sep 4, 2017
player Use last velocity Sep 4, 2017
testing Using two notes doens't work Sep 4, 2017
vendor Vendoring Oct 3, 2017
.gitignore Initial commit Aug 30, 2017
Gopkg.lock Vendoring Oct 3, 2017
Gopkg.toml Vendoring Oct 3, 2017
LICENSE Initial commit Aug 30, 2017
Makefile Update README Sep 4, 2017
README.md Update README.md Nov 11, 2018
main.go Allow velocity following Sep 4, 2017

README.md

PIanoAI (Piano AI on a Raspberry Pi)

This is code for providing an augmented piano playing experience. When run, this code will provide computer accompaniment that learns in real-time from the human host pianist. When the host pianist stops playing for a given amount of time, the computer AI will then improvise in the space using the style learned from the host.

See it

Here's an example of me teaching for ~30 seconds and then jamming with the AI:

Playing

Here are some longer clips of me playing with the AI: clip #2 clip #3

Read about it

Read more about it at rpiai.com/piano.

Try it

  1. Get a MIDI-enabled keyboard and two-way MIDI adapter ($18). Or get a USB-MIDI keyboard ($38).
  2. Get a Raspberry Pi (however, a Windows / Linux / OS X computer should also work) and connect it to the MIDI keyboard.
  3. Build latest version of libportmidi (OS X: brew install portmidi).
sudo apt-get install cmake-curses-gui libasound2-dev
git clone https://github.com/aoeu/portmidi.git
cd portmidi
ccmake .  # press in sequence: c, e, c, e, g
make
sudo make install
  1. Download the latest release OR install Go and go get it:
go get -v github.com/schollz/pianoai
  1. Add export LD_LIBRARY_PATH=/usr/local/lib to your .bashrc. (Unnessecary if you did not build portmidi). Reload bash source ~/.bashrc if this is the first time.
  2. Play!
$ pianoai

For some extra jazziness do

$ pianoai --jazzy

Options

Piano keyboard controls

When you play, you can always trigger learning and improvising by hitting the top B or top C respectively, on the piano keyboard (assuming an 88-key keyboard). If you use --manual mode then you can only hear improvisation after triggering. Normally, however, the improvisation will start as soon as it has enough notes and you leave enough space for the improvisation to take place (usually a few beats).

You can save your current data by pressing the bottom A on the piano keyboard and you can play back what you played by hitting the bottom Bb on the piano keyboard. Currently there is not a way to save the AI playing (but its in the roadmap, see below).

Command line options

There are many command-line options for tuning the AI, but feel free to play with the code as well. Current options:

   --bpm value             BPM to use (default: 120)
   --tick value            tick frequency in hertz (default: 500)
   --hp value              high pass note threshold to use for leraning (default: 65)
   --waits value           beats of silence before AI jumps in (default: 2)
   --quantize value        1/quantize is shortest possible note (default: 64)
   --file value, -f value  file save/load to when pressing bottom C (default: "music_history.json")
   --debug                 debug mode
   --manual                AI is activated manually
   --link value            AI LinkLength (default: 3)
   --jazzy                 AI Jazziness
   --stacatto              AI Stacattoness
   --chords                AI Allow chords
   --follow                AI velocities follow the host

Roadmap

Must haves

Want haves

  • Player changes velocity according to the host
  • Integrating more AI routines

Similar projects

Acknowledgements

Thanks to @egonelbre for the Gopher graphic. Thanks to @rakyll for porting libportmidi to Go.

License

portmidi is Licensed under Apache License, Version 2.0.

Get in touch

Like this? Need help? Tweet at me @yakczar.