To produce a musicxml file from a sheet music image (You must comply with and are also resibonsible for copyright laws, etc. for use of sheet music images in img2Mxml)
-
img2Mxml (sheetmusic2musicxml) can convert a sheet music image (.jpg or .png) for a piano piece (i.e., with (right hand) staff 1 and (left hand) staff 2) into a musicxml file (staff1 or staff 2).
-
Use img2xml.ipynb on GoogleColab or use detectionintegration.py and systemintegration.py (you need to pip install requirements_for_localenv.txt and change FILE_PATH and parameters (e.g., fifths, beats, beat_type, staff)) in your local environment.
-
Use, for instance, Logic Pro (https://www.apple.com/jp/logic-pro/), MuseScore (https://musescore.org/), Sibelius First (https://my.avid.com/get/sibelius-first) to produce a sound from the resulting xml file.
-
To further train YOLOv5 models (stored at yolov5/weightsstock/) for inference, check each model with specific labels set forth in lines 429 to 474 of makeyolomusicdict/generatedictforxml.py.
-
Each measure training and test data can be created by using enlargemeasures/enlargeeachmeasure.py, labelImg (https://github.com/tzutalin/labelImg), and roboflow (https://roboflow.com).
-
Actual inference results of two sheet music images are provided in musicdata/menuetBach/ or musicdata/sarabandePhotoInclined/ for your reference.
-
img2Mxml is part of bFaaaP (barrier-Free assist as a Pedal) project (https://bfaaap.com) or (https://www.barks.jp/keywords/mf2020_bfaaap.html)
-
You may contact Tomo at info.shishido.and.associates@gmail.com