Learning to play the Piano with a Python Bot

https://ibanknatoprad.github.io/Learning-to-play-the-Piano-with-a-Python-Bot/doc/images/froide_232.gif

AUTHOR

Manel Lurbe Sempere ([email protected])

ABSTRACT

This project is based on my interest in learning to play the piano in my spare time. As everyone knows, learning to play an instrument is difficult and requires a lot of time and dedication. In my case, I am a computer engineer and for lack of time I decided to start a project to learn playing the piano using a software teacher implemented with LED lights on each piano key. My interest in this software has increased throughout the development and has ended up becoming a bot that plays the piano.

PROGRAMS AVAILABLE ON THIS PROJECT

PIANO PLAYING BOT

Program pianoPlayPi.py is the program to play with Servo motors.
Folder music_sheets contains example music sheets to play with previous program.
Actual version of the code supports only multiple notes with same tempo in the same thread. Multi-thread is supported for simulate two virtual hands with their own music sheet. Additionally, the actual implementation corresponds to two notes for each servo motor because the actual prototype doesn't have enough space between piano keys.

VIRTUAL PIANO

Program buzzerPi.py is a program to play songs with a passive buzzer using the frequencies of piano notes. To play multiple notes at the same time you need as many as notes are wanted to play at the same time.
Actual version of the code only supports one note each time.

LEARNING TO PLAY THE PIANO

Program ledPi.py is a program to learn to play the piano using a servo controller for switching LEDs, each LED corresponds to one note, you need as many LEDs as notes are wanted to play.
This program was the first implementation and was designed to learn to play the piano by placing a LED on top of each key to play it every time a LED was turned on.
Actual version of the code supports multiple notes with same tempo in the same thread. No multi-thread support yet.

GOOGLE ASSISTANT SUPPORT

The bot can be executed from google assistant, creating commands from a google account and linking the controller device as a home IoT device to launch orders such as: "OK Google, play Bethoven's Fifth Symphony on the piano". Example:

DOCUMENTATION AND SET UP

SOFTWARE REQUISITES

Install python3 for develop (Ubuntu/Debian based systems):

sudo apt install python3-dev python3-pip python3-tk build-essential libi2c-dev i2c-tools libffi-dev
Install libs for python 3:

sudo -H python3 -m pip install adafruit-circuitpython-busdevice adafruit-circuitpython-servokit adafruit-circuitpython-pca9685 PCA9685-driver RPi.GPIO

MIDICOMP

This lib translates a mid file into txt values, that can be interpreted by the programs.

git clone https://github.com/markc/midicomp
mkdir midicomp/build
cd midicomp/build
cmake ..
make
sudo make install #(optional)

HARDWARE REQUISITES

Raspberry Pi (any model) or other similar board with support of GPIO ports and python3. Buy on amazon
Cables to connect anything with the GPIO ports. Buy on amazon

If you want to play pianoPlayPi.py program you need:

Servo motors as many as notes you want to play. Buy on amazon
PCA9685 16 Channel PWM Servo Driver, more than one if you want to support more than 16 servos at the same time. Buy on amazon

If you want to play buzzerPi.py program you need:

As many passive Buzzers as notes you want to play at the same time. Buy on amazon

If you want to play ledPi.py program you need:

LEDs, as many as notes you want to play. Buy on amazon

SET UP HARDWARE CONNECTIONS

buzzerPi.py: The following image shows how to connect one buzzer to the Raspberry Pi. If you have more than one, you have to connect each one to one of the available GPIO ports of your board and enable it in the code.

ledPi.py: The following image shows how to connect one LED to the channel 0 of the controller. If you have more than one, you have to connect each one to each controller channel.

pianoPlayPi.py: The following image shows how to connect one servo motor to the channel 0 of the controller. If you have more than one, you have to connect each one to each controller channel.

HOW TO USE

Set execution permissions:

chmod +x program.py
Usage:

python3 program.py music_sheets/music_sheet.txt

or:

./program.py music_sheets/music_sheet.txt

NOTE: Replace "program" with the name of the program you want to execute and "music_sheet" with the name of the song you want to play from the folder "music_sheets".

ONLY IN pianoPlayPi.pay FOR DUAL HAND EMULATION WITH THREADS:

python3 pianoPlayPi.py music_sheets/music_sheet_hand_1.txt music_sheets/music_sheet_hand_2.txt

or:

./pianoPlayPi.py music_sheets/music_sheet_hand_1.txt music_sheets/music_sheet_hand_2.txt

NOTE: Music sheets for dual hand simulated piano, as in real life, shouldn't contains the same notes (or piano keys) at the same time, there is no reason to play with two hands the same notes.

MUSIC SHEETS

I'm trying to find a lib or website that provides music sheets in plain text for bots or in more complex way, develop a machine learning algorithm to recognise notes in pdf or image based music sheets. The idea is to give the piano bot the capacity of play any kind of song without having to rewrite the music sheet specifically for him.

STYLE

Music Sheets for the piano are composed by a file of tuples (note,tempo), where "note" corresponds to the music note to be played and "tempo" the type of the note represented in the following table:

Music symbols	Code Style
𝅝 𝅝	dr
𝅝	r
𝅗𝅥 .	b+
𝅗𝅥 𝅘𝅥𝅮	b-
𝅗𝅥	b
𝅘𝅥 .	n+
𝅘𝅥 𝅘𝅥𝅮	n-
𝅘𝅥	n
𝅘𝅥𝅮	c
𝅘𝅥𝅯	sc
𝅘𝅥𝅱	ssc
𝅘𝅥𝅲	sssc
♭	Write "b" after the note. Example: "mib" corresponds to note "mi flat".
♯	Translate it to flats.
Silence	Same as the type of the note tempo. Example: "(sil,n)" corresponds to silence with the tempo of quarter note( 𝅘𝅥 ).

In addition, you can play two or more notes at the same time if they have the same tempo in the same thread, separating them with a tab value key (\t). The file will be like this:

For one note:

do,n
re,n
mi,n
fa,n
sol,n
la,n
si,n
do2,n

For two (or more) notes with same tempo:

do,n    do2,n
re,n    si,n
mi,n    la,n
fa,n    sol,n
sol,n   fa,n
la,n    mi,n
si,n    re,n
do2,n   do,n

NOTE: Remember that there are no spaces between notes, they are tab key values (\t).

PIANO FREQUENCIES

Key Number	Franco-Belgian notation	Anglo-Saxon notation	Frecuency
88	do₇	C8	4186,01
87	si₆	B7	3951,07
86	la♯₆/si♭₆	A♯7/B♭7	3729,31
85	la₆	A7	3520,00
84	sol♯₆/la♭₆	G♯7/A♭7	3322,44
83	sol₆	G7	3135,96
82	fa♯₆/sol♭₆	F♯7/G♭7	2959,96
81	fa₆	F7	2793,83
80	mi₆	E7	2637,02
79	re♯₆/mi♭₆	D♯7/E♭7	2489,02
78	re₆	D7	2349,32
77	do♯₆/re♭₆	C♯7/D♭7	2217,46
76	do₆	C7	2093,00
75	si₅	B6	1975,53
74	la♯₅/si♭₅	A♯6/B♭6	1864,66
73	la₅	A6	1760,00
72	sol♯₅/la♭₅	G♯6/A♭6	1661,22
71	sol₅	G6	1567,98
70	fa♯₅/sol♭₅	F♯6/G♭6	1479,98
69	fa₅	F6	1396,91
68	mi₅	E6	1318,51
67	re♯₅/mi♭₅	D♯6/E♭6	1244,51
66	re₅	D6	1174,66
65	do♯₅/re♭₅	C♯6/D♭6	1108,73
64	do₅	C6	1046,50
63	si₄	B5	987,767
62	la♯₄/si♭₄	A♯5/B♭5	932,328
61	la₄	A5	880,000
60	sol♯₄/la♭₄	G♯5/A♭5	830,609
59	sol₄	G5	783,991
58	fa♯₄/sol♭₄	F♯5/G♭5	739,989
57	fa₄	F5	698,456
56	mi₄	E5	659,255
55	re♯₄/mi♭₄	D♯5/E♭5	622,254
54	re₄	D5	587,330
53	do♯₄/re♭₄	C♯5/D♭5	554,365
52	do₄	C5	523,251
51	si₃	B4	493,883
50	la♯₃/si♭₃	A♯4/B♭4	466,164
49	la₃	A4	440,000
48	sol♯₃/la♭₃	G♯4/A♭4	415,305
47	sol₃	G4	391,995
46	fa♯₃/sol♭₃	F♯4/G♭4	369,994
45	fa₃	F4	349,228
44	mi₃	E4	329,628
43	re♯₃/mi♭₃	D♯4/E♭4	311,127
42	re₃	D4	293,665
41	do♯₃/re♭₃	C♯4/D♭4	277,183
40	do₃	C4 (central do)	261,626
39	si₂	B3	246,942
38	la♯₂/si♭₂	A♯3/B♭3	233,082
37	la₂	A3	220,000
36	sol♯₂/la♭₂	G♯3/A♭3	207,652
35	sol₂	G3	195,998
34	fa♯₂/sol♭₂	F♯3/G♭3	184,997
33	fa₂	F3	174,614
32	mi₂	E3	164,814
31	re♯₂/mi♭₂	D♯3/E♭3	155,563
30	re₂	D3	146,832
29	do♯₂/re♭₂	C♯3/D♭3	138,591
28	do₂	C3	130,813
27	si₁	B2	123,471
26	la♯₁/si♭₁	A♯2/B♭2	116,541
25	la₁	A2	110,000
24	sol♯₁/la♭₁	G♯2/A♭2	103,826
23	sol₁	G2	97,9989
22	fa♯₁/sol♭ ₁	F♯2/G♭2	92,4986
21	fa₁	F2	87,3071
20	mi₁	E2	82,4069
19	re♯₁/mi♭₁	D♯2/E♭2	77,7817
18	re₁	D2	73,4162
17	do♯₁/re♭₁	C♯2/D♭2	69,2957
16	do₁	C2	65,4064
15	si₀	B1	61,7354
14	la♯₀/si♭₀	A♯1/B♭1	58,2705
13	la₀	A1	55,0000
12	sol♯₀/la♭₀	G♯1/A♭1	51,9130
11	sol₀	G1	48,9995
10	fa♯₀/sol♭₀	F♯1/G♭1	46,2493
9	fa₀	F1	43,6536
8	mi₀	E1	41,2035
7	re♯₀/mi♭₀	D♯1/E♭1	38,8909
6	re₀	D1	36,7081
5	do♯₀/re♭₀	C♯1/D♭1	34,6479
4	do₀	C1	32,7032
3	si_-1	B0	30,8677
2	la♯_-1/si♭_-1	A♯0/B♭0	29,1353
1	la_-1	A0	27,5000

ibanknatoprad / learning-to-play-the-piano-with-a-python-bot Goto Github PK

learning-to-play-the-piano-with-a-python-bot's Introduction