Learning-to-play-the-Piano-with-a-Python-Bot

Learning to play the Piano with a Python Bot

https://ibanknatoprad.github.io/Learning-to-play-the-Piano-with-a-Python-Bot/doc/images/froide_232.gif

AUTHOR

Manel Lurbe Sempere (malursem@inf.upv.es)

ABSTRACT

This project is based on my interest in learning to play the piano in my spare time. As everyone knows, learning to play an instrument is difficult and requires a lot of time and dedication. In my case, I am a computer engineer and for lack of time I decided to start a project to learn playing the piano using a software teacher implemented with LED lights on each piano key. My interest in this software has increased throughout the development and has ended up becoming a bot that plays the piano.

PROGRAMS AVAILABLE ON THIS PROJECT

PIANO PLAYING BOT

Program pianoPlayPi.py is the program to play with Servo motors.
Folder music_sheets contains example music sheets to play with previous program.
Actual version of the code supports only multiple notes with same tempo in the same thread. Multi-thread is supported for simulate two virtual hands with their own music sheet. Additionally, the actual implementation corresponds to two notes for each servo motor because the actual prototype doesn’t have enough space between piano keys.

VIRTUAL PIANO

Program buzzerPi.py is a program to play songs with a passive buzzer using the frequencies of piano notes. To play multiple notes at the same time you need as many as notes are wanted to play at the same time.
Actual version of the code only supports one note each time.

LEARNING TO PLAY THE PIANO

Program ledPi.py is a program to learn to play the piano using a servo controller for switching LEDs, each LED corresponds to one note, you need as many LEDs as notes are wanted to play.
This program was the first implementation and was designed to learn to play the piano by placing a LED on top of each key to play it every time a LED was turned on.
Actual version of the code supports multiple notes with same tempo in the same thread. No multi-thread support yet.

GOOGLE ASSISTANT SUPPORT

The bot can be executed from google assistant, creating commands from a google account and linking the controller device as a home IoT device to launch orders such as: “OK Google, play Bethoven’s Fifth Symphony on the piano”. Example:

DOCUMENTATION AND SET UP

SOFTWARE REQUISITES

Install python3 for develop (Ubuntu/Debian based systems):

sudo apt install python3-dev python3-pip python3-tk build-essential libi2c-dev i2c-tools libffi-dev
Install libs for python 3:

sudo -H python3 -m pip install adafruit-circuitpython-busdevice adafruit-circuitpython-servokit adafruit-circuitpython-pca9685 PCA9685-driver RPi.GPIO

MIDICOMP

This lib translates a mid file into txt values, that can be interpreted by the programs.

git clone https://github.com/markc/midicomp
mkdir midicomp/build
cd midicomp/build
cmake ..
make
sudo make install #(optional)

HARDWARE REQUISITES

Raspberry Pi (any model) or other similar board with support of GPIO ports and python3. Buy on amazon
Cables to connect anything with the GPIO ports. Buy on amazon

If you want to play pianoPlayPi.py program you need:

Servo motors as many as notes you want to play. Buy on amazon
PCA9685 16 Channel PWM Servo Driver, more than one if you want to support more than 16 servos at the same time. Buy on amazon

If you want to play buzzerPi.py program you need:

As many passive Buzzers as notes you want to play at the same time. Buy on amazon

If you want to play ledPi.py program you need:

LEDs, as many as notes you want to play. Buy on amazon

SET UP HARDWARE CONNECTIONS

buzzerPi.py: The following image shows how to connect one buzzer to the Raspberry Pi. If you have more than one, you have to connect each one to one of the available GPIO ports of your board and enable it in the code.

ledPi.py: The following image shows how to connect one LED to the channel 0 of the controller. If you have more than one, you have to connect each one to each controller channel.

pianoPlayPi.py: The following image shows how to connect one servo motor to the channel 0 of the controller. If you have more than one, you have to connect each one to each controller channel.

HOW TO USE

Set execution permissions:

chmod +x program.py
Usage:

python3 program.py music_sheets/music_sheet.txt

or:

./program.py music_sheets/music_sheet.txt

NOTE: Replace “program” with the name of the program you want to execute and “music_sheet” with the name of the song you want to play from the folder “music_sheets”.

ONLY IN pianoPlayPi.pay FOR DUAL HAND EMULATION WITH THREADS:

python3 pianoPlayPi.py music_sheets/music_sheet_hand_1.txt music_sheets/music_sheet_hand_2.txt

or:

./pianoPlayPi.py music_sheets/music_sheet_hand_1.txt music_sheets/music_sheet_hand_2.txt

NOTE: Music sheets for dual hand simulated piano, as in real life, shouldn’t contains the same notes (or piano keys) at the same time, there is no reason to play with two hands the same notes.

MUSIC SHEETS

I'm trying to find a lib or website that provides music sheets in plain text for bots or in more complex way, develop a machine learning algorithm to recognise notes in pdf or image based music sheets. The idea is to give the piano bot the capacity of play any kind of song without having to rewrite the music sheet specifically for him.

STYLE

Music Sheets for the piano are composed by a file of tuples (note,tempo), where “note” corresponds to the music note to be played and “tempo” the type of the note represented in the following table:

Music symbols

Code Style

𝅝 𝅝

𝅝

𝅗𝅥 .

𝅗𝅥 𝅘𝅥𝅮

𝅗𝅥

𝅘𝅥 .

𝅘𝅥 𝅘𝅥𝅮

𝅘𝅥

𝅘𝅥𝅮

𝅘𝅥𝅯

𝅘𝅥𝅱

ssc

𝅘𝅥𝅲

sssc

♭

*Write "b" after the note. Example: "mib" corresponds to note "mi flat".*</td> </tr>

♯

*Translate it to flats.*</td> </tr>

Silence

*Same as the type of the note tempo. Example: "(sil,n)" corresponds to silence with the tempo of quarter note( 𝅘𝅥 ).*</td> </tr> </tbody> </table> In addition, you can play two or more notes at the same time if they have the same tempo in the same thread, separating them with a tab value key (\t). The file will be like this: - For one note: ``` do,n re,n mi,n fa,n sol,n la,n si,n do2,n - For two (or more) notes with same tempo: ``` do,n do2,n re,n si,n mi,n la,n fa,n sol,n sol,n fa,n la,n mi,n si,n re,n do2,n do,n **NOTE: Remember that there are no spaces between notes, they are tab key values (\t).** ### **PIANO FREQUENCIES**

Key Number Franco-Belgian notation Anglo-Saxon notation Frecuency

88 do₇ C8 4186,01

87 si₆ B7 3951,07

86 la♯₆/si♭₆ A♯7/B♭7 3729,31

85 la₆ A7 3520,00

84 sol♯₆/la♭₆ G♯7/A♭7 3322,44

83 sol₆ G7 3135,96

82 fa♯₆/sol♭₆ F♯7/G♭7 2959,96

81 fa₆ F7 2793,83

80 mi₆ E7 2637,02

79 re♯₆/mi♭₆ D♯7/E♭7 2489,02

78 re₆ D7 2349,32

77 do♯₆/re♭₆ C♯7/D♭7 2217,46

76 do₆ C7 2093,00

75 si₅ B6 1975,53

74 la♯₅/si♭₅ A♯6/B♭6 1864,66

73 la₅ A6 1760,00

72 sol♯₅/la♭₅ G♯6/A♭6 1661,22

71 sol₅ G6 1567,98

70 fa♯₅/sol♭₅ F♯6/G♭6 1479,98

69 fa₅ F6 1396,91

68 mi₅ E6 1318,51

67 re♯₅/mi♭₅ D♯6/E♭6 1244,51

66 re₅ D6 1174,66

65 do♯₅/re♭₅ C♯6/D♭6 1108,73

64 do₅ C6 1046,50

63 si₄ B5 987,767

62 la♯₄/si♭₄ A♯5/B♭5 932,328

61 la₄ A5 880,000

60 sol♯₄/la♭₄ G♯5/A♭5 830,609

59 sol₄ G5 783,991

58 fa♯₄/sol♭₄ F♯5/G♭5 739,989

57 fa₄ F5 698,456

56 mi₄ E5 659,255

55 re♯₄/mi♭₄ D♯5/E♭5 622,254

54 re₄ D5 587,330

53 do♯₄/re♭₄ C♯5/D♭5 554,365

52 do₄ C5 523,251

51 si₃ B4 493,883

50 la♯₃/si♭₃ A♯4/B♭4 466,164

49 la₃ A4 440,000

48 sol♯₃/la♭₃ G♯4/A♭4 415,305

47 sol₃ G4 391,995

46 fa♯₃/sol♭₃ F♯4/G♭4 369,994

45 fa₃ F4 349,228

44 mi₃ E4 329,628

43 re♯₃/mi♭₃ D♯4/E♭4 311,127

42 re₃ D4 293,665

41 do♯₃/re♭₃ C♯4/D♭4 277,183

40 do₃ C4 (central do) 261,626

39 si₂ B3 246,942

38 la♯₂/si♭₂ A♯3/B♭3 233,082

37 la₂ A3 220,000

36 sol♯₂/la♭₂ G♯3/A♭3 207,652

35 sol₂ G3 195,998

34 fa♯₂/sol♭₂ F♯3/G♭3 184,997

33 fa₂ F3 174,614

32 mi₂ E3 164,814

31 re♯₂/mi♭₂ D♯3/E♭3 155,563

30 re₂ D3 146,832

29 do♯₂/re♭₂ C♯3/D♭3 138,591

28 do₂ C3 130,813

27 si₁ B2 123,471

26 la♯₁/si♭₁ A♯2/B♭2 116,541

25 la₁ A2 110,000

24 sol♯₁/la♭₁ G♯2/A♭2 103,826

23 sol₁ G2 97,9989

22 fa♯₁/sol♭ ₁ F♯2/G♭2 92,4986

21 fa₁ F2 87,3071

20 mi₁ E2 82,4069

19 re♯₁/mi♭₁ D♯2/E♭2 77,7817

18 re₁ D2 73,4162

17 do♯₁/re♭₁ C♯2/D♭2 69,2957

16 do₁ C2 65,4064

15 si₀ B1 61,7354

14 la♯₀/si♭₀ A♯1/B♭1 58,2705

13 la₀ A1 55,0000

12 sol♯₀/la♭₀ G♯1/A♭1 51,9130

11 sol₀ G1 48,9995

10 fa♯₀/sol♭₀ F♯1/G♭1 46,2493

9 fa₀ F1 43,6536

8 mi₀ E1 41,2035

7 re♯₀/mi♭₀ D♯1/E♭1 38,8909

6 re₀ D1 36,7081

5 do♯₀/re♭₀ C♯1/D♭1 34,6479

4 do₀ C1 32,7032

3 si_-1 B0 30,8677

2 la♯_-1/si♭_-1 A♯0/B♭0 29,1353

1 la_-1 A0 27,5000

This site is open source. Improve this page.