Final – VIBROTACTILE
In general, music is perceived as art by sound, and we think that if there is a problem with hearing, we will not be able to hear it.
But, just because they can’t hear music on their ears, Does it mean they can’t play music at all? The important thing is that the source of sound is vibration.Then, even if we can’t feel the vibration with our ears, we would it be possible to feel it with other organs of our body.
When listening to a low sound through a loud speaker in a place like club, we can experience the vibrations all over our body. This is a stimulus that can be sensed by a person with a hearing problem because the transmitted stimulus is felt by other sensory organs as well as the ear.
VIBROTACTILE makes them feel the music through vibration through the sense of tactile transmitted to the strings through vibration motors. With a motor that vibrates automatically according to the piano melody of my p5 sketch, they can see which string is which note on which piano with the p5 sketch.
The Concept & Principle
For Project 2, I decided to make a melody box using tactile experience. So, I made a small melody box that allows the user to feel the melody through the vibration motor while visually checking the melody with a p5 sketch. The box is about the size of one hand.
As shown in the following figure,
I let users feel the vibration with their fingertips and knuckle through vibrating motors (total 8 vibration motors = 8 notes) so that they can know the playing melody. I made 8 holes for 8 tones in Wooden Box and make the motor vibrated when the music is played on the p5 sketch.
When the melody ‘Do’ is played in the p5 sketch, and the ‘Do’ expressing bar or stick is highlighter or change the colors at the same time. So, the user can visually see when and how the sound is played through the holes in the eight holes.
(i.e. When the music plays “do,” the vibration sensor in the hole corresponding to “do” informs the user that it is “do.”)
If I put on my fingertips and knuckles on the hole in the wooden box, I can feel the vibration through the hole.
when I press the keyboard of the notes on p5 sketch, each vibrating motors react according to the note.
I continued working on my melody project for the hearing impaired. Last time, I didn’t succeed in the automatic play that the vibrating motors react automatically when the play button in p5 is pressed, but this time it seems to have succeeded about half.
Also, I tried different material, string. The vibration of the string was felt stronger in the hand than the wood box of the last time, so I thought the string seem to be better as a tool for the hearing impaired.
So I used the string of mini harp.
Test 01 – scupture block
Test 02 – mini Harp
Certainly, the vibration of the string through the scupture block and mini Harp was felt stronger in the hand than the wood box of the last time, so I thought the string seem to be better as a tool for the hearing impaired.
After applied to millis() in arduino sketch
Unlike last time, I used a milliless function instead of a delay function on the Arduino, so the playing speed of the song and the reaction speed of the vibration motor became the same. After I applied to millis function in arduino, It felt like more smooth.
Output – Twinkle Twinkle little star & Jingle Bells
As for mini Harp for the 2nd video, Only the fourth and fifth strings only automatically vibrate beacsue only 2 pin numbers of my arduino worked. Unlike last time, I used a milliless function instead of a delay function on the Arduino, so the playing speed of the song and the reaction speed of the vibration motor became the same, but this time it seems that my arduino pins had a problem. I kept changing the pin number, but other pins didn’t respond at all. So I am still figuring out this. I think I can find out the pin number working then I could complete the song.
-When I press the play button on the p5 sketch, only 2 pin numbers of arduino are active. I have to figure out the other working pin numbers of Arduino to complete the song.
-Each vibrating motor works well through p5 sketch, but every time I press the play button of the song, two unrelated motors vibrate at once. Why?