Technology and Music: Learning the Language of Music with Serious Games
The Journey to Becoming a Virtuoso
Admiring a skilled musician who effortlessly creates beautiful sounds from their instrument is easy. However, the path to reaching that level of mastery is long and challenging, especially in the beginning stages.
Learning the language of music is one of the crucial starting points for aspiring virtuosos. By acquiring this language from experienced musicians, individuals can gain the necessary skills to interpret musical scores. This knowledge allows them to:
-
Recognize the names of each note, enabling them to compose music.
-
Understand how each sound is represented on sheet music.
-
Identify the sound of each note, both for singing and recognizing by ear.
-
Distinguish between different musical figures to create rhythms.
-
Recognize different types of measures that dictate musical accents.
Learning this language is a challenging task that requires time, patience, and guidance to ensure correct study methods and progress towards musical goals.
The Role of Technology: Serious Games
In today’s world, technology plays a significant role in various aspects of life, including music education. Thanks to artificial intelligence (AI) techniques, machines can now understand speech, interpret handwritten text, recognize melodies, create art, and even drive cars.
AI can also be a powerful tool for learning music, which led our research group to collaborate with a video game company to develop a series of applications for tablets and smartphones. These applications, known as serious games, utilize AI technology to facilitate the learning of musical language.
The SolFaMe suite, consisting of four applications – SolFaMe, SolFaFly, SolFaMap, and SolFaDrop – was created with the philosophy of learning through play and playing while learning. Soon, the suite will be joined by SolFaEditor.
SolFaMe: Learning the Basics
SolFaMe focuses on teaching the fundamental concepts of musical language through interactive exercises. The application features a tuner that allows users to listen to the sound of each note and see the corresponding note on the staff when they sing.
Real-time interaction with the singing voice sets SolFaMe apart from other educational music applications. Users can sing and immediately observe which note they are singing, enabling them to self-correct and adjust their voice accordingly.
Exploring the Serious Games
In addition to the interactive learning component of SolFaMe, the suite offers three games: SolFaMap, SolFaFly, and SolFaDrop. Each game incorporates the user’s singing voice as a key element.
SolFaMap: Choosing the Path
In SolFaMap, users can choose their desired route by singing a specific note, guiding the game’s protagonist to take a selfie on their chosen street.
SolFaFly: Soaring to New Heights
SolFaFly challenges users to control the height of their avatar by singing different notes, avoiding obstacles to stay airborne.
SolFaDrop: Collecting Musical Objects
In SolFaDrop, users can collect falling objects by singing specific notes, controlling the movement of a singing drone.
Introducing SolFaEditor
Completing the suite, SolFaEditor is a score editor that allows users to write their own musical compositions. The application not only plays back the written score but also evaluates the user’s singing in real-time. This evaluation ensures that the correct notes are sung and the rhythm is accurately interpreted.
Positive Reception and Future Improvements
The SolFaMe suite and its associated applications have already garnered around 400,000 downloads and boast an average rating of 4.6 stars out of 5, based on over 1,000 reviews. Users praise the applications for their comprehensiveness, usefulness, and entertainment value. Additionally, user feedback has prompted the inclusion of the bass clef and an expanded range of singable notes in future updates.
The Power of AI in Music Education
Artificial intelligence, when harnessed effectively, can be a valuable ally in the field of music education. Serious games, combined with real-time interaction with the singing voice, offer students an engaging and effective tool for learning music.
SolFaMe is available for free with advertisements.