This experiment pays tribute to those voices, as musical instruments anyone can learn how to play. To really utilize the technology, many more researches about behavioral and neuroimaging modelling are needed.įor Google, the four singing blobs are just the start, and it is its way to end the sorrowful 2020 with a little joy. Blob Opera is a machine learning experiment by David Li in collaboration with Google Arts and Culture now on tour Opera singers use their voices as expressive and beautiful musical instruments. This kind of capability could change the AI music revolution. To do this, Blob Opera uses a second machine learning model to make the blobs respond to and harmonize users input in real time.

This kind of feat requires a large dataset of existing harmonies, fed into machine-learning algorithm that can find patterns in that data. What makes the blobs smart, is the way the AI harmonizes the voices in real-time to any new directions. When users drag the blobs, the blob with the highest voice will always take the melody while the bassier blobs will do the harmonious groundwork for their star soloist. Users can run a simple pitch tracker of their voice in real-time, and then use the harmonization component from Blob Opera.

For example, users can use their own voice to voice the blobs.

Blob opera google