Making music with AI

This app learns from various MIDI examples and plays the next part according to the user's performance. When you play a few notes, the next part is played accordingly.

An opera created by four Blobs trained with machine learning. Adjust pitch and vowels with your mouse to create harmonies in real time.

Play along with an AI bird trained on cello and violin performance data. The AI generates bowing motions and pitch in real-time based on your mouse movements.

Draw on the canvas, and music plays based on the position and instrument. A synesthetic AI experiment turning visuals into audio.

Google's first AI-powered Doodle, released on Bach's birthday in 2019. A machine learning model harmonizes a two-measure melody you compose into Bach's signature style. It uses Coconet, a model trained on 306 of Bach's chorale harmonizations.

A Google Arts & Culture experiment that uses machine learning to harmonize a melody you enter in the style of Johann Sebastian Bach. You can replay the result with a different instrument or tempo, or share it by link.

Using the Performance RNN model, a song is created by referring to the frequency of use of key signatures. The model learned musical structures and patterns using LSTM.

This is an app that utilizes the MusicVAE model to generate repeating melodies. MusicVAE can create harmonious melodies by smoothly connecting multiple melodies.

We created an arpeggio pattern to play using Magenta and Improv RNN. Improv RNN conditionally generates a melody based on the basic chord progression.

This is a drum composition app created using a pre-trained drum RNN model. If you provide a seed pattern, it continuously generates the next pattern based on it.

Currently the most popular music generation AI that creates high-quality songs including lyrics, vocals, and accompaniment just by entering text prompts.

An experiment from Google Creative Lab that arranges thousands of everyday recorded sounds into a map by similarity, then lets you build drum beats out of them. The raw material is ordinary noise rather than instruments.

An experiment where four different drum patterns sit at the corners of a square and moving through the space between them produces new in-between beats. It lets you hear what rhythms can exist between two rhythms.

A Magenta experiment where you build lo-fi hip hop by clicking objects in a small virtual room. The TV in the middle is wired to MusicVAE, which blends melodies, and the radio beside it to MelodyRNN, which generates new ones, so the music changes in real time as you click.

A Google Magenta experiment that converts a sound you sing or bang into the sound of instruments such as flute, saxophone, trumpet, or violin. Each instrument model was trained on a 10-minute recording of a real performer, so breathing sounds and bowing noises come through as well.

A web tool that uses AI to split an uploaded song into vocals and instrumental. You get two tracks: a karaoke version without vocals and an acapella version with the voice isolated. The site says processing usually takes about 10 seconds.

See how closely your singing matches Freddie Mercury of the legendary band Queen. The AI analyses your pitch, timbre and melody to give you a score.

AI imagines and plays sounds that match an image. You can wander around Google Street View and hear the 'imaginary sounds' of that location.