Plugin that turns words into midi?

Is there a plugin that receives audio voice commands/words/phrases (with voice recognition??) and turns it into a midi message.

Would like to use this experimentally by hooking up the output of my bands “God Mic” into my interface, then when a song is called, using the advanced song selector extension to queue that song that’s called.

You are searching for something like siri or Alexa or HAL?

yes, something like that. Able to hear words and phrases and turn it into text, that turns it into a midi message/parameter

What would be the use case?

So in my group, my band leader will use a mic that routes to our in ears to call songs to reduce transition time.

He calls songs a song ahead of time while playing

I would use the output from the board into my audio interface to have a separate channel, that then routes into a plugin that takes the words or phrases to then queue whatever song he called.

So he calls “Rosanna next”

it queues Rosanna. using the Advanced Song Finder extension that was suggested to me.

This is probably dumb, maybe even super experimental

but, i just wanna see if i can get it to kind of work lol.

1 Like

For sure not reliable, when the band leader is drunk :wink:

1 Like

I actually got it to work

Using Bome’s Midi Translator, I was able to assign a keypress into a midi message

and then, I used Mac’s integrated Voice Control options in accessibility, and mapped a phrase to initiate a keypress.

I then went into gig performer and mapped the widgets to the corresponding program change, and had them mapped to the Bomes Midi Translator MIDI block that appeared in GP.

in theory, you can assign your voice to do anything with this method.

Though, the integrated mac voice recognition is a bit lackluster in terms of mapping keys, and even if you map it to a shortcut and use applecode, apple doesnt allow shortcuts to initiate keypresses. So only special characters work like ><^+= etc.

here’s a video though

5 Likes

Funny, but I use an iPad to display my sheet music, and SIRI has already activated during a rehearsal, even though I hadn’t really asked for it. So I wouldn’t count on word recognition to change my songs. :grimacing:

It wouldn’t change the presets, im gonna use it queue. Ill still force change presets with my ipad.

I use my ipad to control GP with Touch Osc, so ill make a tab at the bottom to queue the songs when the song name is called. itll only use the line where my band leader calls the songs, the God Mic, which is gated, so it wouldnt pick up anything but the phrases needed to initiate a midi change

and subsequently, it ignores anything that isnt the assigned key phrase/word

Or more likely will misinterpret the voice and give you the “nearest” match, thereby selecting the wrong song.

If you use an iPad to display your sheet music, why can’t you select the song you want on your iPad and have your iPad send a program change message to GP to select the desired song?

1 Like

Interesting approach, what will you use in TouchOSC to build this queue?

Interesting concept. Let us how it goes when the time passes by. Who knows, maybe it will work very well for you! :slight_smile: