I've done some of this using the daisy seed. For time based effects like reverb, the memory/hardware constraints can be spicy. Definitely maxed out the seed hardware before achieving the (very long) level of reverb I wanted.
The hardware descriptions here seem on the light side. I'd want to be confident that it can handle intense time based effects.
It's promising that they seem to allow arbitrary write to the device, and only charge for tokens for the people that require the prompt playground.
Looking forward to see where this goes.
As an aside: building an ear-pleasing FDN reverb on an obscure-ish board with intense hardware optimization needs has been one of my favorite barometers for the abilities of new LLM models.
I hate it.
A pedal you can define with code? Kinda cool, definitely already exists, but kinda cool.
A pedal where you buy tokens to feed the ai monster to generate code to customize your pedal? Ugh. I want off this ride.
Edit - other hackable pedals:
https://www.electrosmash.com/pedalshield
https://www.op-electronics.com/en/dsp-multieffect/696-diydsp...
https://clevelandmusicco.com/hothouse-diy-digital-signal-pro...
I think I'm with you on this.
Usually, I'm not a big fan of Polyend products. They look cool, but they lack depth. Not the best tracker, not the best beatbox, etc. And also, I'm totally into Puredata and devices like Organelle, but the learning curve is steep. I get the idea of a vibe sound modeler. Not my alley, but that's interesting for a niche, I'd say.
My guitar teacher has a Line 6 HX Stomp multieffects pedal. In addition to programming effects patches use Line 6’s HX Edit desktop application, he also uses ChatGPT to generate patch files (they’re just JSON) by describing the effect or referencing a specific artist or song by name.
Haha, that's pretty clever. They get to sell $299 pedals, $20 plates, and upmarked "tokens" for their playground. Great example of selling shovels in a gold rush.
Very cool! Would love to know more about the audio processing backend that drives this type of thing
This looks interesting. Would love to see if there are examples of pedals already vibe-coded.
I don't think that's what this is.
From a cursory glance it appears to be a physical guitar pedal that lets you program virtual effects. The "vibe coding" aspect is likely a system directive + effects library SDK docs fed into an LLM along with the user prompt that generates the appropriate C++ which is then compiled into an effect and run on the pedal.
Note: Which is still very cool. The previous programmable guitar pedals that I've seen were all pretty low-level.
Ive been interested in doing this with a raspberry pi. Ive plugged my guitar to my pc and used FL Studio, a daw, and can add effects to it live and was curious if someone would code a os (i guess) that only ran VST (the filters) and had a screen and knobs to control things. I know its very possible, I just didnt have the time to learn how to do it.
Lol, you read my mind. I’ve been wanting a generic-looking, wood-grained “tablet display” covered with a dozen PHYSICAL faders, sliders, and knobs that you can leave permanently hooked up to a DAW that interfaces with virtual synths for over a decade now!
When you switch to a different VST, the hardware’s display would dynamically update all the text around each dial and button to match the corresponding virtual control.
Slightly related, there was a programmable guitar pedal based on the Pi Zero called the Pedal-Pi a little while back that might interest you:
> I’ve been wanting a generic-looking, wood-grained “tablet display” covered with a dozen PHYSICAL faders, sliders, and knobs that you can leave permanently hooked up to a DAW that interfaces with virtual synths for over a decade now!
Just one of several. These have existed for at least two decades, save for "dynamically update all the text around each dial", which has a variety of complications that I won't go into here.