<p>I recommend <a href="http://vvvv.org/" rel="nofollow">VVVV</a> also.
You could make a patch that controls many video effects with levels from microphone input.
Take a look at <a href="http://vvvv.org/contribution/video-effects-and-compositing-tutorials" rel="nofollow">Video Effects and Compositing Tutorials</a></p>

<blockquote>
  <p>Basic tutorials and examples on how to use TextureFX nodes to work
  with the same tricks and techniques you could previously achieve only
  in Photoshop or After Effects. And what's best: everything can be
  animated in real-time.</p>
</blockquote>

CC BY-SA 3.0
2014-09-04T18:43:41.427Z
2014-09-04T18:43:41.427Z
Ventolinmono
<p>There are several programs available that allow you to do that.
One very popular tool in the live visual industry is <a href="http://cycling74.com/products/max/" rel="nofollow">MAX</a> (especially Max for Live).
Its a visual programming language to create visuals for live performances that also integrates into a few tools like Ableton Live.</p>

<p>A program that I personally use at work is called <a href="http://vvvv.org/" rel="nofollow">vvvv</a>, its a visual programming tool aswell that allows for very complex programs and is more "multipurpose" than MAX and offers a huge collection of add-ons to work with all kinds of peripherals and input devices.
For getting started I highly recommend having a look at this <a href="http://vvvv.org/sites/default/files/uploads/dontpanic_45beta25_1_0.pdf" rel="nofollow">cheat sheet</a>, vvvv has a VERY minimalistic GUI and heavily relies on shortcuts and hidden menus for more advanced settings and features.</p>

<p>Unfortunately only available for Windows but unlike Max its absolutely free to use unless you want to use it commercially, then you have to buy a commercial license (no differnces to the free version, you still just download the same version but have permission to earn money with it).</p>

<p>A also a free solution but only available on Mac would be Quartz Composer which is coming with Xcode. Its also a visual programming language that works in a similar fashion like vvvv and MAX.</p>

<p>E: Another solution would be <a href="http://www.madmapper.com/" rel="nofollow">MadMapper</a>, its more meant for projection mapping but also does video with filters that can react to sound. In can also integrate into Live afaik.</p>

CC BY-SA 3.0
2014-09-03T16:46:54.297Z
Various VJ software also has a lot of support for things like this.
AJ Henderson
CC BY-SA 3.0
2014-09-03T17:43:23.070Z
Indeed, vvvv is actually broadly used in the VJ scene.
timonsku
CC BY-SA 3.0
2014-09-03T14:17:14.210Z
2014-09-03T17:40:55.100Z
2014-09-03T17:40:55.100Z
timonsku
<p>There's a variety of software available for live video manipulation, from the minimalistic, developer-oriented <strong>vvvv</strong> and <strong>pd</strong>, to the more aesthetically pleasing <strong>Max/MSP</strong> and <strong>Troikatronix Isadora</strong>.</p>

<p>I've used each of these in some capacity, and personally I prefer Isadora, as it is more intuitive to use and get a basic patch up and running in a short time than the rest. MAX was originally developed as a modular audio manipulation engine, and MSP was later developed to add video functionality.</p>

<p>vvvv and pd are both very powerful tools, but more suited to procedural content generation or content analysis than direct video manipulation, and they can be considered lacking in terms of an interface. As a result, they have a comparably steep learning curve. However, they are more extensible and versatile than Isadora and Max, and are worth digging into if you can devote the time to it.</p>

<p>I often find that it's possible to play to the strengths of each of these paradigms - for example, there have been many occasions where I've used vvvv and Isadora in tandem; vvvv performing real-time live audio analysis, and sending sync data (in terms of pulses and BPM) via OSC to Isadora, which then performs the video manipulation using these data. This may be worth looking into, if you have the chance.</p>

CC BY-SA 3.0
2014-09-05T01:07:37.327Z
2014-09-05T01:07:37.327Z
Cal McLean
<p>I am starting an art project that requires to create a program (running on my computer) that can be able to distort the image of the video projected according to the sound/noise that a mic captures live.</p>

<p>The distortion is supposed to respond to the duration and intensity of the sound, and I'm not looking for glitch art, I'm looking for a smoother distortion (but my biggest concern is not the way the distortion looks but the appropriate respond to the sound captured by the mic)</p>

<p>Is there anything like this? or do I have to create the program from scratch? </p>

CC BY-SA 3.0
2014-09-12T16:12:00.130Z
Did this ever come to a reasonable conclusion?
Cal McLean
<video><video-editor><audio><distortion>
Distorting video with live sound
José de Sancristóbal Higareda
# Distorting video with live sound

(Asked by: username_0 on 2014-09-03)

I am starting an art project that requires to create a program (running on my computer) that can be able to distort the image of the video projected according to the sound/noise that a mic captures live.

The distortion is supposed to respond to the duration and intensity of the sound, and I'm not looking for glitch art, I'm looking for a smoother distortion (but my biggest concern is not the way the distortion looks but the appropriate respond to the sound captured by the mic)

Is there anything like this? or do I have to create the program from scratch?

**Tags:** video, video-editor, audio, distortion

> **Comments:**
> **username_1**: Did this ever come to a reasonable conclusion?  

---

## 3 answers

### Answer by username_2 on 2014-09-04. Score: 1

I recommend [VVVV](http://vvvv.org/) also.
You could make a patch that controls many video effects with levels from microphone input.
Take a look at [Video Effects and Compositing Tutorials](http://vvvv.org/contribution/video-effects-and-compositing-tutorials)

> Basic tutorials and examples on how to use TextureFX nodes to work
> with the same tricks and techniques you could previously achieve only
> in Photoshop or After Effects. And what's best: everything can be
> animated in real-time.


---

### Answer by username_3 on 2014-09-03. Score: 1

There are several programs available that allow you to do that.
One very popular tool in the live visual industry is [MAX](http://cycling74.com/products/max/) (especially Max for Live).
Its a visual programming language to create visuals for live performances that also integrates into a few tools like Ableton Live.

A program that I personally use at work is called [vvvv](http://vvvv.org/), its a visual programming tool aswell that allows for very complex programs and is more "multipurpose" than MAX and offers a huge collection of add-ons to work with all kinds of peripherals and input devices.
For getting started I highly recommend having a look at this [cheat sheet](http://vvvv.org/sites/default/files/uploads/dontpanic_45beta25_1_0.pdf), vvvv has a VERY minimalistic GUI and heavily relies on shortcuts and hidden menus for more advanced settings and features.

Unfortunately only available for Windows but unlike Max its absolutely free to use unless you want to use it commercially, then you have to buy a commercial license (no differnces to the free version, you still just download the same version but have permission to earn money with it).

A also a free solution but only available on Mac would be Quartz Composer which is coming with Xcode. Its also a visual programming language that works in a similar fashion like vvvv and MAX.

E: Another solution would be [MadMapper](http://www.madmapper.com/), its more meant for projection mapping but also does video with filters that can react to sound. In can also integrate into Live afaik.

> **Comments:**
> **username_4**: Various VJ software also has a lot of support for things like this.  
> **username_3**: Indeed, vvvv is actually broadly used in the VJ scene.  

---

### Answer by username_1 on 2014-09-05. Score: 0

There's a variety of software available for live video manipulation, from the minimalistic, developer-oriented **vvvv** and **pd**, to the more aesthetically pleasing **Max/MSP** and **Troikatronix Isadora**.

I've used each of these in some capacity, and personally I prefer Isadora, as it is more intuitive to use and get a basic patch up and running in a short time than the rest. MAX was originally developed as a modular audio manipulation engine, and MSP was later developed to add video functionality.

vvvv and pd are both very powerful tools, but more suited to procedural content generation or content analysis than direct video manipulation, and they can be considered lacking in terms of an interface. As a result, they have a comparably steep learning curve. However, they are more extensible and versatile than Isadora and Max, and are worth digging into if you can devote the time to it.

I often find that it's possible to play to the strengths of each of these paradigms - for example, there have been many occasions where I've used vvvv and Isadora in tandem; vvvv performing real-time live audio analysis, and sending sync data (in terms of pulses and BPM) via OSC to Isadora, which then performs the video manipulation using these data. This may be worth looking into, if you have the chance.


---

