<p>You could certainly do it in After Effects. If you <a href="https://helpx.adobe.com/after-effects/using/assorted-animation-tools.html#convert_audio_to_keyframes" rel="nofollow noreferrer">convert the audio levels to keyframes</a> you can then use expressions / the pickwhip to drive the opacity of the layers. After Effects is not free. I wouldn't be surprised if it was possible in Fusion (freemium) and certainly other compositing tools like Nuke or Apple Motion. <a href="https://natrongithub.github.io/" rel="nofollow noreferrer">Natron</a>, (free) may have the capability. There was an audio to ascii plugin, I don't think it still works though.</p>

<p>You could <a href="https://www.blendernation.com/2014/04/03/using-sound-to-drive-animation-in-blender/" rel="nofollow noreferrer">do it in Blender</a>, because of course you could do it in Blender. Blender is free. </p>

<p>For a more programmatic approach you could use something like Processing or OpenFrameworks (free). You need Java or C++ knowledge to use these.</p>

<p>It is definitely possible in all of these programs, though in none of them is it a beginner-level operation. The simplest workflow would probably be After Effects, though that might be my bias because it's the one I know best.</p>

CC BY-SA 4.0
2020-05-30T21:50:12.110Z
Perfect, I was missing the step to first go to keyframes when I was googling this. Thank you!
Kolichikov
CC BY-SA 4.0
2020-05-30T13:28:17.753Z
2020-05-30T13:28:17.753Z
stib
<p>I'm looking for an automagical way to create a Google Hangouts effect, ie.
 1. I have a number of files that are recordings of individual conversation members.
 2. I want to put together the video tracks into one project, and mask each one when the corresponding audio is silent (below some threshold), and to make it visible when there is audio from that audio track (so basically how Skype/Hangouts looks -> someone is talking, you see their webcam)</p>

<p>I haven't been able to find something like this using Google, or poking around in Premiere and Lightworks, but if it's available in another program, that would be great to know.</p>

<p>The mask doesn't need any motion tracking - either the entire screen is entirely transparent (audio), or entirely opaque (no audio).</p>

<p>Is there any way to do this automatically, or is it something that has to be manually put together?</p>

<video><mask><alpha>
Does any software have the capability to create a mask/alpha value based on the volume of an audio channel
Kolichikov
# Does any software have the capability to create a mask/alpha value based on the volume of an audio channel

(Asked by: username_0 on 2020-05-29)

I'm looking for an automagical way to create a Google Hangouts effect, ie.
1. I have a number of files that are recordings of individual conversation members.
2. I want to put together the video tracks into one project, and mask each one when the corresponding audio is silent (below some threshold), and to make it visible when there is audio from that audio track (so basically how Skype/Hangouts looks -> someone is talking, you see their webcam)

I haven't been able to find something like this using Google, or poking around in Premiere and Lightworks, but if it's available in another program, that would be great to know.

The mask doesn't need any motion tracking - either the entire screen is entirely transparent (audio), or entirely opaque (no audio).

Is there any way to do this automatically, or is it something that has to be manually put together?

**Tags:** video, mask, alpha


---

## 1 answers

### Answer by username_1 on 2020-05-30. Score: 0 | Accepted answer

You could certainly do it in After Effects. If you [convert the audio levels to keyframes](https://helpx.adobe.com/after-effects/using/assorted-animation-tools.html#convert_audio_to_keyframes) you can then use expressions / the pickwhip to drive the opacity of the layers. After Effects is not free. I wouldn't be surprised if it was possible in Fusion (freemium) and certainly other compositing tools like Nuke or Apple Motion. [Natron](https://natrongithub.github.io/), (free) may have the capability. There was an audio to ascii plugin, I don't think it still works though.

You could [do it in Blender](https://www.blendernation.com/2014/04/03/using-sound-to-drive-animation-in-blender/), because of course you could do it in Blender. Blender is free.

For a more programmatic approach you could use something like Processing or OpenFrameworks (free). You need Java or C++ knowledge to use these.

It is definitely possible in all of these programs, though in none of them is it a beginner-level operation. The simplest workflow would probably be After Effects, though that might be my bias because it's the one I know best.

> **Comments:**
> **username_0**: Perfect, I was missing the step to first go to keyframes when I was googling this. Thank you!  

---

