<p>This feature is called "motion detection" in the video surveillance jargon and can be found on most IP cameras and <a href="http://en.wikipedia.org/wiki/Network_Video_Recorder" rel="nofollow">NVRs</a>. There is a large variety of solutions out there depending on the level of accuracy that you need, the ability to divide the monitored perimeter into zones, whether the analytics run off a live or recorded feed, the OS that you use, and more.</p>

<p>If you look for something free and simple that just feeds you with XMLs then you might check <a href="https://github.com/johmathe/Shotdetect" rel="nofollow">Shotdetect</a>. If you look for more of a "solution" then check <a href="http://www.lavrsen.dk/foswiki/bin/view/Motion/MotionGuide" rel="nofollow">motion</a>, note that it is unix-specific.</p>

<p>It is also possible to use <code>ffmpeg</code> to extract thumbnails from your feed and run SNR comparisons on the fly, if you extract only I-Frames then the overhead is minimal. You are bound though to a detection rate that depends on your keyframe rate.</p>

<p>Try to provide some more detail regarding your operating system and overall use case for a more specific answer.</p>

CC BY-SA 3.0
2015-01-06T19:50:44.897Z
2015-01-06T19:50:44.897Z
avnr
<p>I assume you have multiple inputs and want some kind of automatic editing that will switch which feed is live based on what has activity at the time.  Unfortunately, pure changes in pixel values aren't really a super ideal way to tell what is interesting.</p>

<p>There are systems which handle automatic selection of the speaker such as Microsoft's RoundTable system which is able to recognize who is speaking based on position of the audio source and this kind of triggering is pretty common for source selection in things like WebEx and other meeting platforms.</p>

<p>You might be able to find something along the lines of what you are looking for in security software as well as security systems would want to display the most active frame.  In general, it probably isn't something you will find in most streaming systems though.  It would require a relatively high level of development to do well and the nicer streaming systems are going to be more about allowing an editor to directly control things as any high end stream is going to have a dedicated editor manning the console.</p>

CC BY-SA 3.0
2015-01-05T22:44:42.203Z
2015-01-05T22:44:42.203Z
AJ Henderson
<p>Are there any video encoders that can monitor multiple video frames and display whichever frame is the most active?  I would use this during a live streaming event and it would be great to automate the process.</p>

CC BY-SA 3.0
2015-01-05T21:10:24.947Z
Might be easier to suggest something if you explain the actual purpose?
tomh
<video><video-editor><multi-camera>
Video encoders that display frame with most movement
ljavor
# Video encoders that display frame with most movement

(Asked by: username_0 on 2015-01-05)

Are there any video encoders that can monitor multiple video frames and display whichever frame is the most active? I would use this during a live streaming event and it would be great to automate the process.

**Tags:** video, video-editor, multi-camera

> **Comments:**
> **username_1**: Might be easier to suggest something if you explain the actual purpose?  

---

## 2 answers

### Answer by username_2 on 2015-01-06. Score: 2

This feature is called "motion detection" in the video surveillance jargon and can be found on most IP cameras and [NVRs](http://en.wikipedia.org/wiki/Network_Video_Recorder). There is a large variety of solutions out there depending on the level of accuracy that you need, the ability to divide the monitored perimeter into zones, whether the analytics run off a live or recorded feed, the OS that you use, and more.

If you look for something free and simple that just feeds you with XMLs then you might check [Shotdetect](https://github.com/johmathe/Shotdetect). If you look for more of a "solution" then check [motion](http://www.lavrsen.dk/foswiki/bin/view/Motion/MotionGuide), note that it is unix-specific.

It is also possible to use `ffmpeg` to extract thumbnails from your feed and run SNR comparisons on the fly, if you extract only I-Frames then the overhead is minimal. You are bound though to a detection rate that depends on your keyframe rate.

Try to provide some more detail regarding your operating system and overall use case for a more specific answer.


---

### Answer by username_3 on 2015-01-05. Score: 1

I assume you have multiple inputs and want some kind of automatic editing that will switch which feed is live based on what has activity at the time. Unfortunately, pure changes in pixel values aren't really a super ideal way to tell what is interesting.

There are systems which handle automatic selection of the speaker such as Microsoft's RoundTable system which is able to recognize who is speaking based on position of the audio source and this kind of triggering is pretty common for source selection in things like WebEx and other meeting platforms.

You might be able to find something along the lines of what you are looking for in security software as well as security systems would want to display the most active frame. In general, it probably isn't something you will find in most streaming systems though. It would require a relatively high level of development to do well and the nicer streaming systems are going to be more about allowing an editor to directly control things as any high end stream is going to have a dedicated editor manning the console.


---

