<p>Consider an arm-cast device programmed to connect with, or be detected by, video editing software during post-production, for the application of video effects wherever the device appears in frame.</p>
<p>If someone in the video wears the arm cast, is filmed wearing it, and the video shoot finishes and recording is stopped, can the video editing software like Adobe Premiere Pro connect to or identify that device within the film, and apply some pre-set special effects to it in each video frame the arm cast appears?</p>
<p>Do wearable clothes or devices recognizable by video editing software exist like this? If so, link some examples</p>

CC BY-SA 4.0
2021-02-02T12:49:11.343Z
Premiere is not the type of software you’d use for this sort of thing. Cinema4D supports object tracking for 3D postproduction, and I’m sure other 3D apps do too.  But that’s offline, POSTproduction. The hot trend now is doing it real-time. Viacom is a big name in motion capture. Unreal Engine and Unity are big for real-time virtual environments, which can be combined with camera tracking, and possibly also object tracking. Houdini is good at creating procedural geometry to run on UE or Unity.
Jason Conrad
CC BY-SA 4.0
2021-02-02T12:54:07.637Z
As far as wearable goes, most trackers for 3D match moving are retroreflective spheres, about the size of a marble, that get fastened to the objects you want to track. With Viacom systems, the balls reflect infrared light that doesn’t interfere with the visible spectrum that other cameras on set are recording.
Jason Conrad
CC BY-SA 4.0
2021-02-02T15:17:42.490Z
could you provide a sample link to these reotroreflective spheres?
user610620
CC BY-SA 4.0
2021-02-02T15:21:46.437Z
https://optitrack.com/accessories/markers/
Jason Conrad
CC BY-SA 4.0
2021-02-02T15:24:05.110Z
are any $1,500 and under video camcorders compatible with Optitrack markers? or this is exclusively hollywood property
user610620
CC BY-SA 4.0
2021-02-02T15:24:20.833Z
There's a "hand kit" at the bottom of the page, which is like a pair of gloves for the markers.  Since you asked about an arm-cast device, maybe that's close?
Jason Conrad
CC BY-SA 4.0
2021-02-02T15:33:54.183Z
If I had to guess, I'd say that the off-the-shelf stuff is mostly expensive, but it hasn't stopped Do-it-Yourselfers, makers, engineers, and tech-savvy people from coming up with homegrown solutions.  This is a small VFX boutique of four young people who developed a pretty good system:   www.hivedivision.net and in this video of their work, you can tell that they use BlackMagic pocket cinema cameras.  The 4K model is in that price range.  https://youtu.be/ysIOi_MP_cs
Jason Conrad
CC BY-SA 4.0
2021-02-02T15:40:32.400Z
real aim is a face blurring mask, which means that The Avengers baring balls have to be worn on the face? are these as well accessible to amateurs and their software?
user610620
CC BY-SA 4.0
2021-02-02T15:48:30.383Z
You don’t need all that if you don’t need to do it real-time. If you can record it and then sit down and work on it for a month, you can do it in cinema4D. I’m not sure about blender or maya, but probably those too. For C4D, you don’t need the markers, but you do need a rigid piece of geometry in the real world of which you know the exact dimensions, and a matching 3D model of it. So, if you make a solid mask, that would work fine. C4D is lauded for its ease of use, but that doesn’t mean that it’s easy. Consider hiring someone who knows it, but don’t be afraid to give it a shot, either.
Jason Conrad
CC BY-SA 4.0
2021-02-02T16:01:42.180Z
This video shows the actor drawing dots on his face before editing the footage in cinema4D. Can tracking effects be applied post-production even without drawing dots beforehand? If not, how is that drawing dots work in lieu of Optitrack's baring ball markers? https://www.youtube.com/watch?v=Fj5H6-xuqqw
user610620
CC BY-SA 4.0
2021-02-03T08:33:02.740Z
The Viacom systems that use dots use multiple cameras to triangulate the exact 3D location of the markers, which is useful when you need to be very precise.  Drawn dots help with single-camera photogrammetric approaches which use automatic point trackers to "latch on" to an image.  The drawn dots aren't strictly necessary if the image contains enough texture/contrast/detail, and there isn't much motion or lens blur.  Some trackers, like Fusion are good without dots, but can only track one coord system at a time, so moving camera, but not also moving object.  C4d does both but needs help.
Jason Conrad
CC BY-SA 4.0
2021-02-03T08:41:09.743Z
OH, wait a minute.  I misunderstood you.  If all you're trying to do is anonymize someone's face by blurring it out, you don't need 3D tracking at all, 2D tracking is fine.  You don't need dots or markers.  Premiere and Resolve would work fine.  But if that's what you want to do, I'm confused about your original question.  What does "arm cast" mean?  Like a plaster cast for a broken arm?  What does that have to do with "real aim is a face blurring mask"?
Jason Conrad
CC BY-SA 4.0
2021-02-03T20:54:47.023Z
the difference is wearing a marker device that covers the area that we want edited, but in an automatic way (thus wearing it) so that that editor automatically knows what to do whenever the device appears on screen, rather than 2d motion tracking in an editor.
user610620
<premiere><video-editor><editing>
Wearable body gear that automatically evokes video effects during editing?
user610620
# Wearable body gear that automatically evokes video effects during editing?

(Asked by: username_0 on 2021-01-31)

Consider an arm-cast device programmed to connect with, or be detected by, video editing software during post-production, for the application of video effects wherever the device appears in frame.

If someone in the video wears the arm cast, is filmed wearing it, and the video shoot finishes and recording is stopped, can the video editing software like Adobe Premiere Pro connect to or identify that device within the film, and apply some pre-set special effects to it in each video frame the arm cast appears?

Do wearable clothes or devices recognizable by video editing software exist like this? If so, link some examples

**Tags:** premiere, video-editor, editing

> **Comments:**
> **username_1**: Premiere is not the type of software you’d use for this sort of thing. Cinema4D supports object tracking for 3D postproduction, and I’m sure other 3D apps do too.  But that’s offline, POSTproduction. The hot trend now is doing it real-time. Viacom is a big name in motion capture. Unreal Engine and Unity are big for real-time virtual environments, which can be combined with camera tracking, and possibly also object tracking. Houdini is good at creating procedural geometry to run on UE or Unity.  
> **username_1**: As far as wearable goes, most trackers for 3D match moving are retroreflective spheres, about the size of a marble, that get fastened to the objects you want to track. With Viacom systems, the balls reflect infrared light that doesn’t interfere with the visible spectrum that other cameras on set are recording.  
> **username_0**: could you provide a sample link to these reotroreflective spheres?  
> **username_1**: https://optitrack.com/accessories/markers/  
> **username_0**: are any $1,500 and under video camcorders compatible with Optitrack markers? or this is exclusively hollywood property  
> **username_1**: There's a "hand kit" at the bottom of the page, which is like a pair of gloves for the markers.  Since you asked about an arm-cast device, maybe that's close?  
> **username_1**: If I had to guess, I'd say that the off-the-shelf stuff is mostly expensive, but it hasn't stopped Do-it-Yourselfers, makers, engineers, and tech-savvy people from coming up with homegrown solutions.  This is a small VFX boutique of four young people who developed a pretty good system:   www.hivedivision.net and in this video of their work, you can tell that they use BlackMagic pocket cinema cameras.  The 4K model is in that price range.  https://youtu.be/ysIOi_MP_cs  
> **username_0**: real aim is a face blurring mask, which means that The Avengers baring balls have to be worn on the face? are these as well accessible to amateurs and their software?  
> **username_1**: You don’t need all that if you don’t need to do it real-time. If you can record it and then sit down and work on it for a month, you can do it in cinema4D. I’m not sure about blender or maya, but probably those too. For C4D, you don’t need the markers, but you do need a rigid piece of geometry in the real world of which you know the exact dimensions, and a matching 3D model of it. So, if you make a solid mask, that would work fine. C4D is lauded for its ease of use, but that doesn’t mean that it’s easy. Consider hiring someone who knows it, but don’t be afraid to give it a shot, either.  
> **username_0**: This video shows the actor drawing dots on his face before editing the footage in cinema4D. Can tracking effects be applied post-production even without drawing dots beforehand? If not, how is that drawing dots work in lieu of Optitrack's baring ball markers? https://www.youtube.com/watch?v=Fj5H6-xuqqw  
> **username_1**: The Viacom systems that use dots use multiple cameras to triangulate the exact 3D location of the markers, which is useful when you need to be very precise.  Drawn dots help with single-camera photogrammetric approaches which use automatic point trackers to "latch on" to an image.  The drawn dots aren't strictly necessary if the image contains enough texture/contrast/detail, and there isn't much motion or lens blur.  Some trackers, like Fusion are good without dots, but can only track one coord system at a time, so moving camera, but not also moving object.  C4d does both but needs help.  
> **username_1**: OH, wait a minute.  I misunderstood you.  If all you're trying to do is anonymize someone's face by blurring it out, you don't need 3D tracking at all, 2D tracking is fine.  You don't need dots or markers.  Premiere and Resolve would work fine.  But if that's what you want to do, I'm confused about your original question.  What does "arm cast" mean?  Like a plaster cast for a broken arm?  What does that have to do with "real aim is a face blurring mask"?  
> **username_0**: the difference is wearing a marker device that covers the area that we want edited, but in an automatic way (thus wearing it) so that that editor automatically knows what to do whenever the device appears on screen, rather than 2d motion tracking in an editor.  

---

## 0 answers

