<p>I do not know of any existing solutions for this in Premiere or AE.</p>

<p>However, if you know a little about programming, you might be able to write a script using OpenCV that runs <a href="https://github.com/tesseract-ocr/tesseract" rel="nofollow">Tesseract OCR</a> on video frames, and comes out with the text you want. Once you have the text and time codes, you definitely could write a script to build the titles at the appropriate time codes inside of AE or Premiere.</p>

<p>(I became aware of these open-source tools since I am currently building a mobile app that runs OCR on documents.)</p>

<p>Check out the <a href="http://docs.opencv.org/3.0-beta/modules/text/doc/ocr.html" rel="nofollow">Scene Text Recognition</a> docs for OpenCV, if you want to try that route.</p>

CC BY-SA 3.0
2016-07-15T13:17:41.073Z
So for this method you would need to output a series of still frames correct? Or does tesseract accept Video? If it doesn't accept video how would you easily tie the frame number to a timecode? Just count the frames?
Malco
CC BY-SA 3.0
2016-07-16T17:53:11.277Z
OpenCV can handle video, and the Scene Text Recognition docs I pointed to show how to call Tesseract on a frame through OpenCV. They have some C++ sample code there that might get you started, but OpenCV is also useable from Python, if that's more comfortable.
swizzlevixen
CC BY-SA 3.0
2016-07-16T17:59:41.480Z
As for timecode, OpenCV works in integer frame count, but you could use that directly when scripting in AE (and I assume Premiere), assuming the frame rate of the sequence matches.
swizzlevixen
CC BY-SA 3.0
2016-07-15T00:07:42.327Z
2016-07-15T00:07:42.327Z
swizzlevixen
<p>I am currently experimenting with after effects and premiere to see what sort of strange things they might be capable of and was hoping someone had some insight on an Idea I had.</p>

<p>In this situation I have some text, such as some subtitles or even a time code, that is burned into the footage. I do not have any of the project files for this footage, the only thing I have to work with is the final video.</p>

<p>Is there any way to have either Adobe Premiere or After Effects recognize what text is on screen automatically? Bonus points if it can then take this information and feed it into a new title element. </p>

<p>P.S. This is all assuming the source video's text is of decent quality (i.e. the text is static, decently distinguished from the video behind it, and not too tiny.)</p>

CC BY-SA 3.0
2016-02-11T03:10:55.990Z
You could export the frames as a frame sequence and then use OCR software on the frames. This would be a job for shell scripting or a programming language rather than AE or PP though.
stib
CC BY-SA 3.0
2016-02-11T14:12:00.767Z
@stib if you add this as an answer and provide some links to suggested software I will accept it.
Malco
<after-effects><premiere><post-production><after-effects-expressions><programming>
How to automatically pull text out of a video
Malco
# How to automatically pull text out of a video

(Asked by: username_0 on 2016-02-09)

I am currently experimenting with after effects and premiere to see what sort of strange things they might be capable of and was hoping someone had some insight on an Idea I had.

In this situation I have some text, such as some subtitles or even a time code, that is burned into the footage. I do not have any of the project files for this footage, the only thing I have to work with is the final video.

Is there any way to have either Adobe Premiere or After Effects recognize what text is on screen automatically? Bonus points if it can then take this information and feed it into a new title element.

P.S. This is all assuming the source video's text is of decent quality (i.e. the text is static, decently distinguished from the video behind it, and not too tiny.)

**Tags:** after-effects, premiere, post-production, after-effects-expressions, programming

> **Comments:**
> **username_1**: You could export the frames as a frame sequence and then use OCR software on the frames. This would be a job for shell scripting or a programming language rather than AE or PP though.  
> **username_0**: @username_1 if you add this as an answer and provide some links to suggested software I will accept it.  

---

## 1 answers

### Answer by username_2 on 2016-07-15. Score: 2 | Accepted answer

I do not know of any existing solutions for this in Premiere or AE.

However, if you know a little about programming, you might be able to write a script using OpenCV that runs [Tesseract OCR](https://github.com/tesseract-ocr/tesseract) on video frames, and comes out with the text you want. Once you have the text and time codes, you definitely could write a script to build the titles at the appropriate time codes inside of AE or Premiere.

(I became aware of these open-source tools since I am currently building a mobile app that runs OCR on documents.)

Check out the [Scene Text Recognition](http://docs.opencv.org/3.0-beta/modules/text/doc/ocr.html) docs for OpenCV, if you want to try that route.

> **Comments:**
> **username_0**: So for this method you would need to output a series of still frames correct? Or does tesseract accept Video? If it doesn't accept video how would you easily tie the frame number to a timecode? Just count the frames?  
> **username_2**: OpenCV can handle video, and the Scene Text Recognition docs I pointed to show how to call Tesseract on a frame through OpenCV. They have some C++ sample code there that might get you started, but OpenCV is also useable from Python, if that's more comfortable.  
> **username_2**: As for timecode, OpenCV works in integer frame count, but you could use that directly when scripting in AE (and I assume Premiere), assuming the frame rate of the sequence matches.  

---

