Gordon's picture

Gordon

GordonM

·

https://gordonmcd.com

AI & ML interests

Data Science for good

Recent Activity

liked a Space about 1 month ago

webml-community/DINOv3-video-tracking

new activity about 1 month ago

webml-community/DINOv3-video-tracking:Negative points

reacted to Xenova's post with 🔥 about 1 month ago

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 Demo (+ source code): https://huggingface.co/spaces/webml-community/DINOv3-video-tracking This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 How does it work? 🤔 1️⃣ Generate and cache image features for each frame 2️⃣ Create a list of embeddings for selected patch(es) 3️⃣ Compute cosine similarity between each patch and the selected patch(es) 4️⃣ Highlight those whose score is above some threshold ... et voilà! 🥳 You can also make selections across frames to improve temporal consistency! This is super useful if the object changes its appearance slightly throughout the video. Excited to see what the community builds with it!

View all activity

Organizations

upvoted a collection about 1 year ago

Seamless Communication

A significant step towards removing language barriers through expressive, fast and high-quality AI translation. • 16 items • Updated Jan 16, 2024 • 158

upvoted a collection over 1 year ago

InternVL2.0

Expanding Performance Boundaries of Open-Source MLLM • 15 items • Updated Sep 28 • 89