54.9 F
Los Angeles
Saturday, December 9, 2023

ASUS Announces 2023 Vivobook Classic Series

On April 7, 2023, ASUS introduced five new models in the 2023 Vivobook Classic series of laptops. The top laptops in the series use the 13th Gen Intel® Core™...

Airman Arrested In Case of Leaked Classified Documents

Massachusetts Air National Guardsman Jack Teixeira has been arrested in the latest case of leaked classified documents. Teixeira, 21, is the head of Thug Shaker Central, an online gaming...

Microsoft OneNote to Gain Copilot

Microsoft 365 Copilot is coming to OneNote.
TechnologyProgrammingSearching video using audio and text

Searching video using audio and text

This CNet article on searching video by leveraging audio presents an interesting idea. Sounds like an interesting challenge. Working off of closed caption text makes sense too–assuming it exists.

Now let’s say you have a series of “video” cameras in your home, taking pictures all the time, and after Aunt Mini leaves for an afternoon visit, you want to ask the camera system to produce a picture of you and your aunt–that captures the surprise on her face when you gave her a birthday present. Here there wouldn’t be closed captioning to leverage, but a combination of audio, timeline motion indexing, and interactive selection by the user, in which you might locate just the right time from which you could tell the system to synthesize a picture from a perspective you want.

Here’s another “search” problem I find interesting. Imagine you’ve misplaced your sun glasses. You know it’s somewhere in the house. What if you could call up the vision system within the house to display your path throughout the house over the last two hours. It might sound invasive, but it could also help you find your glasses.

Lots of interesting technological issues here, such as archiving the video, combining mulitple video streams, indexing, a query and command language, synthesizing images from a virtual camera, and on and on.

Loren Heiny (1961 - 2010) was a software developer and author of several computer language textbooks. He graduated from Arizona State University in computer science. His first love was robotics.

Latest news

Related news