WO2004021221A3 - System and method for indexing a video sequence - Google Patents

System and method for indexing a video sequence Download PDF

Info

Publication number
WO2004021221A3
WO2004021221A3 PCT/US2003/026852 US0326852W WO2004021221A3 WO 2004021221 A3 WO2004021221 A3 WO 2004021221A3 US 0326852 W US0326852 W US 0326852W WO 2004021221 A3 WO2004021221 A3 WO 2004021221A3
Authority
WO
WIPO (PCT)
Prior art keywords
video sequence
camera
indexing
created
motion
Prior art date
Application number
PCT/US2003/026852
Other languages
French (fr)
Other versions
WO2004021221A2 (en
Inventor
Tong Zhang
Original Assignee
Hewlett Packard Development Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Development Co filed Critical Hewlett Packard Development Co
Priority to JP2004531568A priority Critical patent/JP4778231B2/en
Priority to EP03791857A priority patent/EP1532553A2/en
Priority to AU2003260112A priority patent/AU2003260112A1/en
Publication of WO2004021221A2 publication Critical patent/WO2004021221A2/en
Publication of WO2004021221A3 publication Critical patent/WO2004021221A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion

Abstract

A method and system for indexing a video sequence comprised of video information and audio information, wherein the video sequence has been created by at least one camera. The video sequence is separated into motion segments that were created while the camera was in motion and into still segments that were created while the camera was in a fixed position based on changes in the camera motion mode. Each still segment is partitioned into episodes based on changes in the audio information in each still segment, and the video sequence is indexed with an identifier that signifies at least a start or an end of an episode contained in the video sequence.
PCT/US2003/026852 2002-08-30 2003-08-29 System and method for indexing a video sequence WO2004021221A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2004531568A JP4778231B2 (en) 2002-08-30 2003-08-29 System and method for indexing video sequences
EP03791857A EP1532553A2 (en) 2002-08-30 2003-08-29 System and method for indexing a video sequence
AU2003260112A AU2003260112A1 (en) 2002-08-30 2003-08-29 System and method for indexing a video sequence

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/231,036 US7483624B2 (en) 2002-08-30 2002-08-30 System and method for indexing a video sequence
US10/231,036 2002-08-30

Publications (2)

Publication Number Publication Date
WO2004021221A2 WO2004021221A2 (en) 2004-03-11
WO2004021221A3 true WO2004021221A3 (en) 2004-07-15

Family

ID=31976656

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/026852 WO2004021221A2 (en) 2002-08-30 2003-08-29 System and method for indexing a video sequence

Country Status (5)

Country Link
US (1) US7483624B2 (en)
EP (1) EP1532553A2 (en)
JP (1) JP4778231B2 (en)
AU (1) AU2003260112A1 (en)
WO (1) WO2004021221A2 (en)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7375731B2 (en) * 2002-11-01 2008-05-20 Mitsubishi Electric Research Laboratories, Inc. Video mining using unsupervised clustering of video content
KR100609154B1 (en) * 2003-05-23 2006-08-02 엘지전자 주식회사 Video-contents playing method and apparatus using the same
US7904815B2 (en) * 2003-06-30 2011-03-08 Microsoft Corporation Content-based dynamic photo-to-video methods and apparatuses
WO2006073578A2 (en) * 2004-11-16 2006-07-13 Broadramp, Inc. System for rapid delivery of digital content via the internet
JP2006217060A (en) * 2005-02-01 2006-08-17 Sony Corp Recording apparatus, recording and reproducing apparatus, recording method, and recording and reproducing method
WO2006138519A2 (en) * 2005-06-15 2006-12-28 Flimp Media Inc. System and method of creating and tracking rich media communications
US20070250313A1 (en) * 2006-04-25 2007-10-25 Jiun-Fu Chen Systems and methods for analyzing video content
US8463924B2 (en) * 2007-02-02 2013-06-11 Apple Inc. Remote access of media items
US8238719B2 (en) * 2007-05-08 2012-08-07 Cyberlink Corp. Method for processing a sports video and apparatus thereof
KR20090015323A (en) * 2007-08-08 2009-02-12 (주)씨앤에스 테크놀로지 Apparatus and method for generating a still cut frame
KR100999655B1 (en) * 2009-05-18 2010-12-13 윤재민 Digital video recorder system and application method thereof
US8571330B2 (en) * 2009-09-17 2013-10-29 Hewlett-Packard Development Company, L.P. Video thumbnail selection
TW201122863A (en) * 2009-12-31 2011-07-01 Hon Hai Prec Ind Co Ltd Video search device, search system, and search method
JP5746766B2 (en) * 2010-08-02 2015-07-08 ペキン ユニバーシティ Extraction of typical motion flows for effective video classification and retrieval
US10134440B2 (en) * 2011-05-03 2018-11-20 Kodak Alaris Inc. Video summarization using audio and visual cues
CA2911834A1 (en) 2013-05-10 2014-11-13 Uberfan, Llc Event-related media management system
US9100701B2 (en) * 2013-07-31 2015-08-04 TCL Research America Inc. Enhanced video systems and methods
US10536758B2 (en) 2014-10-09 2020-01-14 Thuuz, Inc. Customized generation of highlight show with narrative component
US10433030B2 (en) 2014-10-09 2019-10-01 Thuuz, Inc. Generating a customized highlight sequence depicting multiple events
US11863848B1 (en) 2014-10-09 2024-01-02 Stats Llc User interface for interaction with customized highlight shows
US20180249056A1 (en) * 2015-08-18 2018-08-30 Lg Electronics Inc. Mobile terminal and method for controlling same
US20170065889A1 (en) * 2015-09-04 2017-03-09 Sri International Identifying And Extracting Video Game Highlights Based On Audio Analysis
US10390082B2 (en) * 2016-04-01 2019-08-20 Oath Inc. Computerized system and method for automatically detecting and rendering highlights from streaming videos
CN115103166A (en) * 2018-01-19 2022-09-23 深圳市大疆创新科技有限公司 Video processing method and terminal equipment
US11594028B2 (en) 2018-05-18 2023-02-28 Stats Llc Video processing for enabling sports highlights generation
US11025985B2 (en) 2018-06-05 2021-06-01 Stats Llc Audio processing for detecting occurrences of crowd noise in sporting event television programming
US11264048B1 (en) 2018-06-05 2022-03-01 Stats Llc Audio processing for detecting occurrences of loud sound characterized by brief audio bursts
CN111400511A (en) * 2020-03-12 2020-07-10 北京奇艺世纪科技有限公司 Multimedia resource interception method and device
CN112101196B (en) * 2020-09-14 2023-08-11 北京百度网讯科技有限公司 Data processing method, device, equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002007164A2 (en) * 2000-07-17 2002-01-24 The Trustees Of Columbia University In The City Of New York Method and system for indexing and content-based adaptive streaming of digital video content
WO2002021843A2 (en) * 2000-09-11 2002-03-14 Koninklijke Philips Electronics N.V. System to index/summarize audio/video content

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5635982A (en) * 1994-06-27 1997-06-03 Zhang; Hong J. System for automatic video segmentation and key frame extraction for video sequences having both sharp and gradual transitions
US5835667A (en) * 1994-10-14 1998-11-10 Carnegie Mellon University Method and apparatus for creating a searchable digital video library and a system and method of using such a library
US5485611A (en) * 1994-12-30 1996-01-16 Intel Corporation Video database indexing and method of presenting video database index to a user
JP4010598B2 (en) 1996-06-04 2007-11-21 株式会社日立国際電気 Video information editing method
US6389168B2 (en) * 1998-10-13 2002-05-14 Hewlett Packard Co Object-based parsing and indexing of compressed video streams
JP2000175149A (en) 1998-12-09 2000-06-23 Matsushita Electric Ind Co Ltd Video detector and summarized video image production device
US6748158B1 (en) * 1999-02-01 2004-06-08 Grass Valley (U.S.) Inc. Method for classifying and searching video databases based on 3-D camera motion
US6973256B1 (en) * 2000-10-30 2005-12-06 Koninklijke Philips Electronics N.V. System and method for detecting highlights in a video program using audio properties

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002007164A2 (en) * 2000-07-17 2002-01-24 The Trustees Of Columbia University In The City Of New York Method and system for indexing and content-based adaptive streaming of digital video content
WO2002021843A2 (en) * 2000-09-11 2002-03-14 Koninklijke Philips Electronics N.V. System to index/summarize audio/video content

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
HONGJIANG ZHANG ET AL: "AUTOMATIC PARTITIONING OF FULL-MOTION VIDEO", MULTIMEDIA SYSTEMS, SPRINGER VERLAG, DE, vol. 1, no. 1, 1993, pages 10 - 28, XP000572496, ISSN: 0942-4962 *
LI W ET AL: "VISION: A DIGITAL VIDEO LIBRARY", PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON DIGITAL LIBRARIES, XX, XX, 20 March 1996 (1996-03-20), pages 19 - 27, XP002910575 *

Also Published As

Publication number Publication date
AU2003260112A1 (en) 2004-03-19
JP4778231B2 (en) 2011-09-21
WO2004021221A2 (en) 2004-03-11
EP1532553A2 (en) 2005-05-25
JP2005538584A (en) 2005-12-15
US7483624B2 (en) 2009-01-27
US20040041831A1 (en) 2004-03-04

Similar Documents

Publication Publication Date Title
WO2004021221A3 (en) System and method for indexing a video sequence
AU2003241278A1 (en) System and method for indexing videos based on speaker distinction
EP1367588A3 (en) Review speed adjustment marker
WO2002086799A3 (en) Methods and apparatus for indexing and archiving encoded audio/video data
EP1487215A3 (en) Fast start-up for digital video streams
WO2005018217A3 (en) Semantics-based motion estimation for multi-view video coding
WO2006055349A3 (en) Apparatus and method of storing video data
WO2002087255A3 (en) Methods and apparatus for generating, including and using information relating to archived audio/video data
WO2003061280A3 (en) Commercial detection in audio-visual content based on scene change distances
WO2003096229A3 (en) Scalable video summarization and navigation system and method
WO2006024922A3 (en) Parameter set and picture header in video coding
EP1182584A3 (en) Method and apparatus for video skimming
WO2005086865A3 (en) Digital ad insertion for video-on-demand
AU2001272409A1 (en) Video coding
WO1999062251A3 (en) Method for storing compressed digital audio and video
WO2003039144A3 (en) Remote surveillance system
EP1024444A3 (en) Image information describing method, video retrieval method, video reproducing method, and video reproducing apparatus
WO2007089752A3 (en) Content substitution editor
EP2211549A3 (en) Video encoding method
EP1592015A3 (en) Method and device for recording or playing back a data stream
WO2005086981A3 (en) Methods and apparatuses for compressing digital image data with motion prediction
AU2003262945A1 (en) System and method for image compression, storage, and retrieval
WO2001050339A3 (en) Method and apparatus for detecting fast motion scenes
EP1089280A3 (en) Method of indexing and searching moving picture data using a motion activity description method
AU2003291519A1 (en) Hybrid scalable encoder, method, and media for standard-definition and high-definition video formats on a single-disc

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003791857

Country of ref document: EP

Ref document number: 2004531568

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 2003791857

Country of ref document: EP