WO2004042652A3 - Method and apparatus for reduction of visual content - Google Patents

Method and apparatus for reduction of visual content Download PDF

Info

Publication number
WO2004042652A3
WO2004042652A3 PCT/US2003/033754 US0333754W WO2004042652A3 WO 2004042652 A3 WO2004042652 A3 WO 2004042652A3 US 0333754 W US0333754 W US 0333754W WO 2004042652 A3 WO2004042652 A3 WO 2004042652A3
Authority
WO
WIPO (PCT)
Prior art keywords
frames
visual
reduction
visual content
visual significance
Prior art date
Application number
PCT/US2003/033754
Other languages
French (fr)
Other versions
WO2004042652A2 (en
Inventor
Zhu Li
Bhavan Gandhi
Aggelos K Katsaggelos
Original Assignee
Motorola Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Inc filed Critical Motorola Inc
Priority to AU2003301775A priority Critical patent/AU2003301775A1/en
Priority to EP03810799A priority patent/EP1576539A4/en
Publication of WO2004042652A2 publication Critical patent/WO2004042652A2/en
Publication of WO2004042652A3 publication Critical patent/WO2004042652A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/147—Scene change detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/785—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using colour or luminescence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7847—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content
    • G06F16/786—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using low-level visual features of the video content using motion, e.g. object motion or camera motion
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/032—Electronic editing of digitised analogue information signals, e.g. audio or video signals on tapes
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection

Abstract

At least one visual significance metric is determined (12) for at least some frames belonging to an original series of frames (11). Key frames are identified (13) as a function, at least in part, of the visual significance metric. Cumulative visual significance values are then determined (14) for at least some of the frames that intervene between each pair of key frames. These cumulative visual significance values are then used to identify (15) frames of additional content interest. Various frames are then selected (16) for use in a visual summary. In one embodiment, all of the key frames and frames of additional content interest are selected for inclusion in the visual summary.
PCT/US2003/033754 2002-11-01 2003-10-22 Method and apparatus for reduction of visual content WO2004042652A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2003301775A AU2003301775A1 (en) 2002-11-01 2003-10-22 Method and apparatus for reduction of visual content
EP03810799A EP1576539A4 (en) 2002-11-01 2003-10-22 Method and apparatus for reduction of visual content

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/286,283 US6963378B2 (en) 2002-11-01 2002-11-01 Method and apparatus for reduction of visual content
US10/286,283 2002-11-01

Publications (2)

Publication Number Publication Date
WO2004042652A2 WO2004042652A2 (en) 2004-05-21
WO2004042652A3 true WO2004042652A3 (en) 2005-08-18

Family

ID=32175409

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/033754 WO2004042652A2 (en) 2002-11-01 2003-10-22 Method and apparatus for reduction of visual content

Country Status (4)

Country Link
US (1) US6963378B2 (en)
EP (1) EP1576539A4 (en)
AU (1) AU2003301775A1 (en)
WO (1) WO2004042652A2 (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3774662B2 (en) * 2000-12-27 2006-05-17 キヤノン株式会社 Image processing apparatus, image processing system, image processing method, program, and recording medium
US7664292B2 (en) * 2003-12-03 2010-02-16 Safehouse International, Inc. Monitoring an output from a camera
JP2005277981A (en) * 2004-03-26 2005-10-06 Seiko Epson Corp Target image selection for image processing
US8089563B2 (en) * 2005-06-17 2012-01-03 Fuji Xerox Co., Ltd. Method and system for analyzing fixed-camera video via the selection, visualization, and interaction with storyboard keyframes
BRPI0613902A2 (en) * 2005-07-27 2016-11-22 Koninkl Philips Electronics Nv method for organizing and providing a multimedia presentation summary, and apparatus for providing a summary of a multimedia presentation
US20070036227A1 (en) * 2005-08-15 2007-02-15 Faisal Ishtiaq Video encoding system and method for providing content adaptive rate control
EP1806919A1 (en) * 2006-01-05 2007-07-11 Alcatel Lucent Media delivery system with content-based trick play mode
US8681239B2 (en) * 2009-04-07 2014-03-25 Panasonic Corporation Image capturing device, image capturing method, program, and integrated circuit
US8229287B1 (en) 2009-08-31 2012-07-24 Adobe Systems Incorporated Multi-modal method for dynamically abridging and expanding media content
CN102184221B (en) * 2011-05-06 2012-12-19 北京航空航天大学 Real-time video abstract generation method based on user preferences
US9307269B2 (en) 2013-03-14 2016-04-05 Google Inc. Determining interest levels in videos
KR20180056655A (en) * 2015-09-25 2018-05-29 퀄컴 인코포레이티드 Systems and methods for video processing
WO2017049577A1 (en) 2015-09-25 2017-03-30 Qualcomm Incorporated Systems and methods for video processing
KR20170098079A (en) * 2016-02-19 2017-08-29 삼성전자주식회사 Electronic device method for video recording in electronic device
CN110990104B (en) * 2019-12-06 2023-04-11 珠海金山数字网络科技有限公司 Texture rendering method and device based on Unity3D

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5835163A (en) * 1995-12-21 1998-11-10 Siemens Corporate Research, Inc. Apparatus for detecting a cut in a video
US6549643B1 (en) * 1999-11-30 2003-04-15 Siemens Corporate Research, Inc. System and method for selecting key-frames of video data

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6055025A (en) * 1993-12-21 2000-04-25 Lucent Technologies, Inc. Method and apparatus for detecting abrupt and gradual scene changes in image sequences
US5635982A (en) * 1994-06-27 1997-06-03 Zhang; Hong J. System for automatic video segmentation and key frame extraction for video sequences having both sharp and gradual transitions
US5485611A (en) * 1994-12-30 1996-01-16 Intel Corporation Video database indexing and method of presenting video database index to a user
US5969755A (en) * 1996-02-05 1999-10-19 Texas Instruments Incorporated Motion based event detection system and method
US5956026A (en) * 1997-12-19 1999-09-21 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
US6331859B1 (en) * 1999-04-06 2001-12-18 Sharp Laboratories Of America, Inc. Video skimming system utilizing the vector rank filter
US6829395B2 (en) * 2000-01-20 2004-12-07 Axis, Ab Apparatus and method for storing and reading digital images
KR100512138B1 (en) 2000-03-08 2005-09-02 엘지전자 주식회사 Video Browsing System With Synthetic Key Frame
US6697523B1 (en) * 2000-08-09 2004-02-24 Mitsubishi Electric Research Laboratories, Inc. Method for summarizing a video using motion and color descriptors
JP3667262B2 (en) * 2000-08-19 2005-07-06 エルジー電子株式会社 Video skimming method and apparatus

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5835163A (en) * 1995-12-21 1998-11-10 Siemens Corporate Research, Inc. Apparatus for detecting a cut in a video
US6549643B1 (en) * 1999-11-30 2003-04-15 Siemens Corporate Research, Inc. System and method for selecting key-frames of video data

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1576539A4 *

Also Published As

Publication number Publication date
US6963378B2 (en) 2005-11-08
WO2004042652A2 (en) 2004-05-21
AU2003301775A1 (en) 2004-06-07
AU2003301775A8 (en) 2004-06-07
EP1576539A4 (en) 2008-07-09
US20040085483A1 (en) 2004-05-06
EP1576539A2 (en) 2005-09-21

Similar Documents

Publication Publication Date Title
WO2004042652A3 (en) Method and apparatus for reduction of visual content
CY1111971T1 (en) IMAGE DISCONNECTION METHOD AND DEVICE
WO2001080088A3 (en) Method of searching and producing matching color information
WO2003075127A3 (en) System and method for processing monitoring data using data profiles
WO2005034185A3 (en) System and method for on-tool semiconductor simulation
EP1381159A3 (en) Time limit function utilization apparatus
TW328629B (en) Production line analysis method and production line analysis device
WO2006072856A3 (en) An apparatus for and a method of processing reproducible data
WO2004056409A3 (en) Patient interface device or component selecting system and method
EP2533203A3 (en) Video-information decoding apparatus and method
WO2003067798A3 (en) State record processing
WO2004044842A3 (en) Method and apparatus for nonlinear multiple motion model and moving boundary extraction
EP0855823A3 (en) Display method, display apparatus and communication method
BR0012538A (en) Method and equipment for maintaining a target bit rate in a speech encoder
WO2003083604A3 (en) System and method to build project management processes
EP1752870A3 (en) Multiplier
WO2001063410A3 (en) System and method for implementing a project facility
WO2004006188A3 (en) Iterative compression parameters control for a sequence of images
WO2003090028A3 (en) Wavelet transform system, method and computer program product
WO2005069126A3 (en) A data processing apparatus and method for performing data processing operations on floating point data elements
WO2005008420A3 (en) Information processing apparatus and method
Karapetiants On behaviour of the norms of fractional integrals of large orders
Hao et al. The thickness precalculation of strip in computer control simulation system of cold rolling mill
Hutton Rebuilds retain their appeal
Sosnin Main terms and determination of the international standards for management of quality

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

REEP Request for entry into the european phase

Ref document number: 2003810799

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2003810799

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWP Wipo information: published in national office

Ref document number: 2003810799

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Ref document number: JP