US20140033092A1 - Associating Presence Information With A Digital Image - Google Patents

Associating Presence Information With A Digital Image Download PDF

Info

Publication number
US20140033092A1
US20140033092A1 US14/017,431 US201314017431A US2014033092A1 US 20140033092 A1 US20140033092 A1 US 20140033092A1 US 201314017431 A US201314017431 A US 201314017431A US 2014033092 A1 US2014033092 A1 US 2014033092A1
Authority
US
United States
Prior art keywords
image
presence information
digital image
identifier
interface control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/017,431
Inventor
Jeffrey S. Bardsley
Richard M. Horner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SCENERA MOBILE TECHNOLOGIES LLC
Original Assignee
Scenera Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Scenera Technologies LLC filed Critical Scenera Technologies LLC
Priority to US14/017,431 priority Critical patent/US20140033092A1/en
Assigned to IPAC ACQUISITION SUBSIDIARY I, LLC reassignment IPAC ACQUISITION SUBSIDIARY I, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BARDSLEY, JEFFREY SCOTT, HORNER, MARK
Assigned to SCENERA TECHNOLOGIES, LLC reassignment SCENERA TECHNOLOGIES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: IPAC ACQUISITION SUBSIDIARY I, LLC
Assigned to SCENERA MOBILE TECHNOLOGIES, LLC reassignment SCENERA MOBILE TECHNOLOGIES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SCENERA TECHNOLOGIES, LLC
Publication of US20140033092A1 publication Critical patent/US20140033092A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Definitions

  • the present invention relates to digital images and image metadata, and more particularly to a method and system for associating presence information with a digital image.
  • digital cameras have the ability to store data along with a captured image that may later be accessed by a viewer. For example, once the digital image has been transferred from the digital camera to a PC and displayed, a user may also view information about the image, such as date and time of capture, the name of the image, and image size, for instance.
  • the data regarding a captured image is stored in metadata within the image file of the captured image.
  • a conventional image file typically includes a header, image data itself, and the metadata.
  • the image file may optionally include a thumbnail image and/or a reference to audio data.
  • the header preferably includes information that identifies and describes the various contents of image file.
  • the image data contains actual captured image data, the resolution of which depends on the settings of the image capture device (e.g., camera, scanner, and the like).
  • the image metadata stores various types of data that correspond and relate to the image data.
  • the image metadata may be populated by the image capture device at the time of image capture, or subsequent to image capture by a user when cataloging the images.
  • the image metadata may comprise system metadata and user metadata.
  • System metadata is typically populated by the image capture device and includes various types of camera information that preserve command settings at the moment of capture and correlate with the captured image data.
  • system metadata may indicate focus setting, aperture setting, and other relevant information that may be used for effectively processing or analyzing the corresponding image data.
  • the data written to the system metadata is controlled by the camera or scanner and cannot be modified by the user.
  • the user metadata in contrast, enables the storage of data that the user enters on either a PC or on the image capture device. For example, most, if not all, images depict a scene that includes multiple objects (e.g., people, buildings, landmarks, nature, etc.). The user may wish to identify these objects by entering metadata describing the objects. Image applications exist that enable the user to do so by entering this information in text format. The text is then stored as user metadata and associated with the image. When the image is subsequently displayed using the same or a different image application, the metadata associated with the image is made available to the viewer. For example, the metadata may be displayed and/or printed as text along with the image.
  • objects e.g., people, buildings, landmarks, nature, etc.
  • Image applications exist that enable the user to do so by entering this information in text format.
  • the text is then stored as user metadata and associated with the image.
  • the metadata associated with the image is made available to the viewer. For example, the metadata may be displayed and/or printed as text along with the image.
  • the metadata may not adequately describe the image.
  • the metadata identifies the individual's names (e.g., Richard and Scott), as well as the houses (e.g., Richard's house and Scott's house) in the image.
  • Richard and Scott the individual's names
  • the user who entered the metadata may be able to provide more specific metadata (e.g., Richard is on the left and Scott is on the right).
  • the present invention provides a computer-implemented method and system for associating presence information with a digital image. Aspects of the preferred embodiment include allowing at least one identifier to be associated with at least one corresponding object depicted in a digital image; determining whether the at least one identifier is sufficient to obtain presence information; and displaying, in association with displaying the digital image, a user interface control configured to perform an action using the identified presence information if the identifier is sufficient to obtain the presence information.
  • the presence information includes contact information and a user interface control configured to initiate a communication using the contact information is provided. The viewer is thereby informed whether or not the object(s) in the image are available for communication.
  • the user interface control is displayed in place of at least part of the digital image.
  • FIG. 1 is a block diagram illustrating a system for associating presence information with objects depicted in a digital image in accordance with a preferred embodiment of the present invention.
  • FIG. 2 is a flow diagram illustrating a process for associating presence information with a digital image in accordance with a preferred embodiment of the present invention.
  • FIG. 3 shows an image with multiple identified objects, each having associated presence information where the presence information for each object is clearly indicated.
  • the present invention relates to associating presence information with digital images.
  • the following description is presented to enable one of ordinary skill in the art to make and use the invention and is provided in the context of a patent application and its requirements.
  • Various modifications to the preferred embodiments and the generic principles and features described herein will be readily apparent to those skilled in the art.
  • the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features described herein.
  • the present invention provides a method for associating presence information with one or more objects depicted in a digital image.
  • the presence information may then be used when the image is accessed to indicate not only who the people are (in the case where the objects are people), but also whether any of the people are available for communication, including real-time communication via chat or telephone, and/or non-real-time communication via e-mail or postage.
  • FIG. 1 is a block diagram illustrating a system for associating presence information with objects depicted in a digital image in accordance with a preferred embodiment of the present invention.
  • the system 10 includes one or more computing devices 12 in communication with a presence service 16 and an optional photosharing site 18 .
  • the computing device 12 which may be any electronic device, such as a camera phone, web-enabled digital camera, personal digital assistant (PDA), personal computer (PC) or photo kiosk, for example, includes a visual display device 24 and a network interface 32 .
  • PDA personal digital assistant
  • PC personal computer
  • Examples of the display device 24 may include liquid crystal display (LCD), organic light emitting diode (OLED), Plasma, or a projector, and examples types of network interfaces 32 include Ethernet, wireless, or a dial-up connection, which may access the network 14 (Internet) through a local area network (LAN) or wide area network (WAN).
  • LCD liquid crystal display
  • OLED organic light emitting diode
  • Plasma plasma
  • network interfaces 32 include Ethernet, wireless, or a dial-up connection, which may access the network 14 (Internet) through a local area network (LAN) or wide area network (WAN).
  • LAN local area network
  • WAN wide area network
  • a digital image 20 accessible by the computing device 12 is shown having associated image metadata 21 that describes and/or categorizes the image 20 .
  • the Exchangeable Image File Format for Digital Still Camera (EXIF) is an example of an international digital still camera image file format standard that supports attachment of tags to image files.
  • the images 20 may be stored as any file type including jpeg, tiff, or bmp, but may but also include video clips, and audio.
  • the images 20 may be captured by the computing device 12 or may be input from a variety of sources (not shown), such as a digital camera, compact disc (CD), digital versatile disc or digital video disc (DVD), or a scanner, for instance.
  • the image 20 may be stored on a storage device (not shown), such as a hard drive, CD recordable (CDR), DVD recordable (DVDR), or an imaging device attached to the computing device 12 .
  • An image application 26 capable of opening and displaying image data, such as an image viewer, a web browser, an instant messenger (IM) application, an operating system (OS), or other graphical user interface, opens and displays the image 20 on the visual display 24 .
  • the presence application 30 which may comprise an IM application, an email application, or other software application that utilizes presence information, accesses the presence service 16 .
  • the presence service 16 accepts information, stores presence information 34 , and distributes the presence information 34 to requesting services, including the presence application 30 .
  • the computing device 12 is further provided with an image presence component 28 , which in conjunction with the image application 26 and the presence application 30 , uses the identifier 22 to associate presence information 34 with the identified object and to make the presence information available to a user, as explained below.
  • FIG. 2 is a flow diagram illustrating a process for associating presence information with a digital image 20 in accordance with a preferred embodiment of the present invention.
  • the process begins in step 50 by allowing an identifier 22 associated with at least one of the objects depicted in the image 20 to be stored as image metadata 21 .
  • the identifier 22 is a means of indicating a point of contact, intended for public use such as on a business card. Names, telephone numbers, email addresses, postage address, and typical home page URLs are all examples of identifiers.
  • the identifier 22 may include information that is not intended for the public, such as employee and account numbers.
  • the image 20 may include multiple identifiers 22 that are associated with multiple objects depicted in the image 20 or multiple portions of the image may be associated with different identifier 22 .
  • the metadata 21 may be part of the image file 20 , or stored separately from the image 20 file.
  • the user may populate the metadata 21 with the identifier 22 using either the image applications 26 or the image presence component 28 .
  • the metadata 21 may be populated with the identifier 22 on an image capture device, such as a digital camera, capable of running the appropriate software.
  • the identifier 22 may be associated with a particular object depicted in the image 20 using the method disclosed in copending U.S. patent application Ser. No. 10/884,395 entitled “Method and System for More Precisely Linking Metadata and Digital Images,” (3204P/I249) filed on Jul. 2, 2004, which is assigned to the assignee of the present application and herein incorporated by reference.
  • the user selects a portion of the image 20 containing the object to which the user wishes to associate an identifier 20 using an application, such as the image application 26 .
  • the user selects a graphical element and positions the graphical element over the object or objects with which the identifier 22 is to be associated.
  • rectangles, ovals, circles, or other forms may be provided as preset shapes, or the user may simply draw a box or rectangle around the object using the cursor.
  • the user enters the identifier 22 .
  • the identifier 22 may be typically entered as text, the identifier 22 may be provided in audio format.
  • the identifier 22 is saved in the metadata 21 in association with the selected object. In one embodiment, the identifier 22 is stored with particular x-coordinates and y-coordinates of the object selected.
  • the identifier 22 is stored in the metadata 21 with the x-coordinates and y-coordinates of the rectangular graphical element.
  • the identifier 22 can be associated with a selected object in the image 20 , rather than only with the entire image. Repeating this process, the user can easily identify multiple objects in the image 20 .
  • the identifier 22 for multiple objects in the image 20 may be stored in a single metadata tag. In another embodiment, the identifier 22 for multiple objects in image 20 may be stored in separate metadata tags. In a preferred embodiment, the x, y coordinates are stored in a separate metadata tag from the identifier 22 . In an alternative embodiment, however, the x, y coordinates may be stored in the same metadata tag as the identifier 22 .
  • the identifier 22 is used to associate presence information with the object.
  • presence is a medium of communications over a network that is a means for finding, retrieving, and subscribing to changes in the presence information (e.g., “online” or “offline”) of other principals (i.e., real-world objects such as people or programs) where each of these principals users has presence information associated with them.
  • a principal is indirectly associated with a presence uniform resource identifier (URI) or uniform resource locator (URL) via the principal's presentity.
  • URI presence uniform resource identifier
  • URL uniform resource locator
  • a presentity (not shown) is the entity that supplies the presence information of the principal to the presence service 16 .
  • the format of the presence information may include an arbitrary number of elements, called presence tuples.
  • Each presence tuple includes a status that conveys status information (such as online, offline, busy, away, do not disturb) of a particular principal/presentity (e.g., user), an optional communication address, and optional other presence markup.
  • a communication address includes a contact means and a contact address.
  • One type of contact means is instant message service, where the corresponding contact address is an instant inbox address.
  • a contact means may also indicate one or more of the following: some form of telephony, for example, with a corresponding contact address containing a telephone number; email communications with a corresponding contact address containing an email address; or a physical mail service with a corresponding contact address containing a postal address.
  • the presence information includes general contact information for the principal, such as name, telephone number, email address, postal address, and IP addresses or URLs associated with the object, and the like.
  • presence information 34 is expanded such that presence information 34 may be associated with inanimate objects in addition to people, and the presence information 34 associated with the object may also include general contact information for the object in addition to, or in lieu of, the presence information as defined in RFC 2778 and RFC 2779. That is, if the presence information 34 associated with an object does not include a status, then the presence information 34 provided may be just general contact information.
  • the identifier 22 is used to associate presence information 34 with the identified object when the corresponding image 20 is accessed as follows. Referring to FIG. 1 , when the image 20 is accessed for display, for example by the image application 26 , the image application 26 sends the image data to the visual display 24 via a line 70 and passes the metadata 21 to the image presence component 28 via line 72 . The image presence component 28 parses the metadata 21 , and extracts any identifier 22 found. The image presence component 28 then determines whether the identifier 22 is a type sufficient to directly obtain the presence information associated with the identified object (e.g., a presence URL). In addition, the image presence component 28 examines the computing device configuration and determines the most appropriate method to obtain presence information associated with the object based on the computing device configuration and the type of identifier 22 .
  • a presence URL e.g., a presence URL
  • the identifier 22 is used to associate the presence information 34 with the identified object according to two embodiments.
  • the image presence component 28 sends the identifier 22 to the presence application 30 via line 74
  • the presence application 30 uses the identifier 22 to subscribe to the presence service 16 via line 76 to obtain the presence information 34 via line 78 .
  • the presence information 34 may include presence status and/or contact information, as explained above.
  • the image presence component 28 uses the identifier 22 to retrieve the presence information 34 associated with the identifier 22 found in an entry in a local presence roster list, such as an IM buddy list 36 .
  • the presence information 34 returned from the presence roster list 36 could be the presence status of the object (e.g., “online”).
  • the presence application 30 may query the presence roster list 36 with the identifier 22 to obtain the presence information 34 , such as the status.
  • the presence application 30 retrieves the presence information 34 from the presence roster list 36 .
  • the identifier 22 is used as an index to obtain the presence URL via a look-up or mapping operation, and the presence URL is then used to obtain the presence information 34 , as explained above. For example, if the identifier 22 is a telephone number or name, then the telephone number or name can be mapped to an email address, which is a sufficient type of presence URL to obtain the presence information 34 . Likewise, if the identifier 22 is an address, then the address can be used to obtain a name or telephone number, which can then be used to obtain the presence URL.
  • the identifier 22 can be validated to ensure that the format of the data is correct. For example, if the image presence component 28 determines that the identifier 22 is a telephone number, then the presence component 28 can validate that the telephone number has a valid prefix area code and/or the requisite number of digits.
  • an action related to the object is performed using the associated presence information 34 .
  • the action performed includes displaying the presence information 34 with the image 20 , printing the presence information 34 with the image 20 , or playing an audio reproduction of the content of the presence information 34 while the image 20 is viewed.
  • the viewer by providing the presence information 34 to a viewer in conjunction with the image 20 , the viewer is thereby informed who or what is depicted in the image 20 and whether or not the object(s) in the image are available for communication. If the presence information 34 includes status, then the viewer is informed whether the identified object is available for real-time communication.
  • means for using the identifier 22 to associate presence information 34 with the least one object and for performing an action related to the object using the presence information 34 includes a combination of the image application 26 , the image presence component 28 , the presence application 30 , and the presence service 16 , although the presence application 30 can be eliminated by implementing the presence component functionality in the image presence component 20 itself.
  • the presence information 34 is displayed as follows.
  • the presence application 30 passes the presence information 34 to the image presence component 28 via line 80
  • the presence component 28 passes the presence information 34 to the image application 26 via line 84
  • the image application 26 displays the presence information 34 via line 86 .
  • the image presence component 28 is used to provide the presence information 34 to the visual display 24 so that all the presence information 34 appears in the same format, regardless of whichever image application 26 is used.
  • the presence information 34 may be displayed in a variety of ways. In one embodiment, the presence information 34 may be displayed next to the image 20 . In another embodiment, the presence information 34 may be displayed in a window separate from the image 20 . Also, the presence information 34 from several presence IDs in one or more images 20 may be displayed as a group.
  • the presence information 34 is displayed over, or points to, a specific location in the image indicated by the x, y coordinates associated with the identifier 22 , as illustrated in FIG. 3 .
  • FIG. 3 shows an image 20 with multiple identified objects, each having associated presence information 34 where the presence information 34 for each object is clearly indicated. Note, some of the objects may include a status, while others may not, in which case only contact information would be shown.
  • the presence information 34 may be converted to HTML so that when a user moves a cursor or pointer over the region of the image 20 encompassed by the x, y coordinates, the presence information 34 is made available. For example, if the presence information 34 is text or sound, the presence information 34 may be displayed or heard, respectively, when the user passes a cursor or pointer over the portion of the image containing the identified object. In this embodiment, the user is allowed to manually access the presence information 34 .
  • the action performed related to the object using the associated presence information 34 includes opening a communication channel via the communication address associated with the object.
  • the user can manually contact the identified object by bringing up a communication method of choice, such as instant messenger, using any contact addresses displayed.
  • the image presence component can be configured to automatically start a default communication method using communication means included in the computing device 12 , such as invoking the instant messenger application when a user clicks on the presence status and opening a communication channel to the identified object using the network interface 32 .
  • a viewer may click on the displayed presence information 34 , which in turn, brings up a menu showing the connection options, such as email, chat, or phone.
  • the computing device may upload the image 20 to the photosharing site 18 for sharing the image 20 with others.
  • the photosharing site 18 may then use its own or an external image presence component 28 to extract the identifier 22 from the metadata 21 , and use the identifier 22 to obtain the presence information 34 , as explained above.
  • the computing device 12 Once connected to the network 14 , the computing device 12 has the capability of accessing images 20 hosted on the photosharing site 18 for viewing, in which case the photosharing site 16 would display the presence information 34 along with the image 20 .
  • Sally is looking at digital images on her PC. She clicks on an image of her sister Kate, which includes Kate's email address as the identifier 22 .
  • the image application 26 extracts the email address i.e. ⁇ kate@hotmail.com> (or presence URL, see Jabber specs i.e. jabber://kate@hotmail.com/MSN) of Kate from the image metadata 21 and connects to the presence service 16 (via the presence component 28 and presence application 30 ) to check Kate's presence status.
  • the presence service 16 returns presence information 34 indicating that Kate is “Available” and can be contacted by chat or email.
  • the image application 26 displays a green icon on top of Kate's image to show that she is “Available”.
  • the image contains metadata 21 that describes for each telephone number the location on the image that the person appears.
  • the phone's image application 26 extracts the telephone numbers from the image metadata 21 and adds them as contacts to the phones presence component 28 .
  • the image application 26 requests the presence for all the telephone numbers in the image from the presence component 28 .
  • the presence component 28 receives the presence information 34
  • the presence component 28 passes the presence information to the image application 26 , which combines the location information with the presence information 34 to display presence status over the image. So for those who are available the word “Available” appears over their image.
  • the photosharing site 18 reads the metadata 21 of all the images and extracts email addresses, telephone numbers, IP addresses and screen names. It uses a built-in presence service to obtain the presence and location of all the contacts.
  • the photosharing site 18 shows Michael all the images in his album and a consolidated list of all the contacts with their presence and location. He sees that his friend John is “Available” and his location is “Vail, Colo., USA”. He also sees that the ski team mascot, Hugs the stuffed Bear, is “Busy” and is located in “Vail, Colo., USA”. He decides to telephone John and ask him to take some more images of Hugs in action on the slopes.
  • the image presence component 28 searches the image metadata 21 and finds the identifier “John Brown of Raleigh, N.C., USA.” The image presence component 28 then performs a search of a contact database on the Internet using John's name and location to retrieve John's email address. The image presence component 28 then passes his email address to the presence service 16 . The presence service 16 finds a match for two presence URL's that are associated with the email address, one for John and one for John II, which are returned and displayed on Jean's device.
  • the image application 26 or image presence component 28 highlights the face of John on the image with a blue glow indicating that he is “Available” and updates the image's metadata 21 with a presence tag set to “Available”.
  • the ABC Company operates a heavy construction equipment rental and sales business.
  • the company website contains a catalogue of images depicting the equipment that the company has available.
  • Chuck is the employee in charge of the company website and decides to utilize a new technology which can include presence in relation to an image. Chuck wants to combine this technology with the instant messenger addresses of the sales people and the equipment images on the company website.
  • the sales people are specialized in handling the rental and sale of various types of equipment.
  • Bob Smith handles all transactions dealing with bull dozers and Jane Doe is responsible for all excavators.
  • Chuck's intention is to allow customers who visit ABC's website to click on an image and be connected to the sales person via an instant messenger chat. Now customers can be in direct communication with a sales person who can best answer questions in relation to the image that they clicked on.
  • the company has just purchased a JCD MX42 bull dozer, so Chuck takes a digital image of it and loads it into an image editor. In the editor he uses the image metadata editor to create a tag called “Sales Presence Id” and assigns it the presence URL of Bob Smith (jabber://bob.smith@abc.com/IM) the dozer sales contact. Chuck uploads the image to the company website.
  • Jake is a customer looking for the new JCD MX42 bull dozer, so he checks the ABC website. Finding the JCD MX42 bull dozer he clicks on the image. His web browser searches all the image metadata 21 looking for a presence URL, it finds one for Bob Smith. The browser makes a request to the ABC presence server for Bob Smith's presence information 34 . The presence server returns his status as “Available”, so the browser displays a green icon on the image of the JCD MX42 bull dozer. Jake has a question about the new dozer, so he clicks on the green icon and the browser uses the presence URL to start a chat session between Jake and Bob Smith. Jake sends a message asking if the new dozer has GPS. Bob Smith replies that it has GPS, so Jake places a rental order.
  • a method and system for associating presence information with a digital image has been disclosed.
  • the present invention has been described in accordance with the embodiments shown, and one of ordinary skill in the art will readily recognize that there could be variations to the embodiments, and any variations would be within the spirit and scope of the present invention.
  • the viewer may be required to be authenticated for obtaining presence information (e.g., by entering a username and password). Accordingly, many modifications may be made by one of ordinary skill in the art without departing from the spirit and scope of the appended claims.

Abstract

Providing for using presence information for an object in a digital image is provided. An association between an identifier and an object depicted in a portion of a digital image is indicated. Whether the identifier is sufficient to identify presence information for the object is determined. In association with displaying the digital image, a user interface control configured is provided to perform an action using the identified presence information if the identifier is sufficient to identify the presence information.

Description

    RELATED APPLICATIONS
  • This application is a continuation of U.S. patent application Ser. No. 13/267,236, titled “Associating Presence Information with a Digital Image,” filed on Oct. 6, 2011, which is a continuation of U.S. patent application Ser. No. 12/693,728, titled “Associating Presence Information with a Digital Image,” filed on Jan. 26, 2010 (issued Oct. 18, 2011 as U.S. Pat. No. 8,041,766), which is a continuation of U.S. patent application Ser. No. 11/170,709, titled “Associating Presence Information with a Digital Image,” filed on Jun. 27, 2005 (issued on Mar. 9, 2010 as U.S. Pat. No. 7,676,543), the entire disclosures of which are herein incorporated by reference. This application is related to U.S. patent application Ser. No. 10/884,395 entitled “Method and System for More Precisely Linking Metadata and Digital Images,” filed on Jul. 2, 2004, currently abandoned, which is assigned to the assignee of the present application and herein incorporated by reference.
  • FIELD OF THE INVENTION
  • The present invention relates to digital images and image metadata, and more particularly to a method and system for associating presence information with a digital image.
  • BACKGROUND
  • One advantage of digital cameras over digital film based cameras is that digital cameras have the ability to store data along with a captured image that may later be accessed by a viewer. For example, once the digital image has been transferred from the digital camera to a PC and displayed, a user may also view information about the image, such as date and time of capture, the name of the image, and image size, for instance. Typically, the data regarding a captured image is stored in metadata within the image file of the captured image.
  • A conventional image file typically includes a header, image data itself, and the metadata. The image file may optionally include a thumbnail image and/or a reference to audio data. The header preferably includes information that identifies and describes the various contents of image file. The image data contains actual captured image data, the resolution of which depends on the settings of the image capture device (e.g., camera, scanner, and the like). The image metadata stores various types of data that correspond and relate to the image data. The image metadata may be populated by the image capture device at the time of image capture, or subsequent to image capture by a user when cataloging the images.
  • The image metadata may comprise system metadata and user metadata. System metadata is typically populated by the image capture device and includes various types of camera information that preserve command settings at the moment of capture and correlate with the captured image data. For example, system metadata may indicate focus setting, aperture setting, and other relevant information that may be used for effectively processing or analyzing the corresponding image data. The data written to the system metadata is controlled by the camera or scanner and cannot be modified by the user.
  • The user metadata, in contrast, enables the storage of data that the user enters on either a PC or on the image capture device. For example, most, if not all, images depict a scene that includes multiple objects (e.g., people, buildings, landmarks, nature, etc.). The user may wish to identify these objects by entering metadata describing the objects. Image applications exist that enable the user to do so by entering this information in text format. The text is then stored as user metadata and associated with the image. When the image is subsequently displayed using the same or a different image application, the metadata associated with the image is made available to the viewer. For example, the metadata may be displayed and/or printed as text along with the image.
  • Although the conventional metadata allows the user to more fully describe the objects appearing in the image, there are limitations to the metadata. For instance, the metadata may not adequately describe the image. In particular, if the metadata describes more than one object depicted in an image, the user often has a difficult time determining which descriptions pertain to which object. For example, assume an image depicts two people and two houses, and the metadata identifies the individual's names (e.g., Richard and Scott), as well as the houses (e.g., Richard's house and Scott's house) in the image. In this case, a viewer who does not know Richard or Scott may be unable to correlate the names with the individuals and to the houses solely on the basis of the metadata that was provided in this example. The user who entered the metadata may be able to provide more specific metadata (e.g., Richard is on the left and Scott is on the right). However, this places a greater burden on the user to enter more information and requires the user to more carefully choose the terms used in the metadata.
  • In addition, while looking at a digital image taken in years past, it would be beneficial to users who view the image to be reminded or notified who (or what) is depicted in the image and whether or not the object(s) in the image are available for communication. Existing image applications fail to provide this functionality.
  • SUMMARY
  • The present invention provides a computer-implemented method and system for associating presence information with a digital image. Aspects of the preferred embodiment include allowing at least one identifier to be associated with at least one corresponding object depicted in a digital image; determining whether the at least one identifier is sufficient to obtain presence information; and displaying, in association with displaying the digital image, a user interface control configured to perform an action using the identified presence information if the identifier is sufficient to obtain the presence information.
  • According to the method and system disclosed herein, in a further embodiment, the presence information includes contact information and a user interface control configured to initiate a communication using the contact information is provided. The viewer is thereby informed whether or not the object(s) in the image are available for communication. In a further embodiment, the user interface control is displayed in place of at least part of the digital image.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram illustrating a system for associating presence information with objects depicted in a digital image in accordance with a preferred embodiment of the present invention.
  • FIG. 2 is a flow diagram illustrating a process for associating presence information with a digital image in accordance with a preferred embodiment of the present invention.
  • FIG. 3 shows an image with multiple identified objects, each having associated presence information where the presence information for each object is clearly indicated.
  • DETAILED DESCRIPTION
  • The present invention relates to associating presence information with digital images. The following description is presented to enable one of ordinary skill in the art to make and use the invention and is provided in the context of a patent application and its requirements. Various modifications to the preferred embodiments and the generic principles and features described herein will be readily apparent to those skilled in the art. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features described herein.
  • The present invention provides a method for associating presence information with one or more objects depicted in a digital image. The presence information may then be used when the image is accessed to indicate not only who the people are (in the case where the objects are people), but also whether any of the people are available for communication, including real-time communication via chat or telephone, and/or non-real-time communication via e-mail or postage.
  • FIG. 1 is a block diagram illustrating a system for associating presence information with objects depicted in a digital image in accordance with a preferred embodiment of the present invention. The system 10 includes one or more computing devices 12 in communication with a presence service 16 and an optional photosharing site 18. The computing device 12, which may be any electronic device, such as a camera phone, web-enabled digital camera, personal digital assistant (PDA), personal computer (PC) or photo kiosk, for example, includes a visual display device 24 and a network interface 32. Examples of the display device 24 may include liquid crystal display (LCD), organic light emitting diode (OLED), Plasma, or a projector, and examples types of network interfaces 32 include Ethernet, wireless, or a dial-up connection, which may access the network 14 (Internet) through a local area network (LAN) or wide area network (WAN).
  • A digital image 20 accessible by the computing device 12 is shown having associated image metadata 21 that describes and/or categorizes the image 20. The Exchangeable Image File Format for Digital Still Camera (EXIF) is an example of an international digital still camera image file format standard that supports attachment of tags to image files. The images 20 may be stored as any file type including jpeg, tiff, or bmp, but may but also include video clips, and audio. The images 20 may be captured by the computing device 12 or may be input from a variety of sources (not shown), such as a digital camera, compact disc (CD), digital versatile disc or digital video disc (DVD), or a scanner, for instance. The image 20 may be stored on a storage device (not shown), such as a hard drive, CD recordable (CDR), DVD recordable (DVDR), or an imaging device attached to the computing device 12.
  • An image application 26 capable of opening and displaying image data, such as an image viewer, a web browser, an instant messenger (IM) application, an operating system (OS), or other graphical user interface, opens and displays the image 20 on the visual display 24. The presence application 30, which may comprise an IM application, an email application, or other software application that utilizes presence information, accesses the presence service 16. The presence service 16 accepts information, stores presence information 34, and distributes the presence information 34 to requesting services, including the presence application 30.
  • According to the preferred embodiment, the computing device 12 is further provided with an image presence component 28, which in conjunction with the image application 26 and the presence application 30, uses the identifier 22 to associate presence information 34 with the identified object and to make the presence information available to a user, as explained below.
  • FIG. 2 is a flow diagram illustrating a process for associating presence information with a digital image 20 in accordance with a preferred embodiment of the present invention. Referring to both FIGS. 1 and 2, the process begins in step 50 by allowing an identifier 22 associated with at least one of the objects depicted in the image 20 to be stored as image metadata 21. In a preferred embodiment, the identifier 22 is a means of indicating a point of contact, intended for public use such as on a business card. Names, telephone numbers, email addresses, postage address, and typical home page URLs are all examples of identifiers. However, in an alternative embodiment, in some business contexts, the identifier 22 may include information that is not intended for the public, such as employee and account numbers.
  • Although only one identifier 22 is shown, the image 20 may include multiple identifiers 22 that are associated with multiple objects depicted in the image 20 or multiple portions of the image may be associated with different identifier 22. As stated above, the metadata 21 may be part of the image file 20, or stored separately from the image 20 file.
  • In one embodiment, the user may populate the metadata 21 with the identifier 22 using either the image applications 26 or the image presence component 28. In an alternative embodiment where the computing device 12 is a PC, the metadata 21 may be populated with the identifier 22 on an image capture device, such as a digital camera, capable of running the appropriate software.
  • In one embodiment, the identifier 22 may be associated with a particular object depicted in the image 20 using the method disclosed in copending U.S. patent application Ser. No. 10/884,395 entitled “Method and System for More Precisely Linking Metadata and Digital Images,” (3204P/I249) filed on Jul. 2, 2004, which is assigned to the assignee of the present application and herein incorporated by reference. In this method, the user selects a portion of the image 20 containing the object to which the user wishes to associate an identifier 20 using an application, such as the image application 26. In one embodiment, the user selects a graphical element and positions the graphical element over the object or objects with which the identifier 22 is to be associated. For example, rectangles, ovals, circles, or other forms may be provided as preset shapes, or the user may simply draw a box or rectangle around the object using the cursor. After selecting the object, the user enters the identifier 22. Although the identifier 22 may be typically entered as text, the identifier 22 may be provided in audio format. After the identifier 22 is entered, and identifier 22 is saved in the metadata 21 in association with the selected object. In one embodiment, the identifier 22 is stored with particular x-coordinates and y-coordinates of the object selected. For example, if a rectangular graphical element is selected, sized, and positioned around the object(s), then the identifier 22 is stored in the metadata 21 with the x-coordinates and y-coordinates of the rectangular graphical element. Using this method, the identifier 22 can be associated with a selected object in the image 20, rather than only with the entire image. Repeating this process, the user can easily identify multiple objects in the image 20.
  • In one embodiment, the identifier 22 for multiple objects in the image 20 may be stored in a single metadata tag. In another embodiment, the identifier 22 for multiple objects in image 20 may be stored in separate metadata tags. In a preferred embodiment, the x, y coordinates are stored in a separate metadata tag from the identifier 22. In an alternative embodiment, however, the x, y coordinates may be stored in the same metadata tag as the identifier 22.
  • After the image 20 and the identifier 22 are made available, in step 52, the identifier 22 is used to associate presence information with the object. As is well-known in the art, presence is a medium of communications over a network that is a means for finding, retrieving, and subscribing to changes in the presence information (e.g., “online” or “offline”) of other principals (i.e., real-world objects such as people or programs) where each of these principals users has presence information associated with them. A principal is indirectly associated with a presence uniform resource identifier (URI) or uniform resource locator (URL) via the principal's presentity. A presentity (not shown) is the entity that supplies the presence information of the principal to the presence service 16.
  • As described in A Model for Presence and Instant Messaging (RFC 2778) and Instant Messaging/Presence Protocol Requirements (RFC 2779) published by the IMPP WG, the format of the presence information may include an arbitrary number of elements, called presence tuples. Each presence tuple includes a status that conveys status information (such as online, offline, busy, away, do not disturb) of a particular principal/presentity (e.g., user), an optional communication address, and optional other presence markup. A communication address includes a contact means and a contact address. One type of contact means is instant message service, where the corresponding contact address is an instant inbox address. However, a contact means may also indicate one or more of the following: some form of telephony, for example, with a corresponding contact address containing a telephone number; email communications with a corresponding contact address containing an email address; or a physical mail service with a corresponding contact address containing a postal address. Thus, broadly speaking, the presence information includes general contact information for the principal, such as name, telephone number, email address, postal address, and IP addresses or URLs associated with the object, and the like.
  • As used herein, the definition of presence information 34 is expanded such that presence information 34 may be associated with inanimate objects in addition to people, and the presence information 34 associated with the object may also include general contact information for the object in addition to, or in lieu of, the presence information as defined in RFC 2778 and RFC 2779. That is, if the presence information 34 associated with an object does not include a status, then the presence information 34 provided may be just general contact information.
  • In a preferred embodiment, the identifier 22 is used to associate presence information 34 with the identified object when the corresponding image 20 is accessed as follows. Referring to FIG. 1, when the image 20 is accessed for display, for example by the image application 26, the image application 26 sends the image data to the visual display 24 via a line 70 and passes the metadata 21 to the image presence component 28 via line 72. The image presence component 28 parses the metadata 21, and extracts any identifier 22 found. The image presence component 28 then determines whether the identifier 22 is a type sufficient to directly obtain the presence information associated with the identified object (e.g., a presence URL). In addition, the image presence component 28 examines the computing device configuration and determines the most appropriate method to obtain presence information associated with the object based on the computing device configuration and the type of identifier 22.
  • If the identifier 22 is a type sufficient to directly obtain the presence information associated with the identified object (e.g., is a presence URL), then the identifier 22 is used to associate the presence information 34 with the identified object according to two embodiments. In one embodiment, the image presence component 28 sends the identifier 22 to the presence application 30 via line 74, and the presence application 30 uses the identifier 22 to subscribe to the presence service 16 via line 76 to obtain the presence information 34 via line 78. In this embodiment, the presence information 34 may include presence status and/or contact information, as explained above.
  • In a second embodiment, the image presence component 28 uses the identifier 22 to retrieve the presence information 34 associated with the identifier 22 found in an entry in a local presence roster list, such as an IM buddy list 36. In this embodiment, the presence information 34 returned from the presence roster list 36 could be the presence status of the object (e.g., “online”). Alternatively, the presence application 30 may query the presence roster list 36 with the identifier 22 to obtain the presence information 34, such as the status. In an alternative embodiment, the presence application 30 retrieves the presence information 34 from the presence roster list 36.
  • If the identifier 22 is not a type sufficient to directly obtain the presence information associated with the identified object (e.g., is not a presence URL), then the identifier 22 is used as an index to obtain the presence URL via a look-up or mapping operation, and the presence URL is then used to obtain the presence information 34, as explained above. For example, if the identifier 22 is a telephone number or name, then the telephone number or name can be mapped to an email address, which is a sufficient type of presence URL to obtain the presence information 34. Likewise, if the identifier 22 is an address, then the address can be used to obtain a name or telephone number, which can then be used to obtain the presence URL. Prior to performing the lookup or mapping operation, the identifier 22 can be validated to ensure that the format of the data is correct. For example, if the image presence component 28 determines that the identifier 22 is a telephone number, then the presence component 28 can validate that the telephone number has a valid prefix area code and/or the requisite number of digits.
  • Referring again to 2, after the presence application 30 receives the presence information 34 from the presence service, in step 54, an action related to the object is performed using the associated presence information 34. In a preferred embodiment, the action performed includes displaying the presence information 34 with the image 20, printing the presence information 34 with the image 20, or playing an audio reproduction of the content of the presence information 34 while the image 20 is viewed.
  • According to the preferred embodiment, by providing the presence information 34 to a viewer in conjunction with the image 20, the viewer is thereby informed who or what is depicted in the image 20 and whether or not the object(s) in the image are available for communication. If the presence information 34 includes status, then the viewer is informed whether the identified object is available for real-time communication.
  • In a preferred embodiment, means for using the identifier 22 to associate presence information 34 with the least one object and for performing an action related to the object using the presence information 34 includes a combination of the image application 26, the image presence component 28, the presence application 30, and the presence service 16, although the presence application 30 can be eliminated by implementing the presence component functionality in the image presence component 20 itself.
  • Referring again to FIG. 1, in a preferred embodiment, the presence information 34 is displayed as follows. The presence application 30 passes the presence information 34 to the image presence component 28 via line 80, the presence component 28 passes the presence information 34 to the image application 26 via line 84, and the image application 26 displays the presence information 34 via line 86. In an alternative embodiment, the image presence component 28 is used to provide the presence information 34 to the visual display 24 so that all the presence information 34 appears in the same format, regardless of whichever image application 26 is used.
  • The presence information 34 may be displayed in a variety of ways. In one embodiment, the presence information 34 may be displayed next to the image 20. In another embodiment, the presence information 34 may be displayed in a window separate from the image 20. Also, the presence information 34 from several presence IDs in one or more images 20 may be displayed as a group.
  • In a preferred embodiment, the presence information 34 is displayed over, or points to, a specific location in the image indicated by the x, y coordinates associated with the identifier 22, as illustrated in FIG. 3. FIG. 3 shows an image 20 with multiple identified objects, each having associated presence information 34 where the presence information 34 for each object is clearly indicated. Note, some of the objects may include a status, while others may not, in which case only contact information would be shown.
  • In another embodiment, the presence information 34 may be converted to HTML so that when a user moves a cursor or pointer over the region of the image 20 encompassed by the x, y coordinates, the presence information 34 is made available. For example, if the presence information 34 is text or sound, the presence information 34 may be displayed or heard, respectively, when the user passes a cursor or pointer over the portion of the image containing the identified object. In this embodiment, the user is allowed to manually access the presence information 34.
  • In a further embodiment, the action performed related to the object using the associated presence information 34 includes opening a communication channel via the communication address associated with the object. After the presence information is displayed, the user can manually contact the identified object by bringing up a communication method of choice, such as instant messenger, using any contact addresses displayed. Or the image presence component can be configured to automatically start a default communication method using communication means included in the computing device 12, such as invoking the instant messenger application when a user clicks on the presence status and opening a communication channel to the identified object using the network interface 32. In another embodiment, a viewer may click on the displayed presence information 34, which in turn, brings up a menu showing the connection options, such as email, chat, or phone.
  • In a further embodiment, the computing device may upload the image 20 to the photosharing site 18 for sharing the image 20 with others. When photosharing site 18 receives requests to view the image 20, the photosharing site 18 may then use its own or an external image presence component 28 to extract the identifier 22 from the metadata 21, and use the identifier 22 to obtain the presence information 34, as explained above. Once connected to the network 14, the computing device 12 has the capability of accessing images 20 hosted on the photosharing site 18 for viewing, in which case the photosharing site 16 would display the presence information 34 along with the image 20.
  • Several user scenarios are provided below to further illustrate operation and advantages of the system 10 for associating presence information 34 with digital images 20.
  • Scenario 1
  • Sally is looking at digital images on her PC. She clicks on an image of her sister Kate, which includes Kate's email address as the identifier 22. The image application 26 extracts the email address i.e. <kate@hotmail.com> (or presence URL, see Jabber specs i.e. jabber://kate@hotmail.com/MSN) of Kate from the image metadata 21 and connects to the presence service 16 (via the presence component 28 and presence application 30) to check Kate's presence status. The presence service 16 returns presence information 34 indicating that Kate is “Available” and can be contacted by chat or email. The image application 26 displays a green icon on top of Kate's image to show that she is “Available”. Sally sees that Kate is available and clicks on the green icon, which brings up a menu showing the connection options of email or chat. Sally selects chat, so the image application 26 starts the default chat application on the PC and instructs it to start a new chat session using Kate's email address as the person to contact. Sally and Kate then chat.
  • Scenario 2
  • Eric is looking at an image of his family on his mobile phone. Each family member has a telephone number identifier 22 associated with them. The image contains metadata 21 that describes for each telephone number the location on the image that the person appears. Eric presses a “Determine Status” key on his phone. In response, the phone's image application 26 extracts the telephone numbers from the image metadata 21 and adds them as contacts to the phones presence component 28. The image application 26 requests the presence for all the telephone numbers in the image from the presence component 28. When the presence component 28 receives the presence information 34, the presence component 28 passes the presence information to the image application 26, which combines the location information with the presence information 34 to display presence status over the image. So for those who are available the word “Available” appears over their image.
  • Scenario 3
  • Michael is looking at digital images on his photosharing site 16. The photosharing site 18 reads the metadata 21 of all the images and extracts email addresses, telephone numbers, IP addresses and screen names. It uses a built-in presence service to obtain the presence and location of all the contacts. The photosharing site 18 shows Michael all the images in his album and a consolidated list of all the contacts with their presence and location. He sees that his friend John is “Available” and his location is “Vail, Colo., USA”. He also sees that the ski team mascot, Hugs the stuffed Bear, is “Busy” and is located in “Vail, Colo., USA”. He decides to telephone John and ask him to take some more images of Hugs in action on the slopes.
  • Scenario 4
  • Jean is looking at an image of a friend. She selects the image and selects the “Determine Presence” option (Sally has configured the image application 26 not to automatically determine presence). The image presence component 28 searches the image metadata 21 and finds the identifier “John Brown of Raleigh, N.C., USA.” The image presence component 28 then performs a search of a contact database on the Internet using John's name and location to retrieve John's email address. The image presence component 28 then passes his email address to the presence service 16. The presence service 16 finds a match for two presence URL's that are associated with the email address, one for John and one for John II, which are returned and displayed on Jean's device. Jean picks the one for John, assuming that John II is his son, and the application retrieves the presence status for John if it was not already returned with the presence URL's. The image application 26 or image presence component 28 highlights the face of John on the image with a blue glow indicating that he is “Available” and updates the image's metadata 21 with a presence tag set to “Available”.
  • Scenario 5
  • The ABC Company operates a heavy construction equipment rental and sales business. The company website contains a catalogue of images depicting the equipment that the company has available. Chuck is the employee in charge of the company website and decides to utilize a new technology which can include presence in relation to an image. Chuck wants to combine this technology with the instant messenger addresses of the sales people and the equipment images on the company website. The sales people are specialized in handling the rental and sale of various types of equipment. Bob Smith handles all transactions dealing with bull dozers and Jane Doe is responsible for all excavators. Chuck's intention is to allow customers who visit ABC's website to click on an image and be connected to the sales person via an instant messenger chat. Now customers can be in direct communication with a sales person who can best answer questions in relation to the image that they clicked on.
  • The company has just purchased a JCD MX42 bull dozer, so Chuck takes a digital image of it and loads it into an image editor. In the editor he uses the image metadata editor to create a tag called “Sales Presence Id” and assigns it the presence URL of Bob Smith (jabber://bob.smith@abc.com/IM) the dozer sales contact. Chuck uploads the image to the company website.
  • Jake is a customer looking for the new JCD MX42 bull dozer, so he checks the ABC website. Finding the JCD MX42 bull dozer he clicks on the image. His web browser searches all the image metadata 21 looking for a presence URL, it finds one for Bob Smith. The browser makes a request to the ABC presence server for Bob Smith's presence information 34. The presence server returns his status as “Available”, so the browser displays a green icon on the image of the JCD MX42 bull dozer. Jake has a question about the new dozer, so he clicks on the green icon and the browser uses the presence URL to start a chat session between Jake and Bob Smith. Jake sends a message asking if the new dozer has GPS. Bob Smith replies that it has GPS, so Jake places a rental order.
  • A method and system for associating presence information with a digital image has been disclosed. The present invention has been described in accordance with the embodiments shown, and one of ordinary skill in the art will readily recognize that there could be variations to the embodiments, and any variations would be within the spirit and scope of the present invention. For example, the viewer may be required to be authenticated for obtaining presence information (e.g., by entering a username and password). Accordingly, many modifications may be made by one of ordinary skill in the art without departing from the spirit and scope of the appended claims.

Claims (24)

We claim:
1. A method for providing for using presence information for an object in a digital image, comprising:
indicating an association between an identifier and an object depicted in a portion of a digital image;
determining whether the identifier is sufficient to identify presence information for the object; and
providing, in association with displaying the digital image, a user interface control configured to perform an action using the identified presence information if the identifier is sufficient to identify the presence information;
wherein at least one of the preceding actions is performed on at least one electronic hardware component.
2. The method of claim 1, comprising receiving user input for associating the identifier with the object depicted in the portion of the digital image.
3. The method of claim 1, wherein indicating an association between an identifier and an object depicted in a portion of a digital image includes presenting a graphic overlay indicating the object in the portion of the digital image.
4. The method of claim 1, wherein determining whether the identifier is sufficient to identify presence information for the object includes identifying presence information from one of a presence application and a roster list.
5. The method of claim 1, wherein the presence information includes contact information and providing a user interface control includes providing a user interface control configured to initiate a communication using the contact information.
6. The method of claim 5, wherein the communication is one of an email, a text message, and a phone call.
7. The method of claim 6 wherein in response to receiving a communication selection, the user interface control is further configured to initiate the communication based on the received communication selection.
8. The method of claim 1, wherein providing a user interface control includes displaying an indicator indicating that presence information is available if the identifier is sufficient to identify the presence information.
9. The method of claim 8 wherein in response to receiving a selection of the indicator, providing a second interface control configured to display at least one of status and connection options.
10. The method of claim 1 wherein providing the user interface control includes displaying the presence information.
11. The method of claim 1 wherein providing, in association with displaying the digital image, a user interface control configured to perform an action using the identified presence information includes displaying the user interface control in place of at least part of the digital image.
12. The method of claim 11 wherein displaying the user interface control in place of at least part of the digital image includes displaying the user interface control in place of the at least part of the digital image in response to user input.
13. The method of claim 11 wherein displaying the user interface control in place of at least part of the digital image includes displaying at least one of an icon and text.
14. A non-transitory computer readable medium storing a computer program, executable by a machine, for obtaining presence information for at least one object in a digital image, the computer program comprising executable instructions for:
indicating an association between an identifier and an object depicted in a portion of a digital image;
determining whether the identifier is sufficient to identify presence information for the object; and
providing, in association with displaying the digital image, a user interface control configured to perform an action using the identified presence information if the identifier is sufficient to identify the presence information;
wherein at least one of the preceding actions is performed on at least one electronic hardware component.
15. An image system for providing for using presence information for an object in a digital image, comprising system components including:
an image presence component configured to indicate an association between an identifier and an object depicted in a portion of a digital image;
the image presence component further configured to determine whether the identifier is sufficient to identify presence information for the object; and
an image component configured to provide, in association with displaying the digital image, a user interface control configured to perform an action using the identified presence information if the identifier is sufficient to identify the presence information;
wherein at least one of the preceding actions is performed on at least one electronic hardware component.
16. The system of claim 15, wherein the image component is further configured to receive user input for associating the identifier with the object depicted in the portion of the digital image.
17. The system of claim 15, wherein in indicating an association between an identifier and an object depicted in a portion of a digital image, the image component is configured to present a graphic overlay indicating the object in the portion of the digital image.
18. The system of claim 15, wherein in determining whether the identifier is sufficient to identify presence information for the object, the image presence component is configured to identify presence information from one of a presence application and a roster list.
19. The system of claim 18, wherein the presence information includes contact information and in providing a user interface control, the image component is configured to provide a user interface control configured to initiate a communication using the contact information.
20. The system of claim 19, wherein the communication is one of an email, a text message, and a phone call.
21. The system of claim 20, wherein in response to receiving a communication selection, the user interface control is further configured to initiate the communication based on the received communication selection.
22. The system of claim 15 wherein in providing, in association with displaying the digital image, a user interface control configured to perform an action using the identified presence information, the image component is further configured to display the user interface control in place of at least part of the digital image.
23. The system of claim 22 wherein in displaying the user interface control in place of at least part of the digital image, the image component is further configured to display the user interface control in place of the at least part of the digital image in response to user input.
24. The system of claim 22 wherein in displaying the user interface control in place of at least part of the digital image, the image component is further configured to display at least one of an icon and text.
US14/017,431 2005-06-27 2013-09-04 Associating Presence Information With A Digital Image Abandoned US20140033092A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/017,431 US20140033092A1 (en) 2005-06-27 2013-09-04 Associating Presence Information With A Digital Image

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US11/170,709 US7676543B2 (en) 2005-06-27 2005-06-27 Associating presence information with a digital image
US12/693,728 US8041766B2 (en) 2005-06-27 2010-01-26 Associating presence information with a digital image
US13/267,236 US8533265B2 (en) 2005-06-27 2011-10-06 Associating presence information with a digital image
US14/017,431 US20140033092A1 (en) 2005-06-27 2013-09-04 Associating Presence Information With A Digital Image

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/267,236 Continuation US8533265B2 (en) 2005-06-27 2011-10-06 Associating presence information with a digital image

Publications (1)

Publication Number Publication Date
US20140033092A1 true US20140033092A1 (en) 2014-01-30

Family

ID=37619423

Family Applications (4)

Application Number Title Priority Date Filing Date
US11/170,709 Expired - Fee Related US7676543B2 (en) 2005-06-27 2005-06-27 Associating presence information with a digital image
US12/693,728 Expired - Fee Related US8041766B2 (en) 2005-06-27 2010-01-26 Associating presence information with a digital image
US13/267,236 Expired - Fee Related US8533265B2 (en) 2005-06-27 2011-10-06 Associating presence information with a digital image
US14/017,431 Abandoned US20140033092A1 (en) 2005-06-27 2013-09-04 Associating Presence Information With A Digital Image

Family Applications Before (3)

Application Number Title Priority Date Filing Date
US11/170,709 Expired - Fee Related US7676543B2 (en) 2005-06-27 2005-06-27 Associating presence information with a digital image
US12/693,728 Expired - Fee Related US8041766B2 (en) 2005-06-27 2010-01-26 Associating presence information with a digital image
US13/267,236 Expired - Fee Related US8533265B2 (en) 2005-06-27 2011-10-06 Associating presence information with a digital image

Country Status (1)

Country Link
US (4) US7676543B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150042683A1 (en) * 2008-09-16 2015-02-12 Intel Corporation Systems and methods for video/multimedia rendering, composition, and user-interactivity
US9798742B2 (en) 2015-12-21 2017-10-24 International Business Machines Corporation System and method for the identification of personal presence and for enrichment of metadata in image media

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4250574B2 (en) * 2004-08-05 2009-04-08 株式会社東芝 Metadata structure and method of reproducing metadata
JP4133981B2 (en) * 2004-09-09 2008-08-13 株式会社東芝 Metadata and video playback device
US20110010631A1 (en) * 2004-11-29 2011-01-13 Ariel Inventions, Llc System and method of storing and retrieving associated information with a digital image
US20120079051A1 (en) * 2004-11-29 2012-03-29 Ariel Inventions, Llc System and method of storing and retrieving associated information with a digital image
KR100654491B1 (en) * 2005-04-01 2006-12-05 (주)인트로모바일 Method of changing template type of idle screen of mobile terminal, computer readable record medium on which program for executing method is recorded and mobile terminal having function thereof
KR100599372B1 (en) * 2005-05-10 2006-07-10 (주)인트로모바일 Method of displaying atypical template type on idle-mode screen of mobile terminal, computer readable record medium on which program for executing method is recorded and mobile terminal having function thereof
US7676543B2 (en) 2005-06-27 2010-03-09 Scenera Technologies, Llc Associating presence information with a digital image
US20070055730A1 (en) * 2005-09-08 2007-03-08 Bagley Elizabeth V Attribute visualization of attendees to an electronic meeting
CA2623394A1 (en) * 2005-09-19 2007-03-29 Industrial Color, Inc. Digital file management
US20070094304A1 (en) * 2005-09-30 2007-04-26 Horner Richard M Associating subscription information with media content
US7729481B2 (en) * 2005-10-28 2010-06-01 Yahoo! Inc. User interface for integrating diverse methods of communication
US8341219B1 (en) * 2006-03-07 2012-12-25 Adobe Systems Incorporated Sharing data based on tagging
US20080195468A1 (en) * 2006-12-11 2008-08-14 Dale Malik Rule-Based Contiguous Selection and Insertion of Advertising
US20080195938A1 (en) * 2006-12-14 2008-08-14 Steven Tischer Media Content Alteration
US20080195458A1 (en) * 2006-12-15 2008-08-14 Thomas Anschutz Dynamic Selection and Incorporation of Advertisements
US8413059B2 (en) 2007-01-03 2013-04-02 Social Concepts, Inc. Image based electronic mail system
US20080030496A1 (en) 2007-01-03 2008-02-07 Social Concepts, Inc. On-line interaction system
US8180852B2 (en) * 2007-01-25 2012-05-15 Social Concepts, Inc. Apparatus for increasing social interaction over an electronic network
US8166407B2 (en) * 2007-01-25 2012-04-24 Social Concepts, Inc. Apparatus for increasing social interaction over an electronic network
US20080183816A1 (en) * 2007-01-31 2008-07-31 Morris Robert P Method and system for associating a tag with a status value of a principal associated with a presence client
US7756936B2 (en) * 2007-02-23 2010-07-13 Yahoo! Inc. User interface for transitioning between chat and email
US10452763B2 (en) 2007-03-08 2019-10-22 Oath Inc. Autocomplete for integrating diverse methods of electronic communication
US7912860B2 (en) 2007-06-25 2011-03-22 Microsoft Corporation Strongly typed tags
KR20090022374A (en) * 2007-08-30 2009-03-04 삼성전자주식회사 Method and apparatus utilizing a presence service for providing status information and method and apparatus utilizing a presence for generating content status information
US8520979B2 (en) * 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
US20100121907A1 (en) * 2008-10-24 2010-05-13 Mcknight Thomas R Cooperative Measurement Technique for the Determination of Internet Web Page Exposure and Viewing Behavior
US8365081B1 (en) * 2009-05-28 2013-01-29 Amazon Technologies, Inc. Embedding metadata within content
US20100318618A1 (en) * 2009-06-15 2010-12-16 Microsoft Corporation Development tools for transition-independent web features
JP5356162B2 (en) * 2009-09-07 2013-12-04 株式会社ザクティ Object image search device
TWI409692B (en) * 2009-10-29 2013-09-21 Mitac Int Corp Method of simultaneously displaying states of a plurality of internet communication software of a plurality of contacts in address books of and related communication device
US8447070B1 (en) * 2010-04-19 2013-05-21 Amazon Technologies, Inc. Approaches for device location and communication
KR101722687B1 (en) * 2010-08-10 2017-04-04 삼성전자주식회사 Method for providing information between objects or object and user, user device, and storage medium thereof
US20120078709A1 (en) * 2010-09-23 2012-03-29 Dunham Carl A Method and system for managing online advertising objects using textual metadata tags
CN102118510B (en) * 2011-03-17 2013-12-25 宇龙计算机通信科技(深圳)有限公司 Contact correlation method, server and mobile terminal
US8861310B1 (en) * 2011-03-31 2014-10-14 Amazon Technologies, Inc. Surface-based sonic location determination
CN102355534A (en) * 2011-11-01 2012-02-15 宇龙计算机通信科技(深圳)有限公司 Mobile terminal and contact information recommendation method
EP2608055A1 (en) * 2011-12-22 2013-06-26 Nokia Corp. Methods, apparatus and non-transitory computer readable storage mediums
EP2807541B1 (en) * 2012-01-26 2020-09-02 EntIT Software LLC Image-based application automation
US9122499B2 (en) 2012-06-27 2015-09-01 International Business Machines Corporation Real time examination of conditions of physical machines using augmented reality in smarter data center
US20140019871A1 (en) * 2012-07-12 2014-01-16 Live Lens Ltd. Systems, Apparatuses, Methods and Computer Executable Code for Providing Interactive Friends and/or Contacts Graphic User Interfaces
CN102843453A (en) * 2012-08-14 2012-12-26 广东欧珀移动通信有限公司 Address list relationship adding method and mobile terminal
WO2014031015A1 (en) 2012-08-24 2014-02-27 Motorola Solutions, Inc. Method and apparatus for authenticating digital information
KR20140112914A (en) * 2013-03-14 2014-09-24 삼성전자주식회사 Apparatus and method for processing an application information in portable device
KR102056080B1 (en) * 2013-03-19 2019-12-16 삼성전자주식회사 Method and apparatus for providing state information
KR102049789B1 (en) 2013-04-25 2019-11-28 삼성전자 주식회사 Apparatus and method for trasnsmitting an information in portable device
US20150106628A1 (en) * 2013-10-10 2015-04-16 Elwha Llc Devices, methods, and systems for analyzing captured image data and privacy data
US10346624B2 (en) 2013-10-10 2019-07-09 Elwha Llc Methods, systems, and devices for obscuring entities depicted in captured images
US20150104004A1 (en) 2013-10-10 2015-04-16 Elwha Llc Methods, systems, and devices for delivering image data from captured images to devices
US10289863B2 (en) 2013-10-10 2019-05-14 Elwha Llc Devices, methods, and systems for managing representations of entities through use of privacy beacons
US10013564B2 (en) 2013-10-10 2018-07-03 Elwha Llc Methods, systems, and devices for handling image capture devices and captured images
US20150106195A1 (en) * 2013-10-10 2015-04-16 Elwha Llc Methods, systems, and devices for handling inserted data into captured images
CN103607497B (en) * 2013-11-29 2016-03-09 张剑文 Contact person's associated apparatus and method
WO2016072120A1 (en) * 2014-11-07 2016-05-12 ソニー株式会社 Information processing system, control method, and storage medium
JP2016143310A (en) * 2015-02-04 2016-08-08 ソニー株式会社 Information processing device, image processing method, and program

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6075537A (en) * 1997-11-20 2000-06-13 International Business Machines Corporation Ease of use interface to hotspots in hypertext document pages in network display stations
US20020055926A1 (en) * 2000-11-06 2002-05-09 Meir Dan Open platform information on universal maps
US6411994B2 (en) * 1997-10-07 2002-06-25 Interval Research Corporation Interface system for providing content using context hotspots
US6693649B1 (en) * 1999-05-27 2004-02-17 International Business Machines Corporation System and method for unifying hotspots subject to non-linear transformation and interpolation in heterogeneous media representations
US20050177463A1 (en) * 2004-02-10 2005-08-11 Crutchfield William G.Jr. Virtual showroom for interactive electronic shopping
US20060073853A1 (en) * 2004-10-05 2006-04-06 Lucian Cighir Interactive imaging for cellular phones
US20060080030A1 (en) * 2004-01-29 2006-04-13 Xanavi Informatics Corporation Automobile navigation apparatus
US20060101005A1 (en) * 2004-10-12 2006-05-11 Yang Wendy W System and method for managing and presenting entity information
US20070047002A1 (en) * 2005-08-23 2007-03-01 Hull Jonathan J Embedding Hot Spots in Electronic Documents
US20080261568A1 (en) * 2007-04-23 2008-10-23 Lopez Matthew G Methods and systems for providing contact information
US20090005981A1 (en) * 2007-06-28 2009-01-01 Apple Inc. Integration of Map Services and User Applications in a Mobile Device

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5141407A (en) 1990-10-01 1992-08-25 Copeland Corporation Scroll machine with overheating protection
JP3528214B2 (en) 1993-10-21 2004-05-17 株式会社日立製作所 Image display method and apparatus
US5689742A (en) 1996-10-11 1997-11-18 Eastman Kodak Company Full frame annotation system for camera
US6041335A (en) 1997-02-10 2000-03-21 Merritt; Charles R. Method of annotating a primary image with an image and for transmitting the annotated primary image
JP3895492B2 (en) 1998-03-13 2007-03-22 株式会社リコー Image processing apparatus, image processing method, and computer-readable recording medium storing program for causing computer to execute the method
US7043529B1 (en) 1999-04-23 2006-05-09 The United States Of America As Represented By The Secretary Of The Navy Collaborative development network for widely dispersed users and methods therefor
US6351777B1 (en) 1999-04-23 2002-02-26 The United States Of America As Represented By The Secretary Of The Navy Computer software for converting a general purpose computer network into an interactive communications system
US6762777B2 (en) 1998-12-31 2004-07-13 International Business Machines Corporation System and method for associating popup windows with selective regions of a document
US6408301B1 (en) 1999-02-23 2002-06-18 Eastman Kodak Company Interactive image storage, indexing and retrieval system
US6687878B1 (en) 1999-03-15 2004-02-03 Real Time Image Ltd. Synchronizing/updating local client notes with annotations previously made by other clients in a notes database
US20020051262A1 (en) 2000-03-14 2002-05-02 Nuttall Gordon R. Image capture device with handwritten annotation
AUPQ717700A0 (en) 2000-04-28 2000-05-18 Canon Kabushiki Kaisha A method of annotating an image
US20020019845A1 (en) 2000-06-16 2002-02-14 Hariton Nicholas T. Method and system for distributed scripting of presentations
US6629104B1 (en) 2000-11-22 2003-09-30 Eastman Kodak Company Method for adding personalized metadata to a collection of digital images
US20020141750A1 (en) 2001-03-30 2002-10-03 Ludtke Harold A. Photographic prints carrying meta data and methods therefor
US20030043190A1 (en) 2001-08-31 2003-03-06 Eastman Kodak Company Website chat room having images displayed simultaneously with interactive chatting
US6874126B1 (en) 2001-11-30 2005-03-29 View Space Technologies Method and apparatus for controlling content display by the cursor motion
WO2003069364A2 (en) * 2002-02-14 2003-08-21 Avaya Technology Corp. Presence tracking and name space interconnection techniques
US7260738B2 (en) 2002-06-17 2007-08-21 Microsoft Corporation System and method for splitting an image across multiple computer readable media
JP2004032131A (en) 2002-06-24 2004-01-29 Canon Inc Imaging apparatus and image processing apparatus
US9100218B2 (en) 2002-11-18 2015-08-04 Aol Inc. Enhanced buddy list interface
US20040126038A1 (en) 2002-12-31 2004-07-01 France Telecom Research And Development Llc Method and system for automated annotation and retrieval of remote digital content
JP4355998B2 (en) 2003-03-07 2009-11-04 ソニー株式会社 Information processing system, information management apparatus and method, and program
US20040201602A1 (en) 2003-04-14 2004-10-14 Invensys Systems, Inc. Tablet computer system for industrial process design, supervisory control, and data management
CA2831132C (en) 2003-05-20 2018-02-06 Facebook, Inc. Presence and geographic location notification
JP2005020654A (en) 2003-06-30 2005-01-20 Minolta Co Ltd Imaging device and method for imparting comment information to image
US20050039134A1 (en) 2003-08-11 2005-02-17 Sony Corporation System and method for effectively implementing a dynamic user interface in an electronic network
US20050071761A1 (en) 2003-09-25 2005-03-31 Nokia Corporation User interface on a portable electronic device
US7484175B2 (en) 2003-09-30 2009-01-27 International Business Machines Corporation Method and apparatus for increasing personability of instant messaging with user images
US7519900B2 (en) 2003-10-24 2009-04-14 Microsoft Corporation System and method for processing digital annotations
US7886024B2 (en) * 2004-07-01 2011-02-08 Microsoft Corporation Sharing media objects in a network
US20060005168A1 (en) 2004-07-02 2006-01-05 Mona Singh Method and system for more precisely linking metadata and digital images
US7676543B2 (en) * 2005-06-27 2010-03-09 Scenera Technologies, Llc Associating presence information with a digital image

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6411994B2 (en) * 1997-10-07 2002-06-25 Interval Research Corporation Interface system for providing content using context hotspots
US6075537A (en) * 1997-11-20 2000-06-13 International Business Machines Corporation Ease of use interface to hotspots in hypertext document pages in network display stations
US6693649B1 (en) * 1999-05-27 2004-02-17 International Business Machines Corporation System and method for unifying hotspots subject to non-linear transformation and interpolation in heterogeneous media representations
US20020055926A1 (en) * 2000-11-06 2002-05-09 Meir Dan Open platform information on universal maps
US20060080030A1 (en) * 2004-01-29 2006-04-13 Xanavi Informatics Corporation Automobile navigation apparatus
US20050177463A1 (en) * 2004-02-10 2005-08-11 Crutchfield William G.Jr. Virtual showroom for interactive electronic shopping
US20060073853A1 (en) * 2004-10-05 2006-04-06 Lucian Cighir Interactive imaging for cellular phones
US20060101005A1 (en) * 2004-10-12 2006-05-11 Yang Wendy W System and method for managing and presenting entity information
US20070047002A1 (en) * 2005-08-23 2007-03-01 Hull Jonathan J Embedding Hot Spots in Electronic Documents
US20080261568A1 (en) * 2007-04-23 2008-10-23 Lopez Matthew G Methods and systems for providing contact information
US20090005981A1 (en) * 2007-06-28 2009-01-01 Apple Inc. Integration of Map Services and User Applications in a Mobile Device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150042683A1 (en) * 2008-09-16 2015-02-12 Intel Corporation Systems and methods for video/multimedia rendering, composition, and user-interactivity
US9235917B2 (en) * 2008-09-16 2016-01-12 Intel Corporation Systems and methods for video/multimedia rendering, composition, and user-interactivity
US9870801B2 (en) 2008-09-16 2018-01-16 Intel Corporation Systems and methods for encoding multimedia content
US10210907B2 (en) 2008-09-16 2019-02-19 Intel Corporation Systems and methods for adding content to video/multimedia based on metadata
US9798742B2 (en) 2015-12-21 2017-10-24 International Business Machines Corporation System and method for the identification of personal presence and for enrichment of metadata in image media

Also Published As

Publication number Publication date
US8533265B2 (en) 2013-09-10
US7676543B2 (en) 2010-03-09
US20100121920A1 (en) 2010-05-13
US20120027312A1 (en) 2012-02-02
US20070011186A1 (en) 2007-01-11
US8041766B2 (en) 2011-10-18

Similar Documents

Publication Publication Date Title
US8533265B2 (en) Associating presence information with a digital image
US11582349B2 (en) System and method for associating audio clips with objects
US8150913B2 (en) System for controlled distribution of user profiles over a network
US8069092B2 (en) Method system of software for publishing images on a publicly available website and for ordering of goods or services
US7003546B1 (en) Method and system for controlled distribution of contact information over a network
US8601589B2 (en) Simplified electronic messaging system
US20030220879A1 (en) System and method for electronic document processing
US20090260060A1 (en) Rich media collaboration system
US7984033B2 (en) Data control system capable of present current image of writer with data
US20060257003A1 (en) Method for the automatic identification of entities in a digital image
KR101793463B1 (en) Picture image and business card information mapping method

Legal Events

Date Code Title Description
AS Assignment

Owner name: SCENERA TECHNOLOGIES, LLC, NEW HAMPSHIRE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IPAC ACQUISITION SUBSIDIARY I, LLC;REEL/FRAME:031543/0532

Effective date: 20061102

Owner name: IPAC ACQUISITION SUBSIDIARY I, LLC, NEW HAMPSHIRE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HORNER, MARK;BARDSLEY, JEFFREY SCOTT;REEL/FRAME:031543/0377

Effective date: 20050627

AS Assignment

Owner name: SCENERA MOBILE TECHNOLOGIES, LLC, NORTH CAROLINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SCENERA TECHNOLOGIES, LLC;REEL/FRAME:031960/0490

Effective date: 20131121

STCV Information on status: appeal procedure

Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS

STCB Information on status: application discontinuation

Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION