US20090285484A1 - Portable image processing and multimedia interface - Google Patents
Portable image processing and multimedia interface Download PDFInfo
- Publication number
- US20090285484A1 US20090285484A1 US12/510,213 US51021309A US2009285484A1 US 20090285484 A1 US20090285484 A1 US 20090285484A1 US 51021309 A US51021309 A US 51021309A US 2009285484 A1 US2009285484 A1 US 2009285484A1
- Authority
- US
- United States
- Prior art keywords
- image
- product
- bar code
- portable device
- program instructions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/217—Input arrangements for video game devices characterised by their sensors, purposes or types using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- A63F13/92—Video game devices specially adapted to be hand-held while playing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1632—External expansion units, e.g. docking stations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
- H04N1/00323—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/33—Services specially adapted for particular environments, situations or purposes for indoor environments, e.g. buildings
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/26—Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/204—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform the platform being a handheld device
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
- A63F2300/301—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device using an additional display connected to the game console, e.g. on the controller
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing
- A63F2300/6081—Methods for processing data by generating or executing the game program for sound processing generating an output signal, e.g. under timing constraints, for spatialization
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/69—Involving elements of the real world in the game world, e.g. measurement in live races, real video
Definitions
- This invention relates generally to augmented reality applications and more particularly to combining image recognition features with augmented reality applications in order to enrich the augmented reality applications.
- Augmented reality attempts to enrich a user's real environment by adding spatially aligned virtual objects (3D models, 2D textures, textual annotations, etc.) to the user's environment.
- the goal is to create the impression that the virtual object is a part of the real environment.
- the users of the AR system experience the augmented environment through special display devices that are typically worn on the body, e.g., head mounts.
- augmented reality systems suffer from issues with general registration problems, i.e., getting the computer graphics to stick to a real-world scene. For example, due to the use of multiple sensors, artifacts, such as miss-movement of the computer graphics with the real-world scene may occur. These artifacts are due to the multiple sensors having different speeds. Additionally, delays between the head tracking system and the camera used to capture the real-world scene along with the need to merge the computer graphics into the real-world scene, cause misalignment/registration problems. These registration problems may even become serious enough to cause a user to become uncomfortable when viewing the image. Additionally, the augmented reality systems tend to be complex systems that are not portable. Accordingly, there are no viable consumer applications for these augmented reality systems.
- the present invention fills these needs by providing a method and device for providing an enhanced shopping experience using a portable device. It should be appreciated that the present invention can be implemented in numerous ways, including as a method, a system, computer readable media or a device. Several inventive embodiments of the present invention are described below.
- a portable device configured to provide enhanced shopping information.
- the portable device has a display screen and an image capture device and the portable device is configured to access databases through a wireless network.
- the portable device includes image recognition logic that is configured to perform analysis of an image of an object that includes a bar code associated with a product. The analysis determines if the graphics found on the object corresponds to a bar code and a portion of the image with the bar code is communicated through the wireless network to databases to identify the product.
- the portable device further includes image generation logic that is configured to obtain product information for the identified product from the databases and present the product information on the display screen of the portable device.
- a method for obtaining product information through a portable device is provided.
- An image of an object including a bar code associated with a product is captured using an image capture device.
- the captured image is analyzed to determine if graphics found on the object correspond to a bar code.
- a portion of the image with the bar code is transmitted to databases through a wireless network and the product associated with the bar code is identified.
- Product information from the databases is obtained and presented through image generation logic incorporated into the portable device.
- the presented product information defines multimedia data in a graphical user interface that includes one of an image or text information about the product.
- FIG. 1 is a simplified schematic diagram of a device having image capture capability, which may be used in an augmented reality application in accordance with one embodiment of the invention.
- FIGS. 2A and 2B are side views of the portable device illustrated in FIG. 1 .
- FIG. 3 is a simplified schematic diagram of an image capture device being utilized in an augmented reality application in accordance with one embodiment of the invention.
- FIG. 4 is a simplified schematic diagram illustrating yet another application of the incorporation of computer graphics into a real world scene in accordance with one embodiment of the invention.
- FIG. 5 is a simplified schematic diagram showing the plurality of users viewing a display monitor with a handheld device in accordance with one embodiment of the invention.
- FIGS. 6A and 6B show yet another application of the use of a portable device capable of recognizing graphical data in accordance with one embodiment of the invention.
- FIG. 7 is a simplified schematic diagram illustrating the use of a portable device and a card game application in accordance with one embodiment of the invention
- FIG. 8 is a flow chart illustrating the method operations for augmenting display data presented to a viewer in accordance with one embodiment of the invention.
- FIG. 9 is a flow chart illustrating the method operations for providing information in a portable environment in accordance with one embodiment of the invention.
- FIG. 10 is a simplified schematic diagram illustrating the modules within the portable device in accordance with one embodiment of the invention.
- a portable device with a display, a camera and software configured to execute the functionality described below is provided.
- One exemplary illustration of the portable device is the PLAYSTATION PORTABLE (PSP) entertainment product combined with a universal serial bus (USB) 2.0 camera attachment and application software delivered on a universal media disk (UMD) or some other suitable optical disc media.
- PSP PLAYSTATION PORTABLE
- USB universal serial bus
- UMD universal media disk
- the portable device can be further augmented through use of wireless networking which is a standard option on the PSP.
- Augmented Reality is a general term for when computer graphics are mixed with real video in such a way as the computer graphics adds extra information to the real scene.
- a user points the portable device having a display and a camera at a real world scene.
- the camera shows the scene on the portable device such that it seems that the user is seeing the world through the device.
- Software stored on the device or accessed through wireless network displays the real world image, and uses image processing techniques to recognize certain objects in the camera's field of vision. Based on this recognition, the portable device constructs appropriate computer graphics and overlays these graphics on the display device on top of the real world image.
- the device is a portable hand held device with limited computing resources
- certain objects may be used so that the image recognition software can recognize the object with relative ease, i.e., in manner suitable for the limited processing capabilities of the portable device.
- Some exemplary objects are listed below. It should be appreciated that this list is not exhaustive and other objects that are recognizable may be used with the embodiments described herein.
- Collectable or regular playing cards are one suitable object.
- the playing cards have a fixed colored design in high contrast.
- the design graphics are easy for the device to recognize through the image recognition software.
- the graphics may be chosen so that the device can easily determine the orientation of the card.
- the portable device can then take the real image, remove the special recognized graphic and replace it with a computer-generated image and then show the resulting combination of real and computer graphics to the user on the display.
- the computer graphics move in the same way.
- an animating character could be superimposed on the card.
- a book could be used. Similar to the cards, a clear design is used and then the portable device overlays registered computer graphics before displaying the scene to the user.
- the clear graphic images can be displayed on a television (TV) either from a computer game, the Internet or broadcast TV.
- TV television
- the user would see different superimposed computer graphics on the portable display as described further below.
- a user with the device can get additional product information by analyzing the standard bar code with the camera attachment.
- the additional product information may include price, size, color, quantity in stock, or any other suitable physical or merchandise attribute.
- graphics can be superimposed on the retail packaging as seen by the portable device.
- catalogue information may be obtained about the merchandise.
- the image data captured by the portable device is used to search for a match of the product through a library of data accessed through the wireless network. It should be appreciated that the embodiments described herein enable a user to obtain the information from a bar code without the use of special purpose laser scanning equipment.
- the user would also own the device and could take it from store to store. This would enable the user to do comparison-shopping more easily. Also, the device would be capable of much richer graphics than bar code scanners available in-store. In one embodiment, retailers or manufacturers could provide optical disc media with catalogues of product information. The user would put the disc in the device and then point the camera at a bar code and they would see detailed product information.
- the bar code would enable the portable device to access a sample of the music and play so the user can effectively listen to a part of the CD simply by capturing an image of the bar code.
- a trailer can be stored in the product catalogue on the removable media of the device. This trailer can be played back to the user after they capture the bar code and the portable device processes the captured image and matches it to the corresponding trailer associated with the bar code.
- a demo of a video game could be played for video game products. It should be appreciated that there are other possible uses including product reviews, cross promotions, etc.
- the portable device is not scanning the bar code as conventional scanners.
- the portable device performs image processing on a captured image of the bar code and matches it with a corresponding image to access the relevant data. Furthermore, with an in-store wireless networked and a portable device like the PSP (which is wireless network enabled), there is no need for a special removable disc media catalogue.
- the catalogue can be provided directly by the in-store wireless network.
- the portable device may be used as a secondary personal display in conjunction with a main display that is shared by several users. For example, several people may play a video game on a single TV and use the portable devices for additional information that is unique for each player. Likewise, for broadcast TV (e.g. game show) where several people in the home watch a single broadcast, but see different personal information on their portable device depending upon their preferences.
- the portable device may be used to obtain additional information from the main display. For example, with respect to a sports game, additional player information or statistics may be displayed for a selected player. It may be necessary to synchronize the graphics on the main display with those on the portable display.
- One approach is to use a wireless network or broadcast and to send information to each display using this network.
- An alternative method is to use visual cues from the main display to drive the synchronization with the portable display. As such no additional expensive network connections are required.
- FIG. 1 is a simplified schematic diagram of a device having image capture capability, which may be used in an augmented reality application in accordance with one embodiment of the invention.
- Portable device 100 includes navigation buttons 104 and display screen 102 .
- Device 100 is capable of accepting memory card 106 and image capture device 108 .
- Image capture device 108 may include a charge couple device (CCD) in order to capture an image of a real-world scene.
- the camera functionality may be provided by a complimentary metal oxide semiconductor chip that uses an active pixel architecture to perform camera functions on-chip.
- device 100 is a PSP device having image capture capability.
- FIGS. 2A and 2B are side views of the portable device illustrated in FIG. 1 .
- FIG. 2A shows device 100 with memory card slot 110 and display panel 102 .
- Image capture device 108 is located on a top surface of device 100 . It should be appreciated that image capture device 108 may be a pluggable device or may be hard-wired into device 100 .
- FIG. 2B illustrates an alternative embodiment of device 100 of FIG. 1 . Here, image capture device 108 is located on a backside of device 100 . Therefore, a user viewing the display screen 102 may have the same viewing angle as image capture device 108 .
- device 100 of FIG. 2B also includes memory card slot 110 . It should be appreciated that the memory card may be interchanged between users in order to swap information with other users.
- FIG. 3 is a simplified schematic diagram of an image capture device being utilized in an augmented reality application in accordance with one embodiment of the invention.
- device 100 is being held by a user with a real-world scene 103 being augmented with computer graphics on display screen 102 .
- Real-world scene 103 includes a street bordering buildings having mountain scenery in the background.
- the computer graphics incorporated into real-world scene 103 is car 105 .
- logic within the portable device recognizes the road or a marker on the road, e.g., the dividing line of the road, and incorporates the car into the scene.
- a PLAYSTATION PORTABLE device is illustrated in FIGS. 1-3 the embodiments described herein may be incorporated into any handheld device having camera capability.
- Other suitable devices include a cell phone, a personal digital assistant, a web tablet, and a pocket PC.
- FIG. 4 is a simplified schematic diagram illustrating yet another application of the incorporation of computer graphics into a real world scene in accordance with one embodiment of the invention.
- a user is holding portable device 100 , which includes display 102 .
- display 102 is expanded relative to device 100 for ease of explanation.
- An image capture device which is incorporated into device 100 , captures a scene being displayed on display device 112 , which may be a television.
- display device 112 illustrates a tree 114 being shown.
- Device 100 captures the image being displayed on device 112 and displays tree 114 on display screen 102 .
- device 100 incorporates additional objects into the scene.
- sun 116 is incorporated into the scene being displayed on display screen 102 .
- a marker such as marker 115 of the first display device, may cause the incorporation of additional objects such as sun 116 into the second display device.
- device 100 includes a logic capable of recognizing objects such as tree 114 or marker 115 and thereafter responding to the recognition of such objects or markers by adding appropriate computer graphics such as sun 116 into the scene being displayed on device 100 .
- the image capture device incorporated into portable device 100 may be a video capture device that continuously captures the changing frames on display device 112 and incorporates additional objects accordingly.
- visual cues from the main display may be used to drive the synchronization with the portable display.
- FIG. 5 is a simplified schematic diagram showing the plurality of users viewing a display monitor with a handheld device in accordance with one embodiment of the invention.
- display device 120 is a single display device but is illustrated three different times for ease of explanation.
- Users 101 a through 101 c have corresponding handheld portable devices 100 a through 100 c , respectively.
- Display devices 100 a , 100 b , and 100 c capture the image being displayed on display screen 120 and augment image data or graphics into the captured image in order to provide additional information to users 101 a through 101 c .
- a game show being displayed on display device 120 is being viewed by each of users 101 a through 101 c , so that users 101 a through 101 c may compete with each other.
- the display on display screen 120 which is captured by devices 100 a through 100 c , includes data which may be analyzed by logic within device 100 a through 100 c so that each of the users see somewhat different displays on the corresponding display screens. For example, with reference to a game of charades, one of the users 101 a through 101 c may have access to what the answer is while the other users do not have this access.
- the television broadcast system may be used to incorporate extra data into the display data being shown by display 120 in order to provide extra functionality for users 101 a through 101 c .
- devices 100 a through 100 c enable extra data in the image being displayed on display 120 to be turned on.
- the extra data may be triggered by graphics within display 120 which are recognized by image recognition logic of the portable device.
- FIGS. 6A and 6B show yet another application of the use of a portable device capable of recognizing graphical data in accordance with one embodiment of the invention.
- a user has a portable device 100 a with display screen 102 a .
- display screen 102 a is enlarged for ease of explanation.
- Device 100 a is capable of being networked to in-store network 131 a .
- Device 100 a captures an image of a barcode 132 a associated with product 130 a .
- device 100 a is enabled to download information concerning the characteristics of item 130 a .
- barcode 132 a device 100 a may recognize a storage box containing item 130 a or item 130 a itself. Then, by communicating with in-store network 131 a , a comparison of the captured image data with a library from in-store network 131 a device 100 a is able to locate the characteristics such as price, size, color, etc., of item 130 a . The user then may move to store Y and use device 100 a to download characteristics associated with item 130 b .
- a barcode 132 b or image data of item 130 d or its storage container may be used to access the item characteristics, which can be any catalogue characteristics from in-store network 133 a .
- the user is then able to compare the characteristics of item 130 a in store X and 130 b in store Y.
- the user is able to perform comparison-shopping in the different locations.
- FIG. 7 is a simplified schematic diagram illustrating the use of a portable device and a card game application in accordance with one embodiment of the invention.
- the user is pointing device 100 toward cards 140 b and 140 b .
- the cards 140 and 140 b may have symbols or some kind of graphical data, which is recognized by logic within device 100 .
- cards 140 a has image 142 a and numbers 142 b , which may be recognized by image device 100 .
- Card 140 b includes barcode 142 c and marker 142 d which also may be recognized by device 100 . In one application, these markings may indicate the value of the cards in order to determine which card is the highest.
- a simulated fight may take place on display screen 102 where the winner of the fight will be associated with the higher of cards 140 a and 140 b .
- a new computer generated graphic can be superimposed on the card and displayed on the portable display.
- the sports person or team on the card can be superimposed in a real 3D view and animated throwing the ball, etc.
- role-playing games it is possible to combine the cards and a video game on the portable device so that collecting physical cards becomes an important part of the game.
- a character of the game may be personalized by the player and this information could be swapped with other players via wireless network or via removable media (e.g. Memory Stick).
- a similar technique could be used to augment business cards.
- a special identifying graphic could be included. This graphic can be associated with the individual and will reference information about that person potentially including photos, video, audio as well as the normal contact info.
- the personal information could be exchanged via removable media.
- a unique graphic is indexed an on-line database via a wireless network to get the information about that person. Having accessed the information, a superimposed graphic, e.g., the person's photo, can be created in place of the graphic on the portable display.
- FIG. 8 is a flow chart illustrating the method operations for augmenting display data presented to a viewer in accordance with one embodiment of the invention.
- the method initiates with operation 150 where the display data on a first display device is presented.
- the display is shown on a television, computer monitor or some other suitable display device.
- the display data on the display device is captured with an image capture device.
- the portable device having image capture capability discussed above is one exemplary device having image capture capability, which includes video capture capability.
- the captured display data is then analyzed in operation 154 . This analysis is performed by logic within the portable device.
- the logic includes software or hardware or some combination of the two.
- a marker within the captured display data is identified.
- the marker may be a any suitable marker, such as the markers illustrated in FIGS. 4 and 7 .
- additional display data is defined in response to identifying the marker.
- the additional display data is generated by image generation logic of the portable device.
- the additional data may be downloaded from a wireless network.
- the captured display data and the additional display data are then presented on a display screen of the image capture device in operation 160 .
- FIG. 9 is a flow chart illustrating the method operations for providing information in a portable environment in accordance with one embodiment of the invention.
- the method initiates with operation 170 where an image of a first object is captured in a first location. For example, an image of an item in a first store may be captured here.
- the object characteristics of the first object are accessed based upon the image of the first object. For example, a wireless network may be accessed within the store in order to obtain the object characteristics of the first object.
- the user may move to a second location.
- an image of a second object in the second location is captured.
- the object characteristics of the second object are accessed based upon the image of the second object in operation 178 .
- the image data is used to access the object characteristics and not laser scan data.
- the object characteristics of the first object and the object characteristics of the second object are presented to a user.
- the user may perform comparison shopping with the use of a portable device based upon the recognition of video image data and the access of in-store networks.
- FIG. 10 is a simplified schematic diagram illustrating the modules within the portable device in accordance with one embodiment of the invention.
- Portable device 100 includes central processing unit (CPU) 200 , augmented reality logic block 202 , memory 210 and charged couple device (CCD) logic 212 .
- CMOS complimentary metal oxide semiconductor
- CMOS image sensor may perform the camera functions on-chip in place of CCD logic 212 .
- CMOS image sensor draws less power than a CCD.
- Each module is in communication with each other through bus 208 .
- Augmented reality logic block 202 includes image recognition logic 204 and image generation logic 206 .
- augmented reality logic block 202 may be a semiconductor chip incorporating the logic to execute the functionality described herein.
- the functionality described with respect to augmented reality logic block 202 , image recognition logic 204 and image generation logic 206 may be performed in software.
- the code may be stored within memory 210 .
- the above-described invention describes a portable device capable of providing an enriched augmented reality experience.
- the markers and graphics that are recognized by the system are computer generated, the invention is not limited to computer-generated markers.
- a set of pre-authored symbols and a set of user definable symbols can be created which can be recognized even when drawn by hand in a manner recognizable to the camera of the image capture device.
- players could create complex 3D computer graphics via drawing simple symbols.
- a player might draw a smiley face character and this might be recognized by the device and shown on the display as a popular cartoon or game character smiling.
- users can also establish secret communications using these symbols.
- the invention may employ various computer-implemented operations involving data stored in computer systems. These operations include operations requiring physical manipulation of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. Further, the manipulations performed are often referred to in terms, such as producing, identifying, determining, or comparing.
- the above-described invention may be practiced with other computer system configurations including hand-held devices, microprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers and the like.
- the invention may also be practiced in distributing computing environments where tasks are performed by remote processing devices that are linked through a communications network.
- the invention can also be embodied as computer readable code on a computer readable medium.
- the computer readable medium is any data storage device that can store data, which can be thereafter read by a computer system. Examples of the computer readable medium include hard drives, network attached storage (NAS), read-only memory, random-access memory, CD-ROMs, CD-Rs, CD-RWs, magnetic tapes, and other optical and non-optical data storage devices.
- the computer readable medium can also be distributed over a network coupled computer system so that the computer readable code is stored and executed in a distributed fashion.
Abstract
A portable device configured to provide enhanced shopping information is provided. The portable device has a display screen and an image capture device and the portable device is configured to access databases through a wireless network. The portable device includes image recognition logic that is configured to perform analysis of an image of an object that includes a bar code associated with a product. The analysis determines if the graphics found on the object correspond to a bar code and a portion of an image with the bar code is communicated through the wireless network to the databases to identify the product. The portable device further includes image generation logic that is configured to obtain product information for the identified product from the databases and present the product information on the display screen of the portable device.
Description
- This application is a continuation of and claims priority from U.S. patent application Ser. No. 10/922,514 filed on Aug. 19, 2004 and entitled “PORTABLE AUGMENTED REALITY DEVICE AND METHOD”, which is incorporated herein by reference in its entirety.
- 1. Field of the Invention
- This invention relates generally to augmented reality applications and more particularly to combining image recognition features with augmented reality applications in order to enrich the augmented reality applications.
- 2. Description of the Related Art
- Augmented reality (AR) attempts to enrich a user's real environment by adding spatially aligned virtual objects (3D models, 2D textures, textual annotations, etc.) to the user's environment. The goal is to create the impression that the virtual object is a part of the real environment. The users of the AR system experience the augmented environment through special display devices that are typically worn on the body, e.g., head mounts.
- Current augmented reality systems suffer from issues with general registration problems, i.e., getting the computer graphics to stick to a real-world scene. For example, due to the use of multiple sensors, artifacts, such as miss-movement of the computer graphics with the real-world scene may occur. These artifacts are due to the multiple sensors having different speeds. Additionally, delays between the head tracking system and the camera used to capture the real-world scene along with the need to merge the computer graphics into the real-world scene, cause misalignment/registration problems. These registration problems may even become serious enough to cause a user to become uncomfortable when viewing the image. Additionally, the augmented reality systems tend to be complex systems that are not portable. Accordingly, there are no viable consumer applications for these augmented reality systems.
- As a result, there is a need to solve the problems of the prior art to provide a method and apparatus for providing a portable device capable of providing an augmented reality experience.
- Broadly speaking, the present invention fills these needs by providing a method and device for providing an enhanced shopping experience using a portable device. It should be appreciated that the present invention can be implemented in numerous ways, including as a method, a system, computer readable media or a device. Several inventive embodiments of the present invention are described below.
- In one embodiment, a portable device configured to provide enhanced shopping information is included. The portable device has a display screen and an image capture device and the portable device is configured to access databases through a wireless network. The portable device includes image recognition logic that is configured to perform analysis of an image of an object that includes a bar code associated with a product. The analysis determines if the graphics found on the object corresponds to a bar code and a portion of the image with the bar code is communicated through the wireless network to databases to identify the product. The portable device further includes image generation logic that is configured to obtain product information for the identified product from the databases and present the product information on the display screen of the portable device.
- In another embodiment, a method for obtaining product information through a portable device is provided. An image of an object including a bar code associated with a product is captured using an image capture device. The captured image is analyzed to determine if graphics found on the object correspond to a bar code. A portion of the image with the bar code is transmitted to databases through a wireless network and the product associated with the bar code is identified. Product information from the databases is obtained and presented through image generation logic incorporated into the portable device. The presented product information defines multimedia data in a graphical user interface that includes one of an image or text information about the product.
- Other aspects and advantages of the invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the invention.
- The present invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, and like reference numerals designate like structural elements.
-
FIG. 1 is a simplified schematic diagram of a device having image capture capability, which may be used in an augmented reality application in accordance with one embodiment of the invention. -
FIGS. 2A and 2B are side views of the portable device illustrated inFIG. 1 . -
FIG. 3 is a simplified schematic diagram of an image capture device being utilized in an augmented reality application in accordance with one embodiment of the invention. -
FIG. 4 is a simplified schematic diagram illustrating yet another application of the incorporation of computer graphics into a real world scene in accordance with one embodiment of the invention. -
FIG. 5 is a simplified schematic diagram showing the plurality of users viewing a display monitor with a handheld device in accordance with one embodiment of the invention. -
FIGS. 6A and 6B show yet another application of the use of a portable device capable of recognizing graphical data in accordance with one embodiment of the invention. -
FIG. 7 is a simplified schematic diagram illustrating the use of a portable device and a card game application in accordance with one embodiment of the invention -
FIG. 8 is a flow chart illustrating the method operations for augmenting display data presented to a viewer in accordance with one embodiment of the invention. -
FIG. 9 is a flow chart illustrating the method operations for providing information in a portable environment in accordance with one embodiment of the invention. -
FIG. 10 is a simplified schematic diagram illustrating the modules within the portable device in accordance with one embodiment of the invention. - An invention is described for a system, device and method that provide an enhanced augmented reality environment. It will be obvious, however, to one skilled in the art, that the present invention may be practiced without some or all of these specific details. In other instances, well known process operations have not been described in detail in order not to unnecessarily obscure the present invention.
- The embodiments of the present invention provide a system and method for enabling a low cost consumer application related to augmented reality for entertainment and informational purposes. In one embodiment, a portable device with a display, a camera and software configured to execute the functionality described below is provided. One exemplary illustration of the portable device is the PLAYSTATION PORTABLE (PSP) entertainment product combined with a universal serial bus (USB) 2.0 camera attachment and application software delivered on a universal media disk (UMD) or some other suitable optical disc media. However, the invention could also apply to cell phones with cameras or PDAs with cameras. In another embodiment, the portable device can be further augmented through use of wireless networking which is a standard option on the PSP. One skilled in the art will appreciate that Augmented Reality (AR) is a general term for when computer graphics are mixed with real video in such a way as the computer graphics adds extra information to the real scene.
- In one aspect of the invention a user points the portable device having a display and a camera at a real world scene. The camera shows the scene on the portable device such that it seems that the user is seeing the world through the device. Software stored on the device or accessed through wireless network displays the real world image, and uses image processing techniques to recognize certain objects in the camera's field of vision. Based on this recognition, the portable device constructs appropriate computer graphics and overlays these graphics on the display device on top of the real world image.
- As the device is a portable hand held device with limited computing resources, certain objects may be used so that the image recognition software can recognize the object with relative ease, i.e., in manner suitable for the limited processing capabilities of the portable device. Some exemplary objects are listed below. It should be appreciated that this list is not exhaustive and other objects that are recognizable may be used with the embodiments described herein.
- Collectable or regular playing cards are one suitable object. In one embodiment, the playing cards have a fixed colored design in high contrast. The design graphics are easy for the device to recognize through the image recognition software. In addition, the graphics may be chosen so that the device can easily determine the orientation of the card. The portable device can then take the real image, remove the special recognized graphic and replace it with a computer-generated image and then show the resulting combination of real and computer graphics to the user on the display. As the card or the camera moves, the computer graphics move in the same way. In one embodiment, an animating character could be superimposed on the card. Alternatively, a book could be used. Similar to the cards, a clear design is used and then the portable device overlays registered computer graphics before displaying the scene to the user.
- In another embodiment, the clear graphic images can be displayed on a television (TV) either from a computer game, the Internet or broadcast TV. Depending upon the software application on the device, the user would see different superimposed computer graphics on the portable display as described further below.
- In yet another embodiment, a user with the device can get additional product information by analyzing the standard bar code with the camera attachment. The additional product information may include price, size, color, quantity in stock, or any other suitable physical or merchandise attribute. Alternatively, by using a special graphic design recognized by the portable device, graphics can be superimposed on the retail packaging as seen by the portable device. In addition, through a wireless network of the store in which the merchandise is located, catalogue information may be obtained about the merchandise. In one embodiment, the image data captured by the portable device is used to search for a match of the product through a library of data accessed through the wireless network. It should be appreciated that the embodiments described herein enable a user to obtain the information from a bar code without the use of special purpose laser scanning equipment. The user would also own the device and could take it from store to store. This would enable the user to do comparison-shopping more easily. Also, the device would be capable of much richer graphics than bar code scanners available in-store. In one embodiment, retailers or manufacturers could provide optical disc media with catalogues of product information. The user would put the disc in the device and then point the camera at a bar code and they would see detailed product information.
- With respect to music and video, the bar code would enable the portable device to access a sample of the music and play so the user can effectively listen to a part of the CD simply by capturing an image of the bar code. Similarly, for DVD and VHS videos, a trailer can be stored in the product catalogue on the removable media of the device. This trailer can be played back to the user after they capture the bar code and the portable device processes the captured image and matches it to the corresponding trailer associated with the bar code. Likewise, a demo of a video game could be played for video game products. It should be appreciated that there are other possible uses including product reviews, cross promotions, etc. Furthermore, it should be appreciated that the portable device is not scanning the bar code as conventional scanners. The portable device performs image processing on a captured image of the bar code and matches it with a corresponding image to access the relevant data. Furthermore, with an in-store wireless networked and a portable device like the PSP (which is wireless network enabled), there is no need for a special removable disc media catalogue. Here, the catalogue can be provided directly by the in-store wireless network.
- In another embodiment, the portable device may be used as a secondary personal display in conjunction with a main display that is shared by several users. For example, several people may play a video game on a single TV and use the portable devices for additional information that is unique for each player. Likewise, for broadcast TV (e.g. game show) where several people in the home watch a single broadcast, but see different personal information on their portable device depending upon their preferences. The portable device may be used to obtain additional information from the main display. For example, with respect to a sports game, additional player information or statistics may be displayed for a selected player. It may be necessary to synchronize the graphics on the main display with those on the portable display. One approach is to use a wireless network or broadcast and to send information to each display using this network. An alternative method is to use visual cues from the main display to drive the synchronization with the portable display. As such no additional expensive network connections are required.
-
FIG. 1 is a simplified schematic diagram of a device having image capture capability, which may be used in an augmented reality application in accordance with one embodiment of the invention.Portable device 100 includesnavigation buttons 104 anddisplay screen 102.Device 100 is capable of acceptingmemory card 106 andimage capture device 108.Image capture device 108 may include a charge couple device (CCD) in order to capture an image of a real-world scene. Alternatively, the camera functionality may be provided by a complimentary metal oxide semiconductor chip that uses an active pixel architecture to perform camera functions on-chip. In one embodiment,device 100 is a PSP device having image capture capability. -
FIGS. 2A and 2B are side views of the portable device illustrated inFIG. 1 .FIG. 2A showsdevice 100 withmemory card slot 110 anddisplay panel 102.Image capture device 108 is located on a top surface ofdevice 100. It should be appreciated thatimage capture device 108 may be a pluggable device or may be hard-wired intodevice 100.FIG. 2B illustrates an alternative embodiment ofdevice 100 ofFIG. 1 . Here,image capture device 108 is located on a backside ofdevice 100. Therefore, a user viewing thedisplay screen 102 may have the same viewing angle asimage capture device 108. As illustrated,device 100 ofFIG. 2B also includesmemory card slot 110. It should be appreciated that the memory card may be interchanged between users in order to swap information with other users. -
FIG. 3 is a simplified schematic diagram of an image capture device being utilized in an augmented reality application in accordance with one embodiment of the invention. Here,device 100 is being held by a user with a real-world scene 103 being augmented with computer graphics ondisplay screen 102. Real-world scene 103 includes a street bordering buildings having mountain scenery in the background. The computer graphics incorporated into real-world scene 103 iscar 105. In one embodiment, logic within the portable device recognizes the road or a marker on the road, e.g., the dividing line of the road, and incorporates the car into the scene. It should be appreciated that while a PLAYSTATION PORTABLE device is illustrated inFIGS. 1-3 the embodiments described herein may be incorporated into any handheld device having camera capability. Other suitable devices include a cell phone, a personal digital assistant, a web tablet, and a pocket PC. -
FIG. 4 is a simplified schematic diagram illustrating yet another application of the incorporation of computer graphics into a real world scene in accordance with one embodiment of the invention. Here, a user is holdingportable device 100, which includesdisplay 102. It should be noted thatdisplay 102 is expanded relative todevice 100 for ease of explanation. An image capture device, which is incorporated intodevice 100, captures a scene being displayed ondisplay device 112, which may be a television. Here,display device 112 illustrates atree 114 being shown.Device 100 captures the image being displayed ondevice 112 and displaystree 114 ondisplay screen 102. In addition totree 114 being shown ondisplay screen 102,device 100 incorporates additional objects into the scene. For example,sun 116 is incorporated into the scene being displayed ondisplay screen 102. As described above, a marker, such asmarker 115 of the first display device, may cause the incorporation of additional objects such assun 116 into the second display device. It should be appreciated thatdevice 100 includes a logic capable of recognizing objects such astree 114 ormarker 115 and thereafter responding to the recognition of such objects or markers by adding appropriate computer graphics such assun 116 into the scene being displayed ondevice 100. Furthermore, the image capture device incorporated intoportable device 100 may be a video capture device that continuously captures the changing frames ondisplay device 112 and incorporates additional objects accordingly. As mentioned above, visual cues from the main display may be used to drive the synchronization with the portable display. -
FIG. 5 is a simplified schematic diagram showing the plurality of users viewing a display monitor with a handheld device in accordance with one embodiment of the invention. Here,display device 120 is a single display device but is illustrated three different times for ease of explanation.Users 101 a through 101 c have corresponding handheldportable devices 100 a through 100 c, respectively. It should be appreciated that a game show, computer game, sporting event or some other suitable display may be being presented ondisplay screen 120.Display devices display screen 120 and augment image data or graphics into the captured image in order to provide additional information tousers 101 a through 101 c. In one embodiment, a game show being displayed ondisplay device 120 is being viewed by each ofusers 101 a through 101 c, so thatusers 101 a through 101 c may compete with each other. In another embodiment, the display ondisplay screen 120, which is captured bydevices 100 a through 100 c, includes data which may be analyzed by logic withindevice 100 a through 100 c so that each of the users see somewhat different displays on the corresponding display screens. For example, with reference to a game of charades, one of theusers 101 a through 101 c may have access to what the answer is while the other users do not have this access. In this embodiment, the television broadcast system may be used to incorporate extra data into the display data being shown bydisplay 120 in order to provide extra functionality forusers 101 a through 101 c. In essence,devices 100 a through 100 c enable extra data in the image being displayed ondisplay 120 to be turned on. The extra data may be triggered by graphics withindisplay 120 which are recognized by image recognition logic of the portable device. -
FIGS. 6A and 6B show yet another application of the use of a portable device capable of recognizing graphical data in accordance with one embodiment of the invention. Here, a user has aportable device 100 a withdisplay screen 102 a. As mentioned above,display screen 102 a is enlarged for ease of explanation.Device 100 a is capable of being networked to in-store network 131 a.Device 100 a captures an image of abarcode 132 a associated withproduct 130 a. By recognizingbarcode 132 a and communicating with in-store network 131 a wirelessly,device 100 a is enabled to download information concerning the characteristics ofitem 130 a. It should be appreciated that in place ofbarcode 132 adevice 100 a may recognize a storagebox containing item 130 a oritem 130 a itself. Then, by communicating with in-store network 131 a, a comparison of the captured image data with a library from in-store network 131 adevice 100 a is able to locate the characteristics such as price, size, color, etc., ofitem 130 a. The user then may move to store Y anduse device 100 a to download characteristics associated withitem 130 b. Here again, abarcode 132 b or image data of item 130 d or its storage container may be used to access the item characteristics, which can be any catalogue characteristics from in-store network 133 a. From this data, the user is then able to compare the characteristics ofitem 130 a in store X and 130 b in store Y. Thus, whereitem -
FIG. 7 is a simplified schematic diagram illustrating the use of a portable device and a card game application in accordance with one embodiment of the invention. Here, the user is pointingdevice 100 towardcards cards 140 and 140 b may have symbols or some kind of graphical data, which is recognized by logic withindevice 100. For example,cards 140 a hasimage 142 a andnumbers 142 b, which may be recognized byimage device 100.Card 140 b includesbarcode 142 c andmarker 142 d which also may be recognized bydevice 100. In one application, these markings may indicate the value of the cards in order to determine which card is the highest. Once each of the images/markings ofcards device 100, a simulated fight may take place ondisplay screen 102 where the winner of the fight will be associated with the higher ofcards portable device 100 and a special recognizable design on the card (possibly the back of the card), a new computer generated graphic can be superimposed on the card and displayed on the portable display. For example, for sports cards, the sports person or team on the card can be superimposed in a real 3D view and animated throwing the ball, etc. For role-playing games, it is possible to combine the cards and a video game on the portable device so that collecting physical cards becomes an important part of the game. In this case, a character of the game may be personalized by the player and this information could be swapped with other players via wireless network or via removable media (e.g. Memory Stick). - A similar technique could be used to augment business cards. In addition to the normal printed material on a business (or personal) card, a special identifying graphic could be included. This graphic can be associated with the individual and will reference information about that person potentially including photos, video, audio as well as the normal contact info. The personal information could be exchanged via removable media. In another embodiment a unique graphic is indexed an on-line database via a wireless network to get the information about that person. Having accessed the information, a superimposed graphic, e.g., the person's photo, can be created in place of the graphic on the portable display.
-
FIG. 8 is a flow chart illustrating the method operations for augmenting display data presented to a viewer in accordance with one embodiment of the invention. The method initiates withoperation 150 where the display data on a first display device is presented. Here, the display is shown on a television, computer monitor or some other suitable display device. Then inoperation 152, the display data on the display device is captured with an image capture device. For example, the portable device having image capture capability discussed above is one exemplary device having image capture capability, which includes video capture capability. The captured display data is then analyzed inoperation 154. This analysis is performed by logic within the portable device. The logic includes software or hardware or some combination of the two. In operation 156 a marker within the captured display data is identified. The marker may be a any suitable marker, such as the markers illustrated inFIGS. 4 and 7 . Inoperation 158 additional display data is defined in response to identifying the marker. The additional display data is generated by image generation logic of the portable device. Alternatively, the additional data may be downloaded from a wireless network. The captured display data and the additional display data are then presented on a display screen of the image capture device inoperation 160. -
FIG. 9 is a flow chart illustrating the method operations for providing information in a portable environment in accordance with one embodiment of the invention. The method initiates withoperation 170 where an image of a first object is captured in a first location. For example, an image of an item in a first store may be captured here. Inoperation 172 the object characteristics of the first object are accessed based upon the image of the first object. For example, a wireless network may be accessed within the store in order to obtain the object characteristics of the first object. Then, inoperation 174 the user may move to a second location. Inoperation 176 an image of a second object in the second location is captured. The object characteristics of the second object are accessed based upon the image of the second object inoperation 178. It should be appreciated that inoperations operation 180 the object characteristics of the first object and the object characteristics of the second object are presented to a user. Thus, the user may perform comparison shopping with the use of a portable device based upon the recognition of video image data and the access of in-store networks. -
FIG. 10 is a simplified schematic diagram illustrating the modules within the portable device in accordance with one embodiment of the invention.Portable device 100 includes central processing unit (CPU) 200, augmentedreality logic block 202,memory 210 and charged couple device (CCD)logic 212. As mentioned above, a complimentary metal oxide semiconductor (CMOS) image sensor may perform the camera functions on-chip in place ofCCD logic 212. One skilled in the art will appreciate that a CMOS image sensor draws less power than a CCD. Each module is in communication with each other throughbus 208. Augmentedreality logic block 202 includesimage recognition logic 204 andimage generation logic 206. It should be appreciated that augmentedreality logic block 202 may be a semiconductor chip incorporating the logic to execute the functionality described herein. Alternatively, the functionality described with respect to augmentedreality logic block 202,image recognition logic 204 andimage generation logic 206 may be performed in software. Here the code may be stored withinmemory 210. - In summary, the above-described invention describes a portable device capable of providing an enriched augmented reality experience. It should be appreciated that while the markers and graphics that are recognized by the system are computer generated, the invention is not limited to computer-generated markers. For example, a set of pre-authored symbols and a set of user definable symbols can be created which can be recognized even when drawn by hand in a manner recognizable to the camera of the image capture device. In this way, players could create complex 3D computer graphics via drawing simple symbols. In one embodiment, a player might draw a smiley face character and this might be recognized by the device and shown on the display as a popular cartoon or game character smiling. With user definable designs, users can also establish secret communications using these symbols.
- With the above embodiments in mind, it should be understood that the invention may employ various computer-implemented operations involving data stored in computer systems. These operations include operations requiring physical manipulation of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. Further, the manipulations performed are often referred to in terms, such as producing, identifying, determining, or comparing.
- The above-described invention may be practiced with other computer system configurations including hand-held devices, microprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers and the like. The invention may also be practiced in distributing computing environments where tasks are performed by remote processing devices that are linked through a communications network.
- The invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data, which can be thereafter read by a computer system. Examples of the computer readable medium include hard drives, network attached storage (NAS), read-only memory, random-access memory, CD-ROMs, CD-Rs, CD-RWs, magnetic tapes, and other optical and non-optical data storage devices. The computer readable medium can also be distributed over a network coupled computer system so that the computer readable code is stored and executed in a distributed fashion.
- Although the foregoing invention has been described in some detail for purposes of clarity of understanding, it will be apparent that certain changes and modifications may be practiced within the scope of the appended claims. Accordingly, the present embodiments are to be considered as illustrative and not restrictive, and the invention is not to be limited to the details given herein, but may be modified within the scope and equivalents of the appended claims. In the claims, elements and/or steps do not imply any particular order of operation, unless explicitly stated in the claims.
Claims (20)
1. A portable device configured to provide enhanced shopping information, comprising:
the portable device configured to access a wireless network, the portable device having a display screen and an image capture device, the portable device configured to access at least one database through the wireless network, the portable device including,
image recognition logic configured to perform analysis of an image of an object captured using the image capture device, the object including a bar code associated with a product, the analysis being done on the image to determine if graphics found on the object correspond to the bar code, an image portion having the bar code is communicated through the wireless network to the one or more databases to identify the product associated with the bar code; and
image generation logic configured to obtain a plurality of product information for the identified product from the one or more databases and presenting the plurality of product information on the display screen of the portable device, wherein the presenting defines multimedia data in a graphical user interface that includes one of an image of the product or text information about the product.
2. The portable device of claim 1 , wherein analysis of the image of the object recognizes the bar code from the graphics found on the object.
3. The portable device of claim 2 , wherein recognition of the bar code in the image of the object triggers communication of the image portion having the bar code to the database.
4. The portable device of claim 1 , wherein the image portion having the bar code is matched to a corresponding entry in the database.
5. The portable device of claim 1 , wherein capturing the image of the object is performed without scanning the image of the object.
6. The portable device of claim 1 , wherein the plurality of product information includes pricing, product reviews, and quantity in stock associated with the identified product.
7. The portable device of claim 1 , wherein the portable device is one of a cell phone, a personal digital assistant, a web tablet, or a pocket PC.
8. A method for obtaining product information through a portable device, comprising:
capturing an image of an object using an image capture device, the object including a bar code associated with a product;
analyzing the image of the object to determine if graphics found on the object correspond to a bar code;
transmitting an image portion having the bar code to at least one database through a wireless network;
identifying the product associated with the bar code through the image portion having the bar code that is provided to the one or more databases;
obtaining a plurality of product information from the one or more databases; and
presenting the plurality of product information associated with the identified product, wherein the presenting defines multimedia data in a graphical user interface that includes one of an image of the product or text information about the product.
9. The method of claim 8 , further comprising:
recognizing the bar code from the graphics of the object.
10. The method of claim 9 , further comprising:
triggering communication of the image portion having the bar code to the database upon recognition of the bar code in the image of the object.
11. The method of claim 8 , further comprising:
matching the transmitted image portion having the bar code to a corresponding entry in the database.
12. The method of claim 8 , wherein the plurality of product information includes audio/video media associated with the identified product.
13. The method of claim 12 , wherein the audio/video media associated with the identified product includes an audio clip representing a portion of a music compact disc or a video clip of a movie.
14. The method of claim 12 , wherein the audio/video media associated with the identified product represents a portion of a video game.
15. A computer readable media including program instructions for presenting product data associated with an identified product to a viewer, comprising:
program instructions for capturing an image of an object, the object having a bar code associated with a product;
program instructions for analyzing the image of the object to determine if graphics found on the object correspond to the bar code;
program instructions for transmitting an image portion having the bar code to at least one database through a wireless network;
program instructions for identifying the product associated with the bar code through the image portion having the bar code that is transmitted to the one or more databases;
program instructions for obtaining a plurality of product information associated with the identified product from the one or more databases; and
program instructions for presenting the plurality of product information associated with the identified product, wherein the presenting defines multimedia data in a graphical user interface that includes one of an image of the product or text information about the product.
16. The computer readable media of claim 15 , further comprising:
program instructions for recognizing the bar code from the graphics of the object.
17. The computer readable media of claim 15 , further comprising:
program instructions for matching the transmitted image portion having the bar code to a corresponding entry in the database.
18. The computer readable media of claim 15 , further comprising:
program instructions for triggering communication of the image portion having the bar code to the database upon recognition of the image of the bar code in the image of the object
19. The computer readable media of claim 15 , wherein the plurality of product information includes catalogue information associated with the identified product.
20. The computer readable media of claim 15 , wherein the multimedia data associated with the identified product includes an audio clip representing a portion of a music compact disc or a video clip of a movie.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/510,213 US20090285484A1 (en) | 2004-08-19 | 2009-07-27 | Portable image processing and multimedia interface |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/922,514 US8547401B2 (en) | 2004-08-19 | 2004-08-19 | Portable augmented reality device and method |
US12/510,213 US20090285484A1 (en) | 2004-08-19 | 2009-07-27 | Portable image processing and multimedia interface |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/922,514 Continuation US8547401B2 (en) | 2004-08-19 | 2004-08-19 | Portable augmented reality device and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090285484A1 true US20090285484A1 (en) | 2009-11-19 |
Family
ID=35909205
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/922,514 Active US8547401B2 (en) | 2004-08-19 | 2004-08-19 | Portable augmented reality device and method |
US12/510,213 Abandoned US20090285484A1 (en) | 2004-08-19 | 2009-07-27 | Portable image processing and multimedia interface |
US14/042,631 Active 2028-03-16 US10099147B2 (en) | 2004-08-19 | 2013-09-30 | Using a portable device to interface with a video game rendered on a main display |
US16/144,928 Abandoned US20190030441A1 (en) | 2004-08-19 | 2018-09-27 | Using a Portable Device to Interface with a Scene Rendered on a Main Display |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/922,514 Active US8547401B2 (en) | 2004-08-19 | 2004-08-19 | Portable augmented reality device and method |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/042,631 Active 2028-03-16 US10099147B2 (en) | 2004-08-19 | 2013-09-30 | Using a portable device to interface with a video game rendered on a main display |
US16/144,928 Abandoned US20190030441A1 (en) | 2004-08-19 | 2018-09-27 | Using a Portable Device to Interface with a Scene Rendered on a Main Display |
Country Status (5)
Country | Link |
---|---|
US (4) | US8547401B2 (en) |
EP (2) | EP2704102B1 (en) |
JP (2) | JP2008510254A (en) |
ES (1) | ES2611336T3 (en) |
WO (1) | WO2006023268A2 (en) |
Cited By (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090310594A1 (en) * | 2008-06-17 | 2009-12-17 | Nintendo Co., Ltd. | Data communication system, information processing apparatus and storage medium having stored thereon information processing program |
US20090313580A1 (en) * | 2008-06-17 | 2009-12-17 | Nintendo Co., Ltd. | Information processing apparatus, information processing system, and storage medium having stored thereon information processing program |
US20100261450A1 (en) * | 2009-04-14 | 2010-10-14 | Research In Motion Limited | Resolved mobile code content tracking |
US20100261454A1 (en) * | 2009-04-14 | 2010-10-14 | Research In Motion Limited | Retrieving additional content based on data within a mobile code |
US20100258630A1 (en) * | 2009-04-14 | 2010-10-14 | Research In Motion Limited | Systems and methods for updating resolved content of a mobile code |
US20110234879A1 (en) * | 2010-03-24 | 2011-09-29 | Sony Corporation | Image processing apparatus, image processing method and program |
US20120120296A1 (en) * | 2010-11-17 | 2012-05-17 | Verizon Patent And Licensing, Inc. | Methods and Systems for Dynamically Presenting Enhanced Content During a Presentation of a Media Content Instance |
US20120280917A1 (en) * | 2011-05-03 | 2012-11-08 | Toksvig Michael John Mckenzie | Adjusting Mobile Device State Based on User Intentions and/or Identity |
US20120309537A1 (en) * | 2011-06-03 | 2012-12-06 | Nintendo Co., Ltd. | Computer-readable storage medium, information processing apparatus, information processing system and information processing method |
US8384770B2 (en) | 2010-06-02 | 2013-02-26 | Nintendo Co., Ltd. | Image display system, image display apparatus, and image display method |
US20130088629A1 (en) * | 2011-10-06 | 2013-04-11 | Samsung Electronics Co., Ltd. | Mobile device and method of remotely controlling a controlled device |
US20130196772A1 (en) * | 2012-01-31 | 2013-08-01 | Stephen Latta | Matching physical locations for shared virtual experience |
US8512152B2 (en) | 2010-06-11 | 2013-08-20 | Nintendo Co., Ltd. | Hand-held game apparatus and housing part of the same |
US20130250142A1 (en) * | 2012-03-20 | 2013-09-26 | Sean Elwell | Device and method for flexibly associating existing readable surfaces with computer and web-based supplemental content |
US20130259293A1 (en) * | 2012-03-28 | 2013-10-03 | Walton Advanced Engineering Inc. | Application program execution method |
US20130328760A1 (en) * | 2012-06-08 | 2013-12-12 | Qualcomm Incorporated | Fast feature detection by reducing an area of a camera image |
US8633947B2 (en) | 2010-06-02 | 2014-01-21 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein information processing program, information processing apparatus, information processing system, and information processing method |
US20140066048A1 (en) * | 2010-05-18 | 2014-03-06 | Electric Mirror, Llc | Apparatuses and methods for streaming audio and video |
US20140185871A1 (en) * | 2012-12-27 | 2014-07-03 | Sony Corporation | Information processing apparatus, content providing method, and computer program |
US8780183B2 (en) | 2010-06-11 | 2014-07-15 | Nintendo Co., Ltd. | Computer-readable storage medium, image display apparatus, image display system, and image display method |
US8854356B2 (en) | 2010-09-28 | 2014-10-07 | Nintendo Co., Ltd. | Storage medium having stored therein image processing program, image processing apparatus, image processing system, and image processing method |
US8894486B2 (en) | 2010-01-14 | 2014-11-25 | Nintendo Co., Ltd. | Handheld information processing apparatus and handheld game apparatus |
US8896685B2 (en) | 2010-03-14 | 2014-11-25 | Ns Solutions Corporation | Method and system for determining information relating to vacant spaces of a parking lot |
US20150170260A1 (en) * | 2012-02-29 | 2015-06-18 | Google Inc. | Methods and Systems for Using a Mobile Device to Visualize a Three-Dimensional Physical Object Placed Within a Three-Dimensional Environment |
US20150235435A1 (en) * | 2013-03-11 | 2015-08-20 | Magic Leap, Inc. | Recognizing objects in a passable world model in augmented or virtual reality systems |
US9128293B2 (en) | 2010-01-14 | 2015-09-08 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
EP2824591A4 (en) * | 2012-03-08 | 2015-11-25 | Omron Tateisi Electronics Co | Output device, output system, and program |
US9277367B2 (en) | 2012-02-28 | 2016-03-01 | Blackberry Limited | Method and device for providing augmented reality output |
US20160062481A1 (en) * | 2014-08-29 | 2016-03-03 | Kyocera Document Solutions Inc. | Electronic equipment displaying various kinds of information available by wearing on body |
US9278281B2 (en) | 2010-09-27 | 2016-03-08 | Nintendo Co., Ltd. | Computer-readable storage medium, information processing apparatus, information processing system, and information processing method |
US9417452B2 (en) | 2013-03-15 | 2016-08-16 | Magic Leap, Inc. | Display system and method |
US9679547B1 (en) | 2016-04-04 | 2017-06-13 | Disney Enterprises, Inc. | Augmented reality music composition |
CN107067295A (en) * | 2017-03-13 | 2017-08-18 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
WO2017155236A1 (en) * | 2016-03-09 | 2017-09-14 | Samsung Electronics Co., Ltd. | Configuration and operation of display devices including content curation |
US20170330036A1 (en) * | 2015-01-29 | 2017-11-16 | Aurasma Limited | Provide augmented reality content |
US10453263B2 (en) | 2018-02-27 | 2019-10-22 | Verizon Patent And Licensing Inc. | Methods and systems for displaying augmented reality content associated with a media content instance |
US10462651B1 (en) * | 2010-05-18 | 2019-10-29 | Electric Mirror, Llc | Apparatuses and methods for streaming audio and video |
US10506218B2 (en) | 2010-03-12 | 2019-12-10 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US11170565B2 (en) | 2018-08-31 | 2021-11-09 | Magic Leap, Inc. | Spatially-resolved dynamic dimming for augmented reality device |
US20220191392A1 (en) * | 2020-12-10 | 2022-06-16 | Seiko Epson Corporation | Display method, detection apparatus, and non-transitory computer-readable storage medium storing a program |
Families Citing this family (285)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7565008B2 (en) | 2000-11-06 | 2009-07-21 | Evryx Technologies, Inc. | Data capture and identification system and process |
US8224078B2 (en) | 2000-11-06 | 2012-07-17 | Nant Holdings Ip, Llc | Image capture and identification system and process |
US7680324B2 (en) | 2000-11-06 | 2010-03-16 | Evryx Technologies, Inc. | Use of image-derived information as search criteria for internet and other search engines |
US20120154438A1 (en) * | 2000-11-06 | 2012-06-21 | Nant Holdings Ip, Llc | Interactivity Via Mobile Image Recognition |
US7899243B2 (en) | 2000-11-06 | 2011-03-01 | Evryx Technologies, Inc. | Image capture and identification system and process |
US8817045B2 (en) | 2000-11-06 | 2014-08-26 | Nant Holdings Ip, Llc | Interactivity via mobile image recognition |
US9310892B2 (en) | 2000-11-06 | 2016-04-12 | Nant Holdings Ip, Llc | Object information derived from object images |
US20090118019A1 (en) * | 2002-12-10 | 2009-05-07 | Onlive, Inc. | System for streaming databases serving real-time applications used through streaming interactive video |
US11278793B2 (en) * | 2004-03-31 | 2022-03-22 | Nintendo Co., Ltd. | Game console |
US8267780B2 (en) * | 2004-03-31 | 2012-09-18 | Nintendo Co., Ltd. | Game console and memory card |
US8547401B2 (en) * | 2004-08-19 | 2013-10-01 | Sony Computer Entertainment Inc. | Portable augmented reality device and method |
US20060094504A1 (en) * | 2004-11-03 | 2006-05-04 | George Polchin | Method and apparatus for dynamic enhancement of video games with vendor specific data |
PT103264B (en) * | 2005-04-22 | 2007-02-28 | Ydreams Informatica Sa | VIRTUAL MIRADOUR: INFORMATION VISUALIZATION SYSTEM OVERCOMING THE REAL IMAGE |
CN101273368A (en) * | 2005-08-29 | 2008-09-24 | 埃韦里克斯技术股份有限公司 | Interactivity via mobile image recognition |
JP2007093259A (en) * | 2005-09-27 | 2007-04-12 | Sharp Corp | Sensing system, program execution system, and imaging system |
US20070184899A1 (en) * | 2006-02-03 | 2007-08-09 | Nokia Corporation | Gaming device, method, and computer program product for modifying input to a native application to present modified output |
US7553229B2 (en) * | 2006-03-21 | 2009-06-30 | Avago Technologies General Ip (Singapore) Pte. Ltd. | Active referencing method with interleaved crosshair navigation frames |
JP4757115B2 (en) * | 2006-06-28 | 2011-08-24 | キヤノン株式会社 | Image processing apparatus and image processing method |
JP2009542297A (en) * | 2006-07-07 | 2009-12-03 | エーエムビーエックス ユーケー リミテッド | Ambient environmental effects |
US7847808B2 (en) * | 2006-07-19 | 2010-12-07 | World Golf Tour, Inc. | Photographic mapping in a simulation |
US20080120558A1 (en) | 2006-11-16 | 2008-05-22 | Paco Xander Nathan | Systems and methods for managing a persistent virtual avatar with migrational ability |
US9253183B2 (en) | 2006-11-16 | 2016-02-02 | Mark Stephen Meadows | Systems and methods for authenticating an avatar |
US20080143825A1 (en) * | 2006-12-19 | 2008-06-19 | Barry Atkinson | Portable multimedia device |
US20080235600A1 (en) * | 2007-03-23 | 2008-09-25 | Microsoft Corporation | Interaction with a Display System |
US8117137B2 (en) | 2007-04-19 | 2012-02-14 | Microsoft Corporation | Field-programmable gate array based accelerator system |
WO2008144729A2 (en) * | 2007-05-21 | 2008-11-27 | World Golf Tour, Inc. | Electronic game utilizing photographs |
US20080310707A1 (en) * | 2007-06-15 | 2008-12-18 | Microsoft Corporation | Virtual reality enhancement using real world data |
CN101795738B (en) * | 2007-09-07 | 2013-05-08 | 安布克斯英国有限公司 | A method for generating an effect script corresponding to a game play event |
US8180396B2 (en) | 2007-10-18 | 2012-05-15 | Yahoo! Inc. | User augmented reality for camera-enabled mobile devices |
US9058764B1 (en) * | 2007-11-30 | 2015-06-16 | Sprint Communications Company L.P. | Markers to implement augmented reality |
US8264505B2 (en) | 2007-12-28 | 2012-09-11 | Microsoft Corporation | Augmented reality and filtering |
US8217995B2 (en) * | 2008-01-18 | 2012-07-10 | Lockheed Martin Corporation | Providing a collaborative immersive environment using a spherical camera and motion capture |
KR100963238B1 (en) * | 2008-02-12 | 2010-06-10 | 광주과학기술원 | Tabletop-Mobile augmented reality systems for individualization and co-working and Interacting methods using augmented reality |
US8231465B2 (en) * | 2008-02-21 | 2012-07-31 | Palo Alto Research Center Incorporated | Location-aware mixed-reality gaming platform |
US9495386B2 (en) | 2008-03-05 | 2016-11-15 | Ebay Inc. | Identification of items depicted in images |
US10936650B2 (en) | 2008-03-05 | 2021-03-02 | Ebay Inc. | Method and apparatus for image recognition services |
US8199966B2 (en) * | 2008-05-14 | 2012-06-12 | International Business Machines Corporation | System and method for providing contemporaneous product information with animated virtual representations |
US8542906B1 (en) | 2008-05-21 | 2013-09-24 | Sprint Communications Company L.P. | Augmented reality image offset and overlay |
US20090289955A1 (en) * | 2008-05-22 | 2009-11-26 | Yahoo! Inc. | Reality overlay device |
US8711176B2 (en) * | 2008-05-22 | 2014-04-29 | Yahoo! Inc. | Virtual billboards |
US7796190B2 (en) * | 2008-08-15 | 2010-09-14 | At&T Labs, Inc. | System and method for adaptive content rendition |
US8301638B2 (en) | 2008-09-25 | 2012-10-30 | Microsoft Corporation | Automated feature selection based on rankboost for ranking |
US8131659B2 (en) | 2008-09-25 | 2012-03-06 | Microsoft Corporation | Field-programmable gate array based accelerator system |
US20100228476A1 (en) * | 2009-03-04 | 2010-09-09 | Microsoft Corporation | Path projection to facilitate engagement |
US9024972B1 (en) | 2009-04-01 | 2015-05-05 | Microsoft Technology Licensing, Llc | Augmented reality computing with inertial sensors |
US8943420B2 (en) * | 2009-06-18 | 2015-01-27 | Microsoft Corporation | Augmenting a field of view |
US8907941B2 (en) * | 2009-06-23 | 2014-12-09 | Disney Enterprises, Inc. | System and method for integrating multiple virtual rendering systems to provide an augmented reality |
US8645220B2 (en) * | 2009-08-28 | 2014-02-04 | Homer Tlc, Inc. | Method and system for creating an augmented reality experience in connection with a stored value token |
US20120022924A1 (en) * | 2009-08-28 | 2012-01-26 | Nicole Runnels | Method and system for creating a personalized experience with video in connection with a stored value token |
US8773465B2 (en) * | 2009-09-11 | 2014-07-08 | Trimble Navigation Limited | Methods and apparatus for providing navigational information associated with locations of objects |
KR100957575B1 (en) * | 2009-10-01 | 2010-05-11 | (주)올라웍스 | Method, terminal and computer-readable recording medium for performing visual search based on movement or pose of terminal |
US9424583B2 (en) * | 2009-10-15 | 2016-08-23 | Empire Technology Development Llc | Differential trials in augmented reality |
JP4816789B2 (en) | 2009-11-16 | 2011-11-16 | ソニー株式会社 | Information processing apparatus, information processing method, program, and information processing system |
JP2011118834A (en) | 2009-12-07 | 2011-06-16 | Sony Corp | Apparatus and method for processing information, and program |
US9164577B2 (en) | 2009-12-22 | 2015-10-20 | Ebay Inc. | Augmented reality system, method, and apparatus for displaying an item image in a contextual environment |
EP2359915B1 (en) * | 2009-12-31 | 2017-04-19 | Sony Computer Entertainment Europe Limited | Media viewing |
KR101036280B1 (en) * | 2010-01-26 | 2011-05-23 | 광주과학기술원 | 3d menu system using manipulation device |
US8913009B2 (en) * | 2010-02-03 | 2014-12-16 | Nintendo Co., Ltd. | Spatially-correlated multi-display human-machine interface |
US9170766B2 (en) * | 2010-03-01 | 2015-10-27 | Metaio Gmbh | Method of displaying virtual information in a view of a real environment |
JP5280475B2 (en) * | 2010-03-31 | 2013-09-04 | 新日鉄住金ソリューションズ株式会社 | Information processing system, information processing method, and program |
US20110234631A1 (en) * | 2010-03-25 | 2011-09-29 | Bizmodeline Co., Ltd. | Augmented reality systems |
US9264785B2 (en) | 2010-04-01 | 2016-02-16 | Sony Computer Entertainment Inc. | Media fingerprinting for content determination and retrieval |
US8560583B2 (en) | 2010-04-01 | 2013-10-15 | Sony Computer Entertainment Inc. | Media fingerprinting for social networking |
KR101677718B1 (en) * | 2010-04-14 | 2016-12-06 | 삼성전자주식회사 | Method and Apparatus for Processing Virtual World |
JP4971483B2 (en) | 2010-05-14 | 2012-07-11 | 任天堂株式会社 | Image display program, image display apparatus, image display system, and image display method |
JP5656457B2 (en) * | 2010-06-01 | 2015-01-21 | シャープ株式会社 | Product information providing terminal device and product information providing system |
JP5643549B2 (en) * | 2010-06-11 | 2014-12-17 | 任天堂株式会社 | Image processing system, image processing program, image processing apparatus, and image processing method |
EP2395474A3 (en) * | 2010-06-11 | 2014-03-26 | Nintendo Co., Ltd. | Storage medium having image recognition program stored therein, image recognition apparatus, image recognition system, and image recognition method |
JP4757948B1 (en) * | 2010-06-11 | 2011-08-24 | 任天堂株式会社 | Information processing program, information processing apparatus, information processing system, and information processing method |
US20110310260A1 (en) * | 2010-06-18 | 2011-12-22 | Minx, Inc. | Augmented Reality |
US8762041B2 (en) | 2010-06-21 | 2014-06-24 | Blackberry Limited | Method, device and system for presenting navigational information |
US8581844B2 (en) | 2010-06-23 | 2013-11-12 | Google Inc. | Switching between a first operational mode and a second operational mode using a natural motion gesture |
US9814977B2 (en) * | 2010-07-13 | 2017-11-14 | Sony Interactive Entertainment Inc. | Supplemental video content on a mobile device |
US9832441B2 (en) * | 2010-07-13 | 2017-11-28 | Sony Interactive Entertainment Inc. | Supplemental content on a mobile device |
US9159165B2 (en) | 2010-07-13 | 2015-10-13 | Sony Computer Entertainment Inc. | Position-dependent gaming, 3-D controller, and handheld as a remote |
US9143699B2 (en) | 2010-07-13 | 2015-09-22 | Sony Computer Entertainment Inc. | Overlay non-video content on a mobile device |
US8730354B2 (en) | 2010-07-13 | 2014-05-20 | Sony Computer Entertainment Inc | Overlay video content on a mobile device |
KR101383982B1 (en) * | 2010-08-06 | 2014-04-10 | 주식회사 비즈모델라인 | Apparatus and method for augmented reality |
KR101722687B1 (en) | 2010-08-10 | 2017-04-04 | 삼성전자주식회사 | Method for providing information between objects or object and user, user device, and storage medium thereof |
US9118832B2 (en) | 2010-08-17 | 2015-08-25 | Nokia Technologies Oy | Input method |
KR101330805B1 (en) * | 2010-08-18 | 2013-11-18 | 주식회사 팬택 | Apparatus and Method for Providing Augmented Reality |
US9466148B2 (en) * | 2010-09-03 | 2016-10-11 | Disney Enterprises, Inc. | Systems and methods to dynamically adjust an image on a display monitor represented in a video feed |
JP5814532B2 (en) * | 2010-09-24 | 2015-11-17 | 任天堂株式会社 | Display control program, display control apparatus, display control system, and display control method |
JP5701559B2 (en) * | 2010-10-12 | 2015-04-15 | 株式会社三共 | GAME SYSTEM, TERMINAL DEVICE, TERMINAL DEVICE PROGRAM, AND GAME MACHINE |
US8854298B2 (en) * | 2010-10-12 | 2014-10-07 | Sony Computer Entertainment Inc. | System for enabling a handheld device to capture video of an interactive application |
US20120086630A1 (en) * | 2010-10-12 | 2012-04-12 | Sony Computer Entertainment Inc. | Using a portable gaming device to record or modify a game or application in real-time running on a home gaming system |
US10127606B2 (en) | 2010-10-13 | 2018-11-13 | Ebay Inc. | Augmented reality system and method for visualizing an item |
JP5701561B2 (en) * | 2010-10-13 | 2015-04-15 | 株式会社三共 | GAME SYSTEM, INFORMATION MANAGEMENT DEVICE, GAME MACHINE, TERMINAL DEVICE, AND TERMINAL DEVICE PROGRAM |
JPWO2012056499A1 (en) * | 2010-10-28 | 2014-02-24 | M.O.T株式会社 | Product information provision system |
US9286721B2 (en) * | 2010-11-08 | 2016-03-15 | Sony Corporation | Augmented reality system for product identification and promotion |
US20120120113A1 (en) * | 2010-11-15 | 2012-05-17 | Eduardo Hueso | Method and apparatus for visualizing 2D product images integrated in a real-world environment |
US8576276B2 (en) | 2010-11-18 | 2013-11-05 | Microsoft Corporation | Head-mounted display device which provides surround video |
KR101338818B1 (en) * | 2010-11-29 | 2013-12-06 | 주식회사 팬택 | Mobile terminal and information display method using the same |
ES2383976B1 (en) * | 2010-12-03 | 2013-05-08 | Alu Group, S.L. | METHOD FOR VIRTUAL FOOTWEAR TESTING. |
JP5170223B2 (en) | 2010-12-07 | 2013-03-27 | カシオ計算機株式会社 | Information display system, information display device, information providing device, and program |
JP5703726B2 (en) * | 2010-12-07 | 2015-04-22 | カシオ計算機株式会社 | Information display system, information display device, information providing device, and program |
JP5195885B2 (en) | 2010-12-07 | 2013-05-15 | カシオ計算機株式会社 | Information display system, information display device, and program |
KR101269773B1 (en) * | 2010-12-13 | 2013-05-30 | 주식회사 팬택 | Terminal and method for providing augmented reality |
US9111418B2 (en) | 2010-12-15 | 2015-08-18 | Bally Gaming, Inc. | System and method for augmented reality using a player card |
US8913085B2 (en) | 2010-12-22 | 2014-12-16 | Intel Corporation | Object mapping techniques for mobile augmented reality applications |
EP2661666A4 (en) * | 2011-01-05 | 2015-01-21 | Razer Asia Pacific Pte Ltd | Systems and methods for managing, selecting, and updating visual interface content using display-enabled keyboards, keypads, and/or other user input devices |
US20120208456A1 (en) * | 2011-02-15 | 2012-08-16 | Ontario, Canada) | Mobile wireless communications device providing object reference data based upon near field communication (nfc) and related methods |
US8326281B2 (en) * | 2011-02-16 | 2012-12-04 | Research In Motion Limited | Mobile wireless communications device providing object reference data based upon near field communication (NFC) and related methods |
KR20120095247A (en) * | 2011-02-18 | 2012-08-28 | 삼성전자주식회사 | Mobile apparatus and method for displaying information |
JP5691632B2 (en) * | 2011-02-24 | 2015-04-01 | 株式会社大林組 | Image composition method |
JP2012174208A (en) * | 2011-02-24 | 2012-09-10 | Sony Corp | Information processing apparatus, information processing method, program, and terminal device |
JP5697487B2 (en) * | 2011-02-25 | 2015-04-08 | 任天堂株式会社 | Image processing system, image processing method, image processing apparatus, and image processing program |
US20120233033A1 (en) * | 2011-03-08 | 2012-09-13 | Bank Of America Corporation | Assessing environmental characteristics in a video stream captured by a mobile device |
US9317860B2 (en) | 2011-03-08 | 2016-04-19 | Bank Of America Corporation | Collective network of augmented reality users |
US9406031B2 (en) | 2011-03-08 | 2016-08-02 | Bank Of America Corporation | Providing social impact information associated with identified products or businesses |
US9224166B2 (en) | 2011-03-08 | 2015-12-29 | Bank Of America Corporation | Retrieving product information from embedded sensors via mobile device video analysis |
US9773285B2 (en) | 2011-03-08 | 2017-09-26 | Bank Of America Corporation | Providing data associated with relationships between individuals and images |
US9317835B2 (en) | 2011-03-08 | 2016-04-19 | Bank Of America Corporation | Populating budgets and/or wish lists using real-time video image analysis |
JP5728775B2 (en) * | 2011-03-22 | 2015-06-03 | 株式会社Where | Information processing apparatus and information processing method |
JP2012215989A (en) * | 2011-03-31 | 2012-11-08 | Toppan Printing Co Ltd | Augmented reality display method |
US20120259744A1 (en) * | 2011-04-07 | 2012-10-11 | Infosys Technologies, Ltd. | System and method for augmented reality and social networking enhanced retail shopping |
US8810598B2 (en) | 2011-04-08 | 2014-08-19 | Nant Holdings Ip, Llc | Interference based augmented reality hosting platforms |
US9335162B2 (en) | 2011-04-19 | 2016-05-10 | Ford Global Technologies, Llc | Trailer length estimation in hitch angle applications |
JP6020446B2 (en) | 2011-04-20 | 2016-11-02 | 日本電気株式会社 | Image display system, image display apparatus, image display method, and program |
US8848970B2 (en) * | 2011-04-26 | 2014-09-30 | Digimarc Corporation | Salient point-based arrangements |
JP5799376B2 (en) * | 2011-05-17 | 2015-10-21 | 株式会社ソフイア | Game machine |
US9547938B2 (en) * | 2011-05-27 | 2017-01-17 | A9.Com, Inc. | Augmenting a live view |
JP5890969B2 (en) * | 2011-06-03 | 2016-03-22 | 任天堂株式会社 | Information processing program, information processing apparatus, information processing system, and information processing method |
US8550909B2 (en) | 2011-06-10 | 2013-10-08 | Microsoft Corporation | Geographic data acquisition by user motivation |
US8498404B2 (en) | 2011-06-20 | 2013-07-30 | Avaya Inc. | Methods and systems for monitoring contact center operations |
US10242456B2 (en) | 2011-06-23 | 2019-03-26 | Limitless Computing, Inc. | Digitally encoded marker-based augmented reality (AR) |
US9092674B2 (en) | 2011-06-23 | 2015-07-28 | International Business Machines Corportion | Method for enhanced location based and context sensitive augmented reality translation |
JP5145444B2 (en) * | 2011-06-27 | 2013-02-20 | 株式会社コナミデジタルエンタテインメント | Image processing apparatus, image processing apparatus control method, and program |
US8963957B2 (en) * | 2011-07-15 | 2015-02-24 | Mark Skarulis | Systems and methods for an augmented reality platform |
JP2013026660A (en) * | 2011-07-15 | 2013-02-04 | Sanyo Electric Co Ltd | Electronic camera |
US9965564B2 (en) * | 2011-07-26 | 2018-05-08 | Schneider Electric It Corporation | Apparatus and method of displaying hardware status using augmented reality |
US20140063061A1 (en) * | 2011-08-26 | 2014-03-06 | Reincloud Corporation | Determining a position of an item in a virtual augmented space |
JP2013052077A (en) * | 2011-09-02 | 2013-03-21 | Daikoku Denki Co Ltd | Mobile terminal device for game machine |
JP5739771B2 (en) * | 2011-09-08 | 2015-06-24 | ダイコク電機株式会社 | Game system |
JP5739772B2 (en) * | 2011-09-09 | 2015-06-24 | ダイコク電機株式会社 | Portable terminal device for gaming machine |
JP5816033B2 (en) * | 2011-09-09 | 2015-11-17 | ダイコク電機株式会社 | GAME PORTABLE TERMINAL AND GAME PROGRAM |
JP5816035B2 (en) * | 2011-09-15 | 2015-11-17 | ダイコク電機株式会社 | Game system |
JP5927822B2 (en) * | 2011-09-21 | 2016-06-01 | カシオ計算機株式会社 | Image communication system |
JP5819691B2 (en) * | 2011-09-22 | 2015-11-24 | ダイコク電機株式会社 | GAME PORTABLE TERMINAL AND GAME PROGRAM |
WO2013044983A1 (en) * | 2011-09-30 | 2013-04-04 | Layar B.V. | Feedback to user for indicating augmentability of an image |
US9345957B2 (en) | 2011-09-30 | 2016-05-24 | Microsoft Technology Licensing, Llc | Enhancing a sport using an augmented reality display |
US9606992B2 (en) | 2011-09-30 | 2017-03-28 | Microsoft Technology Licensing, Llc | Personal audio/visual apparatus providing resource management |
US9268406B2 (en) | 2011-09-30 | 2016-02-23 | Microsoft Technology Licensing, Llc | Virtual spectator experience with a personal audio/visual apparatus |
US9573053B2 (en) * | 2011-09-30 | 2017-02-21 | Bally Gaming, Inc. | Augmented reality for table games |
US9286711B2 (en) | 2011-09-30 | 2016-03-15 | Microsoft Technology Licensing, Llc | Representing a location at a previous time period using an augmented reality display |
CN102402460A (en) * | 2011-10-24 | 2012-04-04 | 广东威创视讯科技股份有限公司 | Switching method and device for user interface of AR (Augmented Reality) software based on smart mobile device |
US9449342B2 (en) | 2011-10-27 | 2016-09-20 | Ebay Inc. | System and method for visualization of items in an environment using augmented reality |
JP5841409B2 (en) | 2011-11-09 | 2016-01-13 | 任天堂株式会社 | Control program, input terminal device, control system, and control method |
JP5810890B2 (en) * | 2011-12-20 | 2015-11-11 | カシオ計算機株式会社 | Information processing apparatus, information processing method, and program |
US8681179B2 (en) * | 2011-12-20 | 2014-03-25 | Xerox Corporation | Method and system for coordinating collisions between augmented reality and real reality |
US9240059B2 (en) | 2011-12-29 | 2016-01-19 | Ebay Inc. | Personal augmented reality |
CN103197980B (en) * | 2012-01-10 | 2016-03-30 | 华为终端有限公司 | A kind of method, Apparatus and system presenting augmented reality content |
US8606645B1 (en) * | 2012-02-02 | 2013-12-10 | SeeMore Interactive, Inc. | Method, medium, and system for an augmented reality retail application |
EP2635013A1 (en) * | 2012-02-28 | 2013-09-04 | BlackBerry Limited | Method and device for providing augmented reality output |
US20150134497A1 (en) * | 2012-03-15 | 2015-05-14 | Sca Hygiene Products Ab | Method for assisting in locating an item in a storage location |
US20150169568A1 (en) * | 2012-03-16 | 2015-06-18 | Laura Garcia-Barrio | Method and apparatus for enabling digital memory walls |
KR101890140B1 (en) * | 2012-05-07 | 2018-09-28 | 삼성전자주식회사 | A method for controlling a display apparatus using a camera device and mobile device, display apparatus, and system thereof |
JP5122036B1 (en) | 2012-05-25 | 2013-01-16 | 任天堂株式会社 | Operating device, information processing system, and communication method |
US8749489B2 (en) | 2012-05-25 | 2014-06-10 | Nintendo Co., Ltd. | Controller device, information processing system, and communication method |
US10429961B2 (en) * | 2012-05-25 | 2019-10-01 | Nintendo Co., Ltd. | Controller device, information processing system, and information processing method |
JP6534198B2 (en) * | 2012-05-31 | 2019-06-26 | 任天堂株式会社 | Game system, game processing method, game device and game program |
JP5404956B2 (en) * | 2012-06-15 | 2014-02-05 | シャープ株式会社 | Information distribution apparatus, information distribution system, information distribution method, and portable communication device |
US10176635B2 (en) * | 2012-06-28 | 2019-01-08 | Microsoft Technology Licensing, Llc | Saving augmented realities |
US10846766B2 (en) | 2012-06-29 | 2020-11-24 | Ebay Inc. | Contextual menus based on image recognition |
US20140015931A1 (en) * | 2012-07-12 | 2014-01-16 | Samsung Electronics Co., Ltd. | Method and apparatus for processing virtual world |
US8743224B2 (en) | 2012-07-13 | 2014-06-03 | Intel Corporation | Context based management for secure augmented reality applications |
US9361730B2 (en) * | 2012-07-26 | 2016-06-07 | Qualcomm Incorporated | Interactions of tangible and augmented reality objects |
JP2014041508A (en) * | 2012-08-23 | 2014-03-06 | Osaka Sealing Printing Co Ltd | Merchandise information providing system |
US9589000B2 (en) * | 2012-08-30 | 2017-03-07 | Atheer, Inc. | Method and apparatus for content association and history tracking in virtual and augmented reality |
US9530232B2 (en) * | 2012-09-04 | 2016-12-27 | Qualcomm Incorporated | Augmented reality surface segmentation |
EP2893706B1 (en) * | 2012-09-04 | 2020-01-08 | Synamedia Limited | Augmented reality for video system |
GB201216210D0 (en) | 2012-09-12 | 2012-10-24 | Appeartome Ltd | Augmented reality apparatus and method |
US9336541B2 (en) | 2012-09-21 | 2016-05-10 | Paypal, Inc. | Augmented reality product instructions, tutorials and visualizations |
US9116604B2 (en) * | 2012-10-25 | 2015-08-25 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Multi-device visual correlation interaction |
SK500492012A3 (en) * | 2012-10-31 | 2014-05-06 | Andrej Grék | The mode of interaction using augmented reality |
JP6018480B2 (en) * | 2012-11-05 | 2016-11-02 | 任天堂株式会社 | Information processing program, information processing apparatus, information processing system, and information processing method |
JP2014106490A (en) * | 2012-11-29 | 2014-06-09 | Buffalo Inc | Code image processing system, code image display apparatus, image display apparatus, and program |
US9215368B2 (en) * | 2012-12-02 | 2015-12-15 | Bachir Babale | Virtual decals for precision alignment and stabilization of motion graphics on mobile video |
KR101981964B1 (en) * | 2012-12-03 | 2019-05-24 | 삼성전자주식회사 | Terminal and method for realizing virtual reality |
US20140172570A1 (en) * | 2012-12-14 | 2014-06-19 | Blaise Aguera y Arcas | Mobile and augmented-reality advertisements using device imaging |
GB2510811A (en) * | 2012-12-18 | 2014-08-20 | Optricks Media Ltd | Augmented reality systems |
US20140175162A1 (en) * | 2012-12-20 | 2014-06-26 | Wal-Mart Stores, Inc. | Identifying Products As A Consumer Moves Within A Retail Store |
US9063692B2 (en) * | 2012-12-21 | 2015-06-23 | Nokia Technologies Oy | Method and apparatus for sharing content |
US9075432B2 (en) * | 2012-12-21 | 2015-07-07 | Nokia Technologies Oy | Method and apparatus for sharing content |
KR102131646B1 (en) * | 2013-01-03 | 2020-07-08 | 삼성전자주식회사 | Display apparatus and control method thereof |
US9035771B2 (en) | 2013-01-31 | 2015-05-19 | Wal-Mart Stores, Inc. | Theft detection system |
US9042603B2 (en) * | 2013-02-25 | 2015-05-26 | Ford Global Technologies, Llc | Method and apparatus for estimating the distance from trailer axle to tongue |
US9547917B2 (en) | 2013-03-14 | 2017-01-17 | Paypay, Inc. | Using augmented reality to determine information |
US9489772B2 (en) * | 2013-03-27 | 2016-11-08 | Intel Corporation | Environment actuation by one or more augmented reality elements |
WO2014182545A1 (en) * | 2013-05-04 | 2014-11-13 | Vupad Partners, Llc | Virtual object scaling in augmented reality environment |
JP2014230087A (en) * | 2013-05-22 | 2014-12-08 | オリンパス株式会社 | Imaging control terminal, imaging terminal, imaging system, imaging method, and program |
US9579573B2 (en) | 2013-06-10 | 2017-02-28 | Pixel Press Technology, LLC | Systems and methods for creating a playable video game from a three-dimensional model |
US10363486B2 (en) | 2013-06-10 | 2019-07-30 | Pixel Press Technology, LLC | Smart video game board system and methods |
US9370721B2 (en) | 2013-06-10 | 2016-06-21 | Pixel Press Technology, LLC | Systems and methods for creating a playable video game from a static model |
JP6329343B2 (en) * | 2013-06-13 | 2018-05-23 | 任天堂株式会社 | Image processing system, image processing apparatus, image processing program, and image processing method |
JP2015001875A (en) * | 2013-06-17 | 2015-01-05 | ソニー株式会社 | Image processing apparatus, image processing method, program, print medium, and print-media set |
US9779548B2 (en) * | 2013-06-25 | 2017-10-03 | Jordan Kent Weisman | Multiuser augmented reality system |
US9582516B2 (en) | 2013-10-17 | 2017-02-28 | Nant Holdings Ip, Llc | Wide area augmented reality location-based services |
EP2871634A1 (en) | 2013-11-06 | 2015-05-13 | Thomson Licensing | Color improvement of selected part of an image |
US8880151B1 (en) | 2013-11-27 | 2014-11-04 | Clear Guide Medical, Llc | Surgical needle for a surgical system with optical recognition |
US9622720B2 (en) | 2013-11-27 | 2017-04-18 | Clear Guide Medical, Inc. | Ultrasound system with stereo image guidance or tracking |
US9191620B1 (en) | 2013-12-20 | 2015-11-17 | Sprint Communications Company L.P. | Voice call using augmented reality |
US9514573B2 (en) * | 2013-12-26 | 2016-12-06 | Dassault Systemes | Diminished reality |
US10037821B2 (en) | 2013-12-27 | 2018-07-31 | General Electric Company | System for integrated protocol and decision support |
US9761059B2 (en) | 2014-01-03 | 2017-09-12 | Intel Corporation | Dynamic augmentation of a physical scene |
US9536351B1 (en) * | 2014-02-03 | 2017-01-03 | Bentley Systems, Incorporated | Third person view augmented reality |
US9311639B2 (en) | 2014-02-11 | 2016-04-12 | Digimarc Corporation | Methods, apparatus and arrangements for device to device communication |
US9615177B2 (en) | 2014-03-06 | 2017-04-04 | Sphere Optics Company, Llc | Wireless immersive experience capture and viewing |
JP2015176186A (en) * | 2014-03-13 | 2015-10-05 | ソニー株式会社 | Information processing apparatus, information processing method and information processing system |
US9613448B1 (en) | 2014-03-14 | 2017-04-04 | Google Inc. | Augmented display of information in a device view of a display screen |
US9240077B1 (en) * | 2014-03-19 | 2016-01-19 | A9.Com, Inc. | Real-time visual effects for a live camera view |
GB201404990D0 (en) * | 2014-03-20 | 2014-05-07 | Appeartome Ltd | Augmented reality apparatus and method |
US9836084B2 (en) * | 2014-03-28 | 2017-12-05 | Intel Corporation | Inferred undocking for hybrid tablet computer |
US9977572B2 (en) | 2014-04-01 | 2018-05-22 | Hallmark Cards, Incorporated | Augmented reality appearance enhancement |
WO2015167549A1 (en) * | 2014-04-30 | 2015-11-05 | Longsand Limited | An augmented gaming platform |
US9501871B2 (en) | 2014-04-30 | 2016-11-22 | At&T Mobility Ii Llc | Explorable augmented reality displays |
US9959675B2 (en) | 2014-06-09 | 2018-05-01 | Microsoft Technology Licensing, Llc | Layout design using locally satisfiable proposals |
GB201410285D0 (en) | 2014-06-10 | 2014-07-23 | Appeartome Ltd | Augmented reality apparatus and method |
US9477852B1 (en) | 2014-07-24 | 2016-10-25 | Wells Fargo Bank, N.A. | Augmented reality numberless transaction card |
US9679152B1 (en) | 2014-07-24 | 2017-06-13 | Wells Fargo Bank, N.A. | Augmented reality security access |
US9350924B2 (en) | 2014-08-25 | 2016-05-24 | John G. Posa | Portable electronic devices with integrated image/video compositing |
US10943111B2 (en) | 2014-09-29 | 2021-03-09 | Sony Interactive Entertainment Inc. | Method and apparatus for recognition and matching of objects depicted in images |
US9900541B2 (en) | 2014-12-03 | 2018-02-20 | Vizio Inc | Augmented reality remote control |
US20160171739A1 (en) * | 2014-12-11 | 2016-06-16 | Intel Corporation | Augmentation of stop-motion content |
US20160166921A1 (en) * | 2014-12-11 | 2016-06-16 | Palmwin Information Technology (Shanghai) Co. Ltd. | Integrating interactive games and video calls |
KR102235707B1 (en) * | 2015-01-29 | 2021-04-02 | 한국전자통신연구원 | Method for providing additional information of contents, and mobile terminal and server controlling contents for the same |
US9804667B2 (en) * | 2015-02-10 | 2017-10-31 | Nintendo Co., Ltd. | Electronic apparatus |
US9560100B1 (en) * | 2015-03-19 | 2017-01-31 | Action Streamer, LLC | Method and system for stabilizing and streaming first person perspective video |
US9826013B2 (en) | 2015-03-19 | 2017-11-21 | Action Streamer, LLC | Method and apparatus for an interchangeable wireless media streaming device |
US9355499B1 (en) | 2015-04-20 | 2016-05-31 | Popcards, Llc | Augmented reality content for print media |
US9171404B1 (en) | 2015-04-20 | 2015-10-27 | Popcards, Llc | Augmented reality greeting cards |
ES2891150T3 (en) * | 2015-05-06 | 2022-01-26 | Reactive Reality Ag | Method and system for producing output images |
US9821845B2 (en) | 2015-06-11 | 2017-11-21 | Ford Global Technologies, Llc | Trailer length estimation method using trailer yaw rate signal |
US10668367B2 (en) * | 2015-06-15 | 2020-06-02 | Activision Publishing, Inc. | System and method for uniquely identifying physical trading cards and incorporating trading card game items in a video game |
US20160378296A1 (en) * | 2015-06-25 | 2016-12-29 | Ashok Mishra | Augmented Reality Electronic Book Mechanism |
JP6628516B2 (en) * | 2015-07-30 | 2020-01-08 | 株式会社きもと | Information providing system and computer program |
US9524589B1 (en) * | 2015-08-31 | 2016-12-20 | Welspun India Limited | Interactive textile article and augmented reality system |
US10127725B2 (en) | 2015-09-02 | 2018-11-13 | Microsoft Technology Licensing, Llc | Augmented-reality imaging |
US9934594B2 (en) | 2015-09-09 | 2018-04-03 | Spell Disain Ltd. | Textile-based augmented reality systems and methods |
US20170084082A1 (en) * | 2015-09-17 | 2017-03-23 | HuntAR Corporation | Systems and methods for providing an augmented reality experience |
GB2544827A (en) * | 2015-09-25 | 2017-05-31 | Pixel Matter Ltd | Viewer and viewing method |
US10384607B2 (en) | 2015-10-19 | 2019-08-20 | Ford Global Technologies, Llc | Trailer backup assist system with hitch angle offset estimation |
US10005492B2 (en) | 2016-02-18 | 2018-06-26 | Ford Global Technologies, Llc | Trailer length and hitch angle bias estimation |
US9965841B2 (en) | 2016-02-29 | 2018-05-08 | Schneider Electric USA, Inc. | Monitoring system based on image analysis of photos |
WO2017161192A1 (en) * | 2016-03-16 | 2017-09-21 | Nils Forsblom | Immersive virtual experience using a mobile communication device |
CN105632263A (en) * | 2016-03-29 | 2016-06-01 | 罗昆 | Augmented reality-based music enlightenment learning device and method |
US10373381B2 (en) | 2016-03-30 | 2019-08-06 | Microsoft Technology Licensing, Llc | Virtual object manipulation within physical environment |
CN107273106B (en) * | 2016-04-08 | 2021-07-06 | 北京三星通信技术研究有限公司 | Object information translation and derivative information acquisition method and device |
EP3242228A1 (en) * | 2016-05-02 | 2017-11-08 | Artag SARL | Managing the display of assets in augmented reality mode |
US10057511B2 (en) | 2016-05-11 | 2018-08-21 | International Business Machines Corporation | Framing enhanced reality overlays using invisible light emitters |
US20170365097A1 (en) * | 2016-06-20 | 2017-12-21 | Motorola Solutions, Inc. | System and method for intelligent tagging and interface control |
US10179289B2 (en) | 2016-06-21 | 2019-01-15 | Activision Publishing, Inc. | System and method for reading graphically-encoded identifiers from physical trading cards through image-based template matching |
US10046800B2 (en) | 2016-08-10 | 2018-08-14 | Ford Global Technologies, Llc | Trailer wheel targetless trailer angle detection |
CN106210909A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl数字技术有限公司 | TV the display processing method of content, Apparatus and system |
CN106297479A (en) * | 2016-08-31 | 2017-01-04 | 武汉木子弓数字科技有限公司 | A kind of song teaching method based on AR augmented reality scribble technology and system |
US10222804B2 (en) | 2016-10-21 | 2019-03-05 | Ford Global Technologies, Llc | Inertial reference for TBA speed limiting |
GB2555410B (en) * | 2016-10-25 | 2020-11-04 | Sony Interactive Entertainment Inc | Video content synchronisation method and apparatus |
CN106888203B (en) | 2016-12-13 | 2020-03-24 | 阿里巴巴集团控股有限公司 | Virtual object distribution method and device based on augmented reality |
US20180182169A1 (en) * | 2016-12-22 | 2018-06-28 | Atlatl Software, Inc. | Marker for augmented reality employing a trackable marker template |
JP6832712B2 (en) * | 2017-01-13 | 2021-02-24 | 任天堂株式会社 | Vibration control system, vibration control device, vibration control program and vibration control method |
GB201702350D0 (en) * | 2017-02-13 | 2017-03-29 | Thisway Global Ltd | Method and system for recruiting candidates |
EP3388999A1 (en) * | 2017-04-11 | 2018-10-17 | Pricer AB | Displaying further information about a product |
KR20180131856A (en) * | 2017-06-01 | 2018-12-11 | 에스케이플래닛 주식회사 | Method for providing of information about delivering products and apparatus terefor |
US11127212B1 (en) | 2017-08-24 | 2021-09-21 | Sean Asher Wilens | Method of projecting virtual reality imagery for augmenting real world objects and surfaces |
US10963596B1 (en) | 2017-09-12 | 2021-03-30 | Atlatl Software, Inc. | Systems and methods for CAD automation |
US10650611B1 (en) | 2017-09-12 | 2020-05-12 | Atlatl Software, Inc. | Systems and methods for graphical programming |
TWI635255B (en) * | 2017-10-03 | 2018-09-11 | 宏碁股份有限公司 | Method and system for tracking object |
US11222081B2 (en) | 2017-11-27 | 2022-01-11 | Evoqua Water Technologies Llc | Off-line electronic documentation solutions |
CN108038916B (en) * | 2017-12-27 | 2022-12-02 | 上海徕尼智能科技有限公司 | Augmented reality display method |
US10976982B2 (en) | 2018-02-02 | 2021-04-13 | Samsung Electronics Co., Ltd. | Guided view mode for virtual reality |
US10818093B2 (en) | 2018-05-25 | 2020-10-27 | Tiff's Treats Holdings, Inc. | Apparatus, method, and system for presentation of multimedia content including augmented reality content |
US10984600B2 (en) | 2018-05-25 | 2021-04-20 | Tiff's Treats Holdings, Inc. | Apparatus, method, and system for presentation of multimedia content including augmented reality content |
US20190378334A1 (en) * | 2018-06-08 | 2019-12-12 | Vulcan Inc. | Augmented reality portal-based applications |
US10996831B2 (en) | 2018-06-29 | 2021-05-04 | Vulcan Inc. | Augmented reality cursors |
US20220198795A1 (en) * | 2019-09-09 | 2022-06-23 | Ar, Llc | Augmented, virtual and mixed-reality content selection & display for bank note |
US11771982B2 (en) | 2020-02-14 | 2023-10-03 | Real Tech, Llc. | Systems and methods for augmented reality role playing entertainment |
IT202000003707A1 (en) * | 2020-02-21 | 2021-08-21 | Toma Francesca | Augmented paper photo album |
JP2021189211A (en) * | 2020-05-26 | 2021-12-13 | キヤノン株式会社 | Electronic instrument |
US20220004764A1 (en) * | 2020-07-06 | 2022-01-06 | Wiliot, LTD. | System and method for an augmented reality tag viewer |
WO2022046952A1 (en) * | 2020-08-25 | 2022-03-03 | Focke Scott | Augmented reality app and app development toolkit |
US11175791B1 (en) * | 2020-09-29 | 2021-11-16 | International Business Machines Corporation | Augmented reality system for control boundary modification |
US11734895B2 (en) | 2020-12-14 | 2023-08-22 | Toyota Motor North America, Inc. | Systems and methods for enabling precise object interaction within an augmented reality environment |
US11383156B1 (en) * | 2020-12-29 | 2022-07-12 | Snap Inc. | Multi-user AR experience with offline synchronization |
US11924561B2 (en) * | 2022-07-18 | 2024-03-05 | Nant Holdings, LLC | Determining a camera control point for virtual production |
US20240037863A1 (en) * | 2022-07-29 | 2024-02-01 | Maplebear Inc. (Dba Instacart) | Displaying an augmented reality element that provides a personalized enhanced experience at a warehouse |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5978772A (en) * | 1996-10-11 | 1999-11-02 | Mold; Jeffrey W. | Merchandise checkout system |
US20020023027A1 (en) * | 2000-08-18 | 2002-02-21 | Grant Simonds | Method and system of effecting a financial transaction |
US20020027164A1 (en) * | 2000-09-07 | 2002-03-07 | Mault James R. | Portable computing apparatus particularly useful in a weight management program |
US6512919B2 (en) * | 1998-12-14 | 2003-01-28 | Fujitsu Limited | Electronic shopping system utilizing a program downloadable wireless videophone |
US6587835B1 (en) * | 2000-02-09 | 2003-07-01 | G. Victor Treyz | Shopping assistance with handheld computing device |
US20030163399A1 (en) * | 2001-08-16 | 2003-08-28 | Harper Gregory W | User-personalized media sampling, recommendation and purchasing system using real-time inventory database |
US20040035925A1 (en) * | 2002-08-19 | 2004-02-26 | Quen-Zong Wu | Personal identification system based on the reading of multiple one-dimensional barcodes scanned from PDA/cell phone screen |
US20050011957A1 (en) * | 2003-07-16 | 2005-01-20 | Olivier Attia | System and method for decoding and analyzing barcodes using a mobile device |
US20060038009A1 (en) * | 2002-01-11 | 2006-02-23 | Metrologic Instruments, Inc. | Point of sale (POS) based bar code reading and cash register systems with integrated internet-enabled customer-kiosk terminals |
US7016532B2 (en) * | 2000-11-06 | 2006-03-21 | Evryx Technologies | Image capture and identification system and process |
US20080208613A1 (en) * | 2002-03-04 | 2008-08-28 | Advanced Communication Design, Inc. | Method for digitally marking media content |
Family Cites Families (369)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3943277A (en) | 1969-02-20 | 1976-03-09 | The United States Of America As Represented By The Secretary Of The Navy | Digital memory area correlation tracker |
US4313227A (en) | 1979-01-29 | 1982-01-26 | Texas Instruments Incorporated | Light energy information transmission system |
US4263504A (en) | 1979-08-01 | 1981-04-21 | Ncr Corporation | High density matrix code |
US6772057B2 (en) | 1995-06-07 | 2004-08-03 | Automotive Technologies International, Inc. | Vehicular monitoring systems using image processing |
US4565999A (en) | 1983-04-01 | 1986-01-21 | Prime Computer, Inc. | Light pencil |
US4558864A (en) | 1984-06-13 | 1985-12-17 | Medwedeff Marion C | Handgrip exercising, computer game controller |
US5195179A (en) | 1986-01-29 | 1993-03-16 | Hitachi, Ltd. | Coordinate input apparatus |
US4843568A (en) | 1986-04-11 | 1989-06-27 | Krueger Myron W | Real time perception of and response to the actions of an unencumbered participant/user |
JPS6347616A (en) | 1986-08-15 | 1988-02-29 | Ricoh Co Ltd | Measurement of moving quantity |
EP0348430A4 (en) | 1987-02-04 | 1992-08-19 | Mayo Foundation For Medical Education And Research | Joystick apparatus having six degrees freedom of motion |
US4802227A (en) | 1987-04-03 | 1989-01-31 | American Telephone And Telegraph Company | Noise reduction processing arrangement for microphone arrays |
GB2206716A (en) | 1987-07-06 | 1989-01-11 | Gen Electric Plc | Apparatus for monitoring the presence or movement of an object |
JP2720455B2 (en) | 1988-05-12 | 1998-03-04 | ヤマハ株式会社 | Finger switch |
IT1219405B (en) | 1988-06-27 | 1990-05-11 | Fiat Ricerche | PROCEDURE AND DEVICE FOR INSTRUMENTAL VISION IN POOR CONDITIONS VISIBILITY IN PARTICULAR FOR DRIVING IN THE MIST |
US5260556A (en) | 1988-12-20 | 1993-11-09 | Australian Meat & Live-Stock Research & Development Corp. | Optically readable coded target |
US5034986A (en) | 1989-03-01 | 1991-07-23 | Siemens Aktiengesellschaft | Method for detecting and tracking moving objects in a digital image sequence having a stationary background |
US5055840A (en) | 1990-01-16 | 1991-10-08 | Carroll Touch Incorporated | Infrared touch input device and light emitted activation circuit |
CA2081910C (en) | 1990-05-01 | 2000-04-25 | Donald E. Drumm | Hands-free hardware keyboard |
US5111401A (en) | 1990-05-19 | 1992-05-05 | The United States Of America As Represented By The Secretary Of The Navy | Navigational control system for an autonomous vehicle |
US5662111A (en) | 1991-01-28 | 1997-09-02 | Cosman; Eric R. | Process of stereotactic optical navigation |
US5485273A (en) | 1991-04-22 | 1996-01-16 | Litton Systems, Inc. | Ring laser gyroscope enhanced resolution system |
US5534917A (en) | 1991-05-09 | 1996-07-09 | Very Vivid, Inc. | Video image based control system |
US5144594A (en) | 1991-05-29 | 1992-09-01 | Cyber Scientific | Acoustic mouse system |
US5455685A (en) | 1991-09-04 | 1995-10-03 | Fuji Photo Film Co., Ltd. | Video camera exposure control apparatus for controlling iris diaphragm and automatic gain control operating speed |
US5889670A (en) | 1991-10-24 | 1999-03-30 | Immersion Corporation | Method and apparatus for tactilely responsive user interface |
US5444462A (en) | 1991-12-16 | 1995-08-22 | Wambach; Mark L. | Computer mouse glove with remote communication |
US5365048A (en) * | 1992-02-20 | 1994-11-15 | Olympus Optical Co., Ltd. | Bar code symbol reading apparatus with double-reading preventing function |
US5790834A (en) | 1992-08-31 | 1998-08-04 | Intel Corporation | Apparatus and method using an ID instruction to identify a computer microprocessor |
JP3244798B2 (en) | 1992-09-08 | 2002-01-07 | 株式会社東芝 | Moving image processing device |
US7098891B1 (en) | 1992-09-18 | 2006-08-29 | Pryor Timothy R | Method for providing human input to a computer |
JPH06102980A (en) | 1992-09-24 | 1994-04-15 | Olympus Optical Co Ltd | Tactual sense presentation device |
US5394168A (en) | 1993-01-06 | 1995-02-28 | Smith Engineering | Dual-mode hand-held game controller |
US5335011A (en) | 1993-01-12 | 1994-08-02 | Bell Communications Research, Inc. | Sound localization system for teleconferencing using self-steering microphone arrays |
US5435554A (en) | 1993-03-08 | 1995-07-25 | Atari Games Corporation | Baseball simulation system |
US5815411A (en) * | 1993-09-10 | 1998-09-29 | Criticom Corporation | Electro-optic vision system which exploits position and attitude |
JP3679426B2 (en) | 1993-03-15 | 2005-08-03 | マサチューセッツ・インスティチュート・オブ・テクノロジー | A system that encodes image data into multiple layers, each representing a coherent region of motion, and motion parameters associated with the layers. |
US5677710A (en) | 1993-05-10 | 1997-10-14 | Apple Computer, Inc. | Recognition keypad |
US5297061A (en) | 1993-05-19 | 1994-03-22 | University Of Maryland | Three dimensional pointing device monitored by computer vision |
US5959596A (en) | 1993-06-24 | 1999-09-28 | Nintendo Co., Ltd. | Airline-based video game and communications system |
US5581270A (en) | 1993-06-24 | 1996-12-03 | Nintendo Of America, Inc. | Hotel-based video game and communication system |
US5473701A (en) | 1993-11-05 | 1995-12-05 | At&T Corp. | Adaptive microphone array |
JP2552427B2 (en) | 1993-12-28 | 1996-11-13 | コナミ株式会社 | Tv play system |
FR2714502A1 (en) | 1993-12-29 | 1995-06-30 | Philips Laboratoire Electroniq | An image processing method and apparatus for constructing from a source image a target image with perspective change. |
JPH086708A (en) | 1994-04-22 | 1996-01-12 | Canon Inc | Display device |
US5543818A (en) | 1994-05-13 | 1996-08-06 | Sony Corporation | Method and apparatus for entering text using an input device having a small number of keys |
JPH07311568A (en) | 1994-05-17 | 1995-11-28 | Sega Enterp Ltd | Method and device for outputting image |
US5846086A (en) | 1994-07-01 | 1998-12-08 | Massachusetts Institute Of Technology | System for human trajectory learning in virtual environments |
US5563988A (en) | 1994-08-01 | 1996-10-08 | Massachusetts Institute Of Technology | Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment |
US5641319A (en) | 1994-08-10 | 1997-06-24 | Lodgenet Entertainment Corporation | Entertainment system for providing interactive video game responses to the game interrogations to the video game engines without being processed by the host computer |
GB2301514B (en) | 1994-12-01 | 1999-06-09 | Namco Ltd | Apparatus and method for image synthesization |
JP3270643B2 (en) | 1994-12-22 | 2002-04-02 | キヤノン株式会社 | Pointed position detection method and device |
US5929444A (en) | 1995-01-31 | 1999-07-27 | Hewlett-Packard Company | Aiming device using radiated energy |
US5568928A (en) | 1995-02-01 | 1996-10-29 | Exertron, Inc. | Video game controller for use with an exercise apparatus |
US5638228A (en) | 1995-02-14 | 1997-06-10 | Iomega Corporation | Retroreflective marker for data storage cartridge |
US5930741A (en) | 1995-02-28 | 1999-07-27 | Virtual Technologies, Inc. | Accurate, rapid, reliable position sensing using multiple sensing technologies |
US5583478A (en) | 1995-03-01 | 1996-12-10 | Renzi; Ronald | Virtual environment tactile system |
US5900863A (en) | 1995-03-16 | 1999-05-04 | Kabushiki Kaisha Toshiba | Method and apparatus for controlling computer without touching input device |
US5706364A (en) | 1995-04-28 | 1998-01-06 | Xerox Corporation | Method of producing character templates using unsegmented samples |
JP3777650B2 (en) | 1995-04-28 | 2006-05-24 | 松下電器産業株式会社 | Interface equipment |
WO1996034332A1 (en) | 1995-04-28 | 1996-10-31 | Matsushita Electric Industrial Co., Ltd. | Interface device |
US5913727A (en) | 1995-06-02 | 1999-06-22 | Ahdoot; Ned | Interactive movement and contact simulation game |
US5649021A (en) | 1995-06-07 | 1997-07-15 | David Sarnoff Research Center, Inc. | Method and system for object detection for instrument control |
CN100524015C (en) | 1995-06-22 | 2009-08-05 | 3Dv系统有限公司 | Method and apparatus for generating range subject distance image |
IL114278A (en) | 1995-06-22 | 2010-06-16 | Microsoft Internat Holdings B | Camera and method |
EP0842463B1 (en) | 1995-07-26 | 2000-03-29 | Tegic Communications, Inc. | Reduced keyboard disambiguating system |
US6311214B1 (en) | 1995-07-27 | 2001-10-30 | Digimarc Corporation | Linking of computers based on optical sensing of digital data |
US5768415A (en) | 1995-09-08 | 1998-06-16 | Lucent Technologies Inc. | Apparatus and methods for performing electronic scene analysis and enhancement |
US5611731A (en) | 1995-09-08 | 1997-03-18 | Thrustmaster, Inc. | Video pinball machine controller having an optical accelerometer for detecting slide and tilt |
US5850222A (en) | 1995-09-13 | 1998-12-15 | Pixel Dust, Inc. | Method and system for displaying a graphic image of a person modeling a garment |
US5818424A (en) | 1995-10-19 | 1998-10-06 | International Business Machines Corporation | Rod shaped device and data acquisition apparatus for determining the position and orientation of an object in space |
US6281930B1 (en) | 1995-10-20 | 2001-08-28 | Parkervision, Inc. | System and method for controlling the field of view of a camera |
US5963250A (en) | 1995-10-20 | 1999-10-05 | Parkervision, Inc. | System and method for controlling the field of view of a camera |
US5719561A (en) | 1995-10-25 | 1998-02-17 | Gilbert R. Gonzales | Tactile communication device and method |
US6282362B1 (en) * | 1995-11-07 | 2001-08-28 | Trimble Navigation Limited | Geographical position/image digital recording and display system |
JPH09128141A (en) | 1995-11-07 | 1997-05-16 | Sony Corp | Controller and control method |
US5870100A (en) | 1995-11-22 | 1999-02-09 | Compaq Computer Corporation | Filling of graphical regions |
AU1328597A (en) | 1995-11-30 | 1997-06-19 | Virtual Technologies, Inc. | Tactile feedback man-machine interface device |
US5742263A (en) * | 1995-12-18 | 1998-04-21 | Telxon Corporation | Head tracking system for a head mounted display system |
JP3014313B2 (en) | 1995-12-25 | 2000-02-28 | 富士通テン株式会社 | Airbag collision detection device |
US6049619A (en) | 1996-02-12 | 2000-04-11 | Sarnoff Corporation | Method and apparatus for detecting moving objects in two- and three-dimensional scenes |
RU2069885C1 (en) | 1996-03-01 | 1996-11-27 | Йелстаун Корпорейшн Н.В. | Method and device for observing objects at low illumination intensity |
JPH09244793A (en) | 1996-03-04 | 1997-09-19 | Alps Electric Co Ltd | Input device |
CN1177634C (en) | 1996-03-05 | 2004-12-01 | 世嘉企业股份有限公司 | Controller and extension unit for controller |
DE69631342T2 (en) | 1996-04-02 | 2004-11-11 | Cognex Corp., Natick | PICTURING DEVICE FOR VISUALIZING CHARACTERS ON A SUBSTANTIVE SUBSTRATE |
US5937081A (en) * | 1996-04-10 | 1999-08-10 | O'brill; Michael R. | Image composition system and method of using same |
US5923318A (en) | 1996-04-12 | 1999-07-13 | Zhai; Shumin | Finger manipulatable 6 degree-of-freedom input device |
US5917493A (en) | 1996-04-17 | 1999-06-29 | Hewlett-Packard Company | Method and apparatus for randomly generating information for subsequent correlating |
US5881366A (en) | 1996-05-01 | 1999-03-09 | Logitech, Inc. | Wireless peripheral interface |
US6516466B1 (en) | 1996-05-02 | 2003-02-04 | Vincent C. Jackson | Method and apparatus for portable digital entertainment system |
US6151009A (en) | 1996-08-21 | 2000-11-21 | Carnegie Mellon University | Method and apparatus for merging real and synthetic images |
US6400374B2 (en) | 1996-09-18 | 2002-06-04 | Eyematic Interfaces, Inc. | Video superposition system and method |
US5930383A (en) | 1996-09-24 | 1999-07-27 | Netzer; Yishay | Depth sensing camera systems and methods |
US6055494A (en) * | 1996-10-28 | 2000-04-25 | The Trustees Of Columbia University In The City Of New York | System and method for medical language extraction and encoding |
US5832931A (en) | 1996-10-30 | 1998-11-10 | Photogen, Inc. | Method for improved selectivity in photo-activation and detection of molecular diagnostic agents |
NL1004648C2 (en) | 1996-11-11 | 1998-05-14 | Johan Michiel Schaaij | Computer game system. |
US5914723A (en) | 1996-12-30 | 1999-06-22 | Sun Microsystems, Inc. | Method and system for converting images in computer systems |
US6243491B1 (en) | 1996-12-31 | 2001-06-05 | Lucent Technologies Inc. | Methods and apparatus for controlling a video system with visually recognized props |
US6021219A (en) | 1997-01-07 | 2000-02-01 | Lucent Technologies Inc. | Methods and apparatus for distinguishing among several visual patterns |
US5850473A (en) | 1997-01-07 | 1998-12-15 | Lucent Technologies Inc. | Method and apparatus for compensating for color variation in a video system |
US5796354A (en) | 1997-02-07 | 1998-08-18 | Reality Quest Corp. | Hand-attachable controller with direction sensing |
US5993314A (en) | 1997-02-10 | 1999-11-30 | Stadium Games, Ltd. | Method and apparatus for interactive audience participation by audio command |
US6009210A (en) | 1997-03-05 | 1999-12-28 | Digital Equipment Corporation | Hands-free interface to a virtual reality environment using head tracking |
WO1998039790A1 (en) | 1997-03-07 | 1998-09-11 | 3Dv Systems Ltd. | Optical shutter |
US6061055A (en) | 1997-03-21 | 2000-05-09 | Autodesk, Inc. | Method of tracking objects with an imaging device |
US6144367A (en) | 1997-03-26 | 2000-11-07 | International Business Machines Corporation | Method and system for simultaneous operation of multiple handheld control devices in a data processing system |
US8120652B2 (en) | 1997-04-02 | 2012-02-21 | Gentex Corporation | System for controlling vehicle equipment |
US6587573B1 (en) | 2000-03-20 | 2003-07-01 | Gentex Corporation | System for controlling exterior vehicle lights |
JP3009633B2 (en) | 1997-04-03 | 2000-02-14 | コナミ株式会社 | Image apparatus, image display method, and recording medium |
US6215898B1 (en) | 1997-04-15 | 2001-04-10 | Interval Research Corporation | Data processing system and method |
US6809776B1 (en) | 1997-04-23 | 2004-10-26 | Thomson Licensing S.A. | Control of video level by region and content of information displayed |
WO1998048571A1 (en) | 1997-04-23 | 1998-10-29 | Thomson Consumer Electronics, Inc. | Control of video level by region and content of information displayed |
US6428411B1 (en) | 1997-05-02 | 2002-08-06 | Konami Co., Ltd. | Volleyball video game system |
NO304715B1 (en) | 1997-05-06 | 1999-02-01 | Dimensions As | Imaging Procedure |
TW362207B (en) * | 1997-05-08 | 1999-06-21 | Shimadzu Corp | Display system |
JP3183632B2 (en) | 1997-06-13 | 2001-07-09 | 株式会社ナムコ | Information storage medium and image generation device |
US6075895A (en) | 1997-06-20 | 2000-06-13 | Holoplex | Methods and apparatus for gesture recognition based on templates |
US6094625A (en) * | 1997-07-03 | 2000-07-25 | Trimble Navigation Limited | Augmented vision for survey work and machine control |
JP3997566B2 (en) | 1997-07-15 | 2007-10-24 | ソニー株式会社 | Drawing apparatus and drawing method |
KR20000068660A (en) | 1997-07-29 | 2000-11-25 | 요트.게.아. 롤페즈 | Method of reconstruction of tridimensional scenes and corresponding reconstruction device and decoding system |
US6044181A (en) | 1997-08-01 | 2000-03-28 | Microsoft Corporation | Focal length estimation method and apparatus for construction of panoramic mosaic images |
US6720949B1 (en) | 1997-08-22 | 2004-04-13 | Timothy R. Pryor | Man machine interfaces and applications |
US20020036617A1 (en) | 1998-08-21 | 2002-03-28 | Timothy R. Pryor | Novel man machine interfaces and applications |
US6297838B1 (en) | 1997-08-29 | 2001-10-02 | Xerox Corporation | Spinning as a morpheme for a physical manipulatory grammar |
US8432414B2 (en) | 1997-09-05 | 2013-04-30 | Ecole Polytechnique Federale De Lausanne | Automated annotation of a view |
US6292771B1 (en) * | 1997-09-30 | 2001-09-18 | Ihc Health Services, Inc. | Probabilistic method for natural language processing and for encoding free-text data into a medical database by utilizing a Bayesian network to perform spell checking of words |
AU1099899A (en) | 1997-10-15 | 1999-05-03 | Electric Planet, Inc. | Method and apparatus for performing a clean background subtraction |
US6031934A (en) | 1997-10-15 | 2000-02-29 | Electric Planet, Inc. | Computer vision system for subject characterization |
US6101289A (en) | 1997-10-15 | 2000-08-08 | Electric Planet, Inc. | Method and apparatus for unencumbered capture of an object |
WO1999026198A2 (en) | 1997-11-14 | 1999-05-27 | National University Of Singapore | System and method for merging objects into an image sequence without prior knowledge of the scene in the image sequence |
JPH11154240A (en) | 1997-11-20 | 1999-06-08 | Nintendo Co Ltd | Image producing device to produce image by using fetched image |
US6166744A (en) * | 1997-11-26 | 2000-12-26 | Pathfinder Systems, Inc. | System for combining virtual images with real-world scenes |
US6677987B1 (en) | 1997-12-03 | 2004-01-13 | 8×8, Inc. | Wireless user-interface arrangement and method |
US6762794B1 (en) * | 1997-12-03 | 2004-07-13 | Canon Kabushiki Kaisha | Image pick-up apparatus for stereoscope |
US6195104B1 (en) | 1997-12-23 | 2001-02-27 | Philips Electronics North America Corp. | System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs |
WO1999035633A2 (en) | 1998-01-06 | 1999-07-15 | The Video Mouse Group | Human motion following computer mouse and game controller |
US6160540A (en) | 1998-01-12 | 2000-12-12 | Xerox Company | Zoomorphic computer user interface |
US6134346A (en) | 1998-01-16 | 2000-10-17 | Ultimatte Corp | Method for removing from an image the background surrounding a selected object |
US6331911B1 (en) | 1998-02-08 | 2001-12-18 | 3Dv Systems Ltd. | Large aperture optical image shutter |
US6115052A (en) | 1998-02-12 | 2000-09-05 | Mitsubishi Electric Information Technology Center America, Inc. (Ita) | System for reconstructing the 3-dimensional motions of a human figure from a monocularly-viewed image sequence |
US6175343B1 (en) * | 1998-02-24 | 2001-01-16 | Anivision, Inc. | Method and apparatus for operating the overlay of computer-generated effects onto a live image |
US6037942A (en) | 1998-03-10 | 2000-03-14 | Magellan Dis, Inc. | Navigation system character input device |
JPH11265249A (en) | 1998-03-17 | 1999-09-28 | Toshiba Corp | Information input device, information input method and storage medium |
US6411392B1 (en) | 1998-04-15 | 2002-06-25 | Massachusetts Institute Of Technology | Method and apparatus for data hiding in printed images |
US6173059B1 (en) | 1998-04-24 | 2001-01-09 | Gentner Communications Corporation | Teleconferencing system with visual feedback |
US6593956B1 (en) | 1998-05-15 | 2003-07-15 | Polycom, Inc. | Locating an audio source |
US6473516B1 (en) | 1998-05-22 | 2002-10-29 | Asa Systems, Inc. | Large capacity steganography |
JP3646969B2 (en) | 1998-05-25 | 2005-05-11 | 富士通株式会社 | 3D image display device |
JP3841132B2 (en) | 1998-06-01 | 2006-11-01 | 株式会社ソニー・コンピュータエンタテインメント | Input position detection device and entertainment system |
FR2780176B1 (en) | 1998-06-17 | 2001-01-26 | Gabriel Guary | SHOOTING GUN FOR VIDEO GAME |
JP2000020163A (en) * | 1998-06-30 | 2000-01-21 | Sony Corp | Information processor |
US6504535B1 (en) * | 1998-06-30 | 2003-01-07 | Lucent Technologies Inc. | Display techniques for three-dimensional virtual reality |
IL125221A0 (en) | 1998-07-06 | 1999-03-12 | Toy Control Ltd | Motion activation using passive sound source |
US7121946B2 (en) | 1998-08-10 | 2006-10-17 | Cybernet Systems Corporation | Real-time head tracking system for computer games and other applications |
US6256398B1 (en) | 1998-08-22 | 2001-07-03 | Kenneth H. P. Chang | Encoding and decoding a message within an image |
US6970183B1 (en) | 2000-06-14 | 2005-11-29 | E-Watch, Inc. | Multimedia surveillance and monitoring system including network configuration |
US6621938B1 (en) | 1998-09-18 | 2003-09-16 | Fuji Photo Film Co., Ltd. | Image capture apparatus and method |
US6184863B1 (en) | 1998-10-13 | 2001-02-06 | The George Washington University | Direct pointing apparatus and method therefor |
DE19849515C1 (en) | 1998-10-19 | 2000-12-28 | Gerhard Wergen | Method for transferring characters in particular to a computer and input device using this method |
US6307568B1 (en) | 1998-10-28 | 2001-10-23 | Imaginarix Ltd. | Virtual dressing over the internet |
US6435969B1 (en) * | 1998-11-03 | 2002-08-20 | Nintendo Co., Ltd. | Portable game machine having image capture, manipulation and incorporation |
US6409602B1 (en) | 1998-11-06 | 2002-06-25 | New Millenium Gaming Limited | Slim terminal gaming system |
US6712703B2 (en) | 1998-11-19 | 2004-03-30 | Nintendo Co., Ltd. | Video game apparatus and information storage medium for video game |
JP2000172431A (en) | 1998-12-09 | 2000-06-23 | Sony Corp | Information input device and game device |
US6533420B1 (en) | 1999-01-22 | 2003-03-18 | Dimension Technologies, Inc. | Apparatus and method for generating and projecting autostereoscopic images |
JP2000222116A (en) * | 1999-01-29 | 2000-08-11 | Sony Corp | Position recognition method for display image, position recognition device therefor and virtual image stereoscopic synthesis device |
US7139767B1 (en) | 1999-03-05 | 2006-11-21 | Canon Kabushiki Kaisha | Image processing apparatus and database |
JP2000261752A (en) | 1999-03-05 | 2000-09-22 | Hewlett Packard Co <Hp> | Device for recording and reproducing image having sound |
JP2000259856A (en) | 1999-03-09 | 2000-09-22 | Nippon Telegr & Teleph Corp <Ntt> | Method and device for displaying three-dimensional computer graphics |
US6323942B1 (en) | 1999-04-30 | 2001-11-27 | Canesta, Inc. | CMOS-compatible three-dimensional image sensor IC |
US7164413B2 (en) | 1999-05-19 | 2007-01-16 | Digimarc Corporation | Enhanced input peripheral |
US6791531B1 (en) | 1999-06-07 | 2004-09-14 | Dot On, Inc. | Device and method for cursor motion control calibration and object selection |
JP2000350859A (en) | 1999-06-11 | 2000-12-19 | Mr System Kenkyusho:Kk | Marker arranging method and composite reality really feeling device |
JP2000350865A (en) | 1999-06-11 | 2000-12-19 | Mr System Kenkyusho:Kk | Game device for composite real space, image processing method therefor and program storage medium |
JP3530772B2 (en) * | 1999-06-11 | 2004-05-24 | キヤノン株式会社 | Mixed reality device and mixed reality space image generation method |
US7084887B1 (en) * | 1999-06-11 | 2006-08-01 | Canon Kabushiki Kaisha | Marker layout method, mixed reality apparatus, and mixed reality space image generation method |
JP2000356972A (en) | 1999-06-15 | 2000-12-26 | Pioneer Electronic Corp | Device and method for driving light emitting panel |
US6952198B2 (en) | 1999-07-06 | 2005-10-04 | Hansen Karl C | System and method for communication with enhanced optical pointer |
US6819318B1 (en) | 1999-07-23 | 2004-11-16 | Z. Jason Geng | Method and apparatus for modeling via a three-dimensional image mosaic system |
US6545706B1 (en) | 1999-07-30 | 2003-04-08 | Electric Planet, Inc. | System, method and article of manufacture for tracking a head of a camera-generated image of a person |
US6417836B1 (en) | 1999-08-02 | 2002-07-09 | Lucent Technologies Inc. | Computer input device having six degrees of freedom for controlling movement of a three-dimensional object |
JP2001056742A (en) | 1999-08-19 | 2001-02-27 | Alps Electric Co Ltd | Input device |
US6556704B1 (en) | 1999-08-25 | 2003-04-29 | Eastman Kodak Company | Method for forming a depth image from digital image data |
JP2001070655A (en) * | 1999-08-31 | 2001-03-21 | Konami Co Ltd | Communication method, game system and information transmission method between game machines of different kinds |
WO2001018563A1 (en) | 1999-09-08 | 2001-03-15 | 3Dv Systems, Ltd. | 3d imaging system |
CN1284381C (en) | 1999-09-17 | 2006-11-08 | 自然工艺株式会社 | Image pickup system, image processor, and camera |
JP3847058B2 (en) | 1999-10-04 | 2006-11-15 | 任天堂株式会社 | GAME SYSTEM AND GAME INFORMATION STORAGE MEDIUM USED FOR THE SAME |
US6441825B1 (en) | 1999-10-04 | 2002-08-27 | Intel Corporation | Video token tracking system for animation |
US6753849B1 (en) | 1999-10-27 | 2004-06-22 | Ken Curran & Associates | Universal remote TV mouse |
US6519359B1 (en) | 1999-10-28 | 2003-02-11 | General Electric Company | Range camera controller for acquiring 3D models |
US20050037844A1 (en) | 2002-10-30 | 2005-02-17 | Nike, Inc. | Sigils for use with apparel |
JP4403474B2 (en) | 1999-12-09 | 2010-01-27 | ソニー株式会社 | Tactile sense presentation mechanism and force-tactile sense presentation device using the same |
US20020107947A1 (en) * | 1999-12-09 | 2002-08-08 | Zephyr Media, Inc. | System and method for integration of a universally publicly accessible global network |
US6785329B1 (en) | 1999-12-21 | 2004-08-31 | Microsoft Corporation | Automatic video object extraction |
KR100384406B1 (en) | 2000-01-24 | 2003-05-22 | (주) 베스트소프트 | A program drive divice for computer |
US20020010734A1 (en) * | 2000-02-03 | 2002-01-24 | Ebersole John Franklin | Internetworked augmented reality system and method |
AU2001241500A1 (en) | 2000-02-15 | 2001-08-27 | Sorceron, Inc. | Method and system for distributing captured motion data over a network |
EP1263626A2 (en) | 2000-03-02 | 2002-12-11 | Donnelly Corporation | Video mirror systems incorporating an accessory module |
JP2001265275A (en) | 2000-03-16 | 2001-09-28 | Olympus Optical Co Ltd | Picture display device |
JP3957468B2 (en) * | 2000-03-31 | 2007-08-15 | 日立造船株式会社 | Mixed reality realization system |
US6676522B2 (en) | 2000-04-07 | 2004-01-13 | Igt | Gaming system including portable game devices |
US6924787B2 (en) | 2000-04-17 | 2005-08-02 | Immersion Corporation | Interface for controlling a graphical image |
WO2001091016A1 (en) * | 2000-05-25 | 2001-11-29 | Realitybuy, Inc. | A real time, three-dimensional, configurable, interactive product display system and method |
US6766956B1 (en) * | 2000-06-08 | 2004-07-27 | United Video Properties, Inc. | System and method for using portable device with bar-code scanner |
US20020056114A1 (en) | 2000-06-16 | 2002-05-09 | Fillebrown Lisa A. | Transmitter for a personal wireless network |
TW527518B (en) | 2000-07-14 | 2003-04-11 | Massachusetts Inst Technology | Method and system for high resolution, ultra fast, 3-D imaging |
US6795068B1 (en) | 2000-07-21 | 2004-09-21 | Sony Computer Entertainment Inc. | Prop input device and method for mapping an object from a two-dimensional camera image to a three-dimensional space for controlling action in a game program |
AU2001287948A1 (en) | 2000-07-24 | 2002-02-05 | Herman Ehrenburg | Computer-compatible, color-coded manual input system |
AUPQ896000A0 (en) | 2000-07-24 | 2000-08-17 | Seeing Machines Pty Ltd | Facial image processing system |
US7227526B2 (en) | 2000-07-24 | 2007-06-05 | Gesturetek, Inc. | Video-based image control system |
US6873747B2 (en) | 2000-07-25 | 2005-03-29 | Farid Askary | Method for measurement of pitch in metrology and imaging systems |
US20020094189A1 (en) * | 2000-07-26 | 2002-07-18 | Nassir Navab | Method and system for E-commerce video editing |
JP3561463B2 (en) | 2000-08-11 | 2004-09-02 | コナミ株式会社 | Virtual camera viewpoint movement control method and 3D video game apparatus in 3D video game |
JP4815661B2 (en) | 2000-08-24 | 2011-11-16 | ソニー株式会社 | Signal processing apparatus and signal processing method |
US7071914B1 (en) | 2000-09-01 | 2006-07-04 | Sony Computer Entertainment Inc. | User input device and method for interaction with graphic images |
JP2002084406A (en) | 2000-09-07 | 2002-03-22 | Sony Corp | Image transfer unit and method, file transfer unit and method, and program storage medium |
EP1316192A2 (en) | 2000-09-08 | 2003-06-04 | Honeywell International, Inc. | Pilot internet practice system and methods |
US6884171B2 (en) | 2000-09-18 | 2005-04-26 | Nintendo Co., Ltd. | Video game distribution network |
AU2001294452A1 (en) | 2000-09-29 | 2002-04-08 | Senseboard Technologies Ab | Wearable data input interface |
FR2814965A1 (en) | 2000-10-11 | 2002-04-12 | Janick Simeray | Remote communicating game personal computer having game transducers sound/ultrasonic signals transmitting and computer with microphone processing detections/identifying signals/computer programme interacting. |
US7061507B1 (en) | 2000-11-12 | 2006-06-13 | Bitboys, Inc. | Antialiasing method and apparatus for video applications |
JP2002149854A (en) * | 2000-11-16 | 2002-05-24 | Kubo Hikari | Information collection system |
JP2002157607A (en) * | 2000-11-17 | 2002-05-31 | Canon Inc | System and method for image generation, and storage medium |
US20020083461A1 (en) | 2000-11-22 | 2002-06-27 | Hutcheson Stewart Douglas | Method and system for providing interactive services over a wireless communications network |
KR100385563B1 (en) | 2000-12-01 | 2003-05-27 | 한국과학기술원 | Spectrophotometer With Driving Means And Intensity Of Light Measurement Method |
US6751338B1 (en) | 2000-12-15 | 2004-06-15 | Cognex Corporation | System and method of using range image data with machine vision tools |
US20040054512A1 (en) * | 2000-12-20 | 2004-03-18 | Byung-Su Kim | Method for making simulator program and simulator system using the method |
US20020085097A1 (en) | 2000-12-22 | 2002-07-04 | Colmenarez Antonio J. | Computer vision-based wireless pointing system |
JP2004537082A (en) | 2001-01-26 | 2004-12-09 | ザクセル システムズ インコーポレイテッド | Real-time virtual viewpoint in virtual reality environment |
DE10103922A1 (en) | 2001-01-30 | 2002-08-01 | Physoptics Opto Electronic Gmb | Interactive data viewing and operating system |
US20020126898A1 (en) * | 2001-01-31 | 2002-09-12 | Guo Jinhong K. | Run length based connected components and contour following for enhancing the performance of circled region extraction algorithm |
US6741741B2 (en) | 2001-02-01 | 2004-05-25 | Xerox Corporation | System and method for automatically detecting edges of scanned documents |
US6789967B1 (en) | 2001-02-02 | 2004-09-14 | George Forester | Distal chording keyboard |
US20020134151A1 (en) | 2001-02-05 | 2002-09-26 | Matsushita Electric Industrial Co., Ltd. | Apparatus and method for measuring distances |
US6746124B2 (en) | 2001-02-06 | 2004-06-08 | Robert E. Fischer | Flashlight producing uniform high brightness |
US7116330B2 (en) | 2001-02-28 | 2006-10-03 | Intel Corporation | Approximating motion using a three-dimensional model |
US6931596B2 (en) | 2001-03-05 | 2005-08-16 | Koninklijke Philips Electronics N.V. | Automatic positioning of display depending upon the viewer's location |
GB2376397A (en) | 2001-06-04 | 2002-12-11 | Hewlett Packard Co | Virtual or augmented reality |
JP2002369969A (en) | 2001-06-15 | 2002-12-24 | Sun Corp | Program for communication game, adapter and game terminal |
JP2003018604A (en) | 2001-07-04 | 2003-01-17 | Matsushita Electric Ind Co Ltd | Image signal encoding method, device thereof and recording medium |
US20030014212A1 (en) * | 2001-07-12 | 2003-01-16 | Ralston Stuart E. | Augmented vision system using wireless communications |
JP3611807B2 (en) | 2001-07-19 | 2005-01-19 | コナミ株式会社 | Video game apparatus, pseudo camera viewpoint movement control method and program in video game |
US7039253B2 (en) | 2001-07-24 | 2006-05-02 | Casio Computer Co., Ltd. | Image display device, image display method, program, and projection system |
KR20030009919A (en) | 2001-07-24 | 2003-02-05 | 삼성전자주식회사 | Inputting device for computer game having inertial sense |
US7148922B2 (en) | 2001-08-02 | 2006-12-12 | Olympus Optical Co., Ltd. | Electronic camera which detects flash influence on an image and controls white balance in accordance with the flash influence |
JP3442754B2 (en) | 2001-08-10 | 2003-09-02 | 株式会社コナミコンピュータエンタテインメント東京 | Gun shooting game apparatus, computer control method and program |
US6709108B2 (en) | 2001-08-31 | 2004-03-23 | Adaptive Optics Associates, Inc. | Ophthalmic instrument with adaptive optic subsystem that measures aberrations (including higher order aberrations) of a human eye and that provides a view of compensation of such aberrations to the human eye |
US7555157B2 (en) | 2001-09-07 | 2009-06-30 | Geoff Davidson | System and method for transforming graphical images |
KR100846761B1 (en) | 2001-09-11 | 2008-07-16 | 삼성전자주식회사 | Pointer control method, pointing apparatus and host apparatus therefor |
US20030063575A1 (en) * | 2001-09-28 | 2003-04-03 | Fuji Photo Film Co., Ltd. | Order processing apparatus, order processing system and image photographing device |
JP2003114640A (en) | 2001-10-04 | 2003-04-18 | Nec Corp | Plasma display panel and its driving method |
JP4028708B2 (en) | 2001-10-19 | 2007-12-26 | 株式会社コナミデジタルエンタテインメント | GAME DEVICE AND GAME SYSTEM |
JP3918813B2 (en) * | 2001-10-23 | 2007-05-23 | ソニー株式会社 | Data communication system, data transmission device, and data reception device |
US20030093591A1 (en) | 2001-11-09 | 2003-05-15 | David Hohl | System and method for fast data transfer to display driver |
FR2832892B1 (en) | 2001-11-27 | 2004-04-02 | Thomson Licensing Sa | SPECIAL EFFECTS VIDEO CAMERA |
US20030100363A1 (en) | 2001-11-28 | 2003-05-29 | Ali Guiseppe C. | Method and apparatus for inputting appearance of computer operator into a computer program |
US20040070565A1 (en) | 2001-12-05 | 2004-04-15 | Nayar Shree K | Method and apparatus for displaying images |
KR20030048570A (en) | 2001-12-12 | 2003-06-25 | 한국전자통신연구원 | A keypad assembly with the supplementary buttons and its operating method |
US6641037B2 (en) * | 2001-12-13 | 2003-11-04 | Peter Williams | Method and system for interactively providing product related information on demand and providing personalized transactional benefits at a point of purchase |
US7106366B2 (en) | 2001-12-19 | 2006-09-12 | Eastman Kodak Company | Image capture system incorporating metadata to facilitate transcoding |
US7305114B2 (en) | 2001-12-26 | 2007-12-04 | Cognex Technology And Investment Corporation | Human/machine interface for a machine vision sensor and method for installing and operating the same |
US7436887B2 (en) | 2002-02-06 | 2008-10-14 | Playtex Products, Inc. | Method and apparatus for video frame sequence-based object tracking |
US6990639B2 (en) | 2002-02-07 | 2006-01-24 | Microsoft Corporation | System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration |
JP3798709B2 (en) * | 2002-02-22 | 2006-07-19 | トヨタ自動車株式会社 | Server, information providing method, and program |
US20030160862A1 (en) | 2002-02-27 | 2003-08-28 | Charlier Michael L. | Apparatus having cooperating wide-angle digital camera system and microphone array |
KR20030075399A (en) | 2002-03-18 | 2003-09-26 | 주식회사 소프트로닉스 | Motion Mouse System |
US7301547B2 (en) | 2002-03-22 | 2007-11-27 | Intel Corporation | Augmented reality system |
FR2837597A1 (en) | 2002-03-25 | 2003-09-26 | Thomson Licensing Sa | Three-dimensional scene modeling process, involves calculating point of reference image on basis of set of images, of defined minimum and maximum depth values of point depth corresponding to maximum distortion |
US6847311B2 (en) | 2002-03-28 | 2005-01-25 | Motorola Inc. | Method and apparatus for character entry in a wireless communication device |
GB2388418A (en) | 2002-03-28 | 2003-11-12 | Marcus James Eales | Input or pointing device with a camera |
US7006009B2 (en) * | 2002-04-01 | 2006-02-28 | Key Energy Services, Inc. | Servicing system for wells |
US7023475B2 (en) * | 2002-04-08 | 2006-04-04 | Hewlett-Packard Development Company, L.P. | System and method for identifying an object with captured images |
US20030199324A1 (en) | 2002-04-23 | 2003-10-23 | Xiaoling Wang | Apparatus and a method for more realistic shooting video games on computers or similar devices using visible or invisible light |
US20030220145A1 (en) * | 2002-05-22 | 2003-11-27 | Erickson Craig S. | Digital camera and networking accessories for a portable video game device |
JP2004048674A (en) * | 2002-05-24 | 2004-02-12 | Olympus Corp | Information presentation system of visual field agreement type, portable information terminal, and server |
JP2004021345A (en) | 2002-06-12 | 2004-01-22 | Toshiba Corp | Image processing device and its method |
US20030232649A1 (en) * | 2002-06-18 | 2003-12-18 | Gizis Alexander C.M. | Gaming system and method |
US20040001082A1 (en) | 2002-06-26 | 2004-01-01 | Amir Said | System and method of interaction with a computer controlled image display system using a projected light source |
JP5109221B2 (en) | 2002-06-27 | 2012-12-26 | 新世代株式会社 | Information processing device equipped with an input system using a stroboscope |
CA2390072C (en) | 2002-06-28 | 2018-02-27 | Adrian Gh Podoleanu | Optical mapping apparatus with adjustable depth resolution and multiple functionality |
US7227976B1 (en) | 2002-07-08 | 2007-06-05 | Videomining Corporation | Method and system for real-time facial image enhancement |
CN1167996C (en) | 2002-07-11 | 2004-09-22 | 庄胜雄 | Glove mouse capable of forming virtual tracing ball |
US8797260B2 (en) | 2002-07-27 | 2014-08-05 | Sony Computer Entertainment Inc. | Inertially trackable hand-held controller |
US7970147B2 (en) | 2004-04-07 | 2011-06-28 | Sony Computer Entertainment Inc. | Video game controller with noise canceling logic |
US7102615B2 (en) | 2002-07-27 | 2006-09-05 | Sony Computer Entertainment Inc. | Man-machine interface using a deformable device |
US7613310B2 (en) | 2003-08-27 | 2009-11-03 | Sony Computer Entertainment Inc. | Audio input system |
US7783061B2 (en) | 2003-08-27 | 2010-08-24 | Sony Computer Entertainment Inc. | Methods and apparatus for the targeted sound detection |
US7697700B2 (en) | 2006-05-04 | 2010-04-13 | Sony Computer Entertainment Inc. | Noise removal for electronic device with far field microphone on console |
US7623115B2 (en) | 2002-07-27 | 2009-11-24 | Sony Computer Entertainment Inc. | Method and apparatus for light input device |
US7646372B2 (en) | 2003-09-15 | 2010-01-12 | Sony Computer Entertainment Inc. | Methods and systems for enabling direction detection when interfacing with a computer program |
US8073157B2 (en) | 2003-08-27 | 2011-12-06 | Sony Computer Entertainment Inc. | Methods and apparatus for targeted sound detection and characterization |
US7809145B2 (en) | 2006-05-04 | 2010-10-05 | Sony Computer Entertainment Inc. | Ultra small microphone array |
US7545926B2 (en) | 2006-05-04 | 2009-06-09 | Sony Computer Entertainment Inc. | Echo and noise cancellation |
US20040017355A1 (en) | 2002-07-24 | 2004-01-29 | Youngtack Shim | Cursor control systems and methods |
US7803050B2 (en) | 2002-07-27 | 2010-09-28 | Sony Computer Entertainment Inc. | Tracking device with sound emitter for use in obtaining information for controlling game program execution |
US9474968B2 (en) | 2002-07-27 | 2016-10-25 | Sony Interactive Entertainment America Llc | Method and system for applying gearing effects to visual tracking |
US8139793B2 (en) | 2003-08-27 | 2012-03-20 | Sony Computer Entertainment Inc. | Methods and apparatus for capturing audio signals based on a visual image |
US7760248B2 (en) | 2002-07-27 | 2010-07-20 | Sony Computer Entertainment Inc. | Selective sound source listening in conjunction with computer interactive processing |
US20070061413A1 (en) | 2005-09-15 | 2007-03-15 | Larsen Eric J | System and method for obtaining user information from voices |
US20070260517A1 (en) | 2006-05-08 | 2007-11-08 | Gary Zalewski | Profile detection |
US20070015559A1 (en) | 2002-07-27 | 2007-01-18 | Sony Computer Entertainment America Inc. | Method and apparatus for use in determining lack of user activity in relation to a system |
US8233642B2 (en) | 2003-08-27 | 2012-07-31 | Sony Computer Entertainment Inc. | Methods and apparatuses for capturing an audio signal based on a location of the signal |
US8686939B2 (en) | 2002-07-27 | 2014-04-01 | Sony Computer Entertainment Inc. | System, method, and apparatus for three-dimensional input control |
US7918733B2 (en) | 2002-07-27 | 2011-04-05 | Sony Computer Entertainment America Inc. | Multi-input game control mixer |
US7391409B2 (en) | 2002-07-27 | 2008-06-24 | Sony Computer Entertainment America Inc. | Method and system for applying gearing effects to multi-channel mixed input |
US10086282B2 (en) | 2002-07-27 | 2018-10-02 | Sony Interactive Entertainment Inc. | Tracking device for use in obtaining information for controlling game program execution |
US7627139B2 (en) | 2002-07-27 | 2009-12-01 | Sony Computer Entertainment Inc. | Computer image and audio processing of intensity and input devices for interfacing with a computer program |
US8313380B2 (en) | 2002-07-27 | 2012-11-20 | Sony Computer Entertainment America Llc | Scheme for translating movements of a hand-held controller into inputs for a system |
US7850526B2 (en) | 2002-07-27 | 2010-12-14 | Sony Computer Entertainment America Inc. | System for tracking user manipulations within an environment |
US7854655B2 (en) | 2002-07-27 | 2010-12-21 | Sony Computer Entertainment America Inc. | Obtaining input for controlling execution of a game program |
US7352359B2 (en) | 2002-07-27 | 2008-04-01 | Sony Computer Entertainment America Inc. | Method and system for applying gearing effects to inertial tracking |
US20060264260A1 (en) | 2002-07-27 | 2006-11-23 | Sony Computer Entertainment Inc. | Detectable and trackable hand-held controller |
US8160269B2 (en) | 2003-08-27 | 2012-04-17 | Sony Computer Entertainment Inc. | Methods and apparatuses for adjusting a listening area for capturing sounds |
US9393487B2 (en) | 2002-07-27 | 2016-07-19 | Sony Interactive Entertainment Inc. | Method for mapping movements of a hand-held controller to game commands |
US20060256081A1 (en) | 2002-07-27 | 2006-11-16 | Sony Computer Entertainment America Inc. | Scheme for detecting and tracking user manipulation of a game controller body |
US20070261077A1 (en) | 2006-05-08 | 2007-11-08 | Gary Zalewski | Using audio/visual environment to select ads on game platform |
US20060282873A1 (en) | 2002-07-27 | 2006-12-14 | Sony Computer Entertainment Inc. | Hand-held controller having detectable elements for tracking purposes |
US7039199B2 (en) | 2002-08-26 | 2006-05-02 | Microsoft Corporation | System and process for locating a speaker using 360 degree sound source localization |
JP2004102835A (en) * | 2002-09-11 | 2004-04-02 | Univ Waseda | Information providing method and system therefor, mobile terminal device, head-wearable device, and program |
US6917688B2 (en) | 2002-09-11 | 2005-07-12 | Nanyang Technological University | Adaptive noise cancelling microphone system |
US20040063480A1 (en) | 2002-09-30 | 2004-04-01 | Xiaoling Wang | Apparatus and a method for more realistic interactive video games on computers or similar devices |
EP1411461A1 (en) | 2002-10-14 | 2004-04-21 | STMicroelectronics S.r.l. | User controlled device for sending control signals to an electric appliance, in particular user controlled pointing device such as mouse or joystick, with 3D-motion detection |
US6995666B1 (en) | 2002-10-16 | 2006-02-07 | Luttrell Clyde K | Cellemetry-operated railroad switch heater |
JP2004145448A (en) | 2002-10-22 | 2004-05-20 | Toshiba Corp | Terminal device, server device, and image processing method |
US8206219B2 (en) | 2002-10-30 | 2012-06-26 | Nike, Inc. | Interactive gaming apparel for interactive gaming |
AU2003288938A1 (en) | 2002-10-30 | 2004-06-07 | Nike International Ltd. | Clothes with tracking marks for computer games |
US20040095327A1 (en) | 2002-11-14 | 2004-05-20 | Lo Fook Loong | Alphanumeric data input system and method |
US8012025B2 (en) | 2002-12-13 | 2011-09-06 | Applied Minds, Llc | Video game controller hub with control input reduction and combination schemes |
US7212308B2 (en) | 2002-12-18 | 2007-05-01 | Morgan Carol L | Interactive photo kiosk |
JP2004206357A (en) * | 2002-12-25 | 2004-07-22 | Nec Infrontia Corp | Output device of sale commodity data and output method of sale commodity data |
US20040140955A1 (en) | 2003-01-21 | 2004-07-22 | Metz Kristofer Erik | Input device for a computer and method of operation |
JP2004261236A (en) | 2003-02-20 | 2004-09-24 | Konami Co Ltd | Game system |
JP3849654B2 (en) | 2003-02-21 | 2006-11-22 | 株式会社日立製作所 | Projection display |
GB2398690B (en) | 2003-02-21 | 2006-05-10 | Sony Comp Entertainment Europe | Control of data processing |
GB2398691B (en) | 2003-02-21 | 2006-05-31 | Sony Comp Entertainment Europe | Control of data processing |
US7665041B2 (en) | 2003-03-25 | 2010-02-16 | Microsoft Corporation | Architecture for controlling a computer using hand gestures |
US7519186B2 (en) | 2003-04-25 | 2009-04-14 | Microsoft Corporation | Noise reduction systems and methods for voice applications |
US7379559B2 (en) | 2003-05-28 | 2008-05-27 | Trw Automotive U.S. Llc | Method and apparatus for determining an occupant's head location in an actuatable occupant restraining system |
US6881147B2 (en) | 2003-06-06 | 2005-04-19 | Nyko Technologies, Inc. | Video game controller with integrated microphone and speaker |
TW571812U (en) | 2003-06-11 | 2004-01-11 | Vision Electronics Co Ltd | Audio device for TV game machine |
ATE339757T1 (en) | 2003-06-17 | 2006-10-15 | Sony Ericsson Mobile Comm Ab | METHOD AND DEVICE FOR VOICE ACTIVITY DETECTION |
US7116342B2 (en) * | 2003-07-03 | 2006-10-03 | Sportsmedia Technology Corporation | System and method for inserting content into an image sequence |
JP2005046422A (en) | 2003-07-30 | 2005-02-24 | Samii Kk | Game machine controller |
US7874917B2 (en) | 2003-09-15 | 2011-01-25 | Sony Computer Entertainment Inc. | Methods and systems for enabling depth and direction detection when interfacing with a computer program |
AU2004287478A1 (en) | 2003-10-28 | 2005-05-19 | Welch Allyn, Inc. | Digital documenting ophthalmoscope |
US20050105777A1 (en) | 2003-11-18 | 2005-05-19 | Kozlowski William J.Jr. | Personalized multimedia summary |
US20050131776A1 (en) * | 2003-12-15 | 2005-06-16 | Eastman Kodak Company | Virtual shopper device |
US7734729B2 (en) * | 2003-12-31 | 2010-06-08 | Amazon Technologies, Inc. | System and method for obtaining information relating to an item of commerce using a portable imaging device |
WO2005107911A1 (en) | 2004-05-11 | 2005-11-17 | Ssd Company Limited | Entertainment apparatus and operating method thereof |
US7671916B2 (en) * | 2004-06-04 | 2010-03-02 | Electronic Arts Inc. | Motion sensor using dual camera inputs |
US7296007B1 (en) | 2004-07-06 | 2007-11-13 | Ailive, Inc. | Real time context learning by software agents |
US20060025222A1 (en) * | 2004-07-27 | 2006-02-02 | Aruze Corp. | Gaming machine, service providing system, server and mobile device |
US7263462B2 (en) | 2004-07-30 | 2007-08-28 | Ailive, Inc. | Non-disruptive embedding of specialized elements |
US8547401B2 (en) * | 2004-08-19 | 2013-10-01 | Sony Computer Entertainment Inc. | Portable augmented reality device and method |
US7613610B1 (en) | 2005-03-14 | 2009-11-03 | Escription, Inc. | Transcription data extraction |
KR100630118B1 (en) | 2005-04-21 | 2006-09-27 | 삼성전자주식회사 | Internetwork optical fiber sharing system |
US7918732B2 (en) | 2005-05-06 | 2011-04-05 | Milton Charles Van Noland | Manifold compatibility electronic omni axis human interface |
US7927216B2 (en) | 2005-09-15 | 2011-04-19 | Nintendo Co., Ltd. | Video game system with wireless modular handheld controller |
US7620316B2 (en) | 2005-11-28 | 2009-11-17 | Navisense | Method and device for touchless control of a camera |
US7834850B2 (en) | 2005-11-29 | 2010-11-16 | Navisense | Method and system for object control |
AU2007215294B2 (en) | 2006-02-10 | 2012-03-15 | Lego A/S | Configurable manual controller |
US7636645B1 (en) | 2007-06-18 | 2009-12-22 | Ailive Inc. | Self-contained inertial navigation system for interactive control using movable controllers |
JP4481280B2 (en) | 2006-08-30 | 2010-06-16 | 富士フイルム株式会社 | Image processing apparatus and image processing method |
US8277316B2 (en) | 2006-09-14 | 2012-10-02 | Nintendo Co., Ltd. | Method and apparatus for using a common pointing input to control 3D viewpoint and object targeting |
GB0622451D0 (en) | 2006-11-10 | 2006-12-20 | Intelligent Earth Ltd | Object position and orientation detection device |
US7636697B1 (en) | 2007-01-29 | 2009-12-22 | Ailive Inc. | Method and system for rapid evaluation of logical expressions |
US7937243B2 (en) | 2007-08-03 | 2011-05-03 | Ailive, Inc. | Method and apparatus for non-disruptive embedding of specialized elements |
US8419545B2 (en) | 2007-11-28 | 2013-04-16 | Ailive, Inc. | Method and system for controlling movements of objects in a videogame |
US20090221368A1 (en) | 2007-11-28 | 2009-09-03 | Ailive Inc., | Method and system for creating a shared game space for a networked game |
US8655622B2 (en) | 2008-07-05 | 2014-02-18 | Ailive, Inc. | Method and apparatus for interpreting orientation invariant motion |
-
2004
- 2004-08-19 US US10/922,514 patent/US8547401B2/en active Active
-
2005
- 2005-08-02 ES ES13187446.3T patent/ES2611336T3/en active Active
- 2005-08-02 JP JP2007527848A patent/JP2008510254A/en active Pending
- 2005-08-02 EP EP13187446.3A patent/EP2704102B1/en active Active
- 2005-08-02 WO PCT/US2005/027456 patent/WO2006023268A2/en active Application Filing
- 2005-08-02 EP EP05778979.4A patent/EP1779372A4/en not_active Ceased
-
2009
- 2009-07-27 US US12/510,213 patent/US20090285484A1/en not_active Abandoned
-
2010
- 2010-07-12 JP JP2010158235A patent/JP2010244575A/en active Pending
-
2013
- 2013-09-30 US US14/042,631 patent/US10099147B2/en active Active
-
2018
- 2018-09-27 US US16/144,928 patent/US20190030441A1/en not_active Abandoned
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5978772A (en) * | 1996-10-11 | 1999-11-02 | Mold; Jeffrey W. | Merchandise checkout system |
US6512919B2 (en) * | 1998-12-14 | 2003-01-28 | Fujitsu Limited | Electronic shopping system utilizing a program downloadable wireless videophone |
US6587835B1 (en) * | 2000-02-09 | 2003-07-01 | G. Victor Treyz | Shopping assistance with handheld computing device |
US20020023027A1 (en) * | 2000-08-18 | 2002-02-21 | Grant Simonds | Method and system of effecting a financial transaction |
US20020027164A1 (en) * | 2000-09-07 | 2002-03-07 | Mault James R. | Portable computing apparatus particularly useful in a weight management program |
US7016532B2 (en) * | 2000-11-06 | 2006-03-21 | Evryx Technologies | Image capture and identification system and process |
US20030163399A1 (en) * | 2001-08-16 | 2003-08-28 | Harper Gregory W | User-personalized media sampling, recommendation and purchasing system using real-time inventory database |
US20060038009A1 (en) * | 2002-01-11 | 2006-02-23 | Metrologic Instruments, Inc. | Point of sale (POS) based bar code reading and cash register systems with integrated internet-enabled customer-kiosk terminals |
US20080208613A1 (en) * | 2002-03-04 | 2008-08-28 | Advanced Communication Design, Inc. | Method for digitally marking media content |
US20040035925A1 (en) * | 2002-08-19 | 2004-02-26 | Quen-Zong Wu | Personal identification system based on the reading of multiple one-dimensional barcodes scanned from PDA/cell phone screen |
US20050011957A1 (en) * | 2003-07-16 | 2005-01-20 | Olivier Attia | System and method for decoding and analyzing barcodes using a mobile device |
Cited By (89)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8762888B2 (en) | 2008-06-17 | 2014-06-24 | Nintendo Co., Ltd. | Information processing apparatus, information processing system, and storage medium having stored thereon information processing program |
US20090313580A1 (en) * | 2008-06-17 | 2009-12-17 | Nintendo Co., Ltd. | Information processing apparatus, information processing system, and storage medium having stored thereon information processing program |
US8520570B2 (en) * | 2008-06-17 | 2013-08-27 | Nintendo Co., Ltd. | Data communication system, information processing apparatus and storage medium having stored thereon information processing program |
US20090310594A1 (en) * | 2008-06-17 | 2009-12-17 | Nintendo Co., Ltd. | Data communication system, information processing apparatus and storage medium having stored thereon information processing program |
US20100261450A1 (en) * | 2009-04-14 | 2010-10-14 | Research In Motion Limited | Resolved mobile code content tracking |
US20100261454A1 (en) * | 2009-04-14 | 2010-10-14 | Research In Motion Limited | Retrieving additional content based on data within a mobile code |
US20100258630A1 (en) * | 2009-04-14 | 2010-10-14 | Research In Motion Limited | Systems and methods for updating resolved content of a mobile code |
WO2010118507A1 (en) * | 2009-04-14 | 2010-10-21 | Research In Motion Limited | Retrieving additional content based on data within a mobile code |
US8559929B2 (en) | 2009-04-14 | 2013-10-15 | Blackberry Limited | Resolved mobile code content tracking |
US8894486B2 (en) | 2010-01-14 | 2014-11-25 | Nintendo Co., Ltd. | Handheld information processing apparatus and handheld game apparatus |
US9128293B2 (en) | 2010-01-14 | 2015-09-08 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US10506218B2 (en) | 2010-03-12 | 2019-12-10 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US10764565B2 (en) | 2010-03-12 | 2020-09-01 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method |
US8896685B2 (en) | 2010-03-14 | 2014-11-25 | Ns Solutions Corporation | Method and system for determining information relating to vacant spaces of a parking lot |
US20110234879A1 (en) * | 2010-03-24 | 2011-09-29 | Sony Corporation | Image processing apparatus, image processing method and program |
US8502903B2 (en) * | 2010-03-24 | 2013-08-06 | Sony Corporation | Image processing apparatus, image processing method and program for superimposition display |
US20130293583A1 (en) * | 2010-03-24 | 2013-11-07 | Sony Corporation | Image processing device, image processing method, and program |
US9367964B2 (en) | 2010-03-24 | 2016-06-14 | Sony Corporation | Image processing device, image processing method, and program for display of a menu on a ground surface for selection with a user's foot |
US10175857B2 (en) * | 2010-03-24 | 2019-01-08 | Sony Corporation | Image processing device, image processing method, and program for displaying an image in accordance with a selection from a displayed menu and based on a detection by a sensor |
US9208615B2 (en) * | 2010-03-24 | 2015-12-08 | Sony Corporation | Image processing apparatus, image processing method, and program for facilitating an input operation by a user in response to information displayed in a superimposed manner on a visual field of the user |
US10521085B2 (en) | 2010-03-24 | 2019-12-31 | Sony Corporation | Image processing device, image processing method, and program for displaying an image in accordance with a selection from a displayed menu and based on a detection by a sensor |
US9689688B2 (en) | 2010-03-30 | 2017-06-27 | Ns Solutions Corporation | Image display system, image display method and program |
US9395195B2 (en) | 2010-03-30 | 2016-07-19 | Ns Solutions Corporation | System, method and program for managing and displaying product information |
US9686673B2 (en) * | 2010-05-18 | 2017-06-20 | Electric Mirror, Llc | Apparatuses and methods for streaming audio and video |
US20140066048A1 (en) * | 2010-05-18 | 2014-03-06 | Electric Mirror, Llc | Apparatuses and methods for streaming audio and video |
US10462651B1 (en) * | 2010-05-18 | 2019-10-29 | Electric Mirror, Llc | Apparatuses and methods for streaming audio and video |
US10972905B1 (en) * | 2010-05-18 | 2021-04-06 | Electric Mirror, Llc | Apparatuses and methods for streaming audio and video |
US9282319B2 (en) | 2010-06-02 | 2016-03-08 | Nintendo Co., Ltd. | Image display system, image display apparatus, and image display method |
US8384770B2 (en) | 2010-06-02 | 2013-02-26 | Nintendo Co., Ltd. | Image display system, image display apparatus, and image display method |
US8633947B2 (en) | 2010-06-02 | 2014-01-21 | Nintendo Co., Ltd. | Computer-readable storage medium having stored therein information processing program, information processing apparatus, information processing system, and information processing method |
US8780183B2 (en) | 2010-06-11 | 2014-07-15 | Nintendo Co., Ltd. | Computer-readable storage medium, image display apparatus, image display system, and image display method |
US10015473B2 (en) | 2010-06-11 | 2018-07-03 | Nintendo Co., Ltd. | Computer-readable storage medium, image display apparatus, image display system, and image display method |
US8512152B2 (en) | 2010-06-11 | 2013-08-20 | Nintendo Co., Ltd. | Hand-held game apparatus and housing part of the same |
US9278281B2 (en) | 2010-09-27 | 2016-03-08 | Nintendo Co., Ltd. | Computer-readable storage medium, information processing apparatus, information processing system, and information processing method |
US8854356B2 (en) | 2010-09-28 | 2014-10-07 | Nintendo Co., Ltd. | Storage medium having stored therein image processing program, image processing apparatus, image processing system, and image processing method |
US20120120296A1 (en) * | 2010-11-17 | 2012-05-17 | Verizon Patent And Licensing, Inc. | Methods and Systems for Dynamically Presenting Enhanced Content During a Presentation of a Media Content Instance |
US8913171B2 (en) * | 2010-11-17 | 2014-12-16 | Verizon Patent And Licensing Inc. | Methods and systems for dynamically presenting enhanced content during a presentation of a media content instance |
US9864425B2 (en) | 2011-05-03 | 2018-01-09 | Facebook, Inc. | Adjusting mobile device state based on user intentions and/or identity |
US9229489B2 (en) * | 2011-05-03 | 2016-01-05 | Facebook, Inc. | Adjusting mobile device state based on user intentions and/or identity |
US20120280917A1 (en) * | 2011-05-03 | 2012-11-08 | Toksvig Michael John Mckenzie | Adjusting Mobile Device State Based on User Intentions and/or Identity |
US20120309537A1 (en) * | 2011-06-03 | 2012-12-06 | Nintendo Co., Ltd. | Computer-readable storage medium, information processing apparatus, information processing system and information processing method |
US8845425B2 (en) * | 2011-06-03 | 2014-09-30 | Nintendo Co., Ltd. | Computer-readable storage medium, information processing apparatus, information processing system and information processing method |
US9436426B2 (en) | 2011-06-03 | 2016-09-06 | Nintendo Co., Ltd. | Computer-readable storage medium, information processing apparatus, information processing system and information processing method |
US8920235B2 (en) | 2011-06-03 | 2014-12-30 | Nintendo Co., Ltd. | Computer-readable storage medium, information processing apparatus, information processing system and information processing method |
US20130088629A1 (en) * | 2011-10-06 | 2013-04-11 | Samsung Electronics Co., Ltd. | Mobile device and method of remotely controlling a controlled device |
US20130196772A1 (en) * | 2012-01-31 | 2013-08-01 | Stephen Latta | Matching physical locations for shared virtual experience |
US9041739B2 (en) * | 2012-01-31 | 2015-05-26 | Microsoft Technology Licensing, Llc | Matching physical locations for shared virtual experience |
US9277367B2 (en) | 2012-02-28 | 2016-03-01 | Blackberry Limited | Method and device for providing augmented reality output |
US10062212B2 (en) | 2012-02-28 | 2018-08-28 | Blackberry Limited | Method and device for providing augmented reality output |
US20150170260A1 (en) * | 2012-02-29 | 2015-06-18 | Google Inc. | Methods and Systems for Using a Mobile Device to Visualize a Three-Dimensional Physical Object Placed Within a Three-Dimensional Environment |
EP2824591A4 (en) * | 2012-03-08 | 2015-11-25 | Omron Tateisi Electronics Co | Output device, output system, and program |
US20130250142A1 (en) * | 2012-03-20 | 2013-09-26 | Sean Elwell | Device and method for flexibly associating existing readable surfaces with computer and web-based supplemental content |
US8831274B2 (en) * | 2012-03-28 | 2014-09-09 | Walton Advanced Engineering Inc. | Application program execution method |
TWI459300B (en) * | 2012-03-28 | 2014-11-01 | Walton Advanced Eng Inc | An application execution method |
US20130259293A1 (en) * | 2012-03-28 | 2013-10-03 | Walton Advanced Engineering Inc. | Application program execution method |
US20130328760A1 (en) * | 2012-06-08 | 2013-12-12 | Qualcomm Incorporated | Fast feature detection by reducing an area of a camera image |
US9418293B2 (en) * | 2012-12-27 | 2016-08-16 | Sony Corporation | Information processing apparatus, content providing method, and computer program |
US20140185871A1 (en) * | 2012-12-27 | 2014-07-03 | Sony Corporation | Information processing apparatus, content providing method, and computer program |
US10629003B2 (en) | 2013-03-11 | 2020-04-21 | Magic Leap, Inc. | System and method for augmented and virtual reality |
US11087555B2 (en) | 2013-03-11 | 2021-08-10 | Magic Leap, Inc. | Recognizing objects in a passable world model in augmented or virtual reality systems |
US10068374B2 (en) | 2013-03-11 | 2018-09-04 | Magic Leap, Inc. | Systems and methods for a plurality of users to interact with an augmented or virtual reality systems |
US20150235435A1 (en) * | 2013-03-11 | 2015-08-20 | Magic Leap, Inc. | Recognizing objects in a passable world model in augmented or virtual reality systems |
US10126812B2 (en) | 2013-03-11 | 2018-11-13 | Magic Leap, Inc. | Interacting with a network to transmit virtual image data in augmented or virtual reality systems |
US11663789B2 (en) | 2013-03-11 | 2023-05-30 | Magic Leap, Inc. | Recognizing objects in a passable world model in augmented or virtual reality systems |
US10163265B2 (en) | 2013-03-11 | 2018-12-25 | Magic Leap, Inc. | Selective light transmission for augmented or virtual reality |
US10282907B2 (en) | 2013-03-11 | 2019-05-07 | Magic Leap, Inc | Interacting with a network to transmit virtual image data in augmented or virtual reality systems |
US10234939B2 (en) | 2013-03-11 | 2019-03-19 | Magic Leap, Inc. | Systems and methods for a plurality of users to interact with each other in augmented or virtual reality systems |
US9429752B2 (en) | 2013-03-15 | 2016-08-30 | Magic Leap, Inc. | Using historical attributes of a user for virtual or augmented reality rendering |
US10510188B2 (en) | 2013-03-15 | 2019-12-17 | Magic Leap, Inc. | Over-rendering techniques in augmented or virtual reality systems |
US10304246B2 (en) | 2013-03-15 | 2019-05-28 | Magic Leap, Inc. | Blanking techniques in augmented or virtual reality systems |
US11854150B2 (en) | 2013-03-15 | 2023-12-26 | Magic Leap, Inc. | Frame-by-frame rendering for augmented or virtual reality systems |
US10453258B2 (en) | 2013-03-15 | 2019-10-22 | Magic Leap, Inc. | Adjusting pixels to compensate for spacing in augmented or virtual reality systems |
US10134186B2 (en) | 2013-03-15 | 2018-11-20 | Magic Leap, Inc. | Predicting head movement for rendering virtual objects in augmented or virtual reality systems |
US11205303B2 (en) | 2013-03-15 | 2021-12-21 | Magic Leap, Inc. | Frame-by-frame rendering for augmented or virtual reality systems |
US9417452B2 (en) | 2013-03-15 | 2016-08-16 | Magic Leap, Inc. | Display system and method |
US10553028B2 (en) | 2013-03-15 | 2020-02-04 | Magic Leap, Inc. | Presenting virtual objects based on head movements in augmented or virtual reality systems |
US20160062481A1 (en) * | 2014-08-29 | 2016-03-03 | Kyocera Document Solutions Inc. | Electronic equipment displaying various kinds of information available by wearing on body |
US20170330036A1 (en) * | 2015-01-29 | 2017-11-16 | Aurasma Limited | Provide augmented reality content |
WO2017155236A1 (en) * | 2016-03-09 | 2017-09-14 | Samsung Electronics Co., Ltd. | Configuration and operation of display devices including content curation |
US11853635B2 (en) | 2016-03-09 | 2023-12-26 | Samsung Electronics Co., Ltd. | Configuration and operation of display devices including content curation |
US10120635B2 (en) | 2016-03-09 | 2018-11-06 | Samsung Electronics Co., Ltd. | Configuration and operation of display devices including device management |
US10262642B2 (en) | 2016-04-04 | 2019-04-16 | Disney Enterprises, Inc. | Augmented reality music composition |
US9679547B1 (en) | 2016-04-04 | 2017-06-13 | Disney Enterprises, Inc. | Augmented reality music composition |
CN107067295A (en) * | 2017-03-13 | 2017-08-18 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
US10453263B2 (en) | 2018-02-27 | 2019-10-22 | Verizon Patent And Licensing Inc. | Methods and systems for displaying augmented reality content associated with a media content instance |
US11461961B2 (en) | 2018-08-31 | 2022-10-04 | Magic Leap, Inc. | Spatially-resolved dynamic dimming for augmented reality device |
US11676333B2 (en) | 2018-08-31 | 2023-06-13 | Magic Leap, Inc. | Spatially-resolved dynamic dimming for augmented reality device |
US11170565B2 (en) | 2018-08-31 | 2021-11-09 | Magic Leap, Inc. | Spatially-resolved dynamic dimming for augmented reality device |
US20220191392A1 (en) * | 2020-12-10 | 2022-06-16 | Seiko Epson Corporation | Display method, detection apparatus, and non-transitory computer-readable storage medium storing a program |
Also Published As
Publication number | Publication date |
---|---|
WO2006023268A3 (en) | 2007-07-12 |
EP2704102A3 (en) | 2014-06-04 |
JP2008510254A (en) | 2008-04-03 |
JP2010244575A (en) | 2010-10-28 |
WO2006023268A2 (en) | 2006-03-02 |
EP2704102B1 (en) | 2017-01-04 |
EP1779372A2 (en) | 2007-05-02 |
EP2704102A2 (en) | 2014-03-05 |
US8547401B2 (en) | 2013-10-01 |
US20190030441A1 (en) | 2019-01-31 |
EP1779372A4 (en) | 2014-06-04 |
US10099147B2 (en) | 2018-10-16 |
ES2611336T3 (en) | 2017-05-08 |
US20060038833A1 (en) | 2006-02-23 |
US20140031120A1 (en) | 2014-01-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190030441A1 (en) | Using a Portable Device to Interface with a Scene Rendered on a Main Display | |
US10948982B2 (en) | Methods and systems for integrating virtual content into an immersive virtual reality world based on real-world scenery | |
US20070273644A1 (en) | Personal device with image-acquisition functions for the application of augmented reality resources and method | |
CN107633441A (en) | Commodity in track identification video image and the method and apparatus for showing merchandise news | |
US20170286993A1 (en) | Methods and Systems for Inserting Promotional Content into an Immersive Virtual Reality World | |
US20080215994A1 (en) | Virtual world avatar control, interactivity and communication interactive messaging | |
US20120278904A1 (en) | Content distribution regulation by viewing user | |
EP2126708A1 (en) | Virtual world user opinion&response monitoring | |
KR20140082610A (en) | Method and apaaratus for augmented exhibition contents in portable terminal | |
CN108416832A (en) | Display methods, device and the storage medium of media information | |
KR20120050714A (en) | Augmented reality system and method of a printed matter and video | |
US20180373884A1 (en) | Method of providing contents, program for executing the method on computer, and apparatus for providing the contents | |
JP6609078B1 (en) | Content distribution system, content distribution method, and content distribution program | |
Rajappa et al. | Application and scope analysis of Augmented Reality in marketing using image processing technique | |
CN107578306A (en) | Commodity in track identification video image and the method and apparatus for showing merchandise news | |
CN112381955A (en) | Activity and exhibition display system based on three-dimensional space | |
CN112288877A (en) | Video playing method and device, electronic equipment and storage medium | |
Stoyanova et al. | Real-time augmented reality shopping platform for studying consumer cognitive experiences | |
CN110213307B (en) | Multimedia data pushing method and device, storage medium and equipment | |
JP6942898B1 (en) | Programs, methods, information processing equipment, systems | |
JP3239472U (en) | Multifunctional AR interactive device | |
CN111915737B (en) | Human-object interaction system based on augmented reality | |
KR102561198B1 (en) | Platform system usiing contents, method for manufacturing image output based on augmented reality | |
CN114780181B (en) | Resource display method, device, computer equipment and medium | |
JP7344084B2 (en) | Content distribution system, content distribution method, and content distribution program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: SONY INTERACTIVE ENTERTAINMENT INC., JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT INC.;REEL/FRAME:039239/0343 Effective date: 20160401 |