WO2012075589A1 - Method and system for virtual shopping - Google Patents

Method and system for virtual shopping Download PDF

Info

Publication number
WO2012075589A1
WO2012075589A1 PCT/CA2011/050764 CA2011050764W WO2012075589A1 WO 2012075589 A1 WO2012075589 A1 WO 2012075589A1 CA 2011050764 W CA2011050764 W CA 2011050764W WO 2012075589 A1 WO2012075589 A1 WO 2012075589A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual
store
user
product
products
Prior art date
Application number
PCT/CA2011/050764
Other languages
French (fr)
Inventor
Fadi Azba
Original Assignee
Fadi Azba
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fadi Azba filed Critical Fadi Azba
Publication of WO2012075589A1 publication Critical patent/WO2012075589A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0639Item locations

Definitions

  • the master server module is communicatively coupled to each of the participating store server modules, wherein the master server module is configured to collect and manage data relating to products associated with the plurality of participating stores. In this manner, the master server module provides a master list of all products which are available in the virtual shopping system.
  • the master server module can be configured for interaction with an online customer, thereby providing an online customer with options which may include one or more of product searching, price comparisons, participating store identification and participating store connection, for example redirecting an online user's browser to the website which contains the virtual replica of that participating store.
  • obtaining images comprises capturing images.
  • the images may comprise a frame from a series of images captured periodically at a given frame rate or it may be a still image comprising a single frame. Accordingly, the images may be obtained from an image-capturing device such as a still camera, video camera, infra-red camera or the like.
  • the image may be captured in a suitable image format as would be readily understood by a worker skilled in the art. Formats for capturing images may include raw image formats, Joint Photographic Experts Group File (JPEG) and the like for still and video images and interlaced and progressive scanning formats for digital video images.
  • JPEG Joint Photographic Experts Group File
  • Using the master product database can provide a means for managing the inventory of entire virtual shopping system including the plurality of participating stores, and can also provide a means for searching and/or identifying potential products for a customer even when those products are not in the specific virtual store that the online user would be shopping.
  • the product presentation devices in the live video feed of the store are replaced by the virtual replicas previously created thereof.
  • the aisle in the video feed is replaced by the virtual replica of that shelf.
  • the live video feed will have an aisle of the physical store that is stocked with inventory (at the physical store), this aisle of the physical store is replace in the video feed with a virtual replica of the aisle, wherein this virtual replica of the aisle is empty, such that the virtual replicas of the products can be added to the virtual replica of the aisle for subsequent presentation to an online customer that enters the virtual store.
  • the virtual products, virtual product presentation devices and store images are stored in a database, namely the specific participating store server module and the master server module.
  • the association between virtual products and virtual product presentation device is based at least in part on the configuration of products on the product presentation devices in the physical store.
  • User input received may comprise input to enable navigation through the store, for example, mouse clicks or drags to move through an aisle.
  • a virtual user browsing the virtual store would be enabled to make only those movements through the virtual store that a shopper in the physical store would be allowed to make. For example, a user of the virtual store would be able to walk up and down the aisles but not through the cabinets or shelves in an aisle.
  • User input received may comprise input to enable interaction with a virtual product presentation device.
  • a user may be enabled to use mouse clicks to open a virtual cabinet door housing virtual products.
  • User input received may comprise input to enable user interaction with one or more virtual products, for example, mouse click to select a virtual product for purchase.
  • a user can select a product and put it into a virtual shopping cart, exemplarily by clicking on the product and dragging it into the shopping cart.
  • a user may be able to place an item on hold, for example, by clicking on a "hold" icon displayed on the screen or that appears when the cursor is rolled over a virtual product or a specific region of the virtual product. The virtual product on hold may then be removed from virtual shelf.
  • user input may be received to ask for a store representative regarding a particular virtual product.
  • received user input may enable a user to examine a virtual product, for example, rotate it to view from different directions.
  • user input may be received to opening of a packaged virtual product and viewing the virtual product inside.
  • product information is displayed on the display screen.
  • Product information may include one or more pieces of information such as price, dimensions, weight, colour options, product reviews, link to the manufacturer website, and the like.
  • the method further comprises enabling a plurality of users to shop together in the same virtual store.
  • navigation through the virtual store may be controlled by one of the plurality of users.
  • one of the plurality of users may select one of the plurality of users as the "shopper" for controlling navigation through the virtual stores.
  • a plurality of users shopping together are presented the same view of the virtual store and virtual products.
  • the plurality of users shopping together are presented the same virtual store presentation device but be able to view different virtual products.
  • the system further comprises providing a virtual cash counter.
  • the virtual cash counter is a virtual replica of the cash counter in the physical store and is staffed by the cashier at the physical store. Accordingly, live images of the cashier may be provided to the user at the virtual cash counter. The live images may be obtained by means of a camera with a camera associated with the cash counter.
  • the real cashier at the physical cash counter may further comprise a screen where they can view and have an interactive video chat with the user of the virtual store.
  • the cashiers at the virtual cash counters are located remotely from the physical store, at a call center, for example, and are dedicated to serving the virtual users only.
  • a user of the virtual store can thus select a virtual product, place it in the virtual cart and wheel it to the cash counter for payment.
  • the user enters the relevant financial information into a user input area configured to enable transactions related to purchases.
  • the payment is made using a general credit card, debit card or other prepaid card.
  • purchases are made using a proprietary card and payment system.
  • purchases from the virtual store are enabled using a card reader connected to the computer, the card reader configured to read a card which may be a general or proprietary credit, debit or prepaid card.
  • a proprietary card reader connected to the user's own computer with a proprietary card has the advantage of greater ability to prevent fraud.
  • the corresponding physical product may be obtained by having it delivered to the user or by the user picking it up from the physical store.
  • the method further comprises use of a proprietary payment system for purchases of products from the virtual stores.
  • the proprietary payment system comprises a prepaid card, a credit card or a debit card.
  • the proprietary payment system is associated with the affiliate network.
  • the proprietary payment system is associated with the primary store of the affiliate network.
  • the proprietary payment system may use appropriate security and authentication means for conducting transactions such as smart chips, pin, passwords, biometric identification and the like.
  • appropriate security and authentication means for conducting transactions such as smart chips, pin, passwords, biometric identification and the like.
  • a worker skilled in the art will be familiar with suitable systems for conducting secure transactions.
  • Appropriate encryption protocols may additionally be used to ensure privacy and security of information being transferred.
  • the proprietary payment system and card may be associated with a loyalty program as will be readily understood by a worker skilled in the art.
  • the proprietary payment system and card may be used for sales and marketing data. For example, data related to purchases made using the proprietary card and system such as number of items purchased, purchase time of day, manufacturer brand and the like may be tracked.
  • the proprietary payment method may be implemented using a payment system comprising a proprietary card reader communicatively linked with the user's computer.
  • the proprietary card reader may be purchased or rented by the user.
  • the proprietary card reader may be included as part of the membership fees associated affiliate network membership.
  • a sales agent may appear on the display screen.
  • the sales agent may additionally be able to see and hear the user in order to have a live video interactive chat.
  • the sales agent may be able to answer the user's questions, recommend and perform demonstrations of products.
  • the sales agent may be enabled to finalize the sales by accepting payment and enabling the user to obtain the product in the manner specified by the user.
  • the system further comprises a means for projecting an image of one or more products into the user' s location.
  • the image can be an image, such as a two-dimensional image projected onto a surface such as a wall, mannequin, model, or the like.
  • the projected image may further be life-sized.
  • the image can be a three-dimensional or two-dimensional holographic image. Alternatively the image may be non-holographic.
  • a projected image generating device such as a hologram generating device, communicatively linked to the customer's computer is accordingly provided to enable the projection.
  • a customer may use a projected image generating device to project clothing onto a wall, onto a mannequin, onto a projection area incorporated with one or more mirrors allowing the customer to see parts of themselves, or even onto a person such as the customer themselves.
  • a customer may use a projected image generating device to project pieces of furniture into parts of a room to see how they will look.
  • a mobile handheld projector may comprise one or more motion sensors operatively coupled to the image projection components, such that, when the handheld projector is pointed in various directions, the projected image is varied accordingly.
  • different parts of a large image may be projected at different times. For example, for an image of a table projected on a wall, the user may point the handheld projector at the lower left corner of the wall to see the lower left corner of the table, and move the handheld projector upward and across to trace out the remainder of the table image presented in its real size. Zooming in on details, projecting different sides of an object, and the like, may similarly be enabled by moving the handheld projector accordingly.
  • the virtual representation of the stores in the virtual store location may be indicative of them being a participating store.
  • the virtual representations of participating stores in the virtual representation of the store location may be highlighted to indicate their inclusion in the virtual shopping system, and thus could be virtually entered by the online customer.
  • a user browsing a virtual store location may enter the store upon selecting the virtual store, exemplarily by double-clicking on the virtual store representation in the virtual store location.
  • the virtual representation of the store location i.e. exterior context and surroundings of the store
  • evolves to a representation of the store i.e. interior of the virtual store
  • a virtual store location may be indicative of the real-time activity in the vicinity of the physical store.
  • the virtual representation of the physical store location may comprise real-time images of activity in the vicinity of the physical store.
  • activity such as vehicle traffic, pedestrian traffic and the like that would be visible to a person present in the vicinity of the physical store at that time, which in some embodiments can be captured by one or more cameras positioned in the vicinity of the physical store.
  • the generated virtual objects associated with the products and aisles and shelves and other presentation devices will be displayed on the administration panel in the inventory/ails section 501 which can provide a store owner or manager to select and drag the virtual object into the store section 502 or out of the store section 502, thereby providing a means for the organization of the virtual store layout that will be visible to the online customer.
  • the inventory/ails section 501 of the administration panel includes each of the virtual replicas creating, for example products, aisles, shelves and other fixtures.
  • the inventory/ails section 501 provides a store owner or manager the ability to select one or more of the virtual replicas for insertion into the store section 502, thereby creating the setup of the virtual store.
  • the virtual shopping system can provide one or more searching options, which can be dependent on who wishes to perform the searching.
  • an online customer can be provided with the ability to search for products in a particular participating store, or can be provided with the ability to search for a particular product without a store limitation.
  • a customer can be provided with the ability to search for particular types of stores which may be associated with the virtual shopping system.
  • this searching ability can be provided by the associated particular store server module or alternately provided by the master server module, wherein which server module performs the functionality may be determined by "where" the customer is, for example in the virtual store.
  • this search will be performed by the master server module.
  • the search may be related to one or more products, one or more stores or both. Accordingly, a search feature and functionality may be provided.
  • a user may perform a search by entering text into a search box provided on the screen. For example, a user may conduct a search for a particular product such as olive oil from a particular producer.
  • the user may be presented with a list of virtual stores where the product is available and can select from the list to be taken to the selected virtual store for browsing and optionally purchasing.
  • the user may be automatically redirected to the virtual store where the searched product is available.
  • the user may be redirected to the particular presentation device in the virtual store associated with the searched product.
  • participant stores when a client is referred to an affiliate store that is presented on a street set up, participant stores will show as previously discussed above, and the referred-to store will be highlighted in a different color or manner to identify it from the other participating stores. This identification of the recommended affiliate store can help competition and result in competitive honest online pricing.
  • one or more stores may be recommended to a user or customer.
  • one or more products may be recommended to a user.
  • the method further comprises keeping track of the traffic within the affiliate network. Traffic from one store to another is tracked.
  • the traffic log is used to calculate compensation to various entities, for example the recommending store.
  • the customer can navigate through a mouse pad or other control device turn left/right look at the aisles.
  • the online users will see shoppers who are in the real store, which is being virtually represented to the customer.
  • a customer may have to wait to examine certain products in instances where another physical user is standing in front of the item of interest, as is similar to being in a real life situation.
  • section names can be displayed to simplify navigation.
  • zoom features will be implemented such that a customer can pick up a product, ask to speak to a sales representative, or complete shopping transaction and pay at the cashier.
  • a user can open cabinets and interact with other accessible fixtures at a store, where these cabinets or other accessible fixtures have been virtualized for presentation to the customer.
  • a customer can selectively ask to speak to a customer care counter to return an item or get a return mailing address for shipping back a previously purchased product back.
  • the customer upon leaving the virtual store, the customer can see displayed on the screen a street view or mall view associated with that store. In embodiments, this street view or mall view can be exactly what a customer would see upon leaving the physical store associated with the virtual store.
  • the communication between the master server module and the plurality of participating store server modules can be performed over a closed communication network.
  • the communication is performed over a public communication network, wherein the communications are provided with a level of security, for example communications can be encrypted.
  • the storage module of the master server module in association with the one or more processing module thereof can be configured in a manner to enable searching of the stored data, for example for product searching by one or more participating store owners or an online customer or both, other search queries relating to participating stores or affiliate stores or the like.
  • the master server module further comprises one or more output devices and one or more input devices, for example for interaction with a user thereof.
  • interaction with the master server module can be provided by an appropriately configured communication network and associated software applications operating on the master server module and the computing device communicating therewith.
  • the participating store server module comprises a processing module for performing the one or more tasks assigned thereto, a communication module for communicatively coupling, when required, the participating store server module to a customer computing device and/or the master server module, and a storage module configured for storing data representative of the products available in the associated virtual store, and optionally both the physical store and the virtual store.
  • the storage module is further configured for storing data representative of the virtual store, for example product positioning and layout and the like.
  • the storage module in association with the processing module can be configured in a manner to enable searching of the stored data, for example for virtual store creation, or product searching by a store owner or an online customer or both.
  • the participating store server module further comprises one or more output devices and one or more input devices, for example for interaction with a user.
  • the participating store server module is configured to collect and manage data relating to products associated with the participating store associated therewith.
  • the participating store server module is further configured to generate a virtual replica of the associated physical store for subsequent presentation to a customer upon request.
  • the participating store server module further comprises a means
  • FIG. 9 illustrates a system for presenting a virtual store based on acquired images of a physical store, in accordance with embodiments of the present technology.
  • the system comprises one or more image capture devices 910 such as cameras configured to acquire images of at least a physical store 912 and products 914 to be sold by the virtual store (and optionally also by the physical store). Images of product presentation devices, such as store shelves 916, may also be acquired.
  • the image capture devices 910 may provide a stream of real-time images, a set of previously recorded images, or a combination thereof.
  • Previously recorded images such as images of products, images of empty product presentation devices, and images of empty physical store aisles, may be recorded in one or more appropriate databases, depicted in FIG.

Abstract

A method and system for enabling a realistic virtual shopping experience. One or more participating stores (22, 24, 26) are recreated as a virtual replica of an actual physical store. Images of the virtual replica are presented to an online shopper. In some embodiments, the virtual replica can at least in part be generated from a "real time" video feed from the physical store, wherein elements of the image, for example the products, are converted into virtual objects, which are selectable by the customer during the shopping process. In some embodiments, product images are obtained (110), store images comprising product presentation devices are obtained (120), the images are processed to generate virtual products and virtual product presentation devices (130), and the interactive virtual store is generated (140) and presented (160). A master server module (10) may be used in directing the user to various participating stores.

Description

METHOD AND SYSTEM FOR VIRTUAL SHOPPING
TECHNICAL FIELD
[0001] This application relates generally to computer-based commerce and more specifically to a method and system for virtual shopping.
BACKGROUND
[0002] Online shopping offers many conveniences over shopping in a physical store and has been widely adopted by customers for its ease and convenience. However, the online shopping experience can be isolating and lacks the advantages of interactivity. Furthermore, online stores often do not convey the character of the physical store. There is a need to provide a more realistic online shopping experience that mimics the experience of shopping at a physical store more closely.
[0003] This background information is provided to reveal information believed by the applicant to be of possible relevance to the present technology. No admission is necessarily intended, nor should be construed, that any of the preceding information constitutes prior art against the present technology.
SUMMARY
[0004] An object of the present technology is to provide a method and system for virtual shopping. In accordance with an aspect of the present technology there is provided a system for creating a virtual shopping experience for a user, said virtual shopping experience commensurate with a real-life shopping experience, the system comprising: a plurality of participating store server modules, each participating store server module configured to collect and manage data relating to products associated with a particular participating store associated therewith, each participating store server module configured to present to a user a virtual replica of the particular participating store associated therewith, the virtual replica of the participating store configured for user interaction therewith, each participating server module further configured to receive input based at least in part on the user's interaction with the virtual replica of the participating store; and a master server module communicatively coupled to each of the plurality of participating store server modules, the master server module configured to collect and manage data relating to products associated with the plurality of participating stores, the master server module configured for user interaction therewith and further configured to enable the user to search for one or more products and to direct the user to one or more of the participating stores based at least in part on the user interaction therewith.
[0005] In accordance with another aspect of the present technology there is provided a method for creating a virtual shopping experience for a user, said virtual shopping experience commensurate with a real-life shopping experience, the method comprising the steps of: providing a plurality of participating store server modules, each participating store module collecting and managing data relating to products associated with a particular participating store associated therewith, each participating store server module presenting to a user a virtual replica of the particular participating store associated therewith wherein the virtual replica of the particular participating store enables user interaction therewith and each participating server module receiving input based at least in part on the user's interaction with the virtual replica of the particular participating store; and providing a master server module communicatively coupled to each of the plurality of participating store server modules, the master server module collecting and managing data relating to products associated with the plurality of participating stores, the master server module enabling user interaction therewith and enabling a user to search for one or more products and directing the user to one or more of the participating stores based at least in part on the user interaction therewith.
[0006] In accordance with another aspect of the present technology there is provided a method of presenting a virtual store and enabling a user to shop in the virtual store, the virtual store being a virtual replica of a physical store having a product inventory, the method comprising: obtaining product images of one or more products in the product inventory of the physical store; obtaining store images of the physical store void of the product inventory, said store images including a plurality of product presentation devices; processing the obtained product images and store images to generate one or more virtual products and a plurality of virtual product presentation devices; associating each of the one or more virtual products with a particular virtual product presentation device; integrating the virtual product presentation devices with associated virtual products thereby generating the virtual store, presenting the virtual store to the user; receiving input from the user, said input based at least in part on the user's interaction with the virtual store; and generating one or more control signals configured to enable the user to browse the virtual store, the control signals at least in part based on the received input from the user.
[0007] In accordance with another aspect of the present technology there is provided a system for presenting a virtual store and enabling a user to shop in the virtual store, the virtual store being a virtual replica of a physical store, the system comprising: a display for presenting said virtual store; a processing module; and one or memory modules operatively coupled with said processor and configured to store information and instructions, the instructions being executable by the processing module and when executed configured to perform the following: obtaining product images of one or more products in the product inventory of the physical store; obtaining store images of the physical store void of the product inventory, said store images including a plurality of product presentation devices; processing the captured product images and store images to generate one or more virtual products and a plurality of virtual product presentation devices; associating each of the one or more virtual products with a particular virtual product presentation device; integrating the virtual product presentation devices with associated virtual products thereby generating the virtual store, presenting the virtual store to the user; receiving input from the user, said input based at least in part on the user's interaction with the virtual store; and generating one or more control signals configured to enable the user to browse the virtual store, the control signals at least in part based on the received input from the user.
BRIEF DESCRIPTION OF FIGURES
[0008] FIG. 1 illustrates a schematic of the system for creating a virtual shopping experience for a user in accordance with embodiments of the present technology.
[0009] FIG. 2 illustrates a flowchart of the steps of a method for presenting a virtual store and enabling a user to shop in the virtual store in accordance with embodiments of the present technology.
[0010] FIG. 3 illustrates an example embodiment of a virtual store as it would be presented to a user on the store's website in accordance with embodiments of the present technology.
[0011] FIG. 4 illustrates a schematic of an image capturing device or camera which can be used for the digitization of the one or more products to be associated with the virtual shopping system according to the present technology. [0012] FIG. 5 illustrates an image of a participating store front which can be presented to an online customer upon entry of its address into a web browser by the online customer, according to embodiments of the present technology.
[0013] FIG. 6 illustrates a virtual store location in accordance with embodiments of the present technology.
[0014] FIG. 7 illustrates a schematic of an administration panel for use by a store owner, according to embodiments of the present technology.
[0015] FIG. 8 illustrates a schematic block diagram of a system configured for presenting a virtual store and enabling a user to shop in the virtual store in accordance with embodiments of the present technology.
[0016] FIG. 9 illustrates a schematic of a system for presenting a virtual store based on acquired images of a physical store, in accordance with embodiments of the present technology.
DETAILED DESCRIPTION
Definitions
[0017] The term "user" and "customer" as used herein interchangeably refer to a person using a computer accessing a virtual shopping system according to embodiments of the present technology.
[0018] The term "virtual replica" as used herein refers to a virtual representation of a physical object or location created to have the likeness of the physical object and configured for a computer or web environment. A virtual replica is created using one or more images of the physical object location and which are manipulated using appropriate software and image processing tools. For example, a virtual replica of a physical object can created from a collection of captured images of a plurality of sides of the object such that a 3 -dimensional electronic image can be created. Images may be captured using a camera, web camera, video camera, or the like, and may optionally be augmented or edited. Also for example, a virtual replica of a physical location can be created from a series of images of the physical location, such that the virtual replica of the physical location is substantially a digitized video of the physical location, thereby including one or more features of the environment associated with the physical location.
[0019] The term "participating store" as used herein refers to a physical store that has a virtual replica generated thereof, and is included in the stores that a customer or user is able to explore and shop using the virtual shopping system according to the present technology. The virtual replica may be a replica of a particular instance of a physical store. For example, for a chain of stores, a virtual replica may be a replica of a particular store in the chain, located at a particular address, rather than the virtual replica being a virtual store made to resemble stores in the chain generally. Furthermore, for a chain of stores, plural virtual replicas may be provided, each corresponding to a particular store with a particular address.
[0020] The present technology relates to a method and system for enabling virtual shopping. The instant system and method for virtual shopping are configured in order provide the user or customer with a shopping experience that is substantially realistic. Each of a plurality of participating stores associated with the virtual shopping system is recreated as a virtual replica of the actual store, such that in some embodiments, the images of the virtual replica of the store presented to an online shopper are substantially representative of the physical participating store. In some embodiments, the virtual replica can at least in part be generated from a substantially "real time" video feed from the specific participating store, located at a specific physical address, wherein elements of the image, for example the products, are converted into virtual objects, which are selectable by the customer during the shopping process.
[0021] According to embodiments of the present technology, the online customer is presented with a virtual store wherein interaction therewith, including sales representatives, customer service representatives and the like, is substantially realistic relative to what typically occurs in the physical store. In this manner, the online customer is provided with a substantially realistic shopping experience.
[0022] The virtual shopping system includes a master server module which is communicatively coupled to a plurality of participating store server modules, wherein each of the participating store server modules is associated with one of the participating stores. Each of the participating store server modules is configured to collect and manage data relating products associated with that particular participating store. For example, the data can include a substantially complete digital representation of each product, which may include size parameters thereof. In addition, each of the participating store server modules can be configured to enable a store owner or employee to organize the presentation of the products in that store, wherein this organization is reflective of the manner in which the products are to be presented to the online customer.
[0023] The master server module is communicatively coupled to each of the participating store server modules, wherein the master server module is configured to collect and manage data relating to products associated with the plurality of participating stores. In this manner, the master server module provides a master list of all products which are available in the virtual shopping system. The master server module can be configured for interaction with an online customer, thereby providing an online customer with options which may include one or more of product searching, price comparisons, participating store identification and participating store connection, for example redirecting an online user's browser to the website which contains the virtual replica of that participating store.
[0024] According to embodiments of the present technology, the virtual shopping system includes a plurality of image capturing devices, for example cameras, which are positioned within the physical participating store and configured to capture data, for example pictures or video, relating to the look and feel of the actual participating store. This picture and/or video data is integrated into the generated virtual replica of the participating store, thereby providing an online customer with a substantially realistic representation of the participating store during the virtual shopping experience. In some embodiments, image capturing devices are also positioned for capturing picture and/or video data relating to the participating store front and/or the immediate locale of the participating store.
[0025] FIG. 1 illustrates a virtual shopping system according to embodiments of the present technology. The master server module 10 is communicatively coupled to each of the participating stores 22, 24 and 26, and in particular the master server module is communicatively coupled to the participating store server module 23, 25 and 27 of each of the participating stores. This communicative coupling between the master server module 10 and the plurality of participating store server modules 22, 24, 26 provides for the transfer of information, for example product data, there between. A customer, via the customer's computing device 30, can access the master server module to for example, search for desired products, and upon identification of a desired product, the master server module 10 can be configured to direct the user to a specific participating store, via the participating store server module, in order to continue shopping for the desired product, for example for product viewing, purchasing or the like. The user may be directed to a specific participating store based on product availability, price, proximity of the physical store to the user, or the like, or a combination thereof, for example. A customer, via the customer's computing device 30, can also access each of the participating stores, via the associated participating store's server module, wherein this access can be provided directly upon selection by the customer or indirectly via the customer's use of the master server module. Each of the participating store server modules is configured to present to the customer a virtual replica of the participating store with which it is associated and interact with the customer, for example modifying the presented images of the participating store based on input from the customer. These inputs can be directed towards for example, product selection, product viewing, requesting customer service, purchasing, or the like, or a combination thereof.
[0026] FIG. 2 illustrates a method of presenting a virtual store and enabling a user to shop in the virtual store, the virtual store being a virtual replica of a physical store having a product inventory. The method comprises obtaining 110 product images of one or more products in the product inventory of the physical store; obtaining 120 store images of the physical store void of the product inventory, said store images including a plurality of product presentation devices; processing 130 the obtained product images and store images to generate one or more virtual products and a plurality of virtual product presentation devices; associating 140 each of the one or more virtual products with a particular virtual product presentation device; integrating 150 the virtual product presentation devices with associated virtual products thereby performing a step in generating the virtual store, presenting 160 the virtual store to the user; receiving 170 input from the user, said input based at least in part on the user's interaction with the virtual store; and generating 180 one or more control signals configured to enable the user to browse the virtual store, the control signals at least in part based on the received input from the user.
[0027] FIG. 3 illustrates an example embodiment of a virtual store 200 as it would be presented to a user on the store's website. In this example, the virtual store is a virtual replica of a physical grocery store having product inventory comprising products 210 such as produce, beverages, dairy products, packaged food products, frozen food products, prepared food, household items, pharmacy items, cosmetics, and the like. The products in the real store are housed in shelves 220 and cabinets in different aisles. The virtual grocery store in this example, displays virtual replicas of the physical store inventory on virtual shelves which are themselves virtual replica of the physical store shelves. For example, the aisle displaying breakfast cereals has two aisles on either side with three shelves each. The cereals displayed and the number of boxes of each kind of cereal reflect the physical store inventory. In this example, the boxes are further displayed on the virtual shelves in an arrangement identical to that in the physical store. The virtual store further comprises real-time images of shoppers 230 in the physical store. When the user enters the virtual store site, they are presented with a view of the store from the entrance and can navigate through the store by navigating on the page using the mouse and associated cursor, for example. A user can proceed towards any of the virtual aisles and click on a virtual replica of a product to select it. The selected product may be placed in a shopping cart for purchasing. The user may then proceed towards a virtual checkout counter and pay by swiping the store's proprietary card on a special card reader connected to the computer. The purchase will then be registered in the real store inventory and the product will be delivered to an address specified by the user.
Virtual Store, Virtual Products, Virtual Product Presentation Devices
[0028] The physical store or participating store comprises one or more products and one or more product presentation devices for displaying the one or more products. The physical store may further comprise one or more shoppers shopping in the store.
[0029] The virtual store is a virtual replica of the physical store or participating generated based at least in part on one or more images of the physical store. The images may be stored previously captured images or real-time images. For example in some embodiments, the real-time images can be capture by a plurality of cameras which are positioned within and in some instances outside the participating store, wherein this real-time data can be used in part to create the virtual replica of this participating store for presentation to an online customer. For example, the plurality of cameras can provide data feeds of store aisles, cashiers, store fronts and the like thereby enabling a substantially realistic virtual replica of the participating store.
[0030] The virtual replica store comprises virtual replicas of one or more products, hereinafter referred to as virtual products. In some embodiments, the virtual products are displayed, placed or housed on virtual replicas of one or more product presentation devices, hereinafter called virtual product presentation devices. In some embodiments, the virtual products are based at least in part on one or more previously captured images of the products. In some embodiments, the virtual product presentation devices are based at least in part on one or more previously captured images of the product presentation devices. The virtual store may further comprise real-time images of one or more shoppers currently shopping in the real store.
[0031] Examples of products include items such as food, clothing, furniture, books, and the like that may be offered for sale in a store. Examples of product presentation devices include any suitable means for displaying products such as shelves, cabinets, racks, bins, boxes, platforms, pedestals, hangers, hooks, floor and floor sections, wall and wall sections, ceiling and ceiling sections, and the like. A worker skilled in the art will be familiar with various products and means of displaying products in a store.
Obtaining Images
[0032] Accordingly, in some embodiments, one or more images of the products are obtained for generating virtual replicas of the products. In some embodiments, one or more images of the product presentation devices of the physical store are obtained for generating virtual replicas of the shelves. In some embodiments, one or more store images may be obtained of the physical store void of the product inventory, the store images including a plurality of product presentation devices, which can provide a means for the digitization of the product presentation devices in that image. Upon the generation of the virtual replicas of the products and the product presentation devices, these virtualized replicas are subsequently stored at the participating store server module and/or the master server module for subsequent use during the creation of the virtual store, for example through the functionality of the administration panel associated with the system.
[0033] In some embodiments for example, the product presentation devices can include aisles, fixtures, clothes racks, shelving and other systems that are used to present products to a customer in a physical store.
[0034] In some embodiments, obtaining images comprises capturing images. The images may comprise a frame from a series of images captured periodically at a given frame rate or it may be a still image comprising a single frame. Accordingly, the images may be obtained from an image-capturing device such as a still camera, video camera, infra-red camera or the like. The image may be captured in a suitable image format as would be readily understood by a worker skilled in the art. Formats for capturing images may include raw image formats, Joint Photographic Experts Group File (JPEG) and the like for still and video images and interlaced and progressive scanning formats for digital video images.
[0035] Images of the products, product presentation devices and store images (also referred to generally as objects for convenience) may be captured from different directions and orientations, and at different magnifications. The obtained images provide a substantially three-dimensional view of the object.
[0036] FIG. 4 illustrates a schematic of a camera device which can be used to capture the images of a product for integration and storage on a participating store's server module and further storage on the master server module. In this embodiment, the camera includes four image cameras to capture the top 252, bottom 256 and left side 254 and right side 250 views of the product. The camera device can further include a scanning lens 258 for scanning the product which can provide a means for sizing of the product and also for digital three dimensional replication of the product. In some embodiments, the camera device can include six image cameras, wherein the front and back views of the product may also be captured. The camera device can be configured to also capture an image of the bar code associated with the product. In some embodiments, the camera device includes a means for manual entry of the one or more pieces of information relating to the product being scanned for example, sizes or dimensional can be manually entered. As would be readily understood, for manual data entry the camera device would be suitably configured with an appropriate input device or connectivity to an appropriate input device.
[0037] In some embodiments, product images comprise products in the packaging. In some embodiments, product images may additionally comprise images of the object without the packaging. For example, product images of fan may include images of the box containing the fan as well as the fan in isolation.
[0038] In some embodiments, the products images comprise images of the product in different configurations. For example, images of a folding table may be captured in various folded and unfolded configurations. [0039] In some embodiments, the dimensions of the object are obtained in addition to the images of the object. The dimensions may include the dimensions of the packaged product, the product itself, or both.
[0040] In some embodiments, live or real-time images of the physical store are additionally obtained. In some embodiments, live images are obtained of a plurality of locations inside the physical store. In some embodiments, live images of the store are obtained from a plurality of directions.
Processing Images to Generate Virtual Objects
[0041] One or more of the obtained images may be processed to generate the virtual store, virtual product presentation devices and virtual products. As mentioned above, the images may be previously captured images or real-time images.
[0042] The obtained images may be processed to convert from one format to another. The obtained images may be digitized if not already in a digital format. The images may be cropped to extract portions. The images may be combined with one or more other images to form a composite image. The images may be rotated, reoriented, resized or rescaled. The image resolution may be changed to suit a particular display size. A worker skilled in the art will be familiar with suitable image processing techniques for creating a virtual representation of an object.
[0043] The obtained images may be subjected to various preprocessing operations such as resampling, noise reduction, image stabilization and the like. For example, the image may be resampled in order to change the size of the image to fit the dimensions of the display. Noise reduction and image stabilization may be necessary to improve the quality of the image before it can be subjected to more detailed processing. The pre-processing step may also include adjustments to image attributes such as color, balance, brightness, luminance, lighting, saturation and contrast.
[0044] The obtained product images, product presentation device images and store images are processed to generate one or more virtual products, one or more virtual product presentation devices; and one or more store configurations, generally referred to as virtual objects for convenience. The virtual object comprises one or more processed images of the object. [0045] In some embodiments, the one or more virtual products are stored in a database associated with the particular participating store. The one or more virtual products are also stored in a master product database associated with the master server module, which can be used to maintain a substantially complete inventory of the virtual products, an identification of substantially all of the virtual products created or the like. Using the master product database can provide a means for managing the inventory of entire virtual shopping system including the plurality of participating stores, and can also provide a means for searching and/or identifying potential products for a customer even when those products are not in the specific virtual store that the online user would be shopping.
[0046] In some embodiments, the images of the products, product presentation devices and the store images may be processed to tag with information related to identity, location, price and the like. For example, the image of a cabinet may be tagged with location information or to indicate that it is cabinet A from aisle 5. In some embodiments, the images of each product may be tagged with the product inventory label, for example, a UPC barcode.
[0047] In some embodiments, the images are processed to create image maps with different areas linked to provide different information or to respond to a user input in different ways. The response may be based on the user input, on the image region in which the input is received or both. For example, an object may be divided into four image regions, each of which when clicked on with a mouse may rotate to display a different view of the product, for example.
[0048] The virtual objects may be configured to be rotatable, translatable, and resizable. In some embodiments, the images comprising the virtual object may be processed to respond to different kinds of user input. In some embodiments, the virtual object may be configured to respond in different ways to different kinds of user input. Examples of different kinds of input include single click, double-click, drag, and the like.
[0049] In some embodiments, the virtual store may be based at least in part on real-time images of the physical store comprising one or more shoppers in the store. The live real-time images of the physical store may be processed to extract images of the shoppers. The images may be processed to recognize objects such as people, cars and chairs. Various object and pattern recognition techniques are used to recognize and extract features from images as will be readily known to a worker skilled in the art. [0050] Object and pattern recognition techniques and algorithms are well known in various fields related to computer vision such as facial detection, baggage scanning, etc. Typical object recognition techniques comprise segmenting the image into segments or sets of pixels that share some common visual characteristic using techniques such as contrast enhancement. The segmented regions or objects may be subjected to feature extraction. Typical features detected by
feature extraction algorithms include edges, corners, blobs and ridges. Other properties such as colour, texture, shape and size of the objects may also be analyzed. Various rough and detailed classification steps may be successively applied to the objects to compare their feature sets with a set of standard patterns such as patterns for person, tree, car, street, etc. stored in a database and to determine the object classes.
Generating a Virtual Store
[0051] The virtual store is generated by integrating virtual products and virtual product presentation devices. In some embodiments, the method further comprises integrating processed store images. In some embodiments, the method further comprises integrating processed images of real-time traffic, for example shoppers, in the physical store. A worker skilled in the art will be familiar with suitable image processing algorithms and software for integrating multiple images.
[0052] For example, when the virtual store is created using a substantially live video feed from the physical store, during the generation of the virtual store thereof, the product presentation devices in the live video feed of the store are replaced by the virtual replicas previously created thereof. For example, the aisle in the video feed is replaced by the virtual replica of that shelf. For example, the live video feed will have an aisle of the physical store that is stocked with inventory (at the physical store), this aisle of the physical store is replace in the video feed with a virtual replica of the aisle, wherein this virtual replica of the aisle is empty, such that the virtual replicas of the products can be added to the virtual replica of the aisle for subsequent presentation to an online customer that enters the virtual store. In this manner, the virtual store that is presented to the online customer comprises the "sights" of the physical store associated therewith, while further enabling the online customer to select and view the products as these products have been converted into virtual replicas thereof. [0053] In some embodiments, the integration of virtual products and virtual products presentation devices is in accordance with the configuration of products and product presentation devices in the physical store. Accordingly, the method comprises obtaining and storing the configuration of products and products presentation devices in the physical store. The method further comprises updating the stored configuration of products and products presentation devices in the physical store in real-time. Configuration may comprise physical layout and arrangement of products and product presentation devices. Configuration may further comprise numbers or quantities of products on the product inventory of the physical store.
[0054] According to embodiments, the method comprises associating each of the one or more virtual products with a particular virtual product presentation device. The virtual product presentation devices are then integrated with the associated virtual products thereby generating the virtual store.
[0055] According to embodiments of the present technology, wherein the virtual store is at least in part generated from real video of the physical store, the aisles, shelves and other fixtures will be digitalized using high resolution camera wherein during the image capture for this process the physical store would be empty of any inventory. These physical fixtures in the store will be hidden from the digital video feed and replaced by the digitalized images of the same fixtures, for example a shelf in the video feed will be replaced by the digitized version thereof which as defined above is a product presentation device. In this manner the online customer is presented with a virtual store for interaction therewith, which is substantially realistic relative to the physical store. In this manner, the online customer is provided with a substantially realistic shopping experience.
[0056] The virtual products, virtual product presentation devices and store images are stored in a database, namely the specific participating store server module and the master server module. In some embodiments, the association between virtual products and virtual product presentation device is based at least in part on the configuration of products on the product presentation devices in the physical store.
[0057] In some embodiments, the virtual objects are placed in a configuration identical to the configuration of the products in the physical store. In some embodiments, there is a one to one correspondence between the real inventory of the physical store and the virtual product inventory of the virtual store. For example, if there are 20 cartons of milk in the physical store, the virtual store also has 20 cartons of milk. Accordingly, in some embodiments, the virtual store inventory is updated in real time. In some embodiments the virtual store inventory is linked to or integrated with the real inventory. In some embodiments, the virtual store inventory is a subset of the real inventory and can be selectively determined by a store operator for example.
Presenting the Virtual Store to a User
[0058] The virtual store is presented to a user on the display screen of a computer. A display for presenting the virtual store may thus be a display of a client computing device, remote from the virtual store and master server modules. A user can browse the virtual store in the same manner as in the physical store. In some embodiments, a virtual store can be accessed by an online customer or user by the selection or entry of a web address by the customer into the web browser associate with their computer. For example, the web address can be configured in a manner that it is representative of the address of the physical store for which a virtual replica has been created. For example, the web address can include the address and postal code of the physical store. As illustrated in FIG. 5, according to embodiments of the present technology, upon the entry of the universal resource locator (URL) 282 for a specific participating store into a web browser, the customer will be presented with an external image or substantially real time video feed 281 of the physical appearance of the participating store.
[0059] In some embodiments, the virtual store may be accessed via a digital geographic map, for example Google Maps™, Google Earth™, or a map generated from a Geographic Information System. For example, the user may navigate through the map to the physical location of a participating store. The map image of the participating store may be associated with an opportunity to link to the corresponding virtual replica. For example, a map layer may be populated with selectable URLs at predetermined map locations and pointing to predetermined virtual replicas.
[0060] In some embodiments, the virtual store may be presented as panoramic views of the physical store and a user may be enabled to zoom in on a desired section. In addition to the virtual products displayed by one or more virtual product presentation device, a user may be able to see real-time traffic of shoppers in the physical store. In some embodiments, a user may also be able to see other online users of the virtual store. [0061] In some embodiments, the screen displayed may comprise other information such as text information, icons, counters, and the like. For example, the screen may display directions to other sections of the store, recommendations for products, messages regarding promotions, search boxes and the like.
Receiving Input from User and Enabling the User to Browse the Virtual Store
[0062] User input is received from the user based at least in part on the user's interaction with the virtual store. User input is received by means of one or more input means such as a mouse, touch pad, microphone and the like that will be readily known to a worker skilled in the art.
[0063] Upon receipt of user input, one or more control signals are generated to enable the user to browse the virtual store, the control signals are at least in part based on the received input from the user.
[0064] User input received may comprise input to enable navigation through the store, for example, mouse clicks or drags to move through an aisle. In some embodiments, a virtual user browsing the virtual store would be enabled to make only those movements through the virtual store that a shopper in the physical store would be allowed to make. For example, a user of the virtual store would be able to walk up and down the aisles but not through the cabinets or shelves in an aisle.
[0065] User input received may comprise input to enable interaction with a virtual product presentation device. For example, a user may be enabled to use mouse clicks to open a virtual cabinet door housing virtual products.
[0066] User input received may comprise input to enable user interaction with one or more virtual products, for example, mouse click to select a virtual product for purchase. In some embodiments, a user can select a product and put it into a virtual shopping cart, exemplarily by clicking on the product and dragging it into the shopping cart. In some embodiments, a user may be able to place an item on hold, for example, by clicking on a "hold" icon displayed on the screen or that appears when the cursor is rolled over a virtual product or a specific region of the virtual product. The virtual product on hold may then be removed from virtual shelf. In some embodiments, user input may be received to ask for a store representative regarding a particular virtual product. [0067] In some embodiments, received user input may enable a user to examine a virtual product, for example, rotate it to view from different directions. As another example, user input may be received to opening of a packaged virtual product and viewing the virtual product inside.
[0068] In some embodiments, when a user selects a product, exemplarily by clicking on it, product information is displayed on the display screen. Product information may include one or more pieces of information such as price, dimensions, weight, colour options, product reviews, link to the manufacturer website, and the like.
[0069] In some embodiments, the method further comprises enabling a plurality of users to shop together in the same virtual store. In some embodiments, navigation through the virtual store may be controlled by one of the plurality of users. In some embodiments, one of the plurality of users may select one of the plurality of users as the "shopper" for controlling navigation through the virtual stores.
[0070] Accordingly, in some embodiments, a plurality of users shopping together are presented the same view of the virtual store and virtual products. In some embodiments, the plurality of users shopping together are presented the same virtual store presentation device but be able to view different virtual products.
Checkout and Payment for Purchasing Virtual Products
[0071] The system further comprises providing a virtual cash counter. In some embodiments, the virtual cash counter is a virtual replica of the cash counter in the physical store and is staffed by the cashier at the physical store. Accordingly, live images of the cashier may be provided to the user at the virtual cash counter. The live images may be obtained by means of a camera with a camera associated with the cash counter. In some embodiments, the real cashier at the physical cash counter may further comprise a screen where they can view and have an interactive video chat with the user of the virtual store.
[0072] In some embodiments, the cashiers at the virtual cash counters are located remotely from the physical store, at a call center, for example, and are dedicated to serving the virtual users only. [0073] A user of the virtual store can thus select a virtual product, place it in the virtual cart and wheel it to the cash counter for payment. In some embodiments, the user enters the relevant financial information into a user input area configured to enable transactions related to purchases. In some embodiments, the payment is made using a general credit card, debit card or other prepaid card.
[0074] In some embodiments, purchases are made using a proprietary card and payment system. In some embodiments, purchases from the virtual store are enabled using a card reader connected to the computer, the card reader configured to read a card which may be a general or proprietary credit, debit or prepaid card. Using a proprietary card reader connected to the user's own computer with a proprietary card has the advantage of greater ability to prevent fraud.
[0075] When a virtual product is purchased from the virtual store by a user, the corresponding physical product may be obtained by having it delivered to the user or by the user picking it up from the physical store.
[0076] In some embodiments, the method further comprises use of a proprietary payment system for purchases of products from the virtual stores. The proprietary payment system comprises a prepaid card, a credit card or a debit card. In some embodiments, the proprietary payment system is associated with the affiliate network. In some embodiments, the proprietary payment system is associated with the primary store of the affiliate network.
[0077] The proprietary payment system may use appropriate security and authentication means for conducting transactions such as smart chips, pin, passwords, biometric identification and the like. A worker skilled in the art will be familiar with suitable systems for conducting secure transactions. Appropriate encryption protocols may additionally be used to ensure privacy and security of information being transferred.
[0078] In some embodiments, the proprietary payment system and card may be associated with a loyalty program as will be readily understood by a worker skilled in the art. In some embodiments, the proprietary payment system and card may be used for sales and marketing data. For example, data related to purchases made using the proprietary card and system such as number of items purchased, purchase time of day, manufacturer brand and the like may be tracked. [0079] In some embodiments, the proprietary payment method may be implemented using a payment system comprising a proprietary card reader communicatively linked with the user's computer. The proprietary card reader may be purchased or rented by the user. In some embodiments, the proprietary card reader may be included as part of the membership fees associated affiliate network membership.
Sales Agents/In-Store Representatives
[0080] In some embodiments, the virtual shopping system and/or virtual store further enables a user to interact with a sales agent/in-store representative. In some embodiments, the sales agents are specifically dedicated for on-line users. The sales agents may be located substantially anywhere, for example, at a call center. In some embodiments, the sales agents that respond to online inquiries may be the sales agents that are present in the physical store associated with the virtual replica that the online users are viewing.
[0081] Upon request by a user, exemplarily by clicking a button specifically provided for the purpose, a sales agent may appear on the display screen. In some embodiments, the sales agent may additionally be able to see and hear the user in order to have a live video interactive chat. The sales agent may be able to answer the user's questions, recommend and perform demonstrations of products. In some embodiments, if a user chooses to purchase a product, the sales agent may be enabled to finalize the sales by accepting payment and enabling the user to obtain the product in the manner specified by the user.
Projections of Products in User's Location
[0082] In some embodiments, the system further comprises a means for projecting an image of one or more products into the user' s location. In some embodiments the image can be an image, such as a two-dimensional image projected onto a surface such as a wall, mannequin, model, or the like. The projected image may further be life-sized. In some embodiments the image can be a three-dimensional or two-dimensional holographic image. Alternatively the image may be non-holographic. Various projection means may be used as would be readily understood to a worker skilled in the art. In some embodiments, a projected image generating device, such as a hologram generating device, communicatively linked to the customer's computer is accordingly provided to enable the projection. The projection of a product may be in its actual size, dimensions and optionally colour and/or other features thereof which can be recreated using the projection. For example, a user wishing to purchase a couch may choose to have it be holographically or non-holographically projected into his living room to determine whether it would be a good fit. Projected images may be static images or moving images. A non-holographic image projector may utilize technology similar to that of known video projectors, television or movie projectors, digital slide projectors, handheld projectors, or the like. In some embodiments, the projected image generating device may optionally be configured to produce a scent related to one or more virtual products.
[0083] In this manner for example, the online customer is presented with a projected, for example holographic, image of a product which is substantially realistic, thereby providing the online customer with a substantially realistic shopping experience. In addition, through the interaction with projected images, an online customer can determine the acceptability of a product without the need for bringing the product home, thereby potentially making the shopping experience more efficient for the online customer, as well as potentially more cost effective for the store owner.
[0084] For example, a customer may use a projected image generating device to project clothing onto a wall, onto a mannequin, onto a projection area incorporated with one or more mirrors allowing the customer to see parts of themselves, or even onto a person such as the customer themselves. A customer may use a projected image generating device to project pieces of furniture into parts of a room to see how they will look.
[0085] In some embodiments, the projected image generating device is built in to the user's computer or provided as a peripheral device configured for operative coupling to the computer. In some embodiments, the projected image generating device is a stand-alone device also incorporating other networking, computing and user-interface components for enabling the online virtual shopping experience. In some embodiments, the projected image generating device is a mobile handheld projector, for example incorporated into a standalone handheld device, cell phone, smartphone, PDA, tablet, digital camera, handheld gaming system, or other handheld device. A user may send images to their mobile handheld projector for displaying on an appropriate surface, for evaluating the product.
[0086] In some embodiments, a handheld projector may be a pico-projector utilizing lasers, LEDs, and/or mirrors, or the like. As an illustrative example, the Samsung™ i8520 "Galaxy Beam™" smartphone incorporates a built-in image projector for projecting images up to 1,300 mm in size. Such a projector may be sufficient for projecting small items in accordance with the present technology. It is contemplated that projectors capable of projecting onto larger areas may be used in accordance with the present technology for presenting larger items. This may require greater projector resolution than the Samsung™ i8520, and possibly require the projector to be placed at a sufficient distance from the projection surface. Plural projectors may be used in parallel to create larger images.
[0087] In one embodiment, to present an image which is larger than the maximum size the handheld projector is capable of presenting, a mobile handheld projector may comprise one or more motion sensors operatively coupled to the image projection components, such that, when the handheld projector is pointed in various directions, the projected image is varied accordingly. Hence, different parts of a large image may be projected at different times. For example, for an image of a table projected on a wall, the user may point the handheld projector at the lower left corner of the wall to see the lower left corner of the table, and move the handheld projector upward and across to trace out the remainder of the table image presented in its real size. Zooming in on details, projecting different sides of an object, and the like, may similarly be enabled by moving the handheld projector accordingly.
Virtual Store Location
[0088] In some embodiments, presenting a virtual store location to an online user or customer comprises the presentation of one or more virtual stores in their physical context and surroundings. The virtual store location is a virtual replica of the exterior context and surroundings of a physical store. Examples of context or surroundings where a physical store may be situated can include street, mall, parking lot, plaza, square, cars, pedestrians, shoppers entering and leaving the physical store and the like.
[0089] In some embodiments, a plurality of physical stores may be located in the same context such as a street or mall. One or more of the physical stores in the same location can be participating stores. In some embodiments, a virtual store location may comprise one or more virtual stores.
[0090] In some embodiments, the arrangement of the virtual stores in virtual store location is indicative of the arrangement of the physical stores in the physical location. A user may browse the virtual store location in the same manner that a person would browse the physical location of the physical store. A user may perform operations such as zooming in and out and moving in different directions while browsing the virtual store location.
[0091] In some embodiments, the virtual representation of the stores in the virtual store location may be indicative of them being a participating store. As an example, the virtual representations of participating stores in the virtual representation of the store location may be highlighted to indicate their inclusion in the virtual shopping system, and thus could be virtually entered by the online customer.
[0092] In the virtual representation of the store location, the virtual representations of the stores (virtual store objects) may be selectable, for example, by moving the mouse to place the cursor on the object and double-clicking. A worker skilled in the art will be familiar with suitable techniques for making a virtual object selectable or responsive to user action. A worker skilled in the art will also be familiar with suitable techniques for enabling selection by a user.
[0093] In some embodiments, a virtual store object may be selectable as it represents a participating store. For example, the participating stores may be represented as virtual store objects that are selectable by a user browsing the virtual street, exemplarily by placing the cursor on the object and clicking, while the non participating stores identified in the image may be represented as unselectable or inactive objects. FIG. 6 is an exemplary illustration of a virtual store location in accordance with some embodiments of the present technology. The virtual store location 300 shows a street 310 having a plurality of stores 320, wherein some of the stores 330 are participating stores.
[0094] In some embodiments, a user browsing a virtual store location may enter the store upon selecting the virtual store, exemplarily by double-clicking on the virtual store representation in the virtual store location. Upon a user's selects a virtual store object, the virtual representation of the store location (i.e. exterior context and surroundings of the store) evolves to a representation of the store (i.e. interior of the virtual store) selected, thereby simulating the experience of entering the store selected.
[0095] In some embodiments, a virtual store location may be indicative of the real-time activity in the vicinity of the physical store. For example, the virtual representation of the physical store location may comprise real-time images of activity in the vicinity of the physical store. Exemplarily, activity such as vehicle traffic, pedestrian traffic and the like that would be visible to a person present in the vicinity of the physical store at that time, which in some embodiments can be captured by one or more cameras positioned in the vicinity of the physical store.
[0096] In some embodiments, the virtual store location displayed is based at least in part on searches performed by a user. For example, when a user performs a search for a particular product, the virtual store location of a store where the searched product is available is displayed. When a searched product is available in a plurality of stores in a particular location, the virtual store location displayed comprises a plurality of virtual stores where the searched product is available. The virtual store representations may be indicative of availability of the searched product, for example, by highlighting in a different colour.
Administration Panel
[0097] In some embodiments, an administration panel is provided to enable association of virtual products and virtual product presentation devices. In some embodiments, an administration panel is operatively linked to the database, for example the participating store server module, to enable association of the virtual products with the virtual presentation device for that particular participating store and/or the master server module, to enable the administration panel to perform searching of the database associated with the master server module. The administration panel may be a user interface such as a graphical user interface configured to receive user input related to virtual store configuration and in response generate control signals to perform operations on the virtual store related to said configuration, wherein these inputs are provided by participating store personnel.
[0098] In some embodiments, the administration panel further enables tracking of inventory in the virtual store, physical store or both. The administration panel may require authorization to operate. For example, only a store manager or an authorized representative of the store manager may be allowed access to the administration panel.
[0099] According to embodiment of the present technology, the administration panel provides a store operator of a participating store, the ability to create the overall setup of their associated virtual replica participating store, which is what would be seen by an online customer. The administration panel can also provide the store owner or employee with the ability to search both their associated participating store server module for products and optionally search the master server module for products which are available in other participating stores. In some embodiments, the searching ability of the master server module which is provided to a particular store owner may be limited to products which are carried by affiliate stores, namely a subset of the participating stores which are so linked as to "refer" customers there between based on some form of reciprocal relationship.
[00100] For example, as illustrated in FIG. 7 the administration panel includes a live feed OFF and ON button 500, wherein this action will determine what an online user will see when walking into that online participating store, for example, live feed ON will provide live traffic for the online user, namely an integration of substantially real time video of the physical store into the presentation and live feed OFF will present to the online customer a special arrangement of aisles and inventory that does not mimic the physical store. For example, the live feed OFF and ON can be a button to turn ON the live feed if the store fixtures are arranged in a similar fashion like the physical store, or turned OFF if a store owner, manager or the like, desires a trial of a different arrangement that does not match the physical store.
[00101] The generated virtual objects associated with the products and aisles and shelves and other presentation devices will be displayed on the administration panel in the inventory/ails section 501 which can provide a store owner or manager to select and drag the virtual object into the store section 502 or out of the store section 502, thereby providing a means for the organization of the virtual store layout that will be visible to the online customer. For example, the inventory/ails section 501 of the administration panel includes each of the virtual replicas creating, for example products, aisles, shelves and other fixtures. The inventory/ails section 501 provides a store owner or manager the ability to select one or more of the virtual replicas for insertion into the store section 502, thereby creating the setup of the virtual store.
[00102] According to embodiments, the administration panel can be configured to make the arrangement and inventory or product placement as realistic as possible for store owners/staff, this tool enables a store owner, manager or other store staff member to place the inventory on the aisles, navigate through the store in the store section 502, drag the inventory from inventory/ails section 501 and place it on the virtual presentation devices, for example digitized shelves. [00103] In some embodiments, when an item or product is displayed on the inventory/ails section 501 the store owner or manager or designated staff can identify the quantity of available inventory for a particular product or item. Store staff might chose to have less numbers of that item to be sold online and more stock in the store. For example, when an item is out of stock in the virtual store, based on the number entered under the item, the item will automatically disappear or be dimmed on the display with an out of stock message. This will also display a message and dim all items that are out of stock in the inventory/ails section 501. In some embodiments, an inventory summary can be implemented for inventory tracking in the administration panel for the virtual store online and the physical store.
[00104] According to embodiments of the present technology, the store section 502 will provide a means for a full view of the store aisles, shelves and the like with the zero, some or all inventory positioned thereon, and store staff can zoom, rotate and/or translate the view to navigate to all parts of the store and view all aisles shelves etc, thereby enabling the store staff to fit or adjust the inventory of products into the virtual store.
[00105] In some embodiments, aisles and sections of the virtual store can be named or in some cases the name of certain sections at the store, for example a section may be named electronics will be displayed to online users and directions to that section may be associated with that name. According to embodiments, the administration panel further provides a means for the editing of these sections names and directions, should they change or the store staff desire a modification thereof. For example, if the store staff decide to change the name of a section from electronics to Electronic devices, this change made via the administration panel will change in real time such that the online users at that virtual store will see this change, should they be in that section of the store. In some embodiments, the administration panel can provide a means for store staff to put directions and signs leading to certain areas in the store, wherein these directions will appear or disappear in real time for an online customer entering the virtual store.
[0100] According to embodiments of the present technology, when an online customer requests the assistance of a sales representative, the assigned sales representative can be provided with access to the administration panel, which can be configured to present to the sales representative information relating to the requesting online customer, for example where the customer is looking, what product is being viewed, what products are in the customer shopping cart etc. In this manner, the administration panel provides the sales representative with details relating to the requesting customer which can enhance the process of explaining a certain product, and can also provide the sales representative with the ability to sell or recommend another product the customer desire or be looking for.
[0101] According to embodiments of the present technology, sales staff or other store staff can use the administration panel to search for a product that is not held by that particular store. In this instance, the sales staff can access the affiliate store search area of the administration panel 503, in order to get a list of affiliate stores 504 that may have the product and thereby be able to make a referral to the customer for where a product may be found. This additional feature can provide a shopping experience that is interactive.
Search Feature
[0102] According to embodiments of the present technology, the virtual shopping system can provide one or more searching options, which can be dependent on who wishes to perform the searching. For example, an online customer can be provided with the ability to search for products in a particular participating store, or can be provided with the ability to search for a particular product without a store limitation. In some embodiments, a customer can be provided with the ability to search for particular types of stores which may be associated with the virtual shopping system. According to embodiments, if the desired search is for a product at a particular virtual store, this searching ability can be provided by the associated particular store server module or alternately provided by the master server module, wherein which server module performs the functionality may be determined by "where" the customer is, for example in the virtual store. In addition, should the search be solely a product search without a store limitation, this search will be performed by the master server module.
[0103] In some embodiment, the search may be related to one or more products, one or more stores or both. Accordingly, a search feature and functionality may be provided. A user may perform a search by entering text into a search box provided on the screen. For example, a user may conduct a search for a particular product such as olive oil from a particular producer. In response to the search terms input, the user may be presented with a list of virtual stores where the product is available and can select from the list to be taken to the selected virtual store for browsing and optionally purchasing. Alternately, the user may be automatically redirected to the virtual store where the searched product is available. In some embodiments, the user may be redirected to the particular presentation device in the virtual store associated with the searched product.
[0104] According to embodiment of the present technology, the database and search engine associated with the master server module, can provide a means for searching for any item scanned at any of the participating stores, as this information is stored in a master database. This information will be accessed by the search engine to serve affiliate searches or users searching for particular products and don't have knowledge of the store address that carries that item. According to some embodiments, the search engine will also detect the client's address or location based on an IP address for example, and this will eliminate displaying certain participating stores around that world where shipping to the client's address is not possible. A user can also search for locations and participating malls or streets.
[0105] According to embodiments of the present technology, which a customer is searching for a product, the search engine can be configured to display the pricing of the product in a variety of the identified participating store. This feature can provide the customer with the ability to search for the lowest price and also results in the store owners to be competitive in the pricing of their products.
Affiliate Network
[0106] According to embodiments of the present technology, the virtual shopping system further includes a designation of affiliate stores, namely an affiliate network, wherein the affiliate stores are a subset of the participating stores, however the affiliate stores can recommend one another for a purchase should the recommending store not have the product in store. For example, for affiliate and referrals, all participating stores can choose to subscribe to this affiliate network that will enable the affiliate store search feature 503, 504 in their administration panel. An affiliate store can search for other products to refer clients or customers to other stores in the event the specific store does not hold the product being requested. The customer can go to the referred store and in the event a purchase takes place, the referring store will receive some revenue sharing.
[0107] According to embodiments, when a client is referred to an affiliate store that is presented on a street set up, participant stores will show as previously discussed above, and the referred-to store will be highlighted in a different color or manner to identify it from the other participating stores. This identification of the recommended affiliate store can help competition and result in competitive honest online pricing.
[0108] Customers or users at a virtual store of an affiliate network may be sent to another affiliate virtual store of the affiliate network when a product is not available at the first virtual store. In some embodiments, a user may be able to search the entire affiliate network for a particular product. If the product is available at more than one affiliate store, the user may choose to shop at or browse any one of the stores.
[0109] In some embodiments, one or more stores may be recommended to a user or customer. In some embodiments, one or more products may be recommended to a user. In some embodiments, the method further comprises keeping track of the traffic within the affiliate network. Traffic from one store to another is tracked. In some embodiments, the traffic log is used to calculate compensation to various entities, for example the recommending store.
User Experience
[0110] The following discussion relates to an example of a user's interaction with a virtual store, namely a participating store, in accordance with embodiments of the present technology. A worker skilled in the art would readily understand that several modifications that are possible, which can be based on the products being selected or other criteria, for example. Accordingly, this example can be modified in many ways and is not to be considered limiting in any way.
Entering the Store
[0111] According to embodiments, in order to make the interaction substantially "realistic", when an online customer or customer enters the universal resource locator (URL) of a participating store into a web browser, the home page associated therewith can be an image of the actual store-front. The store sign, doors promotions on the windows, dummies, for example, can be the same as the physical store associated therewith. Alternately the image displayed for the store front can depend on the store owner preferences, as the store owner may wish to try different store front layouts on his online virtual store for testing or promotional purposes. A customer moves the mouse, pad or other control device to open the door of the store and walk in. In some embodiments, the customer can see the real time traffic entering and leaving the store for example. Upon entry into the store, the customer can navigate through a mouse pad or other control device turn left/right look at the aisles. In some embodiments, during this exploration process of the store, the online users will see shoppers who are in the real store, which is being virtually represented to the customer. In this regard, for example, a customer may have to wait to examine certain products in instances where another physical user is standing in front of the item of interest, as is similar to being in a real life situation. In some embodiments, in order to make the products and specifically small products visual presentable; section names can be displayed to simplify navigation. In addition, zoom features will be implemented such that a customer can pick up a product, ask to speak to a sales representative, or complete shopping transaction and pay at the cashier. In embodiments, a user can open cabinets and interact with other accessible fixtures at a store, where these cabinets or other accessible fixtures have been virtualized for presentation to the customer. In embodiments, during this shopping experience a customer can selectively ask to speak to a customer care counter to return an item or get a return mailing address for shipping back a previously purchased product back.
[0112] In some embodiments, one mode of navigation through the store requires that, from a first location, a user may only navigate to immediately adjacent locations. Thus, in order to navigate to a desired location, the user may have to pass through and view several intermediate locations. This presents the user with further opportunities to view products, sale prices, and the like. This also mimics a physical shopping experience. In some embodiments, users may also be allowed to "jump" to distant locations, although in other embodiments this option may not be available to at least a predetermined class of users.
Product Selection
[0113] In embodiments, during the shopping experience, when a customer selects a product for further viewing, the product can be rotated zoomed in, displaying all the information on the bottom of the screen or through pop ups. In some embodiments, if a product can not be physically picked up in real life, for example a TV, couch or a product over a certain predetermined weight, this pick up feature can be deactivated thereby further mimicking real life shopping in the virtual world. In some embodiments, another feature integrated into the viewing of a selected product, will be an "out of box" selection, wherein a customer can take the product out of its packaging and see it in a separate popup window with all the information. In some embodiments, for example in the case of clothing, a client can pick up a clothing product and selectively move to a virtual dressing area as will be explained further below.
Sales Representative and Customer Service
[0114] In some embodiments, if a customer selects to speak to a sales agent, a popup window will show a live feed of a sales agent. In some embodiments, this sales agent will have access to the store administration panel and can see where the virtual customer is located in the store, for example what aisle and what products the customer might be looking at. In this manner, the virtually provided sales agent can explain promotions or identify alternative products or further details on the product selected. In some embodiments, if the sales agent needs to refer the customer to another store, the sales agent can use the search criteria in the administration panel. Alternately, the searching criteria can be used for identifying prices for the same at other stores. This sales agent can also be configured to accept payments. For example, this virtual sales agent can be configured to perform each task that a sales agent can do in a real life situation.
[0115] In some embodiments, if a customer comes to the participating store to return an item, the customer can speak to a customer service representative at the store to get a return mailing address in order to ship the merchandise back to the physical store. In some embodiments, customer service agents can be located at a call center which services a plurality of the participating stores, or the customer service agents can be located in specific sections or at specific counters in the physical store.
[0116] According to embodiments of the present technology, the online customer is provided with an interaction with sales representative or customer service representative which is substantially realistic relative to what typically occurs in a physical store, thereby providing the online customer with a substantially realistic shopping experience.
Product Presentation to Customer
[0117] In embodiments of the present technology, a customer can see the product online, rotate pick up speak to sales rep etc. In some embodiments, the system includes a projection system which enables the product to be created in a "projected virtual version" such as a "holographic version" for the customer. This technique can provide the customer with the power of visualizing the size of the item. For example, for a predetermined 42 inch. TV or other product, a customer can project it on their wall or choose to have two projections of a TV stand and the TV on it, thereby providing the customer with a means for evaluating the applicability of the product being viewed without the need for the product to be physically delivered to the customer. For furniture for example, a user can visualize the color on the computer screen and project that product at the desired location in the house to determine if it fits, for example. In some embodiments, participant stores may choose a special online scent that can be integrated in the projection equipment, thereby further enhancing the shopping experience.
Clothing Selection for Viewing
[0118] In some embodiments, wherein the products being viewed are clothing, the virtual representation of the products can be configured such that the clothes which are displayed as being hung on a clothes rail can be moved along the clothes rail in order and view a portion of the design of the clothing, which can be considered substantially the same as in real life and similar to the way its done in a physical store. When the set up of the aisles at a store is completed for a clothing section, the section of the virtual store can be configured such that a portion of the clothing, for example a quarter or a certain portion, is presented to the online customer which will enable a peek at the item and if a customer is interested in the full view, another click on the mouse or other controlling device will pull the item for further examination and projection, if desired.
Clothing Sizing
[0119] According to embodiments, shopping for clothes can be done by a customer virtually walking into the dressing area at the store, and upon this selection the screen of the customer's computing device can be converted into an environment that can make suggestions based on the products, for example clothes that the customer has selected, the customer's input based on height and/or weight. In some embodiments, the system can include a size capturing system which can detect the customer's profile for example. In some embodiments, using the projection system can enable the customer to substantially fit the clothing, through interaction with the projected image, and this interaction can be captured by a camera, for example on the customer's computer, for display on the screen of the customer's computer.
Payment [0120] In some embodiments, the method further comprises use of a proprietary payment system for purchases of products from the virtual stores. The proprietary payment system comprises a prepaid card, a credit card or a debit card. In some embodiments, the proprietary payment method may be implemented using a payment system comprising a proprietary card reader communicatively linked with the user's computer. The proprietary card reader may be purchased or rented by the user. In some embodiments, the proprietary card reader may be included as part of the membership fees associated affiliate network membership.
Leaving the Store
[0121] In embodiments, upon leaving the virtual store, the customer can see displayed on the screen a street view or mall view associated with that store. In embodiments, this street view or mall view can be exactly what a customer would see upon leaving the physical store associated with the virtual store.
[0122] For example, upon leaving the virtual store, an online customer will be presented with an external view of the street outside the physical store. In this view, should there be other participating stores in this area, these participating stores can be identified to the online customer, for example by highlight the appropriate store fronts, wherein the online customer would be provided with the ability to subsequently enter another participating store, in the similar manner to the entry as defined above. In this way the online customer is essentially provided with a substantially realistic shopping experience, namely almost as "if they were there".
Virtual Store as Trial for a Physical Store
[0123] In some embodiments, a virtual store may be used as a trial for introducing new products in the physical store. Accordingly, virtual replicas of one or more products that are not offered for sale in the physical store (non-inventory products) may be included in the virtual store. Sales of these non-inventory product may be tracked to determine whether or not they may be introduced in the physical store.
[0124] In some embodiments, the configuration or arrangement of a virtual store may be modified as a trial for a rearrangement or reconfiguration of the corresponding physical store. [0125] The method and system described herein may be implemented using one or more computers. A computer, as used herein, can be one of a variety of electronic devices such as a personal computer, laptop, tablet computer, PDA and the like as will be readily understood by a worker skilled in the art. The computer may be a substantially stationary device or it may be a mobile device.
[0126] The computer comprises a microprocessor (or simply a "processor") and operatively associated memory module (in the form of RAM or flash memory or both), to enable a variety of device functions and to execute an operating system for running software applications loaded on the device. A memory module may be configured to store an operating system comprising information and executable code that enables the accessory to perform a set of functions. Operating systems may include software, firmware, and other information for enabling a variety of functions on the computer and other connected external devices. In some embodiments, in addition to the operating system, the computer may additionally comprise one or more software applications, stored on one or more memory modules, configured to perform functions or tasks as will be readily understood by a worker skilled in the art. Exemplarily, the applications include web-browsing applications such as Firefox™, word processing applications such as Microsoft Word™ and the like. In some embodiments, one or more of the memory modules may also be a mass storage memory module for storing data and configured for read/write operations.
[0127] The computer further comprises electronic components that enable connection to one or more other electronic devices and to a communication network. The computer also comprises a visual display unit and an input module such as a keyboard and mouse. The computer further comprises one or more input/output devices or user interfaces (UI's). The computer may include one or more of the following: a display (e.g. a LCD screen), a thumbwheel and/or trackball, a keyboard, a touch screen, a keypad, a button, a speaker, microphone, a still camera and a video camera.
[0128] According to embodiment of the present technology, the communication between the master server module and the plurality of participating store server modules can be performed over a closed communication network. In some embodiments, the communication is performed over a public communication network, wherein the communications are provided with a level of security, for example communications can be encrypted. Master Server Module
[0129] The master server module comprises one or more processing modules for performing the one or more tasks assigned thereto, a communication module for communicatively coupling, when required, the master server module to a customer computing device and/or one or more of the plurality of participating store server modules. The master server module further comprises a storage module which can include one or more data storage devices configured for storing data representative of the products available in substantially any of the participating stores. The data contained on the master server module storage module can also be representative of products that were available at one or more of the participating stores but are subsequently discontinued. In this manner, the storage module substantially maintains a substantially complete list of all products. The storage module can further contain data relating to each of the participating store, for example location, if it is an affiliate store or the like. In general, the master server module is configured to provide information connectivity which is required between the plurality of participating store server modules to enable the functionality of the virtual shopping system.
[0130] In addition, the storage module of the master server module, in association with the one or more processing module thereof can be configured in a manner to enable searching of the stored data, for example for product searching by one or more participating store owners or an online customer or both, other search queries relating to participating stores or affiliate stores or the like. In some embodiments, the master server module further comprises one or more output devices and one or more input devices, for example for interaction with a user thereof. In some embodiments, interaction with the master server module can be provided by an appropriately configured communication network and associated software applications operating on the master server module and the computing device communicating therewith.
Participating Store Server Module
[0131] The participating store server module comprises a processing module for performing the one or more tasks assigned thereto, a communication module for communicatively coupling, when required, the participating store server module to a customer computing device and/or the master server module, and a storage module configured for storing data representative of the products available in the associated virtual store, and optionally both the physical store and the virtual store. The storage module is further configured for storing data representative of the virtual store, for example product positioning and layout and the like. The storage module in association with the processing module can be configured in a manner to enable searching of the stored data, for example for virtual store creation, or product searching by a store owner or an online customer or both. The participating store server module further comprises one or more output devices and one or more input devices, for example for interaction with a user.
[0132] The participating store server module is configured to collect and manage data relating to products associated with the participating store associated therewith. The participating store server module is further configured to generate a virtual replica of the associated physical store for subsequent presentation to a customer upon request. The participating store server module, further comprises a means
[0133] The processing module may be operatively coupled to one or more memory or storage modules configured to store information and instructions, the instructions being executable by the processing module and when executed configured to perform the following: obtaining product images of one or more products in the product inventory of the physical store; obtaining store images of the physical store void of the product inventory, said store images including a plurality of product presentation devices processing the captured product images and store images to generate one or more virtual products and a plurality of virtual product presentation devices; associating each of the one or more virtual products with a particular virtual product presentation device thereby generating the virtual store; presenting the virtual store to the user; receiving input from the user, said input based at least in part on the user's interaction with the virtual store; and generating one or more control signals configured to enable the user to browse the virtual store, the control signals at least in part based on the received input from the user. Customer Computing Device
[0134] FIG. 8 is a block diagram of an example customer computing device in accordance with some embodiments of the present technology. The system comprises a display module 410, a processing module 420, and a communication module 430.
[0135] The display module 410 is configured for displaying images to enable presentation of the virtual store. Examples of display modules include devices with screen such as an LCD screen, a plasma screen, a touchscreen, projection screen and the like. The display module is capable of displaying real-time images. In some embodiments, the display module may be further configured to receive input for a user (for example, a touchscreen). The display module may comprise other input/output modules such as speakers, microphones, light sensors, and the like.
[0136] The customer computing device further comprises a communication module 430 to enable communication with one or more remote servers and databases, for example one or more participating store server modules and the master server module. The communication may be via a wired or wireless channel. The communication may be via any long-range or short range communication. For example, the communication module may comprise an RF transceiver for communication with one or more remote servers and databases via a base station of an RF network using RF communication. Alternatively, the communication may be using a short-range communication protocol such as Wi-Fi to communicate with a local router and thereby to one or more remote servers and databases. Examples of short-range communication include Bluetooth, Wi-Fi, Near Field Channel (NFC), USB and the like.
[0137] The customer computing device further comprises a processing module 420 operatively linked to the display module and the communication module. The processing module is configured to coordinate and control the functioning of the various other modules. For example, the
[0138] In some embodiments, the customer computing device further comprises a hologram generating module configured to receive one or more input images and output one or more holographic projections based on the input images. The hologram generating module may further comprise a scent module configured to release one or more scents. The scents may be related to the holographic projection. A non-holographic projected image generating module may be used in place of a hologram generating module. [0139] In some embodiments, the customer computing device further comprises a card reader module configured to read coded information in a proprietary card and optionally write information to the card. The information may be coded and enabled for reading and writing using any suitable technology such as optical, magnetic, infrared, and the like.
[0140] FIG. 9 illustrates a system for presenting a virtual store based on acquired images of a physical store, in accordance with embodiments of the present technology. The system comprises one or more image capture devices 910 such as cameras configured to acquire images of at least a physical store 912 and products 914 to be sold by the virtual store (and optionally also by the physical store). Images of product presentation devices, such as store shelves 916, may also be acquired. The image capture devices 910 may provide a stream of real-time images, a set of previously recorded images, or a combination thereof. Previously recorded images, such as images of products, images of empty product presentation devices, and images of empty physical store aisles, may be recorded in one or more appropriate databases, depicted in FIG. 9 as a virtual product database 920, a product presentation device database 922, and a store image database 924. An inventory database 926 may be provided, which is configured to track information regarding availability of different products for sale within the store, a number of copies of each product available for sale, optionally along with pricing information, location information, information regarding availability at an affiliate store, and the like.
[0141] The system comprises a virtual replica generation module 930, operatively coupled to the image capture devices 910 and the databases 920, 922 and 924 and configured to receive various images therefrom. The virtual replica generation module is further operatively coupled to the inventory database 926 and configured to receive inventory information therefrom. The virtual replica generation module is configured to integrate various received images, in a manner dependent on the inventory information, so as to generate interactive images to be presented to a user. The interactive images are configured so as to present to the user a virtual replica of the physical store 912, as described herein. The system further comprises an interface module 935, such as a web server, which facilitates access to the virtual replica, for example via user equipment 940 such as a laptop, via a master server module 945, or the like. The user equipment 940 may connect to the interface module 935 via an Internet connection, for example. The user equipment 940 comprises a user interface 942, via which the user can interact with the virtual replica. The user equipment further comprises a visual display 944 via which the user can view images generated and selectively presented by the virtual replica generation module.
[0142] It is obvious that the foregoing embodiments of the invention are examples and can be varied in many ways. Such present or future variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims.

Claims

WHAT IS CLAIMED IS:
1. A system for creating a virtual shopping experience for a user, said virtual shopping experience commensurate with a real-life shopping experience, the system comprising: a plurality of participating store server modules, each participating store server module configured to collect and manage data relating to products associated with a particular participating store associated therewith, each participating store server module configured to present to a user a virtual replica of the particular participating store associated therewith, the virtual replica of the participating store configured for user interaction therewith, each participating server module further configured to receive input based at least in part on the user's interaction with the virtual replica of the participating store; and
a master server module communicatively coupled to each of the plurality of participating store server modules, the master server module configured to collect and manage data relating to products associated with the plurality of participating stores, the master server module configured for user interaction therewith and further configured to enable the user to search for one or more products and to direct the user to one or more of the plurality of participating stores based at least in part on the user interaction therewith.
2. The system of claim 1, wherein the virtual replica is created using one or more images of the particular participating store.
3. The system of claim 2, wherein the one or more images correspond to a digitized, real-time video feed of the particular participating store.
4. The system of claim 1, wherein the particular participating store is a physical store at a particular physical location.
5. The system of claim 1, wherein user interaction comprises interaction with one or more of: sales representatives, customer service representatives, and product displays.
6. The system of claim 1, wherein user interaction comprises navigating through the virtual replica in a manner corresponding to physical navigation of the participating store, encountering interactive objects at predetermined locations within the virtual replica, and interacting with the interactive objects.
7. The system of claim 2, wherein the virtual one or more images relate to one or both of: a storefront of the particular participating store and an immediate locale of the particular participating store.
8. The system of claim 1, further configured to generate one or more virtual products to be displayed within the virtual replica, the one or more virtual products generated using one or more product images obtained from associated products held in inventory of the particular physical store.
9. The system of claim 8, wherein at least a select virtual product, associated with a select product held in inventory of the particular physical store, is integrated with a corresponding virtual product presentation device so as to appear to be displayed thereon, the system further configured to: determine a number of instances of the select product held in inventory, and display a number of copies of the select virtual product on the virtual product presentation device, wherein the displayed number of copies is a function of the number of instances of the select product.
10. The system of claim 9, wherein the displayed number of copies is updated in real time.
11. The system of claim 1, further configured to display a virtual checkout within the virtual replica, wherein user interaction comprises purchasing products by navigating to and interacting with the virtual checkout.
12. The system of claim 1, further configured to provide a communication link between the user and a live agent, the communication link accessible upon navigation to a predetermined location of the virtual replica.
13. The system of claim 2, further configured to process one or more images to generate one or more corresponding virtual objects, each of the virtual objects corresponding to one or more of: a virtual product, a virtual product presentation device, and a store configuration.
14. The system of claim 2, further configured to process the one or more images to recognize one or more non-product objects currently within the particular participating store.
15. The system of claim 1, further comprising an administration panel configured to facilitate presentation of virtual products.
16. The system of claim 1, wherein directing the user to the one or more participating stores comprises: determining a recommending store associated with the user; determining one or more affiliate stores associated with the recommending store; searching the affiliate stores for the one or more products; and referring the user to one of the affiliate stores carrying the one or more products.
17. The system of claim 16, further configured to: track referrals between affiliate stores; and calculate compensation between affiliate stores based on said tracked referrals.
18. The system of claim 1, further comprising a projected image generating device configured for projecting an image of a selected product into a location of the user.
19. The system of claim 18, wherein a size of the projected image is substantially equal to a size of the selected product in at least two dimensions.
20. The system of claim 18, wherein the projected image generating device is a handheld projector.
21. The system of claim 20, wherein the handheld projector is incorporated into a standalone handheld device, cell phone, smartphone, PDA, tablet, digital camera, or handheld gaming system.
22. A method for creating a virtual shopping experience for a user, said virtual shopping experience commensurate with a real-life shopping experience, the method comprising the steps of:
providing a plurality of participating store server modules, each participating store server module collecting and managing data relating to products associated with a particular participating store associated therewith, each participating store server module presenting to a user a virtual replica of the particular participating store associated therewith wherein the virtual replica of the particular participating store enables user interaction therewith and each participating server module receiving input based at least in part on the user's interaction with the virtual replica of the particular participating store; and
providing a master server module communicatively coupled to each of the participating store server modules, the master server module collecting and managing data relating to products associated with at least one of the participating stores, the master server module enabling user interaction therewith and enabling a user to search for one or more products and directing the user to one or more of the participating stores based at least in part on the user interaction therewith.
23. The method of claim 22, wherein the virtual replica is created using one or more images of the particular participating store.
24. The method of claim 23, wherein the one or more images correspond to a digitized, real-time video feed of the particular participating store.
25. The method of claim 22, wherein the particular participating store is a physical store at a particular physical location.
26. The method of claim 22, wherein user interaction comprises interaction with one or more of: sales representatives, customer service representatives, and product displays.
27. The method of claim 22, wherein user interaction comprises navigating through the virtual replica in a manner corresponding to physical navigation of the participating store, encountering interactive objects at predetermined locations within the virtual replica, and interacting with the interactive objects.
28. The method of claim 23, wherein the virtual one or more images relate to one or both of: a storefront of the particular participating store and an immediate locale of the particular participating store.
29. The method of claim 22, further comprising generating one or more virtual products to be displayed within the virtual replica, the one or more virtual products generated using one or more product images obtained from associated products held in inventory of the particular physical store.
30. The method of claim 29, wherein at least a select virtual product, associated with a select product held in inventory of the particular physical store, is integrated with a corresponding virtual product presentation device so as to appear to be displayed thereon, the method further comprising determining a number of instances of the select product held in inventory, and displaying a number of copies of the select virtual product on the virtual product presentation device, wherein the displayed number of copies is a function of the number of instances of the select product.
31. The method of claim 30, wherein the displayed number of copies is updated in real time.
32. The method of claim 22, further comprising displaying a virtual checkout within the virtual replica, wherein user interaction comprises purchasing products by navigating to and interacting with the virtual checkout.
33. The method of claim 22, further comprising providing a communication link between the user and a live agent, the communication link accessible upon navigation to a predetermined location of the virtual replica.
34. The method of claim 23, further comprising processing one or more images to generate one or more corresponding virtual objects, each of the virtual objects corresponding to one or more of: a virtual product, a virtual product presentation device, and a store configuration.
35. The method of claim 23, further comprising processing the one or more images to recognize one or more non-product objects currently within the particular participating store.
36. The method of claim 22, further comprising providing an administration panel configured to facilitate presentation of virtual products.
37. The method of claim 22, wherein directing the user to the one or more participating stores comprises: determining a recommending store associated with the user; determining one or more affiliate stores associated with the recommending store; searching the affiliate stores for the one or more products; and referring the user to one of the affiliate stores carrying the one or more products.
38. The method of claim 37, further comprising tracking referrals between affiliate stores; and calculating compensation between affiliate stores based on said tracked referrals.
39. The method of claim 22, further comprising projecting an image of a selected product into a location of the user.
40. The method of claim 39, wherein a size of the projected image is substantially equal to a size of the selected product in at least two dimensions.
41. The method of claim 39, wherein the projected image is generated by a handheld projector.
42. The method of claim 41, wherein the handheld projector is incorporated into a standalone handheld device, cell phone, smartphone, PDA, tablet, digital camera, or handheld gaming system.
43. A method of presenting a virtual store and enabling a user to shop in the virtual store, the virtual store being a virtual replica of a physical store having a product inventory, the method comprising:
obtaining (110) product images of one or more products in the product inventory of the physical store;
obtaining (120) store images of the physical store void of the one or more products; processing (130) the obtained product images and store images to generate one or more virtual products and a plurality of virtual product presentation devices;
associating (140) each of the one or more virtual products with a particular virtual product presentation device;
integrating (150) the virtual product presentation devices, virtual products and store images, thereby generating the virtual store;
presenting (160) the virtual store to the user; receiving (170) input from the user, said input based at least in part on the user's interaction with the virtual store; and
generating (180) one or more control signals configured to enable the user to browse the virtual store, the control signals at least in part based on the received input from the user.
44. The method of claim 43, wherein the one or more images correspond to a digitized, real-time video feed of the particular participating store.
45. The method of claim 43, wherein the user's interaction comprises interaction with one or more of: a sales representative, a customer service representative, and a product display.
46. The method of claim 43, wherein the user's interaction comprises navigating through the virtual replica in a manner corresponding to physical navigation of the participating store, encountering interactive objects at predetermined locations within the virtual replica, and interacting with the interactive objects.
47. The method of claim 43, wherein the store images comprise one or more images relating to one or both of: a storefront of the particular participating store and an immediate locale of the particular participating store.
48. The method of claim 43, wherein presenting the virtual store comprises displaying one or more images which are modified based on the user's interaction.
49. The method of claim 48, the method further comprising determining a number of instances of a select product held in inventory, and displaying a number of copies of a corresponding select virtual product on the virtual product presentation device, wherein the displayed number of copies is a function of the number of instances of the select product.
50. The method of claim 49, wherein the displayed number of copies is updated in real time.
51. The method of claim 43, further comprising displaying a virtual checkout within the virtual store, wherein the user's interaction comprises purchasing products by navigating to and interacting with the virtual checkout.
52. The method of claim 43, further comprising providing a communication link between the user and a live agent, the communication link accessible upon navigation to a predetermined location of the virtual replica.
53. The method of claim 43, further comprising processing the store images to recognize one or more non-product objects currently within the particular participating store.
54. The method of claim 43, further comprising providing an administration panel configured to facilitate presentation of the virtual products.
55. The method of claim 43, wherein presenting the virtual store to the user further comprises projecting an image of a selected product into a location of the user.
56. The method of claim 55, wherein a size of the projected image is substantially equal to a size of the selected product in at least two dimensions.
57. The method of claim 55, wherein the projected image is generated by a handheld projector.
58. The method of claim 57, wherein the handheld projector is incorporated into a standalone handheld device, cell phone, smartphone, PDA, tablet, digital camera, or handheld gaming system.
59. A system for presenting a virtual store and enabling a user to shop in the virtual store, the virtual store being a virtual replica of a physical store and presented on a display accessible to the user, the system comprising:
a processing module; and
one or memory modules operatively coupled with said processing module and configured to store information and instructions, the instructions being executable by the processing module and when executed configured to perform the following:
obtaining product images of one or more products in the product inventory of the physical store;
obtaining store images of the physical store void of the one or more products; processing the captured product images and store images to generate one or more virtual products and a plurality of virtual product presentation devices; associating each of the one or more virtual products with a particular virtual product presentation device;
integrating the virtual product presentation devices, virtual products and store images, thereby generating the virtual store;
presenting the virtual store to the user;
receiving input from the user, said input based at least in part on the user's interaction with the virtual store; and
generating one or more control signals configured to enable the user to browse the virtual store, the control signals at least in part based on the received input from the user.
60. The system of claim 59, wherein the one or more images correspond to a digitized, real-time video feed of the particular participating store.
61. The system of claim 59, wherein the user's interaction comprises interaction with one or more of: a sales representative, a customer service representative, and a product display.
62. The system of claim 59, wherein the user's interaction comprises navigating through the virtual replica in a manner corresponding to physical navigation of the participating store, encountering interactive objects at predetermined locations within the virtual replica, and interacting with the interactive objects.
63. The system of claim 59, wherein the store images comprise one or more images relating to one or both of: a storefront of the particular participating store and an immediate locale of the particular participating store.
64. The system of claim 59, wherein presenting the virtual store comprises displaying one or more images which are modified based on the user's interaction.
65. The system of claim 64, the system further configured to: determine a number of instances of a select product held in inventory, and display a number of copies of a corresponding select virtual product on the virtual product presentation device, wherein the displayed number of copies is a function of the number of instances of the select product.
66. The system of claim 65, wherein the displayed number of copies is updated in real time.
67. The system of claim 59, further configured to display a virtual checkout within the virtual store, wherein the user's interaction comprises purchasing products by navigating to and interacting with the virtual checkout.
68. The system of claim 59, further configured to provide a communication link between the user and a live agent, the communication link accessible upon navigation to a predetermined location of the virtual replica.
69. The system of claim 59, further configured to process the store images to recognize one or more non-product objects currently within the particular participating store.
70. The system of claim 59, further comprising an administration panel configured to facilitate presentation of the virtual products.
71. The system of claim 59, further comprising a projected image generating device, wherein presenting the virtual store to the user further comprises projecting an image of a selected product into a location of the user via the projected image generating device.
72. The system of claim 71, wherein a size of the projected image is substantially equal to a size of the selected product in at least two dimensions.
73. The system of claim 71, wherein the projected image generating device is a handheld projector.
74. The system of claim 73, wherein the handheld projector is incorporated into a standalone handheld device, cell phone, smartphone, PDA, tablet, digital camera, or handheld gaming system.
PCT/CA2011/050764 2010-12-09 2011-12-09 Method and system for virtual shopping WO2012075589A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US42156310P 2010-12-09 2010-12-09
US61/421,563 2010-12-09

Publications (1)

Publication Number Publication Date
WO2012075589A1 true WO2012075589A1 (en) 2012-06-14

Family

ID=46206500

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2011/050764 WO2012075589A1 (en) 2010-12-09 2011-12-09 Method and system for virtual shopping

Country Status (1)

Country Link
WO (1) WO2012075589A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013192291A1 (en) * 2012-06-19 2013-12-27 Leo Burnett Company, Inc. Virtual reality promotional experience
WO2014071248A1 (en) 2012-11-02 2014-05-08 Nant Holdings Ip, Llc Virtual planogram management, systems and methods
WO2014112932A1 (en) * 2013-01-15 2014-07-24 Johansson Ulla Virtual trade environment
US20140214629A1 (en) * 2013-01-31 2014-07-31 Hewlett-Packard Development Company, L.P. Interaction in a virtual reality environment
EP2816520A1 (en) * 2013-06-17 2014-12-24 Spreadtrum Communications (Shanghai) Co., Ltd. A method for interchanging data between the three-demensional shopping platform and the external platform
US10600100B2 (en) 2016-09-07 2020-03-24 Walmart Apollo, Llc Apparatus and method for providing item interaction with a virtual store
CN111182278A (en) * 2018-11-09 2020-05-19 上海云绅智能科技有限公司 Projection display management method and system
US11079896B2 (en) 2015-12-29 2021-08-03 Emd Millipore Corporation Interactive system and method of instrumenting a bio-manufacturing process

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6026376A (en) * 1997-04-15 2000-02-15 Kenney; John A. Interactive electronic shopping system and method
WO2001086533A1 (en) * 2000-05-10 2001-11-15 Kim Sug Bae Electronic commerce system and method using live images of online shopping mall on the internet
WO2002005215A1 (en) * 2000-07-11 2002-01-17 Alberto Sollberger 3d virtual landscape database
US7574381B1 (en) * 1999-08-06 2009-08-11 Catherine Lin-Hendel System and method for constructing and displaying active virtual reality cyber malls, show rooms, galleries, stores, museums, and objects within

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6026376A (en) * 1997-04-15 2000-02-15 Kenney; John A. Interactive electronic shopping system and method
US7574381B1 (en) * 1999-08-06 2009-08-11 Catherine Lin-Hendel System and method for constructing and displaying active virtual reality cyber malls, show rooms, galleries, stores, museums, and objects within
WO2001086533A1 (en) * 2000-05-10 2001-11-15 Kim Sug Bae Electronic commerce system and method using live images of online shopping mall on the internet
WO2002005215A1 (en) * 2000-07-11 2002-01-17 Alberto Sollberger 3d virtual landscape database

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013192291A1 (en) * 2012-06-19 2013-12-27 Leo Burnett Company, Inc. Virtual reality promotional experience
US10762470B2 (en) 2012-11-02 2020-09-01 Nant Holdings Ip, Llc Virtual planogram management systems and methods
US10198712B2 (en) 2012-11-02 2019-02-05 Nant Holdings Ip, Llc Virtual planogram management systems and methods
US11887054B2 (en) 2012-11-02 2024-01-30 Nant Holdings Ip, Llc Virtual planogram management systems and methods
US11488104B2 (en) 2012-11-02 2022-11-01 Nant Holdings Ip, Llc Virtual planogram management systems and methods
US9336508B2 (en) 2012-11-02 2016-05-10 Patrick Soon-Shiong Virtual planogram management, systems, and methods
US9430752B2 (en) 2012-11-02 2016-08-30 Patrick Soon-Shiong Virtual planogram management, systems, and methods
WO2014071248A1 (en) 2012-11-02 2014-05-08 Nant Holdings Ip, Llc Virtual planogram management, systems and methods
US9953288B2 (en) 2012-11-02 2018-04-24 Nant Holdings Ip, Llc Virtual planogram management systems and methods
US9536218B2 (en) 2012-11-02 2017-01-03 Patrick Soon-Shiong Virtual planogram management systems and methods
WO2014112932A1 (en) * 2013-01-15 2014-07-24 Johansson Ulla Virtual trade environment
US20140214629A1 (en) * 2013-01-31 2014-07-31 Hewlett-Packard Development Company, L.P. Interaction in a virtual reality environment
EP2816520A1 (en) * 2013-06-17 2014-12-24 Spreadtrum Communications (Shanghai) Co., Ltd. A method for interchanging data between the three-demensional shopping platform and the external platform
US11079896B2 (en) 2015-12-29 2021-08-03 Emd Millipore Corporation Interactive system and method of instrumenting a bio-manufacturing process
US10600100B2 (en) 2016-09-07 2020-03-24 Walmart Apollo, Llc Apparatus and method for providing item interaction with a virtual store
CN111182278A (en) * 2018-11-09 2020-05-19 上海云绅智能科技有限公司 Projection display management method and system

Similar Documents

Publication Publication Date Title
JP6823023B2 (en) Virtual planogram management, systems and methods
WO2012075589A1 (en) Method and system for virtual shopping
US10559019B1 (en) System for centralized E-commerce overhaul
US11887183B2 (en) Systems and methods of sharing an augmented environment with a companion
US20140363059A1 (en) Retail customer service interaction system and method
CN109643527A (en) Virtual Reality Platform for retail environment emulation
US20100265311A1 (en) Apparatus, systems, and methods for a smart fixture
US20150307279A1 (en) Retail automation platform
CA2910661A1 (en) Method and system for identifying a property for purchase using image processing
KR20170067976A (en) Method, apparatus and computer program for managing shopping information
JP6867469B2 (en) Electronic devices, interactive information display methods and computer-readable recording media
KR20160008389A (en) System for searching goods of offline shops by online and method for processing thereof
US20180330393A1 (en) Method for easy accessibility to home design items
JP7201743B2 (en) Cloud type cyber mall system
US11238526B1 (en) Product display visualization in augmented reality platforms
WO2020099915A1 (en) Virtual mall system for shopping decoration equipment by applying augmented reality system and mixed reality
WO2015164652A1 (en) Improved retail automation platform
US20150006194A1 (en) Interactive circuit based on the use of devices with touch screen technology
US20210117913A1 (en) Systems and methods for presenting and dispensing products
KR20170095639A (en) Service unit of global regional information and utilize method for the service unit
CN111127166A (en) Picture-based purchasing system, method, medium, and apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11847416

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11847416

Country of ref document: EP

Kind code of ref document: A1