WO2017143402A1 - Networked system for facilitating a retail transaction - Google Patents

Networked system for facilitating a retail transaction Download PDF

Info

Publication number
WO2017143402A1
WO2017143402A1 PCT/AU2017/050163 AU2017050163W WO2017143402A1 WO 2017143402 A1 WO2017143402 A1 WO 2017143402A1 AU 2017050163 W AU2017050163 W AU 2017050163W WO 2017143402 A1 WO2017143402 A1 WO 2017143402A1
Authority
WO
WIPO (PCT)
Prior art keywords
customer
permission
database
image
retail transaction
Prior art date
Application number
PCT/AU2017/050163
Other languages
French (fr)
Inventor
Geoffrey David Cropley
Original Assignee
Noah Facial Recognition Pty Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2016900706A external-priority patent/AU2016900706A0/en
Application filed by Noah Facial Recognition Pty Ltd filed Critical Noah Facial Recognition Pty Ltd
Publication of WO2017143402A1 publication Critical patent/WO2017143402A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/30Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/322Aspects of commerce using mobile devices [M-devices]
    • G06Q20/3224Transactions dependent on location of M-devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/08Payment architectures
    • G06Q20/20Point-of-sale [POS] network systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/40Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401Transaction verification
    • G06Q20/4014Identity check for transactions
    • G06Q20/40145Biometric identity checks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/70Multimodal biometrics, e.g. combining information from different biometric modalities

Definitions

  • the present invention relates to a system, method, computer program and data signal for facilitating a retail transaction.
  • the invention relates to a system, method, computer program and data signal which improves the efficiency of the retail transaction.
  • POS Point of Sale
  • POS Point of Sale
  • POS Point of Sale
  • a device for executing a retail transaction can substantially delay a given transaction.
  • POS Point of Sale
  • a large volume of transactions need to be executed, all of which requiring the transaction parameters, such as food or beverages purchased, to be specified in the POS device and payment to be received. This can take a substantial amount of time, thereby limiting the number of transactions that can be executed and potentially causing significant customer dissatisfaction due to delays.
  • Previous attempts have been made to address this issue, such as by developing self- service Point of Sale kiosks. However, these require customers to possess a level of technical ability which, if not present, can cause delays and potential malfunction of the kiosk.
  • Salespeople in retail environments can benefit in a number of ways from recognition of potential customers. Recognition of a potential customer and the ability to address them by name, as well as being generally aware of their preferred purchase type within the specific retail environment, may be able to aid a salesperson in targeted marketing and an increased ability to close sales, thereby improving overall retail performance. This is achieved through improving the particular customer's experience within that retail environment, thereby improving the likelihood of the potential customer making additional purchases.
  • the invention provides a system for facilitating a retail transaction an imaging device for capturing images of a customer, a database containing customer profiles, each profile associating biometric features of a particular customer with that customer's identity and a defined retail transaction, a processor in communication with the imaging device and database and configured to execute image analysis software, and a Point of Sale device for executing the retail transaction and in communication with the processor, wherein upon receiving an image of the customer from the imaging device, the processor executes the image analysis software, causing the software to identify a customer within the image, identify the biometric features of that customer, consult the database and identify a customer profile containing biometric features corresponding with the customer within the image, and upon identifying the corresponding customer profile, the processor provides the Point of Sale device with details of the defined retail transaction from the database that corresponds with the customer profile.
  • the Point of Sale device is operated by a user, and upon provision of the details of the defined retail transaction to the Point of Sale device, the user is able to execute the defined retail transaction.
  • the database is a shop-level database that is assigned to a specific defined retail space and in communication with a central database via at least one communication network means wherein the customer profiles are stored in the central database, a permission-receiving means associated with the retail space and adapted to receive permission from the customer and have said received permission removed such that upon provision of permission by the customer to the permission-receiving means, a copy of the customer's associated customer profile is retrieved from the central database and stored within the shop-level database, thereby enabling it to be identified by the software, and upon removal of the received permission, the associated customer profile is removed from the shop-level database.
  • the system further comprises a customer- operated smart device in communication via at least one communication network with the permission-receiving means wherein the smart device is further adapted to provide or refuse permission to the permission-receiving means and to remove permission that has been provided.
  • removal of perm ission is induced by one or more of execution of a retail transaction associated with the customer who provided the permission, failure to capture an image of the customer by the imaging device within a defined period of time, and revocation by the customer.
  • the customer-operated smart device is further adapted to determine the proximity of the smart device to the defined retail space, and upon determining that the smart device has approached within a defined distance of the defined retail space, the smart device notifies the customer and provides the customer with the ability to provide or refuse permission to the permission-receiving means of the defined retail space.
  • the smart device upon determining that the customer has moved a specified distance away from the defined retail space following the provision of permission, transmits a removal of permission to the permission-receiving means.
  • a customer who does not have a customer profile associated with them is provided with the option to create their customer profile during execution of a retail transaction at the Point of Sale.
  • the customer may alter the defined retail transaction associated with their profile during execution of a retail transaction at the Point of Sale.
  • the invention provides a method for facilitating a retail transaction, comprising the steps of an imaging device capturing an image of a customer and providing the image to a processor, the processor, upon receiving an image of the customer from the imaging device, executing image analysis software, causing the software to identify a customer within the image, identify the biometric features of that customer, consult a database and identify a customer profile containing biometric features corresponding with the customer within the image and upon identifying the corresponding customer profile, the processor providing a Point of Sale device with details of the defined retail transaction from the database that corresponds with the customer profile.
  • the invention provides a computer program including at least one instruction, arranged to, when executed on a computing system, perform the method in accordance with the second aspect of the invention..
  • the invention provides a data signal encoding at least one computer readable instruction, arranged to, when executed on a computing system, perform the method in accordance with the second aspect of the invention.
  • Figure 1 is a diagram disclosing an example of a networked computing system utilised to facilitate a method for facilitating a transaction in accordance with the present invention
  • FIG. 2 is a diagram disclosing an example system in accordance with the present invention.
  • Figure 3 is a Flow Chart depicting an example of method steps actioned by the system embodied in Figure 2;
  • Figure 4 is a diagram disclosing an example of a networked system in accordance with of the present invention.
  • Figure 5 is a Flow Chart depicting an example of method steps actioned by the system embodied in Figure 4.
  • the present invention in one embodiment, relates generally to a system for facilitating a retail transaction.
  • the system generally comprises an imaging device for capturing images of a customer, including a database containing customer profiles. Each profile associates biometric features of a particular customer with that customer's identity and an associated commercial characteristic, such as a retail transaction.
  • the embodiment includes a processor in communication with the imaging device and database and configured to execute image analysis software and a salesperson-operated display, such as a Point of Sale device for executing the retail transaction and in communication with the processor wherein upon receiving an image of the customer from the imaging device, the processor executes the image analysis software, causing the software to identify a customer within the image, identify the biometric features of the customer, consult the database and identify a customer profile containing biometric features corresponding with the customer within the image.
  • a processor in communication with the imaging device and database and configured to execute image analysis software and a salesperson-operated display, such as a Point of Sale device for executing the retail transaction and in communication with the processor wherein upon receiving an image of the customer from the imaging device, the processor executes the image analysis software, causing the software to identify a customer within the image, identify the biometric features of the customer, consult the database and identify a customer profile containing biometric features corresponding with the customer within the image.
  • the processor upon identifying the corresponding customer profile, provides the salesperson-operated display such as a Point of Sale device with details of customer's associated commercial characteristics, such as the retail transaction from the database that corresponds with the customer profile.
  • the Point of Sale device is operated by a user and upon provision of the details of the retail transaction to the Point of Sale device, the user is able to execute the retail transaction.
  • the database is a shop-level (local) database that is assigned to a specific defined retail space and in communication with a central database via at least one communication network, wherein the customer profiles are stored in the central database.
  • the system may also further comprise a permission-receiving interface associated with the retail space and arranged to receive input in the form of permitting and/or removing permission.
  • a copy of the customer's associated customer profile is retrieved from the central database and stored within the shop-level database, thereby enabling it to be identified by the software.
  • the associated customer profile is removed from the shop-level database.
  • a customer-operated mobile communications device is in communication via at least one communication network with the permission-receiving interface; wherein the communications device is further arranged to provide or refuse permission to the permission- receiving interface and to remove permission that has been provided.
  • the removal of permission may be induced automatically by, for example, the execution of a retail transaction associated with the customer who provided the permission, or in another example, failure to capture an image of the customer by the imaging device within a defined period of time.
  • the customer-operated communications device may be further arranged to determine the proximity of the communications device to the retail space and upon determining that the communications device is within a defined distance of the retail space, the communications device notifies the customer and provides the customer with the ability to provide or refuse permission to the permission-receiving interface associated with the defined retail space. Upon determining that the customer has moved a defined distance away from the retail space following the provision of permission, the communications device may transmit a removal of permission to the permission-receiving interface.
  • a customer who does not have a customer profile associated with the system may be provided with the option to create a customer profile during execution of a retail transaction at the Point of Sale.
  • the system may alter the defined retail transaction associated with the customer's profile during execution of a retail transaction at the Point of Sale.
  • One embodiment of the method is codified, in part, in a computing system, such as the computing system shown at Figure 1.
  • FIG. 1 there is shown a schematic diagram of a computing system, which in this embodiment is a server 100 suitable for use with an embodiment of the invention.
  • the server 100 may be used to execute application and/or system services such as a system and method for facilitating a retail transaction in accordance with an embodiment of the invention.
  • the server 100 comprises suitable components necessary to receive, store and execute appropriate computer instructions.
  • the components may include a processor 102, read only memory (ROM) 104, random access memory (RAM) 106, an input/output devices such as disc drives 108, remote or connected input devices 110 (such as a mobile computing device, a smartphone or a 'desktop' personal computer), and one or more communications link(s) 114.
  • the server 100 includes instructions that may be installed in ROM 104, RAM 106 or disc drives 112 and may be executed by the processor 102.
  • a plurality of communication links 114 may variously connect to one or more computing devices 110 such as servers, personal computers, terminals, wireless or handheld computing devices, or mobile communication devices such as a mobile (cell) telephone. At least one of a plurality of communications link 114 may be connected to an external computing network through a telecommunications network (not shown).
  • the embodiment also includes an imaging device 120, arranged to capture images for use by the server 100.
  • the device may include a database 116 which may reside on the storage device 112. It will be understood that the database may reside on any suitable storage device, which may encompass solid state drives, hard disc drives, optical drives or magnetic tape drives.
  • the database 116 may reside on a single physical storage device or may be spread across multiple storage devices.
  • the server 100 includes a suitable operating system 118 which may also reside on a storage device or in the ROM of the server 100.
  • the operating system is arranged to interact with the database and with one or more computer programs to cause the server to carry out the steps, functions and/or procedures in accordance with the embodiments described herein.
  • the remote devices may take the form of computing devices as described above, but may also take the form of a purpose built device, such as a Point of Sale device, as will be described in more detail later.
  • the system in one embodiment, utilises a server including a database arranged to contain profile information regarding one or more customers.
  • the database is arranged to receive the information via the communications network from the one or more remote devices and to subsequently communicate information to one or more remote devices.
  • the method facilitates a retail transaction between one or more Point of Sale devices and a local and/or centralized database.
  • an embodiment of the present invention comprises at least one imaging device 202, such as a camera, for capturing one or more images of a customer's face.
  • the imaging device 202 is in communication with a processor 204, typically via a hard-wired or wireless network.
  • the processor 204 is arranged to operate image-analysis software 206 responsive to receiving an image from the imaging device 202.
  • a database of customer profiles 208 is also in communication with the processor 204, the database 208 detailing customer profiles 210.
  • Each profile details a customer's identity 210a, such as the customer's name, a set of associated customer biometric features 210b, and the customer's associated commercial characteristics 210c, which may comprise characteristics such as a preferred retail transaction.
  • a salesperson-operated display (interface) 212 is also in communication with the processor 204 and configured to display the associated commercial characteristic 210c.
  • the salesperson-operated display 212 may include a monitor for displaying transaction information and one or more input devices for allowing an operator to confirm the transaction, and also receive payment.
  • the imaging device 202 captures an image of a customer's face and provides the image to the processor 204.
  • the processor 204 executes the image analysis software 206 to identify biometric features in the image.
  • the biometric features are compared by the software to customer profiles 210 stored in the database 208, and a profile 210 comprising matching biometric features 210b is identified if present.
  • the processer 204 transmits the customer identity 210a, which may include the customer's name, along with at least one associated commercial characteristic 210c associated with the identified customer profile 210 to the salesperson-operated display 212. If at least one transmitted commercial characteristic 210c is a preferred retail transaction, then the retail transaction is executed.
  • the processor 204 may be further arranged so as to enable for creation of a customer profile 210 within the customer profile database 208.
  • the Imaging Device 202 may be used to capture an image of a customer, which may be analysed by the Image Analysis Software 206 in order to identify biometric features within the image. These biometric features may be identified by the processor 204 as customer biometric features 210b and associated, along with a customer identity 210a and an associated commercial characteristic 210c with a new customer profile 210.
  • the commercial characteristics 210c of the customer may include information such as past purchases in similar retail environments.
  • the commercial characteristic 210c may comprise information such as a preferred purchase type as defined by the customer.
  • at least one associated commercial characteristic may be a preferred payment method or type.
  • at least one commercial characteristic 210c may include more specific payment information sufficient to enable payment without presentation of payment tool such as a bank card.
  • the profile of the user 210 would be available for the user to alter so as to customise their preferences, thereby enabling tailoring of the information made available upon a salesperson-operated display 212.
  • the associated information (being the customer's identity 210a and associated commercial characteristics 210c) is transmitted to a device 212b, such as a coffee machine, with the associated commercial characteristics containing at least one command which causes the device 212b to perform an action.
  • a device 212b such as a coffee machine
  • the action is to make a coffee automatically upon receipt of the command.
  • Figure 3 shows a flow chart for the process undertaken by the system of Figure 2.
  • the imaging device and/or the processor operate to autonomously capture images. This may be achieved by use of a motion sensor, a proximity sensor (not shown) or other equivalent technology.
  • a motion sensor e.g., a MEMS microphone
  • a proximity sensor not shown
  • an image is captured 304.
  • the image is transmitted to the processor 306, which subsequently executes image-analysis software.
  • the image analysis software attempts to identify any persons within the transmitted image.
  • the image-analysis software may further attempt to identify any biometric features of a person 308.
  • the processor Upon identification of identifying biometric features 308, they are returned to the processor.
  • the processor communicates 310 with the database containing at least one customer profile, which comprises at least one associated customer biometric feature, customer name and commercial characteristic.
  • the processor attempts to identify a customer profile within the customer database that comprises a customer biometric feature that matches the identified biometric feature 308 from within the image.
  • the associated information being the customer's identity and associated commercial characteristics
  • This may serve to allow for a salesperson to identify by name a particular customer within a particular retail space. It may further serve to expedite any commercial transactions that the customer wishes to undertake.
  • the associated information (being the customer's identity and associated commercial characteristics) is transmitted to a device, such as a coffee machine, with the associated commercial characteristics containing at least one command which causes the device to perform an action.
  • a device such as a coffee machine
  • the action is to make a coffee automatically upon receipt of the command.
  • the system further comprises a central database 414, comprising at least one profile of at least one customer 410.
  • Each customer profile 410 comprises, at a minimum, the user's identity information 410a, including at least one name, at least one biometric identifying feature of the user 410b, and a set of identified commercial characteristics 410c comprising at least one commercial characteristic of the user.
  • the central database 414 is connected to at least one shop-level processor 404 and at least one customer profile database being a shop-level customer profile database 408 located at least partially within a defined retail space 416.
  • the defined retail space 416 may be a store, cafe, restaurant or similar.
  • the defined retail space 416 may be limited to a particular area of a given store, or may comprise a number of stores sharing a common area such as a common rental space, mall, shopping centre, street, hallway or similar.
  • the shop- level processor 404 upon receiving the permission of the user through the permission-receiving means 418, the shop- level processor 404 communicates with the central database 414 and downloads a copy of the customer profile comprising the customer's identity information 410a, at least one biometric identifying feature of the user 410b, and a set of identified commercial characteristics 410c.
  • the imaging device 402 which produces images of the various potential customers within the retail space at defined intervals or upon request, is in connection with the shop-level processor 404 and transmits the generated images to the processor 404.
  • the processor 404 is arranged to operate image analysis software 406 that is capable of identifying biometric identifying features of people within an image and is further capable of comparing these biometric features to the biometric features 410b of user profiles 410 that are temporarily stored within the shop-level database 408.
  • This system operates to streamline the retail transaction process, as the system is able to efficiently and rapidly detect the presence of a known customer in the retail environment 416 and provide information to a salesperson-operated display 412 that functions as a Point of Sale (POS) device, allowing a predefined transaction, identified as a commercial characteristic 410c, to be executed.
  • POS Point of Sale
  • This step requires an operator of the POS device (a salesperson- operated display 412) requesting confirmation of the defined transaction from the customer and pressing a single button/entering a single command to confirm execution of the transaction. If the customer has registered payment information as an additional commercial characteristic 410c with their profile, the transaction is completed with a single input to the salesperson-operated display 412.
  • the customer profile 410 may additionally be provided to salesperson-operated displays 412 other than Points of Sale. This feature enables salespeople or other staff within the retail space 416 to actively seek out valued customers and address them by name and assist them more personally.
  • the customer profile 410 provides elements such as, at a minimum, at least one biometric identifying feature 410b of the customer, the customer's identity information 410a, including at least one name, and a set of associated commercial characteristics 410c comprising at least one commercial characteristic of the customer.
  • the biometric identifying feature 410b comprises elements of facial features and structure, physical characteristics such as height, or other identifying elements such as fingerprints.
  • the customer's identity information 410a may comprise elements such as the customer's at least first name or another name by which they prefer to be known.
  • the customer identity information 410a can additionally include elements such as the customer's age, which is of benefit in environments wherein the customer's age is a legal reason to refuse service, for example in a bar or nightclub type environment, or if the customer is seeking to purchase tobacco products.
  • the customer identity information 410a can include other elements that may be of use in a range of service environments, for example known allergies. The information made available may be dependent upon permissions given by the customer and may further be dependent upon the particular store that contains the shop-level database 408.
  • the commercial characteristics 410c of the customer can include information such as past purchases in similar retail environments.
  • the commercial characteristic 410c may comprise information such as a preferred purchase type as defined by the customer.
  • at least one associated commercial characteristic may be a preferred payment method or type.
  • at least one commercial characteristic 41 Oc may include more specific payment information sufficient to enable payment without presentation of payment tool such as a bank card.
  • the profile of the user 410 would be available for the customer to alter so as to customise their preferences, thereby enabling tailoring of the information made available upon a salesperson-operated display 412.
  • ownership of the central database 414 comprising a set of user profiles may be independent of the shop- level network. This feature permits a provider to provide such a service to a multitude of retail spaces with limited to no commercial affiliation to one another.
  • the customer utilising a customer -operated communications device such as a smart phone, smart watch, smart pad or other sort of network-capable device, may be able to grant or deny permission on a local scale for their profile 410 to be temporarily stored within the shop-level database 408.
  • the customer-operated smart device determines the proximity of the smart device to a particular retail space 416 and, in communication with the shop-level permission receiving means 418 of the retail space 416, transmits either a grant or denial of permission as selected by the customer.
  • transmission of a denial of permission may prevent further generation of permission requests for a period of time. Alternatively, further generation of permission requests may be prevented until certain criteria are fulfilled. These criteria may include options such as the customer actively enabling the specific permission request, or may include options such as the customer leaving and re-entering the threshold distance from the retail space.
  • the selection of grant or denial of permission by the customer may be via an app that is installed upon the smart device.
  • the grant or denial may be selected by the customer via pop-up or similar system message.
  • the grant or denial may be selected via web page.
  • the presence of a customer profile 410 within a particular shop-level profile database 408 is temporary.
  • the customer profile 410 may be deleted from the shop-level database 408 upon removal of permission.
  • such removal of permission may be induced by execution of a retail transaction that is a commercial characteristic 410c associated with the customer profile 410 stored within the shop-level database 408.
  • permission may be removed should the imaging device 402 fail to capture an image of a customer associated with a particular customer profile 410 temporarily stored within the shop-level database 408. This may indicate that the customer entered a particular retail space 416, granted permission to the permission receiving means 418 and subsequently either changed their mind or is otherwise undetectable.
  • permission may be revoked through action of the customer. This may comprise transmission of an active revocation to the permission receiving means 418. This may further comprise other actions such as notification given to a salesperson operating a suitably- connected salesperson-operated display 412.
  • FIG. 5 A flow diagram illustrating the methodology of the process of the embodiment shown in Figure 4 is disclosed in Figure 5.
  • the methodology shown is similar to the methodology shown in Figure 3, in that upon the step of a customer entering the field of view of the imaging device 502, an image is captured 504.
  • the image is transmitted to the processor 506, which subsequently executes image-analysis software.
  • the image analysis software attempts to identify any persons within the transmitted image.
  • the image-analysis software may further attempt to identify any biometric features of a person 508.
  • biometric features of a person 508 Upon identification of identifying biometric features 508, these are returned to the processor.
  • the processor then communicates 510 with the database containing at least one customer profile, which comprises at least one associated customer biometric feature, customer name and commercial characteristic.
  • the processor attempts to identify a customer profile within the customer database that comprises a customer biometric feature that matches the identified biometric feature 508 from within the image.
  • the associated information (being the customer's identity and associated commercial characteristics) may be transmitted to a salesperson- operated display and displayed thereupon. In the event of a failure to identify a relevant customer profile, no information is available to be transmitted to the Salesperson-operated display 514.
  • the associated information (being the customer's identity and associated commercial characteristics) is transmitted to a device, such as a coffee machine, with the associated commercial characteristics containing at least one command which causes the device to perform an action.
  • a device such as a coffee machine
  • the action is to make a coffee automatically upon receipt of the command.
  • An embodiment of the disclosed system may be configured to operate autonomously when a customer is within range of an imaging device.
  • the imaging device may be located in a retail environment, such as a cafe, and autonomously captures images of customer's faces when they enter the environment. Responsive to capturing an image of a customer, the system consults a database for a corresponding customer profile and if found, presents the customer's associated commercial characteristics, such as a preferred coffee order, on a salesperson-operated display device.
  • a retail environment such as a cafe
  • the system consults a database for a corresponding customer profile and if found, presents the customer's associated commercial characteristics, such as a preferred coffee order, on a salesperson-operated display device.
  • the additional step of autonomous recognition streamlines the retail transaction process, as the system rapidly detects the presence of a known customer in the retail environment and provides information to the salesperson- operated display to allow the associated commercial characteristics to be known, and if the associated commercial characteristic is a preferred retail transaction then the retail transaction is executed.
  • an operator of the salesperson-operated display may request confirmation of the transaction that is an associated commercial characteristic of the customer, and pressing a single button/entering a single command to confirm execution of the transaction. If the customer has registered payment information with their profile, the transaction will be complete with a single input to the salesperson-operated display.
  • the invention includes all such variation and modifications.
  • the invention also includes all of the steps, features, components and/or devices referred to or indicated in the specification, individually or collectively and any and all combinations or any two or more of the steps or features.
  • an application programming interface API
  • ADK application development kit
  • a series of program libraries for use by a developer, for the creation of software applications which are to be used on any one or more computing platforms or devices, such as a terminal or personal computer operating system or a portable computing device, such as a smartphone or a tablet computing system, operating system, or within a larger server structure, such as a 'data farm' or within a larger transaction processing system.
  • API application programming interface
  • ADK application development kit
  • program libraries for use by a developer, for the creation of software applications which are to be used on any one or more computing platforms or devices, such as a terminal or personal computer operating system or a portable computing device, such as a smartphone or a tablet computing system, operating system, or within a larger server structure, such as a 'data farm' or within a larger transaction processing system.
  • program modules include routines, programs, objects, components and data files that perform or assist in the performance of particular functions
  • functionality of the software application may be distributed across a number of routines, programs, objects or components to achieve the same functionality as the embodiment and the broader invention claimed herein.
  • Such variations and modifications are within the purview of those skilled in the art.
  • any appropriate computing system architecture may be utilised. This includes standalone computers, network computers and dedicated computing devices (such as field- programmable gate arrays).
  • processor interacting with a database and/or one or more other devices (such as an image capture device)
  • processor also has access to any components necessary to perform any aspect or method step of the invention as described and defined herein. That is, while not explicitly described, a person skilled in the art would understand that the processor would be required to interact with volatile memory (e.g. RAM), storage devices (e.g. hard drives), etc. in order to carry out certain well known operations, such as accessing a database, receiving input from a user, etc.
  • volatile memory e.g. RAM
  • storage devices e.g. hard drives
  • robots or devices may transmit and receive data via a variety of forms: 3G, 4G, 5G, ( CDMA/ GSM) , Wi-Fi, Bluetooth, other radio frequency, optical, acoustic, magnetic, GPS/GPRS, or any other form or method of communication that may become available from time to time.
  • 3G, 4G, 5G, ( CDMA/ GSM) CDMA/ GSM
  • Wi-Fi Wireless Fidelity
  • Bluetooth other radio frequency
  • optical optical
  • acoustic magnetic
  • GPS/GPRS GPS/GPRS

Abstract

A system for facilitating a retail transaction comprising an imaging device for capturing images of a customer, a database containing customer profiles, each profile associating biometric features of a particular customer with that customer's identity and a defined retail transaction, a processor in communication with the imaging device and database and configured to execute image analysis software, and a Point of Sale device for executing the retail transaction and in communication with the processor, wherein upon receiving an image of the customer from the imaging device, the processor executes the image analysis software, causing the software to identify a customer within the image, identify the biometric features of that customer, consult the database and identify a customer profile containing biometric features corresponding with the customer within the image, and upon identifying the corresponding customer profile, the processor provides the Point of Sale device with details of the defined retail transaction from the database that corresponds with the customer profile.

Description

Networked System for Facilitating a Retail Transaction
PRIORITY
[0001] The present specification draws priority from AU 2016900706, "System for Facilitating a Retail Transaction", and AU 2016905081, "Networked System for Facilitating a Retail Transaction", the complete text of which is incorporated by reference herein.
TECHNICAL Fl ELD
[0002] The present invention relates to a system, method, computer program and data signal for facilitating a retail transaction. In particular, the invention relates to a system, method, computer program and data signal which improves the efficiency of the retail transaction.
BACKGROUND TO THE I NVENTI ON
[0003] In retail environments such as a cafeteria, department store, restaurant or other service-oriented stores, operation of a Point of Sale (POS) device, being a device for executing a retail transaction, can substantially delay a given transaction. For example, during very busy periods in restaurants or cafes, a large volume of transactions need to be executed, all of which requiring the transaction parameters, such as food or beverages purchased, to be specified in the POS device and payment to be received. This can take a substantial amount of time, thereby limiting the number of transactions that can be executed and potentially causing significant customer dissatisfaction due to delays. Previous attempts have been made to address this issue, such as by developing self- service Point of Sale kiosks. However, these require customers to possess a level of technical ability which, if not present, can cause delays and potential malfunction of the kiosk.
[0004] Salespeople in retail environments can benefit in a number of ways from recognition of potential customers. Recognition of a potential customer and the ability to address them by name, as well as being generally aware of their preferred purchase type within the specific retail environment, may be able to aid a salesperson in targeted marketing and an increased ability to close sales, thereby improving overall retail performance. This is achieved through improving the particular customer's experience within that retail environment, thereby improving the likelihood of the potential customer making additional purchases.
[0005] Previous attempts to improve potential customer recognition and thereby improve the customer's experience have been made, including systems such as V.I. P. cards or customer loyalty cards. These, however, have the disadvantage of not actively identifying the potential customer until the loyalty card has been sighted by the salesperson. Therefore, in busier environments a salesperson is unlikely to be able to preferentially engage with customers so as to improve customer experience and thereby the customer's loyalty to that retail environment.
[0006] It would therefore be advantageous to provide for a system whereby a retail space may possess a means of identifying potential customers prior to engaging in marketing and/or sales with them, thereby allowing for targeted sales to be made. It would be of a further advantage to offer means of improving a customer's experience and loyalty within a particular retail space through provision of a means of permitting salespeople to identify a valued customer by sight.
SUMMARY OF THE INVENTION
[0007] In a first aspect the invention provides a system for facilitating a retail transaction an imaging device for capturing images of a customer, a database containing customer profiles, each profile associating biometric features of a particular customer with that customer's identity and a defined retail transaction, a processor in communication with the imaging device and database and configured to execute image analysis software, and a Point of Sale device for executing the retail transaction and in communication with the processor, wherein upon receiving an image of the customer from the imaging device, the processor executes the image analysis software, causing the software to identify a customer within the image, identify the biometric features of that customer, consult the database and identify a customer profile containing biometric features corresponding with the customer within the image, and upon identifying the corresponding customer profile, the processor provides the Point of Sale device with details of the defined retail transaction from the database that corresponds with the customer profile.
[0008] In an embodiment, the Point of Sale device is operated by a user, and upon provision of the details of the defined retail transaction to the Point of Sale device, the user is able to execute the defined retail transaction.
[0009] In an embodiment, the database is a shop-level database that is assigned to a specific defined retail space and in communication with a central database via at least one communication network means wherein the customer profiles are stored in the central database, a permission-receiving means associated with the retail space and adapted to receive permission from the customer and have said received permission removed such that upon provision of permission by the customer to the permission-receiving means, a copy of the customer's associated customer profile is retrieved from the central database and stored within the shop-level database, thereby enabling it to be identified by the software, and upon removal of the received permission, the associated customer profile is removed from the shop-level database.
[0010] In an embodiment, the system further comprises a customer- operated smart device in communication via at least one communication network with the permission-receiving means wherein the smart device is further adapted to provide or refuse permission to the permission-receiving means and to remove permission that has been provided.
[0011] I n an embodiment, removal of perm ission is induced by one or more of execution of a retail transaction associated with the customer who provided the permission, failure to capture an image of the customer by the imaging device within a defined period of time, and revocation by the customer.
[0012] In an embodiment, the customer-operated smart device is further adapted to determine the proximity of the smart device to the defined retail space, and upon determining that the smart device has approached within a defined distance of the defined retail space, the smart device notifies the customer and provides the customer with the ability to provide or refuse permission to the permission-receiving means of the defined retail space.
[0013] In an embodiment, upon determining that the customer has moved a specified distance away from the defined retail space following the provision of permission, the smart device transmits a removal of permission to the permission-receiving means.
[0014] In an embodiment, a customer who does not have a customer profile associated with them is provided with the option to create their customer profile during execution of a retail transaction at the Point of Sale.
[0015] In an embodiment, the customer may alter the defined retail transaction associated with their profile during execution of a retail transaction at the Point of Sale.
[0016] I n a second aspect the invention provides a method for facilitating a retail transaction, comprising the steps of an imaging device capturing an image of a customer and providing the image to a processor, the processor, upon receiving an image of the customer from the imaging device, executing image analysis software, causing the software to identify a customer within the image, identify the biometric features of that customer, consult a database and identify a customer profile containing biometric features corresponding with the customer within the image and upon identifying the corresponding customer profile, the processor providing a Point of Sale device with details of the defined retail transaction from the database that corresponds with the customer profile.
[0017] In a third aspect the invention provides a computer program including at least one instruction, arranged to, when executed on a computing system, perform the method in accordance with the second aspect of the invention..
[0018] In a fourth aspect the invention provides a data signal encoding at least one computer readable instruction, arranged to, when executed on a computing system, perform the method in accordance with the second aspect of the invention. BRI EF DESCRI PTI ON OF THE Fl GURES
[0019] The invention will now be described with reference to the following figures, which are outlined in brief below.
[0020] Figure 1 is a diagram disclosing an example of a networked computing system utilised to facilitate a method for facilitating a transaction in accordance with the present invention;
[0021] Figure 2 is a diagram disclosing an example system in accordance with the present invention;
[0022] Figure 3 is a Flow Chart depicting an example of method steps actioned by the system embodied in Figure 2;
[0023] Figure 4 is a diagram disclosing an example of a networked system in accordance with of the present invention; and
[0024] Figure 5 is a Flow Chart depicting an example of method steps actioned by the system embodied in Figure 4.
DETAI LED DESCRI PTI ON OF PREFERRED EMBODI MENTS
Overview
[0025] The present invention, in one embodiment, relates generally to a system for facilitating a retail transaction. The system generally comprises an imaging device for capturing images of a customer, including a database containing customer profiles. Each profile associates biometric features of a particular customer with that customer's identity and an associated commercial characteristic, such as a retail transaction.
[0026] The embodiment includes a processor in communication with the imaging device and database and configured to execute image analysis software and a salesperson-operated display, such as a Point of Sale device for executing the retail transaction and in communication with the processor wherein upon receiving an image of the customer from the imaging device, the processor executes the image analysis software, causing the software to identify a customer within the image, identify the biometric features of the customer, consult the database and identify a customer profile containing biometric features corresponding with the customer within the image.
[0027] Moreover, upon identifying the corresponding customer profile, the processor provides the salesperson-operated display such as a Point of Sale device with details of customer's associated commercial characteristics, such as the retail transaction from the database that corresponds with the customer profile.
[0028] In more detail of an embodiment, the Point of Sale device is operated by a user and upon provision of the details of the retail transaction to the Point of Sale device, the user is able to execute the retail transaction.
[0029] In some embodiments, the database is a shop-level (local) database that is assigned to a specific defined retail space and in communication with a central database via at least one communication network, wherein the customer profiles are stored in the central database. The system may also further comprise a permission-receiving interface associated with the retail space and arranged to receive input in the form of permitting and/or removing permission.
[0030] Upon provision of permission by the customer to the permission- receiving interface, a copy of the customer's associated customer profile is retrieved from the central database and stored within the shop-level database, thereby enabling it to be identified by the software. Upon removal of the received permission, the associated customer profile is removed from the shop-level database.
[0031] In some embodiments, a customer-operated mobile communications device is in communication via at least one communication network with the permission-receiving interface; wherein the communications device is further arranged to provide or refuse permission to the permission- receiving interface and to remove permission that has been provided.
[0032] The removal of permission may be induced automatically by, for example, the execution of a retail transaction associated with the customer who provided the permission, or in another example, failure to capture an image of the customer by the imaging device within a defined period of time.
[0033] The customer-operated communications device may be further arranged to determine the proximity of the communications device to the retail space and upon determining that the communications device is within a defined distance of the retail space, the communications device notifies the customer and provides the customer with the ability to provide or refuse permission to the permission-receiving interface associated with the defined retail space. Upon determining that the customer has moved a defined distance away from the retail space following the provision of permission, the communications device may transmit a removal of permission to the permission-receiving interface.
[0034] A customer who does not have a customer profile associated with the system may be provided with the option to create a customer profile during execution of a retail transaction at the Point of Sale.
[0035] The system may alter the defined retail transaction associated with the customer's profile during execution of a retail transaction at the Point of Sale.
[0036] One embodiment of the method is codified, in part, in a computing system, such as the computing system shown at Figure 1.
[0037] In Figure 1 there is shown a schematic diagram of a computing system, which in this embodiment is a server 100 suitable for use with an embodiment of the invention. The server 100 may be used to execute application and/or system services such as a system and method for facilitating a retail transaction in accordance with an embodiment of the invention.
[0038] With reference to Figure 1, the server 100 comprises suitable components necessary to receive, store and execute appropriate computer instructions. The components may include a processor 102, read only memory (ROM) 104, random access memory (RAM) 106, an input/output devices such as disc drives 108, remote or connected input devices 110 (such as a mobile computing device, a smartphone or a 'desktop' personal computer), and one or more communications link(s) 114. The server 100 includes instructions that may be installed in ROM 104, RAM 106 or disc drives 112 and may be executed by the processor 102. There may be provided a plurality of communication links 114 which may variously connect to one or more computing devices 110 such as servers, personal computers, terminals, wireless or handheld computing devices, or mobile communication devices such as a mobile (cell) telephone. At least one of a plurality of communications link 114 may be connected to an external computing network through a telecommunications network (not shown). The embodiment also includes an imaging device 120, arranged to capture images for use by the server 100.
[0039] In one particular embodiment the device may include a database 116 which may reside on the storage device 112. It will be understood that the database may reside on any suitable storage device, which may encompass solid state drives, hard disc drives, optical drives or magnetic tape drives. The database 116 may reside on a single physical storage device or may be spread across multiple storage devices.
[0040] The server 100 includes a suitable operating system 118 which may also reside on a storage device or in the ROM of the server 100. The operating system is arranged to interact with the database and with one or more computer programs to cause the server to carry out the steps, functions and/or procedures in accordance with the embodiments described herein.
[0041] Broadly, there is described a computing method and system arranged to interact with one or more remote devices via a communications network. The remote devices may take the form of computing devices as described above, but may also take the form of a purpose built device, such as a Point of Sale device, as will be described in more detail later.
[0042] The system, in one embodiment, utilises a server including a database arranged to contain profile information regarding one or more customers. The database is arranged to receive the information via the communications network from the one or more remote devices and to subsequently communicate information to one or more remote devices.
[0043] Other aspects of the broad inventive concept relate to a corresponding method, computer program and data signal. The method facilitates a retail transaction between one or more Point of Sale devices and a local and/or centralized database.
[0044] As depicted in Figure 2, an embodiment of the present invention comprises at least one imaging device 202, such as a camera, for capturing one or more images of a customer's face. The imaging device 202 is in communication with a processor 204, typically via a hard-wired or wireless network. The processor 204 is arranged to operate image-analysis software 206 responsive to receiving an image from the imaging device 202. A database of customer profiles 208 is also in communication with the processor 204, the database 208 detailing customer profiles 210. Each profile details a customer's identity 210a, such as the customer's name, a set of associated customer biometric features 210b, and the customer's associated commercial characteristics 210c, which may comprise characteristics such as a preferred retail transaction. A salesperson-operated display (interface) 212 is also in communication with the processor 204 and configured to display the associated commercial characteristic 210c. The salesperson-operated display 212 may include a monitor for displaying transaction information and one or more input devices for allowing an operator to confirm the transaction, and also receive payment.
[0045] When the system is operated, the imaging device 202 captures an image of a customer's face and provides the image to the processor 204. The processor 204 executes the image analysis software 206 to identify biometric features in the image. The biometric features are compared by the software to customer profiles 210 stored in the database 208, and a profile 210 comprising matching biometric features 210b is identified if present. The processer 204 transmits the customer identity 210a, which may include the customer's name, along with at least one associated commercial characteristic 210c associated with the identified customer profile 210 to the salesperson-operated display 212. If at least one transmitted commercial characteristic 210c is a preferred retail transaction, then the retail transaction is executed.
[0046] In an embodiment of the present invention, the processor 204 may be further arranged so as to enable for creation of a customer profile 210 within the customer profile database 208. In this embodiment, the Imaging Device 202 may be used to capture an image of a customer, which may be analysed by the Image Analysis Software 206 in order to identify biometric features within the image. These biometric features may be identified by the processor 204 as customer biometric features 210b and associated, along with a customer identity 210a and an associated commercial characteristic 210c with a new customer profile 210.
[0047] The commercial characteristics 210c of the customer may include information such as past purchases in similar retail environments. Alternatively, the commercial characteristic 210c may comprise information such as a preferred purchase type as defined by the customer. In some embodiments, at least one associated commercial characteristic may be a preferred payment method or type. In an embodiment, at least one commercial characteristic 210c may include more specific payment information sufficient to enable payment without presentation of payment tool such as a bank card. In an embodiment, the profile of the user 210 would be available for the user to alter so as to customise their preferences, thereby enabling tailoring of the information made available upon a salesperson-operated display 212.
[0048] In an alternative embodiment, upon successful identification of a customer profile within the database 208, the associated information (being the customer's identity 210a and associated commercial characteristics 210c) is transmitted to a device 212b, such as a coffee machine, with the associated commercial characteristics containing at least one command which causes the device 212b to perform an action. For example, in the example given above, the device 212b is a coffee machine, and the action is to make a coffee automatically upon receipt of the command.
[0049] Figure 3 shows a flow chart for the process undertaken by the system of Figure 2. In one embodiment, the imaging device and/or the processor operate to autonomously capture images. This may be achieved by use of a motion sensor, a proximity sensor (not shown) or other equivalent technology. As depicted, upon the step of a customer entering the field of view of the imaging device 302, an image is captured 304. The image is transmitted to the processor 306, which subsequently executes image-analysis software. The image analysis software attempts to identify any persons within the transmitted image. Upon identifying a person within the image, the image-analysis software may further attempt to identify any biometric features of a person 308.
[0050] Upon identification of identifying biometric features 308, they are returned to the processor. The processor communicates 310 with the database containing at least one customer profile, which comprises at least one associated customer biometric feature, customer name and commercial characteristic. The processor attempts to identify a customer profile within the customer database that comprises a customer biometric feature that matches the identified biometric feature 308 from within the image. Upon successful identification of a customer profile within the database 312, the associated information (being the customer's identity and associated commercial characteristics) is transmitted to a salesperson-operated display and displayed thereupon.
[0051] This may serve to allow for a salesperson to identify by name a particular customer within a particular retail space. It may further serve to expedite any commercial transactions that the customer wishes to undertake.
[0052] In the event of a failure to identify a relevant customer profile, no information is available to be transmitted to the Salesperson-operated display 314.
[0053] In an alternative embodiment, upon successful identification of a customer profile within the database 312, the associated information (being the customer's identity and associated commercial characteristics) is transmitted to a device, such as a coffee machine, with the associated commercial characteristics containing at least one command which causes the device to perform an action. For example, in the example given above, the device is a coffee machine, and the action is to make a coffee automatically upon receipt of the command.
Networked Environment
[0054] In the embodiment of the present invention shown in Figure 4, the system further comprises a central database 414, comprising at least one profile of at least one customer 410. Each customer profile 410 comprises, at a minimum, the user's identity information 410a, including at least one name, at least one biometric identifying feature of the user 410b, and a set of identified commercial characteristics 410c comprising at least one commercial characteristic of the user. The central database 414 is connected to at least one shop-level processor 404 and at least one customer profile database being a shop-level customer profile database 408 located at least partially within a defined retail space 416. There is additionally a shop-level, salesperson-operated display 412. The defined retail space 416 may be a store, cafe, restaurant or similar. The defined retail space 416 may be limited to a particular area of a given store, or may comprise a number of stores sharing a common area such as a common rental space, mall, shopping centre, street, hallway or similar.
[0055] In an embodiment of the present invention, there may additionally be a means of receiving permission 418. In this embodiment, upon receiving the permission of the user through the permission-receiving means 418, the shop- level processor 404 communicates with the central database 414 and downloads a copy of the customer profile comprising the customer's identity information 410a, at least one biometric identifying feature of the user 410b, and a set of identified commercial characteristics 410c.
[0056] The imaging device 402, which produces images of the various potential customers within the retail space at defined intervals or upon request, is in connection with the shop-level processor 404 and transmits the generated images to the processor 404. The processor 404 is arranged to operate image analysis software 406 that is capable of identifying biometric identifying features of people within an image and is further capable of comparing these biometric features to the biometric features 410b of user profiles 410 that are temporarily stored within the shop-level database 408.
[0057] Upon positively matching the identified biometric features of an image produced by the imaging device 408 with the associated biometric features 410b of a user, that particular user's profile, including customer identity information 410a and at least one commercial characteristic 410c, is displayed on a salesperson-operated display 412.
[0058] This system operates to streamline the retail transaction process, as the system is able to efficiently and rapidly detect the presence of a known customer in the retail environment 416 and provide information to a salesperson-operated display 412 that functions as a Point of Sale (POS) device, allowing a predefined transaction, identified as a commercial characteristic 410c, to be executed. This step requires an operator of the POS device (a salesperson- operated display 412) requesting confirmation of the defined transaction from the customer and pressing a single button/entering a single command to confirm execution of the transaction. If the customer has registered payment information as an additional commercial characteristic 410c with their profile, the transaction is completed with a single input to the salesperson-operated display 412.
[0059] The customer profile 410 may additionally be provided to salesperson-operated displays 412 other than Points of Sale. This feature enables salespeople or other staff within the retail space 416 to actively seek out valued customers and address them by name and assist them more personally.
[0060] The customer profile 410 provides elements such as, at a minimum, at least one biometric identifying feature 410b of the customer, the customer's identity information 410a, including at least one name, and a set of associated commercial characteristics 410c comprising at least one commercial characteristic of the customer. The biometric identifying feature 410b comprises elements of facial features and structure, physical characteristics such as height, or other identifying elements such as fingerprints. The skilled person will appreciate that there are a multitude of ways available in order to identify a customer and that altering the exact means to another known means does not step beyond the scope of the invention disclosed herein.
[0061] The customer's identity information 410a may comprise elements such as the customer's at least first name or another name by which they prefer to be known. The customer identity information 410a can additionally include elements such as the customer's age, which is of benefit in environments wherein the customer's age is a legal reason to refuse service, for example in a bar or nightclub type environment, or if the customer is seeking to purchase tobacco products. The customer identity information 410a can include other elements that may be of use in a range of service environments, for example known allergies. The information made available may be dependent upon permissions given by the customer and may further be dependent upon the particular store that contains the shop-level database 408. [0062] The commercial characteristics 410c of the customer can include information such as past purchases in similar retail environments. Alternatively, the commercial characteristic 410c may comprise information such as a preferred purchase type as defined by the customer. In some embodiments, at least one associated commercial characteristic may be a preferred payment method or type. In an embodiment, at least one commercial characteristic 41 Oc may include more specific payment information sufficient to enable payment without presentation of payment tool such as a bank card. In an embodiment, the profile of the user 410 would be available for the customer to alter so as to customise their preferences, thereby enabling tailoring of the information made available upon a salesperson-operated display 412.
[0063] In an embodiment of the present invention, ownership of the central database 414 comprising a set of user profiles may be independent of the shop- level network. This feature permits a provider to provide such a service to a multitude of retail spaces with limited to no commercial affiliation to one another.
[0064] In an embodiment of the present invention, the customer, utilising a customer -operated communications device such as a smart phone, smart watch, smart pad or other sort of network-capable device, may be able to grant or deny permission on a local scale for their profile 410 to be temporarily stored within the shop-level database 408. In an embodiment, the customer-operated smart device determines the proximity of the smart device to a particular retail space 416 and, in communication with the shop-level permission receiving means 418 of the retail space 416, transmits either a grant or denial of permission as selected by the customer. In an embodiment, transmission of a denial of permission may prevent further generation of permission requests for a period of time. Alternatively, further generation of permission requests may be prevented until certain criteria are fulfilled. These criteria may include options such as the customer actively enabling the specific permission request, or may include options such as the customer leaving and re-entering the threshold distance from the retail space.
[0065] The selection of grant or denial of permission by the customer may be via an app that is installed upon the smart device. Alternatively, the grant or denial may be selected by the customer via pop-up or similar system message. Alternatively, the grant or denial may be selected via web page. The skilled person will appreciate that selection of a means of granting or denial of permission that is different to the alternatives identified above does not shift the system beyond the scope of the invention claimed herein.
[0066] In an embodiment, the presence of a customer profile 410 within a particular shop-level profile database 408 is temporary. In an embodiment, the customer profile 410 may be deleted from the shop-level database 408 upon removal of permission. In an embodiment, such removal of permission may be induced by execution of a retail transaction that is a commercial characteristic 410c associated with the customer profile 410 stored within the shop-level database 408. In an alternative embodiment, permission may be removed should the imaging device 402 fail to capture an image of a customer associated with a particular customer profile 410 temporarily stored within the shop-level database 408. This may indicate that the customer entered a particular retail space 416, granted permission to the permission receiving means 418 and subsequently either changed their mind or is otherwise undetectable. It may additionally indicate that the granted permission may have been a false positive. In an alternative embodiment of the present invention, permission may be revoked through action of the customer. This may comprise transmission of an active revocation to the permission receiving means 418. This may further comprise other actions such as notification given to a salesperson operating a suitably- connected salesperson-operated display 412.
[0067] A flow diagram illustrating the methodology of the process of the embodiment shown in Figure 4 is disclosed in Figure 5. The methodology shown is similar to the methodology shown in Figure 3, in that upon the step of a customer entering the field of view of the imaging device 502, an image is captured 504. The image is transmitted to the processor 506, which subsequently executes image-analysis software. The image analysis software attempts to identify any persons within the transmitted image. Upon identifying a person within the image, the image-analysis software may further attempt to identify any biometric features of a person 508. Upon identification of identifying biometric features 508, these are returned to the processor. The processor then communicates 510 with the database containing at least one customer profile, which comprises at least one associated customer biometric feature, customer name and commercial characteristic. The processor then attempts to identify a customer profile within the customer database that comprises a customer biometric feature that matches the identified biometric feature 508 from within the image. Upon successful identification of a customer profile within the database 512, the associated information (being the customer's identity and associated commercial characteristics) may be transmitted to a salesperson- operated display and displayed thereupon. In the event of a failure to identify a relevant customer profile, no information is available to be transmitted to the Salesperson-operated display 514.
[0068] In an alternative embodiment, upon successful identification of a customer profile within the database 512, the associated information (being the customer's identity and associated commercial characteristics) is transmitted to a device, such as a coffee machine, with the associated commercial characteristics containing at least one command which causes the device to perform an action. For example, in the example given above, the device is a coffee machine, and the action is to make a coffee automatically upon receipt of the command.
[0069] The methodology of the embodiment disclosed in Figure 5 differs from that of Figure 3 in that it further requires permission to be granted 516 by the customer. Grant of permission triggers the shop-level processor to contact the Central Database 518 and receive a copy of the customer profile which is at least temporarily stored in the shop-level database 522. In the event of denial of permission, a customer profile is not downloaded 520, which ultimately means that no information is provided to the salesperson-operated display 514.
Autonomous Operation
[0070] An embodiment of the disclosed system may be configured to operate autonomously when a customer is within range of an imaging device.
[0071] In one embodiment, the imaging device may be located in a retail environment, such as a cafe, and autonomously captures images of customer's faces when they enter the environment. Responsive to capturing an image of a customer, the system consults a database for a corresponding customer profile and if found, presents the customer's associated commercial characteristics, such as a preferred coffee order, on a salesperson-operated display device.
[0072] The additional step of autonomous recognition streamlines the retail transaction process, as the system rapidly detects the presence of a known customer in the retail environment and provides information to the salesperson- operated display to allow the associated commercial characteristics to be known, and if the associated commercial characteristic is a preferred retail transaction then the retail transaction is executed.
[0073] Optionally, an operator of the salesperson-operated display may request confirmation of the transaction that is an associated commercial characteristic of the customer, and pressing a single button/entering a single command to confirm execution of the transaction. If the customer has registered payment information with their profile, the transaction will be complete with a single input to the salesperson-operated display.
Disclaimers
[0074] Throughout this specification, unless the context requires otherwise, the word "comprise" or variations such as "comprises" or "comprising", will be understood to imply the inclusion of a stated integer or group of integers but not the exclusion of any other integer or group of integers.
[0075] Those skilled in the art will appreciate that the invention described herein is susceptible to variations and modifications other than those specifically described.
[0076] The invention includes all such variation and modifications. The invention also includes all of the steps, features, components and/or devices referred to or indicated in the specification, individually or collectively and any and all combinations or any two or more of the steps or features.
[0077] Other definitions for selected terms used herein may be found within the detailed description of the invention and apply throughout. Unless otherwise defined, all other scientific and technical terms used herein have the same meaning as commonly understood to one of ordinary skill in the art to which the invention belongs.
[0078] Although not required, the embodiments described with reference to the method, computer program, data signal and aspects of the system can be implemented via an application programming interface (API), an application development kit (ADK) or as a series of program libraries, for use by a developer, for the creation of software applications which are to be used on any one or more computing platforms or devices, such as a terminal or personal computer operating system or a portable computing device, such as a smartphone or a tablet computing system, operating system, or within a larger server structure, such as a 'data farm' or within a larger transaction processing system.
[0079] Generally, as program modules include routines, programs, objects, components and data files that perform or assist in the performance of particular functions, it will be understood that the functionality of the software application may be distributed across a number of routines, programs, objects or components to achieve the same functionality as the embodiment and the broader invention claimed herein. Such variations and modifications are within the purview of those skilled in the art.
[0080] It will also be appreciated that where methods and systems of the present invention and/or embodiments are implemented by computing systems or partly implemented by computing systems then any appropriate computing system architecture may be utilised. This includes standalone computers, network computers and dedicated computing devices (such as field- programmable gate arrays).
[0081] Where reference is made to a processor interacting with a database and/or one or more other devices (such as an image capture device), it will be appreciated that it is implied that the processor also has access to any components necessary to perform any aspect or method step of the invention as described and defined herein. That is, while not explicitly described, a person skilled in the art would understand that the processor would be required to interact with volatile memory (e.g. RAM), storage devices (e.g. hard drives), etc. in order to carry out certain well known operations, such as accessing a database, receiving input from a user, etc.
[0082] Where the terms "computer", "computing system" and "computing device" are used in the specification, these terms are intended to cover any appropriate arrangement of computer hardware for implementing the inventive concept and/or embodiments described herein.
[0083] Where reference is made to communication standards, methods and/or systems, robots or devices may transmit and receive data via a variety of forms: 3G, 4G, 5G, ( CDMA/ GSM) , Wi-Fi, Bluetooth, other radio frequency, optical, acoustic, magnetic, GPS/GPRS, or any other form or method of communication that may become available from time to time.
[0084] In the preceding description, where a feature or device such as "processor", "Point of Sale device", etc., is described with reference to separate figures and different reference numerals, it will be understood that each different reference numeral refers to a different embodiment of the feature or device, but that the function of the feature or device remains analogous, even though the interworking relationship between the features may be different in different embodiments. For example, the functionality of processor 102 in Figure 1 is analogous to the functionality of processor 204 in Figure 2.

Claims

CLAI MS
1. A system for facilitating a retail transaction, the system comprising:
an imaging device for capturing images of a customer; a database containing customer profiles, each profile associating biometric features of a particular customer with that customer's identity and a defined retail transaction;
a processor in communication with the imaging device and database and configured to execute image analysis software; and
a Point of Sale device for executing the retail transaction and in communication with the processor;
wherein;
upon receiving an image of the customer from the imaging device, the processor executes the image analysis software, causing the software to identify a customer within the image, identify the biometric features of that customer, consult the database and identify a customer profile containing biometric features corresponding with the customer within the image; and
upon identifying the corresponding customer profile, the processor provides the Point of Sale device with details of the defined retail transaction from the database that corresponds with the customer profile.
2. The system of claim 1 wherein the Point of Sale device is operated by a user; and
upon provision of the details of the defined retail transaction to the Point of Sale device, the user is able to execute the defined retail transaction.
3. The system of claims 1 or 2 wherein the database is a shop-level database that is assigned to a specific defined retail space and in communication with a central database via at least one communication network means, wherein the customer profiles are stored in the central database; the system further comprising a permission-receiving means associated with the retail space and adapted to receive permission from the customer and have said received permission removed,
such that upon provision of permission by the customer to the permission-receiving means, a copy of the customer's associated customer profile is retrieved from the central database and stored within the shop- level database, thereby enabling it to be identified by the software; and upon removal of the received permission, the associated customer profile is removed from the shop-level database.
4. The system of claim 3, further comprising a customer-operated smart device in communication via at least one communication network with the permission-receiving means;
wherein the smart device is further adapted to provide or refuse permission to the permission-receiving means and to remove permission that has been provided.
5. The system of claims 3 or 4 wherein removal of permission is induced by one or more of:
execution of a retail transaction associated with the customer who provided the permission;
failure to capture an image of the customer by the imaging device within a defined period of time; and
revocation by the customer.
6. The system of claim 4 wherein the customer-operated smart device is further adapted to determine the proximity of the smart device to the defined retail space; and
upon determining that the smart device has approached within a defined distance of the defined retail space, the smart device notifies the customer and provides the customer with the ability to provide or refuse permission to the permission-receiving means of the defined retail space.
7. The system of claim 6, wherein upon determining that the customer has moved a specified distance away from the defined retail space following the provision of permission, the smart device transmits a removal of permission to the permission-receiving means.
8. The system of any one of the above claims wherein a customer who does not have a customer profile associated with them is provided with the option to create their customer profile during execution of a retail transaction at the Point of Sale.
9. The system of any one of the above claims wherein the customer may alter the defined retail transaction associated with their profile during execution of a retail transaction at the Point of Sale.
10. The system of any one of the above claims, further comprising an autonomous device in communication with the processor and adapted to produce a good or perform a service associated with a retail transaction; wherein upon identification by the processor of a customer with a customer profile comprising a defined retail transaction associated with a good or service that the autonomous device is adapted to produce and provision of the same to the Point of Sale device and autonomous device, the autonomous device produces the relevant good or performs the relevant service.
11.A method for facilitating a retail transaction, comprising the steps of:
an imaging device capturing an image of a customer and providing the image to a processor;
the processor, upon receiving an image of the customer from the imaging device, executing image analysis software, causing the software to identify a customer within the image, identify the biometric features of that customer, consult a database and identify a customer profile containing biometric features corresponding with the customer within the image and a defined retail transaction; and upon identifying the corresponding customer profile, the processor providing a Point of Sale device with details of the defined retail transaction from the database that corresponds with the customer profile.
12. The method of claim 11, further comprising the step of:
upon identifying the corresponding customer profile, the processor providing an autonomous device adapted to produce a good or perform a service associated with the defined retail transaction with details of the retail transaction; and
the autonomous device producing the associated good or performing the associated service.
13. A computer program including at least one instruction, arranged to, when executed on a computing system, perform the method steps of claim 11.
14. A data signal encoding at least one computer readable instruction, arranged to, when executed on a computing system, perform the method steps of claim 11.
PCT/AU2017/050163 2016-02-26 2017-02-24 Networked system for facilitating a retail transaction WO2017143402A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
AU2016900706 2016-02-26
AU2016900706A AU2016900706A0 (en) 2016-02-26 System for Facilitating A Retail Transaction
AU2016905081A AU2016905081A0 (en) 2016-12-09 System for Facilitating a Retail Transaction
AU2016905081 2016-12-09

Publications (1)

Publication Number Publication Date
WO2017143402A1 true WO2017143402A1 (en) 2017-08-31

Family

ID=59684738

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2017/050163 WO2017143402A1 (en) 2016-02-26 2017-02-24 Networked system for facilitating a retail transaction

Country Status (1)

Country Link
WO (1) WO2017143402A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220036380A1 (en) * 2018-09-26 2022-02-03 Nec Corporation Customer information registration apparatus

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140136419A1 (en) * 2012-11-09 2014-05-15 Keith Shoji Kiyohara Limited use tokens granting permission for biometric identity verification
US8856034B2 (en) * 2012-08-16 2014-10-07 International Business Machines Corporation Intelligent point of sale system
US20150006243A1 (en) * 2013-06-28 2015-01-01 AZAPA R&D Americas, Inc. Digital information gathering and analyzing method and apparatus
US20150199702A1 (en) * 2014-01-11 2015-07-16 Toshiba Global Commerce Solutions Holdings Corporation Systems and methods for using transaction data associated with a loyalty program identifier to conduct a purchase transaction
WO2015105869A1 (en) * 2014-01-10 2015-07-16 Elo Touch Solutions, Inc. Multi-mode point-of-sale device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8856034B2 (en) * 2012-08-16 2014-10-07 International Business Machines Corporation Intelligent point of sale system
US20140136419A1 (en) * 2012-11-09 2014-05-15 Keith Shoji Kiyohara Limited use tokens granting permission for biometric identity verification
US20150006243A1 (en) * 2013-06-28 2015-01-01 AZAPA R&D Americas, Inc. Digital information gathering and analyzing method and apparatus
WO2015105869A1 (en) * 2014-01-10 2015-07-16 Elo Touch Solutions, Inc. Multi-mode point-of-sale device
US20150199702A1 (en) * 2014-01-11 2015-07-16 Toshiba Global Commerce Solutions Holdings Corporation Systems and methods for using transaction data associated with a loyalty program identifier to conduct a purchase transaction

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
BANERJEE, P. M. ET AL.: "Taking mobile payments from coffee shops to retail stores", SMART DEVICE, SMART PAY, 2015, pages 1, 13, XP055412929, Retrieved from the Internet <URL:https://dupress.deloitte.com/content/dam/dup-us-en/articles/mpayments-mobile-pos-system-in-retail/DUP-922_mPayments_FINAL.pdf>> *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220036380A1 (en) * 2018-09-26 2022-02-03 Nec Corporation Customer information registration apparatus

Similar Documents

Publication Publication Date Title
US11748465B2 (en) Synchronizing computer vision interactions with a computer kiosk
US10755337B2 (en) System and method for generating user customized order interface
US11257086B2 (en) Automated sensor-based customer identification and authorization systems within a physical environment
US20210110321A1 (en) Display device and method for controlling display device
US20130019284A1 (en) Automated web based applications with a wireless communication device
CN109215254B (en) Physical store application system, user information processing method and device
TW201407500A (en) Intelligent presentation of documents
WO2019232329A1 (en) Beacon-triggered activation of a near field communication application
US11830287B2 (en) Method and system for customizing user experience
US11893615B2 (en) Spot market: location aware commerce for an event
US20140279422A1 (en) Methods and systems for agnostic payment systems
US11663594B2 (en) Systems and methods for location based account integration and electronic authentication
JP7298594B2 (en) Store management device, store management method, and program
KR20200002785A (en) Method and apparatus for constructing biometric feature database
US20150317642A1 (en) Process to query electronic sales receipts with a portable computerized device
WO2019030941A1 (en) Authentication system and server
WO2017143402A1 (en) Networked system for facilitating a retail transaction
US20230105850A1 (en) Systems and methods for conducting remote user authentication
JP7168132B2 (en) Payment support device, payment support system, payment support method, and payment support program
US11232431B2 (en) Transaction management based on audio of a transaction
KR101758712B1 (en) Method of managing receipt and apparatus for the same
WO2022059173A1 (en) Display control device, display system, display control method, and non-transitory computer-readable medium
KR102644691B1 (en) Method and device for providing information related to virtual assets using private key
JP7153756B1 (en) Electronic payment system, electronic payment method, and program
JP6928696B1 (en) Information processing equipment, systems, control methods and programs

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17755655

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17755655

Country of ref document: EP

Kind code of ref document: A1