WO2017048115A1 - A real-time intelligent video camera system - Google Patents

A real-time intelligent video camera system Download PDF

Info

Publication number
WO2017048115A1
WO2017048115A1 PCT/MY2016/000059 MY2016000059W WO2017048115A1 WO 2017048115 A1 WO2017048115 A1 WO 2017048115A1 MY 2016000059 W MY2016000059 W MY 2016000059W WO 2017048115 A1 WO2017048115 A1 WO 2017048115A1
Authority
WO
WIPO (PCT)
Prior art keywords
distress signal
user
camera
server
communication network
Prior art date
Application number
PCT/MY2016/000059
Other languages
French (fr)
Inventor
Kian Vui Lo
Original Assignee
Kian Vui Lo
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kian Vui Lo filed Critical Kian Vui Lo
Publication of WO2017048115A1 publication Critical patent/WO2017048115A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B27/00Alarm systems in which the alarm condition is signalled from a central station to a plurality of substations
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras

Definitions

  • This invention relates to a camera system. More particularly, the invention relates to a system for detecting abnormal events, disseminating distress signals and triggering alarm siren.
  • the following definitions apply:
  • the term "user” is referring to a person who owns the camera and triggers the distress signal
  • the term "third party user” is referring to a person who receives the distress signal
  • a video surveillance system comprises a plurality of video cameras, means for modulating signals from each camera, means for multiplexing said modulated signals onto a path capable of carrying a plurality of video channels, a signal splitter which provides the signals on said path in parallel to a plurality of video displays each comprising a tuner and a display screen, and a computer connected to said tuners and comprising means for controlling at least one of said tuners so as to display on its display screen a sequence of images from different video cameras.
  • a security system for monitoring a plurality of assets comprises a plurality of agents, each one of said plurality of agents connected with an asset, each said plurality of agents comprises a sensor for monitoring a physical condition of the corresponding one of said plurality of assets; a processor for collecting and processing the physical condition data to produce an asset security data; a communication device for transmitting and receiving data; and a wireless communication channel for communicating between the plurality of agents via a virtual network, wherein one of the plurality of agents is assigned as a primary agent to receive the plurality of asset security data from the plurality of agents and transmit the plurality of asset security data to the master control unit; a master control unit for receiving the plurality of asset security data from the plurality of agents; and a global operations center in communication with the master control unit for receiving the plurality of asset security data retransmitted from the master control unit and analyzing the plurality of asset security data to detect a security threat.
  • the present invention provides such a system.
  • the system further comprises a voice recorder coupled to the camera for capturing voice inputs.
  • system further comprises a vibration sensor coupled to the camera for detecting vibrations of the surroundings.
  • the processor further generates a terrain map from the captured image in the event of the detected object satisfied the set of parameters, and the terrain map may comprise a plurality of parameters indicating the content of the captured images.
  • the processor includes a primary analysis module for human and/or non- human object recognition, a secondary analysis module for measuring the movement of object, and a reasoning module for object activity recognition.
  • an alarm system can be connected to the communication network for sounding the alarm sound upon receiving instruction from the server.
  • the distress signal includes an alert message, the captured images, the captured voice input, the detected vibration data, the terrain map, or any combination thereof.
  • the preset condition is any device that locates within a predetermined distance from the location of the camera.
  • the preset condition may also include a set of preset eligible devices being customizable via the application of the user device.
  • the system further comprises a user device being one of the plurality of devices that the owner of the camera is currently using, wherein the set of parameters and the preset condition are customizable via the application of the user device.
  • the devices include but are not limited to personal digital assistants (PDA), smart phones, tablets, computers, laptops, notebooks, phablets, or any suitable means which capable of processing data, displaying the data, and performing data transmission.
  • PDA personal digital assistants
  • the camera is accessible via barcode verification.
  • a system for detecting an abnormal event and disseminating a distress signal comprises a camera for capturing images, a processor coupled to the camera, configured to analyze the captured images for identifying at least one object, determine if the detected object satisfies a set of parameters, generate and transmit the distress signal to a communication network in the event of the detected object satisfied the set of parameters, a user device having an user application configured to receive the distress signal from the communication network, provide a graphical user interface to display the distress signal, provide an option initiateable by user of the user device to transmit the distress signal to a server, and a plurality of third party devices connected to the communication network, each having a third party application configured to transmit information relating to location of the corresponding third party device to the server upon a request by the server, wherein the server is configured to receive the distress signal from the user device, retrieve information relating to the location of each third party device upon receiving t e distress signal, determine at least one eligible third party device which satisfies
  • the set of parameter is customizable by the user of the user device via the user application.
  • the preset condition is any third party device that locates within a predetermined distance from the location of the camera.
  • the user device includes but is not limited to personal digital assistant (PDA), smart phone, tablet, computer, laptop, netbook, phoblet, or any suitable means which are capable of processing data, displaying the data, providing inputs, and performing data transmission.
  • PDA personal digital assistant
  • smart phone tablet, computer, laptop, netbook, phoblet, or any suitable means which are capable of processing data, displaying the data, providing inputs, and performing data transmission.
  • the third party device includes but is not limited to personal digital assistant (PDA), smart phone, tablet, computer, laptop, netbook, phoblet, or any suitable means which are capable of processing data, displaying the data, and performing data transmission.
  • PDA personal digital assistant
  • smart phone tablet, computer, laptop, netbook, phoblet, or any suitable means which are capable of processing data, displaying the data, and performing data transmission.
  • Figure 1 is a schematic diagram of a system for detecting abnormal events and disseminating distress signals, which embodies therein the principle features of the invention
  • Figure 2 is a block diagram illustrating the architecture of the system
  • FIG. 3 is a flowchart showing an overview of the camera setup process
  • Figure 4 is a flowchart showing an event trigger process
  • Figure 5 is a flowchart showing a transmission process of notifications generated by the camera
  • FIG. 6 is a flowchart showing homepage management process
  • Figure 7 is a flowchart showing the process of adding a new camera to the
  • Figure 8 is a flowchart showing the process of re-configuring the existing cameras of the system
  • Figure 9 is a flowchart showing live stream management process
  • Figure 10 is a flowchart showing multiple live stream management process
  • Figure 11 is a flowchart showing an image storing process
  • Figure 12 is a flowchart showing an event management process
  • Figure 13 is a flowchart showing an event detail management process
  • Figure 14 is a flowchart showing a video playback process
  • Figure 15 is a flowchart showing a notification management process
  • Figure 16 is a flowchart showing an alarm siren activation process
  • Figure 17 is a flowchart showing a setting management process
  • Figure 18 is a flowchart showing a preset alert message management process
  • Figure 19 is a flowchart showing a preset receiver management process
  • Figure 20 is a flowchart showing further details of the preset receiver management process
  • Figure 21 is a flowchart showing a cloud based storage activation process
  • Figure 22 is a flowchart showing an alarm siren management process
  • Figure 23 is a flowchart showing further details of the alarm siren management process
  • FIG. 24 is a flowchart showing further details of the alarm siren management process
  • Figure 25 is a flowchart showing a removal process of the connected cameras
  • Figure 26 is a flowchart showing a transmission process of the incident report
  • Figure 27 is a flowchart showing the process of viewing alert messages or incident reports through an application or a system homepage;
  • Figure 28 is a flowchart showing the process of authority monitoring on alert messages and incident reports through a webpage or a console.
  • a system for detecting abnormal events and disseminating distress signals as illustrated therein comprises a camera 1 , a plurality of devices 2, 4 having an application installed therein, a user device 2 being one of the plurality of devices that owns the camera 1, a server 3, and a communication network 5.
  • the camera 1 is connected to the communication network 5, configured to record video images upon detecting an object that satisfy a set of predetermined parameters and to generate and transmit a distress signal to the user device 2.
  • the application of the user device 2 upon receiving the distress signal triggers a graphical user interface to display the distress signal and further provides the user with an option for the user disseminating the received distress signal. When the option is being activated, the distress signal will be transmitted to the server 3.
  • the server 3 Upon the server 3 receives the distress signal, it transmits a request to the plurality of devices 4 for retrieving information relating to the location of each devices 4. Followinged by the server 3 determines at least one eligible device that locates within a predetermined radius 6 from the camera 1 and transmits the distress signal to the eligible device 4. The application of the eligible device upon receiving the distress signal triggers the graphical user interface for displaying the distress signal.
  • the plurality of devices 2, 4 can be a personal digital assistant (PDA), a smart phone, a tablet, a computer, a laptop, a notebook, a phablet, or any suitable means which are capable of processing data, displaying the data, and performing data transmission
  • the camera 1 is a surveillance camera mounted in a desired location of a user premise.
  • the camera 1 has a sensory unit 1 1 for capturing video image and a processor for processing the captured image.
  • the processor is coupled with an analysis module 13 for detecting objects from the captured image, an event detection module 14 for determining if any abnormal event occurs, a distress signal generator 18 for generating a distress signal, and a transceiver 19 for transmitting/receiving signals to/from the communication network 5.
  • the event detection module 14 consists of a primary analysis module 15 for determining whether a detected object is a human or non-human object, a secondary analysis module 16 for measuring the time span of the object within a region of interest or the movement speed and direction of the object, and a reasoning module 17 for determining whether the actions of the detected object resemble acts of trespassing, vandalism, nuisance, loitering, slipping/falling, or even abnormal crowd activity.
  • the distress signal generator 18 Upon the detection of an abnormal event, the distress signal generator 18 generates a terrain map carrying a plurality of parameters indicating the contents of the captured image, and then aggregates the captured image, the terrain map, and an alert message to form a distress signal.
  • GPS module 20 can be provided for the server to locate the camera.
  • the user device 2 comprises a display unit 25, means for receiving inputs from the user, a transceiver 26, and a user application 21.
  • the user application 21 includes a graphical user interface 22 for displaying the distress signal, a distress signal triggering module 23 for triggering the graphical user interface 22 upon receiving the distress signal and providing options to the user to disseminate the distress signal, and a camera setting module 24 for customising the settings of the camera 1.
  • the user application may couple with a data encoder/decoder for converting the data into signal or vice versa.
  • the graphical user interface 22 is an interactive platform where video image, alert message, and report can be displayed.
  • the graphical user interface 22 is also being provided with a virtual functional button which the user can trigger to disseminate the distress signal to the surrounding user, the preset user, or to instruct the server 3 to trigger an alarm system.
  • the camera setting module 24 allows the user to customise a set of parameters for the analysis module 13 and the event detection module 14, and to customise information of the distress signal generated by the distress signal generator 18 of the camera 1.
  • the plurality of devices 4 also include an application 41, a display unit 45, and a transceiver 46.
  • Each of the devices 2, 4 further comprises a global positioning system 27, 47 for determining their corresponding location.
  • the server 3 may comprise one or more heavy duty computers for processing the received data and transferring the processed data to the plurality of devices 4 through the communication network 5, and any known devices or group of devices to provide sufficient capacity for storing data.
  • the server 3 includes a device location retrieval module 31 for sending requests to the plurality of devices 4 to retrieve information relating to each of their corresponding location and an eligibility determination module 32 for determining the eligible device to disseminate the distress signal using Euclidean algorithm so as to measure the distance between the camera 1 and the rest of the devices. For example, it determines if a potential rescuer is an eligible receiver by judging if the rescuer is located within a radius of a predetermined distance such as 3 km, from the camera 1.
  • the eligible device could be any one of a next-of-kin of the user or a member of an authority such as a police officer or a member of a neighbourhood watch team predetermined by the user.
  • the server 3 may further comprise a registration module for the user to register to the system.
  • the server 3 may also provide a web page through which the user and the potential rescuer can view the distress signal.
  • the communication network 5 is preferably a wireless network which may include but is not limited to a Code Division Multiple Access (CDMA) network, a General Packet Radio Service (GPRS) network for use in conjunction with Global System for Mobile Communications (GSM) network, and future third-generation (3G) networks like Enhanced Data rates for GSM Evolution (EDGE) and Universal Mobile Telecommunications System (UMTS).
  • CDMA Code Division Multiple Access
  • GPRS General Packet Radio Service
  • GSM Global System for Mobile Communications
  • 3G Third-generation
  • EDGE Enhanced Data rates for GSM Evolution
  • UMTS Universal Mobile Telecommunications System
  • step 101 the cameras are installed at desired locations within the coverage of the
  • each of the cameras is being activated to establish a communication link with the network.
  • the user downloads and installs the user application via his mobile device.
  • the user synchronizes his mobile device with the cameras via the user application.
  • the user application updates the synchronization data to a local database or a cloud database.
  • step 201 when the camera detects an abnormal event, the camera will trigger the recording of video and the capturing of image.
  • the recorded video and image will be saved in a cloud storage and/or a local storage depending on the settings of the camera (steps 202-206).
  • step 201 when the camera detects an abnormal event, the camera will trigger the recording of video and the capturing of image.
  • the recorded video and image will be saved in a cloud storage and/or a local storage depending on the settings of the camera (steps 202-206).
  • the camera updates the server by uploading the recorded event data to the server.
  • the camera pushes a notification to a list of synchronized device.
  • a notification management process is illustrated.
  • step 302 when the camera detects and captures an event (301), the camera through its processor will generate a notification message and transmit it to a list of preset user devices and the server.
  • the server retrieves the event, the image and the video data from the local/cloud database.
  • step 304 the user application upon receiving the notification message generates and displays a notification tab. The user may tap on the notification tab to view the incident.
  • step 305 in the event of the user taps on the notification tab (305), the user application will direct the user to an "event detail" page.
  • step 401 the user application retrieves information relating to the cameras from the local/cloud database.
  • step 402 the user application displays a list of icons, each representing a different camera, and a list of taps, each associated with a different function.
  • step 404 the user application directs the user to a "live stream" page in the event of the user taps on the camera icons.
  • step 405 the user application directs the user to a "add camera” page in the event of the user taps on the add camera tab.
  • step 406 the user application directs the user to an "event" page in the event of the user taps on the event tab.
  • step 407 the user application directs the user to a "settings" page in the event of the user taps on the settings tab.
  • step 408 & 409 the user application prompts the user to choose his designated cameras for display and then directs the user to a "multiple live stream” page in the event of the user taps on the multiple live stream tab.
  • step 501 the user application firstly scans for the camera that is yet to be synchronized. In this step, the unsynchronized cameras must connect to the same network as the user device.
  • step 502 the user application displays the unsynchronized cameras if there is any available.
  • step 503 the user application displays a "not available" message and suggests alternative connection if there is no camera available.
  • step 505 when a camera is chosen (504), the user application prompts the user to scan the barcode of the corresponding camera for accessing the camera settings.
  • step 506 the user application prompts the user to choose their designated connection for the selected camera.
  • step 507 the user application displays a "connection failed" message if the connection is unsuccessful.
  • step 509 the user application prompts the user to fill in information such as mobile phone number, the location of the camera, security ID, email address and etc.
  • step 510 the information is stored in the local/cloud database and updated to the server.
  • step 602 the user application prompts the user to enter the password. If the right password is entered, the application will direct the user to the "camera setting" page. In step 604, the user may choose to hard reset the camera settings. A hard reset guide will be displayed for guiding the user through the reset process.
  • a play button is provided in step 701 for the user to play the video.
  • video are displayed on a window panel (in step 702).
  • a close button is provided in step 703 to close the window panel and return to the homepage.
  • a save image function is provided in step 704 for directing the user to the process of saving the image upon trigger.
  • a send notification button is provided in step 705 for directing the user to the "send notification" page upon trigger.
  • An activate alarm siren button is provided in step 706 for directing the user to the process of activating the alarm siren upon trigger.
  • a multiple live stream management process is shown.
  • step 801 the user application renders the chosen video contents so that multiple videos can be displayed within the window panel.
  • a play button is provided in step 802 for the user to play the videos.
  • An activate alarm siren button is provided in step 803 for directing the user to the process of activating the alarm siren upon trigger.
  • the user may tap on a specific video and the application ⁇ will direct the user to the "live stream" page for displaying the specific video with a higher resolution.
  • an image storing process is shown.
  • two types of database are provided.
  • One is a local data storage such as an internal memory card of the user device and the other one is a cloud based data storage accessible via the communication network.
  • the captured image/video image data will be stored in the local data storage and simultaneously uploaded to the cloud based data storage.
  • steps 903 & 904 the user application will display a message indicating whether the image is saved successfully.
  • step 1001 the user application retrieves the event data from the local database or the cloud database.
  • step 1002 the user application will display a no data available message if no event data is detected.
  • step 1003 the user application displays a list of all the found events.
  • step 1004 if the user taps on an event, the application will direct the user to the "event detail" page that displays the details of the selected event.
  • a delete event button and a delete media storage button are provided in steps 1005 & 1006 for the user to delete a selected event and its corresponding media data from the databases.
  • step 1101 the user application displays details of the selected event.
  • step 1 102 the user may tap on the image for viewing the image at a higher resolution.
  • a playback button is provided in step 1103 for directing the user to the "playback” page.
  • a live stream button is provided in step 1104 for directing the user to the "live stream” page.
  • a activate alarm siren button is provided in step 1105 for directing the user to the alarm siren activation process.
  • a send notification button is provided in step 1 106 for directing the user to the "send notification" page.
  • step 1201 the user application retrieves selected video from either the cloud data storage/local data storage.
  • step 1202 the user application plays the video if it is available.
  • step 1203 the user application displays a message indicating the video is not available.
  • a send notification management process is shown.
  • the user application retrieves preset alert message from the local database.
  • the user application prompts the user to edit the alert message.
  • step 1303 the user application provides a button for the user to trigger and send the alert message to the preset user via short message service.
  • step 1304 the user application will direct the user to "add preset receiver" page if no receiver exist.
  • steps 1305 & 1306 the user application performs the transmission of the alert message and displays a message denoting that the message is successfully sent.
  • the user application provides a button for the user to trigger and send the alert message to surrounding receivers.
  • the user application transmits the alert message to the server.
  • an alarm siren management process is shown.
  • a button for the user to deactivate the alarm is provided in step 1401 and another button is provided in step 1402 for the user to activate the alarm.
  • a preset alert message button is provided in step 1501 for directing the user to the "preset alert message” page.
  • a preset receiver button is provided in step 1502 for directing the user to the "preset receiver” page.
  • An image storage button is provided in step 1503 for directing the user to the "image storage setting” page.
  • An alarm siren button is provided in step 1504 for directing the user to the "alarm siren setting” page.
  • a delete camera button is provided in step 1505 for directing the user to "delete camera” page.
  • a preset alert message management process is shown. In step 1601, the user application retrieves preset alert message from the local database.
  • step 1602 the user application prompts the user to edit the message.
  • step 1603 if the entry of the message is empty, the user application will display a message to warn the user.
  • steps 1604 & 1605 if the user application has saved the edited message, it displays a message denoting the edited message is successfully saved and updates the edited message to the local database.
  • a preset receiver management process is shown.
  • the user application retrieves the camera data from the local database.
  • the user application displays the camera data for the user to choose.
  • the user application retrieves preset receiver data from the local database.
  • the user application displays the preset receiver data if it exists.
  • the user application displays a message denoting the request data is not available.
  • the user can add a new preset receiver by entering the details of the preset receiver.
  • the user can edit the preset receiver by changing the details of the preset receiver.
  • a delete button is provided for the user to delete the selected preset receiver.
  • the user application updates the local database with the changes.
  • step 1501 A button for the user to activate the cloud based data storage is provided in step 1501 and another button is provided in step 1903 for the user to deactivate the cloud based data storage.
  • step 1902 the user is provided with links to supported cloud based data storage for the user to choose.
  • step 1904 the user application updates the changes to the local database.
  • an alarm siren setting process is shown.
  • the user application provides functional buttons for the user to activate or deactivate the automation in sounding the alarm siren.
  • the user application will prompt the user to choose the siren duration when event is detected and the changes will be updated to the local database in step 2004.
  • the automation of the alarm siren can be set to operate 24 hours and the user application further updates the changes to the local database in step 2102.
  • the user application will display the current alarm schedule if the user chosen not to always have the auto-siren.
  • the user can add a new alarm schedule by entering the details.
  • the user can edit the current alarm schedule by changing the details of the current schedule.
  • a delete button is provided for the user to delete an alarm schedule.
  • the user application updates the local database with the changes.
  • a process of deleting the camera is shown.
  • the user application retrieves camera information from the local database.
  • the user application displays the camera information if any.
  • the user may tap on a camera for its deletion and the user application prompts the user to confirm the deletion.
  • the user application updates the local data upon receiving the confirmation from user.
  • a process of reporting an incident is shown.
  • the surveillance camera detects an abnormal activity, it will automatically record video images and transmit a distress signal together with the recorded video images to the user.
  • the user upon receiving the distress signal has an option for the user to disseminate the received distress signal.
  • a user can also report on suspicious activities by tapping on the "REPORT" button.
  • the user is then redirected to the "report" page and is required to fill in report details such as the incident description, location details of the incident or attach images from the incident (2401).
  • a report successfully sent message is displayed (2404) to the user to indicate that the report event is successfully inserted into the server database (2405).
  • the server fetches user's next of kin as well as the nearby users (2406), by computing the distance between the camera and other surrounding users or authorities via the Euclidean algorithm, and adds them into the alert list (2407).
  • Notification will then be pushed to the preset users (2408) or surrounding users so that they can provide help as soon as possible.
  • a user who is within the predetermined distance can view the alert or report detail through a web portable or their respective device application.
  • the flow of this viewing process is shown in FIG. 27.
  • Information such as the time, description location details, and also image of the incident from reports is shown in the "detail" page.
  • the user also has the option to choose preinstalled navigation applications (2504) such as Google Map, Waze or Apple Maps to navigate to the location of incident by tapping on the location cursor on the map in "detail” page.
  • Alert messages, reports, and video images captured on the incident that are sent by camera can be monitored by police administrators from a control centre. This process is shown in FIG. 28.
  • the incident Whenever there is an emergency triggered or report sent from public, the incident is inserted into the server database.
  • the server will then receive the incident's information from database (2601) and display it in the Incident List tab.

Abstract

A system for detecting an abnormal event and disseminating a distress signal comprises a camera (1) for capturing images, a processor coupled to the camera (1), configured to analyze the captured images for identifying at least one object, determine if the detected object satisfies a set of parameters, generate and transmit the distress signal to a communication network (5) in the event of the detected object satisfied the set of parameters, a user device (2) having an user application (21) configured to receive the distress signal from the communication network (5), provide a graphical user interface to display the distress signal, provide an option initiateable by user of the user device (2) to transmit the distress signal to a server (3), and a plurality of third party devices (4) connected to the communication network (5), each having an third party application (41) configured to transmit information relating to location of the corresponding third party device (4) to the server (3) upon a request by the server (3), wherein the server (3) is configured to receive the distress signal from the user device (2), retrieve information relating to the location of each third party device (4) upon receiving the distress signal, determine surrounding third party device, and transmit the distress signal to the surrounding third party device, and wherein third party application (41) triggers a graphical user interface for displaying the distress signal upon receiving it from the server (3).

Description

A REAL-TIME INTELLIGENT VIDEO CAMERA SYSTEM
FIELD OF INVENTION
This invention relates to a camera system. More particularly, the invention relates to a system for detecting abnormal events, disseminating distress signals and triggering alarm siren. For the purposes of this application the following definitions apply:
a) the term "user" is referring to a person who owns the camera and triggers the distress signal; and
b) the term "third party user" is referring to a person who receives the distress signal;
BACKGROUND OF THE INVENTION
Over the years, there are a few patented technologies over the prior art relating to video surveillance system. Of interest in respect to a video surveillance system is illustrated in US Patent No. 4814869 A. This patent discloses a video surveillance system comprises a plurality of video cameras, means for modulating signals from each camera, means for multiplexing said modulated signals onto a path capable of carrying a plurality of video channels, a signal splitter which provides the signals on said path in parallel to a plurality of video displays each comprising a tuner and a display screen, and a computer connected to said tuners and comprising means for controlling at least one of said tuners so as to display on its display screen a sequence of images from different video cameras.
Another US patent No. 7012520 B2 discloses a security system for monitoring a plurality of assets comprises a plurality of agents, each one of said plurality of agents connected with an asset, each said plurality of agents comprises a sensor for monitoring a physical condition of the corresponding one of said plurality of assets; a processor for collecting and processing the physical condition data to produce an asset security data; a communication device for transmitting and receiving data; and a wireless communication channel for communicating between the plurality of agents via a virtual network, wherein one of the plurality of agents is assigned as a primary agent to receive the plurality of asset security data from the plurality of agents and transmit the plurality of asset security data to the master control unit; a master control unit for receiving the plurality of asset security data from the plurality of agents; and a global operations center in communication with the master control unit for receiving the plurality of asset security data retransmitted from the master control unit and analyzing the plurality of asset security data to detect a security threat. Existing systems and methods suffer from a number of drawbacks. These systems lack the ability to identify abnormal events and to trigger signals to the owner upon detection of the abnormality. Furthermore, they are not developed to determine electronic devices which are located, at the moment of incident, within a radius from the surveillance camera so as to warn the surrounding peoples and to seek for potential rescuer. They also lack the ability to report on incidents, more especially, by attaching image or video, which could serve as evidence in prosecution.
Therefore there exists a need for the prior system to overcome the above mentioned drawbacks. The present invention provides such a system.
SUMMARY OF INVENTION
The invention provides a system for detecting an abnormal event and disseminating a distress signal comprises a camera for capturing images, a processor coupled to the camera, configured to analyze the captured images for identifying at least one object, determine if the detected object satisfies a set of parameters, generate and transmit the distress signal to a communication network in the event of the detected object satisfied the set of parameters, a plurality of devices connected to the communication network, each having an application configured to transmit information relating to location of the corresponding third party device to a server upon a request by the server, wherein the server is configured to receive the distress signal from the communication network, retrieve information relating to the location of each device upon receiving the distress signal, determine at least one eligible device which satisfies a preset condition, and transmit the distress signal to the eligible device, and wherein the application of the eligible devices triggers a graphical user interface for displaying the distress signal upon receiving it from the server. In addition, the system further comprises a voice recorder coupled to the camera for capturing voice inputs.
In addition, the system further comprises a vibration sensor coupled to the camera for detecting vibrations of the surroundings.
Preferably, the processor further generates a terrain map from the captured image in the event of the detected object satisfied the set of parameters, and the terrain map may comprise a plurality of parameters indicating the content of the captured images. Preferably, the processor includes a primary analysis module for human and/or non- human object recognition, a secondary analysis module for measuring the movement of object, and a reasoning module for object activity recognition.
In addition, an alarm system can be connected to the communication network for sounding the alarm sound upon receiving instruction from the server.
Preferably, the distress signal includes an alert message, the captured images, the captured voice input, the detected vibration data, the terrain map, or any combination thereof.
Preferably, the preset condition is any device that locates within a predetermined distance from the location of the camera. The preset condition may also include a set of preset eligible devices being customizable via the application of the user device.
Alternatively, the system further comprises a user device being one of the plurality of devices that the owner of the camera is currently using, wherein the set of parameters and the preset condition are customizable via the application of the user device. Preferably, the devices include but are not limited to personal digital assistants (PDA), smart phones, tablets, computers, laptops, notebooks, phablets, or any suitable means which capable of processing data, displaying the data, and performing data transmission. Preferably, the camera is accessible via barcode verification.
In a second embodiment of the invention, it provides a system for detecting an abnormal event and disseminating a distress signal comprises a camera for capturing images, a processor coupled to the camera, configured to analyze the captured images for identifying at least one object, determine if the detected object satisfies a set of parameters, generate and transmit the distress signal to a communication network in the event of the detected object satisfied the set of parameters, a user device having an user application configured to receive the distress signal from the communication network, provide a graphical user interface to display the distress signal, provide an option initiateable by user of the user device to transmit the distress signal to a server, and a plurality of third party devices connected to the communication network, each having a third party application configured to transmit information relating to location of the corresponding third party device to the server upon a request by the server, wherein the server is configured to receive the distress signal from the user device, retrieve information relating to the location of each third party device upon receiving t e distress signal, determine at least one eligible third party device which satisfies a preset condition, and transmit the distress signal to the eligible third party device, and wherein the third party application triggers a graphical user interface for displaying the distress signal upon receiving it from the server.
Preferably, the set of parameter is customizable by the user of the user device via the user application. Preferably, the preset condition is any third party device that locates within a predetermined distance from the location of the camera.
Preferably, the user device includes but is not limited to personal digital assistant (PDA), smart phone, tablet, computer, laptop, netbook, phoblet, or any suitable means which are capable of processing data, displaying the data, providing inputs, and performing data transmission.
Preferably, the third party device includes but is not limited to personal digital assistant (PDA), smart phone, tablet, computer, laptop, netbook, phoblet, or any suitable means which are capable of processing data, displaying the data, and performing data transmission.
One skilled in the art will readily appreciate that the invention is well adapted to carry out the objects and obtain the ends and advantages mentioned, as well as those inherent therein. The embodiments described herein are not intended as limitations on the scope of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
For the purpose of facilitating an understanding of the invention, there is illustrated in the accompanying drawing the preferred embodiments from an inspection of which when considered in connection with the following description, the invention, it's construction and operation and many of its advantages would be readily understood and appreciated.
Figure 1 is a schematic diagram of a system for detecting abnormal events and disseminating distress signals, which embodies therein the principle features of the invention;
Figure 2 is a block diagram illustrating the architecture of the system;
Figure 3 is a flowchart showing an overview of the camera setup process;
Figure 4 is a flowchart showing an event trigger process;
Figure 5 is a flowchart showing a transmission process of notifications generated by the camera;
Figure 6 is a flowchart showing homepage management process;
Figure 7 is a flowchart showing the process of adding a new camera to the
system; Figure 8 is a flowchart showing the process of re-configuring the existing cameras of the system; Figure 9 is a flowchart showing live stream management process;
Figure 10 is a flowchart showing multiple live stream management process;
Figure 11 is a flowchart showing an image storing process;
Figure 12 is a flowchart showing an event management process;
Figure 13 is a flowchart showing an event detail management process; Figure 14 is a flowchart showing a video playback process;
Figure 15 is a flowchart showing a notification management process;
Figure 16 is a flowchart showing an alarm siren activation process;
Figure 17 is a flowchart showing a setting management process;
Figure 18 is a flowchart showing a preset alert message management process; Figure 19 is a flowchart showing a preset receiver management process;
Figure 20 is a flowchart showing further details of the preset receiver management process; Figure 21 is a flowchart showing a cloud based storage activation process;
Figure 22 is a flowchart showing an alarm siren management process; Figure 23 is a flowchart showing further details of the alarm siren management process;
Figure 24 is a flowchart showing further details of the alarm siren management process;
Figure 25 is a flowchart showing a removal process of the connected cameras;
Figure 26 is a flowchart showing a transmission process of the incident report; Figure 27 is a flowchart showing the process of viewing alert messages or incident reports through an application or a system homepage; and
Figure 28 is a flowchart showing the process of authority monitoring on alert messages and incident reports through a webpage or a console.
DETAILED DESCRIPTION OF THE INVENTION
The present invention is described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, that execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
Referring to Fig. 1 , a system for detecting abnormal events and disseminating distress signals as illustrated therein comprises a camera 1 , a plurality of devices 2, 4 having an application installed therein, a user device 2 being one of the plurality of devices that owns the camera 1, a server 3, and a communication network 5. In operation, the camera 1 is connected to the communication network 5, configured to record video images upon detecting an object that satisfy a set of predetermined parameters and to generate and transmit a distress signal to the user device 2. The application of the user device 2 upon receiving the distress signal triggers a graphical user interface to display the distress signal and further provides the user with an option for the user disseminating the received distress signal. When the option is being activated, the distress signal will be transmitted to the server 3. Upon the server 3 receives the distress signal, it transmits a request to the plurality of devices 4 for retrieving information relating to the location of each devices 4. Followed by the server 3 determines at least one eligible device that locates within a predetermined radius 6 from the camera 1 and transmits the distress signal to the eligible device 4. The application of the eligible device upon receiving the distress signal triggers the graphical user interface for displaying the distress signal. The plurality of devices 2, 4 can be a personal digital assistant (PDA), a smart phone, a tablet, a computer, a laptop, a notebook, a phablet, or any suitable means which are capable of processing data, displaying the data, and performing data transmission
Referring to Fig. 2, a general architecture of the system is illustrated. Preferably, the camera 1 is a surveillance camera mounted in a desired location of a user premise. The camera 1 has a sensory unit 1 1 for capturing video image and a processor for processing the captured image. The processor is coupled with an analysis module 13 for detecting objects from the captured image, an event detection module 14 for determining if any abnormal event occurs, a distress signal generator 18 for generating a distress signal, and a transceiver 19 for transmitting/receiving signals to/from the communication network 5. The event detection module 14 consists of a primary analysis module 15 for determining whether a detected object is a human or non-human object, a secondary analysis module 16 for measuring the time span of the object within a region of interest or the movement speed and direction of the object, and a reasoning module 17 for determining whether the actions of the detected object resemble acts of trespassing, vandalism, nuisance, loitering, slipping/falling, or even abnormal crowd activity. Upon the detection of an abnormal event, the distress signal generator 18 generates a terrain map carrying a plurality of parameters indicating the contents of the captured image, and then aggregates the captured image, the terrain map, and an alert message to form a distress signal. GPS module 20 can be provided for the server to locate the camera.
Preferably, the user device 2 comprises a display unit 25, means for receiving inputs from the user, a transceiver 26, and a user application 21. The user application 21 includes a graphical user interface 22 for displaying the distress signal, a distress signal triggering module 23 for triggering the graphical user interface 22 upon receiving the distress signal and providing options to the user to disseminate the distress signal, and a camera setting module 24 for customising the settings of the camera 1. The user application may couple with a data encoder/decoder for converting the data into signal or vice versa. The graphical user interface 22 is an interactive platform where video image, alert message, and report can be displayed. The graphical user interface 22 is also being provided with a virtual functional button which the user can trigger to disseminate the distress signal to the surrounding user, the preset user, or to instruct the server 3 to trigger an alarm system. The camera setting module 24 allows the user to customise a set of parameters for the analysis module 13 and the event detection module 14, and to customise information of the distress signal generated by the distress signal generator 18 of the camera 1. Similar to the user device 2, the plurality of devices 4 also include an application 41, a display unit 45, and a transceiver 46. Each of the devices 2, 4 further comprises a global positioning system 27, 47 for determining their corresponding location.
The server 3 may comprise one or more heavy duty computers for processing the received data and transferring the processed data to the plurality of devices 4 through the communication network 5, and any known devices or group of devices to provide sufficient capacity for storing data. The server 3 includes a device location retrieval module 31 for sending requests to the plurality of devices 4 to retrieve information relating to each of their corresponding location and an eligibility determination module 32 for determining the eligible device to disseminate the distress signal using Euclidean algorithm so as to measure the distance between the camera 1 and the rest of the devices. For example, it determines if a potential rescuer is an eligible receiver by judging if the rescuer is located within a radius of a predetermined distance such as 3 km, from the camera 1. The eligible device could be any one of a next-of-kin of the user or a member of an authority such as a police officer or a member of a neighbourhood watch team predetermined by the user. The server 3 may further comprise a registration module for the user to register to the system. The server 3 may also provide a web page through which the user and the potential rescuer can view the distress signal.
The communication network 5 is preferably a wireless network which may include but is not limited to a Code Division Multiple Access (CDMA) network, a General Packet Radio Service (GPRS) network for use in conjunction with Global System for Mobile Communications (GSM) network, and future third-generation (3G) networks like Enhanced Data rates for GSM Evolution (EDGE) and Universal Mobile Telecommunications System (UMTS). It is to be understood that although particular IP-based wireless networks have been described, the system could be utilized in any suitable type of wireless network. It should also be noted that the communication network 5 can be a wired network such as telephone network, cable television, internet access, or fiber-optic communication.
Referring to Fig. 3, a setup overview of the user application is illustrated. In step 101, the cameras are installed at desired locations within the coverage of the
communication network. In step 102, each of the cameras is being activated to establish a communication link with the network. In step 103, the user downloads and installs the user application via his mobile device. In step 104, the user synchronizes his mobile device with the cameras via the user application. In step 105, the user application updates the synchronization data to a local database or a cloud database.
Referring to Fig. 4, an event trigger process is illustrated. In step 201, when the camera detects an abnormal event, the camera will trigger the recording of video and the capturing of image. The recorded video and image will be saved in a cloud storage and/or a local storage depending on the settings of the camera (steps 202-206). In step
207, the camera updates the server by uploading the recorded event data to the server. In step 208, the camera pushes a notification to a list of synchronized device.
Referring to Fig. 5, a notification management process is illustrated. In step 302, when the camera detects and captures an event (301), the camera through its processor will generate a notification message and transmit it to a list of preset user devices and the server. In step 303, the server retrieves the event, the image and the video data from the local/cloud database. In step 304, the user application upon receiving the notification message generates and displays a notification tab. The user may tap on the notification tab to view the incident. In step 305, in the event of the user taps on the notification tab (305), the user application will direct the user to an "event detail" page.
Referring to Fig. 6, a homepage management process is illustrated. In step 401, the user application retrieves information relating to the cameras from the local/cloud database. In step 402, the user application displays a list of icons, each representing a different camera, and a list of taps, each associated with a different function. In step 404, the user application directs the user to a "live stream" page in the event of the user taps on the camera icons. In step 405, the user application directs the user to a "add camera" page in the event of the user taps on the add camera tab. In step 406, the user application directs the user to an "event" page in the event of the user taps on the event tab. In step 407, the user application directs the user to a "settings" page in the event of the user taps on the settings tab. In step 408 & 409, the user application prompts the user to choose his designated cameras for display and then directs the user to a "multiple live stream" page in the event of the user taps on the multiple live stream tab.
Referring to Fig. 7, a process of adding a new camera is illustrated. In step 501, the user application firstly scans for the camera that is yet to be synchronized. In this step, the unsynchronized cameras must connect to the same network as the user device. In step 502, the user application displays the unsynchronized cameras if there is any available. In step 503, the user application displays a "not available" message and suggests alternative connection if there is no camera available. In step 505, when a camera is chosen (504), the user application prompts the user to scan the barcode of the corresponding camera for accessing the camera settings. In step 506, the user application prompts the user to choose their designated connection for the selected camera. In step 507, the user application displays a "connection failed" message if the connection is unsuccessful. In step 509, the user application prompts the user to fill in information such as mobile phone number, the location of the camera, security ID, email address and etc. In step 510, the information is stored in the local/cloud database and updated to the server.
Referring to Fig. 8, a process of the reconfiguration of the existing cameras is shown. In step 602, the user application prompts the user to enter the password. If the right password is entered, the application will direct the user to the "camera setting" page. In step 604, the user may choose to hard reset the camera settings. A hard reset guide will be displayed for guiding the user through the reset process.
Referring to Fig. 9, a live stream management process is shown. A play button is provided in step 701 for the user to play the video. Preferably, video are displayed on a window panel (in step 702). A close button is provided in step 703 to close the window panel and return to the homepage. A save image function is provided in step 704 for directing the user to the process of saving the image upon trigger. A send notification button is provided in step 705 for directing the user to the "send notification" page upon trigger. An activate alarm siren button is provided in step 706 for directing the user to the process of activating the alarm siren upon trigger. Referring to Fig. 10, a multiple live stream management process is shown. In step 801, the user application renders the chosen video contents so that multiple videos can be displayed within the window panel. A play button is provided in step 802 for the user to play the videos. An activate alarm siren button is provided in step 803 for directing the user to the process of activating the alarm siren upon trigger. In step 804, the user may tap on a specific video and the application · will direct the user to the "live stream" page for displaying the specific video with a higher resolution.
Referring to Fig. 11, an image storing process is shown. Preferably, two types of database are provided. One is a local data storage such as an internal memory card of the user device and the other one is a cloud based data storage accessible via the communication network. In steps 901 & 902, the captured image/video image data will be stored in the local data storage and simultaneously uploaded to the cloud based data storage. In steps 903 & 904, the user application will display a message indicating whether the image is saved successfully.
Referring to Fig. 12, an event management process is shown. In step 1001, the user application retrieves the event data from the local database or the cloud database. In step 1002, the user application will display a no data available message if no event data is detected. In step 1003, the user application displays a list of all the found events. In step 1004, if the user taps on an event, the application will direct the user to the "event detail" page that displays the details of the selected event. A delete event button and a delete media storage button are provided in steps 1005 & 1006 for the user to delete a selected event and its corresponding media data from the databases.
Referring to Fig. 13, an "event detail" page management process is shown. In step 1101, the user application displays details of the selected event. In step 1 102, the user may tap on the image for viewing the image at a higher resolution. A playback button is provided in step 1103 for directing the user to the "playback" page. A live stream button is provided in step 1104 for directing the user to the "live stream" page. A activate alarm siren button is provided in step 1105 for directing the user to the alarm siren activation process. A send notification button is provided in step 1 106 for directing the user to the "send notification" page. Referring to Fig. 14, a playback process is illustrated. In step 1201, the user application retrieves selected video from either the cloud data storage/local data storage. In step 1202, the user application plays the video if it is available. In step 1203, the user application displays a message indicating the video is not available. Referring to Fig. 15, a send notification management process is shown. In step 1301, the user application retrieves preset alert message from the local database. In step 1302, the user application prompts the user to edit the alert message. In step 1303, the user application provides a button for the user to trigger and send the alert message to the preset user via short message service. In step 1304, the user application will direct the user to "add preset receiver" page if no receiver exist. In steps 1305 & 1306, the user application performs the transmission of the alert message and displays a message denoting that the message is successfully sent. In step 1307, the user application provides a button for the user to trigger and send the alert message to surrounding receivers. In step 1308, the user application transmits the alert message to the server.
Referring to Fig. 16, an alarm siren management process is shown. A button for the user to deactivate the alarm is provided in step 1401 and another button is provided in step 1402 for the user to activate the alarm.
Referring to Fig. 17, a setting management process is shown. A preset alert message button is provided in step 1501 for directing the user to the "preset alert message" page. A preset receiver button is provided in step 1502 for directing the user to the "preset receiver" page. An image storage button is provided in step 1503 for directing the user to the "image storage setting" page. An alarm siren button is provided in step 1504 for directing the user to the "alarm siren setting" page. A delete camera button is provided in step 1505 for directing the user to "delete camera" page. Referring to Fig. 18, a preset alert message management process is shown. In step 1601, the user application retrieves preset alert message from the local database. In step 1602, the user application prompts the user to edit the message. In step 1603, if the entry of the message is empty, the user application will display a message to warn the user. In steps 1604 & 1605, if the user application has saved the edited message, it displays a message denoting the edited message is successfully saved and updates the edited message to the local database.
Referring to Fig. 19 & Fig. 20, a preset receiver management process is shown. In step 1701, the user application retrieves the camera data from the local database. In step 1702, the user application displays the camera data for the user to choose. In step 1704, the user application retrieves preset receiver data from the local database. In step 1706, the user application displays the preset receiver data if it exists. In steps 1703 & 1705, the user application displays a message denoting the request data is not available. In step 1801, the user can add a new preset receiver by entering the details of the preset receiver. In step 1802, the user can edit the preset receiver by changing the details of the preset receiver. In step 1803, a delete button is provided for the user to delete the selected preset receiver. In steps 1804 & 1805, the user application updates the local database with the changes.
Referring to Fig. 21, an image storage settings process is shown. A button for the user to activate the cloud based data storage is provided in step 1501 and another button is provided in step 1903 for the user to deactivate the cloud based data storage. In step 1902, the user is provided with links to supported cloud based data storage for the user to choose. In step 1904, the user application updates the changes to the local database.
Referring to Fig. 22 to 24, an alarm siren setting process is shown. In steps 2001 & 2002, the user application provides functional buttons for the user to activate or deactivate the automation in sounding the alarm siren. In step 2003, if the automation of the alarm siren is set to OFF, the user application will prompt the user to choose the siren duration when event is detected and the changes will be updated to the local database in step 2004. In step 2101, the automation of the alarm siren can be set to operate 24 hours and the user application further updates the changes to the local database in step 2102. In step 2201, the user application will display the current alarm schedule if the user chosen not to always have the auto-siren. In step 2202, the user can add a new alarm schedule by entering the details. In step 2203, the user can edit the current alarm schedule by changing the details of the current schedule. In step 2204, a delete button is provided for the user to delete an alarm schedule. In steps 2205 & 2206, the user application updates the local database with the changes.
Referring to Fig. 25, a process of deleting the camera is shown. In step 2301, the user application retrieves camera information from the local database. In step 2302, the user application displays the camera information if any. In step 2304, the user may tap on a camera for its deletion and the user application prompts the user to confirm the deletion. In step 2305, the user application updates the local data upon receiving the confirmation from user. Referring to Fig. 26, a process of reporting an incident is shown. When the surveillance camera detects an abnormal activity, it will automatically record video images and transmit a distress signal together with the recorded video images to the user. The user upon receiving the distress signal has an option for the user to disseminate the received distress signal. A user can also report on suspicious activities by tapping on the "REPORT" button. The user is then redirected to the "report" page and is required to fill in report details such as the incident description, location details of the incident or attach images from the incident (2401). The report can only be sent when there is at least one field filled in (2402 = NO). Once the report is sent, a report successfully sent message is displayed (2404) to the user to indicate that the report event is successfully inserted into the server database (2405). Then, the server fetches user's next of kin as well as the nearby users (2406), by computing the distance between the camera and other surrounding users or authorities via the Euclidean algorithm, and adds them into the alert list (2407). Notification will then be pushed to the preset users (2408) or surrounding users so that they can provide help as soon as possible.
In the system, a user who is within the predetermined distance can view the alert or report detail through a web portable or their respective device application. The flow of this viewing process is shown in FIG. 27. Information such as the time, description location details, and also image of the incident from reports is shown in the "detail" page. The user also has the option to choose preinstalled navigation applications (2504) such as Google Map, Waze or Apple Maps to navigate to the location of incident by tapping on the location cursor on the map in "detail" page.
Alert messages, reports, and video images captured on the incident that are sent by camera can be monitored by police administrators from a control centre. This process is shown in FIG. 28. Whenever there is an emergency triggered or report sent from public, the incident is inserted into the server database. The server will then receive the incident's information from database (2601) and display it in the Incident List tab. The incident is displayed as a pointer in the console map (2602). If the police user clicks on the particular incident either on the map or the incident list (2603 = YES), it will show the details of the incident such as GPS coordinates, alarm sending time, and a message describing the event and address (2604). If the police user clicks on disarm emergency button for a particular incident (2605 = YES), it disarms the incident and removes it from incident list and console map (2606). The status of the incident is updated to disarm in the server database (2607) to indicate that the incident is no longer in active. The present disclosure includes as contained in the appended claims, as well as that of the foregoing description. Although this invention has been described in its preferred form with a degree of particularity, it is understood that the present disclosure of the preferred form has been made only by way of example and that numerous changes in the details of construction and the combination and arrangements of parts may be resorted to without departing from the scope of the invention.

Claims

1. A system for detecting an abnormal event and disseminating a distress signal comprising:
a camera (1) for capturing images;
a processor coupled to the camera (1), configured to analyze the captured images for identifying at least one object, determine if the detected object satisfies a set of
Parameters generate and transmit the distress signal to a communication network (5) in the event of the detected object satisfied the set of parameters;
a plurality of devices (2, 4) connected to the communication network (5), each having an application (21, 41) configured to transmit information relating to location of the corresponding third party device (4) to a server (3) upon a request by the server (3); wherein the server (3) is configured to receive the distress signal from the
communication network (5), retrieve information relating to the location of each device (2, 4) upon receiving the distress signal, determine at least one eligible device which satisfies a preset condition, and transmit the distress signal to the eligible device;
and wherein the application (21, 41) of the devices (2, 4) triggers a graphical user Interface for displaying the distress signal upon receiving it from the server (3).
2. A system according claim 1, further comprising a voice recorder coupled to the camera (1) for capturing voice inputs.
3. A system according claim 1 or claim 2, further comprising a vibration sensor coupled to the camera (1) for detecting vibrations of the surroundings.
4. A system according to any one of claims 1 to 3, wherein the processor further generates a terrain map from the captured image in the event of the detected object satisfied the set of parameters.
5. A system according to any one of claims 1 to 4, wherein the terrain map comprises a plurality of parameters indicating the content of the captured images.
6. A system according to any one of claims 1 to 5, wherein the processor includes a primary analysis module (15) for human and/or non-human object recognition, a secondary analysis module (16) for measuring the movement of object, and a reasoning module (17) for object activity recognition.
7. A system according to any one of claims 1 to 6, wherein the distress signal includes an alert message, the captured images, the captured voice input, the detected vibration data, the terrain map, or any combination thereof.
8. A system according to any one of claims 1 to 7, further comprising an alarm system connected to the communication network (5) for sounding the alarm upon receiving instruction from the server (3).
9. A system according to any one of claims 1 to 8, wherein the preset condition is any Device (2, 4) that locates within a predetermined distance from the location of the camera (1).
10. A system according to any one of claims 1 to 9, further comprising a user device (2) being one of the plurality of devices (2, 4) that the owner of the camera (1) is currently using, wherein the set of parameters and the preset condition are customisable via the application (21) of the user device (2).
11. A system according to any one of claims 1 to 10, wherein the devices (2, 4) are personal digital assistants (PDA), smart phones, tablets, computers, laptops, notebooks, phablets, or any suitable means which capable of processing data, displaying the data, and performing data transmission.
12. A system according to any one of claims 1 to 11, wherein the camera (1) is accessible via barcode verification.
13. A system for detecting an abnormal event and disseminating a distress signal comprising:
a camera (1) for capturing images;
a processor coupled to the camera (1), configured to analyse the captured images for identifying at least one object, determine if the detected object satisfies a set of parameters, generate and transmit the distress signal to a communication network (5) in the event of the detected object satisfied the set of parameters;
a user device (2) having an user application (21) configured to receive the distress signal from the communication network (5), provide a graphical user interface to display the distress signal, provide an option initiateable by user of the user device (2) to transmit the distress signal to a server (3); and
a plurality of third party devices (4) connected to the communication network (5), each having an third party application (41) configured to transmit information relating to location of the corresponding third party device (4) to the server (3) upon a request by the server (3);
wherein the server (3) is configured to receive the distress signal from the user device (2), retrieve information relating to the location of each third party device (4) upon receiving the distress signal, determine at least one eligible third party device which satisfies a preset condition, and transmit the distress signal to the eligible third party device;
and wherein the third party application (41) triggers a graphical user interface for displaying the distress signal upon receiving it from the server (3).
14. A system according claim 13, further comprising a voice recorder coupled to the camera (1) for capturing voice inputs.
15. A system according claim 13 or claim 14, further comprising a vibration sensor 5 coupled to the camera (1) for detecting vibrations of the surroundings.
16. A system according to any one of claims 13 to 15, wherein the processor further generates a terrain map from the captured image in the event of the detected object satisfied the set of parameters.
10
17. A system according to any one of claims 13 to 16, wherein the terrain map comprises a plurality of parameters indicating the content of the captured images.
18. A system according to any one of claims 13 to 17, wherein the processor includes 15 a primary analysis module (15) for human and/or non-human object recognition, a secondary analysis module (16) for measuring the movement of object, and a reasoning module (17) for object activity recognition.
19. A system according to any one of claims 13 to 18, further comprising an alarm 20 system connected to the communication network (5) for sounding the alarm upon
receiving instruction from the server (3).
20. A system according to claim 19, wherein the application provides a button option for the user to instruct the server for sounding the alarm.
25
21. A system according to any one of claims 13 to 20, wherein the distress signal includes an alert message, the captured images, the captured voice input, the detected vibration data, the terrain map, or any combination thereof.
22. A system according to any one of claims 13 to 20, wherein the preset condition is any third party device (4) that locates within a predetermined distance from the location of the camera (1).
23. A system according to any one of claims 13 to 22, wherein the user device (1) is personal digital assistant (PDA), smart phone, tablet, computer, laptop, notebook, phablet, or any suitable means which capable of processing data, displaying the data, providing inputs, and performing data transmission.
24. A system according to any one of claims 13 to 23, wherein the third party device
(3) is personal digital assistant (PDA), smart phone, tablet, computer, laptop, notebook, phablet, or any suitable means which capable of processing data, displaying the data, and performing data transmission.
25. A system according to any one of claims 13 to 24, wherein the camera (1) is accessible via barcode verification.
PCT/MY2016/000059 2015-09-18 2016-09-15 A real-time intelligent video camera system WO2017048115A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
MYPI2015703278 2015-09-18
MYPL2015703278 2015-09-18

Publications (1)

Publication Number Publication Date
WO2017048115A1 true WO2017048115A1 (en) 2017-03-23

Family

ID=57354425

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2016/000059 WO2017048115A1 (en) 2015-09-18 2016-09-15 A real-time intelligent video camera system

Country Status (1)

Country Link
WO (1) WO2017048115A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109698768A (en) * 2018-12-26 2019-04-30 广东中安金狮科创有限公司 Equipment monitoring apparatus and its monitoring method, readable storage medium storing program for executing
CN110020079A (en) * 2017-12-01 2019-07-16 北京京东尚科信息技术有限公司 Data processing method, system, electronic equipment and computer readable storage medium
US10909333B2 (en) 2017-11-07 2021-02-02 Carrier Corporation Machine interpretation of distress situations using body language

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4814869A (en) 1987-04-27 1989-03-21 Oliver Jr Robert C Video surveillance system
US7012520B2 (en) 2003-06-17 2006-03-14 Infraegis, Inc. Global intelligent remote detection system
WO2011060388A1 (en) * 2009-11-13 2011-05-19 Zoll Medical Corporation Community-based response system
US20150049190A1 (en) * 2013-08-13 2015-02-19 Sensormatic Electronics, LLC System and Method for Video/Audio and Event Dispatch Using Positioning System

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4814869A (en) 1987-04-27 1989-03-21 Oliver Jr Robert C Video surveillance system
US7012520B2 (en) 2003-06-17 2006-03-14 Infraegis, Inc. Global intelligent remote detection system
WO2011060388A1 (en) * 2009-11-13 2011-05-19 Zoll Medical Corporation Community-based response system
US20150049190A1 (en) * 2013-08-13 2015-02-19 Sensormatic Electronics, LLC System and Method for Video/Audio and Event Dispatch Using Positioning System

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10909333B2 (en) 2017-11-07 2021-02-02 Carrier Corporation Machine interpretation of distress situations using body language
CN110020079A (en) * 2017-12-01 2019-07-16 北京京东尚科信息技术有限公司 Data processing method, system, electronic equipment and computer readable storage medium
CN109698768A (en) * 2018-12-26 2019-04-30 广东中安金狮科创有限公司 Equipment monitoring apparatus and its monitoring method, readable storage medium storing program for executing

Similar Documents

Publication Publication Date Title
US11259165B2 (en) Systems, devices, and methods for emergency responses and safety
EP3033742B1 (en) System and method for video/audio and event dispatch using positioning system
US8768294B2 (en) Notification and tracking system for mobile devices
US8311515B1 (en) System, method, and device for intelligence gathering and position tracking
KR20180034568A (en) Video data management method, apparatus, terminal and server
JP6750998B2 (en) Monitoring system and monitoring method
US20110227730A1 (en) System and apparatus for locating and surveillance of persons and/or surroundings
US20180137724A1 (en) Processing security-related messages
US20070199076A1 (en) System and method for remote data acquisition and distribution
US20140375800A1 (en) Mobile surveillance system
JP2018061216A (en) Information display system and information display method
WO2008120971A1 (en) Method of and apparatus for providing tracking information together with environmental information using a personal mobile device
WO2017048115A1 (en) A real-time intelligent video camera system
KR102022343B1 (en) System, server and method for detecting offensive word, analyzing location and notifying them based on smart phone
KR102093650B1 (en) Security service system and method based on cloud
US20090215426A1 (en) Personal security system and method
KR100975861B1 (en) System for providing family safety service
WO2016163871A1 (en) Distress signal disseminating system and method
KR20130049221A (en) Patrol supporting system and method based on a code, apparatus and portable device supporting the same
KR101605746B1 (en) Report system based on application
KR20160034833A (en) Integrated control system with dynamic user experience, control method thereof, and computer readable recording medium thereof
KR200434039Y1 (en) Centralized Surveillance System
KR100751030B1 (en) System for protecting privacy and method therefor
EP1398744B1 (en) Method and device for managing an alarm system
KR101363275B1 (en) Method and apparatus for emergency information intermediation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16798575

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 23/07/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16798575

Country of ref document: EP

Kind code of ref document: A1