CN104306118A - Smartphone based family monitoring system on intelligent wheelchair - Google Patents
Smartphone based family monitoring system on intelligent wheelchair Download PDFInfo
- Publication number
- CN104306118A CN104306118A CN201410623906.9A CN201410623906A CN104306118A CN 104306118 A CN104306118 A CN 104306118A CN 201410623906 A CN201410623906 A CN 201410623906A CN 104306118 A CN104306118 A CN 104306118A
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- zigbee
- data
- smart mobile
- intelligent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a smartphone based family monitoring system on an intelligent wheelchair. According to the smartphone based family monitoring system on the intelligent wheelchair, monitoring factors of the environment safety and the human body health are determined aiming at the home environment in which the intelligent wheelchair is arranged, a ZigBee technology based wireless sensor network is selected according to characteristics of the monitoring factors, monitoring of the environment safety and the human body health is performed, warning is achieved according to the risk information condition, a ZigBee and Bluetooth based complementary gateway is provided and designed, communication between mobile communication terminals is effectively simplified, interconnection and interworking of the ZigBee network and the mobile network is solved, control of remote telephone voice of the intelligent wheelchair at home is achieved through the remote smartphone terminal under assistance of remote mobile phone video monitoring, the problem that remote man-machine interaction of the intelligent wheelchair is difficult is solved, and the purpose of remote monitoring the intelligent wheelchair at home through the smartphone is achieved.
Description
Technical field
The present invention relates to multisensor safety and Health monitoring technique field, particularly a kind of based on household monitoring system on the intelligent wheel chair chair of smart mobile phone.
Background technology
Along with the reasons such as social senilization's progress faster and disease, disaster, vehicle accident cause the increase of damage number, old people and disabled increase gradually.And along with the development of society, the quickening of youngster rhythm of life, old people and disabled are solitary or the situation of being in alone gets more and more.Help old people and disabled to realize healthy and safe living on one's own life and can reduce their pressure to society and the dependency to society.Simultaneously along with the raising of social informatization degree, old people and disabled to the walking-replacing tool of superior performance, perfect daily custodial care facility and the demand of clog-free information interaction approach further urgent.Mobile phone is a kind of almost everybody terminal of having in the society of present this scientific and technological high speed development.Direct mobile phone is the effective utilization to it as remote monitoring terminal, also fundamentally meet while decreasing investment user at any time, the demand of wheelchair in remote real-time monitoring man everywhere, the uniqueness of phone number and cell phone apparatus serial number can carry out proper unique authentication to user, is convenient to user management.Therefore, based on household monitoring system on the intelligent wheel chair chair of smart mobile phone by starting new life pattern and life concept for the elderly and the disabled, there is very important realistic meaning.
The concept of Smart Home has had very early, but really by Smart Home with the actual case that combines of building until 1984 just occur, with the monitoring of computer realization to equipment such as air-conditioning, illumination, elevators, the service of the aspects such as voice communication can be provided simultaneously.Electronic technology development, household electrical appliance were widely used in early 1980s, had at this moment occurred house electronization.Arrive the mid-80 and occurred the concept of house automation, be about to independently household electrical appliances, communication and security device and be integrated.At present, had a large amount of users to adopt intelligentized home room in the country such as Singapore and the U.S., what they generally installed is " house intelligentized system " or similar system.The Smart Home of China just started in the later stage nineties 20th century, developed into today, and the share of intellectual communityintellectualized village 80% all concentrates on Bohai Rim, the Yangtze River Delta and Pearl River Delta.The Smart Home of present China has not been said " Intelligent Community " or independently product in the past, but conventional in life or that relate to computer, network, household electrical appliances, communication for information, community security protection, various services etc. are combined effectively, the residence space that people are lived is safer, comfortable, convenient.
Intelligent wheel chair is as the intelligent robot based on electric wheelchair Function Extension, research the earliest starts from 1986, initial stage mainly controls automatically to the basic exercise function of wheelchair, and as realized, simple forward-reverse turns left to turn right, the change of speed controls and according to having judged avoiding barrier etc.; Along with the development of image procossing, pattern recognition, intelligent algorithm and Robot Control Technology, extend its function gradually, intelligent wheel chair better can adapt to surrounding gradually, strengthen man-machine interaction, and can independently execution.By now, multiple intelligent wheel chair platform is developed in succession by research institution all over the world, MAID project, the Spain SIAMO project of such as Massachusetts Institute Technology WHEELESLEY project, French VAHM project, ULM, Germany university, and domestic Institute of Automation, CAS 863 intelligent robot intelligent wheel chair project, Shanghai Communications University, Taiwan Zhongzheng Univ department of electrical engineering and Third Military Medical University etc.Each laboratory completes relevant design object by different research approaches, and the wheelchair after design solves different application problems.
Summary of the invention
For above deficiency of the prior art, the object of the present invention is to provide a kind of intelligent high, integration strong based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, technical scheme of the present invention is as follows: a kind of based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, comprise sensor device, intelligent wheel chair and far-end intelligent mobile phone terminal, it is characterized in that: described intelligent wheel chair chair is also provided with complementary gateway and near-end smart mobile phone; Described complementary gateway comprises coordinator and bluetooth module; Wherein
Described sensor device, for obtaining environmental information data and human health information data in family and by wireless-transmission network, information data being sent to coordinator;
Described complementary gateway: for the information data of being sent by coordinator receiving sensor device, and packet data converted to for Bluetooth communication, and by bluetooth module, packet is transmitted to the data communication that near-end smart mobile phone realizes coordinator and near-end smart mobile phone;
Described near-end smart mobile phone: for the treatment of the information data received, determines whether distally intelligent mobile phone terminal transmission processing result and send alarm signal according to the result of information data; Also there is the phonetic control command receiving far-end intelligent mobile phone terminal and send, control wheelchair according to instruction and leave deathtrap;
Described far-end intelligent mobile phone terminal, for receiving alarming short message, receive or store the data that house security health monitoring systems gathers, real-time condition in family is monitored with the rear video of networking of IP Camera in family, send remote phone voice control command at the auxiliary lower of video monitor, control wheelchair in family and leave deathtrap.
Further, described sensor device comprises environment temperature sensor, combustable gas concentration sensor, Smoke Sensor, CO concentration sensor, pulse transducer and temperature sensor for human body, and information data is sent to complementary gateway respectively by wireless-transmission network by described environment temperature sensor, combustable gas concentration sensor, Smoke Sensor, CO concentration sensor, pulse transducer, human blood-pressure sensor and temperature sensor for human body.
Further, the wireless-transmission network that described sensor device adopts adopts the ZigBee wireless sensor network of star-network topological structure.
Further, the remote interaction between described near-end smart mobile phone and far-end intelligent mobile phone terminal controls to adopt GSM/3G real-time performance telecommunication.
Further, described complementary gateway is the complementary gateway of ZigBee/ Bluetooth technology, and described coordinator adopts ZigBee/ coordinator.
Further, between described ZigBee/ coordinator and bluetooth module, the data field form of information is data command territory, node address information territory and data payload territory.
Advantage of the present invention and beneficial effect as follows:
The present invention adopts sensor information to be realized by wireless sensor network, solves the inconvenience of line monitoring system, increases motility and the extensibility of system; Propose and design a kind of complementary gateway based on ZigBee and Bluetooth technology, the effective communication simplified between mobile communication terminal device, solving interconnecting of ZigBee-network and mobile network; Achieve far-end intelligent mobile phone terminal remote handset video monitor auxiliary under, to the remote phone Voice command of intelligent wheel chair in family, solve the problem with intelligent wheel chair remote human-machine difficult interface, finally reach by the object of smart mobile phone to intelligent wheel chair remote monitoring in family.
Accompanying drawing explanation
Fig. 1 be the present invention is based on smart mobile phone intelligent wheel chair chair on the structural representation of household monitoring system;
The complementary gateway hardware connection diagram of Fig. 2 ZigBee/ bluetooth;
The data field form schematic diagram of information between Fig. 3 ZigBee and bluetooth equipment;
Fig. 4 comprises the communication pictorial diagram of the complementary gateway of ZigBee/ bluetooth and near-end smart mobile phone;
Fig. 5 near-end smart mobile phone obtains the display figure of data;
Fig. 6 near-end smart mobile phone speech recognition theory diagram;
Fig. 7 far-end intelligent mobile phone terminal remote monitoring flow chart;
Fig. 8 far-end intelligent mobile phone terminal video monitor picture.
Detailed description of the invention
The invention will be further elaborated to provide an infinite embodiment below in conjunction with accompanying drawing.But should be appreciated that, these describe just example, and do not really want to limit the scope of the invention.In addition, in the following description, the description to known features and technology is eliminated, to avoid unnecessarily obscuring concept of the present invention.
Embodiment 1
Based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, mainly comprise the various environmental factorss monitoring in family and remote alarming function, and there is the function that the physical signs (pulse, body temperature, blood pressure etc.) to user monitors.The object of system design is for old people or disabled provide safer, comfortable, life style easily, and system mainly comprises environmental monitoring and physical signs detects.
Fig. 1 is the structural representation of household monitoring system on the intelligent wheel chair chair based on smart mobile phone, as shown in the figure: provided by the invention based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, comprise intelligent wheel chair, sensor device and far-end intelligent mobile phone terminal, described intelligent wheel chair chair is arranged complementary gateway and near-end smart mobile phone.
Described sensor device, for obtaining environmental information data and human health information data and by wireless-transmission network information data being sent to the coordinator in complementary gateway.Described sensor device comprises environment temperature sensor, combustable gas concentration sensor, Smoke Sensor, CO concentration sensor, pulse transducer, human blood-pressure sensor and temperature sensor for human body, and information data to be sent to the coordinator in complementary gateway by the sensor respectively by wireless-transmission network.
The wireless-transmission network of described sensor device adopts the ZigBee wireless sensor network of star-network topological structure.
Described far-end intelligent mobile phone terminal, for receiving alarming short message, receive or store the data that house security health monitoring systems gathers, real-time condition in family is monitored with the rear video of networking of IP Camera in family, send remote phone voice control command at the auxiliary lower of video monitor, control wheelchair in family and leave deathtrap.
Described complementary gateway, comprises ZigBee sensor network coordinator and bluetooth module, for collecting the information data of ZigBee sensor device acquisition and being transferred to near-end smart mobile phone;
Data for gathering the data message that in ZigBee sensor network, sensor device obtains, and are converted to the packet for Bluetooth communication by the ZigBee coordinator in described complementary gateway.
Bluetooth module in described complementary gateway, for by ZigBee sensor network sensor device obtain data message Wireless transceiver to near-end smart mobile phone.
Described near-end smart mobile phone, has two effects: for the treatment of the information data received, and determines whether distally intelligent mobile phone terminal transmission processing result and send alarm signal according to the result of information data; Receive the phonetic control command that far-end intelligent mobile phone terminal sends, control wheelchair according to instruction and leave deathtrap.
ZigBee wireless sensor network major function in native system is data acquisition, date processing on intelligent wheel chair chair, near-end smart mobile phone carries out, based on the remote interaction on the intelligent wheel chair chair of smart mobile phone between household monitoring system and user by GSM/3G real-time performance.Whole system is made up of ZigBee wireless sensor node, ZigBee/ bluetooth complementary gateway, intelligent wheel chair, near-end smart mobile phone and far-end intelligent mobile phone terminal.System global structure design comprises: wireless sensor network adopts star-network topological structure, ZigBee child node gathers on the ZigBee coordinator that the information such as infrared monitoring, ambient temperature, disaster hidden-trouble, human pulse and body temperature thereof turns back in the complementary gateway of ZigBee/ bluetooth, then ZigBee coordinator by bluetooth module by information transmission on near-end smart mobile phone on intelligent wheel chair chair; The information data that the process of near-end smart mobile phone receives, distally intelligent mobile phone terminal transmission processing result and send alarm signal is determined whether according to the result of information data, and for receiving the phonetic control command that far-end intelligent mobile phone terminal sends, controlling wheelchair according to instruction and leaving deathtrap; Far-end intelligent mobile phone terminal is for receiving alarming short message, receive or store the data that house security health monitoring systems gathers, real-time condition in family is monitored with the rear video of networking of IP Camera in family, send remote phone voice control command at the auxiliary lower of video monitor, control wheelchair in family and leave deathtrap.
Fig. 2 is the complementary gateway hardware connection diagram of ZigBee/ bluetooth, as shown in the figure: the complementary gateway of ZigBee/ bluetooth provided by the invention, comprises ZigBee module and bluetooth module.
Data for gathering the data message that in ZigBee sensor network, sensor device obtains, and are converted to the packet for Bluetooth communication by described ZigBee coordinator.
Described bluetooth module, for by ZigBee sensor network sensor device obtain data message Wireless transceiver to near-end smart mobile phone.
Fig. 3 is the data field form schematic diagram of information between ZigBee and bluetooth equipment, as shown in the figure: the data field form of information between ZigBee provided by the invention and bluetooth equipment, is defined as data command territory, node address information territory and data payload territory.
Described data command territory (8 bit), for the direction of control data transmission and the control command of transmission data, the wherein data direction position of 1 bit and the rate control command position of 7 bits.
The data direction position of described 1 bit is data transfer direction position, is divided into up-downgoing data to transmit.When the highest-order bit is 1, be downlink data transmission, namely data reach bluetooth by upper layer device, and bluetooth reaches zigbee coordinator, then reach ZigBee terminal node.When the highest-order bit is 0, be transmitting uplink data, namely data reach ZigBee coordinator by ZigBee terminal node, then reach bluetooth, and bluetooth reaches upper layer device.
The rate control command position of described 7 bits is the control command of data, and user can arrange 27 data commands, controls lower floor's terminal unit.
Described node address information territory is the network address of ZigBee terminal unit 16 bit, is the transmission source address of data and the destination address of order data.
Described data payload territory is the valid data of transmission.
Fig. 4 is the communication pictorial diagram comprising the complementary gateway of ZigBee/ bluetooth and near-end smart mobile phone.
The complementary gateway of described ZigBee/ bluetooth and the communication pictorial diagram of near-end smart mobile phone are the connection layout in kind of the waveform that shows on near-end smart mobile phone of ZigBee-network collecting temperature data and ZigBee/ bluetooth complementarity gateway.
Fig. 5 is display figure near-end smart mobile phone obtaining data.
What described near-end smart mobile phone obtains data is shown as the partial data that ZigBee-network image data shows on near-end smart mobile phone.
Fig. 6 is near-end smart mobile phone speech recognition theory diagram, as shown in the figure: speech recognition mainly comprises several funtion parts such as speech signal pre-processing, feature extraction, feature modeling, similarity measurement and post processing, and post processing is selective sections.
Fig. 7 is far-end intelligent mobile phone terminal remote monitoring flow chart, as shown in the figure: speech recognition is carried out to the voice signal that near-end smart mobile phone hears, reference template in the command word obtained and template base mates, using reference template the highest for matching similarity as recognition result, control intelligent wheel chair and move accordingly.
Fig. 8 is far-end intelligent mobile phone terminal video monitor picture.
What described far-end intelligent mobile phone terminal video monitor picture showed is far-end intelligent mobile phone terminal video monitoring interface, the left side, interface is for monitoring picture, the truth in getting home can be seen here, it is control area on the right of interface, the angle of IP Camera in family can be controlled, turning left as allowed photographic head, turning right, come back, bow, rotation etc.
Embodiment 2
The embodiment of the present invention 2 is the detailed description of the invention of the complementary gateway of ZigBee/ bluetooth in the information data transmission that provides on the basis of embodiment 1, is described in detail as follows.
Because ZigBee and bluetooth all belong to wireless personal area network (WPAN) standard, and all work in 2.4GHz frequency range, have identical point to have any different again.In application, Bluetooth technology is mainly towards the message transmission rate of speech and Geng Gao, be suitable for voice and cell phone apparatus etc., effectively can simplify the communication between mobile communication terminal device, also can communication successfully between simplified apparatus and the Internet Internet, be lay particular emphasis on the mobility of subscriber equipment and eliminate the technology of the cable between short-range device.ZigBee technology is more suitable for control appliance, environmental monitoring, and it does not need very high transfer rate, but requires low-power consumption, low cost and easily use, and can be used for environmental monitoring, remote control, home automation etc., it lays particular emphasis on Long-distance Control and automatization.In performance, bluetooth adopts FHSS technology, and 2.4GHz ISM band is divided into the channel of 79 1MHz, and bluetooth equipment jumps 1600 times in pseudo noise code mode at 79 interchannels each second.The theory of frequency hopping is that these systems only just frequency of utilization conflict can occur at part-time according under using the system of 2.4GHz frequency band in many groups. other times then can operate in different glitch-free channel each other.ZigBee system is non-frequency hopping systems, so bluetooth just has the communication frequency of 1 meeting and ZigBee to overlap in 79 communication.And another frequency will be skipped to rapidly.In most of the cases, bluetooth can not produce serious threat to ZigBee, and the impact of ZigBee on Bluetooth system is negligible.Therefore in conjunction with the advantage of two kinds of technology, effectively simplify the communication between mobile communication terminal device, solve interconnecting of ZigBee-network and mobile network.
In the design of the complementary gateway of ZigBee/ bluetooth, selective temperature, smog and CO concentration are as transmission information, through the complementary gateway transmission of ZigBee/ bluetooth, receive display by near-end smart mobile phone.
The present embodiment based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, the realization of the complementary gateway of ZigBee/ bluetooth comprises the steps:
1. the hardware designs of the complementary gateway of ZigBee/ bluetooth
The signal wiring schematic diagram of the complementary gateway of ZigBee/ bluetooth is see Fig. 2, by RS232 serial communication between ZigBee chip and Bluetooth chip, wherein CC2430 is part crucial in the complementary gateway of this ZigBee/ bluetooth, all management procedures between two equipment we all write in CC2430 chip.Simultaneously, because Bluetooth chip is all the same with the supply voltage (1.8V ~ 3.3V) of ZigBee chip, so when connection two equipment, as long as interface configuration has been got well, centre does not just need separately to add level switch module, as long as they have directly been connected.
2. the design of the data field form of information between ZigBee and bluetooth equipment
Between ZigBee and bluetooth equipment, the regulation of the data field form of information is see Fig. 3, the data frame format that terminal node is uploaded by the ZigBee module in the complementary gateway of ZigBee/ bluetooth carries out the frame head of Internet, MAC layer and PHY layer successively and postamble carries out deblocking, obtains the data of terminal node.Be sent to bluetooth equipment after being encapsulated by the data of data frame format to terminal node of Fig. 3, bluetooth equipment adds the bluetooth packet of L2CAP head to data, the bluetooth packet of physical layer header is sent to bluetooth equipment (near-end smart mobile phone).
3. the work that in the complementary gateway of ZigBee/ bluetooth, ZigBee application layer realizes
According to the data frame format of information conversion between designed ZigBee and bluetooth equipment, the work process following steps that in the complementary gateway of ZigBee/ bluetooth, ZigBee application layer realizes:
1) data frame format of data message according to design loads by the terminal node of ZigBee-network by the application layer of the data message of collection through Zigbee protocol stack.The most-significant byte in setting data territory is 0 (not considering the control command between ZigBee-network node); Ensuing 16 than the source address information of bit loading image data; Gather gained information to be loaded into after address information.The first character joint of data message is the information type (as temperature, humidity, blood pressure, pulse etc.) gathered, (n is less than 87 to its n below, because the greatest length of MAC data bag is 127 bytes, MAC layer sync header length is 25 bytes, consider that the sync header of ZigBee is 15 bytes, the space that can be used for transmitting useful information load just remaining 87 bytes) individual byte is the data of Real-time Collection.
2), after the data message of terminal node collection has encapsulated by application layer, routing forwarding in network is sent to ZigBee coordinator.After ZigBee coordinator receives information frame, send confirmation frame, inform terminal node, data transmission success.If terminal node does not receive the acknowledgement frame returned, then retransmit.
3) source address (mainly referring to 16 network address of network node) in ZigBee coordinator information extraction frame, then removes the Internet frame head in information frame and postamble, the frame head of MAC layer and postamble, the frame head of physical layer and postamble successively.Obtain effective data load.
4) carry out the transmission direction of control data according to the highest order of the data frame format judged, if highest order is 0, then the data message of gained is sent to bluetooth equipment by serial ports.Data are sent on the smart mobile phone with Bluetooth adapter by bluetooth equipment after bluetooth protocol repertory encapsulation, extract the information (source address of information, the type of data and real time data etc.) of data.
5) same, upper strata bluetooth equipment sends control information and data to zigbee network, is the form of the Frame according to design, by what realize the software development of bluetooth cellular phone.The highest order setting gradually data field is the control command information of 1,7, the destination address information of 16 bits and effective data message (this valid data territory can be 0).After having encapsulated, be sent to bluetooth equipment.
6), after bluetooth equipment receives the information of upper layer device, remove the grouping of bluetooth physical layer and the grouping of L2CAP head successively, information is sent to ZigBee coordinator.
7) ZigBee coordinator carrys out the transmission direction of control data according to the highest order of the information judged, if highest order is 1, then extracts the destination address information behind data command territory, the data command information of gained is sent to the network terminal of specifying by radio-frequency module.
4. the experiment of the complementary gateway of ZigBee/ bluetooth and checking
System connection procedure, first open ZigBee coordinator and set up network, corresponding child node adds network.Then open bluetooth equipment, after making it to connect with ZigBee coordinator, open Bluetooth adapter by smart mobile phone and be connected with bluetooth equipment, realize mobile phone and communicate with ZigBee-network.
The temperature information that gets of the known ZigBee sensor network of result by experiment, is sent to mobile phone terminal by the bluetooth equipment on the complementary gateway of ZigBee/ Bluetooth technology, and shows on mobile phone.Be can coexist in a system between this test specification ZigBee and bluetooth, between two, can mutual supplement with each other's advantages be formed.The design demonstrating ZigBee and the interconnected programme of work of bluetooth from theory and test is practicable.
This gateway applies the communication that can effectively simplify between mobile communication terminal device in based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, solves interconnecting of ZigBee-network and Internet or mobile communications network.Too increase the motility of user to ZigBee sensor network examination and controlling simultaneously, realize intelligent wheel chair networking, easy and simple to handleization.
Embodiment 3
The embodiment of the present invention 3 is the detailed description of the invention of far-end intelligent mobile phone terminal remote monitoring provided on the basis of embodiment 1 and embodiment 2, is described in detail as follows.
Language carries out exchanging and the instrument of transmission of information as the mankind, more effectively, easy, natural, also has more hommization and affinity.Direct language is controlled to one of the important way into man-machine interaction to machines such as intelligent wheel chairs.Smart mobile phone is combined with Voice command, monitor in conjunction with mobile video, during by making a phone call, the phonetic order of transmission carries out long-range motor control to the intelligent wheel chair in family, can make remote monitoring hommization and the intellectuality more on the intelligent wheel chair chair based on smart mobile phone in household monitoring system.
After far-end intelligent mobile phone terminal dials near-end smart phone number, near-end smart mobile phone is compared to caller ID, if meet the requirement arranged in advance, automatic call answering, the word that now user says in far-end intelligent mobile phone terminal is exactly the phonetic order of training.Instruction training terminates automatically to enter speech recognition period afterwards, at this moment after user says phonetic order to far-end intelligent mobile phone terminal, in family, intelligent wheel chair takes corresponding motion, in conjunction with the video monitor picture of far-end intelligent mobile phone terminal to intelligent wheel chair, controls wheelchair and leaves deathtrap.
The height of the phonetic recognization rate of whole far-end intelligent mobile phone terminal remote monitoring is key issue, and the implementation procedure of near-end smart mobile phone speech recognition is see Fig. 6.First the voice signal that near-end smart mobile phone hears will carry out pretreatment, comprises the preemphasis filtering of voice, windowing sub-frame processing and double threshold end-point detection etc.Secondly, voice signal is after pretreatment, and a next very important ring is exactly the extraction of characteristic parameter, then, in the training stage, after characteristic parameter is carried out certain process, for each order word obtains a template, saves as template base.At cognitive phase, voice signal obtains speech parameter through identical method, generates test template, mates, using reference template the highest for matching similarity as recognition result with the reference template in template base.
The present embodiment based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, the realization of far-end intelligent mobile phone terminal remote monitoring comprises the steps:
1. the speech recognition of near-end smart mobile phone in remote monitoring
First voice man-machine interactive system will realize speech recognition.Speech recognition is in fact a mode identification procedure.Speech recognition mainly comprises several funtion parts such as speech signal pre-processing, feature extraction, feature modeling, similarity measurement and post processing, and post processing is selective sections.
Speech recognition has two stages: training and identification.These two stages all need to carry out pretreatment and feature extraction to the primary speech signal heard.End-point detection, preemphasis, framing, windowing etc. are pretreated main contents.End-point detection utilizes Digital Signal Processing, to determine beginning and the end position of voice signal in this section.The main purpose of isolated word recognition finds out beginning and the end point of word.In background noise voice distinguish right form wrong often important accurately, judging starting point and end point mistakenly, causing erroneous judgement by causing the disappearance of initial consonant.
The phonetic order that user says at far-end intelligent mobile phone terminal by GSM/3G Internet Transmission to near-end smart mobile phone, the phonetic order that near-end smart mobile phone hears has been digital signal from analog-signal transitions, and digitized voice signal is saved on near-end smart mobile phone with the sample frequency of regulation, sampling precision and sound channel by recorded program; Then the end points of voice signal is marked by end-point detection program; Then the voice signal having done end points labelling is carried out MFCC (Mel-Frequency Cepstrum Coefficient, Mel frequency cepstral coefficient) feature extraction, sound is just processed to a series of characteristic sequence, these characteristic sequence analyses to be compared with the data that store in the data base set up by pretreatment and feature extraction.Phonetic order takes suitable motion by controlling wheelchair with database information comparison result.Whole far-end intelligent mobile phone terminal remote monitoring process is see Fig. 7.
2. the experiment of far-end intelligent mobile phone terminal remote monitoring and checking
After IP Camera is opened, open the remote video monitoring picture of far-end intelligent mobile phone terminal, far-end intelligent mobile phone terminal video monitor picture is see Fig. 8, and the video pictures on far-end intelligent mobile phone terminal is clear.Dial near-end smart phone number with far-end intelligent mobile phone terminal, near-end smart mobile phone is compared to caller ID, meets the requirement automatic call answering arranged in advance.The word that now user says in far-end intelligent mobile phone terminal is exactly the phonetic order of training.Instruction training terminates automatically to enter speech recognition period afterwards, at this moment after user says phonetic order to far-end intelligent mobile phone terminal, in family, intelligent wheel chair takes corresponding motion, in conjunction with the video monitor picture of far-end intelligent mobile phone terminal to intelligent wheel chair, controls wheelchair and leaves deathtrap.
These embodiments are interpreted as only being not used in for illustration of the present invention limiting the scope of the invention above.After the content of reading record of the present invention, technical staff can make various changes or modifications the present invention, and these equivalence changes and modification fall into the scope of the claims in the present invention equally.
Claims (6)
1. based on a household monitoring system on the intelligent wheel chair chair of smart mobile phone, comprise sensor device, intelligent wheel chair and far-end intelligent mobile phone terminal, it is characterized in that: described intelligent wheel chair chair is also provided with complementary gateway and near-end smart mobile phone; Described complementary gateway comprises coordinator and bluetooth module; Wherein
Described sensor device, for obtaining environmental information data and human health information data in family and by wireless-transmission network, information data being sent to coordinator;
Described complementary gateway: for the information data of being sent by coordinator receiving sensor device, and packet data converted to for Bluetooth communication, and by bluetooth module, packet is transmitted to the data communication that near-end smart mobile phone realizes coordinator and near-end smart mobile phone;
Described near-end smart mobile phone: for the treatment of the information data received, determines whether distally intelligent mobile phone terminal transmission processing result and send alarm signal according to the result of information data; Also there is the phonetic control command receiving far-end intelligent mobile phone terminal and send, control wheelchair according to instruction and leave deathtrap;
Described far-end intelligent mobile phone terminal, for receiving alarming short message, receive or store the data that house security health monitoring systems gathers, real-time condition in family is monitored with the rear video of networking of IP Camera in family, send remote phone voice control command at the auxiliary lower of video monitor, control wheelchair in family and leave deathtrap.
2. according to claim 1 a kind of based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, it is characterized in that: described sensor device comprises environment temperature sensor, combustable gas concentration sensor, Smoke Sensor, CO concentration sensor, pulse transducer and temperature sensor for human body, information data is sent to complementary gateway respectively by wireless-transmission network by described environment temperature sensor, combustable gas concentration sensor, Smoke Sensor, CO concentration sensor, pulse transducer, human blood-pressure sensor and temperature sensor for human body.
3. according to claim 1 a kind of based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, it is characterized in that: the wireless-transmission network that described sensor device adopts adopts the ZigBee wireless sensor network of star-network topological structure.
4. according to claim 1 a kind of based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, it is characterized in that: the remote interaction between described near-end smart mobile phone and far-end intelligent mobile phone terminal controls to adopt GSM/3G real-time performance telecommunication.
5. according to claim 1 a kind of based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, it is characterized in that: described complementary gateway is the complementary gateway of ZigBee/ Bluetooth technology, and described coordinator adopts ZigBee/ coordinator.
6. according to claim 5 a kind of based on household monitoring system on the intelligent wheel chair chair of smart mobile phone, it is characterized in that: between described ZigBee/ coordinator and bluetooth module, the data field form of information is data command territory, node address information territory and data payload territory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410623906.9A CN104306118A (en) | 2014-11-07 | 2014-11-07 | Smartphone based family monitoring system on intelligent wheelchair |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410623906.9A CN104306118A (en) | 2014-11-07 | 2014-11-07 | Smartphone based family monitoring system on intelligent wheelchair |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104306118A true CN104306118A (en) | 2015-01-28 |
Family
ID=52361538
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410623906.9A Pending CN104306118A (en) | 2014-11-07 | 2014-11-07 | Smartphone based family monitoring system on intelligent wheelchair |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104306118A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104932363A (en) * | 2015-06-03 | 2015-09-23 | 浙江大学 | Electric appliance intelligent monitoring control system |
| CN105681747A (en) * | 2015-12-10 | 2016-06-15 | 北京理工大学 | Telepresence interaction wheelchair |
| CN106963568A (en) * | 2017-04-06 | 2017-07-21 | 湖北纪思智能科技有限公司 | Intelligent wheel chair with health monitoring systems |
| CN106983613A (en) * | 2017-04-12 | 2017-07-28 | 深圳市元征科技股份有限公司 | The control method of intelligent wheel chair and intelligent wheel chair |
| CN107067632A (en) * | 2017-02-25 | 2017-08-18 | 支录奎 | Indoor positioning Bluetooth transmission Smoke Sensor |
| CN107533041A (en) * | 2015-04-29 | 2018-01-02 | 霍尼韦尔国际公司 | For integrating multiple chemical sensor data to detect the system for not surveying compound |
| CN108670228A (en) * | 2018-05-25 | 2018-10-19 | 绥化学院 | A kind of safeguard and supervision for the aged and recovering aid system |
| CN108873710A (en) * | 2018-05-31 | 2018-11-23 | 平湖市超越时空图文设计有限公司 | A kind of smart home system based on ZigBee intelligent gateway control |
| CN109259948A (en) * | 2018-11-22 | 2019-01-25 | 复旦大学无锡研究院 | Auxiliary drives wheelchair |
| CN110797977A (en) * | 2019-10-30 | 2020-02-14 | 重庆瑞坤科技发展股份有限公司 | Intelligent power distribution monitoring system based on smart phone and Kinect sensor |
| CN111542294A (en) * | 2017-12-29 | 2020-08-14 | 四川金瑞麒智能科学技术有限公司 | Intelligent wheelchair system |
| CN111714298A (en) * | 2020-06-18 | 2020-09-29 | 深圳市智维健康科技有限公司 | Electronic wheelchair control system of intelligence thing networking |
| CN112486039A (en) * | 2019-08-21 | 2021-03-12 | 王海滨 | Intelligent interconnection and mutual control system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080114127A (en) * | 2007-06-27 | 2008-12-31 | 한국과학기술원 | Wireless controllable modularized intelligent powered wheelchair |
| CN201327585Y (en) * | 2008-10-27 | 2009-10-14 | 北京晋科光技术有限公司 | 3G robot |
| CN101592947A (en) * | 2009-07-03 | 2009-12-02 | 西安交通大学 | Electric wheelchair controller and control method that a kind of Zigbee inserts |
| CN102184732A (en) * | 2011-04-28 | 2011-09-14 | 重庆邮电大学 | Fractal-feature-based intelligent wheelchair voice identification control method and system |
| US20110251469A1 (en) * | 2010-04-09 | 2011-10-13 | The Board Of Trustees Of The University Of Arkansas | Wireless nanotechnology based system for diagnosis of neurological and physiological disorders |
| CN102736607A (en) * | 2012-07-06 | 2012-10-17 | 重庆邮电大学 | Living security health remote monitoring system based on data integration |
| CN102789218A (en) * | 2012-07-20 | 2012-11-21 | 大连理工大学 | Zigbee smart home system based on multiple controllers |
| CN203480677U (en) * | 2013-09-16 | 2014-03-12 | 河北烽联信息技术有限公司 | Intelligent residential district network communication system |
-
2014
- 2014-11-07 CN CN201410623906.9A patent/CN104306118A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080114127A (en) * | 2007-06-27 | 2008-12-31 | 한국과학기술원 | Wireless controllable modularized intelligent powered wheelchair |
| CN201327585Y (en) * | 2008-10-27 | 2009-10-14 | 北京晋科光技术有限公司 | 3G robot |
| CN101592947A (en) * | 2009-07-03 | 2009-12-02 | 西安交通大学 | Electric wheelchair controller and control method that a kind of Zigbee inserts |
| US20110251469A1 (en) * | 2010-04-09 | 2011-10-13 | The Board Of Trustees Of The University Of Arkansas | Wireless nanotechnology based system for diagnosis of neurological and physiological disorders |
| CN102184732A (en) * | 2011-04-28 | 2011-09-14 | 重庆邮电大学 | Fractal-feature-based intelligent wheelchair voice identification control method and system |
| CN102736607A (en) * | 2012-07-06 | 2012-10-17 | 重庆邮电大学 | Living security health remote monitoring system based on data integration |
| CN102789218A (en) * | 2012-07-20 | 2012-11-21 | 大连理工大学 | Zigbee smart home system based on multiple controllers |
| CN203480677U (en) * | 2013-09-16 | 2014-03-12 | 河北烽联信息技术有限公司 | Intelligent residential district network communication system |
Non-Patent Citations (4)
| Title |
|---|
| 张毅等: "ZigBee/蓝牙技术的互补性网关设计及应用", 《广东通信技术》 * |
| 熊鹏: "智能轮椅网络化技术研究", 《万方数据》 * |
| 罗元等: "一种新的语音端点检测方法及在智能轮椅人机交互中的应用", 《重庆邮电大学学报（自然科学报）》 * |
| 齐玉超: "基于智能轮椅的家居安全健康远程监测系统研究", 《万方数据》 * |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11946919B2 (en) | 2015-04-29 | 2024-04-02 | Honeywell International Inc. | System for integrating multiple chemical sensor data to detect an unmeasured compound |
| CN113075366A (en) * | 2015-04-29 | 2021-07-06 | 霍尼韦尔国际公司 | System for integrating multiple chemical sensor data to detect an unmeasured compound |
| CN107533041A (en) * | 2015-04-29 | 2018-01-02 | 霍尼韦尔国际公司 | For integrating multiple chemical sensor data to detect the system for not surveying compound |
| CN113075365A (en) * | 2015-04-29 | 2021-07-06 | 霍尼韦尔国际公司 | System for integrating multiple chemical sensor data to detect an unmeasured compound |
| US11300550B2 (en) | 2015-04-29 | 2022-04-12 | Honeywell International Inc. | System for integrating multiple chemical sensor data to detect an unmeasured compound |
| CN104932363A (en) * | 2015-06-03 | 2015-09-23 | 浙江大学 | Electric appliance intelligent monitoring control system |
| CN105681747A (en) * | 2015-12-10 | 2016-06-15 | 北京理工大学 | Telepresence interaction wheelchair |
| CN107067632A (en) * | 2017-02-25 | 2017-08-18 | 支录奎 | Indoor positioning Bluetooth transmission Smoke Sensor |
| CN106963568A (en) * | 2017-04-06 | 2017-07-21 | 湖北纪思智能科技有限公司 | Intelligent wheel chair with health monitoring systems |
| CN106983613A (en) * | 2017-04-12 | 2017-07-28 | 深圳市元征科技股份有限公司 | The control method of intelligent wheel chair and intelligent wheel chair |
| CN111542294A (en) * | 2017-12-29 | 2020-08-14 | 四川金瑞麒智能科学技术有限公司 | Intelligent wheelchair system |
| CN108670228A (en) * | 2018-05-25 | 2018-10-19 | 绥化学院 | A kind of safeguard and supervision for the aged and recovering aid system |
| CN108873710A (en) * | 2018-05-31 | 2018-11-23 | 平湖市超越时空图文设计有限公司 | A kind of smart home system based on ZigBee intelligent gateway control |
| CN109259948A (en) * | 2018-11-22 | 2019-01-25 | 复旦大学无锡研究院 | Auxiliary drives wheelchair |
| CN109259948B (en) * | 2018-11-22 | 2024-01-12 | 复旦大学无锡研究院 | Wheelchair for assisting driving |
| CN112486039A (en) * | 2019-08-21 | 2021-03-12 | 王海滨 | Intelligent interconnection and mutual control system |
| CN110797977A (en) * | 2019-10-30 | 2020-02-14 | 重庆瑞坤科技发展股份有限公司 | Intelligent power distribution monitoring system based on smart phone and Kinect sensor |
| CN111714298A (en) * | 2020-06-18 | 2020-09-29 | 深圳市智维健康科技有限公司 | Electronic wheelchair control system of intelligence thing networking |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104306118A (en) | Smartphone based family monitoring system on intelligent wheelchair | |
| CN105900042B (en) | Redirect the method and apparatus of audio input and output | |
| CN108900502B (en) | Communication method and system based on household intelligent interconnection | |
| US7539618B2 (en) | System for operating device using animated character display and such electronic device | |
| CN106531165A (en) | Portable smart home voice control system and control method adopting same | |
| CN203446722U (en) | Intelligent bracelet | |
| CN107247711A (en) | A kind of two-way translation method, mobile terminal and computer-readable recording medium | |
| CN110070863A (en) | A kind of sound control method and device | |
| CN103442129A (en) | Interactive method and system between intelligent watch and mobile terminal | |
| CN106933807A (en) | Memorandum event-prompting method and system | |
| CN203279119U (en) | Wireless earphone based on motion sensor | |
| CN205158728U (en) | Sign language translating system | |
| CN109901698B (en) | Intelligent interaction method, wearable device, terminal and system | |
| CN104683584B (en) | A kind of convenient call method of mobile terminal and system | |
| CN108595003A (en) | Function control method and relevant device | |
| CN105094681B (en) | A kind of method and user terminal that control incoming call is mute | |
| CN203149569U (en) | Voice and gesture interactive translation device | |
| CN108989558A (en) | The method and device of terminal call | |
| CN106028257A (en) | Wearable communication headset and communication method based on communication headset | |
| CN109903761A (en) | Voice interactive method, device and storage medium | |
| CN106097835A (en) | A kind of deaf mute exchanges the method for intelligent assistance system and exchange | |
| CN106178496B (en) | Game control method and system based on motion sensing and sound operation | |
| CN107465832A (en) | A kind of system and method that mobile portable phone is taken using expansion equipment | |
| CN207624216U (en) | A kind of voice and the two-way mutual translation system of sign language | |
| CN107371144A (en) | A kind of intelligence sends the method and device of information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150128 |