DE102015009721A1 - Apparatus and method for determining brightnesses and their cleavage in colors - Google Patents

Abstract

The device is characterized in that the measured total brightnesses of at least one RR interval of a human, for example, are converted from white light into color models.

Description

The apparatus and method determines luminances in pulse wave / RR intervals of humans.

The apparatus and method determines from the luminances of the pulse wave / RR intervals of humans by means of color models, color spaces and colors.

The device and method determines from the brightnesses in pulse wave / RR intervals, by means of color models, color spaces and colors, speeds, pressures and the movements of a person.

The position of the device is, for example, on the extremities of a human body.

The device determines from at least two RR intervals, pressures, position and movement of a human.

The device and the method determines from personal pulse wave / RR intervals, personal features using split colors from total brightness measurements, for example, from the camera of a smartphone.

The device and the method measures, for example, with a white light color a total brightness value on the skin of a human and converts these into known color models.

The novelty describes, for example, the change of total brightness values, for example, from the light color white, into an RGB color model.

With the signals from the RGB color model, it is thus possible to determine, for example, reflections of the blue light components from the upper skin layers and absorptions of, for example, oxygen with a smartphone from deeper layers, more than 2 mm.

Thus, mobile devices, such as the smartphone, can provide reliable information on vital data of people.

introduction

For some years now, vital data measurements have been carried out in humans very easily with smartphone devices and apps. These solutions require only the white light of the camera and the photo lens for single or even continuous pulse wave measurements.

In the last 2 years, Wearable's have been developed and launched with similar and expanded offerings.

Today, these "helpers" have a large market acceptance and an even larger market for all sorts of applications in the most diverse areas.

Also, the classic health care market, to monitor our activities and vital signs with watches and bracelets, are the target of these products.

In 2015, companies such as Apple, Samsung, LG, as well as newly developing companies such as Jawbone or Misfit, have recognized and occupied the market for themselves.

The systems all measure similar and differ, for example, usually in light color and their installed number, photodiode / transistor n, frequencies and the algorithms.

Apple and Samsung opened in 2014 the advertising battle to findings of the next generation watches "Watch". Blood pressure, blood sugar, and diagnostics were just a few of the buzz words about the upcoming possibilities of your products.

In the summer of 2015, Apple and Samsung announce open source platforms to inspire mass intelligence for product development under the corporate umbrella.

The watches from Apple and Samsung will only measure a single pulse in the summer of 2015. Other offers, such as the announced statements on blood pressure, blood sugar, and diagnostics, have been postponed.

The novelty describes simple solutions to improve the performance of existing hardware such as Apple and Co. by splitting light color through color models.

history

The pulse wave has been represented and evaluated in medical application as a 2-dimensional wave for many years.

In order to be able to perform the pulse measurement, brightness changes from the measurement with light are still used today.

The preferred light color in the medical application is red. The preferred light color for measurements with wearable's such as Runtasic and Co. is green.

The questions about the measurement of the pulse with light and light color, are limited to today according to energy consumption and the result of the respective pulse.

The oxygen is absorbed in daylight as a green color component within the measuring point. By absorbing and thus the detected absence of the green color component, the overall brightness of the pulse wave becomes darker. The more oxygen in the blood, the darker the measured total brightness at the measuring point.

Blue is known to reflect in the upper layers of the skin to a maximum of 2 mm. The results for a pulse wave measurement are evidently poor, since none of the commercially available wearable blue light color used.

Green light is absorbed in deeper layers and, as a green light color, is a commonly used light color in Wearable's.

Red light is reflected in the layers from 2 mm and represents the largest proportion of light color in the entire color space of smartphone and wearable.

The 2-dimensional pulse wave shown in today's applications describes transit times of an RR interval, from the physical ejection to the occlusion of the heart and its course, dynamically and in time, to the periphery.

In this case, speed and transit time are also occasionally measured, which the pulse wave requires in order to be detected in the periphery, for example at the A. Radial.

This is usually done with the help of a simultaneous ECG, or one of the intervals of the 1 and 2 wave from each other and within a RR interval.

At the same time, the change in the pulse waveform is often measured and evaluated.

So you can determine the vascular age or the augmentation index of the total brightness with natural or artificial light and a matching photodiode / transistor.

The pulse wave analysis is shown in 2dimensional and is also used to determine the oxygen content by plethysmography on the finger.

Plethysmography is a measuring method known in medicine for determining the pulse wave and the oxygen filling.

Here, for example, the oxygen content of hands or feet is determined with 1000 signals per second.

The 1000 signals are displayed to the user 2dimensional, also with view of systole and diastole, usually also a reflection wave.

These signals are measured in the current ambulatory and medical standard at up to 3 Hertz.

However, the pulse wave contains much more information than the one described above.

The information described in the novelty can thus be determined with at least one photodiode / transistor from the conventional measuring methods.

The wave dynamics of individual pulse waves and within a RR interval, created at the vessel branches to the periphery, have different speeds due to the change in cross-section and movements of the extremities.

Like the main wave / systole, the reflection wave / dicrotic wave is "washed" by the path from the starting point, or the reflection point, such as at the aortic valve to the measuring point in the periphery and presented to the observer of the 2dimensional brightness wave according to current knowledge.

All pulse waves / RR intervals which are measured with light and thus from total brightness values to people in motion are subject to very different vascular resistances and blood pressures, for example also due to the respective position to the hydrostatic indifferent point HIP.

Thus, the reflection and propagation times of the pulse wave / n in the course towards the peripheral measuring point are impaired, or shown changed and thus misinterpreted.

The wrong interpretation arises from the fact that the movements of the extremities and position of the measuring point compared to the HIP can drastically change the brightness.

The change in the brightness due to movements, for example, measured or determined with wearable's, sometimes represented as a value to the user, however, is usually separated as an artifact from the good results or not displayed to the user.

This leads to interpolation of the removed results and thus to incorrect values.

In order not to jeopardize the credibility of branded products such as Apple or Samsung, for example, the announced vital data measurements were withdrawn from the planned content of the Apple Watch and Samsung Gear.

However, in order to implement the planned opportunities, Samsung 2014 and Apple 2015 have created open source platforms.

Products such as Fitbit, Sigma, Polar, Jawbone, Withings, Misfit, runtastic, garmin, nike, adidas micoach, sony, LG measure the pulse wave with light and a brightness value from the photodiode / transistor and create insights for the user, but mostly not more than just the pulse.

description

The totality of all brightnesses, which, for example, radiates on the skin of a human being, arise from the sunlight which acts on the earth by the electromagnetic radiation, including the artificial light and the changes from, for example, shadow formations, filters, reflections, color mixtures, absorptions, scattering ,

The sunlight has a visible and invisible area for humans.

Specific wavelengths of light (designation and abbreviation in nm wavelength) govern with gases, substances and substances and change states and brightnesses, for example by scattering, absorption or reflection.

To determine a pulse wave in humans, the ambient light, starting from the sun, can be used.

In order to be able to measure the pulse wave even without the sun and in the dark, artificial light is radiated onto the skin to illuminate the pulse wave and illuminated.

The most varied artificial light is currently used to determine the pulse wave.

The green light color with a red light color is also added as a second measurement on the skin.

A disadvantage of visible light is the visibility of light sources that can be disturbing in everyday life. Shielding mounted underneath the hardware, worn like a clock, however, the disturbance factor is zero.

The influence of daylight, however, is a problem with shadows cast by trees, windows, etc. in the basic brightness image.

Non-visible IR light has these disadvantages only limited, by the adapted photodiode / transistor on the artificially introduced infrared light.

Thus, the benefit of determining the pulse wave / RR interval could be in an infrared measurement.

Red light color has the advantage of representing the largest proportion of measured brightness data on the skin in current measurement methods.

About 50-70 percent, depending on the pressure and daylight of the color components on the skin, for example, measured with the RGB color model described in the novelty, are red.

Red thus represents the largest color space proportion in the overall brightness of a 2-dimensional display / apps, or in plethysmography.

The comparability of the measured total brightness from the white light color, for example of a smartphone compared to the split color components red determined from the RGB color model, are almost identical.

The light color red and green is used in fitness trackers and watches.

However, the disadvantage for all light colors, whether individually or in combination, is the disturbance and influence by movement, due to changes in blood pressure, or the sinking of blood into the extremities, or the pressing out by an acceleration of the extremities away from the body.

Blue light has a lower radiation depth due to the amount of energy being radiated. At 1 to a maximum of 2 mm penetration into the skin, the blue light is limited. In this area are often vessel parts that represent the venous area. This is particularly true when the pressure in the lower layers of the skin remains held for a relatively longer period of time due to the extreme blood pressure, for example produced by a hanging hand downwards.

Presently known results with a special blue light color for a pulse wave measurement are, due to the high proportion of influence of the disturbing venous circulation, worst of all the general light colors named so far, such as red, green and white or the respective wavelengths.

Thus, in Wearable usually green light color as in previous products eg., Fitbit, Samsung, Apple or Withings, as well as red light color or infrared light used.

Only in the open source solution from Samsung, Simband, a blue light is installed.

Video Recordings from smartphone devices use the white camera light, as the lamp and its white light comes closest to the sunlight composition.

However, white light needs the most energy of all light colors.

Since the built-in photodiode / Transistorn in the cameras of, for example, smartphone video recording devices dictate 3 colors, a transfer of the brightnesses in color models is changeable.

The energy consumption for the conversion of the data plays with a Smartphone rather a subordinated role because the mobile terminals like the Smartphone possess far over 2000 mAh.

Since the novelty can be easily and for example built into a smartphone or wearable due to existing hardware, improvements of the algorithms can serve the purpose also without change of current hardware.

The novelty is to convert brightness from, for example, white light color into colors.

The pulse wave consists of a plurality of waves which form during the course towards the periphery by, for example, branches.

These waves, which are formed by reflections from the branches, form the pulse wave.

These multiple waves have different speeds and form the later sum of the 2-dimensional image of a single pulse wave with the known first and second peaks, in the case standing for the systole and the reflection wave.

In order to use a known solution for the conversion of measured brightnesses in color, for example, the YCbCr color model can be used.

The YCbCr color model stands for the recording of data. The RGB color model stands for the display of the data.

The brightness, for example, measured from a smartphone, are converted into the YCbCr color model. From the YCbCr color model, an RGB color model can be calculated.

The RGB color model meets the well-known idea of the color of a human and therefore the closest.

With the RGB color model, for example, the pulse wave of a human being can be represented in three dimensions and different speeds of the possible countless pulse waves / colors calculated and, for example, displayed directly, individually and or continuously to the user.

This is done, for example, by the possibility of a view of pulse waves multiple RR intervals, which are displayed by the splitting of the total brightness W4, in example. 3 colors, red W3, green W1, blue W2 with an RGB color model.

The 1 shows 4 waves which were split from the white light color of a smartphone, after a pulse wave measurement into an RGB color model in colors and shows a clear rash in the middle of the figure. This rash is a simulated movement of everyday life. please refer 1

The pulse wave W4 is the sum of the pulse waves of W1, W2, W3.

How to get out of 1 can be seen, the waves W3 and W4 behave similarly.

Both pulse waves lose a lot of brightness due to the movement.

Since the wave W3 represents over 70 percent of the total brightness and W1 increases in contrast with brightness, the wave W3 must have a higher amplitude swing than the total brightness.

The wave W2, see 2 , with similar levels of amplitude during movement, contributes little to maximizing overall brightness.

In summary, it should be noted that the wave W4 as the sum of the total brightness, for example from a smartphone pulse wave measurement, does not reflect the actual contents of the measurement.

The simulated movement within a pulse measurement, see 1 , the total brightness measurement from wave W4 would be interpreted as a motion artifact and thus could not register an RR interval.

This hidden and changeable behavior of individual wavelengths arises, for example, from changes in pressure at the measuring location due to the position to HIP. The penetration depth of the light is thus determined by the pressure conditions.

Also striking are the different start times of minima to maxima of individual pulse wave intervals from the determined waves W1, W2, W3 and the sum of all waves W4. Please refer 3 W2 and W3 have different peeks in time. Also evident in the 3 recognizable, the total brightness is the lowest in the amplitude height. However, this result would be from a 2dimensional measurement of the actual output value.

The 3 shows with same time stamp pulse wave / RR intervals such as, W1, W2, W3 with different start times for the creation of a special pulse wave, different amplitude levels and a steadily adjusted percentage distribution of colors in the RGB color model, adapted to the situation of a movement.

The pressure changes are triggered also in the peripheral system depending on the situation, for example, by the central nervous system to adjust movements, heat, altitude, deficiency symptoms such as fluid loss, lack of energy supply due to lack of food or diseases.

The variably measurable speeds of pulse waves within a RR interval arise, for example, due to pressure changes in the vessels themselves and also as actual vessel resistances for further transmission of the pressures on the tissue (amount of tissue, condition and type).

4 shows the same simulated motion section as in 1 to 3 , but in a different presentation.

The brightness wave W4 of white light color and thus carrier of the total brightness, responds to the movement in a different ratio than W3 from the RGB model. The measurable temporal beginning of the lowering of the brightness is not identical to both waves. Please refer 4 Point t1

Wave W2, from the RGB color model, only weakly records the simulated motion. 4 Point t2 shows another start time of the RR interval. Clearly visible in the overall brightness of the wave W4, the brightness reduction in the middle of a RR interval. The pulse wave W2 records the pulse wave without drastic loss of brightness or brightness gains. 4 Point t3 makes the different brightnesses, pulse waveforms and timings visible.

Thus, it becomes clear that in the overall brightness, see 4 further information is included.

See in 4 the waves W1 or W2 or W3, which are not visible in a 2 dimensional "grayscale" viewing, from the total brightness wave W4.

5 - Picture 1 shows the off 1 to 4 known simulated motion section from this patent now in 2dimensionale view. Measure this total brightness indicator like smartphone and wearable's and watches with today's media.

As in 5 - Picture 2 the different waves from the RGB colors and the constantly adapting color spaces to the situations or changes.

The novelty solves, for example, the task of detecting movement artifacts and their assignment with the calculation of at least one pulse wave of a single RR interval.

To clean up or improve the data from the pulse waves, for example, measured with smartphones, wearables or watches, with the split brightnesses in colors, movements can be measured.

Furthermore, the different speeds and the location of the measuring location of a pulse wave to the HIP become clear.

The slumping of the blood into the extremities, for example the hand or the finger, by the pressing in of blood by acceleration towards the body or centrifugal forces by rotation as well as by the inertia of the blood by the acceleration away from the body, produces a variety of blood pressures and thus different brightnesses.

The multitude of possible pulse waves within a RR interval allows the viewing of the tissue with the RGB color model from different regions / depths of the tissue.

The comparison between each other and the indivisibility of a single pulse wave against a fast movement, determined from the RGB model, solves the task of improving the continuous pulse wave display.

Each individual color from the split brightnesses of the light reacts differently when pressed against the respectively different penetration depth of the colors at the measuring point.

Thus, the pressure change is the main cause of artifacts from the movement.

To save resources, frequency splitting, single waves and views can be used to provide more favorable information delivery within pulse waves of a RR interval.

7 shows a pulse wave series with two vessel pressure changes / jumps. W1, W3 and in particular W4 does not recognize this pressure change.

To process these pressure changes or motion artefacts resources this happens to be used in the special filter.

6 Figure 1 shows, for example, 8 unfiltered pulse waves. The pressure jump is still recognizable in image 1 wave W2.

After filtering in 6 Figure 2 filtered the jump at 0.1 Hz.

With the use of filters, respiratory waves and vascular circuits can be measured separately and, depending on requirements, displayed and evaluated by computer or by image or image series.

In particular, changes of pressures arise from the inside to the outside of the tissue. Thus, always from the arterial vessels to the skin surface. The arterial vessels respond very quickly to pressure changes due to movement to the HIP.

Since the waves W1, W2, W3 are split and determined from the total brightness W4 of, for example, white light color, but behave very contrary, the measuring errors of the 2-dimensional view, with almost 500 wearable's worldwide, become clear.

Claims (18)

The device is characterized in that the measured total brightnesses of at least one RR interval of a human, for example, are converted from white light into color models. The device is characterized in that the total brightness data measured in claim 1 are represented in colors. The device of claim 1 and 2 consists of at least one computing and storage unit, at least one converter, at least one energy unit, at least one evaluation logic, at least one photodiode / transistor, at least one lamp, at least one sensor and at least one radio solution, carrier material for the electronic Components, and at least one mobile and stationary image unit, and at least one device for receiving the components, eg. In the smartphone, wearable's, such as rings, watches, arm bands and footbands, headbands, headphones, plasters, shoes, soles, socks, gloves , Holds and foot rests. The device is characterized in that the novelty described in claim 1 is measured with visible and invisible light. The device is countersigned by the fact that the data recorded in claim 1 can be directly compared with other data from the respective sensors involved and thus helps the particular application. The device of claim 1 to 5 is characterized by the fact that movements of a human for vital data measurements also measured by light, can be assigned as a defined and evaluable movements a benefit. The device is characterized in that individual data as well as continuous data can be measured. The device is countersigned by detecting movements and accelerations of limbs of a person from the position to the hydrostatic point of difference HIP. The device is characterized in that defined and measurable motion artifacts in the measurement of vital and movement data also with visible and invisible light and other sensors for position, acceleration, movement temperature, Impendanz and pressure measured to improve the data for wearables like rings , Watches serve wrist bands and footbands, headbands, earphones, patches, shoes, soles, socks, gloves, holds and foot rests. The method is characterized in that, for example, white light from the measured total brightness, for example, of a smartphone is split up by means of color models into colors, for example green, red and blue. The method is characterized in that white light is split as a measured total brightness by means of color models in a variety of colors. The method is characterized in that the colors from the split light provide information for different pulse waves within a pulse wave / RR interval. The method is characterized in that the measured total brightnesses, for example, from at least one RR interval, from at least an image of a camera, as a single image or series of images are converted into color models. The method is characterized in that the measured total brightnesses of at least one RR interval are split into color models and colors. The method is characterized in that at least one color is determined with at least one color model, for example YCbCr or and RGB. The method is characterized in that the hydrostatic indifferent point HIP is detected. The method is characterized in that by splitting the measured total brightnesses from, for example, white light, at least one colored pulse wave can be determined and its speed can be measured. The process is countered by providing defined and measurable motion artefacts during the measurement of vital signs, improving data for wearables such as rings, watches arm and foot bands, headbands, headphones, plasters, shoes, soles, socks, gloves, hold-downs and foot rests ,

Images