WO2014156051A1 - Refrigerator and refrigerator system - Google Patents

Refrigerator and refrigerator system Download PDF

Info

Publication number
WO2014156051A1
WO2014156051A1 PCT/JP2014/001532 JP2014001532W WO2014156051A1 WO 2014156051 A1 WO2014156051 A1 WO 2014156051A1 JP 2014001532 W JP2014001532 W JP 2014001532W WO 2014156051 A1 WO2014156051 A1 WO 2014156051A1
Authority
WO
WIPO (PCT)
Prior art keywords
refrigerator
storage
display terminal
door
image data
Prior art date
Application number
PCT/JP2014/001532
Other languages
French (fr)
Japanese (ja)
Inventor
上迫　豊志
雅至 中川
元城 中村
Original Assignee
パナソニック株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
Priority to CN201490000557.9U priority Critical patent/CN205245656U/en
Priority to DE212014000095.5U priority patent/DE212014000095U1/en
Publication of WO2014156051A1 publication Critical patent/WO2014156051A1/en

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D27/00—Lighting arrangements
    • F25D27/005—Lighting arrangements combined with control means
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2400/00—General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
    • F25D2400/36—Visual displays

Definitions

  • the present invention relates to a refrigerator and a refrigerator system that can photograph food in a storage and check the storage status with a display terminal or the like.
  • a terminal is also provided on the surface of the refrigerator, and the display terminal is composed of a terminal incorporated in the refrigerator surface and a terminal such as a mobile phone that can be carried away from the refrigerator surface.
  • Both terminals are configured to be able to display the food storage status in the storage taken by the small camera on the display unit via the Internet line. Thereby, it is possible to know the state of food storage in the storage without opening the refrigerator door, not only when going out but also at home (see, for example, Patent Document 3).
  • Japanese Patent Application Laid-Open No. 2004-228561 discloses that when photographing with a small camera, photographing is performed with an interior illumination lamp in a storage. However, food illuminated by the interior lighting located on the back wall of the storage. When photographing with a small camera provided on the inner surface of the door, the image is dark and it is difficult to determine the food type as it is. Therefore, it is necessary to perform advanced correction processing to make it easy to determine the type of food, which causes a significant increase in cost and becomes a major obstacle to commercialization.
  • the present invention has been made in view of these problems, and provides a refrigerator and a refrigerator system that can easily photograph foods in a storage and can easily identify foods. .
  • the refrigerator of the present invention includes a storage, a camera that captures food in the storage, a communication unit that transmits image data captured by the camera to the server device via the Internet, and the interior of the storage when irradiated by the camera. And an interior lighting provided in the storage. Moreover, the camera and the interior lighting lamp are arrange
  • the food in the storage can be irradiated with the interior lighting, and the interior of the storage can be photographed by the camera from the side irradiated with the interior lighting. Thereby, the food in the storage can be photographed brightly and clearly. Therefore, the food in the storage can be easily identified.
  • FIG. 1 is a front view of the refrigerator in the embodiment of the present invention.
  • FIG. 2 is a cross-sectional view seen from the side showing a schematic configuration of the refrigerator in the embodiment of the present invention.
  • FIG. 3 is a perspective view showing the internal structure when the door of the refrigerator storage in the embodiment of the present invention is opened.
  • FIG. 4A is a perspective view showing a state in which a display terminal is integrally provided in the refrigerator according to the embodiment of the present invention.
  • FIG. 4B is a perspective view showing a state in which the display terminal is detachably mounted on the refrigerator in the embodiment of the present invention.
  • FIG. 5A is a diagram illustrating a cross-sectional configuration example when the display terminal is integrally attached to the door in the refrigerator according to the embodiment of the present invention.
  • FIG. 5B is a diagram showing a cross-sectional configuration example when the display terminal is detachably attached to the door in the refrigerator according to the embodiment of the present invention.
  • FIG. 6A is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is a glass plate in the refrigerator according to the embodiment of the present invention.
  • FIG. 6B is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is a glass plate in the refrigerator according to the embodiment of the present invention.
  • FIG. 6A is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is a glass plate in the refrigerator according to the embodiment of the present invention.
  • FIG. 6B is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is
  • FIG. 6C is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is a magic mirror in the refrigerator according to the embodiment of the present invention.
  • FIG. 7 is a cross-sectional view seen from the side showing a state in which the door is closed in the refrigerator according to the embodiment of the present invention.
  • FIG. 8A is a cross-sectional view seen from above showing an inner surface portion of the door in a state where the door is closed in the refrigerator according to the embodiment of the present invention.
  • FIG. 8B is a front view of the inner surface portion of the door in the refrigerator according to the embodiment of the present invention.
  • FIG. 9A is a cross-sectional view seen from the side showing another example of the attachment of the camera of the refrigerator in the embodiment of the present invention.
  • FIG. 9B is a cross-sectional view seen from the side showing another example of the attachment of the camera of the refrigerator in the embodiment of the present invention.
  • FIG. 9C is a cross-sectional view seen from the side showing another example of attachment of the camera of the refrigerator in the embodiment of the present invention.
  • FIG. 10 is a cross-sectional view of the refrigerator in the embodiment of the present invention as seen from the side, showing an example of camera attachment in the case of a single door configuration.
  • FIG. 11A is a cross-sectional view seen from above the door portion with the door closed, showing an example of mounting the refrigerator camera in the embodiment of the present invention.
  • FIG. 11B is a front view of the inner surface side of the door in a state where the door is opened, showing an example of mounting the camera of the refrigerator in the embodiment of the present invention.
  • FIG. 12A is a cross-sectional view seen from above showing another example of camera attachment for a single door refrigerator according to an embodiment of the present invention.
  • FIG. 12B is a front view of the door inner surface side showing another example of camera attachment for the refrigerator with a single door configuration according to the embodiment of the present invention.
  • FIG. 13 is a view seen from below for explaining a shooting state in the camera mounting example of FIGS. 12A and 12B.
  • FIG. 14 is a diagram showing a cross-sectional configuration viewed from the side, showing an example of a camera attached to the refrigerator in the embodiment of the present invention.
  • FIG. 15 is a diagram showing a system configuration of the refrigerator system in the embodiment of the present invention.
  • FIG. 16 is a diagram showing a system configuration of a refrigerator used in the refrigerator system in the embodiment of the present invention.
  • FIG. 17 is a diagram illustrating a configuration example of the server device of the refrigerator system in the embodiment of the present invention.
  • FIG. 18 is a flowchart showing an operation when photographing food in the storage when the door is closed in the refrigerator according to the embodiment of the present invention.
  • FIG. 19 is a flowchart showing an operation in the case where the food in the storage room is photographed during cooling after the food in and out of the refrigerator is taken in and out in the refrigerator according to the embodiment of the present invention.
  • FIG. 20 is a flowchart showing an operation when food in the storage is photographed when the door is opened at a predetermined angle in the case where the refrigerator according to the embodiment of the present invention has a single door.
  • FIG. 21 is a flowchart showing another example of the control of turning on and off the interior illumination lamp during photographing by the camera in the refrigerator of the present embodiment.
  • FIG. 22 is a flowchart when the server device performs image data storage processing and composition processing in the refrigerator system according to the embodiment of the present invention.
  • FIG. 23 is a flowchart when image data storage processing and composition processing are performed on the refrigerator side in the refrigerator system according to the embodiment of the present invention.
  • FIG. 24 is a flowchart in the case where image data storage processing and composition processing are performed on the display terminal side in the refrigerator system according to the embodiment of the present invention.
  • FIG. 25 is a flowchart showing transmission / reception between the server device or the refrigerator and the display terminal in the refrigerator system according to the embodiment of the present invention.
  • FIG. 26 is a flowchart showing an operation when image data is already stored and stored in the display terminal in the refrigerator system according to the embodiment of the present invention.
  • FIG. 27 is a flowchart showing an operation in a case where the individual image captured by each camera and the composite image are switched and transmitted / received in the refrigerator system according to the embodiment of the present invention.
  • FIG. 28 is a flowchart of processing performed when there is an image prior transmission request from the display terminal in the refrigerator system according to the embodiment of the present invention.
  • FIG. 29 is a diagram showing a display display when the communication path of the display terminal is selected in the refrigerator system according to the embodiment of the present invention.
  • FIG. 30 is a diagram illustrating an example in which images are combined in the refrigerator system according to the embodiment of the present invention.
  • Configuration of French Door Type Refrigerator First, the configuration of the French door type refrigerator 100 will be described with reference to FIGS. 1 to 9C.
  • FIG. 1 is a front view of a refrigerator 100 according to an embodiment of the present invention
  • FIG. 2 is a cross-sectional view showing a schematic configuration of the refrigerator 100, viewed from the side
  • FIG. It is a perspective view which shows an internal structure when the door 10 of this is opened.
  • the refrigerator 100 includes a refrigerator body 1.
  • the refrigerator body 1 includes a metal (for example, iron plate) outer box 2 that opens forward, a hard resin (for example, ABS) inner box 3, and a hard foam filled between the outer box 2 and the inner box 3. And a heat insulating material 4 such as urethane foam.
  • a plurality of storages are partitioned.
  • the plurality of storages are provided from the upper part of the refrigerator body 1 to the refrigerating room 5, the switching room 6 located below the refrigerating room 5, and the ice making room 7, the switching room 6, and the ice making room 7 arranged in parallel to the switching room 6.
  • the freezer compartment 8 located in the lower part and the vegetable compartment 9 located in the lower part of the freezer compartment 8 are included.
  • the front surface of the refrigerator compartment 5 is closed freely by a door 10 that is a double-spread type heat insulating door. Front portions of the switching chamber 6, the ice making chamber 7, the freezing chamber 8, and the vegetable chamber 9 are closed freely by drawer-type doors 11, 12, 13, and 14, respectively.
  • a cooling chamber 16 is disposed on the back side of the refrigerator body 1.
  • the cooling chamber 16 is provided with a cooler 17 that generates cool air, a blower fan 18 that supplies the cool air to each chamber, and a damper 22 that is an air volume adjusting means for adjusting the air volume to the refrigerator compartment. Yes.
  • a compressor 19 is provided in the back of the top surface of the refrigerator body 1.
  • a condenser (not shown), a heat radiating pipe 20, a capillary tube 21, and a cooler 17 are sequentially connected in an annular shape to constitute a refrigeration cycle. The refrigeration cycle is configured so that a refrigerant is sealed and a cooling operation is performed.
  • each of the doors 10 to 14 described above is filled with hard foamed urethane like the refrigerator body 1 and has a heat insulating property.
  • a display device is provided on the front surface of one of the storage doors 10 serving as the refrigerator compartment 5 (in the present embodiment, on the right side in FIG. 1).
  • a display terminal 15 is provided.
  • FIG. 4A is a perspective view showing a state in which display terminal 15 is integrally provided in refrigerator 100 according to the embodiment of the present invention
  • FIG. 4B is a diagram in which display terminal 15 is detachably installed in refrigerator 100. It is a perspective view which shows a state.
  • the display terminal 15 includes a display such as a liquid crystal panel and a control unit that controls the display, and is attached to the door 10 integrally.
  • the display terminal 15 may be configured by a smartphone, a tablet PC, or the like and detachably disposed on the door 10.
  • FIG. 5A is a diagram illustrating a cross-sectional configuration example when the display terminal 15 is integrally attached to the door 10 in the refrigerator 100 according to the embodiment of the present invention
  • FIG. It is a figure which shows the cross-sectional structural example at the time of attaching the display terminal 15 to the door 10 so that attachment or detachment is possible.
  • the door 10 mainly includes an outer panel 10 a disposed on the front side of the refrigerator 100, an inner plate 10 b disposed on the inner side of the refrigerator 100, and an outer panel. It is comprised with the heat insulating material 4 with which it filled between 10a and the inner side board 10b.
  • the jacket panel 10a is made of a metal member such as a color steel plate or a transparent member such as a glass plate.
  • the inner plate 10b is made of a synthetic resin member formed by vacuum molding or the like. Around the inner plate 10b, a raised wall portion 10b-1 projecting inward is provided in a square shape when viewed from the inner side.
  • the heat insulating material 4 the hard foaming urethane etc. which were mentioned above are used, for example.
  • a resin-made storage frame body that covers the heat insulating material 4 continuously with the jacket panel 10 a on the front side of the door 10. 23 is provided.
  • the jacket panel 10a is a glass plate
  • the storage frame 23 is integrally bonded to the glass plate.
  • the display terminal 15 is fixed to the storage frame 23 via the terminal holder 24.
  • a touch panel 25 is provided on the front side of the display terminal 15.
  • a gap 26 is provided between the display terminal 15 and the touch panel 25 so that the touch panel 25 does not malfunction due to noise from the display terminal 15.
  • the display terminal 15 and the touch panel 25 are fixed by attaching a frame body 27 covering their outer peripheral edges to the surface of the door 10.
  • the heat insulating material 4 does not touch the display terminal 15 directly. Therefore, when foaming the heat insulating material 4, it is possible to prevent the occurrence of problems such as the display terminal 15 being exposed to a high temperature or being deformed.
  • the recess 28 is formed by providing the storage frame 23 on the front surface of the door 10.
  • the display terminal 15 is detachably disposed in the recess 28.
  • 6A and 6B are cross-sectional configurations of the door 10 and the display portion of the display terminal 15 when the cover panel 10a of the door 10 is the glass plate 10a-1 in the refrigerator 100 according to the embodiment of the present invention.
  • 6C is an example of a cross-sectional configuration of the door 10 and the display portion of the display terminal 15 when the outer cover panel 10a of the door 10 is the magic mirror 10a-2 in the refrigerator 100.
  • FIG. FIG. 1 is a cross-sectional configurations of the door 10 and the display portion of the display terminal 15 when the outer cover panel 10a of the door 10 is the magic mirror 10a-2 in the refrigerator 100.
  • a smoke sheet 29 in which only a portion facing the display terminal 15 is transparent is provided between the display terminal 15 embedded in the door 10 and the glass plate 10a-1.
  • FIG. 6B shows a configuration in which a transparent liquid crystal display unit is used as the display unit of the display terminal 15 and a smoke sheet 29a that is entirely black is laid along the back surface of the transparent liquid crystal display unit. Even with such a configuration, the appearance can be improved.
  • FIG. 6C the smoke sheets 29 and 29a are unnecessary by using the magic mirror 10a-2 instead of the glass plate 10a-1 used in FIGS. 6A and 6B. Even in this configuration, the appearance can be maintained well.
  • 6A to 6C show an example in which the display terminal 15 is attached to the door 10 integrally. Instead of arranging the smoke sheet 29a, the rear surface side of the glass plate 10a-1 may be painted so as to look blackish.
  • FIG. 7 With reference to FIG. 7, FIG. 8A, and FIG. 8B, an example of mounting the camera and the interior lamp in the refrigerator 100 of the present embodiment will be described.
  • FIG. 7 is a cross-sectional view of the refrigerator 100 according to the embodiment of the present invention as viewed from the side, showing a state in which the door 10 is closed, and FIG. 8A shows the door in the refrigerator 100 with the door 10 closed.
  • FIG. 8B is a front view of the inner surface portion of the door 10 in the refrigerator 100.
  • the storage of the refrigerator 100 is provided with a plurality of shelf plates 30-1 to 30-4 as partition shelves in the vertical direction.
  • Each of the shelf boards 30-1 to 30-4 is made of a transparent synthetic resin material or a light-transmitting material such as glass, except for the surrounding frame.
  • a storage container 31 that can be pulled out is disposed below the lowermost shelf 30-4.
  • the lowermost shelf 30-4 constitutes the upper surface of the storage container 31, and is fixed.
  • the shelf plates 30-1 to 30-3 are respectively placed on the side wall projections 32-1 to 32-3 provided on the both side walls of the storage, and are detachable.
  • the shelf board 30-4 is placed on the storage container 31.
  • a plurality of side wall convex portions 32-2 corresponding to the central shelf plate 30-2 are provided at different heights. The height of the shelf board 30-2 can be adjusted.
  • a plurality of door pockets 33-1 to 33-3 are provided in the vertical direction on the inner surface side of the door 10 that opens and closes the opening of the storage.
  • the door pockets 33-1 to 33-3 are also formed of a light transmissive material.
  • the interior lighting lamps 34-1 and 34-2 which are illumination devices, are provided in front of the front ends of the shelf plates 30-1 to 30-4, on both sides of the front opening of the storage, and on the wall surface of the upper surface of the front opening. And is provided.
  • a substrate on which a plurality of LEDs are arranged is, for example, the interior lighting lamp 34-1 in the vertical direction. It is provided and covered with a translucent cover.
  • Cameras 35-1 and 35-2 which are imaging devices, are provided so as to be located on the front side of the storage, similarly to the interior lighting lamps 34-1 and 34-2.
  • the cameras 35-1 and 35-2 are composed of, for example, a CCD camera or a CMOS camera, and the type thereof is not particularly limited to these examples. However, it is desirable to use a camera that is resistant to condensation and the like. .
  • two cameras are provided.
  • One camera 35-1 is attached to a substantially central lower surface in the front-rear direction of the upper door pocket 33-1.
  • the other camera 35-2 is attached near the upper part of the lowermost door pocket 33-3.
  • the front-rear direction of the door pocket 33-1 is a direction perpendicular to the surface formed by the inner plate 10b of the door 10, and is the same direction as the front-rear direction of the storage when the door 10 is closed. It is.
  • the upper camera 35-1 is provided at a substantial front position of the uppermost shelf 30-1.
  • the lower camera 35-2 is provided in front of the third shelf 30-3 from the top in the drawing. Both cameras are provided on the premise of height adjustment.
  • the cameras 35-1 and 35-2 are not the shelf 30-2 mounted on the plurality of side wall projections 32-2, but the shelf 30-1 that is detachable but does not require height adjustment, or the shelf It is provided at a substantially forward position of the plate 30-3.
  • each of the cameras 35-1 and 35-2 is located in front of the front ends of the shelf boards 30-1 to 30-4, and as shown in FIG. 8B, It is provided so as to be positioned in the vicinity of the open end side end Y opposite to the shaft support X of the door 10, that is, in the substantial center in the left-right direction of the refrigerator 100.
  • the two cameras 35-1 and 35-2 are arranged so that almost the entire area can be photographed.
  • the cameras 35-1 and 35-2 are provided on the side of the door 10 having a relatively large area, and are disposed so as to be located at the substantial center of the refrigerator 100.
  • the cameras 35-1 and 35-2 are arranged on the door 10 side where the center pillar 36 (see FIG.
  • the center pillar 36 is used to prevent cold air in the storage from leaking from a gap formed between the two doors 10 on one side surface of the two doors 10. It is a member provided.
  • FIG. 9A to FIG. 9C are cross-sectional views seen from the side showing other examples of the attachment of the camera of the refrigerator 100 in the embodiment of the present invention.
  • a camera 35-3 for photographing the inside of the storage container 31 can be additionally installed.
  • the lower camera 35-2 is provided so as to be movable in the vertical direction
  • the lower camera 35-2 is provided so as to be rotatable in the vertical direction. And it can set according to the form of refrigerator 100 to install.
  • the interior lighting lamps 34-1 and 34-2 are provided at positions on the far side of the storage with respect to the cameras 35-1 and 35-2.
  • the interior illumination lamps 34-1 and 34-2 are provided so that light does not directly enter the photographing units of the cameras 35-1 and 35-2.
  • the photographing units of the cameras 35-1 and 35-2 correspond to the irradiation amount (maximum irradiation amount) in the irradiation direction of the interior lamps 34-1 and 34-2.
  • the irradiation amount is provided outside the range where the irradiation angle is 60 degrees.
  • a light-shielding portion is provided on the camera side of the interior lighting lamps 34-1 and 34-2, and light sources such as LEDs constituting the interior lighting lamps 34-1 and 34-2 are inclined obliquely rearwardly. By doing so, it is possible to prevent the light from the interior illumination lamps 34-1 and 34-2 from directly entering the photographing units of the cameras 35-1 and 35-2.
  • These methods can be appropriately selected according to the installation conditions of the camera. The same applies to a single door type refrigerator 200 described below.
  • FIG. 10 is a cross-sectional view of the refrigerator 200 according to the embodiment of the present invention as seen from the side, showing a camera mounting example in the case of a single door configuration
  • FIG. 11A shows a camera mounting example of the refrigerator 200. It is sectional drawing seen from the door 10 part of the state which closed the door 10
  • FIG. 11B is a front view by the side of the inner surface of the door 10 of the state which opened the door 10 which shows the camera attachment example of the refrigerator 200. .
  • the upper camera 35-1 is a general arrangement example in the single door configuration
  • the raised wall portion 10b-2 is provided between the door pockets 33-4 and 33-6 and the door pocket 33-5.
  • the lower camera 35-2 is provided on the inner surface of the door between the door pocket 33-7 and the door pocket 33-8, which are juxtaposed in the vertical direction.
  • each of the cameras 35-1 and 35-2 described above has a shelf 30-1 and a shelf 30-3 that are detachable but are not predicated on height adjustment. It is provided at a substantially forward position. As shown in FIG. 10, the cameras 35-1 and 35-2 are provided in front of the front ends of the shelf plates 30-1 to 30-4. Further, as shown in FIGS. 11A and 11B, the cameras 35-1 and 35-2 are provided in the vicinity of the central portion of the door 10, that is, in the substantially central portion in the left-right direction of the refrigerator 200. The cameras 35-1 and 35-2 are configured so that almost the entire area inside the warehouse can be photographed.
  • the interior lighting lamps 34-1 and 34-2 are provided in the same manner as the French door type refrigerator 100. That is, the interior lighting lamps 34-1 and 34-2 are in front of the front ends of the respective shelf plates 30-1 to 30-4, and both side walls of the front opening of the storage and the upper wall surface of the front opening. And is provided.
  • the interior illumination lamps 34-1 and 34-2 are provided at positions where light does not directly enter the photographing units of the cameras 35-1 and 35-2. Specifically, the imaging units of the cameras 35-1 and 35-2 have an irradiation amount of 1 ⁇ 2 with respect to the irradiation amount (maximum irradiation amount) in the irradiation direction of the interior lamps 34-1 and 34-2.
  • the above range, in this example, is provided outside the range of the irradiation angle of 60 degrees.
  • FIG. 12A is a cross-sectional view seen from above showing another example of camera attachment for refrigerator 200 having a single door configuration according to the embodiment of the present invention
  • FIG. It is a front view of the door 10 inner surface side which shows the other example.
  • FIG. 13 is a view seen from below for explaining a shooting state in the camera mounting example of FIGS. 12A and 12B.
  • the cameras 35-1 and 35-2 are provided in the vicinity of Y on the door open end side opposite to the shaft support portion X of the door 10. ing.
  • the height positions of the cameras 35-1 and 35-2 are the same positions as those of the single door described above (see FIGS. 11A and 11B).
  • the photographing is performed when the door 10 is opened at a predetermined angle, for example, 30 degrees.
  • the image can be taken over a wide range up to the vicinity of the opening of the storage, and the user sometimes opens the door slightly. This is substantially the same as the state seen when checking the inside state. Therefore, when visually recognizing the image on the display terminal 15, the user can see the image in a natural form without feeling uncomfortable.
  • FIG. 14 is a diagram showing a cross-sectional configuration viewed from the side, showing an example of a camera attached to refrigerators 100 and 200 in the embodiment of the present invention.
  • the entire area in the cabinet can also be photographed by installing the upper and lower cameras 35-1 and 35-2 close to each other.
  • the camera module 41 by integrating the cameras 35-1 and 35-2.
  • modularizing it is possible to facilitate installation and reduce costs.
  • modularization can be promoted by using a wide-angle lens such as a fisheye lens.
  • FIG. 15 is a diagram showing a system configuration of the refrigerator system 50 according to the embodiment of the present invention.
  • the refrigerator system 50 is a system that allows the user to check the food status in the refrigerators 100 and 200 using the display terminal 15 or the like.
  • the refrigerator system 50 includes refrigerators 100 and 200 and a display terminal 15. Furthermore, the refrigerator system 50 includes a wireless adapter 53 that is a communication unit, a gateway device 54 that is a relay device, a router device 55, and a server device 57.
  • Refrigerators 100 and 200 are arranged in the user's residence A, for example, in the kitchen room.
  • the wireless adapter 53 is configured to be electrically connected to a control unit (described later) of the refrigerators 100 and 200 and to communicate with the router device 55 via the gateway device 54.
  • the wireless adapter 53 receives the signal transmitted from the router device 55 and outputs the received signal to the control units of the refrigerators 100 and 200. Based on this signal, the refrigerators 100 and 200 are configured to perform corresponding operations.
  • the wireless adapter 53 also receives at least one of the identification information (for example, the serial number and model number) of the refrigerators 100 and 200 and the image data in the store to be described later from the storage unit of the refrigerators 100 and 200. The information is acquired and transmitted to the router device 55 via the gateway device 54.
  • the wireless adapter 53 may be provided integrally with the refrigerators 100 and 200, or may be configured to be detachable.
  • the wireless adapter 53 includes a “connect” button 53a.
  • the “connect” button 53 a is a button for newly connecting to the gateway device 54.
  • the wireless adapter 53 is configured to acquire identification information (for example, a manufacturing number or a model number) of the refrigerators 100 and 200 from the storage unit 60 of the refrigerators 100 and 200. Yes.
  • a general-purpose portable terminal such as a smartphone or a tablet PC (personal computer) can be used as the display terminal 15.
  • the display terminal 15 can be detachably mounted on the doors 10 of the refrigerators 100 and 200, and has a function (means) for connecting to the Internet 56 and a function for communicating with a gateway device 54 described later ( Means).
  • the display terminal 15 (for example, a smartphone) is configured to be able to connect to the Internet 56 via a telephone line network (for example, a 3G line network).
  • a telephone line network for example, a 3G line network
  • the display terminal 15 is configured to be connected to the Internet 56 via a public wireless LAN, for example, by a Wi-Fi communication function.
  • the display terminal 15 acquires, for example, at least one of image data of food in the refrigerators 100 and 200 and data for energy saving operation (for example, data such as the number of times of opening and closing the door).
  • the program can be acquired from the website of the manufacturer of the refrigerator 100 or 200 via the Internet 56.
  • the display terminal 15 installs the acquired program and activates the installed program. Thereby, the display terminal 15 can acquire image data of food in the refrigerators 100 and 200. That is, the display terminal 15 can generate and transmit an operation signal for acquiring image data of the refrigerators 100 and 200 by operating the operation screen of the display 15a. Details will be described later.
  • the display terminal 15 is connected to the router device 55 by general-purpose communication not via the Internet 56, such as Wi-Fi communication, Bluetooth (registered trademark) communication, and infrared communication.
  • the display terminal 15 is configured to be connected for communication with the gateway device 54 via the router device 55.
  • Devices necessary for this purpose for example, Wi-Fi antennas are incorporated in the display terminal 15.
  • the gateway device 54 is a device that relays communication between the wireless adapter 53 and the display terminal 15. For example, the gateway device 54 transmits a signal of a specific low power wireless special small frequency band (924.0 to 928.0 MHz) to the wireless adapter 53. It is comprised so that it can communicate using.
  • the frequency band of communication between the gateway device 54 and the wireless adapter 53 is preferably a low frequency band that reaches a long distance, and the gateway device 54, together with the router device 55, is the residence of the user in which the refrigerators 100 and 200 are installed. It is installed in A.
  • the gateway device 54 is configured to be able to communicate with the display terminal 15 via the router device 55. That is, the gateway device 54 is configured to be able to execute communication (first communication) with the display terminal 15 not via the Internet 56 but only through the router device 55.
  • the gateway device 54 is configured to be connectable to the Internet 56 via the router device 55. Thereby, the gateway device 54 can communicate with the display terminal 15 (second communication) via the Internet 56 and the router device 55. The gateway device 54 can also communicate with the server device 57.
  • the gateway device 54 communicates with the display terminal 15 via the Internet 56 (ie, the first communication via only the router device 55) and via the Internet 56 (ie, the Internet 56 and the router device 55). 2nd communication via). The reason for this configuration will be described later.
  • the server device 57 is prepared by a manufacturer of the refrigerators 100 and 200, for example.
  • the server device 57 manages information necessary for access and authentication regarding the display terminal 15, the refrigerators 100 and 200, and the wireless adapter 53.
  • the server device 57 authenticates whether the identification information of the display terminal 15 included in the communication request signal matches the identification information of the display terminal stored (registered) in association with the wireless adapter 53. (Distinction) Then, if they match, the server device 57 authenticates the accessing display terminal 15 as a regular display terminal and permits communication with the refrigerators 100 and 200 in the residence A.
  • the server device 57 stores at least one of the image data transmitted from the refrigerators 100 and 200, the food image data in the refrigerators 100 and 200, and the data for energy saving operation. These data are transmitted from the server device 57 to the display terminal 15 based on a data call signal from the display terminal 15. That is, the user can check the food image data in the refrigerators 100 and 200 on the display 15a by operating the display terminal 15.
  • FIG. 16 is a diagram showing a system configuration of the refrigerators 100 and 200 used in the refrigerator system 50 according to the embodiment of the present invention.
  • the refrigerators 100 and 200 include an interface 58 (I / F), a controller 59 as a control unit, a storage unit 60, a door open / close detection unit 61, and interior lighting lamps 34-1 and 34-2. Cameras 35-1 and 35-2, a fan drive circuit 62, a compressor drive circuit 63, a blower fan 18, and a compressor 19.
  • the refrigerators 100 and 200 are supplied with power from an AC power source 64 such as a commercial power source in the residence A, for example.
  • the interface 58 exchanges data and the like between the wireless adapter 53 and the controllers 59 of the refrigerators 100 and 200.
  • the controller 59 controls the operation of the refrigerators 100 and 200. In addition, the controller 59 controls the cameras 35-1 and 35-2 and the interior lighting lamps 34-1 and 34-2 to photograph the food in the refrigerators 100 and 200, and the captured image data. Once stored in the storage unit 60. The controller 59 further transmits the image data to the server device 57 on the Internet 56.
  • the controller 59 immediately transmits the image data to the display terminal 15 via the server device 57 after photographing food. To instruct. Details of this operation will be described later.
  • the storage unit 60 rewrites and stores the image data of the food in the cabinet taken by the cameras 35-1 and 35-2 and the data for energy saving operation, in addition to the identification symbol and the control program.
  • the interior lighting lamps 34-1 and 34-2 are controlled to be turned on and off by the controller 59 based on a signal from the door opening / closing detection unit 61. Specifically, for example, the interior lighting lamps 34-1 and 34-2 are turned on when the door 10 is opened, and are turned off with a delay time of several seconds when the door 10 is closed.
  • the cameras 35-1 and 35-2 are controlled by the controller 59 based on a signal from the door opening / closing detection unit 61. For example, when the door 10 is closed, control is performed so that the cameras 35-1 and 35-2 photograph foods in the refrigerators 100 and 200. Details will be described later.
  • the fan drive circuit 62 receives the control signal from the controller 59 and controls the rotational drive of the blower fan 18.
  • the compressor drive circuit 63 receives the control signal from the controller 59 and controls the drive of the compressor 19 such as the rotational speed.
  • the blower fan 18 operates according to the control of the fan drive circuit 62, and generates an air flow for circulating cold air.
  • the compressor 19 compresses the refrigerant circulating in the refrigerators 100 and 200 according to the control of the compressor drive circuit 63.
  • FIG. 17 is a diagram illustrating a configuration example of the server device 57 of the refrigerator system 50 according to the embodiment of the present invention.
  • the server device 57 includes a server interface 65 (described as I / F in the drawing), a server control unit 66, and a data storage unit 67.
  • the server interface 65 is a communication unit that exchanges data and the like between at least one of the display terminal 15 and the router device 55 and the server device 57 via the Internet 56 under the control of the server control unit 66. is there.
  • the server control unit 66 controls the overall operation of the server device 57.
  • the server control unit 66 performs a combination process on the food image data transmitted from the refrigerators 100 and 200 and stores it in the data storage unit 67.
  • the server control unit 66 updates the latest image data stored in the data storage unit 67 each time the image data is transmitted from the refrigerators 100 and 200. , Transmitted to the display terminal 15 and rewritten and updated on the display terminal 15.
  • the server control unit 66 transmits the latest image data stored in the data storage unit 67 to the display terminal 15. To do.
  • the data storage unit 67 stores necessary data such as a management program for executing control of the refrigerator system 50 and an application program. Furthermore, the data storage unit 67 rewrites and stores the latest data of the food image data transmitted from the refrigerators 100 and 200 under the control of the server control unit 66.
  • the data storage unit 67 includes, for example, an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like.
  • the server device 57 can be constructed by any one of a server device configured by a single large computer and a cloud type server device configured by a large number of computers.
  • FIG. 18 is a flowchart showing an operation when photographing food in the storage when the door 10 is closed in the refrigerators 100 and 200 according to the embodiment of the present invention.
  • the captured image data is stored in the storage unit 60 of the refrigerators 100 and 200 (S6), and the interior lighting lamps 34-1 and 34-2 are turned off (S7).
  • the illuminance of the interior lighting lamps 34-1 and 34-2 is taken to be lower than that when the door 10 is open. Thereby, food can be clearly photographed, which is preferable.
  • the interior lighting lamps 34-1 and 34-2 are turned on with the illuminance when the door 10 is open and the food is photographed, the inner surface of the storage is white, so the entire circumference excluding the opening of the storage Reflected light is strongly reflected from the surface to the food (it returns to the food with high illuminance without lowering the illuminance). If it does so, food will become whitish and clear photography will become difficult. Therefore, as in the example described above, reducing the illuminance of the interior lighting lamps 34-1 and 34-2 can greatly reduce the influence of reflected light from the inner surface of the storage, so that a sharp image can be taken immediately. Is possible.
  • FIG. 19 is a flowchart showing an operation when photographing food in the storage room during cooling after the food in and out of the refrigerator is taken in and out in the refrigerators 100 and 200 according to the embodiment of the present invention. It is.
  • the illuminance of the interior lamps 34-1 and 34-2 is reduced (S4), the cameras 35-1 and 35-2 are activated, and the food in the interior is photographed (S5). Thereafter, the photographed image data is stored in the storage unit 60 of the refrigerators 100 and 200 (S6), and the interior lighting lamps 34-1 and 34-2 are turned off (S7).
  • the photographing by the cameras 35-1 and 35-2 is preferable because it is performed so sharply that the characters written on the food packaging container can be read.
  • the interior illumination lights 34-1 and 34-2 are turned off once and again before photographing.
  • the interior illumination lights 34-1 and 34-2 may be turned on to reduce the illuminance. As a result, it is possible to suppress wasteful power consumption due to the interior lighting lights 34-1 and 34-2 being continuously lit.
  • FIG. 20 shows a case where the food in the storage is photographed when the door 10 is opened at a predetermined angle when the refrigerator 200 according to the embodiment of the present invention is a single door. It is a flowchart which shows operation
  • the opening angle of the door 10 is a predetermined angle, for example, the opening angle of 30 degrees shown in FIG. 13 (S10). If it is determined that the opening angle of the door 10 is equal to or greater than the predetermined angle (S10, YES), the illumination intensity of the interior lighting lamps 34-1 and 34-2 is reduced (S4), and the cameras 35-1, 35- 2 is activated and food in the warehouse is photographed (S5). Thereafter, the photographed image data is stored in the storage unit 60 of the refrigerator 200 (S6).
  • the door 10 is closed, it is detected that the door 10 is closed (S11, YES), and the interior lamp 34- 1 and 34-2 are turned off (S7).
  • the interior of the storage can be photographed over a wide area, as described above, and the image is uncomfortable. This is preferable because it is not natural.
  • step S10 when detecting whether or not the opening angle of the door 10 reaches a predetermined angle, if the door 10 is closed before the door 10 reaches the predetermined angle, the interior lighting lights 34-1 and 34- 2 is turned off and the refrigerator 200 stands by until the door 10 is opened again.
  • the typical shooting operation has been described by way of example. However, in addition to these shooting operations, for example, it is also possible to perform shooting at a fixed time or when a predetermined time elapses after the previous shooting. is there. Also, a shooting operation such as shooting when a shooting instruction is given from the display terminal 15 is possible.
  • the illumination lamps 34-1 and 34-2 are turned on and the illuminance is lowered. Take a picture by irradiating the inside. At this time, it is also possible to turn on only the interior lighting 34-1 on both sides of the storage or the interior lighting 34-2 on the upper surface of the storage, illuminate with lowering the illuminance, and take a picture.
  • FIG. 21 shows another example of the control of turning on and off the interior lighting lamps 34-1 and 34-2 at the time of photographing by the cameras 35-1 and 35-2 in the refrigerators 100 and 200 of the present embodiment. It is a flowchart to show.
  • FIG. 21 corresponds to the operation of the broken line portions (S4 and S5) in FIGS.
  • the interior illumination lamps 34-1 and 34-2 are turned on and the illuminance is lowered to take pictures.
  • one of the interior lamps 34-1 on both sides of the storage is turned off, in other words, only one of the interior lamps 34-1 on both sides of the storage is turned on. Irradiate food and photograph.
  • the interior illumination lamp 34-2 on the upper surface of the storage may be either on or off, and if any state is appropriately selected so that the illuminance in the interior is optimal for photographing. Good.
  • Image data stored by irradiating food from one side can be combined and stored as a single image.
  • the reason why the interior lighting lamps 34-1 and 34-2 are turned on one by one to photograph foods and combine them into one image data is as follows.
  • the illuminance of the interior lighting lamps 34-1 and 34-2 is reduced at the time of shooting, but if the decrease in illuminance is too large, the image becomes dark and lacks clarity. There is a limit to reducing the illuminance. For this reason, it is necessary to maintain a certain level of illuminance. However, even if the illuminance is high, the effect of reflected light may remain when the internal volume of the storage is small. However, as described above, when the food is photographed by lighting one of the left and right sides of the interior lamp 34-1, the influence of the reflected light can be reduced, and the side where the interior lamp 34-1 is lit. The surface can be taken with moderate brightness. Therefore, it is preferable to perform a combining process that combines the left and right images of food taken with moderate brightness, so that the entire image can be made clear.
  • FIG. 22 is a flowchart when the server device 57 performs image data storage processing and composition processing in the refrigerator system 50 according to the embodiment of the present invention.
  • the refrigerators 100 and 200 connect the gateway device 54 and the router device 55 from the wireless adapter 53. To the Internet 56 (S20). Then, the refrigerators 100 and 200 transmit the individual image data photographed and stored by each camera to the server device 57 connected to the Internet 56 (S21).
  • the image data transmitted via the Internet 56 is subjected to a combining process (S22) for combining individual image data by the server control unit 66 of the server device 57.
  • the combined image data is stored in the data storage unit 67 of the server device 57 (S23).
  • FIG. 23 is a flowchart in the case where image data storage processing and composition processing are performed on the refrigerators 100 and 200 side in the refrigerator system 50 according to the embodiment of the present invention. .
  • the controller 59 that is the control unit of the refrigerators 100 and 200 is stored in the storage unit 60. Individual image data from each camera is extracted, combined, and synthesized (S24). Then, the controller 59 stores the synthesized image data in the storage unit 60 (S25).
  • the refrigerators 100 and 200 are connected from the wireless adapter 53 to the Internet 56 via the gateway device 54 and the router device 55 (S20). Then, the refrigerators 100 and 200 transmit the stored image data to the server device 57 connected to the Internet 56 (S21). The composite image data transmitted via the Internet 56 is stored in the data storage unit 67 of the server device 57 (S23).
  • the load on the controller 59 and the storage unit 60 on the refrigerators 100 and 200 side increases, but image data can be transmitted and received with the display terminal 15 without going through the data storage unit 67 of the server device 57. Therefore, the system operation cost can be reduced.
  • FIG. 24 is a flowchart in the case where image data storage processing and composition processing are performed on the display terminal 15 side in the refrigerator system 50 according to the embodiment of the present invention. .
  • the refrigerators 100 and 200 are connected from the wireless adapter 53 to the gateway device 54 and the router device 55. Then, it connects to the Internet 56 (S20). The refrigerators 100 and 200 transmit the image data to the display terminal 15 instead of the server device 57 (S26). The image data transmitted via the Internet 56 is subjected to a combining process (S27) for combining the image data by the display terminal 15. The combined image data is stored in the data storage unit of the display terminal 15 (S28).
  • the load on the display terminal 15 increases, the load on the controller 59 and the storage unit 60 on the refrigerator 100, 200 side can be reduced, and the Internet-compatible refrigerator 100, 200 can be made inexpensive. Can be provided.
  • the apparatus for storing and the apparatus for combining do not necessarily have to be performed by the same apparatus, for example, the server apparatus 57.
  • image data is combined by the refrigerators 100 and 200, and the server apparatus 57 performs image processing. What is necessary is just to set arbitrarily according to the structure of the refrigerator system 50, such as preserve
  • FIG. 25 is a flowchart showing transmission / reception between server device 57 or refrigerators 100 and 200 and display terminal 15 in refrigerator system 50 according to the embodiment of the present invention.
  • FIG. 25 shows a transmission / reception process of image data stored in the server device 57 or the refrigerators 100 and 200.
  • the user presses a server connection button (not shown) displayed on the display 15a of the display terminal 15 at a shopping destination, for example, and requests to read image data stored in the data storage unit 67 of the server device 57. (S31).
  • the display terminal 15 detects whether image data has been taken in from the server device 57 (S32). In step S32, if the image data is not transferred (S32, NO), connection is made from the display terminal 15 to the Internet 56 (S33).
  • the image data stored in the data storage unit 67 of the server device 57 or the storage unit 60 of the refrigerators 100 and 200 is taken out (S34), and the image data passes through the Internet 56 and is the smartphone that is the data caller. Or the like is transferred to the display terminal 15 (S35).
  • the display terminal 15 detects whether or not the image data is captured from the server device 57 or the like (S32), and when the image data is captured (S32, YES), outputs the image data to the display 15a of the display terminal 15 (S32). S36).
  • the display terminal 15 detects whether or not an enlarge button (not shown) displayed on the display 15a has been pressed (S37).
  • the display terminal 15 detects that the enlarge button has been pressed (S37, YES)
  • the display terminal 15 The image data stored in the storage is enlarged by 1.1 times or more by digital conversion to create image data.
  • the display terminal 15 outputs the enlarged and converted image data to the display of the display terminal 15 (S36).
  • the display terminal 15 detects whether a numeric key button (not shown) displayed on the display 15a has been pressed (S38), and if it detects that the numeric key button has been pressed (S38, YES), the display terminal 15 displays on the display 15a.
  • the output enlarged image data in the storage is output to the display 15a as image data corresponding to the location specified by the numeric keypad (S36).
  • the display terminal 15 proceeds to the next step when the enlarge button is not pressed (S37, NO) and when the numeric keypad button is not pressed (S38, NO).
  • the above-described enlargement button and the numeric keypad button for displaying image data at a predetermined location may be a method of tapping the surface of the display 15a with a finger or a method of inputting by sliding. With such a configuration, usability can be improved.
  • the contents of the refrigerators 100 and 200 can be confirmed at a glance at a shopping destination. Therefore, the user can prevent forgetting to buy and can eliminate the waste of purchasing extra food. Further, in a home where couples work together, it is possible to check the inside of the refrigerators 100 and 200 immediately before returning, and to purchase food and the like on the way home, so that the user can effectively use time.
  • FIG. 26 is a flowchart showing an operation when image data is already stored and stored in display terminal 15 in refrigerator system 50 according to the embodiment of the present invention.
  • image data is transmitted from the refrigerators 100 and 200 to the display terminal 15 and stored.
  • the image data is fetched from the storage unit of the display terminal 15 and is output to the display of the display terminal 15 (S36). ).
  • the subsequent enlarged display operation (S37) and local display (S38) are as described with reference to FIG.
  • images captured by the cameras 35-1 and 35-2 individual images of the respective cameras 35-1 and 35-2 (for example, images in the upper half of the storage and Assume that a lower half image) and a synthesized image obtained by combining these captured images (an image synthesized from the top to the bottom in the storage into one sheet) are stored and saved.
  • a synthesized image obtained by combining these captured images an image synthesized from the top to the bottom in the storage into one sheet
  • FIG. 27 is a flowchart showing an operation in the case where the individual images captured by the cameras 35-1 and 35-2 and the composite image are switched and transmitted / received in the refrigerator system 50 according to the embodiment of the present invention.
  • the display terminal 15 determines whether or not the individual image / composite image calling button has been pressed (S41). If the button has been pressed (S41, YES), one of the individual images and the composite image is selected. A call is made (S42, S42 '). Whether the individual image is called or the composite image is called can be switched, for example, every time the button is pressed or by the number of times the button is pressed. Thereafter, according to the flow shown in FIG. 25 or FIG. 26, either individual image data or composite image data is captured and displayed on the display 15 a of the display terminal 15.
  • the image displayed on the display terminal 15 can be switched to either an individual image or a composite image.
  • the composite image is called in and displayed, so that the food status in the storage can be checked at a glance. If it is difficult to distinguish the food because it is in the corner of the storage, switch to the individual image. Can be displayed. Thereby, the user can discriminate
  • FIG. 28 is a flowchart of processing when there is a request for prior transmission of an image from the display terminal 15 in the refrigerator system 50 according to the embodiment of the present invention.
  • the user operates the display terminal 15 to perform a request operation that transmits a prior request signal (S51).
  • the server device 57 or the refrigerators 100 and 200 receives this request signal (S52), and stores image data (individual image data or composite image data corresponding to the request, stored in the data storage unit 67 or the storage unit 60). The same applies hereinafter) is read and transmitted (S53).
  • the display terminal 15 detects whether the image data transmitted from the server device 57 or the refrigerators 100 and 200 has been taken in (S54). If it is determined that the image data has not been transmitted (S54, NO), the display terminal 15 connects to the Internet 56 (S55). If it does so, the image data memorize
  • the display terminal 15 detects whether the image data has been taken in from the server device 57 or the like (S54). When the image data is detected (S54, YES), the display terminal 15 waits for an image data calling operation (S58, NO). . If there is an image data call operation (S58, YES), the display terminal 15 outputs the image data to the display 15a (S59).
  • the server device 57 or the like may be set to transmit image data to the display terminal 15 each time the doors 10 of the refrigerators 100 and 200 are closed. it can. Furthermore, by setting the user having the display terminal 15 to notify that the image data has been transmitted, the user can know that the door has been opened and closed each time. Can do. Therefore, for example, when the door opening / closing frequency increases and the power consumption is likely to increase, the user can call his / her home and talk to the children to refrain from using the refrigerators 100 and 200. In addition, convenience related to energy saving can be improved.
  • FIG. 29 is a diagram showing a display display when the communication path of display terminal 15 is selected in refrigerator system 50 according to the embodiment of the present invention.
  • the flow of image data transmission / reception is as described above.
  • an example of changing the communication path to speed up the acquisition of image data will be described.
  • the user can select whether the communication of the display terminal 15 is performed directly with the gateway device 54 via the router device 55 or with the server device 57 via the Internet 56.
  • the selection buttons 70 and 71 are communication path selection buttons displayed on the display 15a of the display terminal 15.
  • the selection button 70 is a “direct” selection button for directly connecting the display terminal 15 to the refrigerators 100 and 200 via the router device 55 and the gateway device 54.
  • the selection button 71 is a “server” selection button that connects the display terminal 15 to the server device 57 or the refrigerators 100 and 200 via the Internet 56.
  • the data selection buttons 72 and 73 are data selection buttons for selecting data to be called.
  • the data selection button 72 is an image data button for selecting image data of food
  • the data selection button 73 is another data button for selecting data related to energy saving such as the number of times of opening and closing the door.
  • the display terminal 15 also has a send button 74.
  • “direct” communication is set in the display terminal 15.
  • the image data request signal of the display terminal 15 is transmitted directly from the display terminal 15 to the gateway device 54 via the router device 55. Is done.
  • the gateway device 54 transmits the received data request signal to the wireless adapter 53 of the refrigerators 100 and 200.
  • the wireless adapter 53 receives the image data request signal
  • the wireless adapter 53 transmits it to the controller 59 of the refrigerator 100 or 200.
  • the controller 59 of the refrigerator 100 or 200 reads the image data stored in the storage unit 60 and transmits the image data to the display terminal 15 via the wireless adapter 53 and the router device 55.
  • the display terminal 15 when the display terminal 15 possessed by the user is located in the residence A as shown by a two-dot chain line in FIG. 15, in a broad sense, the display terminal 15 exists at a position where the display terminal 15 can directly communicate with the router device 55. Assume that In this case, the display terminal 15 can communicate with the gateway device 54 via the router device 55 and directly acquire image data from the storage unit 60 of the refrigerators 100 and 200.
  • the user The terminal 15 can be switched to “direct” communication. Thereby, it is possible to acquire image data without receiving congestion of the Internet 56 line. Therefore, the user can display an image on the display of the display terminal 15 in real time without waiting time, and can confirm the food state in the storage.
  • the display terminal 15 when the user is located outside the residence A as shown by the solid line in FIG. 15, it is assumed in a broad sense that the display terminal 15 is present at a position where it cannot directly communicate with the router device 55.
  • the display terminal 15 when the user touches the “server” selection button 71, the display terminal 15 communicates with the server device 57 via the Internet 56 and reads the image data of the refrigerators 100 and 200. That is, when the user is outside the residence A, the user sets the “server” communication by touching the “server” selection button 71 to obtain the image data of the refrigerator by the display terminal 15 even in a remote place, You can know the food storage status.
  • the user can select either “direct” communication or “server” communication.
  • server When the user is in the house A, the user can view the image in a comfortable state without being affected by the congestion of the Internet line by selecting “direct” communication.
  • the gateway device 54 is interposed on the communication path between the display terminal 15, the wireless adapter 53 of the refrigerators 100 and 200, and the Internet 56.
  • the gateway device 54 is not necessarily required. is not.
  • the display terminal 15 and the wireless adapter 53 of the refrigerators 100 and 200 can be configured to communicate directly via the Internet 56 via the router device 55. As a result, the system configuration can be simplified.
  • the image data is acquired from the server device 57.
  • the display terminal 15 via the Internet 56 is used. You may comprise so that it may communicate with the router apparatus 55 and the gateway apparatus 54, and the image data memorize
  • the “direct” selection button 70 and the “server” selection button 71 are displayed on the display 15 a of the display terminal 15, and the user selects “direct” communication or “server” communication.
  • the case of performing was illustrated. However, this may be configured such that the display terminal 15 has a function of automatically switching to “direct” communication when the radio wave from the router device 55 is caught, and “direct” communication is automatically selected. Good. Thereby, usability can be improved.
  • the refrigerators 100 and 200 and the refrigerator system 50 according to the present embodiment have various functions and effects. According to the installation configuration of the camera and the interior illumination lamp according to the present embodiment, the food in the storage can be photographed well, and the food can be easily identified.
  • cameras 35-1 and 35-2 photograph food in the storage from the front side of the storage.
  • the interior lighting lamps 34-1 and 34-2 are also provided on the front side of the storage, and the food in the storage is irradiated from the front side in the same direction as the photographing direction by the cameras 35-1 and 35-2. Yes. Therefore, the photographed image is not as dark or difficult to see as when the interior lighting lamps 34-1 and 34-2 are provided on the inner wall of the storage, and becomes a clear image. Further, it is not necessary to perform image processing to brighten and sharpen the captured image in the server device 57.
  • the cameras 35-1, 35-2 and the interior lighting lamps 34-1, 34-2 are provided in front of the front ends of the shelf plates 30-1 to 30-4.
  • the images in the storage taken by the cameras 35-1 and 35-2 are the same as when the user actually opened the doors 10 of the refrigerators 100 and 200. Therefore, when the user displays the image data on the display terminal 15, the user can check the state of food in the storage without any sense of incongruity.
  • the interior lamps 34-1 and 34-2 illuminate food on the shelf from the front of the front of the shelf 30-1 to 30-4, so that the front end of the shelf 30-1 to 30-4 is illuminated. The food on the board can be photographed brightly and clearly.
  • the cameras 35-1 and 35-2 are provided on the inner surface of the door 10 of the refrigerators 100 and 200, and are provided so as to be located at the substantial center in the left-right direction of the storage. Therefore, the images taken by the cameras 35-1 and 35-2 can be made closer to a state in which the user opens the doors 10 of the refrigerators 100 and 200 and actually sees them. In addition, by taking a large distance between the cameras 35-1 and 35-2 and the food on the shelf, it is possible to photograph a wide range in the storage, and display a wider range of food storage status display terminals 15 can be confirmed.
  • a compressor 19 is provided at the uppermost part of the storage that is relatively difficult to be seen when the cameras 35-1 and 35-2 are provided on the inner surface of the door, and the uppermost part protrudes forward. As a result, this part can also be photographed reliably, and the compressor 19 is provided in the upper part of the main body to improve the storage capacity of the lower part of the main body, and the photographing with the cameras 35-1 and 35-2 is made favorable. Can do.
  • the cameras 35-1 and 35-2 are provided so as to be positioned at a substantial central portion in the front-rear direction of the door pockets 33-1 and 33-2 on the inner surface of the door. Therefore, not only the food in the storage, but also a part of the food stored in the door pockets 33-1 and 33-2, such as a milk pack, can be photographed. The user can recognize what he / she has stored even if only a part of it is shown. Therefore, it is possible to photograph almost all food items in the storage.
  • FIG. 9A by providing a camera 35-3 dedicated to the storage container as a camera, the food in the storage container 31 can be clearly photographed. Furthermore, as shown in FIG. 9B, by making the camera 35-2 movable up and down or turning up and down as shown in FIG. It is possible to shoot efficiently with a relatively small number of cameras.
  • the interior lighting lamps 34-1 and 34-2 are provided at positions farther from the cameras 35-1 and 35-2. 1 and 34-2 are provided so as not to directly enter the photographing units of the cameras 35-1 and 35-2. As a result, it is possible to prevent the light from the interior lighting lamps 34-1 and 34-2 from entering the cameras 35-1 and 35-2 and the image of the cameras 35-1 and 35-2 from being deteriorated. Can be obtained. This can be achieved by providing a light-shielding portion on the camera side of the interior lighting lamps 35-1 and 35-2, or by illuminating light sources such as LEDs constituting the interior lighting lamps 34-1 and 34-2 obliquely backward. The same effect can be obtained by adopting a configuration such as an inclined arrangement.
  • the illumination lamps 34-1 and 34-2 have an illuminance in the storage of 150 lux to 200 lux.
  • the food appears whitish as described in the photographing operation of FIG. It becomes difficult to distinguish.
  • a configuration is adopted in which shooting is performed with reduced illuminance.
  • the illuminance of the interior lighting lamps 34-1 and 34-2 is controlled by the control unit so that the illuminance is lower than that in the normal state only when the door 10 is closed or the door 10 is opened for photographing. It may be.
  • the images in the storage taken by the cameras 35-1 and 35-2 are transmitted to the server device 57 from the respective cameras 35-1 and 35-2, and the server device 57, the refrigerators 100 and 200, or Then, combining processing is performed in the display terminal 15. This facilitates image composition processing.
  • the cameras 35-1 and 35-2 are door inner surfaces corresponding to the front ends of the shelf plates 30-1 to 30-4, in this example, the upper shelf plate 30-1 and the third shelf plate 30-. 3 is provided on the inner surface of the door corresponding to the front end.
  • the respective cameras 35-1 and 35-2 are photographed around the shelf boards 30-1 and 30-3 so that the line Z in FIG. 30 becomes the boundary line. .
  • FIG. 30 is a diagram illustrating an example in which images are combined in the refrigerator system 50 according to the embodiment of the present invention.
  • the image data in the storage taken by the two cameras 35-1 and 35-2 can be combined in the second shelf 30-2 portion that is the boundary line Z. That is, as shown in the “photographed raw image” in FIG. 30, the shelf plate 30-2 is shown in common in the upper and lower images. After making the “processed image”, the captured images of the entire storage can be synthesized by matching the common shelf board 30-2 shown in the upper and lower images.
  • the processing program for image combination can be simplified, and the server device 57, the refrigerators 100 and 200, or the control portion of the display terminal 15 for image combination processing have a large capacity. This is unnecessary and can contribute to speeding up of processing speed.
  • the two cameras 35-1 and 35-2 are provided substantially in front of the shelf plate 30-1 and the shelf plate 30-3 whose height cannot be adjusted. Thereby, even when the height of the shelf plate 30-2 whose height can be adjusted is changed, by adjusting the range to be combined according to the height of the shelf plate 30-2 at the time of image combining processing, Image combining processing can be easily performed.
  • the refrigerators 100 and 200 have the storage, the cameras 35-1 and 35-2 for capturing food in the storage, and the images captured by the cameras 35-1 and 35-2.
  • the wireless adapter 53 is a communication unit that transmits data to the server device 57 via the Internet.
  • the interior lighting lamps 34-1 and 34-2 provided in the storage are provided for irradiating the interior of the storage when photographing with the cameras 35-1 and 35-2.
  • cameras 35-1 and 35-2 and interior illumination lamps 34-1 and 34-2 are arranged on the front opening side of the storage.
  • the front opening side means the front opening side from the center in the front-rear direction of the storage.
  • the food in the storage is irradiated with the interior lighting lamps 34-1 and 34-2, and the interior of the storage is illuminated from the side illuminated by the interior lighting lights 34-1 and 34-2 with the camera 35-1. , 35-2.
  • the food in the storage can be photographed brightly and clearly. Therefore, the food in the storage can be easily discriminated, and it is not necessary to perform image processing for facilitating the food discrimination, so that it can be put into practical use at a low cost.
  • the storage has a plurality of shelf plates 30-1 to 30-4, and the cameras 35-1 and 35-2 and the interior lighting lamps 34-1 and 34-2 are shelf plates 30-1 to 30-. 4 is provided so as to be positioned on the front side of the front end.
  • the images in the storage taken by the cameras 35-1 and 35-2 are the same as when the user actually opens the doors of the refrigerators 100 and 200. Therefore, when displayed on the display terminal 15, the user can check the state of food in the storage without any discomfort.
  • the interior lighting lamps 34-1 and 34-2 illuminate the food on the shelf boards 30-1 to 30-4 from the front of the front ends of the shelf boards 30-1 to 30-4, the shelf boards 30-1 The food placed on the front end of ⁇ 30-4 can be photographed brightly and clearly.
  • the cameras 35-1 and 35-2 are provided on the inner surface of the storage door 10, and the interior lighting lights 34-1 and 34-2 are provided on both side walls of the opening edge of the storage.
  • the cameras 35-1 and 35-2 are provided at substantially central positions in the front-rear direction of the door pockets 33-1 to 33-8 provided on the inner surface of the door 10.
  • the interior lighting lamps 34-1 and 34-2 are provided at positions where direct light from the interior lighting lamps 34-1 and 34-2 does not enter the cameras 35-1 and 35-2, or the camera It is configured so that light does not enter directly into 35-1 and 35-2.
  • the refrigerator system 50 in this Embodiment is provided with the refrigerator 100,200 of any one of the above-described forms and a display terminal that transmits an image request signal for requesting an image in the storage of the refrigerator 100,200.
  • the image data transmitted from the communication units of the refrigerators 100 and 200 is stored through the Internet, and the image request signal transmitted from the display terminal 15 through the Internet is received, and the image data is transmitted to the display terminal 15.
  • the server device 57 is provided.
  • the user can check the state of food in the refrigerators 100 and 200 in a clear form from anytime and anywhere, so that it is possible to prevent forgetting to buy food, etc. Can be configured.
  • the server device 57 is configured to transmit the image data in the refrigerator to the display terminal in advance when there is a request for transmitting the image in the storage from the display terminal 15 in advance.
  • the food in the storage can be brightly and clearly photographed, and there is an extraordinary effect that the food in the storage can be easily identified. Can do. Therefore, this invention is useful as a refrigerator, a refrigerator system, etc. which can image
  • the present invention is applied not only to household refrigerators but also to commercial refrigerators (including freezers) for chain stores such as convenience stores, and in the convenience store headquarters equipped with a server device, food in the refrigerators of each convenience store You can check the situation and deliver food automatically. It is also possible to check the food and goods in the refrigerator installed in each facility such as a factory or a laboratory in the material department and automatically deliver the missing items.

Abstract

A refrigerator is provided with a storage compartment, cameras (35-1, 35-2) which capture images of food within the storage compartment, and a communication section which transmits the data relating to the images, captured by the cameras (35-1, 35-2), to a server device via the Internet. The refrigerator is provided with illumination lamps (34-1, 34-2) which are provided within the storage compartment and which illuminate the inside of the storage compartment during the capturing of images by the cameras (35-1, 35-2). The cameras (35-1, 35-2) and the illumination lamps (34-1, 34-2) are arranged on the front face opening side of the storage compartment.

Description

冷蔵庫、および冷蔵庫システムRefrigerator and refrigerator system
　本発明は、貯蔵庫内の食品を撮影して、収納状況を表示端末等で確認することのできる冷蔵庫、および冷蔵庫システムに関する。 The present invention relates to a refrigerator and a refrigerator system that can photograph food in a storage and check the storage status with a display terminal or the like.
　従来から、この種の冷蔵庫、および冷蔵庫システムとして、数多くのものが提案されている。例えば、貯蔵庫内に小型カメラを設けて、小型カメラで撮影された貯蔵庫内の食品収納状況を、インターネット回線を介して携帯電話等の表示端末において確認できるように構成されたものがある（例えば、特許文献１を参照）。 Conventionally, a number of such refrigerators and refrigerator systems have been proposed. For example, there is a configuration in which a small camera is provided in the storage so that the food storage status in the storage taken by the small camera can be confirmed on a display terminal such as a mobile phone via the Internet line (for example, (See Patent Document 1).
　また、冷蔵庫の扉を閉じたときに、小型カメラで貯蔵庫内の食品状態を撮影するように構成されたものも提案されている（例えば、特許文献２を参照）。 In addition, there has also been proposed a configuration in which the food state in the storage is photographed with a small camera when the refrigerator door is closed (see, for example, Patent Document 2).
　さらに、冷蔵庫の表面にも端末を設けて、表示端末を、冷蔵庫表面に組み込まれた端末と、冷蔵庫表面から取り外して持ち歩ける携帯電話等の端末とで構成したものも提案されている。両端末は、インターネット回線を介して、小型カメラで撮影された貯蔵庫内の食品収納状況を、その表示部に表示できるように構成されている。これにより、出かけているときはもちろん、在宅時にも、冷蔵庫の扉を開くことなく、貯蔵庫内の食品収納状況を知ることができる（例えば、特許文献３を参照）。 Furthermore, there has also been proposed a device in which a terminal is also provided on the surface of the refrigerator, and the display terminal is composed of a terminal incorporated in the refrigerator surface and a terminal such as a mobile phone that can be carried away from the refrigerator surface. Both terminals are configured to be able to display the food storage status in the storage taken by the small camera on the display unit via the Internet line. Thereby, it is possible to know the state of food storage in the storage without opening the refrigerator door, not only when going out but also at home (see, for example, Patent Document 3).
　上述したように、貯蔵庫内の食品を撮影し、収納状況を表示端末等で確認することができるようにした冷蔵庫、および冷蔵庫システムが数多く提案されている。しかしながら、未だ実用化されたものはない。 As described above, many refrigerators and refrigerator systems have been proposed in which food in a storage can be photographed and the storage status can be confirmed with a display terminal or the like. However, nothing has been put into practical use yet.
　そこで発明者らは、上述したような冷蔵庫、および冷蔵庫システムの実用化に向けて検討を進め、検証を行っている。その結果、この種の冷蔵庫、およびその冷蔵庫システムには、実用化していく上で解決していかなければならない数多くの課題があることを見出した。 Therefore, the inventors have been examining and verifying the practical use of the refrigerator and the refrigerator system as described above. As a result, it has been found that this type of refrigerator and its refrigerator system have a number of problems that must be solved before practical use.
　その一つは、小型カメラによる貯蔵庫内の食品状況の写りが悪く、食品種別の判別が困難であるという課題である。上述した特許文献２には、小型カメラで撮影するとき、貯蔵庫内の庫内照明灯をつけて撮影することが開示されている。しかしながら、貯蔵庫の奥壁に位置する庫内照明灯で照らされた食品を。扉内面に設けられた小型カメラで撮影する場合、その写りが暗く、そのままでは食品種別を判別しにくい。よって、高度な補正処理を行って食品種別を判別しやすくする必要があるので、大幅なコストアップを招く等、実用化に向けて大きな阻害要因となる。 One of them is the problem that it is difficult to distinguish the type of food because the food situation in the storage is not well reflected by the small camera. Japanese Patent Application Laid-Open No. 2004-228561 discloses that when photographing with a small camera, photographing is performed with an interior illumination lamp in a storage. However, food illuminated by the interior lighting located on the back wall of the storage. When photographing with a small camera provided on the inner surface of the door, the image is dark and it is difficult to determine the food type as it is. Therefore, it is necessary to perform advanced correction processing to make it easy to determine the type of food, which causes a significant increase in cost and becomes a major obstacle to commercialization.
特開２００２－２３６７９８号公報JP 2002-236798 A 特開２００７－４６８３３号公報JP 2007-46833 A 特開２００２－８１８１８号公報JP 2002-81818 A
　本発明はこれらの課題に鑑みてなされたものであり、貯蔵庫内の食品を良好に撮影できるようにして、食品の判別を容易に行うことができる、冷蔵庫、および冷蔵庫システムを提供するものである。 The present invention has been made in view of these problems, and provides a refrigerator and a refrigerator system that can easily photograph foods in a storage and can easily identify foods. .
　本発明の冷蔵庫は、貯蔵庫と、貯蔵庫内の食品を撮影するカメラと、カメラで撮影された画像データを、インターネットを経由してサーバ装置に送信する通信部と、カメラによる撮影時に貯蔵庫内を照射する、貯蔵庫内に設けられた庫内照明灯とを備えている。また、カメラ、および庫内照明灯が、貯蔵庫の前面開口側に配置されている。 The refrigerator of the present invention includes a storage, a camera that captures food in the storage, a communication unit that transmits image data captured by the camera to the server device via the Internet, and the interior of the storage when irradiated by the camera. And an interior lighting provided in the storage. Moreover, the camera and the interior lighting lamp are arrange | positioned at the front opening side of the storage.
　この構成により、庫内照明灯で貯蔵庫内の食品を照射するとともに、庫内照明灯によって照射する側から貯蔵庫内をカメラによって撮影することができる。これにより、貯蔵庫内の食品を明るく、かつ、鮮明に撮影することができる。よって、貯蔵庫内の食品の判別を容易に行うことができる。 With this configuration, the food in the storage can be irradiated with the interior lighting, and the interior of the storage can be photographed by the camera from the side irradiated with the interior lighting. Thereby, the food in the storage can be photographed brightly and clearly. Therefore, the food in the storage can be easily identified.
図１は、本発明の実施の形態における冷蔵庫の正面図である。FIG. 1 is a front view of the refrigerator in the embodiment of the present invention. 図２は、本発明の実施の形態における冷蔵庫の概略の構成を示す横から見た断面図である。FIG. 2 is a cross-sectional view seen from the side showing a schematic configuration of the refrigerator in the embodiment of the present invention. 図３は、本発明の実施の形態における冷蔵庫の貯蔵庫の扉を開いたときの内部構造を示す斜視図である。FIG. 3 is a perspective view showing the internal structure when the door of the refrigerator storage in the embodiment of the present invention is opened. 図４Ａは、本発明の実施の形態における冷蔵庫に表示端末が一体的に装備された状態を示す斜視図である。FIG. 4A is a perspective view showing a state in which a display terminal is integrally provided in the refrigerator according to the embodiment of the present invention. 図４Ｂは、本発明の実施の形態における冷蔵庫に表示端末が着脱自在に装備された状態を示す斜視図である。FIG. 4B is a perspective view showing a state in which the display terminal is detachably mounted on the refrigerator in the embodiment of the present invention. 図５Ａは、本発明の実施の形態に係る冷蔵庫において、表示端末が扉に対して一体的に取り付けられた場合の断面構成例を示す図である。FIG. 5A is a diagram illustrating a cross-sectional configuration example when the display terminal is integrally attached to the door in the refrigerator according to the embodiment of the present invention. 図５Ｂは、本発明の実施の形態に係る冷蔵庫において、表示端末を扉に着脱自在に装着した場合の断面構成例を示す図である。FIG. 5B is a diagram showing a cross-sectional configuration example when the display terminal is detachably attached to the door in the refrigerator according to the embodiment of the present invention. 図６Ａは、本発明の実施の形態の冷蔵庫における、扉の外被パネルがガラス板であるときの、扉と表示端末の表示部との断面構成の一例を示す図である。FIG. 6A is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is a glass plate in the refrigerator according to the embodiment of the present invention. 図６Ｂは、本発明の実施の形態の冷蔵庫における、扉の外被パネルがガラス板であるときの、扉と表示端末の表示部との断面構成の一例を示す図である。FIG. 6B is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is a glass plate in the refrigerator according to the embodiment of the present invention. 図６Ｃは、本発明の実施の形態の冷蔵庫における、扉の外被パネルがマジックミラーであるときの、扉と表示端末の表示部との断面構成の一例を示す図である。FIG. 6C is a diagram illustrating an example of a cross-sectional configuration of the door and the display unit of the display terminal when the cover panel of the door is a magic mirror in the refrigerator according to the embodiment of the present invention. 図７は、本発明の実施の形態に係る冷蔵庫において、扉を閉じた状態を示す横から見た断面図である。FIG. 7 is a cross-sectional view seen from the side showing a state in which the door is closed in the refrigerator according to the embodiment of the present invention. 図８Ａは、本発明の実施の形態に係る冷蔵庫において、扉を閉じた状態における扉の内面部を示す上から見た断面図である。FIG. 8A is a cross-sectional view seen from above showing an inner surface portion of the door in a state where the door is closed in the refrigerator according to the embodiment of the present invention. 図８Ｂは、本発明の実施の形態に係る冷蔵庫における扉の内面部の正面図である。FIG. 8B is a front view of the inner surface portion of the door in the refrigerator according to the embodiment of the present invention. 図９Ａは、本発明の実施の形態における冷蔵庫のカメラの取り付けの、他の例を示す横から見た断面図である。FIG. 9A is a cross-sectional view seen from the side showing another example of the attachment of the camera of the refrigerator in the embodiment of the present invention. 図９Ｂは、本発明の実施の形態における冷蔵庫のカメラの取り付けの、他の例を示す横から見た断面図である。FIG. 9B is a cross-sectional view seen from the side showing another example of the attachment of the camera of the refrigerator in the embodiment of the present invention. 図９Ｃは、本発明の実施の形態における冷蔵庫のカメラの取り付けの、他の例を示す横から見た断面図である。FIG. 9C is a cross-sectional view seen from the side showing another example of attachment of the camera of the refrigerator in the embodiment of the present invention. 図１０は、本発明の実施の形態における冷蔵庫の、一枚扉構成の場合のカメラ取り付け例を示す横から見た断面図である。FIG. 10 is a cross-sectional view of the refrigerator in the embodiment of the present invention as seen from the side, showing an example of camera attachment in the case of a single door configuration. 図１１Ａは、本発明の実施の形態における冷蔵庫のカメラ取り付け例を示す、扉を閉じた状態の扉部分の上から見た断面図である。FIG. 11A is a cross-sectional view seen from above the door portion with the door closed, showing an example of mounting the refrigerator camera in the embodiment of the present invention. 図１１Ｂは、本発明の実施の形態における冷蔵庫のカメラ取り付け例を示す、扉を開いた状態の扉の内面側の正面図である。FIG. 11B is a front view of the inner surface side of the door in a state where the door is opened, showing an example of mounting the camera of the refrigerator in the embodiment of the present invention. 図１２Ａは、本発明の実施の形態における一枚扉構成の冷蔵庫についての、カメラ取り付けの他の例を示す上から見た断面図である。FIG. 12A is a cross-sectional view seen from above showing another example of camera attachment for a single door refrigerator according to an embodiment of the present invention. 図１２Ｂは、本発明の実施の形態における一枚扉構成の冷蔵庫についての、カメラ取り付けの他の例を示す、扉内面側の正面図である。FIG. 12B is a front view of the door inner surface side showing another example of camera attachment for the refrigerator with a single door configuration according to the embodiment of the present invention. 図１３は、図１２Ａおよび図１２Ｂのカメラ取り付け例における撮影状態を説明するための下方から見た図である。FIG. 13 is a view seen from below for explaining a shooting state in the camera mounting example of FIGS. 12A and 12B. 図１４は、本発明の実施の形態における冷蔵庫において取り付けられるカメラの一例を示す、横から見た断面構成を示す図である。FIG. 14 is a diagram showing a cross-sectional configuration viewed from the side, showing an example of a camera attached to the refrigerator in the embodiment of the present invention. 図１５は、本発明の実施の形態における冷蔵庫システムのシステム構成を示す図である。FIG. 15 is a diagram showing a system configuration of the refrigerator system in the embodiment of the present invention. 図１６は、本発明の実施の形態における冷蔵庫システムに用いられる冷蔵庫のシステム構成を示す図である。FIG. 16 is a diagram showing a system configuration of a refrigerator used in the refrigerator system in the embodiment of the present invention. 図１７は、本発明の実施の形態における冷蔵庫システムのサーバ装置の構成例を示す図である。FIG. 17 is a diagram illustrating a configuration example of the server device of the refrigerator system in the embodiment of the present invention. 図１８は、本発明の実施の形態に係る冷蔵庫において、扉を閉じたときに貯蔵庫内の食品の撮影を行う場合の動作を示すフローチャートである。FIG. 18 is a flowchart showing an operation when photographing food in the storage when the door is closed in the refrigerator according to the embodiment of the present invention. 図１９は、本発明の実施の形態に係る冷蔵庫において、庫内の食品を出し入れした後、冷却時に貯蔵室の食品の撮影を行う場合の動作を示すフローチャートである。FIG. 19 is a flowchart showing an operation in the case where the food in the storage room is photographed during cooling after the food in and out of the refrigerator is taken in and out in the refrigerator according to the embodiment of the present invention. 図２０は、本発明の実施の形態に係る冷蔵庫が一枚扉の場合において、扉が所定角度開いた時点で貯蔵庫内の食品の撮影が行われるようにした場合の動作を示すフローチャートである。FIG. 20 is a flowchart showing an operation when food in the storage is photographed when the door is opened at a predetermined angle in the case where the refrigerator according to the embodiment of the present invention has a single door. 図２１は、本実施の形態の冷蔵庫における、カメラによる撮影時の庫内照明灯の点灯、および消灯の制御の他の例を示すフローチャートである。FIG. 21 is a flowchart showing another example of the control of turning on and off the interior illumination lamp during photographing by the camera in the refrigerator of the present embodiment. 図２２は、本発明の実施の形態の冷蔵庫システムにおいて、サーバ装置で画像データの保存処理と合成処理を行う場合のフローチャートである。FIG. 22 is a flowchart when the server device performs image data storage processing and composition processing in the refrigerator system according to the embodiment of the present invention. 図２３は、本発明の実施の形態に係る冷蔵庫システムにおいて、冷蔵庫側で画像データの保存処理と合成処理を行う場合のフローチャートである。FIG. 23 is a flowchart when image data storage processing and composition processing are performed on the refrigerator side in the refrigerator system according to the embodiment of the present invention. 図２４は、本発明の実施の形態に係る冷蔵庫システムにおいて、表示端末側で画像データの保存処理と合成処理とを行う場合のフローチャートである。FIG. 24 is a flowchart in the case where image data storage processing and composition processing are performed on the display terminal side in the refrigerator system according to the embodiment of the present invention. 図２５は、本発明の実施の形態に係る冷蔵庫システムにおけるサーバ装置または冷蔵庫と、表示端末との送受信を示すフローチャートである。FIG. 25 is a flowchart showing transmission / reception between the server device or the refrigerator and the display terminal in the refrigerator system according to the embodiment of the present invention. 図２６は、本発明の実施の形態における冷蔵庫システムにおいて、すでに表示端末に画像データが記憶、保存されている場合の動作を示すフローチャートである。FIG. 26 is a flowchart showing an operation when image data is already stored and stored in the display terminal in the refrigerator system according to the embodiment of the present invention. 図２７は、本発明の実施の形態における冷蔵庫システムにおいて、カメラそれぞれによって撮影された個別画像と、合成画像とを切り替えて送受信する場合の動作を示すフローチャートである。FIG. 27 is a flowchart showing an operation in a case where the individual image captured by each camera and the composite image are switched and transmitted / received in the refrigerator system according to the embodiment of the present invention. 図２８は、本発明の実施の形態に係る冷蔵庫システムにおいて、表示端末から画像の事前送信要求があった場合の処理のフローチャートである。FIG. 28 is a flowchart of processing performed when there is an image prior transmission request from the display terminal in the refrigerator system according to the embodiment of the present invention. 図２９は、本発明の実施の形態に係る冷蔵庫システムにおける、表示端末の通信経路選択時のディスプレイ表示を示す図である。FIG. 29 is a diagram showing a display display when the communication path of the display terminal is selected in the refrigerator system according to the embodiment of the present invention. 図３０は、本発明の実施の形態に係る冷蔵庫システムにおいて、画像が合成される例を示す図である。FIG. 30 is a diagram illustrating an example in which images are combined in the refrigerator system according to the embodiment of the present invention.
　以下、本発明の実施の形態について、図面を用いて説明する。なお、この実施の形態によって、本発明が限定されるものではない。 Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments.
　＜１．構成＞
　　１－１．冷蔵庫の構成
　　　１－１－１．フレンチドアタイプの冷蔵庫の構成
　まず、図１～図９Ｃを用いて、フレンチドアタイプの冷蔵庫１００の構成について説明する。 <1. Configuration>
1-1. Configuration of refrigerator 1-1-1. Configuration of French Door Type Refrigerator First, the configuration of the French door type refrigerator 100 will be described with reference to FIGS. 1 to 9C.
　図１は、本発明の実施の形態における冷蔵庫１００の正面図であり、図２は、同冷蔵庫１００の概略の構成を示す横から見た断面図であり、図３は、同冷蔵庫１００の貯蔵庫の扉１０を開いたときの内部構造を示す斜視図である。 FIG. 1 is a front view of a refrigerator 100 according to an embodiment of the present invention, FIG. 2 is a cross-sectional view showing a schematic configuration of the refrigerator 100, viewed from the side, and FIG. It is a perspective view which shows an internal structure when the door 10 of this is opened.
　図１～図３に示したように、冷蔵庫１００は、冷蔵庫本体１を備えている。冷蔵庫本体１は、前方に開口する金属（例えば鉄板）製の外箱２と、硬質樹脂（例えばＡＢＳ）製の内箱３と、外箱２と内箱３との間に発泡充填された硬質発泡ウレタン等の断熱材４とを有している。 As shown in FIGS. 1 to 3, the refrigerator 100 includes a refrigerator body 1. The refrigerator body 1 includes a metal (for example, iron plate) outer box 2 that opens forward, a hard resin (for example, ABS) inner box 3, and a hard foam filled between the outer box 2 and the inner box 3. And a heat insulating material 4 such as urethane foam.
　冷蔵庫本体１の内部には、複数の貯蔵庫（収納室）が仕切形成されている。複数の貯蔵庫は、冷蔵庫本体１の上部から、冷蔵室５、冷蔵室５の下に位置する、切替室６、および切替室６に並設された製氷室７、切替室６および製氷室７の下部に位置する冷凍室８、ならびに、冷凍室８の下部に位置する野菜室９を含んでいる。冷蔵室５の前面は、観音開き式の断熱扉である扉１０により開閉自由に閉塞されている。切替室６、製氷室７、冷凍室８、および野菜室９の前面部は、それぞれ、引き出し式の扉１１，１２，１３，１４によって、開閉自由に閉塞されている。 In the refrigerator main body 1, a plurality of storages (storage rooms) are partitioned. The plurality of storages are provided from the upper part of the refrigerator body 1 to the refrigerating room 5, the switching room 6 located below the refrigerating room 5, and the ice making room 7, the switching room 6, and the ice making room 7 arranged in parallel to the switching room 6. The freezer compartment 8 located in the lower part and the vegetable compartment 9 located in the lower part of the freezer compartment 8 are included. The front surface of the refrigerator compartment 5 is closed freely by a door 10 that is a double-spread type heat insulating door. Front portions of the switching chamber 6, the ice making chamber 7, the freezing chamber 8, and the vegetable chamber 9 are closed freely by drawer- type doors 11, 12, 13, and 14, respectively.
　冷蔵庫本体１の背面側には、冷却室１６が配置されている。冷却室１６には、冷気を生成する冷却器１７と、冷気を各室に供給する送風ファン１８と、冷蔵室への風量を調整するための、風量調整手段であるダンパ２２とが設けられている。また、冷蔵庫本体１の天面奥部には、コンプレッサ１９が設けられている。コンデンサ（図示せず）と、放熱用の放熱パイプ２０と、キャピラリーチューブ２１と、冷却器１７とが順次環状に接続されて、冷凍サイクルが構成されている。冷凍サイクルには、冷媒が封入されて、冷却運転が行われるように構成されている。 A cooling chamber 16 is disposed on the back side of the refrigerator body 1. The cooling chamber 16 is provided with a cooler 17 that generates cool air, a blower fan 18 that supplies the cool air to each chamber, and a damper 22 that is an air volume adjusting means for adjusting the air volume to the refrigerator compartment. Yes. In addition, a compressor 19 is provided in the back of the top surface of the refrigerator body 1. A condenser (not shown), a heat radiating pipe 20, a capillary tube 21, and a cooler 17 are sequentially connected in an annular shape to constitute a refrigeration cycle. The refrigeration cycle is configured so that a refrigerant is sealed and a cooling operation is performed.
　ここで、上述した扉１０～１４それぞれには、冷蔵庫本体１と同様に硬質発泡ウレタンが充填されて、断熱性を有している。本実施の形態における冷蔵庫１００では、扉１０～１４のうち、冷蔵室５となる貯蔵庫の扉１０の一方（本実施の形態においては、図１の向かって右側）の前面に、表示装置である表示端末１５が装備されている。 Here, each of the doors 10 to 14 described above is filled with hard foamed urethane like the refrigerator body 1 and has a heat insulating property. In the refrigerator 100 according to the present embodiment, among the doors 10 to 14, a display device is provided on the front surface of one of the storage doors 10 serving as the refrigerator compartment 5 (in the present embodiment, on the right side in FIG. 1). A display terminal 15 is provided.
　図４Ａは、本発明の実施の形態における冷蔵庫１００に表示端末１５が一体的に装備された状態を示す斜視図であり、図４Ｂは、同冷蔵庫１００に表示端末１５が着脱自在に装備された状態を示す斜視図である。 4A is a perspective view showing a state in which display terminal 15 is integrally provided in refrigerator 100 according to the embodiment of the present invention, and FIG. 4B is a diagram in which display terminal 15 is detachably installed in refrigerator 100. It is a perspective view which shows a state.
　表示端末１５は、図４Ａに示したように、液晶パネル等のディスプレイとそれを制御する制御部とで構成され、扉１０に一体的に取付けられている。または、図４Ｂに示したように、表示端末１５は、スマートフォン、またはタブレットＰＣ等で構成されて、扉１０に着脱自在に配置される構成であってもよい。 As shown in FIG. 4A, the display terminal 15 includes a display such as a liquid crystal panel and a control unit that controls the display, and is attached to the door 10 integrally. Alternatively, as illustrated in FIG. 4B, the display terminal 15 may be configured by a smartphone, a tablet PC, or the like and detachably disposed on the door 10.
　図５Ａは、本発明の実施の形態に係る冷蔵庫１００において、表示端末１５が扉１０に対して一体的に取り付けられた場合の断面構成例を示す図であり、図５Ｂは、同冷蔵庫１００において、表示端末１５を扉１０に着脱自在に装着した場合の断面構成例を示す図である。 FIG. 5A is a diagram illustrating a cross-sectional configuration example when the display terminal 15 is integrally attached to the door 10 in the refrigerator 100 according to the embodiment of the present invention, and FIG. It is a figure which shows the cross-sectional structural example at the time of attaching the display terminal 15 to the door 10 so that attachment or detachment is possible.
　図５Ａ、および図５Ｂに示したように、扉１０は、主として、冷蔵庫１００の前面側に配置された外被パネル１０ａと、冷蔵庫１００の庫内側に配置された内側板１０ｂと、外被パネル１０ａおよび内側板１０ｂの間に充填された断熱材４とで構成されている。外被パネル１０ａは、カラー鋼板等の金属製の部材、またはガラス板等の透明の部材で構成されている。内側板１０ｂは、真空成型等により形成された合成樹脂部材によって構成されている。内側板１０ｂの周囲部分には、庫内側から見てロの字状に、庫内側に突出する隆起壁部１０ｂ－１が設けられている。また、断熱材４としては、例えば、上述した硬質発泡ウレタン等が用いられている。 As shown in FIG. 5A and FIG. 5B, the door 10 mainly includes an outer panel 10 a disposed on the front side of the refrigerator 100, an inner plate 10 b disposed on the inner side of the refrigerator 100, and an outer panel. It is comprised with the heat insulating material 4 with which it filled between 10a and the inner side board 10b. The jacket panel 10a is made of a metal member such as a color steel plate or a transparent member such as a glass plate. The inner plate 10b is made of a synthetic resin member formed by vacuum molding or the like. Around the inner plate 10b, a raised wall portion 10b-1 projecting inward is provided in a square shape when viewed from the inner side. Moreover, as the heat insulating material 4, the hard foaming urethane etc. which were mentioned above are used, for example.
　また、表示端末１５が扉１０に一体化された、図５Ａの扉１０においては、扉１０の前面側には、外被パネル１０ａと連続して断熱材４を覆う、樹脂製の収納枠体２３が設けられている。収納枠体２３は、外被パネル１０ａがガラス板である場合には、ガラス板に一体的に接着され、構成されている。 Further, in the door 10 of FIG. 5A in which the display terminal 15 is integrated with the door 10, a resin-made storage frame body that covers the heat insulating material 4 continuously with the jacket panel 10 a on the front side of the door 10. 23 is provided. When the jacket panel 10a is a glass plate, the storage frame 23 is integrally bonded to the glass plate.
　表示端末１５は、端末保持体２４を介して収納枠体２３に固定されている。また、表示端末１５の前面側には、タッチパネル２５が設けられている。表示端末１５とタッチパネル２５との間には、隙間２６が設けられており、表示端末１５からのノイズによってタッチパネル２５が誤作動を起さないように構成されている。表示端末１５、およびタッチパネル２５は、それらの外周縁を覆う枠体２７を扉１０表面に取り付けることによって固定されている。このように、収納枠体２３を設けることにより、断熱材４が表示端末１５に直接触れることがない。よって、断熱材４を発泡させる際に、表示端末１５が高温に曝されたり、変形したりする等の不具合の発生を防止することができる。 The display terminal 15 is fixed to the storage frame 23 via the terminal holder 24. A touch panel 25 is provided on the front side of the display terminal 15. A gap 26 is provided between the display terminal 15 and the touch panel 25 so that the touch panel 25 does not malfunction due to noise from the display terminal 15. The display terminal 15 and the touch panel 25 are fixed by attaching a frame body 27 covering their outer peripheral edges to the surface of the door 10. Thus, by providing the storage frame 23, the heat insulating material 4 does not touch the display terminal 15 directly. Therefore, when foaming the heat insulating material 4, it is possible to prevent the occurrence of problems such as the display terminal 15 being exposed to a high temperature or being deformed.
　一方、表示端末１５を着脱自在に配置した、図５Ｂに示した扉１０では、扉１０の前面部に収納枠体２３を設けることにより、凹部２８が形成される。この凹部２８に、表示端末１５が着脱可能に配置されている。 On the other hand, in the door 10 shown in FIG. 5B in which the display terminal 15 is detachably disposed, the recess 28 is formed by providing the storage frame 23 on the front surface of the door 10. The display terminal 15 is detachably disposed in the recess 28.
　図６Ａ、および図６Ｂは、本発明の実施の形態の冷蔵庫１００における、扉１０の外被パネル１０ａがガラス板１０ａ－１であるときの、扉１０と表示端末１５の表示部との断面構成の一例を示す図であり、図６Ｃは、同冷蔵庫１００における、扉１０の外被パネル１０ａがマジックミラー１０ａ－２であるときの、扉１０と表示端末１５の表示部との断面構成の一例を示す図である。 6A and 6B are cross-sectional configurations of the door 10 and the display portion of the display terminal 15 when the cover panel 10a of the door 10 is the glass plate 10a-1 in the refrigerator 100 according to the embodiment of the present invention. 6C is an example of a cross-sectional configuration of the door 10 and the display portion of the display terminal 15 when the outer cover panel 10a of the door 10 is the magic mirror 10a-2 in the refrigerator 100. FIG. FIG.
　図６Ａにおいては、扉１０に埋設された表示端末１５とガラス板１０ａ－１との間に、表示端末１５と対向する部分のみを透明としたスモークシート２９が設けられている。この構成により、表示端末１５がオフ状態で黒っぽく見えるときには、表示端末１５と対向する領域以外のガラス板１０ａ－１の部分も、スモークシート２９によって黒っぽく見えるので、表示端末１５との境界が目立つことがなくなる。よって、外観を良好に維持することができる。 In FIG. 6A, a smoke sheet 29 in which only a portion facing the display terminal 15 is transparent is provided between the display terminal 15 embedded in the door 10 and the glass plate 10a-1. With this configuration, when the display terminal 15 looks black in the off state, the portion of the glass plate 10a-1 other than the area facing the display terminal 15 also looks black due to the smoke sheet 29, so that the boundary with the display terminal 15 is noticeable. Disappears. Therefore, the appearance can be maintained well.
　また、図６Ｂにおいては、表示端末１５の表示部として透明液晶表示部を用いて、全体が黒いスモークシート２９ａを透明液晶表示部の裏面に沿うように敷設した構成を示している。このような構成によっても、外観を良好なものとすることができる。 FIG. 6B shows a configuration in which a transparent liquid crystal display unit is used as the display unit of the display terminal 15 and a smoke sheet 29a that is entirely black is laid along the back surface of the transparent liquid crystal display unit. Even with such a configuration, the appearance can be improved.
　さらに、図６Ｃにおいては、図６Ａ、および図６Ｂで用いたガラス板１０ａ－１の代わりに、マジックミラー１０ａ－２を用いて、スモークシート２９，２９ａを不要としている。この構成においても、外観を良好に維持することができる。図６Ａ～図６Ｃのいずれの構成においても、表示端末１５を扉１０に一体的に取り付けた場合の例を示している。なお、スモークシート２９ａを配置する代わりに、ガラス板１０ａ－１を用いて、その背面側を黒っぽく見えるように塗装してもよい。 Further, in FIG. 6C, the smoke sheets 29 and 29a are unnecessary by using the magic mirror 10a-2 instead of the glass plate 10a-1 used in FIGS. 6A and 6B. Even in this configuration, the appearance can be maintained well. 6A to 6C show an example in which the display terminal 15 is attached to the door 10 integrally. Instead of arranging the smoke sheet 29a, the rear surface side of the glass plate 10a-1 may be painted so as to look blackish.
　次に、図７、図８Ａ、および図８Ｂを用いて、本実施の形態の冷蔵庫１００におけるカメラ、および庫内照明灯の取り付け例について説明する。 Next, with reference to FIG. 7, FIG. 8A, and FIG. 8B, an example of mounting the camera and the interior lamp in the refrigerator 100 of the present embodiment will be described.
　図７は、本発明の実施の形態に係る冷蔵庫１００において、扉１０を閉じた状態を示す横から見た断面図であり、図８Ａは、同冷蔵庫１００において、扉１０を閉じた状態における扉１０の内面部を示す上から見た断面図であり、図８Ｂは、同冷蔵庫１００における扉１０の内面部の正面図である。 FIG. 7 is a cross-sectional view of the refrigerator 100 according to the embodiment of the present invention as viewed from the side, showing a state in which the door 10 is closed, and FIG. 8A shows the door in the refrigerator 100 with the door 10 closed. FIG. 8B is a front view of the inner surface portion of the door 10 in the refrigerator 100.
　図７、図８Ａ、および図８Ｂに示したように、冷蔵庫１００の貯蔵庫には、上下方向に、仕切棚である複数の棚板３０－１～３０－４が設けられている。棚板３０－１～３０－４は、それぞれ、周囲の枠を除いて、透明な合成樹脂材料、またはガラス等の光透過性を有する材料で形成されている。 As shown in FIGS. 7, 8A, and 8B, the storage of the refrigerator 100 is provided with a plurality of shelf plates 30-1 to 30-4 as partition shelves in the vertical direction. Each of the shelf boards 30-1 to 30-4 is made of a transparent synthetic resin material or a light-transmitting material such as glass, except for the surrounding frame.
　最下段の棚板３０－４の下方には、引き出し自在に設けられた収納容器３１が配置されている。最下段の棚板３０－４は、収納容器３１の上面を構成しているので、固定されている。しかしながら、棚板３０－１～３０－３は、それぞれ、貯蔵庫の両側壁部に設けられた側壁凸部３２－１～３２－３に載せられており、脱着自在となっている。棚板３０－４は、収納容器３１に載せられている。特に、最下段の棚板３０－４を除いた棚板３０－１～３０－３のうち、中央の棚板３０－２に対応する側壁凸部３２－２は、異なる高さに複数設けられており、棚板３０－２の高さが調節できるように構成されている。 A storage container 31 that can be pulled out is disposed below the lowermost shelf 30-4. The lowermost shelf 30-4 constitutes the upper surface of the storage container 31, and is fixed. However, the shelf plates 30-1 to 30-3 are respectively placed on the side wall projections 32-1 to 32-3 provided on the both side walls of the storage, and are detachable. The shelf board 30-4 is placed on the storage container 31. In particular, among the shelf plates 30-1 to 30-3 excluding the lowermost shelf plate 30-4, a plurality of side wall convex portions 32-2 corresponding to the central shelf plate 30-2 are provided at different heights. The height of the shelf board 30-2 can be adjusted.
　貯蔵庫の開口を開閉する扉１０の内面側には、扉ポケット３３－１～３３－３が、上下方向に複数段設けられている。扉ポケット３３－１～３３－３も光透過性を有する材料で形成されている。 A plurality of door pockets 33-1 to 33-3 are provided in the vertical direction on the inner surface side of the door 10 that opens and closes the opening of the storage. The door pockets 33-1 to 33-3 are also formed of a light transmissive material.
　照明装置である庫内照明灯３４－１，３４－２は、各棚板３０－１～３０－４の前端よりも前方の、貯蔵庫の前面開口両側の壁部と、前面開口上面の壁面部とに設けられている。なお、庫内照明灯３４－１，３４－２は、省エネルギー性を考慮して、複数のＬＥＤが配置された基板を、例えば、庫内照明灯３４－１であれば、上下方向に亘って設けて、透光性を有するカバーで覆って構成されている。 The interior lighting lamps 34-1 and 34-2, which are illumination devices, are provided in front of the front ends of the shelf plates 30-1 to 30-4, on both sides of the front opening of the storage, and on the wall surface of the upper surface of the front opening. And is provided. For the interior lighting lamps 34-1 and 34-2, in consideration of energy saving, a substrate on which a plurality of LEDs are arranged is, for example, the interior lighting lamp 34-1 in the vertical direction. It is provided and covered with a translucent cover.
　撮像装置であるカメラ３５－１，３５－２は、庫内照明灯３４－１，３４－２と同様に、貯蔵庫の前面側に位置するように設けられている。カメラ３５－１，３５－２は、例えば、ＣＣＤカメラまたはＣＭＯＳカメラ等で構成されており、その種類は特にこれらの例に限定されるものではないが、結露等に強いものを用いることが望ましい。 Cameras 35-1 and 35-2, which are imaging devices, are provided so as to be located on the front side of the storage, similarly to the interior lighting lamps 34-1 and 34-2. The cameras 35-1 and 35-2 are composed of, for example, a CCD camera or a CMOS camera, and the type thereof is not particularly limited to these examples. However, it is desirable to use a camera that is resistant to condensation and the like. .
　本実施の形態において、カメラは二つ設けられている。一方のカメラ３５－１は、上段の扉ポケット３３－１の前後方向の実質的な中央の下面に取り付けられている。もう一つのカメラ３５－２は、最下段の扉ポケット３３－３の、上部付近に取り付けられている。なお、扉ポケット３３－１の前後方向とは、扉１０の内側板１０ｂが構成する面に対して垂直な方向であり、扉１０を閉じた際には、貯蔵庫の前後方向と同一となる方向である。 In this embodiment, two cameras are provided. One camera 35-1 is attached to a substantially central lower surface in the front-rear direction of the upper door pocket 33-1. The other camera 35-2 is attached near the upper part of the lowermost door pocket 33-3. The front-rear direction of the door pocket 33-1 is a direction perpendicular to the surface formed by the inner plate 10b of the door 10, and is the same direction as the front-rear direction of the storage when the door 10 is closed. It is.
　また、上方のカメラ３５－１は、最上段の棚板３０－１の実質的な前方位置に設けられている。また、下方のカメラ３５－２は、図中の上から三段目の棚板３０－３の前方位置に設けられている。いずれのカメラも、高さ調節を前提にして設けられている。カメラ３５－１，３５－２は、複数の側壁凸部３２－２に載せられた棚板３０－２ではなく、脱着可能ではあるが高さ調整を前提としていない棚板３０－１、または棚板３０－３の実質的な前方位置に設けられている。 The upper camera 35-1 is provided at a substantial front position of the uppermost shelf 30-1. The lower camera 35-2 is provided in front of the third shelf 30-3 from the top in the drawing. Both cameras are provided on the premise of height adjustment. The cameras 35-1 and 35-2 are not the shelf 30-2 mounted on the plurality of side wall projections 32-2, but the shelf 30-1 that is detachable but does not require height adjustment, or the shelf It is provided at a substantially forward position of the plate 30-3.
　いずれのカメラ３５－１，３５－２も、図７から明らかなように、各棚板３０－１～３０－４の前端よりも前方位置であって、かつ、図８Ｂに示したように、扉１０の軸支部Ｘとは反対の開放端側端部Ｙ付近、すなわち冷蔵庫１００の左右方向の実質的な中央部に位置するように設けられている。この二つのカメラ３５－１，３５－２により、庫内のほぼ全域が撮影できるように配置されている。このフレンチドアの例の場合、カメラ３５－１，３５－２は、比較的大きい面積の扉１０側に設けられ、冷蔵庫１００の実質的な中央部に位置するように配置されている。また、この例では、カメラ３５－１，３５－２は、センターピラー３６（図３参照）が設けられていない扉１０側に、冷蔵庫１００の実質的な中央部に位置するように配置されている。なお、センターピラー３６とは、フレンチドアの場合に、二枚の扉１０のいずれか一方の側面に、二枚の扉１０の間に生じる隙間から貯蔵庫内の冷気が漏れるのを防止するために設けられた部材のことである。 As is clear from FIG. 7, each of the cameras 35-1 and 35-2 is located in front of the front ends of the shelf boards 30-1 to 30-4, and as shown in FIG. 8B, It is provided so as to be positioned in the vicinity of the open end side end Y opposite to the shaft support X of the door 10, that is, in the substantial center in the left-right direction of the refrigerator 100. The two cameras 35-1 and 35-2 are arranged so that almost the entire area can be photographed. In the example of the French door, the cameras 35-1 and 35-2 are provided on the side of the door 10 having a relatively large area, and are disposed so as to be located at the substantial center of the refrigerator 100. In this example, the cameras 35-1 and 35-2 are arranged on the door 10 side where the center pillar 36 (see FIG. 3) is not provided so as to be positioned at the substantial center of the refrigerator 100. Yes. In the case of a French door, the center pillar 36 is used to prevent cold air in the storage from leaking from a gap formed between the two doors 10 on one side surface of the two doors 10. It is a member provided.
　図９Ａ～図９Ｃは、本発明の実施の形態における冷蔵庫１００のカメラの取り付けの、他の例を示す横から見た断面図である。 FIG. 9A to FIG. 9C are cross-sectional views seen from the side showing other examples of the attachment of the camera of the refrigerator 100 in the embodiment of the present invention.
　カメラ３５－１，３５－２に加えて、図９Ａに示したように、収納容器３１内を専用に撮影するカメラ３５－３を追加設置することもできる。また、図９Ｂに示したように、下方のカメラ３５－２を上下方向に移動自在に設けたり、図９Ｃに示したように、下方のカメラ３５－２を上下方向に回動自在に設けたりと、設置する冷蔵庫１００の形態に応じて設定することができる。 In addition to the cameras 35-1 and 35-2, as shown in FIG. 9A, a camera 35-3 for photographing the inside of the storage container 31 can be additionally installed. Further, as shown in FIG. 9B, the lower camera 35-2 is provided so as to be movable in the vertical direction, and as shown in FIG. 9C, the lower camera 35-2 is provided so as to be rotatable in the vertical direction. And it can set according to the form of refrigerator 100 to install.
　また、庫内照明灯３４－１，３４－２は、図７に示したように、カメラ３５－１，３５－２よりも貯蔵庫の奥側の位置に設けられている。庫内照明灯３４－１，３４－２は、光が直接カメラ３５－１，３５－２の撮影部に入り込まないように設けられている。 Further, as shown in FIG. 7, the interior lighting lamps 34-1 and 34-2 are provided at positions on the far side of the storage with respect to the cameras 35-1 and 35-2. The interior illumination lamps 34-1 and 34-2 are provided so that light does not directly enter the photographing units of the cameras 35-1 and 35-2.
　具体的には、図８Ａに示したように、カメラ３５－１，３５－２の撮影部は、庫内照明灯３４－１，３４－２の照射方向の照射量（最大照射量）に対して、照射量が１／２以上となる範囲、この例では、照射角６０度の範囲の外に設けられている。 Specifically, as shown in FIG. 8A, the photographing units of the cameras 35-1 and 35-2 correspond to the irradiation amount (maximum irradiation amount) in the irradiation direction of the interior lamps 34-1 and 34-2. In this example, the irradiation amount is provided outside the range where the irradiation angle is 60 degrees.
　また、庫内照明灯３４－１，３４－２のカメラ側に遮光部を設けたり、庫内照明灯３４－１，３４－２を構成するＬＥＤ等の光源を、斜め後方向きに傾斜配置させたりすることによっても、庫内照明灯３４－１，３４－２の光が直接カメラ３５－１，３５－２の撮影部に入り込まないようにすることができる。これらの方法は、カメラの設置条件等に応じて適切に選択することができる。これは、以降説明するシングルドアタイプの冷蔵庫２００の場合でも同様である。 In addition, a light-shielding portion is provided on the camera side of the interior lighting lamps 34-1 and 34-2, and light sources such as LEDs constituting the interior lighting lamps 34-1 and 34-2 are inclined obliquely rearwardly. By doing so, it is possible to prevent the light from the interior illumination lamps 34-1 and 34-2 from directly entering the photographing units of the cameras 35-1 and 35-2. These methods can be appropriately selected according to the installation conditions of the camera. The same applies to a single door type refrigerator 200 described below.
　　１－１－２．シングルドアタイプの冷蔵庫の構成
　次に、扉１０が一枚扉の冷蔵庫２００（シングルドアタイプの冷蔵庫）における、カメラ、および庫内照明灯の取り付け例を説明する。なお、このシングルドアタイプの冷蔵庫２００では、上述したフレンチドアタイプの冷蔵庫１００と同じ構成要素については同一の番号を付記してその説明を省略し、異なる部分を中心に説明する。 1-1-2. Configuration of Single Door Type Refrigerator Next, an example of mounting a camera and an interior lamp in a refrigerator 200 (single door type refrigerator) having a single door 10 will be described. In this single door type refrigerator 200, the same components as those in the above-described French door type refrigerator 100 are denoted by the same reference numerals, description thereof is omitted, and different portions are mainly described.
　図１０は、本発明の実施の形態における冷蔵庫２００の、一枚扉構成の場合のカメラ取り付け例を示す横から見た断面図であり、図１１Ａは、同冷蔵庫２００のカメラ取り付け例を示す、扉１０を閉じた状態の扉１０部分の上から見た断面図であり、図１１Ｂは、冷蔵庫２００のカメラ取り付け例を示す、扉１０を開いた状態の扉１０の内面側の正面図である。 FIG. 10 is a cross-sectional view of the refrigerator 200 according to the embodiment of the present invention as seen from the side, showing a camera mounting example in the case of a single door configuration, and FIG. 11A shows a camera mounting example of the refrigerator 200. It is sectional drawing seen from the door 10 part of the state which closed the door 10, and FIG. 11B is a front view by the side of the inner surface of the door 10 of the state which opened the door 10 which shows the camera attachment example of the refrigerator 200. .
　図１０、図１１Ａ、および図１１Ｂに示したように、この一枚扉の冷蔵庫２００の場合、上方のカメラ３５－１は、一枚扉構成において一般的な配置例となっている、左右方向に分割して設けられた、扉ポケット３３－４，３３－６と扉ポケット３３－５との間に存在する隆起壁部１０ｂ－２に設けられている。また、下方のカメラ３５－２は、上下方向に並列する、扉ポケット３３－７と扉ポケット３３－８との間の扉内面部に設けられている。 As shown in FIG. 10, FIG. 11A, and FIG. 11B, in the case of this single door refrigerator 200, the upper camera 35-1 is a general arrangement example in the single door configuration, The raised wall portion 10b-2 is provided between the door pockets 33-4 and 33-6 and the door pocket 33-5. The lower camera 35-2 is provided on the inner surface of the door between the door pocket 33-7 and the door pocket 33-8, which are juxtaposed in the vertical direction.
　上述した各カメラ３５－１，３５－２は、フレンチドアタイプの冷蔵庫１００と同様に、脱着可能ではあるが高さ調整を前提としていない、棚板３０－１および棚板３０－３それぞれの、実質的な前方位置に設けられている。そして、図１０に示したように、カメラ３５－１，３５－２は、各棚板３０－１～３０－４の前端よりも前方位置に設けられている。また、図１１Ａ、および図１１Ｂに示したように、カメラ３５－１，３５－２は、扉１０の中央部分付近、すなわち冷蔵庫２００の左右方向の実質的な中央部に設けられ、これら二つのカメラ３５－１，３５－２によって、庫内のほぼ全域が撮影できるように構成されている。 As with the French door type refrigerator 100, each of the cameras 35-1 and 35-2 described above has a shelf 30-1 and a shelf 30-3 that are detachable but are not predicated on height adjustment. It is provided at a substantially forward position. As shown in FIG. 10, the cameras 35-1 and 35-2 are provided in front of the front ends of the shelf plates 30-1 to 30-4. Further, as shown in FIGS. 11A and 11B, the cameras 35-1 and 35-2 are provided in the vicinity of the central portion of the door 10, that is, in the substantially central portion in the left-right direction of the refrigerator 200. The cameras 35-1 and 35-2 are configured so that almost the entire area inside the warehouse can be photographed.
　また、庫内照明灯３４－１，３４－２は、フレンチドアタイプの冷蔵庫１００と同様に設けられている。すなわち、庫内照明灯３４－１，３４－２は、各棚板３０－１～３０－４の前端よりも前方であって、貯蔵庫の前面開口の両側壁部と、前面開口の上面壁面部とに設けられている。庫内照明灯３４－１，３４－２は、光が、直接カメラ３５－１，３５－２の撮影部に入り込まない位置に設けられている。具体的には、カメラ３５－１，３５－２の撮影部が、庫内照明灯３４－１，３４－２の照射方向の照射量（最大照射量）に対して、照射量が１／２以上となる範囲、この例では、照射角６０度の範囲の外に設けられている。 The interior lighting lamps 34-1 and 34-2 are provided in the same manner as the French door type refrigerator 100. That is, the interior lighting lamps 34-1 and 34-2 are in front of the front ends of the respective shelf plates 30-1 to 30-4, and both side walls of the front opening of the storage and the upper wall surface of the front opening. And is provided. The interior illumination lamps 34-1 and 34-2 are provided at positions where light does not directly enter the photographing units of the cameras 35-1 and 35-2. Specifically, the imaging units of the cameras 35-1 and 35-2 have an irradiation amount of ½ with respect to the irradiation amount (maximum irradiation amount) in the irradiation direction of the interior lamps 34-1 and 34-2. The above range, in this example, is provided outside the range of the irradiation angle of 60 degrees.
　図１２Ａは、本発明の実施の形態における一枚扉構成の冷蔵庫２００についての、カメラ取り付けの他の例を示す上から見た断面図であり、図１２Ｂは、同冷蔵庫２００についての、カメラ取り付けの他の例を示す、扉１０内面側の正面図である。また、図１３は、図１２Ａおよび図１２Ｂのカメラ取り付け例における撮影状態を説明するための下方から見た図である。 FIG. 12A is a cross-sectional view seen from above showing another example of camera attachment for refrigerator 200 having a single door configuration according to the embodiment of the present invention, and FIG. It is a front view of the door 10 inner surface side which shows the other example. FIG. 13 is a view seen from below for explaining a shooting state in the camera mounting example of FIGS. 12A and 12B.
　この例の場合、カメラ３５－１，３５－２は、図１２Ａ、および図１２Ｂに示したように、扉１０の軸支部Ｘとは反対側の、扉開放端部側のＹ付近に設けられている。カメラ３５－１，３５－２の高さ位置は、上述した一枚扉の場合（図１１Ａおよび図１１Ｂを参照）と同じ位置である。扉開放端部側のＹ付近に、カメラ３５－１，３５－２を設ける場合には、扉１０を所定角度、例えば３０度開いたときに撮影する構成とする。これにより、その撮影は、図１３の破線で示したように、貯蔵庫の開口部付近までの広い範囲を撮影することができ、しかも、その画像は、使用者が、時おりわずかに扉を開いて中の状態を確認するときに見る状態と実質的に同一となる。よって、表示端末１５で画像を視認したときに、使用者は、違和感がなく自然な形で画像を見ることができる。 In this example, as shown in FIGS. 12A and 12B, the cameras 35-1 and 35-2 are provided in the vicinity of Y on the door open end side opposite to the shaft support portion X of the door 10. ing. The height positions of the cameras 35-1 and 35-2 are the same positions as those of the single door described above (see FIGS. 11A and 11B). When the cameras 35-1 and 35-2 are provided near Y on the door open end side, the photographing is performed when the door 10 is opened at a predetermined angle, for example, 30 degrees. As a result, as shown by the broken line in FIG. 13, the image can be taken over a wide range up to the vicinity of the opening of the storage, and the user sometimes opens the door slightly. This is substantially the same as the state seen when checking the inside state. Therefore, when visually recognizing the image on the display terminal 15, the user can see the image in a natural form without feeling uncomfortable.
　　１－１－３．カメラ構成
　次に、庫内撮影に用いるカメラの構成について説明する。 1-1-3. Camera Configuration Next, the configuration of the camera used for internal shooting will be described.
　図１４は、本発明の実施の形態における冷蔵庫１００，２００において取り付けられるカメラの一例を示す、横から見た断面構成を示す図である。 FIG. 14 is a diagram showing a cross-sectional configuration viewed from the side, showing an example of a camera attached to refrigerators 100 and 200 in the embodiment of the present invention.
　前述したように、庫内撮影を行うに際し、カメラは、上下方向に離れた位置に複数設けることが好ましい。しかしながら、図１４に示したように、上下のカメラ３５－１，３５－２を近接設置することによっても、庫内の全域を撮影できる。 As described above, it is preferable to provide a plurality of cameras at positions separated in the vertical direction when performing internal shooting. However, as shown in FIG. 14, the entire area in the cabinet can also be photographed by installing the upper and lower cameras 35-1 and 35-2 close to each other.
　このような場合、カメラ３５－１，３５－２を一体化して、カメラモジュール４１を構成することが考えられる。このようにモジュール化することによって、設置の容易化とコストダウンを可能にすることができる。また、魚眼レンズ等、広角なレンズを用いることによっても、モジュール化を促進することができる。 In such a case, it is conceivable to form the camera module 41 by integrating the cameras 35-1 and 35-2. By modularizing in this way, it is possible to facilitate installation and reduce costs. Also, modularization can be promoted by using a wide-angle lens such as a fisheye lens.
　１－２．冷蔵庫システムの全体構成
　次にこれまでに述べてきたような冷蔵庫１００，２００を用いた冷蔵庫システム５０全体について説明する。 1-2. Next, the entire refrigerator system 50 using the refrigerators 100 and 200 as described above will be described.
　図１５は、本発明の実施の形態における冷蔵庫システム５０のシステム構成を示す図である。 FIG. 15 is a diagram showing a system configuration of the refrigerator system 50 according to the embodiment of the present invention.
　図１５に示したように、冷蔵庫システム５０は、使用者が、表示端末１５等によって、冷蔵庫１００，２００内の食品状況を確認することのできるシステムである。 As shown in FIG. 15, the refrigerator system 50 is a system that allows the user to check the food status in the refrigerators 100 and 200 using the display terminal 15 or the like.
　この冷蔵庫システム５０は、冷蔵庫１００，２００と、表示端末１５とを備えている。さらに、冷蔵庫システム５０は、通信部である無線アダプタ５３と、中継装置であるゲートウェイ装置５４と、ルータ装置５５と、サーバ装置５７とを含んでいる。 The refrigerator system 50 includes refrigerators 100 and 200 and a display terminal 15. Furthermore, the refrigerator system 50 includes a wireless adapter 53 that is a communication unit, a gateway device 54 that is a relay device, a router device 55, and a server device 57.
　冷蔵庫１００，２００は、使用者の住居Ａ内、例えば、キッチンルームに配置されている。 Refrigerators 100 and 200 are arranged in the user's residence A, for example, in the kitchen room.
　無線アダプタ５３は、冷蔵庫１００，２００の制御部（後述）に電気的に接続するとともに、ゲートウェイ装置５４を介してルータ装置５５と通信するように構成されている。無線アダプタ５３は、ルータ装置５５から送信される信号を受信し、受信した信号を冷蔵庫１００，２００の制御部に出力する。この信号に基づいて、冷蔵庫１００，２００は、対応する動作を実行するように構成されている。 The wireless adapter 53 is configured to be electrically connected to a control unit (described later) of the refrigerators 100 and 200 and to communicate with the router device 55 via the gateway device 54. The wireless adapter 53 receives the signal transmitted from the router device 55 and outputs the received signal to the control units of the refrigerators 100 and 200. Based on this signal, the refrigerators 100 and 200 are configured to perform corresponding operations.
　無線アダプタ５３は、また、冷蔵庫１００，２００の識別情報（例えば、製造番号や型番等）、および、後述する庫内画像データのうち、少なくともいずれかの情報等を冷蔵庫１００，２００の記憶部から取得して、ゲートウェイ装置５４を介してルータ装置５５に送信するように構成されている。なお、無線アダプタ５３は、冷蔵庫１００，２００に一体的に設けられていてもよいし、着脱可能に構成されていてもよい。 The wireless adapter 53 also receives at least one of the identification information (for example, the serial number and model number) of the refrigerators 100 and 200 and the image data in the store to be described later from the storage unit of the refrigerators 100 and 200. The information is acquired and transmitted to the router device 55 via the gateway device 54. The wireless adapter 53 may be provided integrally with the refrigerators 100 and 200, or may be configured to be detachable.
　無線アダプタ５３は、「接続」ボタン５３ａを備えている。「接続」ボタン５３ａは、ゲートウェイ装置５４と新規に接続するためのボタンである。「接続」ボタン５３ａが使用者によって操作されると、無線アダプタ５３は、冷蔵庫１００，２００の記憶部６０から冷蔵庫１００，２００の識別情報（例えば製造番号や型番）を取得するように構成されている。 The wireless adapter 53 includes a “connect” button 53a. The “connect” button 53 a is a button for newly connecting to the gateway device 54. When the “connect” button 53 a is operated by the user, the wireless adapter 53 is configured to acquire identification information (for example, a manufacturing number or a model number) of the refrigerators 100 and 200 from the storage unit 60 of the refrigerators 100 and 200. Yes.
　表示端末１５としては、上述したように、例えば、スマートフォン、またはタブレットＰＣ（パーソナルコンピュータ）等の汎用の携帯型の端末を用いることができる。以下の例においては、表示端末１５は、冷蔵庫１００，２００の扉１０に着脱自在に装備可能なものであり、インターネット５６に接続する機能（手段）と、後述するゲートウェイ装置５４と通信する機能（手段）とを備えているものとする。 As described above, for example, a general-purpose portable terminal such as a smartphone or a tablet PC (personal computer) can be used as the display terminal 15. In the following example, the display terminal 15 can be detachably mounted on the doors 10 of the refrigerators 100 and 200, and has a function (means) for connecting to the Internet 56 and a function for communicating with a gateway device 54 described later ( Means).
　表示端末１５（例えばスマートフォン）は、電話回線網（例えば３Ｇ回線網）を介して、インターネット５６に接続できるように構成されている。それに加えて、またはその代わりに、表示端末１５は、例えばＷｉ－Ｆｉ通信機能によって公衆無線ＬＡＮを介してインターネット５６に接続できるように構成されている。 The display terminal 15 (for example, a smartphone) is configured to be able to connect to the Internet 56 via a telephone line network (for example, a 3G line network). In addition to or instead of this, the display terminal 15 is configured to be connected to the Internet 56 via a public wireless LAN, for example, by a Wi-Fi communication function.
　インターネット５６に接続することにより、表示端末１５は、例えば、冷蔵庫１００，２００内の食品の画像データ、および省エネ運転をさせるためのデータ（例えば扉の開閉回数等のデータ）の少なくとも一方を取得するプログラムを、インターネット５６を介して冷蔵庫１００，２００の製造メーカのホームページから取得することができる。表示端末１５は、取得したプログラムをインストールし、インストールされたプログラムを起動する。これにより、表示端末１５は、冷蔵庫１００，２００内の食品の画像データ等を取得することが可能になる。すなわち、表示端末１５は、そのディスプレイ１５ａの操作画面を操作することによって、冷蔵庫１００，２００の画像データを取得するための操作信号を生成し、送信することが可能になる。詳細については、後述する。 By connecting to the Internet 56, the display terminal 15 acquires, for example, at least one of image data of food in the refrigerators 100 and 200 and data for energy saving operation (for example, data such as the number of times of opening and closing the door). The program can be acquired from the website of the manufacturer of the refrigerator 100 or 200 via the Internet 56. The display terminal 15 installs the acquired program and activates the installed program. Thereby, the display terminal 15 can acquire image data of food in the refrigerators 100 and 200. That is, the display terminal 15 can generate and transmit an operation signal for acquiring image data of the refrigerators 100 and 200 by operating the operation screen of the display 15a. Details will be described later.
　また、表示端末１５は、例えば、Ｗｉ－Ｆｉ通信、Ｂｌｕｅｔｏｏｔｈ（登録商標）通信、赤外線通信等の、インターネット５６を介さない汎用の通信によってルータ装置５５と接続している。表示端末１５は、ルータ装置５５を介してゲートウェイ装置５４と通信接続するように構成されている。そのために必要なデバイス（例えばＷｉ－Ｆｉアンテナ等）は表示端末１５に組み込まれている。 In addition, the display terminal 15 is connected to the router device 55 by general-purpose communication not via the Internet 56, such as Wi-Fi communication, Bluetooth (registered trademark) communication, and infrared communication. The display terminal 15 is configured to be connected for communication with the gateway device 54 via the router device 55. Devices necessary for this purpose (for example, Wi-Fi antennas) are incorporated in the display terminal 15.
　ゲートウェイ装置５４は、無線アダプタ５３と表示端末１５との通信を中継する装置であって、例えば、無線アダプタ５３と、特定小電力無線特別小型周波数帯（９２４．０～９２８．０ＭＨｚ）の信号を用いて通信できるように構成されている。ゲートウェイ装置５４と無線アダプタ５３間の通信の周波数帯は、遠距離まで届く低周波数帯を用いることが好ましく、ゲートウェイ装置５４は、ルータ装置５５とともに、冷蔵庫１００，２００が設置された使用者の住居Ａ内に設置されている。 The gateway device 54 is a device that relays communication between the wireless adapter 53 and the display terminal 15. For example, the gateway device 54 transmits a signal of a specific low power wireless special small frequency band (924.0 to 928.0 MHz) to the wireless adapter 53. It is comprised so that it can communicate using. The frequency band of communication between the gateway device 54 and the wireless adapter 53 is preferably a low frequency band that reaches a long distance, and the gateway device 54, together with the router device 55, is the residence of the user in which the refrigerators 100 and 200 are installed. It is installed in A.
　また、ゲートウェイ装置５４は、表示端末１５と、ルータ装置５５を介して通信接続できるように構成されている。すなわち、ゲートウェイ装置５４は、表示端末１５と、インターネット５６を介さず、ルータ装置５５のみを介して通信（第１の通信）が実行できるように構成されている。 The gateway device 54 is configured to be able to communicate with the display terminal 15 via the router device 55. That is, the gateway device 54 is configured to be able to execute communication (first communication) with the display terminal 15 not via the Internet 56 but only through the router device 55.
　さらに、ゲートウェイ装置５４は、ルータ装置５５を介してインターネット５６に接続可能に構成されている。これにより、ゲートウェイ装置５４は、インターネット５６、およびルータ装置５５を介しても、表示端末１５と通信（第２の通信）することができる。また、ゲートウェイ装置５４は、サーバ装置５７とも通信することができる。 Furthermore, the gateway device 54 is configured to be connectable to the Internet 56 via the router device 55. Thereby, the gateway device 54 can communicate with the display terminal 15 (second communication) via the Internet 56 and the router device 55. The gateway device 54 can also communicate with the server device 57.
　したがって、ゲートウェイ装置５４は、表示端末１５との間で、インターネット５６を介さない通信（すなわちルータ装置５５のみを介する第１の通信）と、インターネット５６を介する通信（すなわちインターネット５６およびルータ装置５５を介する第２の通信）とが実行できるように構成されている。このように構成する理由については後述する。 Accordingly, the gateway device 54 communicates with the display terminal 15 via the Internet 56 (ie, the first communication via only the router device 55) and via the Internet 56 (ie, the Internet 56 and the router device 55). 2nd communication via). The reason for this configuration will be described later.
　サーバ装置５７は、例えば、冷蔵庫１００，２００の製造メーカによって用意される。サーバ装置５７は、表示端末１５、冷蔵庫１００，２００、および無線アダプタ５３に関して、アクセスや認証に必要な情報等を管理している。例えば、サーバ装置５７は、通信要求信号に含まれる表示端末１５の識別情報と、無線アダプタ５３に対応付けされて記憶（登録）されている表示端末の識別情報とが一致するか否かを認証（判別）する。そして、サーバ装置５７は、これらが一致する場合には、アクセスしている表示端末１５を、正規の表示端末として認証し、住居Ａ内の冷蔵庫１００，２００との通信を許可する。 The server device 57 is prepared by a manufacturer of the refrigerators 100 and 200, for example. The server device 57 manages information necessary for access and authentication regarding the display terminal 15, the refrigerators 100 and 200, and the wireless adapter 53. For example, the server device 57 authenticates whether the identification information of the display terminal 15 included in the communication request signal matches the identification information of the display terminal stored (registered) in association with the wireless adapter 53. (Distinction) Then, if they match, the server device 57 authenticates the accessing display terminal 15 as a regular display terminal and permits communication with the refrigerators 100 and 200 in the residence A.
　また、サーバ装置５７は、上述した、冷蔵庫１００，２００から送信された、冷蔵庫１００，２００内の食品の画像データ、および省エネ運転をさせるためのデータのうち少なくともいずれかの情報等を保存する。これらのデータは、表示端末１５からのデータ呼び出し信号に基づき、サーバ装置５７から表示端末１５に送信される。すなわち、使用者は、表示端末１５を操作することによって、冷蔵庫１００，２００内の食品画像データをディスプレイ１５ａに表示させて確認することができる。 In addition, the server device 57 stores at least one of the image data transmitted from the refrigerators 100 and 200, the food image data in the refrigerators 100 and 200, and the data for energy saving operation. These data are transmitted from the server device 57 to the display terminal 15 based on a data call signal from the display terminal 15. That is, the user can check the food image data in the refrigerators 100 and 200 on the display 15a by operating the display terminal 15.
　１－３．冷蔵庫のシステム部構成
　図１６は、本発明の実施の形態における冷蔵庫システム５０に用いられる冷蔵庫１００，２００のシステム構成を示す図である。 1-3. FIG. 16 is a diagram showing a system configuration of the refrigerators 100 and 200 used in the refrigerator system 50 according to the embodiment of the present invention.
　図１６に示したように、冷蔵庫１００，２００は、インターフェイス５８（Ｉ／Ｆ）、制御部であるコントローラ５９、記憶部６０、扉開閉検出部６１、庫内照明灯３４－１，３４－２、カメラ３５－１，３５－２、ファン駆動回路６２、コンプレッサ駆動回路６３、送風ファン１８、およびコンプレッサ１９を備えている。冷蔵庫１００，２００は、例えば住居Ａ内の商用電源等の交流電源６４から電力の供給を受けている。 As shown in FIG. 16, the refrigerators 100 and 200 include an interface 58 (I / F), a controller 59 as a control unit, a storage unit 60, a door open / close detection unit 61, and interior lighting lamps 34-1 and 34-2. Cameras 35-1 and 35-2, a fan drive circuit 62, a compressor drive circuit 63, a blower fan 18, and a compressor 19. The refrigerators 100 and 200 are supplied with power from an AC power source 64 such as a commercial power source in the residence A, for example.
　インターフェイス５８は、無線アダプタ５３と、冷蔵庫１００，２００のコントローラ５９との間のデータ等のやり取りを行う。 The interface 58 exchanges data and the like between the wireless adapter 53 and the controllers 59 of the refrigerators 100 and 200.
　コントローラ５９は、冷蔵庫１００，２００の動作を制御する。また、コントローラ５９は、カメラ３５－１，３５－２、および庫内照明灯３４－１，３４－２を制御して、冷蔵庫１００，２００内の食品を撮影するとともに、撮影された画像データを記憶部６０に一旦記憶する。コントローラ５９は、さらに、画像データをインターネット５６上のサーバ装置５７に送信する。 The controller 59 controls the operation of the refrigerators 100 and 200. In addition, the controller 59 controls the cameras 35-1 and 35-2 and the interior lighting lamps 34-1 and 34-2 to photograph the food in the refrigerators 100 and 200, and the captured image data. Once stored in the storage unit 60. The controller 59 further transmits the image data to the server device 57 on the Internet 56.
　また、コントローラ５９は、表示端末１５からサーバ装置５７を介して画像データの事前送信の要求信号があれば、食品撮影後、画像データを直ちにサーバ装置５７を介して表示端末１５に送信実行するように指示する。この動作の詳細については、後述する。 Further, if there is a request signal for image data pre-transmission from the display terminal 15 via the server device 57, the controller 59 immediately transmits the image data to the display terminal 15 via the server device 57 after photographing food. To instruct. Details of this operation will be described later.
　記憶部６０は、識別記号、および制御プログラムの他に、カメラ３５－１，３５－２で撮影された庫内食品の画像データ、および省エネ運転をさせるためのデータを書き換えて記憶する。 The storage unit 60 rewrites and stores the image data of the food in the cabinet taken by the cameras 35-1 and 35-2 and the data for energy saving operation, in addition to the identification symbol and the control program.
　庫内照明灯３４－１，３４－２は、扉開閉検出部６１からの信号に基づいて、コントローラ５９によって点灯および消灯が制御される。具体的には、例えば、扉１０が開かれると庫内照明灯３４－１，３４－２が点灯し、扉１０が閉じられると数秒の遅延時間をおいて消灯する制御が行われる。 The interior lighting lamps 34-1 and 34-2 are controlled to be turned on and off by the controller 59 based on a signal from the door opening / closing detection unit 61. Specifically, for example, the interior lighting lamps 34-1 and 34-2 are turned on when the door 10 is opened, and are turned off with a delay time of several seconds when the door 10 is closed.
　カメラ３５－１，３５－２は、扉開閉検出部６１からの信号に基づいて、コントローラ５９によって制御される。例えば、扉１０が閉じられると、カメラ３５－１，３５－２が冷蔵庫１００，２００内の食品を撮影する制御が行われる。詳細は後述する。 The cameras 35-1 and 35-2 are controlled by the controller 59 based on a signal from the door opening / closing detection unit 61. For example, when the door 10 is closed, control is performed so that the cameras 35-1 and 35-2 photograph foods in the refrigerators 100 and 200. Details will be described later.
　ファン駆動回路６２は、コントローラ５９からの制御信号を受けて、送風ファン１８の回転駆動を制御する。 The fan drive circuit 62 receives the control signal from the controller 59 and controls the rotational drive of the blower fan 18.
　コンプレッサ駆動回路６３は、コントローラ５９からの制御信号を受けて、コンプレッサ１９の回転数等の駆動を制御する。 The compressor drive circuit 63 receives the control signal from the controller 59 and controls the drive of the compressor 19 such as the rotational speed.
　送風ファン１８は、ファン駆動回路６２の制御に従って動作し、冷気を循環させるための気流を発生する。 The blower fan 18 operates according to the control of the fan drive circuit 62, and generates an air flow for circulating cold air.
　コンプレッサ１９は、コンプレッサ駆動回路６３の制御に従って、冷蔵庫１００，２００内を循環する冷媒を圧縮する。 The compressor 19 compresses the refrigerant circulating in the refrigerators 100 and 200 according to the control of the compressor drive circuit 63.
　１－４．サーバ装置の構成
　次に、本実施の形態における冷蔵庫システム５０のサーバ装置５７の構成例について説明する。 1-4. Next, a configuration example of the server device 57 of the refrigerator system 50 in the present embodiment will be described.
　図１７は、本発明の実施の形態における冷蔵庫システム５０のサーバ装置５７の構成例を示す図である。 FIG. 17 is a diagram illustrating a configuration example of the server device 57 of the refrigerator system 50 according to the embodiment of the present invention.
　図１７に示したように、サーバ装置５７は、サーバ用インターフェイス６５（図面にはＩ／Ｆと記載する）、サーバ制御部６６、およびデータ記憶部６７を備えている。 As shown in FIG. 17, the server device 57 includes a server interface 65 (described as I / F in the drawing), a server control unit 66, and a data storage unit 67.
　サーバ用インターフェイス６５は、サーバ制御部６６の制御に従って、インターネット５６を介して、表示端末１５およびルータ装置５５のうちの少なくともいずれかと、サーバ装置５７との間のデータ等のやり取りを行う通信部である。 The server interface 65 is a communication unit that exchanges data and the like between at least one of the display terminal 15 and the router device 55 and the server device 57 via the Internet 56 under the control of the server control unit 66. is there.
　サーバ制御部６６は、サーバ装置５７の全体の動作を制御する。サーバ制御部６６は、冷蔵庫１００，２００から送信された食品の画像データを結合処理し、データ記憶部６７に記憶させる。サーバ制御部６６は、表示端末１５から画像データの事前送信要求の信号があると、データ記憶部６７に記憶されている最新画像データを、その画像データが冷蔵庫１００，２００から送信されてくる都度、表示端末１５に送信して、表示端末１５に書き換え更新させる。画像データの事前送信要求の信号がない状態で表示端末１５からデータ呼び出し信号が送信されると、サーバ制御部６６は、データ記憶部６７に記憶されている最新の画像データを表示端末１５に送信する。 The server control unit 66 controls the overall operation of the server device 57. The server control unit 66 performs a combination process on the food image data transmitted from the refrigerators 100 and 200 and stores it in the data storage unit 67. When there is a signal for requesting prior transmission of image data from the display terminal 15, the server control unit 66 updates the latest image data stored in the data storage unit 67 each time the image data is transmitted from the refrigerators 100 and 200. , Transmitted to the display terminal 15 and rewritten and updated on the display terminal 15. When a data call signal is transmitted from the display terminal 15 in the absence of a signal for requesting prior transmission of image data, the server control unit 66 transmits the latest image data stored in the data storage unit 67 to the display terminal 15. To do.
　データ記憶部６７は、冷蔵庫システム５０の制御を実行するための管理プログラム、およびアプリケーションプログラム等の必要なデータを記憶している。さらに、データ記憶部６７は、サーバ制御部６６の制御に従って、冷蔵庫１００，２００から送信される食品画像データの最新データを書き換えて記憶する。データ記憶部６７は、例えば、ＨＤＤ（Ｈａｒｄ　Ｄｉｓｃ　Ｄｒｉｖｅ）やＳＳＤ（Ｓｏｌｉｄ　Ｓｔａｔｅ　Ｄｒｉｖｅ）等により構成されている。 The data storage unit 67 stores necessary data such as a management program for executing control of the refrigerator system 50 and an application program. Furthermore, the data storage unit 67 rewrites and stores the latest data of the food image data transmitted from the refrigerators 100 and 200 under the control of the server control unit 66. The data storage unit 67 includes, for example, an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like.
　なお、サーバ装置５７は、単一の大型コンピュータによって構成されるサーバ装置、および、多数のコンピュータ群で構成されるクラウド型サーバ装置のうちのいずれによっても構築することができる。 The server device 57 can be constructed by any one of a server device configured by a single large computer and a cloud type server device configured by a large number of computers.
　＜２．動作＞
　次に、上述した構成を有する冷蔵庫１００，２００、および冷蔵庫システム５０の動作について説明する。なお、以下の各説明において、同じ動作については同一のステップ番号を付記して説明する。 <2. Operation>
Next, operations of the refrigerators 100 and 200 and the refrigerator system 50 having the above-described configuration will be described. In the following descriptions, the same operation will be described with the same step number added.
　２－１．食品の撮影動作
　　２－１－１．扉閉時の撮影
　図１８は、本発明の実施の形態に係る冷蔵庫１００，２００において、扉１０を閉じたときに貯蔵庫内の食品の撮影を行う場合の動作を示すフローチャートである。 2-1. Food shooting operation 2-1-1. Photographing When Door is Closed FIG. 18 is a flowchart showing an operation when photographing food in the storage when the door 10 is closed in the refrigerators 100 and 200 according to the embodiment of the present invention.
　使用者によって、食品を出し入れすべく扉１０が開かれると、扉１０が開かれたことが検知され（Ｓ１，ＹＥＳ）、庫内照明灯３４－１，３４－２が点灯される（Ｓ２）。 When the user opens the door 10 to put food in and out, it is detected that the door 10 has been opened (S1, YES), and the interior lamps 34-1 and 34-2 are turned on (S2). .
　次に、使用者によって扉１０が閉じられると、扉１０が閉じられたことが検知されて（Ｓ３，ＹＥＳ）、庫内照明灯３４－１，３４－２の照度が落とされて（Ｓ４）、しばらくの後、例えば数秒経過後に、カメラ３５－１，３５－２が起動されて、庫内の食品が撮影される（Ｓ５）。 Next, when the door 10 is closed by the user, it is detected that the door 10 has been closed (S3, YES), and the illuminance of the interior lamps 34-1 and 34-2 is reduced (S4). After a while, for example, after a few seconds have elapsed, the cameras 35-1 and 35-2 are activated and the food in the warehouse is photographed (S5).
　その後、撮影された画像データが冷蔵庫１００，２００の記憶部６０に記憶され（Ｓ６）、庫内照明灯３４－１，３４－２が消灯される（Ｓ７）。 Thereafter, the captured image data is stored in the storage unit 60 of the refrigerators 100 and 200 (S6), and the interior lighting lamps 34-1 and 34-2 are turned off (S7).
　このように、本実施の形態において、庫内の撮影時には、庫内照明灯３４－１，３４－２の照度を、扉１０が開いているときの照度よりも落として撮影する。これにより、食品を鮮明に撮影することができ、好適である。庫内照明灯３４－１，３４－２を、扉１０が開いているときの照度のままで点灯させて食品を撮影すると、貯蔵庫内面が白色系であるために、貯蔵庫開口部分を除く全周面から反射光が食品に強く反射する（照度が低下することなく高い照度のままで食品にはね返る）。そうすると、食品が白っぽくなって、鮮明な撮影が困難となる。そこで、上述した例のように、庫内照明灯３４－１，３４－２の照度を落とすと、貯蔵庫内面からの反射光の影響を大幅に低減することができるので、鮮明な画像の即時撮影が可能となる。 As described above, in this embodiment, when photographing inside the warehouse, the illuminance of the interior lighting lamps 34-1 and 34-2 is taken to be lower than that when the door 10 is open. Thereby, food can be clearly photographed, which is preferable. If the interior lighting lamps 34-1 and 34-2 are turned on with the illuminance when the door 10 is open and the food is photographed, the inner surface of the storage is white, so the entire circumference excluding the opening of the storage Reflected light is strongly reflected from the surface to the food (it returns to the food with high illuminance without lowering the illuminance). If it does so, food will become whitish and clear photography will become difficult. Therefore, as in the example described above, reducing the illuminance of the interior lighting lamps 34-1 and 34-2 can greatly reduce the influence of reflected light from the inner surface of the storage, so that a sharp image can be taken immediately. Is possible.
　　２－１－２．冷蔵室冷却運転時の撮影
　図１９は、本発明の実施の形態に係る冷蔵庫１００，２００において、庫内の食品を出し入れした後、冷却時に貯蔵室の食品の撮影を行う場合の動作を示すフローチャートである。 2-1-2. FIG. 19 is a flowchart showing an operation when photographing food in the storage room during cooling after the food in and out of the refrigerator is taken in and out in the refrigerators 100 and 200 according to the embodiment of the present invention. It is.
　使用者によって、食品を出し入れするために扉１０が開かれると、扉１０が開かれたことが検知され（Ｓ１，ＹＥＳ）、庫内照明３４－１、３４－２が点灯される（Ｓ２）。そして、使用者によって、扉１０が閉じられて、扉１０が閉じられたことが検知されると（Ｓ３，ＹＥＳ）、冷蔵室５が冷却運転状態か否かが判断される（Ｓ８）。もし、送風ファン１８がＯＮ状態で、かつ、ダンパ２２が開状態であれば、冷蔵室５の冷却運転中であると判定され（Ｓ８，ＹＥＳ）、前述した扉閉時（図１８、Ｓ３，ＹＥＳ）と同様に、庫内照明灯３４－１，３４－２の照度が落とされて（Ｓ４）、カメラ３５－１，３５－２が起動され、庫内の食品が撮影される（Ｓ５）。その後、撮影された画像データが冷蔵庫１００，２００の記憶部６０に記憶されて（Ｓ６）、庫内照明灯３４－１，３４－２が消灯される（Ｓ７）。 When the user opens the door 10 to put food in and out, it is detected that the door 10 has been opened (S1, YES), and the interior lighting 34-1 and 34-2 are turned on (S2). . When the user detects that the door 10 is closed and the door 10 is closed (S3, YES), it is determined whether the refrigerator compartment 5 is in the cooling operation state (S8). If the blower fan 18 is in the ON state and the damper 22 is in the open state, it is determined that the refrigerating room 5 is in the cooling operation (S8, YES), and the door is closed (FIG. 18, S3). Similarly to (YES), the illuminance of the interior lamps 34-1 and 34-2 is reduced (S4), the cameras 35-1 and 35-2 are activated, and the food in the interior is photographed (S5). . Thereafter, the photographed image data is stored in the storage unit 60 of the refrigerators 100 and 200 (S6), and the interior lighting lamps 34-1 and 34-2 are turned off (S7).
　このように、冷蔵室５の冷却運転中に撮影を行うことによって、例えば、新しく貯蔵庫内に入れた食品の表面に貯蔵庫内外の温度差による結露が生じた場合でも、結露は冷却動作によって解消され、なくなる。よって、カメラ３５－１，３５－２による撮影は、食品包装容器に記載されている文字が読み取れるほど鮮明に行われるので、好適である。 Thus, by performing imaging during the cooling operation of the refrigerator compartment 5, for example, even when condensation occurs due to a temperature difference between the inside and outside of the storage on the surface of the food newly put in the storage, the condensation is eliminated by the cooling operation. It ’s gone. Therefore, the photographing by the cameras 35-1 and 35-2 is preferable because it is performed so sharply that the characters written on the food packaging container can be read.
　なお、上述した図１８，図１９における動作の中で、扉１０が閉じられたときには（Ｓ３，ＹＥＳ）、一度、庫内照明灯３４－１，３４－２を消灯させて、撮影前に再度、庫内照明灯３４－１，３４－２を点灯させ、その照度を低下させるようにしてもよい。これにより、庫内照明灯３４－１，３４－２が点灯し続けることによる無駄な電力の消費を抑制させることができる。 18 and 19, when the door 10 is closed (S3, YES), the interior illumination lights 34-1 and 34-2 are turned off once and again before photographing. Alternatively, the interior illumination lights 34-1 and 34-2 may be turned on to reduce the illuminance. As a result, it is possible to suppress wasteful power consumption due to the interior lighting lights 34-1 and 34-2 being continuously lit.
　　２－１－３．扉開時の撮影
　図２０は、本発明の実施の形態に係る冷蔵庫２００が一枚扉の場合において、扉１０が所定角度開いた時点で貯蔵庫内の食品の撮影が行われるようにした場合の動作を示すフローチャートである。 2-1-3. Photographing when the door is opened FIG. 20 shows a case where the food in the storage is photographed when the door 10 is opened at a predetermined angle when the refrigerator 200 according to the embodiment of the present invention is a single door. It is a flowchart which shows operation | movement.
　使用者によって、食品を出し入れするために扉１０が開かれると、扉１０が開かれたことが検知され（Ｓ１，ＹＥＳ）、庫内照明灯３４－１，３４－２が点灯され（Ｓ２）、扉１０の開き角度が所定角度、例えば図１３に示した３０度の開き角度となっているか否かが判定される（Ｓ１０）。扉１０の開き角度が所定角度以上であると判定されると（Ｓ１０，ＹＥＳ）、庫内照明灯３４－１，３４－２の照度が落とされて（Ｓ４）、カメラ３５－１，３５－２を起動されて、庫内の食品が撮影される（Ｓ５）。その後、撮影された画像データが冷蔵庫２００の記憶部６０に記憶され（Ｓ６）、扉１０が閉じられると、扉１０が閉じられたことが検知され（Ｓ１１，ＹＥＳ）、庫内照明灯３４－１，３４－２が消灯される（Ｓ７）。 When the user opens the door 10 to put food in and out, it is detected that the door 10 has been opened (S1, YES), and the interior lamps 34-1 and 34-2 are turned on (S2). Then, it is determined whether the opening angle of the door 10 is a predetermined angle, for example, the opening angle of 30 degrees shown in FIG. 13 (S10). If it is determined that the opening angle of the door 10 is equal to or greater than the predetermined angle (S10, YES), the illumination intensity of the interior lighting lamps 34-1 and 34-2 is reduced (S4), and the cameras 35-1, 35- 2 is activated and food in the warehouse is photographed (S5). Thereafter, the photographed image data is stored in the storage unit 60 of the refrigerator 200 (S6). When the door 10 is closed, it is detected that the door 10 is closed (S11, YES), and the interior lamp 34- 1 and 34-2 are turned off (S7).
　図２０に示した例のように、扉１０を所定角度開いた時点で庫内を撮影するようにすると、すでに述べたように、貯蔵庫内を広範囲に撮影でき、しかも、その画像は、違和感のない自然なものとなるので、好適である。 When the door 10 is opened at a predetermined angle as in the example shown in FIG. 20, the interior of the storage can be photographed over a wide area, as described above, and the image is uncomfortable. This is preferable because it is not natural.
　なお、扉１０が所定角度開いた時に撮影する場合には、扉１０が開く動作時と扉１０が閉じる動作時の少なくとも二回以上撮影が行われることになる。このとき、一回の扉１０の開状態から閉状態までの動作時間の中で、最後に撮影された画像データ（通常は、扉閉動作時）を記憶部６０に記憶することにより、食品の出し入れを終えた、最新の貯蔵庫の食品状態を撮影することができる。 Note that, when shooting is performed when the door 10 is opened at a predetermined angle, shooting is performed at least twice during the operation of opening the door 10 and the operation of closing the door 10. At this time, the image data (usually at the time of the door closing operation) taken in the operation time from the opening state to the closing state of the door 10 once is stored in the storage unit 60, thereby You can take a picture of the state of food in the latest storage after you have taken in and out.
　なお、ステップＳ１０において、扉１０の開き角度が所定角度に達するか否かを検出するとき、扉１０が所定角度に達する前に扉１０が閉じられると、庫内照明灯３４－１，３４－２を消灯され、再び扉１０が開かれるまで、冷蔵庫２００は待機する。 In step S10, when detecting whether or not the opening angle of the door 10 reaches a predetermined angle, if the door 10 is closed before the door 10 reaches the predetermined angle, the interior lighting lights 34-1 and 34- 2 is turned off and the refrigerator 200 stands by until the door 10 is opened again.
　以上、撮影動作について代表的なものを例示して説明したが、これらの撮影動作以外にも、例えば、定刻になると、または、前回の撮影後所定時間が経過すると、撮影を行うことも可能である。また、表示端末１５から撮影指示があると撮影する、等の撮影動作も可能である。 As described above, the typical shooting operation has been described by way of example. However, in addition to these shooting operations, for example, it is also possible to perform shooting at a fixed time or when a predetermined time elapses after the previous shooting. is there. Also, a shooting operation such as shooting when a shooting instruction is given from the display terminal 15 is possible.
　　２－１－４．撮影時の照明
　本実施の形態における撮影時には、図１８～図２０を用いて説明したように、庫内照明灯３４－１，３４－２を点灯させた上で、その照度を低下させた状態で庫内を照射して撮影する。このとき、貯蔵庫両側面の庫内照明灯３４－１、または、貯蔵庫上面の庫内照明灯３４－２のみを点灯させ、照度を低下させて照射し、撮影することも可能である。 2-1-4. Illumination at the time of photographing At the time of photographing in the present embodiment, as described with reference to FIGS. 18 to 20, the illumination lamps 34-1 and 34-2 are turned on and the illuminance is lowered. Take a picture by irradiating the inside. At this time, it is also possible to turn on only the interior lighting 34-1 on both sides of the storage or the interior lighting 34-2 on the upper surface of the storage, illuminate with lowering the illuminance, and take a picture.
　また、撮影時の食品照射の他の例として、次のように制御することも考えられる。 Also, as another example of food irradiation at the time of photographing, the following control can be considered.
　図２１は、本実施の形態の冷蔵庫１００，２００における、カメラ３５－１，３５－２による撮影時の庫内照明灯３４－１，３４－２の点灯、および消灯の制御の他の例を示すフローチャートである。なお、図２１は、図１８～図２０における、破線部分（Ｓ４、およびＳ５）の動作に相当する。 FIG. 21 shows another example of the control of turning on and off the interior lighting lamps 34-1 and 34-2 at the time of photographing by the cameras 35-1 and 35-2 in the refrigerators 100 and 200 of the present embodiment. It is a flowchart to show. FIG. 21 corresponds to the operation of the broken line portions (S4 and S5) in FIGS.
　上述した図１８～図２０による撮影は、庫内照明灯３４－１，３４－２を点灯させた上で、その照度を低下させて撮影する例である。図２１の例では、貯蔵庫両側面の庫内照明灯３４－１の片方ずつを消灯させ、換言すると、貯蔵庫両側面の庫内照明灯３４－１の片方のみが点灯している状態にして、食品を照射し、撮影する。このとき、貯蔵庫上面の庫内照明灯３４－２は、点灯、消灯いずれの状態であってもよいが、庫内の照度が撮影に最適になるように、いずれかの状態を適宜選択すればよい。 18 to 20 described above is an example in which the interior illumination lamps 34-1 and 34-2 are turned on and the illuminance is lowered to take pictures. In the example of FIG. 21, one of the interior lamps 34-1 on both sides of the storage is turned off, in other words, only one of the interior lamps 34-1 on both sides of the storage is turned on. Irradiate food and photograph. At this time, the interior illumination lamp 34-2 on the upper surface of the storage may be either on or off, and if any state is appropriately selected so that the illuminance in the interior is optimal for photographing. Good.
　図２１に示したように、カメラ３５－１，３５－２による撮影を始める前に、すでに点灯している、貯蔵庫両側面の庫内照明灯３４－１のうちいずれか一方、例えば右庫内照明灯が消灯され（Ｓ１２）、左庫内照明灯により照射されている状態の食品が撮影（Ｓ１３）され、記憶される（Ｓ１４）。その後、右庫内照明灯が点灯され（Ｓ１５）、次に、左庫内照明灯が消灯されて（Ｓ１６）、右庫内照明灯で照射されている状態の食品が撮影される（Ｓ１７）。撮影された画像データは記憶され（Ｓ１８）、右庫内照明灯が消灯される（Ｓ１９）。ステップＳ１２～Ｓ１９の例は、左右逆としても実行可能である。 As shown in FIG. 21, before shooting with the cameras 35-1 and 35-2, one of the interior lighting lamps 3-1 on both sides of the storage, which is already lit, for example, in the right warehouse The illuminating lamp is turned off (S12), and the food that has been irradiated by the left interior illuminating lamp is photographed (S13) and stored (S14). Thereafter, the right interior lighting is turned on (S15), then the left interior lighting is turned off (S16), and the food being irradiated with the right interior lighting is photographed (S17). . The captured image data is stored (S18), and the right interior lighting lamp is turned off (S19). The examples of steps S12 to S19 can be executed in the reverse direction.
　食品を片方側から照射して記憶された画像データは、合成されて一つの画像として記憶されることも可能である。庫内照明灯３４－１，３４－２を片方ずつ点灯させて食品を撮影し、一つの画像データに合成する理由は以下の通りである。 Image data stored by irradiating food from one side can be combined and stored as a single image. The reason why the interior lighting lamps 34-1 and 34-2 are turned on one by one to photograph foods and combine them into one image data is as follows.
　すでに述べたとおり、撮影時には庫内照明灯３４－１，３４－２の照度を低下させて撮影するが、その照度低下をあまり大きくすると、写りが暗くなって鮮明さに欠けるようになるので、照度を低下させるのにも限度がある。このため、ある程度の照度を維持する必要があるが、その照度であっても、貯蔵庫内容積が小さい場合等には、反射光による影響が残る場合がある。しかしながら、上述したように、庫内照明灯３４－１の左右の片方ずつを点灯させて食品を撮影すると、反射光の影響を低減でき、庫内照明灯３４－１が点灯している側の面を適度な明るさで撮影することができる。よって、この適度の明るさで撮影された食品の左右の画像を結合する合成処理を行えば、全体を鮮明な画像とすることができ、好適である。 As already described, the illuminance of the interior lighting lamps 34-1 and 34-2 is reduced at the time of shooting, but if the decrease in illuminance is too large, the image becomes dark and lacks clarity. There is a limit to reducing the illuminance. For this reason, it is necessary to maintain a certain level of illuminance. However, even if the illuminance is high, the effect of reflected light may remain when the internal volume of the storage is small. However, as described above, when the food is photographed by lighting one of the left and right sides of the interior lamp 34-1, the influence of the reflected light can be reduced, and the side where the interior lamp 34-1 is lit. The surface can be taken with moderate brightness. Therefore, it is preferable to perform a combining process that combines the left and right images of food taken with moderate brightness, so that the entire image can be made clear.
　２－２．画像の保存と合成
　次に、上述した各動作において撮影された画像データの保存処理、および合成処理について説明する。 2-2. Image Storage and Compositing Next, image data storage processing and composition processing performed in each of the above-described operations will be described.
　　２－２－１．サーバ装置で保存と合成を行う場合
　図２２は、本発明の実施の形態の冷蔵庫システム５０において、サーバ装置５７で画像データの保存処理と合成処理を行う場合のフローチャートである。 2-2-1. FIG. 22 is a flowchart when the server device 57 performs image data storage processing and composition processing in the refrigerator system 50 according to the embodiment of the present invention.
　上述した図１８～図２０（図２１に示した工程を含む）に示した動作によって庫内が撮影されると、冷蔵庫１００，２００は、無線アダプタ５３から、ゲートウェイ装置５４、およびルータ装置５５を介してインターネット５６に接続する（Ｓ２０）。そして、冷蔵庫１００，２００は、各カメラで撮影され、記憶された個別の画像データを、インターネット５６に接続されたサーバ装置５７に送信する（Ｓ２１）。 When the interior is photographed by the operation shown in FIGS. 18 to 20 (including the steps shown in FIG. 21), the refrigerators 100 and 200 connect the gateway device 54 and the router device 55 from the wireless adapter 53. To the Internet 56 (S20). Then, the refrigerators 100 and 200 transmit the individual image data photographed and stored by each camera to the server device 57 connected to the Internet 56 (S21).
　インターネット５６を経由して送信された画像データは、サーバ装置５７のサーバ制御部６６によって、個別の画像データを結合する合成処理（Ｓ２２）が行われる。合成処理された画像データは、サーバ装置５７のデータ記憶部６７に、保存される（Ｓ２３）。 The image data transmitted via the Internet 56 is subjected to a combining process (S22) for combining individual image data by the server control unit 66 of the server device 57. The combined image data is stored in the data storage unit 67 of the server device 57 (S23).
　このように、サーバ装置５７で画像を合成し、かつ、記憶保存することにより、冷蔵庫１００，２００側のコントローラ５９、および記憶部６０等の負荷を低減することができ、インターネット対応型の冷蔵庫１００，２００を安価に提供することができる。 In this way, by combining the images in the server device 57 and storing and storing them, it is possible to reduce the load on the refrigerator 59, the controller 59 on the side of the 200, the storage unit 60, etc. , 200 can be provided at low cost.
　　２－２－２．冷蔵庫側で保存処理と合成処理とを行う場合
　図２３は、本発明の実施の形態に係る冷蔵庫システム５０において、冷蔵庫１００，２００側で画像データの保存処理と合成処理を行う場合のフローチャートである。 2-2-2. FIG. 23 is a flowchart in the case where image data storage processing and composition processing are performed on the refrigerators 100 and 200 side in the refrigerator system 50 according to the embodiment of the present invention. .
　上述した図１８～図２０（図２１に示した工程を含む）に示した動作によって庫内が撮影されると、冷蔵庫１００，２００の制御部であるコントローラ５９は、記憶部６０に記憶された各カメラからの個別の画像データを取り出して、結合し、合成する（Ｓ２４）。そして、コントローラ５９は、合成された画像データを記憶部６０に記憶させる（Ｓ２５）。 When the interior is photographed by the operation shown in FIGS. 18 to 20 (including the steps shown in FIG. 21), the controller 59 that is the control unit of the refrigerators 100 and 200 is stored in the storage unit 60. Individual image data from each camera is extracted, combined, and synthesized (S24). Then, the controller 59 stores the synthesized image data in the storage unit 60 (S25).
　冷蔵庫１００，２００は、無線アダプタ５３から、ゲートウェイ装置５４、およびルータ装置５５を介してインターネット５６に接続する（Ｓ２０）。そして、冷蔵庫１００，２００は、記憶された画像データを、インターネット５６に接続されたサーバ装置５７に送信する（Ｓ２１）。インターネット５６を経由して送信された合成画像データは、サーバ装置５７のデータ記憶部６７に、保存される（Ｓ２３）。 The refrigerators 100 and 200 are connected from the wireless adapter 53 to the Internet 56 via the gateway device 54 and the router device 55 (S20). Then, the refrigerators 100 and 200 transmit the stored image data to the server device 57 connected to the Internet 56 (S21). The composite image data transmitted via the Internet 56 is stored in the data storage unit 67 of the server device 57 (S23).
　この例においては、冷蔵庫１００，２００側のコントローラ５９、および記憶部６０の負荷は大きくなるが、サーバ装置５７のデータ記憶部６７を介することなく、表示端末１５と画像データを送受信することができるので、システム運用費を安価にすることができる。 In this example, the load on the controller 59 and the storage unit 60 on the refrigerators 100 and 200 side increases, but image data can be transmitted and received with the display terminal 15 without going through the data storage unit 67 of the server device 57. Therefore, the system operation cost can be reduced.
　　２－２－３．表示端末側で保存処理と合成処理を行う場合
　図２４は、本発明の実施の形態に係る冷蔵庫システム５０において、表示端末１５側で画像データの保存処理と合成処理とを行う場合のフローチャートである。 2-2-3. FIG. 24 is a flowchart in the case where image data storage processing and composition processing are performed on the display terminal 15 side in the refrigerator system 50 according to the embodiment of the present invention. .
　上述した図１８～図２０（図２１に示した工程を含む）に示した動作によって庫内が撮影されると、冷蔵庫１００，２００は、無線アダプタ５３からゲートウェイ装置５４、およびルータ装置５５を介して、インターネット５６に接続する（Ｓ２０）。冷蔵庫１００，２００は、サーバ装置５７ではなく、表示端末１５に画像データを送信する（Ｓ２６）。インターネット５６を経由して送信された画像データには、表示端末１５によって画像データを結合する合成処理（Ｓ２７）が行われる。合成処理された画像データは、表示端末１５のデータ記憶部に保存される（Ｓ２８）。 When the interior is photographed by the operation shown in FIGS. 18 to 20 (including the steps shown in FIG. 21), the refrigerators 100 and 200 are connected from the wireless adapter 53 to the gateway device 54 and the router device 55. Then, it connects to the Internet 56 (S20). The refrigerators 100 and 200 transmit the image data to the display terminal 15 instead of the server device 57 (S26). The image data transmitted via the Internet 56 is subjected to a combining process (S27) for combining the image data by the display terminal 15. The combined image data is stored in the data storage unit of the display terminal 15 (S28).
　この例の場合には、表示端末１５の負荷は増大するものの、冷蔵庫１００，２００側のコントローラ５９、および記憶部６０の負荷を低減することができ、インターネット対応型の冷蔵庫１００，２００を安価に提供することができる。 In the case of this example, although the load on the display terminal 15 increases, the load on the controller 59 and the storage unit 60 on the refrigerator 100, 200 side can be reduced, and the Internet- compatible refrigerator 100, 200 can be made inexpensive. Can be provided.
　以上、画像データの送信と合成動作について、代表的なものを例示して説明した。しかしながら、保存を行う装置と合成を行う装置とは必ずしも同一の装置、例えばサーバ装置５７で行わなければならないというものではなく、例えば、冷蔵庫１００，２００で画像データを合成し、サーバ装置５７で画像データを保存する等、冷蔵庫システム５０の構成に応じて任意に設定すればよい。 The image data transmission and composition operations have been described above by exemplifying typical ones. However, the apparatus for storing and the apparatus for combining do not necessarily have to be performed by the same apparatus, for example, the server apparatus 57. For example, image data is combined by the refrigerators 100 and 200, and the server apparatus 57 performs image processing. What is necessary is just to set arbitrarily according to the structure of the refrigerator system 50, such as preserve | saving data.
　２－３．画像データの通常の送受信
　　２－３－１．サーバ装置、冷蔵庫に保存された画像データの送受信
　図２５は、本発明の実施の形態に係る冷蔵庫システム５０におけるサーバ装置５７または冷蔵庫１００，２００と、表示端末１５との送受信を示すフローチャートである。図２５は、サーバ装置５７または冷蔵庫１００，２００に記憶されている画像データの送受信処理を示している。 2-3. Normal transmission / reception of image data 2-3-1. Transmission / Reception of Image Data Stored in Server Device and Refrigerator FIG. 25 is a flowchart showing transmission / reception between server device 57 or refrigerators 100 and 200 and display terminal 15 in refrigerator system 50 according to the embodiment of the present invention. FIG. 25 shows a transmission / reception process of image data stored in the server device 57 or the refrigerators 100 and 200.
　まず、使用者は、例えば買い物先等において、表示端末１５のディスプレイ１５ａに表示されるサーバ接続ボタン（図示せず）を押して、サーバ装置５７のデータ記憶部６７に記憶された画像データの読み込み要求を行う（Ｓ３１）。表示端末１５は、サーバ装置５７から画像データを取り込まれたか否かを検出する（Ｓ３２）。ステップＳ３２において、画像データが転送されていなければ（Ｓ３２，ＮＯ）、表示端末１５からインターネット５６に接続を行う（Ｓ３３）。 First, the user presses a server connection button (not shown) displayed on the display 15a of the display terminal 15 at a shopping destination, for example, and requests to read image data stored in the data storage unit 67 of the server device 57. (S31). The display terminal 15 detects whether image data has been taken in from the server device 57 (S32). In step S32, if the image data is not transferred (S32, NO), connection is made from the display terminal 15 to the Internet 56 (S33).
　次に、サーバ装置５７のデータ記憶部６７、または冷蔵庫１００，２００の記憶部６０に記憶された画像データが取り出され（Ｓ３４）、画像データは、インターネット５６を経由し、データ呼び出し元であるスマートフォン等の表示端末１５に転送される（Ｓ３５）。表示端末１５は、サーバ装置５７等から画像データを取り込まれたか否かを検出し（Ｓ３２）、画像データが取り込まれたら（Ｓ３２，ＹＥＳ）、表示端末１５のディスプレイ１５ａに画像データを出力する（Ｓ３６）。 Next, the image data stored in the data storage unit 67 of the server device 57 or the storage unit 60 of the refrigerators 100 and 200 is taken out (S34), and the image data passes through the Internet 56 and is the smartphone that is the data caller. Or the like is transferred to the display terminal 15 (S35). The display terminal 15 detects whether or not the image data is captured from the server device 57 or the like (S32), and when the image data is captured (S32, YES), outputs the image data to the display 15a of the display terminal 15 (S32). S36).
　その後、表示端末１５は、ディスプレイ１５ａに表示される拡大ボタン（図示せず）が押されたか否かを検知し（Ｓ３７）、拡大ボタンが押されたことを検知すると（Ｓ３７，ＹＥＳ）、ディスプレイに出力された貯蔵庫内の画像データを、デジタル変換で１．１倍以上に拡大して画像データを作成する。そして、表示端末１５は、拡大変換された画像データを、表示端末１５のディスプレイに出力する（Ｓ３６）。 Thereafter, the display terminal 15 detects whether or not an enlarge button (not shown) displayed on the display 15a has been pressed (S37). When the display terminal 15 detects that the enlarge button has been pressed (S37, YES), the display terminal 15 The image data stored in the storage is enlarged by 1.1 times or more by digital conversion to create image data. Then, the display terminal 15 outputs the enlarged and converted image data to the display of the display terminal 15 (S36).
　その後、表示端末１５は、ディスプレイ１５ａに表示されるテンキーボタン（図示せず）が押されたかを検知し（Ｓ３８）、テンキーボタンが押されたことを検知すると（Ｓ３８，ＹＥＳ）、ディスプレイ１５ａに出力された貯蔵庫内の拡大画像データを、テンキーボタンで指定された箇所に対応する画像データとして、ディスプレイ１５ａに出力する（Ｓ３６）。表示端末１５は、拡大ボタンが押されなかった場合（Ｓ３７，ＮＯ），かつ、テンキーボタンが押されなかった場合（Ｓ３８，ＮＯ）には、次のステップに進む。 Thereafter, the display terminal 15 detects whether a numeric key button (not shown) displayed on the display 15a has been pressed (S38), and if it detects that the numeric key button has been pressed (S38, YES), the display terminal 15 displays on the display 15a. The output enlarged image data in the storage is output to the display 15a as image data corresponding to the location specified by the numeric keypad (S36). The display terminal 15 proceeds to the next step when the enlarge button is not pressed (S37, NO) and when the numeric keypad button is not pressed (S38, NO).
　なお、上述した拡大ボタン、および所定箇所の画像データを表示させるテンキーボタンは、ディスプレイ１５ａの表面を指でタップする方式、または、スライドすることによって入力する方式とすればよい。このような構成とすることによって、使い勝手を向上させることができる。 Note that the above-described enlargement button and the numeric keypad button for displaying image data at a predetermined location may be a method of tapping the surface of the display 15a with a finger or a method of inputting by sliding. With such a configuration, usability can be improved.
　以上述べたように、本実施の形態の冷蔵庫システム５０によれば、買い物先で冷蔵庫１００，２００の中身を一目で確認することができる。よって、使用者は、買い忘れを予防することができるとともに、余分な食材を購入してしまう無駄をなくすことができる。また、夫婦が共働きで働く家庭においては、帰る間際に冷蔵庫１００，２００の貯蔵庫内を確認して、帰宅途中で食材等を購入することができるので、使用者にとって時間の有効活用ができる。 As described above, according to the refrigerator system 50 of the present embodiment, the contents of the refrigerators 100 and 200 can be confirmed at a glance at a shopping destination. Therefore, the user can prevent forgetting to buy and can eliminate the waste of purchasing extra food. Further, in a home where couples work together, it is possible to check the inside of the refrigerators 100 and 200 immediately before returning, and to purchase food and the like on the way home, so that the user can effectively use time.
　また、拡大表示や所定箇所表示をさせることによって、表示端末１５のように小型化が進んだ端末においても、拡大させて画像を表示させることで小型の表示端末１５では確認しにくい食材も確実に見せることができる。 In addition, by displaying an enlarged display or a predetermined location, even in a terminal that has been miniaturized such as the display terminal 15, it is possible to reliably display foods that are difficult to confirm on the small display terminal 15 by displaying an enlarged image. Can show.
　　２－３－２．表示端末に保存の画像データの送受信
　図２６は、本発明の実施の形態における冷蔵庫システム５０において、すでに表示端末１５に画像データが記憶、保存されている場合の動作を示すフローチャートである。 2-3-2. Transmission / Reception of Image Data Stored on Display Terminal FIG. 26 is a flowchart showing an operation when image data is already stored and stored in display terminal 15 in refrigerator system 50 according to the embodiment of the present invention.
　図２６に示した場合においては、図２４で述べた様に、冷蔵庫１００，２００から表示端末１５に、画像データが送信されて保存されている。使用者が、表示端末１５において、この画像データの読み込み要求を行う（Ｓ３１）と、表示端末１５の記憶部から画像データが取り込まれて、表示端末１５のディスプレイに画像データが出力される（Ｓ３６）。その後の、拡大表示操作（Ｓ３７）や局所表示（Ｓ３８）については、図２５を用いて説明した通りである。 In the case shown in FIG. 26, as described in FIG. 24, image data is transmitted from the refrigerators 100 and 200 to the display terminal 15 and stored. When the user makes a read request for the image data on the display terminal 15 (S31), the image data is fetched from the storage unit of the display terminal 15 and is output to the display of the display terminal 15 (S36). ). The subsequent enlarged display operation (S37) and local display (S38) are as described with reference to FIG.
　　２－３－３．画像データの切換受信
　ここでは、例えば、カメラ３５－１，３５－２で撮影された画像として、各カメラ３５－１，３５－２それぞれの個別画像（例として、貯蔵庫内の上半分の画像および下半分の画像）と、これらの各撮影画像を結合して合成された合成画像（貯蔵庫内の上から下までを一枚に合成した画像）とが記憶保存されているものとする。これらの画像を切換えて送受信し、表示端末１５に表示する例について説明する。 2-3-3. Here, for example, as images captured by the cameras 35-1 and 35-2, individual images of the respective cameras 35-1 and 35-2 (for example, images in the upper half of the storage and Assume that a lower half image) and a synthesized image obtained by combining these captured images (an image synthesized from the top to the bottom in the storage into one sheet) are stored and saved. An example in which these images are switched and transmitted and received and displayed on the display terminal 15 will be described.
　図２７は、本発明の実施の形態における冷蔵庫システム５０において、カメラ３５－１，３５－２それぞれによって撮影された個別画像と、合成画像とを切り替えて送受信する場合の動作を示すフローチャートである。 FIG. 27 is a flowchart showing an operation in the case where the individual images captured by the cameras 35-1 and 35-2 and the composite image are switched and transmitted / received in the refrigerator system 50 according to the embodiment of the present invention.
　使用者は、表示端末１５のディスプレイ１５ａに表示される個別画像／合成画像呼び込みボタン（図示せず）を押す。表示端末１５は、個別画像／合成画像呼び込みボタンが押されたか否かを判定し（Ｓ４１）、押された場合には（Ｓ４１，ＹＥＳ）、個別画像および合成画像のうち、いずれかの画像の呼び出しを行う（Ｓ４２，Ｓ４２’）。個別画像が呼び出されるか、合成画像が呼び出されるかについては、例えば、ボタンが押される都度、または、ボタンが押される回数によって切り替えることができる。以降は、図２５または図２６に示したフローにしたがって、個別画像または合成画像のいずれかの画像データが取り込まれ、表示端末１５のディスプレイ１５ａに表示される。 The user presses an individual image / composite image calling button (not shown) displayed on the display 15a of the display terminal 15. The display terminal 15 determines whether or not the individual image / composite image calling button has been pressed (S41). If the button has been pressed (S41, YES), one of the individual images and the composite image is selected. A call is made (S42, S42 '). Whether the individual image is called or the composite image is called can be switched, for example, every time the button is pressed or by the number of times the button is pressed. Thereafter, according to the flow shown in FIG. 25 or FIG. 26, either individual image data or composite image data is captured and displayed on the display 15 a of the display terminal 15.
　この例では、表示端末１５に表示させる画像を、個別画像および合成画像のうちのいずれかに切り換えることができるようにしている。これにより、通常は合成画像を呼び込んで表示させることにより、貯蔵庫内の食品状況を一目で確認し、食品が貯蔵庫の隅にある等の理由によって、判別しにくいとき等は、個別画像に切り換えて表示させることができる。これにより、使用者は、食品を確実に判別することができ、使い勝手を向上させることができる。 In this example, the image displayed on the display terminal 15 can be switched to either an individual image or a composite image. As a result, usually the composite image is called in and displayed, so that the food status in the storage can be checked at a glance.If it is difficult to distinguish the food because it is in the corner of the storage, switch to the individual image. Can be displayed. Thereby, the user can discriminate | determine food reliably and can improve usability.
　２－４．画像データ等の事前送信要求があったときの送受信
　図２８は、本発明の実施の形態に係る冷蔵庫システム５０において、表示端末１５から画像の事前送信要求があった場合の処理のフローチャートである。 2-4. Transmission / reception when there is a request for prior transmission of image data and the like FIG. 28 is a flowchart of processing when there is a request for prior transmission of an image from the display terminal 15 in the refrigerator system 50 according to the embodiment of the present invention.
　まず、使用者が表示端末１５を操作して、事前要求信号を送信する、要求操作を行う（Ｓ５１）。サーバ装置５７、または冷蔵庫１００，２００は、この要求信号を受信し（Ｓ５２）、データ記憶部６７、または記憶部６０に記憶された画像データ（要求に対応した個別画像データ、または合成画像データ、以下同じ）を読み込んで送信する（Ｓ５３）。 First, the user operates the display terminal 15 to perform a request operation that transmits a prior request signal (S51). The server device 57 or the refrigerators 100 and 200 receives this request signal (S52), and stores image data (individual image data or composite image data corresponding to the request, stored in the data storage unit 67 or the storage unit 60). The same applies hereinafter) is read and transmitted (S53).
　表示端末１５は、サーバ装置５７、または冷蔵庫１００，２００から送信された画像データが取り込まれたか否かを検出する（Ｓ５４）。画像データが送信されていないと判定された場合には（Ｓ５４，ＮＯ）、表示端末１５からインターネット５６に接続を行う（Ｓ５５）。そうすると、サーバ装置５７、または冷蔵庫１００，２００に記憶された画像データが取り込まれて（Ｓ５６）、画像データがインターネット５６を経由して、表示端末１５に送信される（Ｓ５７）。表示端末１５は、サーバ装置５７等から画像データが取り込まれたかを検出し（Ｓ５４）、画像データが検出されたら（Ｓ５４，ＹＥＳ）、画像データの呼び出し操作があるまで待機する（Ｓ５８，ＮＯ）。画像データの呼び出し操作があれば（Ｓ５８，ＹＥＳ）、表示端末１５は、ディスプレイ１５ａに画像データを出力する（Ｓ５９）。 The display terminal 15 detects whether the image data transmitted from the server device 57 or the refrigerators 100 and 200 has been taken in (S54). If it is determined that the image data has not been transmitted (S54, NO), the display terminal 15 connects to the Internet 56 (S55). If it does so, the image data memorize | stored in the server apparatus 57 or the refrigerator 100,200 will be taken in (S56), and image data will be transmitted to the display terminal 15 via the internet 56 (S57). The display terminal 15 detects whether the image data has been taken in from the server device 57 or the like (S54). When the image data is detected (S54, YES), the display terminal 15 waits for an image data calling operation (S58, NO). . If there is an image data call operation (S58, YES), the display terminal 15 outputs the image data to the display 15a (S59).
　ここで、表示端末１５から画像データが要求されたとき、サーバ装置５７等へのアクセスが集中していて、サーバ装置５７等からの画像データの送信が遅くなる場合を想定する。このような場合でも、上述した処理を行うことにより、画像データの要求と同時にリアルタイムに画像データをディスプレイ１５ａに表示させて、使用者が画像を確認することができる。したがって、買い物先で画像データが表示されるまで、長時間待つような事態を避けることができ、買い物時間を短縮することができる。 Here, it is assumed that when image data is requested from the display terminal 15, access to the server device 57 or the like is concentrated, and transmission of the image data from the server device 57 or the like is delayed. Even in such a case, by performing the above-described processing, the image data can be displayed on the display 15a in real time simultaneously with the request for the image data, and the user can confirm the image. Therefore, a situation of waiting for a long time until the image data is displayed at the shopping destination can be avoided, and the shopping time can be shortened.
　また、表示端末１５から画像の事前送信要求があれば、サーバ装置５７等は、冷蔵庫１００，２００の扉１０が閉じられる度に、画像データを都度、表示端末１５に送信する設定としておくこともできる。さらに、表示端末１５を持っている使用者に対して、画像データが送信されたことを報知するように設定しておくことにより、使用者は、扉開閉が行われたことを、都度知ることができる。よって、使用者は、例えば扉開閉回数が多くなって電力消費量が多くなりそうな場合には、自宅に電話して子供等に冷蔵庫１００，２００の使用を控えるように話をすることができ、省エネルギー性に関する利便性を向上させることもできる。 Further, if there is an image pre-transmission request from the display terminal 15, the server device 57 or the like may be set to transmit image data to the display terminal 15 each time the doors 10 of the refrigerators 100 and 200 are closed. it can. Furthermore, by setting the user having the display terminal 15 to notify that the image data has been transmitted, the user can know that the door has been opened and closed each time. Can do. Therefore, for example, when the door opening / closing frequency increases and the power consumption is likely to increase, the user can call his / her home and talk to the children to refrain from using the refrigerators 100 and 200. In addition, convenience related to energy saving can be improved.
　２－５．画像データ等の送受信経路の切換
　図２９は、本発明の実施の形態に係る冷蔵庫システム５０における、表示端末１５の通信経路選択時のディスプレイ表示を示す図である。 2-5. Switching of transmission / reception paths for image data and the like FIG. 29 is a diagram showing a display display when the communication path of display terminal 15 is selected in refrigerator system 50 according to the embodiment of the present invention.
　画像データの送受信の流れは、すでに述べたとおりであるが、ここでは、通信の経路を変更して画像データの取得を迅速化する例について説明する。 The flow of image data transmission / reception is as described above. Here, an example of changing the communication path to speed up the acquisition of image data will be described.
　具体的には、使用者が、表示端末１５の通信を、ルータ装置５５を介してゲートウェイ装置５４と直接行うか、または、インターネット５６を介してサーバ装置５７と行うか、選択可能としている。 Specifically, the user can select whether the communication of the display terminal 15 is performed directly with the gateway device 54 via the router device 55 or with the server device 57 via the Internet 56.
　図２９に示したように、選択ボタン７０，７１は、表示端末１５のディスプレイ１５ａに表示される、通信経路の選択ボタンである。選択ボタン７０は、表示端末１５を、ルータ装置５５、およびゲートウェイ装置５４を介して冷蔵庫１００，２００に直接接続する「ダイレクト」選択ボタンである。選択ボタン７１は、表示端末１５を、インターネット５６を介してサーバ装置５７、または冷蔵庫１００，２００と接続する「サーバ」選択ボタンである。データ選択ボタン７２，７３は、呼び出すデータを選択するためのデータ選択ボタンである。データ選択ボタン７２は、食品の画像データを選択するための画像データボタンであり、データ選択ボタン７３は、扉開閉回数等の省エネルギー性に関連するデータを選択するための他データボタンである。表示端末１５は、送信ボタン７４も有している。 As shown in FIG. 29, the selection buttons 70 and 71 are communication path selection buttons displayed on the display 15a of the display terminal 15. The selection button 70 is a “direct” selection button for directly connecting the display terminal 15 to the refrigerators 100 and 200 via the router device 55 and the gateway device 54. The selection button 71 is a “server” selection button that connects the display terminal 15 to the server device 57 or the refrigerators 100 and 200 via the Internet 56. The data selection buttons 72 and 73 are data selection buttons for selecting data to be called. The data selection button 72 is an image data button for selecting image data of food, and the data selection button 73 is another data button for selecting data related to energy saving such as the number of times of opening and closing the door. The display terminal 15 also has a send button 74.
　「ダイレクト」選択ボタン７０が選択されると、表示端末１５には「ダイレクト」通信が設定される。「ダイレクト」通信が設定されている状態で、使用者が送信ボタン７４に触れると、表示端末１５の画像データ要求信号が、表示端末１５からルータ装置５５を介して、直接、ゲートウェイ装置５４に送信される。ゲートウェイ装置５４は、受信したデータ要求信号を、冷蔵庫１００，２００の無線アダプタ５３に送信する。無線アダプタ５３は、画像データ要求信号を受信すると、冷蔵庫１００，２００のコントローラ５９にこれを送信する。冷蔵庫１００，２００のコントローラ５９は、画像データ要求信号を受信すると、記憶部６０に保存された画像データを読み込み、無線アダプタ５３、ルータ装置５５を介して表示端末１５に画像データを送信する。 When the “direct” selection button 70 is selected, “direct” communication is set in the display terminal 15. When the user touches the send button 74 while “direct” communication is set, the image data request signal of the display terminal 15 is transmitted directly from the display terminal 15 to the gateway device 54 via the router device 55. Is done. The gateway device 54 transmits the received data request signal to the wireless adapter 53 of the refrigerators 100 and 200. When the wireless adapter 53 receives the image data request signal, the wireless adapter 53 transmits it to the controller 59 of the refrigerator 100 or 200. When receiving the image data request signal, the controller 59 of the refrigerator 100 or 200 reads the image data stored in the storage unit 60 and transmits the image data to the display terminal 15 via the wireless adapter 53 and the router device 55.
　ここで、使用者の有する表示端末１５が、図１５の二点鎖線で示したように、住居Ａ内に位置する場合、広義には、表示端末１５がルータ装置５５と直接通信できる位置に存在する場合を想定する。この場合、表示端末１５は、ルータ装置５５を介してゲートウェイ装置５４と通信し、冷蔵庫１００，２００の記憶部６０から画像データを直接取得することができる。 Here, when the display terminal 15 possessed by the user is located in the residence A as shown by a two-dot chain line in FIG. 15, in a broad sense, the display terminal 15 exists at a position where the display terminal 15 can directly communicate with the router device 55. Assume that In this case, the display terminal 15 can communicate with the gateway device 54 via the router device 55 and directly acquire image data from the storage unit 60 of the refrigerators 100 and 200.
　これによって、インターネット５６へのアクセス集中による回線の混雑等により、表示端末１５への使用者の操作に対して、画像データの送信レスポンスに遅延が発生するような場合には、使用者は、表示端末１５を「ダイレクト」通信に切り替えることができる。これにより、インターネット５６の回線の混雑等を受けずに画像データの取得を行うことができる。よって、使用者は待ち時間なしにリアルタイムに表示端末１５のディスプレイに画像を表示させ、貯蔵庫内の食品状況を確認することができる。 As a result, when a delay occurs in the image data transmission response to the user's operation on the display terminal 15 due to congestion of the line due to concentration of access to the Internet 56, the user The terminal 15 can be switched to “direct” communication. Thereby, it is possible to acquire image data without receiving congestion of the Internet 56 line. Therefore, the user can display an image on the display of the display terminal 15 in real time without waiting time, and can confirm the food state in the storage.
　一方で、使用者が、図１５の実線に示したように、住居Ａ外に位置する場合、広義には、表示端末１５がルータ装置５５と直接通信できない位置に存在する場合を想定する。この場合、使用者が「サーバ」選択ボタン７１に触れることによって、表示端末１５は、インターネット５６を介してサーバ装置５７と通信を行い、冷蔵庫１００，２００の画像データを読み込む。すなわち、使用者は、住居Ａ外にいる場合、「サーバ」選択ボタン７１に触れて「サーバ」通信を設定することにより、遠隔地に居ても表示端末１５によって冷蔵庫の画像データを取得し、食品の収納状況を知ることができる。 On the other hand, when the user is located outside the residence A as shown by the solid line in FIG. 15, it is assumed in a broad sense that the display terminal 15 is present at a position where it cannot directly communicate with the router device 55. In this case, when the user touches the “server” selection button 71, the display terminal 15 communicates with the server device 57 via the Internet 56 and reads the image data of the refrigerators 100 and 200. That is, when the user is outside the residence A, the user sets the “server” communication by touching the “server” selection button 71 to obtain the image data of the refrigerator by the display terminal 15 even in a remote place, You can know the food storage status.
　以上述べたように、本実施の形態における冷蔵庫システム５０は、使用者が、「ダイレクト」通信、および「サーバ」通信のうち、いずれか一方を選択することができる。使用者は、住居Ａ内に居るような場合には「ダイレクト」通信を選択することにより、インターネット回線の混雑に影響されることなく快適な状態で画像を見ることができる。 As described above, in the refrigerator system 50 according to the present embodiment, the user can select either “direct” communication or “server” communication. When the user is in the house A, the user can view the image in a comfortable state without being affected by the congestion of the Internet line by selecting “direct” communication.
　以上、具体的な構成を例示して、本実施の形態の冷蔵庫１００，２００、および冷蔵庫システム５０を説明したが、本発明は上記構成に限定されるものではない。 As mentioned above, although the specific structure was illustrated and the refrigerator 100,200 of this Embodiment and the refrigerator system 50 were demonstrated, this invention is not limited to the said structure.
　例えば、上述の例においては、表示端末１５と、冷蔵庫１００，２００の無線アダプタ５３、およびインターネット５６との通信経路上にゲートウェイ装置５４を介在させる例を示したが、このゲートウェイ装置５４は必ずしも必要ではない。例えば、ルータ装置５５を介して、直接、表示端末１５と、冷蔵庫１００，２００の無線アダプタ５３とが、インターネット５６を通じて通信するように構成することもできる。これによって、システム構成の簡素化を図ることができる。 For example, in the above-described example, the gateway device 54 is interposed on the communication path between the display terminal 15, the wireless adapter 53 of the refrigerators 100 and 200, and the Internet 56. However, the gateway device 54 is not necessarily required. is not. For example, the display terminal 15 and the wireless adapter 53 of the refrigerators 100 and 200 can be configured to communicate directly via the Internet 56 via the router device 55. As a result, the system configuration can be simplified.
　また、上述の例では、使用者が住居Ａ外に居るときには、サーバ装置５７から画像データを取得するようにしたが、サーバ装置５７を介さずに、表示端末１５から、インターネット５６を介して、ルータ装置５５、およびゲートウェイ装置５４と通信し、冷蔵庫１００，２００の記憶部６０に記憶されている画像データを冷蔵庫１００，２００から直接取り込むように構成してもよい。この場合、および、「ダイレクト」通信を行う場合には、冷蔵庫１００，２００の記憶部６０で画像の結合処理を行って、結合処理後の画像データを送信することが好ましい。 Further, in the above example, when the user is outside the residence A, the image data is acquired from the server device 57. However, instead of via the server device 57, the display terminal 15 via the Internet 56 is used. You may comprise so that it may communicate with the router apparatus 55 and the gateway apparatus 54, and the image data memorize | stored in the memory | storage part 60 of the refrigerator 100,200 are directly taken in from the refrigerator 100,200. In this case and when “direct” communication is performed, it is preferable to perform image combination processing in the storage unit 60 of the refrigerators 100 and 200 and transmit the image data after the combination processing.
　さらに、上述の例では、表示端末１５のディスプレイ１５ａに、「ダイレクト」選択ボタン７０と「サーバ」選択ボタン７１とを表示させて、使用者が「ダイレクト」通信と「サーバ」通信との選択を行う場合を例示した。しかしながら、これを、表示端末１５に、ルータ装置５５からの電波をキャッチすると自動的に「ダイレクト」通信に切り替わる機能を持たせ、「ダイレクト」通信が自動的に選択されるように構成してもよい。これにより、使い勝手を向上させることができる。 Further, in the above-described example, the “direct” selection button 70 and the “server” selection button 71 are displayed on the display 15 a of the display terminal 15, and the user selects “direct” communication or “server” communication. The case of performing was illustrated. However, this may be configured such that the display terminal 15 has a function of automatically switching to “direct” communication when the radio wave from the router device 55 is caught, and “direct” communication is automatically selected. Good. Thereby, usability can be improved.
　以上、説明してきたように、本実施の形態における、冷蔵庫１００，２００、および冷蔵庫システム５０は種々の作用効果を奏する。本実施の形態の、カメラおよび庫内照明灯の設置構成によれば、貯蔵庫内の食品を良好に撮影でき、食品の判別を容易に行うことができる。 As described above, the refrigerators 100 and 200 and the refrigerator system 50 according to the present embodiment have various functions and effects. According to the installation configuration of the camera and the interior illumination lamp according to the present embodiment, the food in the storage can be photographed well, and the food can be easily identified.
　すなわち、本実施の形態の冷蔵庫１００，２００において、カメラ３５－１，３５－２は、貯蔵庫の前面側から貯蔵庫内の食品を撮影する。このとき、庫内照明灯３４－１，３４－２も貯蔵庫の前面側に設けられており、貯蔵庫内の食品を、カメラ３５－１，３５－２による撮影方向と同じ前面側から照射している。したがって、その撮影画像は、庫内照明灯３４－１，３４－２が貯蔵庫の奥壁に設けられている場合のような暗さや見にくさはなく、鮮明な画像となる。また、撮影した画像を明るくし、鮮明にする画像処理をサーバ装置５７にて行う必要もなくなる。 That is, in refrigerators 100 and 200 of the present embodiment, cameras 35-1 and 35-2 photograph food in the storage from the front side of the storage. At this time, the interior lighting lamps 34-1 and 34-2 are also provided on the front side of the storage, and the food in the storage is irradiated from the front side in the same direction as the photographing direction by the cameras 35-1 and 35-2. Yes. Therefore, the photographed image is not as dark or difficult to see as when the interior lighting lamps 34-1 and 34-2 are provided on the inner wall of the storage, and becomes a clear image. Further, it is not necessary to perform image processing to brighten and sharpen the captured image in the server device 57.
　また、カメラ３５－１，３５－２と庫内照明灯３４－１，３４－２とは、棚板３０－１～３０－４の前端よりも前方側に位置するように設けられている。これにより、カメラ３５－１，３５－２で撮影された貯蔵庫内の画像は、使用者が冷蔵庫１００，２００の扉１０を開いて実際に見る状態と同じとなる。したがって、使用者は、表示端末１５に画像データを表示させたとき、何ら違和感を持つことなく貯蔵庫内の食品状況を確認することができる。しかも、庫内照明灯３４－１，３４－２は、棚板３０－１～３０－４の前端前方から棚板上の食品を照らすので、棚板３０－１～３０－４の前端部に載置されている食品も明るく、かつ、鮮明に撮影することができる。 Further, the cameras 35-1, 35-2 and the interior lighting lamps 34-1, 34-2 are provided in front of the front ends of the shelf plates 30-1 to 30-4. As a result, the images in the storage taken by the cameras 35-1 and 35-2 are the same as when the user actually opened the doors 10 of the refrigerators 100 and 200. Therefore, when the user displays the image data on the display terminal 15, the user can check the state of food in the storage without any sense of incongruity. In addition, the interior lamps 34-1 and 34-2 illuminate food on the shelf from the front of the front of the shelf 30-1 to 30-4, so that the front end of the shelf 30-1 to 30-4 is illuminated. The food on the board can be photographed brightly and clearly.
　また、カメラ３５－１，３５－２は、冷蔵庫１００，２００の扉１０内面部に設けられるとともに、貯蔵庫の左右方向の実質的な中央部に位置するように設けられている。したがって、カメラ３５－１，３５－２で撮影された画像を、使用者が冷蔵庫１００，２００の扉１０を開いて実際に見る状態に、より近い形とすることができる。加えて、カメラ３５－１，３５－２と棚板上の食品との間の距離を大きくとることにより、貯蔵庫内の広い範囲を撮影することができ、より広範囲の食品の収納状況を表示端末１５で確認することが可能となる。 Further, the cameras 35-1 and 35-2 are provided on the inner surface of the door 10 of the refrigerators 100 and 200, and are provided so as to be located at the substantial center in the left-right direction of the storage. Therefore, the images taken by the cameras 35-1 and 35-2 can be made closer to a state in which the user opens the doors 10 of the refrigerators 100 and 200 and actually sees them. In addition, by taking a large distance between the cameras 35-1 and 35-2 and the food on the shelf, it is possible to photograph a wide range in the storage, and display a wider range of food storage status display terminals 15 can be confirmed.
　さらに、扉内面部にカメラ３５－１，３５－２を設けた場合に比較的写りにくくなる貯蔵庫の最上奥部には、コンプレッサ１９を設けてその最上奥部を前方にせり出させている。これにより、この部分も確実に撮影することができ、コンプレッサ１９を本体上部に設けて本体下部の収納容積の向上を図りつつ、カメラ３５－１，３５－２による撮影を良好なものとすることができる。 Furthermore, a compressor 19 is provided at the uppermost part of the storage that is relatively difficult to be seen when the cameras 35-1 and 35-2 are provided on the inner surface of the door, and the uppermost part protrudes forward. As a result, this part can also be photographed reliably, and the compressor 19 is provided in the upper part of the main body to improve the storage capacity of the lower part of the main body, and the photographing with the cameras 35-1 and 35-2 is made favorable. Can do.
　また、カメラ３５－１，３５－２は、扉内面の扉ポケット３３－１，３３－２の前後方向の実質的な中央部分に位置するように設けられている。よって、貯蔵庫内の食品のみならず、扉ポケット３３－１，３３－２に収納されている食品、例えば牛乳パック等もその一部を撮影することができる。使用者は、自分で収納したものについては、その一部が写っているだけでもそれが何であるかを認識することができる。よって、貯蔵庫内のほぼ全ての食品を撮影することが可能となる。 Further, the cameras 35-1 and 35-2 are provided so as to be positioned at a substantial central portion in the front-rear direction of the door pockets 33-1 and 33-2 on the inner surface of the door. Therefore, not only the food in the storage, but also a part of the food stored in the door pockets 33-1 and 33-2, such as a milk pack, can be photographed. The user can recognize what he / she has stored even if only a part of it is shown. Therefore, it is possible to photograph almost all food items in the storage.
　また、カメラとして、図９Ａに示したように、収納容器専用のカメラ３５－３を設けることにより、収納容器３１内の食品を鮮明に撮影することができる。さらに、図９Ｂで示したように、カメラ３５－２を上下動可能にしたり、図９Ｃに示したように上下回動自在にしたりすることによって、収納容器３１内の食品も二つのカメラ、すなわち、比較的少ないカメラ数で効率よく撮影することができる。 Further, as shown in FIG. 9A, by providing a camera 35-3 dedicated to the storage container as a camera, the food in the storage container 31 can be clearly photographed. Furthermore, as shown in FIG. 9B, by making the camera 35-2 movable up and down or turning up and down as shown in FIG. It is possible to shoot efficiently with a relatively small number of cameras.
　一方、庫内照明灯３４－１，３４－２は、図７、および図１０から明らかなように、カメラ３５－１，３５－２より奥側の位置に設けられ、庫内照明灯３４－１，３４－２の光が、直接カメラ３５－１，３５－２の撮影部に入り込まないように設けられている。これにより、庫内照明灯３４－１，３４－２の光がカメラ３５－１，３５－２に入ってカメラ３５－１，３５－２の写りが悪くなることを防止でき、常に良好な画像を得ることができる。これは、庫内照明灯３５－１，３５－２のカメラ側に遮光部を設けたり、または、庫内照明灯３４－１，３４－２を構成するＬＥＤ等の光原を斜め後方向きに傾斜配置する等の構成を採用したりすることによっても同様の効果を得ることができる。 On the other hand, as is apparent from FIGS. 7 and 10, the interior lighting lamps 34-1 and 34-2 are provided at positions farther from the cameras 35-1 and 35-2. 1 and 34-2 are provided so as not to directly enter the photographing units of the cameras 35-1 and 35-2. As a result, it is possible to prevent the light from the interior lighting lamps 34-1 and 34-2 from entering the cameras 35-1 and 35-2 and the image of the cameras 35-1 and 35-2 from being deteriorated. Can be obtained. This can be achieved by providing a light-shielding portion on the camera side of the interior lighting lamps 35-1 and 35-2, or by illuminating light sources such as LEDs constituting the interior lighting lamps 34-1 and 34-2 obliquely backward. The same effect can be obtained by adopting a configuration such as an inclined arrangement.
　また、庫内照明灯３４－１，３４－２は、貯蔵庫内の照度が１５０ルックス～２００ルックスであり、このままの照度で撮影すると、図１８の撮影動作において説明したように、食品が白っぽく写り、判別がしにくいものとなる。そのため、本実施の形態では、照度を低下させて撮影を行う構成としている。これにより、ＣＣＤカメラやＣＭＯＳカメラを用いても、適度な明るさで鮮明な撮影が可能となる。この庫内照明灯３４－１，３４－２の照度は、扉１０を閉じて、または、扉１０を開いて撮影するときだけ、通常時よりも低い照度となるように制御部によって制御するようにしてもよい。 In addition, the illumination lamps 34-1 and 34-2 have an illuminance in the storage of 150 lux to 200 lux. When photographing with this illuminance, the food appears whitish as described in the photographing operation of FIG. It becomes difficult to distinguish. For this reason, in this embodiment, a configuration is adopted in which shooting is performed with reduced illuminance. As a result, even if a CCD camera or a CMOS camera is used, clear shooting can be performed with appropriate brightness. The illuminance of the interior lighting lamps 34-1 and 34-2 is controlled by the control unit so that the illuminance is lower than that in the normal state only when the door 10 is closed or the door 10 is opened for photographing. It may be.
　このような制御をすることによって、撮影しない通常時は、これまで通りの照度を保って庫内を見やすくしつつ、鮮明な撮影を可能とすることができる。この照度の低下は、例えば庫内照明灯３４－１，３４－２のいずれか一方、またはその両方の庫内照明灯３４－１，３４－２の一部を消灯させたり、両方の庫内照明灯３４－１，３４－２の照度を低下させたりする等、種々考えられ、適宜選択することができる。 By performing such control, it is possible to make clear shooting possible during normal times when shooting is not being performed while maintaining the same illuminance as before and making the inside of the cabinet easy to see. This decrease in illuminance is caused, for example, by turning off one of the interior lighting lamps 34-1 and 34-2, or a part of both interior lighting lamps 34-1 and 34-2, Various considerations such as lowering the illuminance of the illuminating lamps 34-1 and 34-2 are possible and can be selected as appropriate.
　また、カメラ３５－１，３５－２で撮影された貯蔵庫内の画像は、それぞれのカメラ３５－１，３５－２の画像をサーバ装置５７に送信してサーバ装置５７、冷蔵庫１００，２００、または、表示端末１５内で結合処理し合成する。これにより画像の合成処理が容易になる。 Further, the images in the storage taken by the cameras 35-1 and 35-2 are transmitted to the server device 57 from the respective cameras 35-1 and 35-2, and the server device 57, the refrigerators 100 and 200, or Then, combining processing is performed in the display terminal 15. This facilitates image composition processing.
　すなわち、カメラ３５－１，３５－２は、棚板３０－１～３０－４の前端と対応する扉内面部、この例では、上段の棚板３０－１と三段目の棚板３０－３の前端と対応する扉内面部に設けられている。これにより、それぞれのカメラ３５－１，３５－２の撮影は、図３０における、線Ｚが境界線となるように、棚板３０－１，３０－３を中心として撮影が行われることとなる。 That is, the cameras 35-1 and 35-2 are door inner surfaces corresponding to the front ends of the shelf plates 30-1 to 30-4, in this example, the upper shelf plate 30-1 and the third shelf plate 30-. 3 is provided on the inner surface of the door corresponding to the front end. As a result, the respective cameras 35-1 and 35-2 are photographed around the shelf boards 30-1 and 30-3 so that the line Z in FIG. 30 becomes the boundary line. .
　図３０は、本発明の実施の形態に係る冷蔵庫システム５０において、画像が合成される例を示す図である。 FIG. 30 is a diagram illustrating an example in which images are combined in the refrigerator system 50 according to the embodiment of the present invention.
　二つのカメラ３５－１，３５－２で撮影された貯蔵庫内の画像データは、境界線Ｚとなる二段目の棚板３０－２部分で結合処理することができる。すなわち、図３０の「撮影生画像」に示すように、上下それぞれの画像には棚板３０－２が共通して写っているが、この「撮影生画像」の湾曲を修正し、「湾曲修正処理後画像」にした後、上下の画像に写っている共通の棚板３０－２を合致させれば貯蔵庫全体の撮影画像を合成することができる。 The image data in the storage taken by the two cameras 35-1 and 35-2 can be combined in the second shelf 30-2 portion that is the boundary line Z. That is, as shown in the “photographed raw image” in FIG. 30, the shelf plate 30-2 is shown in common in the upper and lower images. After making the “processed image”, the captured images of the entire storage can be synthesized by matching the common shelf board 30-2 shown in the upper and lower images.
　この結果、画像の結合処理時に棚板の上に置かれている各食品を食品ごとに位置合わせして結合させる、きわめて困難な補正処理をする必要がなくなるので、画像の結合処理は容易となる。よって、画像結合のための処理プログラムも簡素なものとすることができ、画像結合処理のためのサーバ装置５７、冷蔵庫１００，２００、または表示端末１５の制御部分の容量も大容量のものを用いる必要がなくなり、処理速度のスピーディ化に貢献できる。 As a result, it is not necessary to perform a very difficult correction process for aligning and combining the foods placed on the shelves at the time of the image combining process, so that the image combining process is facilitated. . Therefore, the processing program for image combination can be simplified, and the server device 57, the refrigerators 100 and 200, or the control portion of the display terminal 15 for image combination processing have a large capacity. This is unnecessary and can contribute to speeding up of processing speed.
　さらに、二つのカメラ３５－１，３５－２は、高さ調整ができない棚板３０－１、棚板３０－３の実質的な前方位置に設けられている。これにより、高さ調節可能な棚板３０－２の高さが変更された場合でも、画像の結合処理時に、棚板３０－２の高さに応じて結合処理する範囲を調整することで、容易に画像の結合処理を行うことが可能となる。 Furthermore, the two cameras 35-1 and 35-2 are provided substantially in front of the shelf plate 30-1 and the shelf plate 30-3 whose height cannot be adjusted. Thereby, even when the height of the shelf plate 30-2 whose height can be adjusted is changed, by adjusting the range to be combined according to the height of the shelf plate 30-2 at the time of image combining processing, Image combining processing can be easily performed.
　以上述べたように、本実施の形態における冷蔵庫１００，２００は、貯蔵庫と、貯蔵庫内の食品を撮影するカメラ３５－１，３５－２と、カメラ３５－１，３５－２で撮影された画像データを、インターネットを経由してサーバ装置５７に送信する通信部である無線アダプタ５３とを備える。さらに、カメラ３５－１，３５－２による撮影時に貯蔵庫内を照射する、貯蔵庫内に設けられた庫内照明灯３４－１，３４－２とを備えている。また、カメラ３５－１，３５－２、および庫内照明灯３４－１，３４－２が、貯蔵庫の前面開口側に配置されている。ここで、前面開口側、とは、貯蔵庫の前後方向の中心よりも前面開口側であることを意味するものとする。 As described above, the refrigerators 100 and 200 according to the present embodiment have the storage, the cameras 35-1 and 35-2 for capturing food in the storage, and the images captured by the cameras 35-1 and 35-2. The wireless adapter 53 is a communication unit that transmits data to the server device 57 via the Internet. Furthermore, the interior lighting lamps 34-1 and 34-2 provided in the storage are provided for irradiating the interior of the storage when photographing with the cameras 35-1 and 35-2. In addition, cameras 35-1 and 35-2 and interior illumination lamps 34-1 and 34-2 are arranged on the front opening side of the storage. Here, the front opening side means the front opening side from the center in the front-rear direction of the storage.
　このような構成により、庫内照明灯３４－１，３４－２で貯蔵庫内の食品を照射するとともに、庫内照明灯３４－１，３４－２によって照射する側から貯蔵庫内をカメラ３５－１，３５－２で撮影することになる。これにより、貯蔵庫内の食品を明るく、かつ、鮮明に撮影することができる。よって、貯蔵庫内の食品の判別が容易になり、しかも、食品判別を容易にするための画像処理をする必要もなくなって安価に実用化することができる。 With such a configuration, the food in the storage is irradiated with the interior lighting lamps 34-1 and 34-2, and the interior of the storage is illuminated from the side illuminated by the interior lighting lights 34-1 and 34-2 with the camera 35-1. , 35-2. Thereby, the food in the storage can be photographed brightly and clearly. Therefore, the food in the storage can be easily discriminated, and it is not necessary to perform image processing for facilitating the food discrimination, so that it can be put into practical use at a low cost.
　また、貯蔵庫は複数の棚板３０－１～３０－４を有し、カメラ３５－１，３５－２、および庫内照明灯３４－１，３４－２は、棚板３０－１～３０－４の前端よりも前方側に位置するように設けられている。 Further, the storage has a plurality of shelf plates 30-1 to 30-4, and the cameras 35-1 and 35-2 and the interior lighting lamps 34-1 and 34-2 are shelf plates 30-1 to 30-. 4 is provided so as to be positioned on the front side of the front end.
　これによって、カメラ３５－１，３５－２で撮影された貯蔵庫内の画像は、使用者が冷蔵庫１００，２００の扉を開いて実際に見る状態と同じとなる。よって、表示端末１５に表示させたときに、使用者は、何ら違和感を持つことなく、貯蔵庫内の食品状況を確認することができる。しかも、庫内照明灯３４－１，３４－２は、棚板３０－１～３０－４の前端の前方から棚板３０－１～３０－４上の食品を照らすので、棚板３０－１～３０－４の前端部に載置されている食品を、明るく、かつ鮮明に撮影することができる。 Thus, the images in the storage taken by the cameras 35-1 and 35-2 are the same as when the user actually opens the doors of the refrigerators 100 and 200. Therefore, when displayed on the display terminal 15, the user can check the state of food in the storage without any discomfort. In addition, since the interior lighting lamps 34-1 and 34-2 illuminate the food on the shelf boards 30-1 to 30-4 from the front of the front ends of the shelf boards 30-1 to 30-4, the shelf boards 30-1 The food placed on the front end of ~ 30-4 can be photographed brightly and clearly.
　また、カメラ３５－１，３５－２は、貯蔵庫の扉１０の内面部に設けられるとともに、庫内照明灯３４－１，３４－２は、貯蔵庫の開口縁両側壁部に設けられている。 The cameras 35-1 and 35-2 are provided on the inner surface of the storage door 10, and the interior lighting lights 34-1 and 34-2 are provided on both side walls of the opening edge of the storage.
　これによって、カメラ３５－１，３５－２を、貯蔵庫の左右の実質的な中央部に位置させることができる。よって、カメラ３５－１，３５－２で撮影された画像を、使用者が冷蔵庫１００，２００の扉１０を開いて実際に見る状態に近い形とすることができる。また、棚板３０－１～３０－４上の食品との距離を大きくとって、貯蔵庫内の広い範囲を撮影することができ、より広範囲の食品の収納状況を表示端末１５で確認することが可能となる。 This makes it possible to position the cameras 35-1 and 35-2 at the substantial center of the left and right of the storage. Therefore, it is possible to make the images taken by the cameras 35-1 and 35-2 close to the state in which the user actually opens the doors 10 of the refrigerators 100 and 200. Further, it is possible to photograph a wide range in the storage by taking a large distance from the food on the shelf plates 30-1 to 30-4, and confirming the storage status of a wider range of food on the display terminal 15. It becomes possible.
　また、カメラ３５－１，３５－２は、扉１０の内面部に設けられた扉ポケット３３－１～３３－８の前後方向の実質的な中央位置に設けられている。 Further, the cameras 35-1 and 35-2 are provided at substantially central positions in the front-rear direction of the door pockets 33-1 to 33-8 provided on the inner surface of the door 10.
　これにより、扉ポケット３３－１～３３－８に収納された牛乳パックのような食品もカメラ３５－１，３５－２で写すことが可能となり、貯蔵庫内の、さらに広い範囲を撮影できる。 This enables foods such as milk cartons stored in the door pockets 33-1 to 33-8 to be photographed by the cameras 35-1 and 35-2, and a wider range in the storage can be photographed.
　また、庫内照明灯３４－１，３４－２は、庫内照明灯３４－１，３４－２の直接光がカメラ３５－１，３５－２に入り込まない位置に設けられている、またはカメラ３５－１，３５－２に直接光が入り込まないように構成されている。 The interior lighting lamps 34-1 and 34-2 are provided at positions where direct light from the interior lighting lamps 34-1 and 34-2 does not enter the cameras 35-1 and 35-2, or the camera It is configured so that light does not enter directly into 35-1 and 35-2.
　これによって、庫内照明灯３４－１，３４－２の光がカメラ３５－１，３５－２に入って、カメラ３５－１，３５－２の写りが悪くなることを防止することができ、常に良好な画像を得ることができる。 As a result, it is possible to prevent the light from the interior lighting lamps 34-1 and 34-2 from entering the cameras 35-1 and 35-2 and the image of the cameras 35-1 and 35-2 from being deteriorated. A good image can always be obtained.
　また本実施の形態における、冷蔵庫システム５０は、上述したいずれかの形態の冷蔵庫１００，２００と、冷蔵庫１００，２００の貯蔵庫内の画像を要求する画像要求信号を送信する表示端末とを備えている。また、冷蔵庫１００，２００の通信部からインターネットを介して送信される画像データを記憶するとともに、表示端末１５からインターネットを介して送信される画像要求信号を受けて、表示端末１５に画像データを送信するサーバ装置５７を備えている。 Moreover, the refrigerator system 50 in this Embodiment is provided with the refrigerator 100,200 of any one of the above-described forms and a display terminal that transmits an image request signal for requesting an image in the storage of the refrigerator 100,200. . Further, the image data transmitted from the communication units of the refrigerators 100 and 200 is stored through the Internet, and the image request signal transmitted from the display terminal 15 through the Internet is received, and the image data is transmitted to the display terminal 15. The server device 57 is provided.
　これにより、使用者は、冷蔵庫１００，２００内の食品状況を何時、何処からでも鮮明な形で確認することができるので、食料品の買い忘れ等を防止することができ、使い勝手の良いシステムを構成することができる。 As a result, the user can check the state of food in the refrigerators 100 and 200 in a clear form from anytime and anywhere, so that it is possible to prevent forgetting to buy food, etc. Can be configured.
　さらに、サーバ装置５７は、表示端末１５から貯蔵庫内の画像の事前送信要求があると、冷蔵庫内の画像データを、事前に表示端末に送信するように構成されている。 Furthermore, the server device 57 is configured to transmit the image data in the refrigerator to the display terminal in advance when there is a request for transmitting the image in the storage from the display terminal 15 in advance.
　これによって、サーバ装置５７にアクセスが集中して応答が遅い場合であっても、表示端末１５を操作すれば直ちに貯蔵庫内の画像データを確認することができ、使い勝手を一段と向上させることができる。 Thereby, even when the access is concentrated on the server device 57 and the response is slow, if the display terminal 15 is operated, the image data in the storage can be immediately confirmed, and the usability can be further improved.
　以上述べたように、本発明によれば、貯蔵庫内の食品を明るく、かつ、鮮明に撮影することができ、貯蔵庫内の食品の判別を容易に行うことができる、という格別な効果を奏することができる。よって、本発明は、貯蔵庫内の食品を撮影して収納状況を表示端末等で確認することのできる冷蔵庫、および冷蔵庫システム等として有用である。例えば、家庭用の冷蔵庫はもちろん、業務用、例えばコンビニ等のチェーン店の冷蔵庫（冷凍庫を含む）にも本発明を適用して、サーバ装置を備えたコンビニ本部において、各コンビニの冷蔵庫内の食品状況を確認し、食品を自動納品することができる。また、工場や研究所等の各施設に設置されている冷蔵庫内の食品や品物等を、資材部で確認し、足りないものを自動納品したりすることも可能である。 As described above, according to the present invention, the food in the storage can be brightly and clearly photographed, and there is an extraordinary effect that the food in the storage can be easily identified. Can do. Therefore, this invention is useful as a refrigerator, a refrigerator system, etc. which can image | photograph the foodstuff in a store | warehouse | chamber and can confirm a storage condition with a display terminal etc. For example, the present invention is applied not only to household refrigerators but also to commercial refrigerators (including freezers) for chain stores such as convenience stores, and in the convenience store headquarters equipped with a server device, food in the refrigerators of each convenience store You can check the situation and deliver food automatically. It is also possible to check the food and goods in the refrigerator installed in each facility such as a factory or a laboratory in the material department and automatically deliver the missing items.
　１　　冷蔵庫本体
　２　　外箱
　３　　内箱
　４　　断熱材
　５　　冷蔵室
　６　　切替室
　７　　製氷室
　８　　冷凍室
　９　　野菜室
　１０～１４　　扉
　１０ａ　　外被パネル
　１０ａ－１　　ガラス板
　１０ａ－２　　マジックミラー
　１０ｂ　　内側板
　１０ｂ－１，１０ｂ－２　　隆起壁部
　１５　　表示端末
　１５ａ　　ディスプレイ
　１６　　冷却室
　１７　　冷却器
　１８　　送風ファン
　１９　　コンプレッサ
　２０　　放熱パイプ
　２１　　キャピラリーチューブ
　２２　　ダンパ
　２３　　収納枠体
　２４　　端末保持体
　２５　　タッチパネル
　２６　　隙間
　２７　　枠体
　２８　　凹部
　２９，２９ａ　　スモークシート
　３０－１～３０－４　　棚板
　３１　　収納容器
　３２－１～３２－３　　側壁凸部
　３３－１～３３－８　　扉ポケット
　３４－１，３４－２　　庫内照明灯
　３５－１，３５－２，３５－３　　カメラ
　３６　　センターピラー
　４１　　カメラモジュール
　５０　　冷蔵庫システム
　５３　　無線アダプタ（通信部）
　５３ａ　　「接続」ボタン
　５４　　ゲートウェイ装置
　５５　　ルータ装置
　５６　　インターネット
　５７　　サーバ装置
　５８　　インターフェイス
　５９　　コントローラ
　６０　　記憶部
　６１　　扉開閉検出部
　６２　　ファン駆動回路
　６３　　コンプレッサ駆動回路
　６４　　交流電源
　６５　　サーバ用インターフェイス
　６６　　サーバ制御部
　６７　　データ記憶部
　７０，７１　　選択ボタン
　７２，７３　　データ選択ボタン
　７４　　送信ボタン
　１００，２００　　冷蔵庫 DESCRIPTION OF SYMBOLS 1 Refrigerator main body 2 Outer box 3 Inner box 4 Heat insulating material 5 Refrigeration room 6 Switching room 7 Ice making room 8 Freezing room 9 Vegetable room 10-14 Door 10a Cover panel 10a-1 Glass plate 10a-2 Magic mirror 10b Inner plate 10b- DESCRIPTION OF SYMBOLS 1,10b-2 Raised wall part 15 Display terminal 15a Display 16 Cooling chamber 17 Cooler 18 Blower fan 19 Compressor 20 Radiation pipe 21 Capillary tube 22 Damper 23 Storage frame body 24 Terminal holding body 25 Touch panel 26 Gap 27 Frame body 28 Recessed part 29 29a Smoke sheet 30-1 to 30-4 Shelf plate 31 Storage container 32-1 to 32-3 Side wall convex portion 33-1 to 33-8 Door pocket 34-1 and 34-2 Interior lamp 35-1, 35-2, 35-3 Camera 36 Center pillar 41 Camera module Le 50 refrigerator system 53 wireless adapter (communication unit)
53a “Connect” button 54 Gateway device 55 Router device 56 Internet 57 Server device 58 Interface 59 Controller 60 Storage unit 61 Door open / close detection unit 62 Fan drive circuit 63 Compressor drive circuit 64 AC power supply 65 Server interface 66 Server control unit 67 Data storage Section 70, 71 Selection button 72, 73 Data selection button 74 Send button 100, 200 Refrigerator

Claims (8)

  1. 貯蔵庫と、
    前記貯蔵庫内の食品を撮影するカメラと、
    前記カメラで撮影された画像データを、インターネットを経由してサーバ装置に送信する通信部と、
    前記カメラによる撮影時に前記貯蔵庫内を照射する、前記貯蔵庫内に設けられた庫内照明灯とを備え、
    前記カメラ、および前記庫内照明灯が、前記貯蔵庫の前面開口側に配置された
    冷蔵庫。     A storage,
    A camera for photographing food in the storage;
    A communication unit that transmits image data captured by the camera to a server device via the Internet;
    Irradiating the inside of the storage at the time of photographing with the camera, and an interior lighting lamp provided in the storage,
    The refrigerator in which the camera and the interior lamp are arranged on the front opening side of the storage.
  2. 前記貯蔵庫は、複数の棚板を有し、
    前記カメラ、および前記庫内照明灯は、前記複数の棚板の前端よりも前方側に位置するように設けられた
    請求項１記載の冷蔵庫。     The storage has a plurality of shelf boards,
    The refrigerator according to claim 1, wherein the camera and the interior lighting are provided so as to be positioned in front of the front ends of the plurality of shelf boards.
  3. 前記カメラは、前記貯蔵庫の扉内面部に設けられ、
    前記庫内照明灯は、前記貯蔵庫の開口縁両側壁部に設けられた
    請求項１または請求項２に記載の冷蔵庫。     The camera is provided on the inner surface of the storage door.
    The refrigerator according to claim 1 or 2, wherein the interior lamp is provided on both side walls of the opening edge of the storage.
  4. 前記カメラは、前記扉内面部に設けられた扉ポケットの、前後方向の実質的な中央位置に設けられた
    請求項３記載の冷蔵庫。     The refrigerator according to claim 3, wherein the camera is provided at a substantially central position in a front-rear direction of a door pocket provided on the inner surface of the door.
  5. 前記庫内照明灯は、前記庫内照明灯の直接光が前記カメラに入り込まない位置に設けられた
    請求項１から請求項４までのいずれか１項に記載の冷蔵庫。     The refrigerator according to any one of claims 1 to 4, wherein the internal lighting is provided at a position where direct light from the internal lighting does not enter the camera.
  6. 前記庫内照明灯は、前記カメラに直接光が入り込まないように構成された
    請求項１から請求項４までのいずれか１項に記載の冷蔵庫。     The refrigerator according to any one of claims 1 to 4, wherein the interior illumination lamp is configured such that light does not directly enter the camera.
  7. 請求項１から請求項６までのいずれか１項に記載の冷蔵庫と、
    前記冷蔵庫の前記貯蔵庫内の画像を要求する画像要求信号を送信する表示端末と、
    前記冷蔵庫の前記通信部から前記インターネットを介して送信される前記画像データを記憶するとともに、前記表示端末から前記インターネットを介して送信される前記画像要求信号を受けて、前記表示端末に前記画像データを送信する前記サーバ装置と、を備えた
    冷蔵庫システム。     The refrigerator according to any one of claims 1 to 6,
    A display terminal for transmitting an image request signal for requesting an image in the storage of the refrigerator;
    The image data transmitted from the communication unit of the refrigerator via the Internet is stored, the image request signal transmitted from the display terminal via the Internet is received, and the image data is transmitted to the display terminal. A refrigerator system comprising: the server device that transmits
  8. 前記サーバ装置は、前記表示端末から前記貯蔵庫内の前記画像の事前送信要求があると、前記冷蔵庫内の前記画像データを、事前に前記表示端末に送信するように構成された
    請求項７に記載の冷蔵庫システム。     The said server apparatus is comprised so that the said image data in the said refrigerator may be transmitted to the said display terminal in advance, when there is a prior transmission request | requirement of the said image in the said storage from the said display terminal. Refrigerator system.
PCT/JP2014/001532 2013-03-29 2014-03-18 Refrigerator and refrigerator system WO2014156051A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201490000557.9U CN205245656U (en) 2013-03-29 2014-03-18 Freezer and freezer system
DE212014000095.5U DE212014000095U1 (en) 2013-03-29 2014-03-18 Refrigerator and fridge system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013071719 2013-03-29
JP2013-071719 2013-03-29

Publications (1)

Publication Number Publication Date
WO2014156051A1 true WO2014156051A1 (en) 2014-10-02

Family

ID=51623067

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/001532 WO2014156051A1 (en) 2013-03-29 2014-03-18 Refrigerator and refrigerator system

Country Status (4)

Country Link
JP (17) JP6402353B2 (en)
CN (1) CN205245656U (en)
DE (1) DE212014000095U1 (en)
WO (1) WO2014156051A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105222514A (en) * 2015-10-27 2016-01-06 合肥华凌股份有限公司 Mounting box and refrigerator
GB2545013A (en) * 2015-12-03 2017-06-07 Otegui Van Leeuw Jon Multifunctional refrigerator
CN110942711A (en) * 2018-09-21 2020-03-31 合肥海尔电冰箱有限公司 Display device for displaying refrigerator and display method thereof
US11009287B2 (en) * 2016-07-28 2021-05-18 Samsung Electronics Co., Ltd. Refrigerator
JPWO2021106029A1 (en) * 2019-11-25 2021-06-03
CN112984916A (en) * 2018-01-31 2021-06-18 日立环球生活方案株式会社 Refrigerator with a door

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6701281B2 (en) * 2013-03-12 2020-05-27 東芝ライフスタイル株式会社 Refrigerator, camera device, refrigerator door pocket, communication terminal, home appliance network system, internal image display program
JP6498866B2 (en) 2013-03-12 2019-04-10 東芝ライフスタイル株式会社 Refrigerator, camera device
JP6391943B2 (en) 2013-03-12 2018-09-19 東芝ライフスタイル株式会社 Refrigerator, camera device, internal image display program
JP6600145B2 (en) * 2015-03-25 2019-10-30 東芝ライフスタイル株式会社 Food management method and food management system
JP2016196981A (en) * 2015-04-03 2016-11-24 三菱電機株式会社 Storage shed management system and storage shed management method
JP6592970B2 (en) * 2015-06-02 2019-10-23 三菱電機株式会社 refrigerator
US10474987B2 (en) 2015-08-05 2019-11-12 Whirlpool Corporation Object recognition system for an appliance and method for managing household inventory of consumables
US11156970B2 (en) 2015-08-05 2021-10-26 Whirlpool Corporation Foodstuff sensing appliance
DE102015219492A1 (en) * 2015-10-08 2017-04-13 BSH Hausgeräte GmbH RF transmission path from independent waveguide structures
JP6324360B2 (en) * 2015-11-04 2018-05-16 三菱電機株式会社 Refrigerator and network system including the same
JP6655955B2 (en) * 2015-11-24 2020-03-04 三菱電機株式会社 Purchase support program and purchase support system
JP6818407B2 (en) * 2015-12-10 2021-01-20 三菱電機株式会社 Refrigerator, image management system and program in the refrigerator
KR20180094085A (en) 2015-12-14 2018-08-22 에이에스엠엘 네델란즈 비.브이. Membrane assembly
CN206890984U (en) * 2016-04-08 2018-01-16 三菱电机株式会社 Refrigerator
CN105783376B (en) * 2016-05-06 2018-10-12 青岛海尔股份有限公司 A kind of refrigerator compartment partition control method
JP6799958B2 (en) * 2016-07-20 2020-12-16 三菱電機株式会社 refrigerator
WO2018021229A1 (en) * 2016-07-27 2018-02-01 三菱電機株式会社 Simulation system, simulation method, and refrigerator
CN106123462B (en) * 2016-08-22 2019-03-12 青岛海尔股份有限公司 The production method of refrigerator door and the refrigerator door
JP2018050251A (en) * 2016-09-23 2018-03-29 シャープ株式会社 Monitoring system
EP3543630A4 (en) * 2016-11-21 2019-11-06 Mitsubishi Electric Corporation Refrigerator system
WO2018116390A1 (en) * 2016-12-21 2018-06-28 三菱電機株式会社 Refrigerator
JP6877529B2 (en) * 2017-03-03 2021-05-26 シャープ株式会社 How to make refrigerators and refrigerator doors
WO2018216234A1 (en) * 2017-05-26 2018-11-29 シャープ株式会社 Refrigerator
DE102017212316A1 (en) * 2017-07-19 2019-01-24 BSH Hausgeräte GmbH Household dishwasher, system with household dishwasher and server and method of operating a household dishwasher
DE102017214941A1 (en) 2017-08-25 2019-02-28 Dometic Sweden Ab Recreational vehicle, cooling device, control system and method of controlling the cooling device
JP7012261B2 (en) * 2017-10-06 2022-01-28 パナソニックＩｐマネジメント株式会社 refrigerator
JP7012262B2 (en) * 2017-10-06 2022-01-28 パナソニックＩｐマネジメント株式会社 refrigerator
JP7012263B2 (en) * 2017-10-06 2022-01-28 パナソニックＩｐマネジメント株式会社 refrigerator
WO2019082168A1 (en) 2017-10-27 2019-05-02 Dometic Sweden Ab Systems, methods, and apparatuses for providing communications between climate control devices in a recreational vehicle
JP6954005B2 (en) * 2017-10-30 2021-10-27 トヨタ自動車株式会社 vehicle
DE102018202631A1 (en) 2018-02-21 2019-08-22 BSH Hausgeräte GmbH Determine a free volume in a household refrigerator
KR102535152B1 (en) 2018-04-17 2023-05-22 삼성전자주식회사 Display device and method for controlling thereof
JP7191561B2 (en) * 2018-06-29 2022-12-19 シャープ株式会社 refrigerator
JP7039416B2 (en) * 2018-07-31 2022-03-22 東芝ライフスタイル株式会社 refrigerator
JP7313156B2 (en) * 2019-02-08 2023-07-24 三菱電機株式会社 refrigerator
CN111692830A (en) * 2019-03-13 2020-09-22 青岛海尔电冰箱有限公司 Control method of refrigerator and refrigerator adopting control method
JP2020194233A (en) * 2019-05-24 2020-12-03 沖電気工業株式会社 Image processing device, image processing program, and image processing method
EP4038588A4 (en) * 2019-10-04 2022-11-09 Ism Makine Elektrik Sanayi Ve Ticaret Anonim Sirketi A smart mini bar system and method thereof
JP2022035347A (en) * 2020-08-20 2022-03-04 日立グローバルライフソリューションズ株式会社 Method for processing image data in refrigerator and refrigerator
US11692769B2 (en) * 2020-11-17 2023-07-04 Haier Us Appliance Solutions, Inc. Inventory management system for a refrigerator appliance
JP2022093365A (en) * 2020-12-11 2022-06-23 クリナップ株式会社 Kitchen information presentation program
JP7084517B2 (en) * 2021-02-25 2022-06-14 東芝ライフスタイル株式会社 Food management method, food management system, refrigerator
JP7386485B2 (en) * 2021-03-25 2023-11-27 ダイキン工業株式会社 Information processing equipment and programs
US20230057240A1 (en) * 2021-08-17 2023-02-23 Haier Us Appliance Solutions, Inc. Four camera system for a refrigerator appliance
JP2023127906A (en) * 2022-03-02 2023-09-14 パナソニックＩｐマネジメント株式会社 Food material management system, food material management method, and program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000244906A (en) * 1999-02-19 2000-09-08 Electrolux:Ab System and method for obtaining information on contents in cabinet
JP2001216230A (en) * 2000-02-01 2001-08-10 Fuji Xerox Co Ltd Document processing method and device utilizing network
JP2003090673A (en) * 2001-09-17 2003-03-28 Hitachi Electronics Service Co Ltd Image display system of refrigerator contents
US20060096303A1 (en) * 2004-11-10 2006-05-11 Kavounas Gregory T Home refrigerator systems imaging their interior and methods
JP2007046834A (en) * 2005-08-09 2007-02-22 Funai Electric Co Ltd Article storage, article storage monitoring system and refrigerator monitoring system
WO2012117724A1 (en) * 2011-03-02 2012-09-07 パナソニック株式会社 Refrigerator

Family Cites Families (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4084866A (en) * 1976-11-03 1978-04-18 Kikuo Hayashi Door structure
JPS611346Y2 (en) * 1981-02-04 1986-01-17
JPH01302340A (en) * 1988-05-31 1989-12-06 Konica Corp Copy photographing device
JPH0545041A (en) * 1991-08-09 1993-02-23 Sharp Corp Device for controlling storage space in freezer-refrigerator
JPH0545042A (en) * 1991-08-09 1993-02-23 Sharp Corp Freezer-refrigerator with warning indicator
JPH109753A (en) * 1996-06-26 1998-01-16 Matsushita Refrig Co Ltd Food inventory control device for refrigerator-freezer
JP3041725U (en) * 1997-03-24 1997-10-03 株式会社メガチップス Monitoring device
JP3471201B2 (en) * 1997-09-05 2003-12-02 株式会社東芝 Imaging module and imaging device
JPH11270964A (en) * 1998-03-24 1999-10-05 Sanyo Electric Co Ltd Cooled storage chamber
JP3819655B2 (en) * 1999-11-16 2006-09-13 三洋電機株式会社 Portable device
JP2001256036A (en) * 2000-03-03 2001-09-21 Ever Prospect Internatl Ltd Method for transferring information with equipment, equipment with interactive function applying the same and life support system formed by combining equipment
JP2001294308A (en) * 2000-04-10 2001-10-23 Matsushita Electric Ind Co Ltd Article storage cabinet
JP2001317858A (en) * 2000-05-09 2001-11-16 Matsushita Refrig Co Ltd Refrigerator
JP2001349661A (en) * 2000-06-05 2001-12-21 Sharp Corp Refrigerator
JP3900808B2 (en) * 2000-08-28 2007-04-04 三菱電機株式会社 refrigerator
JP2002081818A (en) * 2000-09-05 2002-03-22 Hitachi Ltd Refrigerator
JP4731765B2 (en) * 2000-09-25 2011-07-27 キヤノン株式会社 Imaging apparatus, control method therefor, and program
JP2002236798A (en) * 2001-02-13 2002-08-23 Matsushita Refrig Co Ltd Device and method for managing food in refrigerator
JP2002243335A (en) * 2001-02-21 2002-08-28 Toshiba Corp Food preservation chamber, home network device, portable information terminal, food information provision server, menu information provision server, and information provision server containing in preservation chamber
JP2002251518A (en) * 2001-02-21 2002-09-06 Nec Corp Support system for cooking, and controller for foodstuff
JP2002267336A (en) * 2001-03-09 2002-09-18 Hitachi Ltd System for indicating contained article contained in chamber on portable phone, etc.
JP2002288361A (en) * 2001-03-27 2002-10-04 Ricoh Co Ltd System for providing menu preparation application service, its program and recording medium
JP2002295962A (en) * 2001-03-29 2002-10-09 Sanyo Electric Co Ltd Refrigerator
JP3738196B2 (en) * 2001-03-30 2006-01-25 三洋電機株式会社 refrigerator
JP2002340471A (en) * 2001-05-18 2002-11-27 Fujitsu General Ltd Refrigerator interior display system
JP2003189288A (en) * 2001-12-17 2003-07-04 Fuji Photo Film Co Ltd System for monitoring household appliance and system for monitoring refrigerator
JP2003185327A (en) * 2001-12-18 2003-07-03 Hitachi Ltd Food storage, food managing device and food managing method
AU5069202A (en) * 2002-01-17 2003-07-24 Lg Electronics Inc. Apparatus and method for controlling cool air in refrigerator
JP2004183987A (en) * 2002-12-04 2004-07-02 Hitachi Home & Life Solutions Inc Refrigerator
JP3095497U (en) * 2003-01-27 2003-07-31 春子 柳田 Refrigerator with information display function
JP4450562B2 (en) * 2003-03-26 2010-04-14 富士フイルム株式会社 Collection case
JP2005032188A (en) * 2003-07-11 2005-02-03 Nippon Telegr & Teleph Corp <Ntt> Cooking support system and method
JP2005202696A (en) * 2004-01-15 2005-07-28 Matsushita Electric Ind Co Ltd Refrigerator stock food management system, refrigerator and recipe server
JP2005274053A (en) * 2004-03-25 2005-10-06 Sanden Corp On-vehicle cold storage managing system
JP2006046771A (en) * 2004-08-04 2006-02-16 Hitachi Home & Life Solutions Inc Refrigerator
JP4002565B2 (en) * 2004-08-24 2007-11-07 埼玉日本電気株式会社 Portable terminal device and ambient environment detection method using portable terminal device
JP2006214644A (en) * 2005-01-07 2006-08-17 Matsushita Electric Ind Co Ltd Storage
JP2006275324A (en) * 2005-03-28 2006-10-12 Sanyo Electric Co Ltd Household food management system
JP2007046833A (en) * 2005-08-09 2007-02-22 Funai Electric Co Ltd Article storage, article storage monitoring system, and refrigerator monitoring system
JP2007113858A (en) * 2005-10-21 2007-05-10 Hitachi Appliances Inc Freezer-refrigerator
JP2007121963A (en) * 2005-10-31 2007-05-17 Sharp Corp Electronic device
JP2007127385A (en) * 2005-11-07 2007-05-24 Toshiba Corp Refrigerator
KR20070050244A (en) * 2005-11-10 2007-05-15 엘지전자 주식회사 Refrigerator having a display function for remain capacity
JP2007139355A (en) * 2005-11-21 2007-06-07 Matsushita Electric Ind Co Ltd Article storage device
JP2007170838A (en) * 2005-12-19 2007-07-05 Ryusyo Industrial Co Ltd Visual inspection apparatus
JP2007329823A (en) * 2006-06-09 2007-12-20 Fujifilm Corp Equipment control system and equipment control method
JP2008075935A (en) * 2006-09-20 2008-04-03 Matsushita Electric Ind Co Ltd Storage
JP2008224812A (en) * 2007-03-09 2008-09-25 Konica Minolta Holdings Inc Person photographing device
JP2008304127A (en) * 2007-06-07 2008-12-18 Aruze Corp Food inventory management system
KR20090049286A (en) * 2007-11-13 2009-05-18 주식회사 대우일렉트로닉스 Anti-blocking apparatus in freezer duct of a refrigerator and method thereby
JP5106245B2 (en) * 2008-05-23 2012-12-26 三菱電機株式会社 refrigerator
JP2010061382A (en) * 2008-09-03 2010-03-18 Nikon Corp Automatic recipe creation apparatus and program
JP2010121784A (en) * 2008-11-17 2010-06-03 Toshiba Corp Stock management device of refrigerator
KR101517083B1 (en) * 2009-05-11 2015-05-15 엘지전자 주식회사 A Portable terminal controlling refrigerator and operation method for the same
WO2011016225A1 (en) * 2009-08-06 2011-02-10 パナソニック株式会社 Air conditioner
JP5085616B2 (en) * 2009-08-19 2012-11-28 三菱電機株式会社 refrigerator
JP5381697B2 (en) * 2009-12-28 2014-01-08 株式会社リコー Imaging device
US9353990B2 (en) * 2010-02-23 2016-05-31 Lg Electronics Inc. Refrigerator including a terminal, and method for controlling same
JP5789779B2 (en) * 2010-03-09 2015-10-07 パナソニックＩｐマネジメント株式会社 refrigerator
JP5543831B2 (en) * 2010-04-14 2014-07-09 矢崎総業株式会社 Electrical equipment
US8756942B2 (en) * 2010-07-29 2014-06-24 Lg Electronics Inc. Refrigerator and method for controlling the same
JP2012051647A (en) * 2010-08-02 2012-03-15 Honko Mfg Co Ltd Cool container and vacuum heat insulating panel with sensor
US8655881B2 (en) * 2010-09-16 2014-02-18 Alcatel Lucent Method and apparatus for automatically tagging content
JP2012180904A (en) * 2011-03-01 2012-09-20 Honko Mfg Co Ltd Heat insulation sensors
JP2012193873A (en) * 2011-03-15 2012-10-11 Nikon Corp Storage device
JP5828660B2 (en) * 2011-04-11 2015-12-09 日本電産サンキョー株式会社 Optical unit with shake correction function
JP2012220134A (en) * 2011-04-12 2012-11-12 Hitachi Appliances Inc Refrigerator
KR20120116207A (en) * 2011-04-12 2012-10-22 엘지전자 주식회사 A display device and a refrigerator comprising the display device
KR101774054B1 (en) * 2011-04-15 2017-09-12 엘지전자 주식회사 A network system and a control method the same
JP5316674B2 (en) * 2011-05-09 2013-10-16 パナソニック株式会社 refrigerator
JP2012251722A (en) * 2011-06-03 2012-12-20 Panasonic Corp Refrigerator
JP6391943B2 (en) * 2013-03-12 2018-09-19 東芝ライフスタイル株式会社 Refrigerator, camera device, internal image display program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000244906A (en) * 1999-02-19 2000-09-08 Electrolux:Ab System and method for obtaining information on contents in cabinet
JP2001216230A (en) * 2000-02-01 2001-08-10 Fuji Xerox Co Ltd Document processing method and device utilizing network
JP2003090673A (en) * 2001-09-17 2003-03-28 Hitachi Electronics Service Co Ltd Image display system of refrigerator contents
US20060096303A1 (en) * 2004-11-10 2006-05-11 Kavounas Gregory T Home refrigerator systems imaging their interior and methods
JP2007046834A (en) * 2005-08-09 2007-02-22 Funai Electric Co Ltd Article storage, article storage monitoring system and refrigerator monitoring system
WO2012117724A1 (en) * 2011-03-02 2012-09-07 パナソニック株式会社 Refrigerator

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105222514A (en) * 2015-10-27 2016-01-06 合肥华凌股份有限公司 Mounting box and refrigerator
CN105222514B (en) * 2015-10-27 2017-12-19 合肥华凌股份有限公司 Mounting box and refrigerator
GB2545013A (en) * 2015-12-03 2017-06-07 Otegui Van Leeuw Jon Multifunctional refrigerator
US11009287B2 (en) * 2016-07-28 2021-05-18 Samsung Electronics Co., Ltd. Refrigerator
CN112984916A (en) * 2018-01-31 2021-06-18 日立环球生活方案株式会社 Refrigerator with a door
CN110942711A (en) * 2018-09-21 2020-03-31 合肥海尔电冰箱有限公司 Display device for displaying refrigerator and display method thereof
JPWO2021106029A1 (en) * 2019-11-25 2021-06-03
WO2021106029A1 (en) * 2019-11-25 2021-06-03 三菱電機株式会社 Display device
JP7150197B2 (en) 2019-11-25 2022-10-07 三菱電機株式会社 Display device

Also Published As

Publication number Publication date
JP2019124461A (en) 2019-07-25
JP6318359B2 (en) 2018-05-09
JP2014209048A (en) 2014-11-06
JP2019174106A (en) 2019-10-10
JP2014209050A (en) 2014-11-06
JP6303125B2 (en) 2018-04-04
JP2014209051A (en) 2014-11-06
JP2014209047A (en) 2014-11-06
JP2022118243A (en) 2022-08-12
JP6307698B2 (en) 2018-04-11
DE212014000095U1 (en) 2015-10-30
JP6371965B2 (en) 2018-08-15
JP2018091623A (en) 2018-06-14
JP2018124059A (en) 2018-08-09
JP2021050909A (en) 2021-04-01
JP7113378B2 (en) 2022-08-05
JP2014209049A (en) 2014-11-06
JP2021050906A (en) 2021-04-01
JP6402353B2 (en) 2018-10-10
JP2018124058A (en) 2018-08-09
JP6945131B2 (en) 2021-10-06
JP2021073421A (en) 2021-05-13
JP2014209053A (en) 2014-11-06
JP2014209052A (en) 2014-11-06
JP2019143967A (en) 2019-08-29
CN205245656U (en) 2016-05-18

Similar Documents

Publication Publication Date Title
WO2014156051A1 (en) Refrigerator and refrigerator system
JP6229142B2 (en) Refrigerator and refrigerator system
JP6221048B2 (en) refrigerator
WO2014167806A1 (en) Refrigerator
JP2015072109A (en) Refrigerator
JP6322803B2 (en) Refrigerator and refrigerator system
JP6167330B2 (en) Refrigerator and refrigerator system
JP6167331B2 (en) Refrigerator and refrigerator system
JP6167289B2 (en) Refrigerator and refrigerator system thereof
JP6361014B2 (en) Refrigerator and refrigerator system
JP6167327B2 (en) refrigerator
JP6485678B2 (en) Refrigerator and refrigerator system
JP2018004247A (en) Refrigerator
JP6212700B2 (en) Refrigerator and refrigerator system thereof
JP6167288B2 (en) refrigerator
JP2019007728A (en) refrigerator
JP2017142059A (en) refrigerator
JP6167329B2 (en) refrigerator
JP6671002B2 (en) refrigerator
JP6145701B2 (en) refrigerator
JP6114916B2 (en) refrigerator
JP2017106715A (en) refrigerator
JP6167328B2 (en) refrigerator
JP6145702B2 (en) refrigerator
JP2020197373A (en) refrigerator

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14773407

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2120140000955

Country of ref document: DE

Ref document number: 212014000095

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14773407

Country of ref document: EP

Kind code of ref document: A1