US20140146188A1 - Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method - Google Patents
Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method Download PDFInfo
- Publication number
- US20140146188A1 US20140146188A1 US13/965,225 US201313965225A US2014146188A1 US 20140146188 A1 US20140146188 A1 US 20140146188A1 US 201313965225 A US201313965225 A US 201313965225A US 2014146188 A1 US2014146188 A1 US 2014146188A1
- Authority
- US
- United States
- Prior art keywords
- compression algorithm
- multimedia data
- sensor
- data processing
- output
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H04N5/23241—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3278—Power saving in modem or I/O interface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H04N19/00006—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/179—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scene or a shot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/815—Camera processing pipelines; Components thereof for controlling the resolution by using a single image
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Definitions
- an exemplary data processing apparatus includes a compressor and an output interface.
- the compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data.
- the output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface.
- the input multimedia data is derived from an output of a camera sensor; and the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a sensor configuration of the camera sensor.
- an exemplary data processing method includes at least the following steps: receiving an input multimedia data, wherein the input multimedia data is derived from an output of a camera sensor; adaptively adjusting a compression algorithm according to a sensor configuration of the camera sensor; generating an output multimedia data according to the input multimedia data and the compression algorithm; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface
- FIG. 2 is a table showing characteristics of different compression algorithms supported by the compressor shown in FIG. 1 .
- FIG. 3 is a diagram illustrating an embodiment of the compressor shown in FIG. 1 .
- FIG. 4 is a flowchart illustrating an adaptive compression method based on at least one sensor input signal according to a first embodiment of the present invention.
- FIG. 5 is a diagram illustrating another embodiment of the compressor shown in FIG. 1 .
- FIG. 7 is a diagram illustrating yet another embodiment of the compressor shown in FIG. 1 .
- FIG. 9 is a flowchart illustrating an adaptive compression method based on a display configuration of a display apparatus and/or a sensor configuration of a camera sensor according to an embodiment of the present invention.
- the camera module 110 is coupled to the camera interface 103 , and supports un-compressed data transmission and compressed data transmission.
- the camera module 110 When the camera module 110 is used to transmit un-compressed data to the ISP 114 , the camera module 110 generates an un-compressed multimedia data, and transmits the un-compressed multimedia data over the camera interface 103 .
- the camera module 110 When the camera module 110 is used to transmit compressed data to the ISP 114 , the camera module 110 generates a compressed multimedia data, and transmits the compressed multimedia data over the camera interface 103 .
- the camera module 110 includes a compressor 142 , other circuitry 144 , and an output interface 146 .
- Other circuitry 116 includes a camera sensor 145 and other circuit elements required for capturing incident light to obtain an input multimedia data D 1 , where the input multimedia data D 1 is derived from an output of the camera sensor 145 .
- other circuitry 116 may have a lens module, a camera controller, a camera buffer, multiplexer(s), etc.
- the compressor 142 When the camera module 110 is operated in a compression mode, the compressor 142 is enabled to perform data compression upon the input multimedia data D 1 , and accordingly generates an output multimedia data D 1 ′, wherein the compressed multimedia data (i.e., output multimedia data D 1 ′) is packed/packetized into an output bitstream by the output interface 146 according to the transmission protocol of the camera interface 103 , and the output bitstream is transmitted to the ISP 114 via the camera interface 103 .
- the compressed multimedia data i.e., output multimedia data D 1 ′
- the output bitstream is transmitted to the ISP 114 via the camera interface 103 .
- the un-compressed data transmitted under the non-compression mode should be identical to the un-compressed data received under the non-decompression mode, and the compressed data transmitted under the compression mode should be identical to the compressed data received under the de-compression mode.
- other circuitry 134 includes circuit elements required for generating the processed multimedia data according to an internal transmission mode (e.g., an on-the-fly mode or an off-line mode).
- other circuitry 134 may have a write direct memory access (DMA) controller, a read DMA controller, an image processor, multiplexers, etc.
- DMA write direct memory access
- the present invention focuses on the adaptive compression and de-compression scheme for configuring the compressor 142 and the de-compressor 132 , further details directed to transmitting compressed/un-compressed multimedia data from the camera module 110 to the ISP 114 via the camera interface 103 and generating the processed multimedia data based on the compressed/un-compressed multimedia data received from the camera interface 103 are omitted here for brevity.
- the application processor 102 further includes a micro control unit (MCU) 112 , an image encoder 116 , an image decoder 118 , a display processor 120 , a video encoder 122 , a video decoder 124 , a graphic engine 126 , and a battery meter 130 .
- the battery meter 130 is arranged to monitor the power status of a power source such as the battery capacity of a battery device 109 .
- the camera module 110 and other data processing apparatuses shown in FIG. 1 are powered by the battery device 109 .
- the MCU 112 serves as a display controller used for controlling generation of a display data, and therefore controls circuit elements within the application processor 102 to generate a desired display data to the driver IC 104 . In other words, the MCU 112 controls the operation of the application processor.
- the ISP 114 serves as a backend processor for an image/video output of the camera module 110 .
- the ISP 114 may be used to perform auto white balance (AWB), auto exposure (AE) and auto focus (AF).
- a processed image generated from the ISP 114 may be transmitted to the image encoder 116 , and an encoded image is generated from the image encoder 116 to an external storage 108 such as a dynamic random access memory (DRAM).
- DRAM dynamic random access memory
- a processed video generated from the ISP 114 may be transmitted to the video encoder 122 , and an encoded video is generated from the video encoder 122 to the external storage 108 .
- the image decoder 118 receives an encoded image from the external storage 108 , and generates a decoded image to the display processor 120 .
- the video decoder 124 receives an encoded video from the external storage 108 , and generates a decoded video to the display processor 120 .
- the graphic engine 126 generates graphic data (e.g., a 3D graphic image) to the display processor 120 .
- the display processor 120 is arranged to generate a display data based on one or more of the image data, video data, graphic data, etc., and transmit the multimedia data to a driver integrated circuit (IC) 104 .
- the display data generated at the application processor 102 is derived from the output multimedia D 1 ′ transmitted from the camera module 110 to the ISP 114 via the camera interface 103 .
- the display processor 120 may combine video data, text data and graphic data to generate a multimedia data of a frame, such that the display of the frame would show a graphic scene, a web-browsing text content, and a video playback content.
- the driver IC 104 is coupled between the display processor 120 and a display panel 106 , and drives the display panel 106 according to the display data generated from the display processor 120 .
- the display panel 106 may be implemented using any 2D/3D display device (e.g. a retina display), and the pixel arrangement may be a rectangle layout, a triangle layout or a pentile layout.
- these compression algorithms indicate different capability of compression performance in terms of compression ratio, compression efficiency, compression complexity, and power dissipation.
- the compression efficiency is the ability of a compression algorithm to encode the input multimedia data D 1 at the lowest possible bit rate while maintaining a certain level of visual quality.
- PSNR peak signal-to-noise ratio
- the compression efficiency of a compression algorithm is low, it means that the compression algorithm will lose more input data information after compression is performed under a certain compression ratio. Hence, a high compression efficiency algorithm can preserve more input data information under a certain compression ratio, and the de-compressed multimedia data can have better visual appearance and visual quality.
- the compressor 142 is capable of adaptively adjusting a compression algorithm by referring to at least the side information shown as dotted lines in FIG. 1 , where the side information may be provided by at least one auxiliary sensor 105 , the camera sensor 145 , and the display panel 106 .
- the compressor 142 refers to the side information to select an adequate compression algorithm from supported compression algorithms having different compression characteristics, the compression performance can be optimized. For better understanding of technical features of the present invention, several embodiments are illustrated as below.
- the compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D 1 according to at least one sensor input signal generated from the at least one auxiliary sensor 105 .
- FIG. 3 is a diagram illustrating an embodiment of the compressor 142 shown in FIG. 1 .
- the compressor 142 includes a comparing unit 302 and a compression unit 304 .
- the comparing unit 302 receives side information SI from at least one of a plurality of auxiliary sensors such as an ambient light sensor 105 _ 1 , a proximity sensor 105 _ 2 , a thermal sensor 105 _ 3 , and an accelerometer 105 _ 4 .
- the comparing unit 302 compares the side information SI with at least one predetermined threshold to generate a comparison result CR.
- the compression unit 304 is arranged for referring to the comparison result CR to adaptively adjust the compression algorithm employed. More specifically, the compression unit 304 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR to select one of the supported compression algorithms for data compression.
- the comparing unit 302 employs a predetermined threshold THR 1 to check the side information SI (i.e., ambient light strength).
- a predetermined threshold THR 1 to check the side information SI (i.e., ambient light strength).
- the comparing unit 302 employs a predetermined threshold THR 2 to check the side information SI (i.e., a distance between the display panel 106 and an object (e.g., user's face)).
- a predetermined threshold THR 2 i.e., a distance between the display panel 106 and an object (e.g., user's face)
- the display panel 106 may be controlled to be black out or even powered down, and the compression algorithm employed by the compressor 142 is disabled such that no data compression is applied to the input multimedia data D 1 .
- the display panel 106 may be controlled to operate normally, and the compression algorithm employed by the compressor 142 is enabled such that data compression is applied to the input multimedia data D 1 .
- the comparing unit 302 employs a predetermined threshold THR 3 to check the side information SI (i.e., temperature of an electronic device (e.g., a smartphone) in which the circuit elements shown in FIG. 1 are disposed).
- a predetermined threshold THR 3 to check the side information SI (i.e., temperature of an electronic device (e.g., a smartphone) in which the circuit elements shown in FIG. 1 are disposed).
- a more complex and higher power dissipation compression algorithm or a compression algorithm with a less aggressive compression ratio may be selected to improve the visual quality.
- the comparing unit 302 employs a predetermined threshold THR 4 to check the side information SI (i.e., acceleration of an electronic device (e.g., a smartphone) in which the circuit elements shown in FIG. 1 are disposed).
- the acceleration is high (i.e., the acceleration is higher than the predetermined threshold THR 4 )
- FIG. 4 is a flowchart illustrating an adaptive compression method based on at least one sensor input signal according to a first embodiment of the present invention.
- the exemplary adaptive compression method may be briefly summarized by following steps.
- Step 400 Start.
- Step 401 Receive an image of the input multimedia data D 1 to be compressed.
- Step 402 Check if the side information SI includes one of the ambient light strength and the acceleration of an electronic device (e.g., a smartphone). If yes, go to step 404 ; otherwise, go to step 410 .
- an electronic device e.g., a smartphone
- Step 404 Check if the ambient light strength/acceleration is higher than the predetermined threshold THR 1 /THR 4 . If yes, go to step 406 ; otherwise, go to step 408 .
- Step 406 Apply a compression algorithm with a more aggressive compression ratio to the image. Go to step 424 .
- Step 408 Apply a compression algorithm with a less aggressive compression ratio to the image. Go to step 424 .
- Step 410 Check if the side information SI includes the distance between the display panel 106 and an object (e.g., user's face). If yes, go to step 412 ; otherwise, go to step 418 .
- an object e.g., user's face
- Step 412 Check if the distance is smaller than the predetermined threshold THR 2 . If yes, go to step 414 ; otherwise, go to step 416 .
- Step 414 Disable a compression algorithm employed by the compressor 218 such that no data compression is applied to the image. Go to step 424 .
- Step 416 Enable a compression algorithm employed by the compressor 218 such that data compression is applied to the image. Go to step 424 .
- Step 418 Check if the temperature of the electronic device is higher than the predetermined threshold THR 3 . If yes, go to step 420 ; otherwise, go to step 422 .
- Step 420 Apply a less complex and lower power dissipation compression algorithm to the image. Go to step 424 .
- Step 422 Apply a more complex and higher power dissipation compression algorithm or a compression algorithm with a less aggressive compression ratio to the image.
- Step 424 End.
- steps 402 , 410 and 418 may be changed, depending upon actual design consideration.
- the same objective of adaptively selecting the compression algorithm is achieved.
- steps 402 , 404 , 410 , 412 , 418 are performed by the comparing unit 302
- steps 401 , 406 , 408 , 414 , 416 , 420 , 422 are performed by the compression unit 304 .
- steps 401 , 406 , 408 , 414 , 416 , 420 , 422 are performed by the compression unit 304 .
- FIG. 5 is a diagram illustrating another embodiment of the compressor 142 shown in FIG. 1 .
- the compressor 142 includes a decision unit 502 and a compression unit 504 .
- the decision unit 502 receives side information SI from at least one of a plurality of auxiliary sensors such as the accelerometer 105 _ 4 , a gyroscope 105 _ 5 , and a receiver of a global navigation satellite system (e.g., a global positioning system (GPS) receiver 105 _ 6 ).
- GPS global positioning system
- the compression unit 504 is arranged for referring to the decision result DR to adaptively adjust the compression algorithm employed. More specifically, the compression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the decision result DR to select one of the supported compression algorithms for data compression.
- the decision unit 502 refers to the orientation measured/estimated by the gyroscope 105 _ 5 based on angular momentum to determine the decision result DR. If the gyroscope 105 _ 5 detects that an electronic device (e.g., a smartphone) in which the circuit elements shown in FIG. 1 are disposed is moving horizontally, the decision result DR indicates that a compression algorithm with horizontal prediction between horizontal pixels should be preferably selected. If the gyroscope 105 _ 5 detects that the electronic device is moving vertically, the decision result DR indicates that a compression algorithm with vertical prediction between vertical pixels should be preferably selected. If the gyroscope 105 _ 5 detects that the electronic device is moving horizontally and vertically, the decision result DR indicates that a compression algorithm with prediction along the moving direction should be preferably selected.
- an electronic device e.g., a smartphone
- the decision result DR indicates that a compression algorithm with horizontal prediction between horizontal pixels should be preferably selected.
- a predetermined range i.e., a normal view range of the display panel 106 .
- the decision unit 502 refers to the location and/or time information provided by a space-based satellite navigation system to determine the decision result DR.
- the decision result DR may instruct the compression unit 504 to select among different compression algorithms with different compression ratios according to the location of an electronic device (e.g., a smartphone) in which the circuit elements shown in FIG. 1 are disposed. For example, a user may prefer higher display quality at home and prefer lower power consumption in the office.
- the compression unit 504 therefore refers to the decision result DR to select an appropriate compression algorithm to meet user's requirement/preference.
- FIG. 6 is a flowchart illustrating an adaptive compression method based on at least one sensor input signal according to a second embodiment of the present invention.
- the exemplary adaptive compression method may be briefly summarized by following steps.
- Step 600 Start.
- Step 601 Receive an image of the input multimedia data D 1 to be compressed.
- Step 602 Check if the side information SI includes orientation information of an electronic device (e.g., a smartphone). If yes, go to step 604 ; otherwise, go to step 606 .
- an electronic device e.g., a smartphone
- Step 604 Apply a compression algorithm with prediction along the moving direction. Go to step 618 .
- Step 606 Check if the side information SI includes acceleration and orientation information of an electronic device (e.g., a smartphone). If yes, go to step 608 ; otherwise, go to step 616 .
- an electronic device e.g., a smartphone
- Step 608 Derive a view angle from acceleration and orientation information of the electronic device.
- Step 610 Check if the view angle is within a normal view range of the display panel 106 . If yes, go to step 612 ; otherwise, go to step 614 :
- Step 614 Apply a compression algorithm with a more aggressive compression ratio. Go to step 618 .
- Step 616 Check if the location of the electronic device has the coordinate of user's home. If yes, go to step 612 ; otherwise (e.g., the location of the electronic device has the coordinate of user's office), go to step 614 .
- Step 618 End.
- steps are not required to be executed in the exact order shown in FIG. 6 .
- the order of steps 602 , 606 , 616 may be changed, depending upon actual design consideration.
- the same objective of adaptively selecting the compression algorithm is achieved.
- steps 602 , 606 , 608 , 610 , 616 are performed by the decision unit 502
- steps 601 , 604 , 612 , 614 are performed by the compression unit 504 .
- steps 601 , 604 , 612 , 614 are performed by the compression unit 504 .
- the compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D 1 according to a sensor configuration of the camera sensor 145 and/or a display configuration of a display apparatus (e.g., display panel 106 ).
- FIG. 7 is a diagram illustrating yet another embodiment of the compressor 142 shown in FIG. 1 .
- the compressor 142 includes a decision unit 702 and a compression unit 704 .
- the decision unit 702 may receive side information SI from at least one of the display panel 106 and the camera sensor 145 , and determine a decision result DR′ based on the display configuration and/or sensor configuration indicated by the side information SI.
- the compression unit 704 supports a plurality of compression algorithms having different characteristics, and refers to the decision result DR′ to select one of the supported compression algorithms for data compression.
- the display panel 106 may support a two-dimensional (2D) display mode and a 3D display mode.
- 2D two-dimensional
- 3D display mode the display panel 106 is operated under the 2D display mode; and when the display data carries the 3D content, the display panel 106 is operated under the 3D display mode.
- the decision unit 702 therefore refers to the side information SI indicative of the display configuration of the display panel 106 to determine whether the display panel 106 acts as a 2D panel or a 3D panel.
- the decision result DR′ instructs the compression unit 704 to preferably select the compression algorithm N 1 since the compression algorithm N 1 is particularly designed for applying data compression to the input multimedia data D 1 carrying the 3D content to be displayed on the display panel 106 acting as a 3D panel; and when the decision unit 702 determines that the 2D display mode is employed by the display panel 106 , the decision result DR′ instructs the compression unit 704 to preferably select the compression algorithm N 2 since the compression algorithm N 2 is particularly designed for applying data compression to the input multimedia data D 1 carrying 2D content to be displayed on the display panel 106 acting as a 2D panel.
- the camera sensor 145 may support a stereo camera mode and a single camera mode.
- FIG. 8 is a diagram illustrating an exemplary implementation of the camera sensor 145 and the compression unit 704 shown in FIG. 7 .
- the camera sensor 145 includes a plurality of image sensor modules 802 _ 1 , 802 _ 2 .
- the compression unit 704 includes a plurality of compression modules 804 _ 1 , 804 _ 2 .
- both of the image sensor modules 802 _ 1 , 802 _ 2 are enabled such that a stereo image composed of a left-view image IMG L and a right-view image IMG R can be obtained under a photo mode, and a stereo video sequence having a plurality of successive stereo images, each composed of a left-view image IMG L and a right-view image IMG R , can be obtained under a video recording mode.
- the compression modules 804 _ 1 and 804 _ 2 are both enabled to employ the compression algorithm N 1 to jointly compress the input multimedia data D 1 which is a stereo image or a stereo video sequence.
- the right-view image IMG R is referenced by the compression module 804 _ 1 to compress the left-view image IMG L
- the left-view image IMG L is referenced by the compression module 804 _ 2 to compress the right-view image IMG R .
- the compression efficiency of the input multimedia data D 1 is improved.
- this is for illustrative purposes only, and is not meant to be a limitation of the present invention.
- the compression module 804 _ 1 compresses the left-view image IMG L without referring to the right-view image IMG R , and the left-view image IMG L is referenced by the compression module 804 _ 2 to compress the right-view image IMG R .
- the compression module 804 _ 2 compresses the right-view image IMG R without referring to the left-view image IMG L , and the right-view image IMG R is referenced by the compression module 804 _ 1 to compress the left-view image IMG L .
- the compression module 804 _ 1 and 804 _ 2 are enabled to employ the compression algorithm N 2 to compress the input multimedia data D 1 .
- the compression module 804 _ 2 is disabled, and the right-view image IMG R is referenced by the compression module 804 _ 1 to compress the left-view image IMG L to generate the output multimedia data D 1 ′.
- the compression module 804 _ 1 is disabled, and the left-view image IMG L may be referenced by the compression module 804 _ 2 to compress the right-view image IMG R to generate the output multimedia data D 1 ′.
- the compression module 804 _ 1 is enabled to employ the compression algorithm N 3 to apply data compression to an output of the image sensor module 802 _ 1 .
- the compression module 804 _ 2 is enabled to employ the compression algorithm N 3 to apply data compression to an output of the image sensor module 802 _ 2 .
- FIG. 9 is a flowchart illustrating an adaptive compression method based on a display configuration of a display apparatus and/or a sensor configuration of a camera sensor according to a second embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 9 .
- the exemplary adaptive compression method may be briefly summarized by following steps.
- Step 900 Start.
- Step 902 Receive the input multimedia data D 1 to be compressed.
- Step 904 Refer to side information SI to obtain the camera mode of the camera sensor 145 .
- Step 906 Does the camera sensor 145 act as a stereo camera? If yes, go to step 907 ; otherwise, go to step 914 .
- Step 907 Refer to side information SI to obtain the display mode of the display panel 106 .
- Step 908 Does the display panel 106 act as a 2D panel? If yes, go to step 910 ; otherwise, go to step 912 .
- Step 910 Apply the compression algorithm N 2 . Go to step 916 .
- Step 912 Apply the compression algorithm N 1 . Go to step 916 .
- Step 914 Apply the compression algorithm N 3 .
- Step 916 End.
- steps 904 , 906 , 907 , 908 are performed by the decision unit 702
- steps 902 , 910 , 912 , 914 are performed by the compression unit 704 .
- steps 904 , 906 , 907 , 908 are performed by the decision unit 702
- steps 902 , 910 , 912 , 914 are performed by the compression unit 704 .
Abstract
A data processing apparatus has a compressor and an output interface. The compressor receives an input multimedia data, and generates an output multimedia data according to the input multimedia data. The output interface packs the output multimedia data into an output bitstream, and outputs the output bitstream via a camera interface. The compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to at least one sensor input signal. For example, the at least one sensor input signal is generated from at least one of an ambient light sensor, a proximity sensor, a thermal sensor, an accelerometer, a gyroscope, and a receiver of a global navigation satellite system. Alternatively, the compressor may be configured to adaptively adjust the compression algorithm applied to the input multimedia data according to a sensor configuration of a camera sensor or a display configuration of a display apparatus.
Description
- This application claims the benefit of U.S. provisional application No. 61/729,426, filed on Nov. 23, 2012 and incorporated herein by reference.
- The disclosed embodiments of the present invention relate to transmitting multimedia data over a camera interface, and more particularly, to a data processing system which transmits compressed multimedia data over a camera interface.
- A camera interface is disposed between a first chip and a second chip to transmit multimedia data from the first chip to the second chip for further processing. For example, the first chip may include a camera module, and the second chip may include an image signal processor (ISP). The multimedia data may include image data (i.e., a single captured image) or video data (i.e., a video sequence composed of captured images). When a camera sensor with a higher resolution is employed in the camera module, the multimedia data transmitted over the camera interface would have a larger data size/data rate, which increases the power consumption of the camera interface inevitably. If the camera module and the ISP are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the camera interface. Thus, there is a need for an innovative design which can effectively reduce the power consumption of the camera interface.
- In accordance with exemplary embodiments of the present invention, a data processing apparatus with adaptive compression algorithm selection for data communication over a camera interface and related data processing method are proposed.
- According to a first aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface. The compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to at least one sensor input signal.
- According to a second aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface. The input multimedia data is derived from an output of a camera sensor; and the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a sensor configuration of the camera sensor.
- According to a third aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface. A display data derived from the output multimedia data transmitted via the camera interface is displayed on a display apparatus. The compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a display configuration of the display apparatus.
- According to a fourth aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to at least one sensor input signal; generating an output multimedia data according to the input multimedia data and the compression algorithm; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface.
- According to a fifth aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data, wherein the input multimedia data is derived from an output of a camera sensor; adaptively adjusting a compression algorithm according to a sensor configuration of the camera sensor; generating an output multimedia data according to the input multimedia data and the compression algorithm; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface
- According to a sixth aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to a display configuration of a display apparatus; generating an output multimedia data according to the input multimedia data and the compression algorithm; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface. A display data derived from the output multimedia data transmitted via the camera interface is displayed on the display apparatus.
- These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
-
FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention. -
FIG. 2 is a table showing characteristics of different compression algorithms supported by the compressor shown inFIG. 1 . -
FIG. 3 is a diagram illustrating an embodiment of the compressor shown inFIG. 1 . -
FIG. 4 is a flowchart illustrating an adaptive compression method based on at least one sensor input signal according to a first embodiment of the present invention. -
FIG. 5 is a diagram illustrating another embodiment of the compressor shown inFIG. 1 . -
FIG. 6 is a flowchart illustrating an adaptive compression method based on at least one sensor input signal according to a second embodiment of the present invention. -
FIG. 7 is a diagram illustrating yet another embodiment of the compressor shown inFIG. 1 . -
FIG. 8 is a diagram illustrating an exemplary implementation of the camera sensor and the compression unit shown inFIG. 7 . -
FIG. 9 is a flowchart illustrating an adaptive compression method based on a display configuration of a display apparatus and/or a sensor configuration of a camera sensor according to an embodiment of the present invention. - Certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms “include” and “comprise” are used in an open-ended fashion, and thus should be interpreted to mean “include, but not limited to . . . ”. Also, the term “couple” is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
- The present invention proposes applying data compression to a multimedia data and then transmitting a compressed multimedia data over a camera interface. As the data size/data rate of the compressed multimedia data is smaller than that of the original un-compressed multimedia data, the power consumption of the camera interface is reduced correspondingly. Besides, the present invention further proposes an adaptive compression scheme which is based on side information given by at least one auxiliary sensor, a camera sensor, and/or a display apparatus. This may allow the configuration of a compressor to be adjusted in a static or dynamic way according to the side information. In general, data compression is exploited to remove the information redundancy under a specific pixel size (i.e., a unit size of compression) and produce a compressed data constrained by a compression ratio. The compression ratio M may be defined as below.
-
- In a case where the compression ratio is equal to 0.5 (i.e., M=1/2), the size of the compressed data is half of the size of the un-compressed data. As the compression performance is strongly related to some design factors such as the unit size of compression and the constrained compression ratio, the present invention therefore proposes using the adaptive compression scheme for enabling a compression algorithm selected from a plurality of candidate compression algorithms, where the selected compression algorithm most efficiently compresses the multimedia data. Compared to a typical compression scheme using a fixed compression algorithm, the proposed adaptive compression scheme achieves better performance. Further details will be described as below.
-
FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention. Thedata processing system 100 includes a plurality of data processing apparatuses such as acamera module 110 external to anapplication processor 102 and an image signal processor (ISP) 114 included in theapplication processor 102. Thecamera module 110 and theISP 114 may be implemented in different chips, and thecamera module 110 communicates with theISP 114 via acamera interface 103. Alternatively, theISP 114 may be integrated within thecamera module 110, and a single chip having theISP 114 and thecamera module 110 included therein communicates with another data processing apparatus in theapplication processor 102 via thecamera interface 103. In this embodiment, thecamera interface 103 may be a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). - The
camera module 110 is coupled to thecamera interface 103, and supports un-compressed data transmission and compressed data transmission. When thecamera module 110 is used to transmit un-compressed data to theISP 114, thecamera module 110 generates an un-compressed multimedia data, and transmits the un-compressed multimedia data over thecamera interface 103. When thecamera module 110 is used to transmit compressed data to theISP 114, thecamera module 110 generates a compressed multimedia data, and transmits the compressed multimedia data over thecamera interface 103. - As shown in
FIG. 1 , thecamera module 110 includes acompressor 142,other circuitry 144, and anoutput interface 146.Other circuitry 116 includes acamera sensor 145 and other circuit elements required for capturing incident light to obtain an input multimedia data D1, where the input multimedia data D1 is derived from an output of thecamera sensor 145. For example, besides thecamera sensor 145,other circuitry 116 may have a lens module, a camera controller, a camera buffer, multiplexer(s), etc. When thecamera module 110 is operated in a compression mode, thecompressor 142 is enabled to perform data compression upon the input multimedia data D1, and accordingly generates an output multimedia data D1′, wherein the compressed multimedia data (i.e., output multimedia data D1′) is packed/packetized into an output bitstream by theoutput interface 146 according to the transmission protocol of thecamera interface 103, and the output bitstream is transmitted to theISP 114 via thecamera interface 103. - Regarding the
ISP 114, it is coupled to thecamera interface 103, and supports un-compressed data reception and compressed data reception. When thecamera module 110 transmits the un-compressed data to theISP 114, theISP 114 is operated under a non-decompression mode to receive an un-compressed data from thecamera interface 103 and generate a processed multimedia data according to the un-compressed multimedia data. When thecamera module 110 transmits the compressed data to theISP 114, theISP 114 is operated under a de-compression mode to receive a compressed multimedia data from thecamera interface 103 and generate the processed multimedia data according to a de-compressed multimedia data derived from de-compressing the compressed multimedia data. If there is no error introduced during the data transmission, the un-compressed data transmitted under the non-compression mode should be identical to the un-compressed data received under the non-decompression mode, and the compressed data transmitted under the compression mode should be identical to the compressed data received under the de-compression mode. - As shown in
FIG. 1 , theISP 114 includes a de-compressor 132,other circuitry 134, and aninput interface 136. Theinput interface 136 receives an input bitstream from thecamera interface 103, and un-packs/un-packetizes the input bitstream into an input multimedia data D2 which is a compressed multimedia data when thecamera module 110 is operated under the compression mode. In this embodiment, the de-compressor 132 is arranged to perform data de-compression upon the input multimedia data D2, and accordingly generate a de-compressed multimedia data D2′.Other circuitry 134 is arranged to generate a processed multimedia data according to the de-compressed multimedia data D2′. Specifically,other circuitry 134 includes circuit elements required for generating the processed multimedia data according to an internal transmission mode (e.g., an on-the-fly mode or an off-line mode). For example,other circuitry 134 may have a write direct memory access (DMA) controller, a read DMA controller, an image processor, multiplexers, etc. - As the present invention focuses on the adaptive compression and de-compression scheme for configuring the
compressor 142 and the de-compressor 132, further details directed to transmitting compressed/un-compressed multimedia data from thecamera module 110 to theISP 114 via thecamera interface 103 and generating the processed multimedia data based on the compressed/un-compressed multimedia data received from thecamera interface 103 are omitted here for brevity. - As shown in
FIG. 1 , theapplication processor 102 further includes a micro control unit (MCU) 112, animage encoder 116, animage decoder 118, adisplay processor 120, avideo encoder 122, avideo decoder 124, agraphic engine 126, and abattery meter 130. Thebattery meter 130 is arranged to monitor the power status of a power source such as the battery capacity of abattery device 109. In this embodiment, thecamera module 110 and other data processing apparatuses shown inFIG. 1 are powered by thebattery device 109. TheMCU 112 serves as a display controller used for controlling generation of a display data, and therefore controls circuit elements within theapplication processor 102 to generate a desired display data to thedriver IC 104. In other words, theMCU 112 controls the operation of the application processor. TheISP 114 serves as a backend processor for an image/video output of thecamera module 110. For example, theISP 114 may be used to perform auto white balance (AWB), auto exposure (AE) and auto focus (AF). In a case where thecamera module 110 generates a single captured image to theISP 114 under a photo mode, a processed image generated from theISP 114 may be transmitted to theimage encoder 116, and an encoded image is generated from theimage encoder 116 to anexternal storage 108 such as a dynamic random access memory (DRAM). In another case where thecamera module 110 generates a video sequence composed of successive captured images to theISP 114 under a video recording mode, a processed video generated from theISP 114 may be transmitted to thevideo encoder 122, and an encoded video is generated from thevideo encoder 122 to theexternal storage 108. - The
image decoder 118 receives an encoded image from theexternal storage 108, and generates a decoded image to thedisplay processor 120. Thevideo decoder 124 receives an encoded video from theexternal storage 108, and generates a decoded video to thedisplay processor 120. However, it is possible that the single captured image/video sequence generated from theISP 114 may be bypassed to thedisplay processor 120 without additionally encoding and decoding operations applied thereto. Thegraphic engine 126 generates graphic data (e.g., a 3D graphic image) to thedisplay processor 120. - The
display processor 120 is arranged to generate a display data based on one or more of the image data, video data, graphic data, etc., and transmit the multimedia data to a driver integrated circuit (IC) 104. Hence, the display data generated at theapplication processor 102 is derived from the output multimedia D1′ transmitted from thecamera module 110 to theISP 114 via thecamera interface 103. For example, thedisplay processor 120 may combine video data, text data and graphic data to generate a multimedia data of a frame, such that the display of the frame would show a graphic scene, a web-browsing text content, and a video playback content. Thedriver IC 104 is coupled between thedisplay processor 120 and adisplay panel 106, and drives thedisplay panel 106 according to the display data generated from thedisplay processor 120. By way of example, thedisplay panel 106 may be implemented using any 2D/3D display device (e.g. a retina display), and the pixel arrangement may be a rectangle layout, a triangle layout or a pentile layout. - In this embodiment, the
compressor 142 supports a plurality of compression algorithms having different compression characteristics. Please refer toFIG. 2 , which is a table showing characteristics of different compression algorithms supported by thecompressor 142 shown inFIG. 1 . A compression algorithm represents a set of coding tools so as to remove the data redundancy on the input multimedia data D1. The coding tools may be any kind of compression methods developed by proprietary algorithms or specified by state-of-the-art video standards (e.g., MPEG-1/2/4, H.261/262/263/264, and HEVC) or image standards (e.g., JPEG, JPEG-1s, JPEG-2000, JPEG-XR, PNG, and GIF). As shown inFIG. 2 , these compression algorithms indicate different capability of compression performance in terms of compression ratio, compression efficiency, compression complexity, and power dissipation. Specifically, the compression efficiency is the ability of a compression algorithm to encode the input multimedia data D1 at the lowest possible bit rate while maintaining a certain level of visual quality. There are two standard ways to measure the compression efficiency of a compression algorithm. One is to use an objective metric, such as a peak signal-to-noise ratio (PSNR). The other is to use a subjective assessment of video/image quality. If the compression efficiency of a compression algorithm is high, it means that the compression algorithm can preserve more input data information after compression is performed under a certain compression ratio. If the compression efficiency of a compression algorithm is low, it means that the compression algorithm will lose more input data information after compression is performed under a certain compression ratio. Hence, a high compression efficiency algorithm can preserve more input data information under a certain compression ratio, and the de-compressed multimedia data can have better visual appearance and visual quality. - In this embodiment, the
compressor 142 is capable of adaptively adjusting a compression algorithm by referring to at least the side information shown as dotted lines inFIG. 1 , where the side information may be provided by at least oneauxiliary sensor 105, thecamera sensor 145, and thedisplay panel 106. As thecompressor 142 refers to the side information to select an adequate compression algorithm from supported compression algorithms having different compression characteristics, the compression performance can be optimized. For better understanding of technical features of the present invention, several embodiments are illustrated as below. - In a first exemplary embodiment, the
compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D1 according to at least one sensor input signal generated from the at least oneauxiliary sensor 105. Please refer toFIG. 3 , which is a diagram illustrating an embodiment of thecompressor 142 shown inFIG. 1 . As shown inFIG. 3 , thecompressor 142 includes a comparingunit 302 and acompression unit 304. The comparingunit 302 receives side information SI from at least one of a plurality of auxiliary sensors such as an ambient light sensor 105_1, a proximity sensor 105_2, a thermal sensor 105_3, and an accelerometer 105_4. Besides, the comparingunit 302 compares the side information SI with at least one predetermined threshold to generate a comparison result CR. Thecompression unit 304 is arranged for referring to the comparison result CR to adaptively adjust the compression algorithm employed. More specifically, thecompression unit 304 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR to select one of the supported compression algorithms for data compression. - In a first case where the ambient light sensor 105_1 generates a sensor input signal as the side information SI, the comparing
unit 302 employs a predetermined threshold THR1 to check the side information SI (i.e., ambient light strength). When the ambient light strength is high (i.e., the ambient light strength is higher than the predetermined threshold THR1), the compression artifacts are hard to be seen by the end-user, and a compression algorithm with a more aggressive compression ratio (e.g., M=1/4, compared to 1/2) may be selected to save power. When the ambient light strength is low (i.e., the ambient light strength is not higher than the predetermined threshold THR1), the compression artifacts are easier to be seen by the end-user, and a compression algorithm with a less aggressive compression ratio (e.g., M=3/4, compared to 1/2) may be selected to ensure the visual quality. - In a second case where the proximity sensor 105_2 generates a sensor input signal as the side information SI, the comparing
unit 302 employs a predetermined threshold THR2 to check the side information SI (i.e., a distance between thedisplay panel 106 and an object (e.g., user's face)). When the distance is small (i.e., the distance is not larger than the predetermined threshold THR2), thedisplay panel 106 may be controlled to be black out or even powered down, and the compression algorithm employed by thecompressor 142 is disabled such that no data compression is applied to the input multimedia data D1. When the distance is large (i.e., the distance is larger than the predetermined threshold THR2), thedisplay panel 106 may be controlled to operate normally, and the compression algorithm employed by thecompressor 142 is enabled such that data compression is applied to the input multimedia data D1. - In a third case where the thermal sensor 105_3 generates a sensor input signal as the side information SI, the comparing
unit 302 employs a predetermined threshold THR3 to check the side information SI (i.e., temperature of an electronic device (e.g., a smartphone) in which the circuit elements shown inFIG. 1 are disposed). When the temperature is high (i.e., the temperature is higher than the predetermined threshold THR3), a low power technique is crucial, and a less complex and lower power dissipation compression algorithm may be selected to save power and prevent the temperature from going higher. When the temperature is low (i.e., the temperature is not higher than the predetermined threshold THR3), a more complex and higher power dissipation compression algorithm or a compression algorithm with a less aggressive compression ratio (e.g., M=3/4, compared to 1/2) may be selected to improve the visual quality. - In a fourth case where the accelerometer (or a G-sensor) 105_4 generates a sensor input signal as the side information SI, the comparing
unit 302 employs a predetermined threshold THR4 to check the side information SI (i.e., acceleration of an electronic device (e.g., a smartphone) in which the circuit elements shown inFIG. 1 are disposed). When the acceleration is high (i.e., the acceleration is higher than the predetermined threshold THR4), the compression artifacts are hard to be seen by the end-user, and a compression algorithm with a more aggressive compression ratio (e.g., M=1/4, compared to 1/2) may be selected to save power. When the acceleration is low (i.e., the acceleration is not higher than the predetermined threshold THR4), the compression artifacts are easier to be seen by the end-user, and a compression algorithm with a less aggressive compression ratio (e.g., M=3/4, compared to 1/2) may be selected to ensure the visual quality. -
FIG. 4 is a flowchart illustrating an adaptive compression method based on at least one sensor input signal according to a first embodiment of the present invention. The exemplary adaptive compression method may be briefly summarized by following steps. - Step 400: Start.
- Step 401: Receive an image of the input multimedia data D1 to be compressed.
- Step 402: Check if the side information SI includes one of the ambient light strength and the acceleration of an electronic device (e.g., a smartphone). If yes, go to step 404; otherwise, go to step 410.
- Step 404: Check if the ambient light strength/acceleration is higher than the predetermined threshold THR1/THR4. If yes, go to step 406; otherwise, go to step 408.
- Step 406: Apply a compression algorithm with a more aggressive compression ratio to the image. Go to step 424.
- Step 408: Apply a compression algorithm with a less aggressive compression ratio to the image. Go to step 424.
- Step 410: Check if the side information SI includes the distance between the
display panel 106 and an object (e.g., user's face). If yes, go to step 412; otherwise, go to step 418. - Step 412: Check if the distance is smaller than the predetermined threshold THR2. If yes, go to step 414; otherwise, go to step 416.
- Step 414: Disable a compression algorithm employed by the compressor 218 such that no data compression is applied to the image. Go to step 424.
- Step 416: Enable a compression algorithm employed by the compressor 218 such that data compression is applied to the image. Go to step 424.
- Step 418: Check if the temperature of the electronic device is higher than the predetermined threshold THR3. If yes, go to step 420; otherwise, go to step 422.
- Step 420: Apply a less complex and lower power dissipation compression algorithm to the image. Go to step 424.
- Step 422: Apply a more complex and higher power dissipation compression algorithm or a compression algorithm with a less aggressive compression ratio to the image.
- Step 424: End.
- Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in
FIG. 4 . For example, the order ofsteps - It should be noted that
steps unit 302, and steps 401, 406, 408, 414, 416, 420, 422 are performed by thecompression unit 304. As a person skilled in the art can readily understand details of each step shown inFIG. 4 after reading above paragraphs, further description is omitted here for brevity. - Please refer to
FIG. 5 , which is a diagram illustrating another embodiment of thecompressor 142 shown inFIG. 1 . As shown inFIG. 5 , thecompressor 142 includes adecision unit 502 and acompression unit 504. Thedecision unit 502 receives side information SI from at least one of a plurality of auxiliary sensors such as the accelerometer 105_4, a gyroscope 105_5, and a receiver of a global navigation satellite system (e.g., a global positioning system (GPS) receiver 105_6). Besides, thedecision unit 502 checks the side information SI to generate a decision result DR. Thecompression unit 504 is arranged for referring to the decision result DR to adaptively adjust the compression algorithm employed. More specifically, thecompression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the decision result DR to select one of the supported compression algorithms for data compression. - In a first case where the gyroscope 105_5 generate a sensor input signal as the side information SI, the
decision unit 502 refers to the orientation measured/estimated by the gyroscope 105_5 based on angular momentum to determine the decision result DR. If the gyroscope 105_5 detects that an electronic device (e.g., a smartphone) in which the circuit elements shown inFIG. 1 are disposed is moving horizontally, the decision result DR indicates that a compression algorithm with horizontal prediction between horizontal pixels should be preferably selected. If the gyroscope 105_5 detects that the electronic device is moving vertically, the decision result DR indicates that a compression algorithm with vertical prediction between vertical pixels should be preferably selected. If the gyroscope 105_5 detects that the electronic device is moving horizontally and vertically, the decision result DR indicates that a compression algorithm with prediction along the moving direction should be preferably selected. - In a second case where the gyroscope 105_5 and the accelerometer 105_4 generate sensor input signals as the side information SI, the
decision unit 502 obtains a view angle based on the acceleration information provided from the accelerometer 105_4 and the orientation information provided from the gyroscope 105_5, and determines the decision result DR by comparing the view angle with a predetermined range (i.e., a normal view range of the display panel 106). If the view angle is within the normal view range, the compression artifacts are easier to be seen by the end-user, and a compression algorithm with a less aggressive compression ratio (e.g., M=3/4, compared to 1/2) may be selected to ensure the visual quality. When the view angle is out of the normal view range, the compression artifacts are hard to be seen by the end-user, and a compression algorithm with a more aggressive compression ratio (e.g., M=1/4, compared to 1/2) may be selected to save power. - In a third case where the GPS receiver 105_6 generates a sensor input signal as the side information SI, the
decision unit 502 refers to the location and/or time information provided by a space-based satellite navigation system to determine the decision result DR. In one embodiment, the decision result DR may instruct thecompression unit 504 to select among different compression algorithms with different compression ratios according to the location of an electronic device (e.g., a smartphone) in which the circuit elements shown inFIG. 1 are disposed. For example, a user may prefer higher display quality at home and prefer lower power consumption in the office. Thecompression unit 504 therefore refers to the decision result DR to select an appropriate compression algorithm to meet user's requirement/preference. More specifically, if the location indicated by the GPS receiver 105_6 has a coordinate of user's home, a compression algorithm with a less aggressive compression ratio (e.g., M=3/4, compared to 1/2) may be selected to ensure the visual quality; and if the location indicated by the GPS receiver 105_6 has a coordinate of user's office, a compression algorithm with a more aggressive compression ratio (e.g., M=1/4, compared to 1/2) may be selected to save power. -
FIG. 6 is a flowchart illustrating an adaptive compression method based on at least one sensor input signal according to a second embodiment of the present invention. The exemplary adaptive compression method may be briefly summarized by following steps. - Step 600: Start.
- Step 601: Receive an image of the input multimedia data D1 to be compressed.
- Step 602: Check if the side information SI includes orientation information of an electronic device (e.g., a smartphone). If yes, go to step 604; otherwise, go to step 606.
- Step 604: Apply a compression algorithm with prediction along the moving direction. Go to step 618.
- Step 606: Check if the side information SI includes acceleration and orientation information of an electronic device (e.g., a smartphone). If yes, go to step 608; otherwise, go to step 616.
- Step 608: Derive a view angle from acceleration and orientation information of the electronic device.
- Step 610: Check if the view angle is within a normal view range of the
display panel 106. If yes, go to step 612; otherwise, go to step 614: - Step 612: Apply a compression algorithm with a less aggressive compression ratio. Go to step 618.
- Step 614: Apply a compression algorithm with a more aggressive compression ratio. Go to step 618.
- Step 616: Check if the location of the electronic device has the coordinate of user's home. If yes, go to step 612; otherwise (e.g., the location of the electronic device has the coordinate of user's office), go to step 614.
- Step 618: End.
- Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in
FIG. 6 . For example, the order ofsteps - It should be noted that
steps decision unit 502, and steps 601, 604, 612, 614 are performed by thecompression unit 504. As a person skilled in the art can readily understand details of each step shown inFIG. 6 after reading above paragraphs, further description is omitted here for brevity. - In a second exemplary embodiment, the
compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D1 according to a sensor configuration of thecamera sensor 145 and/or a display configuration of a display apparatus (e.g., display panel 106). Please refer toFIG. 7 , which is a diagram illustrating yet another embodiment of thecompressor 142 shown inFIG. 1 . Thecompressor 142 includes adecision unit 702 and acompression unit 704. Thedecision unit 702 may receive side information SI from at least one of thedisplay panel 106 and thecamera sensor 145, and determine a decision result DR′ based on the display configuration and/or sensor configuration indicated by the side information SI. Thecompression unit 704 supports a plurality of compression algorithms having different characteristics, and refers to the decision result DR′ to select one of the supported compression algorithms for data compression. - In one exemplary design, the
display panel 106 may support a two-dimensional (2D) display mode and a 3D display mode. Thus, when the display data carries the 2D content, thedisplay panel 106 is operated under the 2D display mode; and when the display data carries the 3D content, thedisplay panel 106 is operated under the 3D display mode. Thedecision unit 702 therefore refers to the side information SI indicative of the display configuration of thedisplay panel 106 to determine whether thedisplay panel 106 acts as a 2D panel or a 3D panel. When thedecision unit 702 determines that the 3D display mode is employed by thedisplay panel 106, the decision result DR′ instructs thecompression unit 704 to preferably select the compression algorithm N1 since the compression algorithm N1 is particularly designed for applying data compression to the input multimedia data D1 carrying the 3D content to be displayed on thedisplay panel 106 acting as a 3D panel; and when thedecision unit 702 determines that the 2D display mode is employed by thedisplay panel 106, the decision result DR′ instructs thecompression unit 704 to preferably select the compression algorithm N2 since the compression algorithm N2 is particularly designed for applying data compression to the input multimedia data D1 carrying 2D content to be displayed on thedisplay panel 106 acting as a 2D panel. - In one exemplary design, the
camera sensor 145 may support a stereo camera mode and a single camera mode. Please refer toFIG. 8 , which is a diagram illustrating an exemplary implementation of thecamera sensor 145 and thecompression unit 704 shown inFIG. 7 . Thecamera sensor 145 includes a plurality of image sensor modules 802_1, 802_2. Thecompression unit 704 includes a plurality of compression modules 804_1, 804_2. When thecamera sensor 145 is operated in a stereo camera mode, both of the image sensor modules 802_1, 802_2 are enabled such that a stereo image composed of a left-view image IMGL and a right-view image IMGR can be obtained under a photo mode, and a stereo video sequence having a plurality of successive stereo images, each composed of a left-view image IMGL and a right-view image IMGR, can be obtained under a video recording mode. - Consider a case where the
camera sensor 145 is operated in the stereo camera mode. If thedisplay panel 106 is operated under the 3D display mode, the compression modules 804_1 and 804_2 are both enabled to employ the compression algorithm N1 to jointly compress the input multimedia data D1 which is a stereo image or a stereo video sequence. For example, the right-view image IMGR is referenced by the compression module 804_1 to compress the left-view image IMGL, and the left-view image IMGL is referenced by the compression module 804_2 to compress the right-view image IMGR. In this way, the compression efficiency of the input multimedia data D1 is improved. However, this is for illustrative purposes only, and is not meant to be a limitation of the present invention. In one alternative design, the compression module 804_1 compresses the left-view image IMGL without referring to the right-view image IMGR, and the left-view image IMGL is referenced by the compression module 804_2 to compress the right-view image IMGR. In another alternative design, the compression module 804_2 compresses the right-view image IMGR without referring to the left-view image IMGL, and the right-view image IMGR is referenced by the compression module 804_1 to compress the left-view image IMGL. - Consider the case where the
camera sensor 145 is operated in the stereo camera mode. If thedisplay panel 106 is operated under the 2D display mode, only one of the compression modules 804_1 and 804_2 is enabled to employ the compression algorithm N2 to compress the input multimedia data D1. For example, the compression module 804_2 is disabled, and the right-view image IMGR is referenced by the compression module 804_1 to compress the left-view image IMGL to generate the output multimedia data D1′. For another example, the compression module 804_1 is disabled, and the left-view image IMGL may be referenced by the compression module 804_2 to compress the right-view image IMGR to generate the output multimedia data D1′. - When the
camera sensor 145 is operated in a single camera mode, only one of the image sensor modules 802_1, 802_2 is enabled. Hence, a single-view image or a single-view video sequence is generated from thecamera sensor 145. If the image sensor module 802_1 is enabled, the compression module 804_1 is enabled to employ the compression algorithm N3 to apply data compression to an output of the image sensor module 802_1. If the image sensor module 802_2 is enabled, the compression module 804_2 is enabled to employ the compression algorithm N3 to apply data compression to an output of the image sensor module 802_2. -
FIG. 9 is a flowchart illustrating an adaptive compression method based on a display configuration of a display apparatus and/or a sensor configuration of a camera sensor according to a second embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 9 . The exemplary adaptive compression method may be briefly summarized by following steps. - Step 900: Start.
- Step 902: Receive the input multimedia data D1 to be compressed.
- Step 904: Refer to side information SI to obtain the camera mode of the
camera sensor 145. - Step 906: Does the
camera sensor 145 act as a stereo camera? If yes, go to step 907; otherwise, go to step 914. - Step 907: Refer to side information SI to obtain the display mode of the
display panel 106. - Step 908: Does the
display panel 106 act as a 2D panel? If yes, go to step 910; otherwise, go to step 912. - Step 910: Apply the compression algorithm N2. Go to step 916.
- Step 912: Apply the compression algorithm N1. Go to step 916.
- Step 914: Apply the compression algorithm N3.
- Step 916: End.
- It should be noted that
steps decision unit 702, and steps 902, 910, 912, 914 are performed by thecompression unit 704. As a person skilled in the art can readily understand details of each step shown inFIG. 9 after reading above paragraphs, further description is omitted here for brevity. - Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Claims (26)
1. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface;
wherein the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to at least one sensor input signal.
2. The data processing apparatus of claim 1 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
3. The data processing apparatus of claim 1 , wherein the at least one sensor input signal is generated from an ambient light sensor; and the compressor is arranged to employ a first compression algorithm as the compression algorithm when the at least one sensor input signal indicates that an ambient light strength is higher than a predetermined threshold, and employ a second compression algorithm as the compression algorithm when the at least one sensor input signal indicates that the ambient light strength is not higher than the predetermined threshold, where the second compression algorithm is different from the first compression algorithm.
4. The data processing apparatus of claim 3 , wherein the first compression algorithm has a more aggressive compression ratio than the second compression algorithm.
5. The data processing apparatus of claim 1 , wherein the at least one sensor input signal is generated from a proximity sensor; and the compressor is arranged to enable the compression algorithm when the at least one sensor input signal indicates that a distance is larger than a predetermined threshold, and disable the compression algorithm when the at least one sensor input signal indicates that the distance is not larger than the predetermined threshold.
6. The data processing apparatus of claim 1 , wherein the at least one sensor input signal is generated from a thermal sensor; and the compressor is arranged to employ a first compression algorithm as the compression algorithm when the at least one sensor input signal indicates that a temperature is higher than a predetermined threshold, and employ a second compression algorithm as the compression algorithm when the at least one sensor input signal indicates that the temperature is not higher than the predetermined threshold, where the second compression algorithm is different from the first compression algorithm.
7. The data processing apparatus of claim 6 , wherein the first compression algorithm is less complex than the second compression algorithm.
8. The data processing apparatus of claim 1 , wherein the at least one sensor input signal is generated from an accelerometer; and the compressor is arranged to employ a first compression algorithm as the compression algorithm when the at least one sensor input signal indicates that acceleration is higher than a predetermined threshold, and employ a second compression algorithm as the compression algorithm when the at least one sensor input signal indicates that the acceleration is not higher than the predetermined threshold, where the second compression algorithm is different from the first compression algorithm.
9. The data processing apparatus of claim 8 , wherein the first compression algorithm has a more aggressive compression ratio than the second compression algorithm.
10. The data processing apparatus of claim 1 , wherein the at least one sensor input signal is generated from a gyroscope; and the compressor is arranged to employ a first compression algorithm as the compression algorithm when the at least one sensor input signal indicates a first moving direction, and employ a second compression algorithm as the compression algorithm when the at least one sensor input signal indicates that a second moving direction different from the first moving direction, where the first compression algorithm is configured to perform prediction along the first moving direction, and the second compression algorithm is configured to perform prediction along the second moving direction.
11. The data processing apparatus of claim 1 , wherein the at least one sensor input signal includes sensor input signals generated from an accelerometer and a gyroscope; and the compressor is arranged to employ a first compression algorithm as the compression algorithm when the at least one sensor input signal indicates that a view angle is within a predetermined range, and employ a second compression algorithm as the compression algorithm when the at least one sensor input signal indicates that view angle is out of the predetermined range, where the second compression algorithm is different from the first compression algorithm.
12. The data processing apparatus of claim 11 , wherein the second compression algorithm has a more aggressive compression ratio than the first compression algorithm.
13. The data processing apparatus of claim 1 , wherein the at least one sensor input signal is generated from a receiver of a global navigation satellite system.
14. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface;
wherein the input multimedia data is derived from an output of a camera sensor; and the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a sensor configuration of the camera sensor.
15. The data processing apparatus of claim 14 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
16. The data processing apparatus of claim 14 , wherein the compressor is arranged to employ a first compression algorithm as the compression algorithm when the sensor configuration indicates a stereo camera mode, and employ a second compression algorithm as the compression algorithm when the sensor configuration indicates a single camera mode, where the second compression algorithm is different from the first compression algorithm.
17. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface;
wherein a display data derived from the output multimedia data transmitted via the camera interface is displayed on a display apparatus; and the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a display configuration of the display apparatus.
18. The data processing apparatus of claim 17 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
19. The data processing apparatus of claim 17 , wherein the compressor is arranged to employ a first compression algorithm as the compression algorithm when the display configuration indicates a three-dimensional (3D) display mode, and employ a second compression algorithm as the compression algorithm when the display configuration indicates a two-dimensional (2D) display mode, where the second compression algorithm is different from the first compression algorithm.
20. A data processing method comprising:
receiving an input multimedia data;
adaptively adjusting a compression algorithm according to at least one sensor input signal;
generating an output multimedia data according to the input multimedia data and the compression algorithm; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface.
21. The data processing method of claim 20 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
22. The data processing method of claim 20 , wherein the at least one sensor input signal is generated from at least one of an ambient light sensor, a proximity sensor, a thermal sensor, an accelerometer, a gyroscope, and a receiver of a global navigation satellite system.
23. A data processing method comprising:
receiving an input multimedia data, wherein the input multimedia data is derived from an output of a camera sensor;
adaptively adjusting a compression algorithm according to a sensor configuration of the camera sensor;
generating an output multimedia data according to the input multimedia data and the compression algorithm; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface.
24. The data processing method of claim 23 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
25. A data processing method comprising:
receiving an input multimedia data;
adaptively adjusting a compression algorithm according to a display configuration of a display apparatus;
generating an output multimedia data according to the input multimedia data and the compression algorithm; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface;
wherein a display data derived from the output multimedia data transmitted via the camera interface is displayed on the display apparatus.
26. The data processing method of claim 25 , wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/965,225 US20140146188A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method |
CN201310544279.5A CN103841417B (en) | 2012-11-23 | 2013-11-05 | Data processing equipment and data processing method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261729426P | 2012-11-23 | 2012-11-23 | |
US13/965,225 US20140146188A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140146188A1 true US20140146188A1 (en) | 2014-05-29 |
Family
ID=50772955
Family Applications (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/964,102 Active US9568985B2 (en) | 2012-11-23 | 2013-08-11 | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
US13/965,169 Abandoned US20140146187A1 (en) | 2012-11-23 | 2013-08-12 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US13/965,210 Abandoned US20140146195A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method |
US13/965,225 Abandoned US20140146188A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method |
US13/965,203 Active 2034-01-11 US9535489B2 (en) | 2012-11-23 | 2013-08-13 | Data processing system for transmitting compressed multimedia data over camera interface |
US14/022,203 Abandoned US20140146874A1 (en) | 2012-11-23 | 2013-09-09 | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method |
US15/292,145 Abandoned US20170034517A1 (en) | 2012-11-23 | 2016-10-13 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US15/361,006 Active US10200603B2 (en) | 2012-11-23 | 2016-11-24 | Data processing system for transmitting compressed multimedia data over camera interface |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/964,102 Active US9568985B2 (en) | 2012-11-23 | 2013-08-11 | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
US13/965,169 Abandoned US20140146187A1 (en) | 2012-11-23 | 2013-08-12 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US13/965,210 Abandoned US20140146195A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method |
Family Applications After (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/965,203 Active 2034-01-11 US9535489B2 (en) | 2012-11-23 | 2013-08-13 | Data processing system for transmitting compressed multimedia data over camera interface |
US14/022,203 Abandoned US20140146874A1 (en) | 2012-11-23 | 2013-09-09 | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method |
US15/292,145 Abandoned US20170034517A1 (en) | 2012-11-23 | 2016-10-13 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US15/361,006 Active US10200603B2 (en) | 2012-11-23 | 2016-11-24 | Data processing system for transmitting compressed multimedia data over camera interface |
Country Status (2)
Country | Link |
---|---|
US (8) | US9568985B2 (en) |
CN (7) | CN103841415B (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140192062A1 (en) * | 2011-12-26 | 2014-07-10 | Sameer KP | Techniques for managing three-dimensional graphics display modes |
US20160150399A1 (en) * | 2013-07-09 | 2016-05-26 | Guang Dong Oppo Mobile Telecommunications Corp., Ltd. | Method for preventing call-up operation errors and system using the same |
US20160360136A1 (en) * | 2015-06-02 | 2016-12-08 | Canon Kabushiki Kaisha | Imaging element, image pickup apparatus, method of controlling imaging element, program, and storage medium |
US9536045B1 (en) * | 2015-03-16 | 2017-01-03 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US10827039B1 (en) * | 2015-10-19 | 2020-11-03 | Quest Software Inc. | Systems and methods for dynamic compression of time-series data |
US11212434B2 (en) * | 2020-04-15 | 2021-12-28 | Novatek Microelectronics Corp. | Image device and image processing integrated circuit |
Families Citing this family (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9568985B2 (en) * | 2012-11-23 | 2017-02-14 | Mediatek Inc. | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
JP2015053644A (en) * | 2013-09-09 | 2015-03-19 | オリンパス株式会社 | Imaging device |
US10080018B2 (en) * | 2014-03-25 | 2018-09-18 | Owtware Holdings Limited, BVI | Video content classification |
US20160154444A1 (en) * | 2014-06-12 | 2016-06-02 | Mediatek Inc. | Thermal management method and electronic system with thermal management mechanism |
CN105404331A (en) * | 2014-09-10 | 2016-03-16 | 联想(北京)有限公司 | Control method and device, and electronic equipment |
US9491495B2 (en) * | 2015-01-16 | 2016-11-08 | Analog Devices Global | Method and apparatus for providing input to a camera serial interface transmitter |
CN104717433A (en) * | 2015-03-27 | 2015-06-17 | 电子科技大学 | Distributed transmission device for video stream signal processing system |
US20170094190A1 (en) * | 2015-09-30 | 2017-03-30 | Microsoft Technology Licensing, Llc | Processing display of digital camera readout with minimal latency |
JP6743427B2 (en) * | 2016-03-08 | 2020-08-19 | 株式会社リコー | Information processing apparatus, imaging system, and data transfer method |
KR102510708B1 (en) * | 2016-07-25 | 2023-03-16 | 삼성전자주식회사 | Electronic device and method for diplaying image |
KR102647268B1 (en) * | 2016-09-16 | 2024-03-12 | 소니 세미컨덕터 솔루션즈 가부시키가이샤 | Image pickup device and electronic apparatus |
CN109716660B (en) * | 2017-01-24 | 2021-08-13 | 华为技术有限公司 | Data compression apparatus and method |
US10229322B2 (en) | 2017-04-06 | 2019-03-12 | Ants Technology (Hk) Limited | Apparatus, methods and computer products for video analytics |
US10453221B2 (en) * | 2017-04-10 | 2019-10-22 | Intel Corporation | Region based processing |
CN107241600B (en) * | 2017-04-20 | 2018-07-03 | 中国科学技术大学 | A kind of static background inner frame coding method and device |
CN107176100A (en) * | 2017-05-12 | 2017-09-19 | 深圳市京弘全智能科技股份有限公司 | Car-mounted terminal and its distance-finding method with distance measurement function |
KR102204596B1 (en) * | 2017-06-02 | 2021-01-19 | 삼성전자주식회사 | Processor, image processing device comprising the same, and method for image processing |
KR102434417B1 (en) | 2017-07-20 | 2022-08-22 | 삼성전자주식회사 | Method for transmitting image data and data associated with control of image capture based on sizes of image data and data associated with control of image capture and electronic device for supporting the same |
TWI640957B (en) | 2017-07-26 | 2018-11-11 | 聚晶半導體股份有限公司 | Image processing chip and image processing system |
US10331564B2 (en) * | 2017-11-29 | 2019-06-25 | Intel Corporation | Technologies for secure I/O with MIPI camera device |
KR102301940B1 (en) | 2017-12-01 | 2021-09-14 | 삼성전자주식회사 | Method and apparatus for image fusion |
CN108205320A (en) * | 2017-12-18 | 2018-06-26 | 深圳市奇虎智能科技有限公司 | Map data processing method and device |
TWI653886B (en) | 2017-12-21 | 2019-03-11 | 鴻海精密工業股份有限公司 | Picture transmision method and photographic device |
US10739838B2 (en) * | 2017-12-28 | 2020-08-11 | Omnivision Technologies, Inc. | Quality-driven dynamic frequency scaling for energy optimization of smart camera systems |
KR102499033B1 (en) | 2018-01-31 | 2023-02-13 | 삼성전자주식회사 | Image sensor and electronic device including the image sensor |
KR102499286B1 (en) | 2018-02-23 | 2023-02-14 | 삼성전자주식회사 | Electronic device for compressing image based on compression loss data associated with compression of a plurality of blocks into which image has been segmented and method for operating thefeof |
US11432187B2 (en) * | 2018-04-04 | 2022-08-30 | Charter Communications Operating, Llc | Dynamic use of header compression in a wireless network |
GB2575463B (en) * | 2018-07-10 | 2022-12-14 | Displaylink Uk Ltd | Compression of display data |
CN110971943B (en) * | 2018-09-30 | 2021-10-15 | 北京微播视界科技有限公司 | Video code rate adjusting method, device, terminal and storage medium |
US11412136B2 (en) * | 2018-12-07 | 2022-08-09 | Samsung Electronics Co., Ltd. | Apparatus and method for operating multiple cameras for digital photography |
CN111756963B (en) * | 2019-03-29 | 2022-01-14 | 华为技术有限公司 | Image shooting module and electronic terminal |
KR20210009255A (en) | 2019-07-16 | 2021-01-26 | 삼성전자주식회사 | Image sensor and image processing system comprising thereof |
CN113918298A (en) * | 2021-10-12 | 2022-01-11 | 北京字节跳动网络技术有限公司 | Method, system and equipment for processing multimedia data |
Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5502485A (en) * | 1993-06-23 | 1996-03-26 | Nikon Corporation | Camera which compresses digital image data in correspondence with the focus control or the stop value of the camera |
US20020015092A1 (en) * | 2000-01-13 | 2002-02-07 | Meir Feder | Method and system for multimedia communication control |
US20040012686A1 (en) * | 2002-07-04 | 2004-01-22 | Minolta Co., Ltd. | Image capturing apparatus |
US20060222252A1 (en) * | 2005-03-31 | 2006-10-05 | Industry-Academia Cooperation Group Of Sejong University | Apparatus and method for encoding multi-view video using camera parameters, apparatus and method for generating multi-view video using camera parameters, and recording medium storing program for implementing the methods |
US20080076471A1 (en) * | 2006-09-21 | 2008-03-27 | Kabushiki Kaisha Toshiba | Mobile terminal |
US20080170806A1 (en) * | 2007-01-12 | 2008-07-17 | Samsung Electronics Co., Ltd. | 3D image processing apparatus and method |
US20090129219A1 (en) * | 2007-11-21 | 2009-05-21 | Hitachi, Ltd. | Recording/Reproducing Apparatus |
US20100260486A1 (en) * | 2007-12-28 | 2010-10-14 | Huawei Device Co., Ltd | Apparatus, System and Method for Recording a Multi-View Video and Processing Pictures, and Decoding Method |
US20110018970A1 (en) * | 2009-07-21 | 2011-01-27 | Fujifilm Corporation | Compound-eye imaging apparatus |
US20110261217A1 (en) * | 2010-04-21 | 2011-10-27 | Nokia Corporation | Image processing architecture with pre-scaler |
WO2012076906A1 (en) * | 2010-12-10 | 2012-06-14 | Apical Limited | Display controller and display system |
US20130011047A1 (en) * | 2011-07-05 | 2013-01-10 | Texas Instruments Incorporated | Method, System and Computer Program Product for Switching Between 2D and 3D Coding of a Video Sequence of Images |
US20140092439A1 (en) * | 2012-09-28 | 2014-04-03 | Scott A. Krig | Encoding images using a 3d mesh of polygons and corresponding textures |
US9077917B2 (en) * | 2011-06-09 | 2015-07-07 | Apple Inc. | Image sensor having HDR capture capability |
Family Cites Families (85)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1995029437A1 (en) | 1994-04-22 | 1995-11-02 | Sony Corporation | Device and method for transmitting data, and device and method for recording data |
US5553160A (en) * | 1994-09-01 | 1996-09-03 | Intel Corporation | Method and apparatus for dynamically selecting an image compression process based on image size and color resolution |
US5778191A (en) | 1995-10-26 | 1998-07-07 | Motorola, Inc. | Method and device for error control of a macroblock-based video compression technique |
US6031929A (en) * | 1996-07-18 | 2000-02-29 | University Of Pittsburgh | Image facsimile with real time image segmentation |
US6356709B1 (en) * | 1996-08-30 | 2002-03-12 | Sony Corporation | Device, method, and medium for recording still picture and animation |
JPH1093918A (en) | 1996-09-17 | 1998-04-10 | Nikon Corp | Picture recording device |
US6201834B1 (en) | 1996-12-20 | 2001-03-13 | Intel Corporation | Method and apparatus for packet loss recovery with standard-based packet video |
US7110025B1 (en) | 1997-05-28 | 2006-09-19 | Eastman Kodak Company | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data |
US6507672B1 (en) | 1997-09-10 | 2003-01-14 | Lsi Logic Corporation | Video encoder for digital video displays |
US6614934B1 (en) * | 1998-03-06 | 2003-09-02 | Divio, Inc. | Method and apparatus for concatenating bits of odd-length words |
JP2000232649A (en) * | 1998-12-10 | 2000-08-22 | Fujitsu Ltd | Mpeg video decoder and mpeg video decoding method |
US6704310B1 (en) | 1999-06-30 | 2004-03-09 | Logitech Europe, S.A. | Header encoding method and apparatus for packet-based bus |
US6995794B2 (en) | 1999-06-30 | 2006-02-07 | Logitech Europe S.A. | Video camera with major functions implemented in host software |
DE10035109B4 (en) | 1999-07-20 | 2012-03-08 | Lg Information & Communications, Ltd. | Terminal and method for transporting still images |
JP3849461B2 (en) | 2001-06-07 | 2006-11-22 | ソニー株式会社 | Imaging apparatus and imaging method |
US7027520B2 (en) | 2001-08-30 | 2006-04-11 | Thomson Licensing | Method and apparatus for simultaneously retrieving portions of a data stream from different channels |
US7088398B1 (en) * | 2001-12-24 | 2006-08-08 | Silicon Image, Inc. | Method and apparatus for regenerating a clock for auxiliary data transmitted over a serial link with video data |
KR20030097310A (en) * | 2002-06-20 | 2003-12-31 | 삼성전자주식회사 | method and system for adjusting image size of display apparatus and recording media for computer program therefor |
US7069394B2 (en) | 2002-12-05 | 2006-06-27 | International Business Machines Corporation | Dynamic data routing mechanism for a high speed memory cloner |
US7403660B2 (en) | 2003-04-30 | 2008-07-22 | Nokia Corporation | Encoding picture arrangement parameter in picture bitstream |
KR100513274B1 (en) | 2003-07-30 | 2005-09-09 | 이디텍 주식회사 | A controlling method for a high speed DVI using compression technique and a DVI transmitter and Receiver using the method |
US20050073586A1 (en) * | 2003-10-06 | 2005-04-07 | Songnian Li | Digital camera interface |
CN1309258C (en) * | 2003-12-19 | 2007-04-04 | 联想(北京)有限公司 | A method of lossless image compression applied to real time transmission |
US7394410B1 (en) | 2004-02-13 | 2008-07-01 | Samplify Systems, Inc. | Enhanced data converters using compression and decompression |
US20050195205A1 (en) * | 2004-03-03 | 2005-09-08 | Microsoft Corporation | Method and apparatus to decode a streaming file directly to display drivers |
US7539218B2 (en) * | 2004-03-04 | 2009-05-26 | Nvidia Corporation | Media processing engine framework |
US7570270B2 (en) * | 2004-05-21 | 2009-08-04 | Broadcom Corporation | Buffer for driving display with asynchronous display engine |
US7656561B2 (en) | 2004-05-31 | 2010-02-02 | Phase One A/S | Image compression for rapid high-quality imaging |
CN101002477A (en) * | 2004-08-13 | 2007-07-18 | 皇家飞利浦电子股份有限公司 | System and method for compression of mixed graphic and video sources |
CN2724334Y (en) | 2004-08-27 | 2005-09-07 | 马晨阳 | Cell phone video frequency image monitor |
US20060104356A1 (en) * | 2004-11-15 | 2006-05-18 | Microsoft Corporation | Timing for decoder buffer examination |
US20060176960A1 (en) * | 2005-02-07 | 2006-08-10 | Paul Lu | Method and system for decoding variable length code (VLC) in a microprocessor |
US8311088B2 (en) * | 2005-02-07 | 2012-11-13 | Broadcom Corporation | Method and system for image processing in a microprocessor for portable video communication devices |
JP4368835B2 (en) | 2005-08-29 | 2009-11-18 | 富士通マイクロエレクトロニクス株式会社 | Image processing apparatus, imaging apparatus, and image processing system |
KR100744120B1 (en) | 2006-01-10 | 2007-08-01 | 삼성전자주식회사 | Video signal scaler and video signal processing apparatus having the same |
JP2009526264A (en) * | 2006-02-07 | 2009-07-16 | エルジー エレクトロニクス インコーポレイティド | Encoding / decoding apparatus and method |
US7873224B2 (en) | 2006-03-01 | 2011-01-18 | Qualcomm Incorporated | Enhanced image/video quality through artifact evaluation |
US20070286277A1 (en) * | 2006-06-13 | 2007-12-13 | Chen Xuemin Sherman | Method and system for video compression using an iterative encoding algorithm |
DE102007035204A1 (en) | 2006-07-28 | 2008-02-07 | Mediatek Inc. | Video processing and operating device |
EP1921867B1 (en) * | 2006-10-17 | 2016-05-25 | Harman Becker Automotive Systems GmbH | Sensor assisted video compression |
CN101578869B (en) * | 2006-12-28 | 2012-11-14 | 汤姆逊许可证公司 | Method and apparatus for automatic visual artifact analysis and artifact reduction |
TW200830170A (en) | 2007-01-04 | 2008-07-16 | Benq Corp | Data processing system and method |
JP4858294B2 (en) * | 2007-05-09 | 2012-01-18 | ソニー株式会社 | Imaging device, imaging circuit, and image processing circuit |
FR2917919B1 (en) | 2007-06-21 | 2010-06-11 | Canon Kk | METHOD AND DEVICE FOR TRANSMITTING IMAGES |
US20090074058A1 (en) | 2007-09-14 | 2009-03-19 | Sony Corporation | Coding tool selection in video coding based on human visual tolerance |
US20090086174A1 (en) | 2007-09-28 | 2009-04-02 | Sanyo Electric Co., Ltd. | Image recording apparatus, image correcting apparatus, and image sensing apparatus |
US8049761B1 (en) | 2007-11-08 | 2011-11-01 | Nvidia Corporation | Bus protocol for transferring pixel data between chips |
DE102007058724B3 (en) | 2007-12-06 | 2009-05-14 | Fujitsu Siemens Computers Gmbh | Data processing system |
CN201127091Y (en) | 2007-12-20 | 2008-10-01 | 唐斌 | Mobile phone having function of preventing wireless video from watching |
CN101217623B (en) | 2007-12-26 | 2012-07-11 | 广东威创视讯科技股份有限公司 | A quick manual focusing method |
JP5593596B2 (en) | 2008-02-04 | 2014-09-24 | ソニー株式会社 | Video signal transmitting apparatus and video signal transmitting method |
TW201026056A (en) | 2008-12-16 | 2010-07-01 | Quanta Comp Inc | Image capturing device and image delivery method |
BRPI1007163A2 (en) * | 2009-01-26 | 2018-09-25 | Thomson Licensing | frame compression for video encoding |
US8157738B2 (en) * | 2009-06-02 | 2012-04-17 | Samplify Systems, Inc. | Ultrasound signal compression |
US20100309987A1 (en) | 2009-06-05 | 2010-12-09 | Apple Inc. | Image acquisition and encoding system |
TWM378589U (en) * | 2009-07-10 | 2010-04-11 | Jetcom Technology Inc | Video conference device in combination with camera lens |
CN102063265A (en) * | 2009-11-17 | 2011-05-18 | 智微科技股份有限公司 | Memory device and memory controller for accessing non-volatile memory |
CN101702778B (en) * | 2009-11-30 | 2011-04-13 | 公安部第一研究所 | Network video encoder using PS encapsulation technology to carry OSD information |
CN102118791B (en) * | 2009-12-31 | 2014-01-08 | 华为技术有限公司 | Method and device for transmitting data packets |
CN102118792B (en) * | 2009-12-31 | 2015-01-21 | 华为技术有限公司 | Method and device for transmitting data packets |
JP5131286B2 (en) | 2010-01-04 | 2013-01-30 | 株式会社ニコン | Image processing apparatus and image processing program |
CN101778161A (en) * | 2010-01-19 | 2010-07-14 | 中兴通讯股份有限公司 | Mobile Internet terminal |
US8588536B2 (en) | 2010-02-22 | 2013-11-19 | Texas Instruments Incorporated | Guaranteed-rate tiled image data compression |
US9973768B2 (en) | 2010-03-16 | 2018-05-15 | Texas Instruments Incorporated | CABAC decoder with decoupled arithmetic decoding and inverse binarization |
US20110235500A1 (en) * | 2010-03-24 | 2011-09-29 | Kishan Shenoi | Integrated echo canceller and speech codec for voice-over IP(VoIP) |
US8233534B2 (en) * | 2010-04-09 | 2012-07-31 | Newport Media, Inc. | Frame buffer compression and memory allocation in a video decoder |
US8599316B2 (en) | 2010-05-25 | 2013-12-03 | Intellectual Ventures Fund 83 Llc | Method for determining key video frames |
US20120120083A1 (en) * | 2010-11-12 | 2012-05-17 | Novatek Microelectronics Corp. | Display apparatus, and display controller and operating method thereof |
JP2012105188A (en) | 2010-11-12 | 2012-05-31 | Sony Corp | Image output device, image output method, image processing system, image processing method, program, and imaging apparatus |
KR20120058057A (en) * | 2010-11-29 | 2012-06-07 | 삼성전자주식회사 | Offset canceling circuit, sampling circuit and image sensor |
CN102647611A (en) | 2011-02-18 | 2012-08-22 | 安凯(广州)微电子技术有限公司 | Chip camera interface function testing method and chip camera interface function testing system |
JP5822544B2 (en) * | 2011-06-08 | 2015-11-24 | キヤノン株式会社 | Imaging apparatus and imaging system |
CN102523446B (en) * | 2011-12-26 | 2014-06-04 | 南京鹏力系统工程研究所 | Adaptive compression method of radar video in vessel traffic navigation system |
TW201408071A (en) * | 2012-04-09 | 2014-02-16 | Vid Scale Inc | Weighted prediction parameter signaling for video coding |
CN202551178U (en) | 2012-04-25 | 2012-11-21 | 东北石油大学 | Portable image acquisition and compression device |
US9532080B2 (en) * | 2012-05-31 | 2016-12-27 | Sonic Ip, Inc. | Systems and methods for the reuse of encoding information in encoding alternative streams of video data |
CN102685532B (en) * | 2012-06-04 | 2014-04-16 | 山东大学 | Coding method for free view point four-dimensional space video coding system |
CN102843566B (en) | 2012-09-20 | 2015-06-17 | 歌尔声学股份有限公司 | Communication method and equipment for three-dimensional (3D) video data |
US20140098111A1 (en) | 2012-10-09 | 2014-04-10 | Mediatek Inc. | Data processing system for transmitting compressed display data over display interface |
US9355613B2 (en) | 2012-10-09 | 2016-05-31 | Mediatek Inc. | Data processing apparatus for transmitting/receiving compression-related indication information via display interface and related data processing method |
US9077965B2 (en) | 2012-10-12 | 2015-07-07 | Mediatek Inc. | Method and apparatus for performing lossy image compression through source quantization and lossless compression kernel, and related method and apparatus for image decompression |
US9568985B2 (en) * | 2012-11-23 | 2017-02-14 | Mediatek Inc. | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
CN103220492A (en) | 2013-03-25 | 2013-07-24 | 东莞市久益通信科技有限公司 | Mobile phone video conference system based on 3G networks |
CN103294038A (en) | 2013-06-10 | 2013-09-11 | 中山市拓维电子科技有限公司 | Stabilized soil and cement stabilized macadam production process dynamic quality remote monitoring system |
CN103338354A (en) | 2013-06-17 | 2013-10-02 | 青岛海信电子设备有限公司 | Small-sized video encoding equipment, and video capture, coding and transmission system |
-
2013
- 2013-08-11 US US13/964,102 patent/US9568985B2/en active Active
- 2013-08-12 US US13/965,169 patent/US20140146187A1/en not_active Abandoned
- 2013-08-13 US US13/965,210 patent/US20140146195A1/en not_active Abandoned
- 2013-08-13 US US13/965,225 patent/US20140146188A1/en not_active Abandoned
- 2013-08-13 US US13/965,203 patent/US9535489B2/en active Active
- 2013-09-09 US US14/022,203 patent/US20140146874A1/en not_active Abandoned
- 2013-11-04 CN CN201310539313.XA patent/CN103841415B/en active Active
- 2013-11-05 CN CN201710412700.5A patent/CN107277347A/en not_active Withdrawn
- 2013-11-05 CN CN201310544279.5A patent/CN103841417B/en not_active Expired - Fee Related
- 2013-11-05 CN CN201310541485.0A patent/CN103841315B/en active Active
- 2013-11-21 CN CN201310593889.4A patent/CN103841317A/en active Pending
- 2013-11-21 CN CN201310594147.3A patent/CN103841318A/en active Pending
- 2013-11-21 CN CN201310593750.XA patent/CN103841316B/en not_active Expired - Fee Related
-
2016
- 2016-10-13 US US15/292,145 patent/US20170034517A1/en not_active Abandoned
- 2016-11-24 US US15/361,006 patent/US10200603B2/en active Active
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5502485A (en) * | 1993-06-23 | 1996-03-26 | Nikon Corporation | Camera which compresses digital image data in correspondence with the focus control or the stop value of the camera |
US20020015092A1 (en) * | 2000-01-13 | 2002-02-07 | Meir Feder | Method and system for multimedia communication control |
US20040012686A1 (en) * | 2002-07-04 | 2004-01-22 | Minolta Co., Ltd. | Image capturing apparatus |
US20060222252A1 (en) * | 2005-03-31 | 2006-10-05 | Industry-Academia Cooperation Group Of Sejong University | Apparatus and method for encoding multi-view video using camera parameters, apparatus and method for generating multi-view video using camera parameters, and recording medium storing program for implementing the methods |
US20080076471A1 (en) * | 2006-09-21 | 2008-03-27 | Kabushiki Kaisha Toshiba | Mobile terminal |
US20080170806A1 (en) * | 2007-01-12 | 2008-07-17 | Samsung Electronics Co., Ltd. | 3D image processing apparatus and method |
US20090129219A1 (en) * | 2007-11-21 | 2009-05-21 | Hitachi, Ltd. | Recording/Reproducing Apparatus |
US20100260486A1 (en) * | 2007-12-28 | 2010-10-14 | Huawei Device Co., Ltd | Apparatus, System and Method for Recording a Multi-View Video and Processing Pictures, and Decoding Method |
US20110018970A1 (en) * | 2009-07-21 | 2011-01-27 | Fujifilm Corporation | Compound-eye imaging apparatus |
US20110261217A1 (en) * | 2010-04-21 | 2011-10-27 | Nokia Corporation | Image processing architecture with pre-scaler |
WO2012076906A1 (en) * | 2010-12-10 | 2012-06-14 | Apical Limited | Display controller and display system |
US9077917B2 (en) * | 2011-06-09 | 2015-07-07 | Apple Inc. | Image sensor having HDR capture capability |
US20130011047A1 (en) * | 2011-07-05 | 2013-01-10 | Texas Instruments Incorporated | Method, System and Computer Program Product for Switching Between 2D and 3D Coding of a Video Sequence of Images |
US20140092439A1 (en) * | 2012-09-28 | 2014-04-03 | Scott A. Krig | Encoding images using a 3d mesh of polygons and corresponding textures |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140192062A1 (en) * | 2011-12-26 | 2014-07-10 | Sameer KP | Techniques for managing three-dimensional graphics display modes |
US10275924B2 (en) * | 2011-12-26 | 2019-04-30 | Intel Corporation | Techniques for managing three-dimensional graphics display modes |
US20160150399A1 (en) * | 2013-07-09 | 2016-05-26 | Guang Dong Oppo Mobile Telecommunications Corp., Ltd. | Method for preventing call-up operation errors and system using the same |
US9955341B2 (en) * | 2013-07-09 | 2018-04-24 | Guang Dong Oppo Mobile Telecommunications Corp., Ltd. | Method for preventing call-up operation errors and system using the same |
US9536045B1 (en) * | 2015-03-16 | 2017-01-03 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US9536324B1 (en) | 2015-03-16 | 2017-01-03 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US9800882B2 (en) | 2015-03-16 | 2017-10-24 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US10129553B2 (en) | 2015-03-16 | 2018-11-13 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US20160360136A1 (en) * | 2015-06-02 | 2016-12-08 | Canon Kabushiki Kaisha | Imaging element, image pickup apparatus, method of controlling imaging element, program, and storage medium |
US10567766B2 (en) * | 2015-06-02 | 2020-02-18 | Canon Kabushiki Kaisha | Image pickup apparatus, method of controlling imaging apparatus, program, and storage medium, using different compression processes for imaging and non-imaging pixel data |
US10827039B1 (en) * | 2015-10-19 | 2020-11-03 | Quest Software Inc. | Systems and methods for dynamic compression of time-series data |
US11212434B2 (en) * | 2020-04-15 | 2021-12-28 | Novatek Microelectronics Corp. | Image device and image processing integrated circuit |
Also Published As
Publication number | Publication date |
---|---|
US20140146187A1 (en) | 2014-05-29 |
CN103841317A (en) | 2014-06-04 |
US20140146874A1 (en) | 2014-05-29 |
CN103841316B (en) | 2018-04-17 |
US9568985B2 (en) | 2017-02-14 |
US20140146186A1 (en) | 2014-05-29 |
CN103841415A (en) | 2014-06-04 |
CN103841315A (en) | 2014-06-04 |
US9535489B2 (en) | 2017-01-03 |
CN103841415B (en) | 2017-08-01 |
US20170078567A1 (en) | 2017-03-16 |
US10200603B2 (en) | 2019-02-05 |
CN103841417B (en) | 2018-03-06 |
CN107277347A (en) | 2017-10-20 |
US20140146195A1 (en) | 2014-05-29 |
CN103841417A (en) | 2014-06-04 |
CN103841316A (en) | 2014-06-04 |
US20170034517A1 (en) | 2017-02-02 |
CN103841315B (en) | 2017-07-07 |
CN103841318A (en) | 2014-06-04 |
US20140146194A1 (en) | 2014-05-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20140146188A1 (en) | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method | |
US9466258B2 (en) | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/display configuration over display interface and related data processing method | |
US9628718B2 (en) | Image sensor alignment in a multi-camera system accelerator architecture | |
US20150049105A1 (en) | Data processing apparatus for transmitting/receiving indication information of pixel data grouping setting via display interface and related data processing method | |
US20150237351A1 (en) | Techniques for inclusion of region of interest indications in compressed video data | |
WO2015056424A1 (en) | Decoding device and decoding method, and coding device and coding method | |
US11388403B2 (en) | Video encoding method and apparatus, storage medium, and device | |
US20140098111A1 (en) | Data processing system for transmitting compressed display data over display interface | |
US11140400B2 (en) | Image processing apparatus and image processing method for intra BC prediction | |
US11399191B2 (en) | Adaptive frame resolution for compression matching | |
KR20130094661A (en) | Apparatus and method for shooting a moving picture in camera device | |
WO2011031592A2 (en) | Bitstream syntax for graphics-mode compression in wireless hd 1.1 | |
CN102088599A (en) | Image processing apparatus and image processing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JU, CHI-CHENG;LIU, TSU-MING;REEL/FRAME:030993/0619 Effective date: 20130808 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |