US20090290182A1 - Image processing apparatus with preview display function, image processing method, and image processing program - Google Patents

Image processing apparatus with preview display function, image processing method, and image processing program Download PDF

Info

Publication number
US20090290182A1
US20090290182A1 US12/468,328 US46832809A US2009290182A1 US 20090290182 A1 US20090290182 A1 US 20090290182A1 US 46832809 A US46832809 A US 46832809A US 2009290182 A1 US2009290182 A1 US 2009290182A1
Authority
US
United States
Prior art keywords
image data
image
preview
preview image
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/468,328
Other versions
US8861022B2 (en
Inventor
Masaya Hashimoto
Hisashi Uchida
Yoshiyuki Tamai
Kazusei Takahashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Konica Minolta Business Technologies Inc
Original Assignee
Konica Minolta Business Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Konica Minolta Business Technologies Inc filed Critical Konica Minolta Business Technologies Inc
Assigned to KONICA MINOLTA BUSINESS TECHNOLOGIES, INC. reassignment KONICA MINOLTA BUSINESS TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HASHIMOTO, MASAYA, TAKAHASHI, KAZUSEI, TAMAI, YOSHIYUKI, UCHIDA, HISASHI
Publication of US20090290182A1 publication Critical patent/US20090290182A1/en
Application granted granted Critical
Publication of US8861022B2 publication Critical patent/US8861022B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K15/00Arrangements for producing a permanent visual presentation of the output data, e.g. computer output printers
    • G06K15/002Interacting with the operator
    • G06K15/005Interacting with the operator only locally
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G15/00Apparatus for electrographic processes using a charge pattern
    • G03G15/50Machine control of apparatus for electrographic processes using a charge pattern, e.g. regulating differents parts of the machine, multimode copiers, microprocessor control
    • G03G15/5016User-machine interface; Display panels; Control console
    • G03G15/502User-machine interface; Display panels; Control console relating to the structure of the control menu, e.g. pop-up menus, help screens
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G15/00Apparatus for electrographic processes using a charge pattern
    • G03G15/50Machine control of apparatus for electrographic processes using a charge pattern, e.g. regulating differents parts of the machine, multimode copiers, microprocessor control
    • G03G15/5075Remote control machines, e.g. by a host
    • G03G15/5087Remote control machines, e.g. by a host for receiving image data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1202Dedicated interfaces to print systems specifically adapted to achieve a particular effect
    • G06F3/1211Improving printing performance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1223Dedicated interfaces to print systems specifically adapted to use a particular technique
    • G06F3/1237Print job management
    • G06F3/1253Configuration of print job parameters, e.g. using UI at the client
    • G06F3/1256User feedback, e.g. print preview, test print, proofing, pre-flight checks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1278Dedicated interfaces to print systems specifically adapted to adopt a particular infrastructure
    • G06F3/1285Remote printer device, e.g. being remote from client or server
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03GELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY
    • G03G2215/00Apparatus for electrophotographic processes
    • G03G2215/00025Machine control, e.g. regulating different parts of the machine
    • G03G2215/00109Remote control of apparatus, e.g. by a host
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1296Printer job scheduling or printer resource handling

Definitions

  • the present invention relates to an image processing apparatus, an image processing method, and an image processing program, which are capable of displaying a preview of image generated by image processing before outputting the image data.
  • MFP multi function peripheral
  • Japanese Laid-Open Patent Publication No. 10-126606 there is disclosed an image processing apparatus in which when a preview of an image obtained by operating a document is displayed on a display device, and if editing processing is instructed to a predetermined specified area of the image, an outer frame of the specified area is displayed, and processing contents within the area are also displayed as specific textual information.
  • Japanese Laid-Open Patent Publication No. 2007-036809 there is disclosed an image forming apparatus that displays a document scanning image with a staple position set on a preview screen. On this preview screen, the staple position and a screen area are simultaneously displayed at high speed with the image area shown simply.
  • the present invention is achieved to solve the above-described problem, and an object thereof is to provide an image processing apparatus, an image processing method and a storage medium that stores an image processing program, which are capable of quickly displaying a preview of an output image.
  • An image processing apparatus includes a display, and an input unit for receiving an operation by a user for user setting, an image processor for generating, by image-processing first image data in accordance with the user setting, second image data, and a controller for providing a preview display on the display prior to outputting the second image data.
  • the controller includes a first image generator for generating first preview image data from the first image data, and for displaying a first preview image on the display based on the generated first preview image data, and a second image generator for generating second preview image data corresponding to the second image data, and for updating the preview display on the display from the first preview image to a second preview image based on the generated second preview image data.
  • the image-processing includes image synthesis processing of synthesizing third image data on the first image data to thereby generate the second image data, and the first image generator generates the first preview image data that is changed in a screen appearance of an area corresponding to an area on the first image data in which the third image data is to be synthesized.
  • the second image generator generates the second preview image data from the second image data generated by the image processor.
  • the first image generator generates third preview image data having a smaller image size from the first image data, stores the generated third preview image data, and generates the first preview image data from the third preview image data, and the second image generator generates the second preview image data from the third preview image data stored by the first image generator.
  • the second image generator regenerates, in response to change of the user setting relating to the image synthesis processing, the second preview image data from the third preview image data stored by the first image generator.
  • the first image generator generates the first preview image data by executing at least any one of adding a frame indicating the area in which the third image data is to be synthesized, changing a characteristic value of a pixel included in the area in which the third image data is to be synthesized, and replacing the area in which the third image data is to be synthesized by a predetermined pattern image.
  • the image-processing includes image conversion processing of converting the first image data to the second image data having an output mode specified by the user setting, the image processor determines requirement of the image conversion processing based on an attribute of the first image data and the user setting, and executes the image conversion processing to generate the second image data when the image conversion processing is determined to be required.
  • the second image generator generates the second preview image data from the generated second image data when the image conversion processing to the first image data is executed by the image processor.
  • the first image generator generates the first preview image data having a smaller image size from the first image data, and stores the generated first preview image data, and the second image generator image-converts the first preview image data stored by the first image generator to generate the second preview image data.
  • the second image generator regenerates, in response to change of the user setting relating to the image conversion processing, the second preview image data from the first preview image data stored by the first image generator.
  • the controller causes the display to display, in addition to the preview display, that generation of the second preview image data is in processing in at least a part of a period between the time the first preview image is displayed and the time the displayed first preview image is updated to the second preview image.
  • an image processing method in an image processing apparatus having a display and an input unit.
  • the present image processing method includes the steps of generating, by image-processing first image data in accordance with user setting, second image data, and providing a preview display on the display prior to outputting the second image data.
  • the step of providing the preview display includes the steps of generating first preview image data from the first image data, displaying a first preview image on the display based on the generated first preview image data, generating second preview image data corresponding to the second image data, and updating the preview display on the display from the first preview image to a second preview image based on the generated second preview image data.
  • the image-processing includes image synthesis processing of synthesizing third image data on the first image data to thereby generate the second image data
  • the step of displaying the first preview image includes the step of generating the first preview image data that is changed in a screen appearance of a portion of an area corresponding to an area on the first image data in which the third image data is to be synthesized.
  • the step of displaying the second preview image data includes the step of generating the second preview image data includes the step of generating the second preview image data from the second image data.
  • the step of generating the first preview image data includes the steps of generating third preview image data having a smaller image size from the first image data, storing the generated third preview image data, and generating the first preview image data from the third preview image data
  • the step of generating the second preview image data includes the step of generating the second preview image data from the stored third preview image data.
  • the present image processing method further includes the step of regenerating, in response to change of the user setting relating to the image synthesis processing, the second preview image data from the stored third preview image data.
  • the step of displaying the first preview image includes the step of generating the first preview image data by executing at least any one of adding a frame indicating the area in which the third image data is to be synthesized, changing a characteristic value of a pixel included in the area in which the third image data is to be synthesized, and replacing the area in which the third image data is to be synthesized by a predetermined pattern image.
  • the image-processing includes image-conversion processing of converting the first image data to the second image data having an output mode specified by the user setting
  • the step of generating the second image data includes the steps of determining requirement of the image conversion processing based on an attribute of the first image data and the user setting, and executing the image conversion processing to generate the second image data when the image conversion processing is determined to be required.
  • the step of generating the second preview image data includes the step of generating the second preview image data from the generated second image data when the image conversion processing to the first image data is executed.
  • the steps of generating the first preview image data includes the steps of generating the first preview image data having a smaller image size from the first image data, and storing the generated first preview image data
  • the step of generating the second preview image data includes the step of image-converting the stored first preview image data to generate the second preview image data.
  • the present image processing method includes the step of regenerating, in response to change of the user setting relating to the image conversion processing, the second preview image data from the stored first preview image data.
  • the step of providing the preview display further includes the step of displaying that generation of the second preview image data is in processing in at least a part of a period between the time the first preview image is displayed and the time the displayed first preview image is updated to the second preview image.
  • a computer-readable medium that stores an image processing program for executing an image processing method in a computer having a display and an input unit.
  • the image processing program causes the computer to execute the steps of generating, by image-processing first image data in accordance with user setting, second image data, and providing a preview display on the display prior to outputting the second image data.
  • the step of providing the preview display including the steps of generating first preview image data from the first image data, displaying a first preview image on the display based on the generated first preview image data, generating second preview image data corresponding to the second image data, and updating the preview display on the display from the first preview image to a second preview image based on the generated second preview image data.
  • the preview display of the output image can be performed quickly.
  • FIG. 1 is a schematic configuration diagram of an overall system including an MFP according to Embodiment 1 of the present invention.
  • FIG. 2 is a schematic configuration diagram of hardware of the MFP according to Embodiment 1 of the present invention.
  • FIG. 3 is diagram showing a representative exterior appearance of an operation panel of the MFP according to Embodiment 1 of the present invention.
  • FIG. 4 is a schematic configuration diagram of hardware of a personal computer according to Embodiment 1 of the present invention.
  • FIGS. 5A and 5B are diagrams showing one example of a result of stamp processing executed in the MFP according to Embodiment 1 of the present invention.
  • FIG. 6 is a diagram showing another example of a result of the stamp processing executed in the MFP according to Embodiment 1 of the present invention.
  • FIGS. 7A and 7B are diagrams showing one example of a result of overlay processing executed in the MFP according to Embodiment 1 of the present invention.
  • FIG. 8 is a block diagram showing a control structure in the MFP according to Embodiment 1 of the present invention.
  • FIG. 9 is a diagram showing a screen example of a first stage of preview display according to Embodiment 1 of the present invention.
  • FIG. 10 is a diagram showing a screen example of a second stage of preview display according to Embodiment 1 of the present invention.
  • FIGS. 11A to 11C are diagrams showing a generation processing example of first preview image data according to Embodiment 1 of the present invention.
  • FIG. 12 is a diagram showing a first screen example for performing setting relating to image synthesis processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 13 is a diagram showing a second screen example for performing setting relating to the image synthesis processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 14 is a diagram showing a third screen example for performing setting relating to the image synthesis processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 15 is a diagram showing one example of contents of a user setting file stored in the MFP according to Embodiment 1 of the present invention.
  • FIG. 16 is a flowchart showing overall processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 17 is a flowchart showing processing of a preview display subroutine (step S 8 ) shown in FIG. 16 .
  • FIG. 18 is a block diagram showing a control structure in the MFP according to a modification of Embodiment 1 of the present invention.
  • FIG. 19 is a flowchart showing processing of the preview display subroutine (step S 8 ) shown in FIG. 16 , according to the modification of Embodiment 1 of the present invention.
  • FIG. 20 is a block diagram showing a control structure in an MFP according to Embodiment 2 of the present invention.
  • FIG. 21 is a diagram showing one example of contents of a user setting file and a page information file according Embodiment 2 of the present invention.
  • FIG. 22 is a diagram showing a screen example of a first stage of preview display according to Embodiment 2 of the present invention.
  • FIG. 23 is a diagram showing a screen example of a second stage of the preview display according to Embodiment 2 of the present invention.
  • FIG. 24 is a flowchart showing overall processing in the MFP according to Embodiment 2 of the present invention.
  • FIG. 25 is a flowchart showing processing of a preview display subroutine (step S 58 ) shown in FIG. 24 .
  • FIG. 26 is a block diagram showing a control structure in an MFP according to a modification of Embodiment 2 of the present invention.
  • FIG. 27 is a flowchart showing processing of the preview display subroutine (step S 58 ) shown in FIG. 24 , according to the modification of Embodiment 2 of the present invention.
  • a multi function peripheral (hereinafter, also referred to as MFP) having a plurality of functions such as a copy function (monochrome and/or color), printing function, facsimile transmission/reception function, and image scanning function is illustrated.
  • MFP multi function peripheral
  • the image processing apparatus according to the present invention may be implemented by a personal computer or the like.
  • an MFP 1 according to Embodiment 1 of the present invention and at least one personal computer PC are configured so as to be capable of intercommunicating data through a network NW.
  • MFP 1 can perform image processing in accordance with user setting to image data scanned by an image scanner (described later) mounted thereon, image data received from personal computer PC or another server device (not shown), image data of a facsimile received through a telephone line not shown or the like, and so on (hereinafter, collectively referred to as “input image data”) to thereby generate an image data (hereinafter, referred to as “output image data”).
  • the image data transmitted from personal computer PC may be created by a document creating application executed in the personal computer.
  • MFP 1 in accordance with a user operation, can perform processing such as printing-out of the output image data onto paper, transmission of the output image data by facsimile, storage in a recording medium of the output image data, download of the output image data to personal computer PC, upload of the output image data to the server device, and the like.
  • the “output” of the output image data collectively refers to processing of outputting the output image data itself or substance of the output image data outside MFP 1 as the image processing apparatus.
  • MFP 1 includes a CPU (Central Processing Unit) 101 , a ROM (Read Only Memory) 102 , a RAM (Random Access Memory) 103 , a hard disk 104 , an operation panel 105 , an image scanner 106 , a printer 107 , and a network interface 108 , and the respective units are interconnected through an internal bus 110 .
  • CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • CPU 101 is a processor that provides an image processing method according to the present embodiment by reading out, in RAM 103 , a program stored in ROM 102 , hard disk 104 , or the like in advance to execute the same.
  • ROM 102 stores the program to be executed in CPU 101 , various setting values and the like in a nonvolatile manner.
  • RAM 103 is a volatile storage device representatively including DRAM (Dynamic Random Access Memory), temporarily storing the program to be executed in a controller 100 , data necessary for the execution of the program, and the like. Particularly, RAM 103 temporarily stores image data generated in a process of image processing described later.
  • Hard disk 104 stores input image data scanned in image scanner 106 , input image data externally inputted through network NW or the like. When the storage function of the input image data by hard disk 104 is focused on, hard disk 104 is also referred to as “Box”.
  • Operation panel 105 is a user interface for receiving various user operations and displaying various types of information to a user.
  • FIG. 3 shows a representative exterior appearance of operation panel 105 of MFP 1 according to Embodiment 1 of the present invention.
  • operation panel 105 includes a plurality of operation keys such as ten keys 124 , a start key 128 and a stop key 130 , and a touch panel 122 .
  • Touch panel 122 includes a liquid crystal display (LCD) for displaying various types of information in MFP 1 , and a pressure-sensitive panel that is arranged on the liquid crystal display and receives a user operation by sensing its pressure. Specifically, in touch panel 122 , various types of information are displayed to the user, and buttons and icons for receiving respective operations to MFP 1 are displayed. When the pressure-sensitive panel senses that a user operation is performed in a position corresponding to any of the buttons, a command corresponding to that button is issued to CPU 101 ( FIG. 2 ) and the like. Particularly, MFP 1 according to the present embodiment can display a preview image of the output image data on touch panel 122 prior to outputting the output image data.
  • LCD liquid crystal display
  • image scanner 106 scans image information from a document to generate input image data. Specifically, image scanner 106 irradiates light from a light source to the document placed on a platen glass, and receives the light reflected from the document by an image pickup element or the like to thereby obtain the image information of the document. Alternatively, image scanner 106 may include a document feeder tray, a delivery roller, a resist roller, a carrier drum, a paper discharge tray, and the like so as to enable successive document scanning.
  • the input image data generated from the image information obtained by image scanner 106 is stored in hard disk 104 or the like.
  • printer 107 prints out the input image data stored in hard disk 104 or the like, or the output image data generated by performing image processing in accordance with user setting to the input image data.
  • printer 107 includes a photoreceptor drum, a charger, an exposure unit, a developing unit, a transfer unit, a static eliminator, a fixing device, a cleaning device and the like, and these mechanisms operate in series to thereby provide print processing.
  • Network interface 108 provides data intercommunication with another MFP 1 , personal computer or the like through network NW.
  • the user operates operation panel 105 to thereby provide user setting from operation panel 105 to CPU 101 .
  • this user setting specification of the input image to be subjected to image processing, contents of the image processing, and the like are included.
  • CPU 101 reads out the specified input image data from hard disk 104 , and performs the image processing to this read input image data in accordance with the user setting to generate the output image data.
  • This output image data is temporarily stored in RAM 103 .
  • preview display when preview display is instructed by the user, CPU 101 displays a preview corresponding to the output image data on operation panel 105 prior to outputting the generated output image data (for example, prior to printing-out).
  • Preview display denotes displaying an output image of the output image data, and generally, a resolution of the display is set to be lower than that of the output image data. The processing relating to this preview display will be described later. “Prior to outputting the output image data”, the output image data may not be generated actually. Namely, the output image data may be generated after the preview display ends.
  • the user checks this preview display, and determines whether or not the corresponding output image data is to be outputted.
  • CPU 101 outputs the output image data to printer 107 and the like.
  • FIG. 4 is a schematic configuration diagram of hardware of personal computer PC according to Embodiment 1 of the present invention.
  • personal computer PC typically, a known operating system (OS) is installed.
  • OS operating system
  • personal computer PC includes a CPU 201 that executes the operating system, and any application, a RAM (Random Access Memory) 203 that temporarily stores data necessary for the processing in CPU 201 , and a hard disk 204 that stores the operating system and the program executed in CPU 201 in a nonvolatile manner.
  • the program executed on personal computer PC is read from a CD-ROM (Compact Disk-Read Only Memory) 206 a, a flexible disk (FD) 207 a or the like, by a CD-ROM drive 206 or a flexible disk (FD) drive 207 , respectively.
  • CD-ROM Compact Disk-Read Only Memory
  • CPU 201 receives a command through an input unit 202 made up of a keyboard, a mouse and the like, and displays an output result obtained by the execution of the program, on a display 205 . Moreover, CPU 201 can intercommunicate data with MFP 1 through a network interface 208 made up of a LAN card or the like. The respective units are interconnected through an internal bus 209 .
  • the program for executing the image processing according to the present invention may be installed in personal computer PC to execute the program on personal computer PC.
  • personal computer PC corresponds to the image processing apparatus according to the present invention.
  • MFP 1 As one example of the image processing, image synthesis processing of synthesizing another image data on the input image data to thereby generate the output image data is enabled.
  • this image synthesis processing is described. More specifically, as a representative example of the image synthesis processing, stamp processing of synthesizing accessory information of a document, a fixed pattern and the like in a predetermined printing position, and overlay processing of superimposing a plurality of pieces of image data to generate one piece of image data are described.
  • the stamp processing is processing of specifying a printing position (synthesis area) within the input image data, and adding a textual image or a fixed pattern in the printing position to generate output image data.
  • a textual image a date/time, page number, numbering (serial number) and the like are included.
  • the fixed pattern “Urgent”, “Confidential” and the like are included.
  • FIGS. 5A and 5B show output image data 10 in which a textual image 14 indicating a date/time is synthesized on input image data 12 , as one example of a result of the stamp processing executed in MFP 1 according to Embodiment 1 of the present invention.
  • textual image 14 indicates “20 Sep. 2007” as the date, and “9:28 PM” as the time.
  • the date/time indicated by textual image 14 may indicate a time and date when the output image is generated, or may indicate a time and date when the input image data is generated.
  • the contents of the date/time are configured so that the user can freely set them.
  • characters to be added may be selected from ones predetermined by the user, or may be freely inputted by the user.
  • textual image 14 as describe above is added to a header portion at the upper left of input image data 12 as one example.
  • the printing position of this textual image 14 can be freely set by the user as will be described later.
  • FIG. 6 shows output image data 20 in which a fixed pattern 24 is added to input image data 22 , as another example of a result of the stamp processing executed in MFP 1 according to Embodiment 1 of the present invention.
  • output image data 20 is obtained by adding fixed pattern 24 indicating “URGENT” at the upper right of input image data 22 .
  • the overlay processing is processing of superimposing a plurality of pieces of image data to generate one piece of image data, and in many cases, a plurality of pieces of input image data selected by the user are superimposed to generate one piece of output image data.
  • FIGS. 7A and 7B show processing of generating output image data 30 from input image data 32 scanned from a document, and input image data 34 , which is a predefined form, as one example of a result of the overlay processing executed in MFP 1 according to Embodiment 1 of the present invention.
  • the plurality of pieces of input image data used in the overlay processing have almost the same size as one another.
  • the pixel information of the respective pixels making up the output image data is processed.
  • This overlay processing generates output image data 30 as shown in FIG. 7B .
  • MFP 1 includes, as a control structure, a reader 302 , an image processor 304 , a buffer 306 , an output unit 308 , a pattern storage 310 , a first preview image generator 312 , a second preview image generator 314 , a preview display controller 316 , and an input unit 318 .
  • buffer 306 is typically implemented by allocating a specific area of RAM 103
  • pattern storage 310 is implemented by allocating a specific area of hard disk 104 .
  • the other units are typically implemented by CPU 101 executing a control program. All or some included in the control structure may be implemented by hardware.
  • Input unit 318 outputs a corresponding internal command to a corresponding unit in accordance with an operation (user operation) of operation panel 105 ( FIGS. 2 and 3 ) by the user. Specifically, input unit 318 outputs a start instruction to reader 302 in accordance with the user operation, outputs user setting to image processor 304 and first preview image generator 312 , and outputs an output instruction to output unit 308 .
  • Reader 302 in response to the start instruction from input unit 318 , selectively reads out a specified one from input image data stored in hard disk 104 ( FIG. 2 ).
  • the source from which reader 302 reads out the input image data is not limited to hard disk 104 .
  • reader 302 reads out a plurality of pieces of input image data. Reader 302 then outputs the read one or plurality of pieces of input image data to image processor 304 and first preview image generator 312 .
  • image processor 304 Upon receiving the input image data from reader 302 , image processor 304 performs image processing (image synthesis processing) in accordance with the user setting received from input unit 318 to generate the output image data. When the synthesis of a fixed pattern is instructed in the user setting, the necessary fixed pattern is obtained from pattern storage 310 .
  • Pattern storage 310 has stored one or a plurality of fixed patterns in advance, and responds to a request from image processor 304 with the necessary fixed pattern.
  • the output image data generated in image processor 304 is temporarily stored in buffer 306 .
  • Output unit 308 outputs the output image data stored in buffer 306 to printer 107 ( FIG. 2 ) or the like in response to an output instruction from input unit 318 .
  • first preview image generator 312 operates so as to display a preview screen of the output image data on operation panel 105 ( FIGS. 2 and 3 ) when the preview display is instructed by the user.
  • Second preview image generator 314 generates preview image data from the output image data stored in buffer 306 .
  • the preview image data generated by this second preview image generator 314 is for simply displaying an output image, and an image size thereof is smaller than that of the output image data.
  • This preview image can be generated only after the output image data is generated by image processor 304 .
  • first preview image generator 312 generates a preview image by reducing the input image data read out by reader 302 .
  • This preview image generated by first preview image generator 312 is tentatively displayed on operation panel 105 until the generation of the preview image by second preview image generator 314 has been completed.
  • the preview display based on the preview image data generated by first preview image generator 312 (first stage) is provided, and then, the preview display based on the preview image data generated by second preview image generator 314 (second stage) is provided.
  • first preview image generator 312 is also referred to as a “first preview image”
  • second preview image is also referred to as a “second preview image”.
  • first preview image generator 312 includes an image reducing unit 312 a, a buffer 312 b, and an image processing unit 312 c.
  • Image reducing unit 312 a reduces the input image data to generate third preview image data that has an image size appropriate for the preview image.
  • This third preview image data generated by image reducing unit 312 a is temporarily stored in buffer 312 b.
  • image processing unit 312 c When the image synthesis processing is set as the user setting, image processing unit 312 c, in accordance with the user setting, changes a screen appearance of at least a portion of an area on the third preview image data corresponding to an area on the input image data in which another image data (the fixed pattern or the like) is to be synthesized. Image processing unit 312 c outputs the third preview image data in which the screen appearance of the object area has been changed is outputted as the first preview image data.
  • image processing unit 312 c specifies the area on the input image data to be subjected to the image synthesis processing, based on a type, a size, a printing position and the like of the pattern to be synthesized, which are included in the user setting.
  • Image processing unit 312 c specifies the area on the third preview image data corresponding to this specified area to change the screen appearance for all or a portion thereof.
  • first preview image generator 312 generates the preview image having the screen appearance enabling identification as to which area of the input image is to be subjected to the synthesis processing, until the second preview image data is generated by second preview image generator 314 .
  • Such processing relating to the generation of the first preview image data in first preview image generator 312 is made simpler than the image synthesis processing in image processor 304 , which enables quick preview display without making the user feel stress.
  • Preview display controller 316 when the first preview image data is generated by first preview image generator 312 , displays the preview on operation panel 105 based on the first preview image data. Subsequently to this image, when second preview image generator 314 generates the second preview image data, preview display controller 316 updates the display on operation panel 105 with the preview display based on the second preview image data.
  • image processing unit 312 c If the image synthesis processing is not set as the user setting, and when the preview display is instructed by the user, image processing unit 312 c outputs the third preview image data as the first preview image as it is without performing the change processing of screen appearance for the third preview image data. At this time, second preview image generator 314 does not generate the second preview image data.
  • FIGS. 9 and 10 an example of the preview display is described.
  • preview display when the stamp processing shown in FIG. 6 is executed is illustrated as one example of the image synthesis processing according to the user setting.
  • FIG. 9 shows a display example of the preview image based on the first preview image data
  • FIG. 10 shows a display example of the preview image based on the second preview image data.
  • Preview display controller 316 causes a preview window as shown in FIGS. 9 and 10 to be displayed on operation panel 105 ( FIGS. 2 and 3 ).
  • a job display button 402 , a setting contents button 404 , a preview button 406 and the like are arranged to the left side of this preview window.
  • job display button 402 and setting contents button 404 is pressed by the user, the display contents of operation panel 105 are changed to a job display window and a setting contents window not shown, respectively.
  • jobs in processing or waiting for processing in MFP 1 are displayed in a list.
  • the setting contents window as will be described later, change of various types of the user setting is acceptable.
  • the preview window shown in FIGS. 9 and 10 is also displayed by pressing preview button 406 while another window is being displayed.
  • a preview display area 410 is provided, and a preview image is displayed within this preview display area 410 .
  • a button group 412 for changing a size of the preview image displayed in preview display area 410 is arranged to the right side of preview display area 410 .
  • preview display controller 316 FIG. 8 ) enlarges or reduces the preview image, corresponding to the button.
  • FIG. 9 when the user first presses preview button 406 , the preview image based on the first preview image data generated by first preview image generator 312 ( FIG. 8 ) is displayed.
  • the screen appearance of at least a portion of the area corresponding to the area on the input image data in which another image data (fixed pattern or the like) is to be synthesized is changed.
  • FIG. 9 shows a preview image 420 in which a frame 422 indicating the area where the fixed pattern is to be synthesized is added.
  • image processor 304 ( FIG. 8 ) generates the output image data from the input image data
  • second preview image generator 314 ( FIG. 8 ) generates the second preview image data from the output image data.
  • the display on operation panel 105 is switched from the preview display shown in FIG. 9 to the preview display shown in FIG. 10 .
  • preview display area 410 a preview image 424 in which a fixed pattern 426 of “Urgent” has been synthesized on the input image is displayed.
  • preview display controller 316 displays a message 430 of “IMAGE SYNTHESIS IN PROCESSING” indicating that the second preview image data is being generated until the display is switched to the display of preview image 424 based on the second preview image data ( FIG. 10 ).
  • preview image 420 in which frame 422 indicating the area where the fixed pattern is to be synthesized is added to the input image is quickly displayed, and subsequently, preview image 424 corresponding to the output image data in which the fixed pattern has been synthesized is displayed
  • the user can check final output without feeling stress due to the time required for the image processing.
  • FIG. 9 the processing for generating the first preview image data in which the frame indicating the area to be synthesized is added has been described.
  • FIGS. 11A to 11C variation of the processing for generating the above-described first preview image data is illustrated.
  • FIG. 11A shows the first preview image data in which a frame 422 A indicating the area to be synthesized is added. A size, a shape, a printing position and the like of this frame 422 A are changed as needed by first preview image generator 312 in accordance with the fixed pattern to be synthesized.
  • FIG. 11B shows the first preview image data in which characteristic values of pixels included in an area 422 B to be synthesized are changed.
  • the first preview image data is changed in color information such as lightness, luminance, hue and the like of the pixels included in area 422 B in accordance with a predetermined rule.
  • the first preview image data in which the lightness of the pixels included in area 422 B is increased is generated.
  • FIG. 11C shows the first preview image data in which an area 422 C to be synthesized is replaced by a predetermined pattern image. Specifically, in the first preview image data, the predetermined pattern stored in advance is read out, and area 422 C is replaced by the predetermined pattern.
  • the user can also perform setting relating to the image processing (image synthesis processing). Referring to FIGS. 12 to 14 , such a setting method relating to the image synthesis processing is illustrated.
  • FIG. 12 shows a first screen example for performing the setting relating to the image synthesis processing in MFP 1 according to Embodiment 1 of the present invention.
  • FIG. 13 shows a second screen example for performing the setting relating to the image synthesis processing in MFP 1 according to Embodiment 1 of the present invention.
  • FIG. 14 shows a third screen example for performing the setting relating to the image synthesis processing in MFP 1 according to Embodiment 1 of the present invention.
  • the display contents on operation panel 105 are switched to a setting window as shown in FIG. 12 .
  • a setting window for selecting a desired one from a plurality of types of image processing including the image synthesis processing may be displayed.
  • a list display area 442 is arranged so that the user can select a desired one from the plurality of types of image synthesis processing.
  • processing contents executable as the image synthesis processing are displayed in a list.
  • list display area 442 there are arranged a “DATE/TIME” button for adding a date/time to the input image data, a “PAGE” button for adding a page number to the input image data, a “NUMBERING” button for adding a serial number to the image input data, a “FIXED STAMP” button for adding a fixed pattern to the input image data, a “WATERMARK” button for adding a background pattern to the input image data and the like.
  • a “DATE/TIME” button for adding a date/time to the input image data
  • PAGE for adding a page number to the input image data
  • NUMBERING for adding a serial number to the image input data
  • FIXED STAMP for adding a fixed pattern to the input image data
  • WATERMARK for adding a background pattern to the input image data and the like.
  • the corresponding button in this case, the “FIXED STAMP” button
  • the corresponding button may be displayed so as to be differentiated from the other buttons in the screen appearance.
  • the setting window shown in FIG. 13 is for setting more detailed contents of the “FIXED STAMP” processing.
  • printing-position display areas 444 and 452 and list display areas 450 and 454 are arranged.
  • printing-position display area 444 a total of nine areas resulting from vertically dividing the printing area into three and horizontally dividing the same into three are displayed graphically, and an indicator is displayed in an area corresponding to a position set by the user for synthesizing the fixed stamp among these nine areas.
  • printing-position display area 452 the position set by the user for synthesizing the fixed stamp is displayed in a text.
  • list display area 450 fixed patterns selectable in the “FIXED STAMP” processing are displayed in a list. Moreover, in list display area 454 is displayed a button for selecting an object page on which the selected pattern is to be printed. More specifically, in list display area 454 , there are arranged an “ONLY FRONT COVER” button for setting printing of the fixed stamp only on a first page of the input image data, and an “ALL PAGES” button for setting printing of the fixed stamp on all pages of the input image data.
  • the setting window shown in FIG. 14 is for setting the printing position of the fixed stamp. Specifically, in the setting window shown in FIG. 14 , printing-position display area 444 , a printing-position specifying area 446 , and a fine-adjustment display area 448 are arranged. Printing-position display area 444 is similar to that displayed in the setting window in FIG. 13 . In printing-position specifying area 446 , nine printing positions are selectably displayed in a list, corresponding to the nine areas displayed graphically in printing-position display area 444 .
  • fine-adjustment display area 448 statuses of the fine adjustment to any of the areas selected in printing-position specifying area 446 (e.g., “upper left”) are displayed. Moreover, in fine-adjustment display area 448 , an “adjustment change” button for selecting a setting window (not shown) for performing the above-described fine adjustment is also displayed.
  • the user can perform the setting relating to the image synthesizing processing by performing a desired operation to the setting window as shown in FIGS. 12 to 14 .
  • the user presses a “close” button 456 to thereby reflect the setting contents.
  • the contents set by the user on the setting windows as shown in FIGS. 12 to 14 are outputted to image processor 304 ( FIG. 8 ) and the like through input unit 318 ( FIGS. 8 ).
  • These contents of the user setting may be temporarily stored in RAM 103 ( FIG. 2 ) or may be stored in hard disk 104 ( FIG. 2 ) as a file (user setting file).
  • the file is preferably associated with the input image data to which the user setting is applied. This configuration allows the corresponding user setting file to be read out together with the input image data, when the user selects the input image data of interest.
  • FIG. 15 shows one example of the contents of the user setting file stored in MFP 1 according to Embodiment 1 of the present invention.
  • a “BOX FILE ID” for specifying the associated input image data is defined in the user setting file. Moreover, in the user setting file, items such as a “DATE/TIME”, “PAGE NUMBER”, “HEADER/FOOTER”, “STAMP”, “OVERLAY SYNTHESIS” and the like are provided for specifying requirement for the respective processing items.
  • the above-described contents of the user setting file may be set by another apparatus such as personal computer PC, besides the embodiment in which the user operates operation panel 105 to set them.
  • the above-described user setting file may be outputted concurrently with the creation of the input image data from a document.
  • the contents of the user setting file can be set on a printer driver installed in personal computer PC.
  • a Web-based user interface may be provided.
  • CPU 101 of MFP 1 executes a program for providing a Web server, and this Web server provides a Web-based interface for receiving the user setting on a browser application on personal computer PC connected through network.
  • first preview image generator 312 regenerates the first preview image data based on the input image data.
  • image processor 304 also performs the image processing in accordance with the user setting after the change to regenerate the output image data.
  • second preview image generator 314 regenerates the second preview image data from this regenerated output image data.
  • the preview images as shown in FIG. 9 and FIG. 10 are redisplayed based on the first and second preview image data generated by first and second preview image generators 312 and 314 , respectively.
  • the user can set the contents of the desired image synthesis processing while checking the final output.
  • a user who will perform some image synthesis processing to an input image data to output output image data operates operation panel 105 to select an input image as an object, and inputs user setting relating to the image synthesis processing (step S 2 ).
  • This user setting is stored in RAM 103 , hard disk 104 or the like.
  • input unit 318 After inputting the user setting, when the user presses start key 128 on operation panel 105 , input unit 318 outputs a start instruction to CPU 101 functioning as reader 302 . In response to this start instruction, CPU 101 functioning as reader 302 reads out the specified input image data from hard disk 104 (step S 4 ). If a user setting file is stored in hard disk 104 in advance, CPU 101 also reads out the user setting file corresponding to the input image data together with the specified input image data.
  • CPU 101 determines whether or not the preview display is instructed by the user (step S 6 ). If the preview display is instructed (in a case of YES in step S 6 ), CPU 101 executes a preview display subroutine (step S 8 ) to display a preview image on operation panel 105 . After the execution of this preview display subroutine, CPU 101 determines whether or not the display of the setting windows is instructed by the user (step S 10 ).
  • CPU 101 displays the setting windows as shown in FIGS. 12 to 14 (step S 12 ). Furthermore, CPU 101 determines whether or not change of the user setting is instructed on any of the setting windows (step S 14 ).
  • CPU 101 If any change of the user setting is instructed on the setting window (in a case of YES in step S 14 ), CPU 101 reflects the change contents on the user setting stored in RAM 103 or the like to update the contents of the user setting (step S 16 ). CPU 101 again executes the preview display subroutine based on the changed setting (step S 8 ) to update the preview image on operation panel 105 .
  • step S 18 determines whether or not the output of the output image data is instructed.
  • step S 18 If the output of the output image data is instructed (in a case of YES in step S 18 ), CPU 101 functioning as image processor 304 performs the image processing (image synthesis processing) to the input image data read out in step S 4 in accordance with the user setting to generate the output image data (step S 20 ).
  • This output image data is stored in RAM 103 functioning as buffer 306 .
  • CPU 101 functioning as output unit 308 outputs the output image data generated in step S 12 (step S 22 ). Then, a series of processing ends. If the output image data has been already generated for displaying the preview image, the processing in step S 20 may be skipped.
  • step S 18 CPU 101 repeatedly executes the processing in step S 6 and later.
  • CPU 101 functioning as image reducing unit 312 a reduces the input image data read out in step S 4 in FIG. 16 to generate the third preview image data (step S 80 ).
  • This third preview image data is stored in RAM 103 functioning as buffer 312 b.
  • CPU 101 functioning as image processing unit 312 c determines whether or not the image synthesis processing is set as the user setting (step S 81 ).
  • CPU 101 functioning as image processing unit 312 c outputs the third preview image data stored in RAM 103 as the first preview image data.
  • CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (the same as the third preview image data) (step S 82 ). Then, the preview display subroutine ends, and the processing returns to step S 10 in FIG. 16 .
  • CPU 101 functioning as image processing unit 312 c changes the screen appearance of a predetermined area of the third preview image data based on the contents of the user setting to generate the first preview image data (step S 83 ).
  • CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (step S 84 ).
  • CPU 101 displays the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 (step S 85 ).
  • CPU 101 functioning as image processor 304 performs the image processing (image synthesis processing) to the input image data read out in step S 4 in FIG. 16 , in accordance with the user setting to generate the output image data (step S 86 ).
  • This output image data is stored in RAM 103 functioning as buffer 306 .
  • CPU 101 functioning as second preview image generator 314 reduces the output image data generated in step S 85 to generate second preview image data (step S 87 ).
  • CPU 101 functioning as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S 88 ). At this time, CPU 101 makes the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 undisplayed.
  • the preview image based on the first preview image data generated from the input image data is first displayed quickly, and subsequently to this image, the preview image based on the second preview image data generated from the output image data is displayed. This can alleviate stress that the user feels due to time required for the preview display.
  • Embodiment 1 of the present invention since in the first preview image data, the frame indicating an area to be subjected to the image synthesis, and the like are added, the user can, in advance, visually confirm the area where a fixed pattern or the like is synthesized. Thus, the user can quickly set the contents of the desired image synthesis processing while checking the final output.
  • Embodiment 1 of the present invention a configuration in which the generation processing of the second preview image data corresponding to the output image data is modified is illustrated. Basically, configurations other than the configuration relating to the generation of the second preview image data are similar to those of the above-described Embodiment 1, and thus, a detailed description thereof is not repeated.
  • a second preview image generator 314 # is provided in place of second preview image generator 314 in the control structure of MFP 1 according to Embodiment 1 shown in FIG. 8 .
  • the other units are similar to those in FIG. 8 , and thus, a detailed description thereof is not repeated.
  • image processor 304 While in MFP 1 according to Embodiment 1, image processor 304 temporarily generates the output image data for displaying a preview image on operation panel 105 , in MFP 1 # according to the modification of Embodiment 1, a preview image can be displayed without the generation of the output image data by image processor 304 .
  • second preview image generator 314 # generates the second preview image data based on the third preview image data generated by image reducing unit 312 a included in first preview image generator 312 .
  • second preview image generator 314 # performs the image processing (image synthesis processing) equivalent to that of image processor 304 to the third preview image data stored in buffer 312 b, in accordance with the user setting to generate the second preview image data. If the synthesis of a fixed pattern is instructed in the user setting, second preview image generator 314 # also obtains the necessary fixed pattern from pattern storage 310 .
  • the second preview image data is generated from the third preview image data, which has a smaller image size than that of the input image data (and the output image data).
  • an amount of processing relating to the generation of the second preview image data can be reduced, so that the preview display can be further speeded up.
  • first preview image generator 312 regenerates the first preview image data from the input image data
  • second preview image generator 314 # regenerates the second preview image data from the third preview image data restored in buffer 312 b.
  • FIG. 19 is a flowchart showing the processing according to the modification of the present embodiment of the preview display subroutine shown in FIG. 16 (step S 8 ). Among processing steps shown in FIG. 19 , the same symbols are given to those having the processing contents similar to those in the processing steps shown in FIG. 17 .
  • CPU 101 functioning as image reducing unit 312 a reduces the input image data read out in step S 4 of FIG. 16 to generate the third preview image data (step S 80 ).
  • This third preview image data is stored in RAM 103 functioning as buffer 312 b.
  • CPU 101 functioning as image processing unit 312 c determines whether or not the image synthesis processing is set as the user setting (step S 81 ).
  • CPU 101 functioning as image processing unit 312 c outputs the third preview image data stored in RAM 103 as the first preview image data.
  • CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (the same as the third preview image data) (step S 82 ). Then, the preview display subroutine ends, and the processing returns to step S 10 in FIG. 16 .
  • CPU 101 functioning as image processing unit 312 c changes the screen appearance of a predetermined area of the third preview image data based on the contents of the user setting to generate the first preview image data (step S 83 ).
  • CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (step S 84 ).
  • CPU 101 displays the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 (step S 85 ).
  • CPU 101 functioning as second preview image processor 314 # performs the image processing (image synthesis processing) to the third preview image data stored in RAM 103 , in accordance with the user setting to generate the second preview image data (step S 87 A).
  • CPU 101 functioning as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S 88 ).
  • CPU 101 makes the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 undisplayed.
  • the preview image based on the second preview image data can be displayed more quickly.
  • Embodiment 2 While in the above-described Embodiment 1, the configuration in which the image synthesis processing is executed as one example of the image processing is illustrated, in Embodiment 2 described below, a configuration in which image conversion processing of converting the input image data to second image data having a specified output mode is executed is illustrated as one example of the image processing.
  • Embodiment 2 The overall system according to Embodiment 2, a hardware configuration of an MFP 2 according to Embodiment 2 and the like are similar to those in the above-described Embodiment 1, and thus, a detailed description thereof is not repeated.
  • MFP 2 includes, as a control structure, reader 302 , an image processor 305 , buffer 306 , output unit 308 , a first preview image generator 313 , a second preview image generator 315 , preview display controller 316 , input unit 318 , a determining unit 320 , and a determination table storage 322 .
  • buffer 306 is typically implemented by allocating a specific area of RAM 103
  • determination table storage 322 is implemented by allocating a specific area of hard disk 104 .
  • the other units are typically implemented by CPU 101 executing a control program. All or some included in the control structure may be implemented by hardware.
  • Input unit 318 outputs a corresponding internal command to the corresponding unit in accordance with an operation (user operation) of operation panel 105 ( FIGS. 2 and 3 ) by the user. Specifically, input unit 318 outputs a start instruction to reader 302 , outputs user setting to determining unit 320 , and outputs an output instruction to output unit 308 in accordance with the user operation. In this user setting, the setting of an output mode of output image data is included. The output mode indicates an attribute of the output image data (e.g., image format, image gradation or the like). In the present embodiment, as one example, the output mode setting includes two items of “output application” and “output color”.
  • Reader 302 in response to a start instruction from input unit 318 , selectively reads out a specified input image data from hard disk 104 ( FIG. 2 ).
  • hard disk 104 a page information file in which attributes (typically, image format, image gradation and the like) of the input image data are described has been stored in association with the input image data.
  • This page information file is also generated at the time of generation of the input image data.
  • the contents of the page information file may be incorporated in a portion of the input image data, and in this case, the input image data and the page information file can be dealt with as integrated data (file). Details of this page information file will be described later.
  • image scanner 106 FIG. 2
  • the contents of the page information file may be concurrently outputted from image scanner 106 .
  • Reader 302 outputs the read input image data to image processor 305 and first preview image generator 313 , and outputs the read page information file to determining unit 320 .
  • a “BOX FILE ID” for specifying the input image data to be subjected to the image processing is defined in a user setting file according to Embodiment 2 of the present invention.
  • the two items of “OUTPUT APPLICATION” and “OUTPUT COLOR” for specifying the output mode are also defined.
  • a “PAGE NUMBER” of the input image data to be subjected to the image processing is defined, and the association with the page information file is defined for each page.
  • the contents of the user setting file may be set by another apparatus such as personal computer PC and the like, besides the aspect in which the user operates operation panel 105 for setting.
  • a Web-based interface may be provided.
  • Determining unit 320 determines requirement for the image conversion processing, based on the contents of the output mode setting included in the user setting (values of the “OUTPUT APPLICATION” and the “OUTPUT COLOR”), and the contents of the page information file associated with the specified input image data. In this determination, determining unit 320 refers to a determination table 322 a stored in determination table storage 322 .
  • determination table 322 a one example of the contents of determination table 322 a is shown.
  • Determining unit 322 selects corresponding minor items of the “User setting (Output mode)” based on the contents of the user setting, selects corresponding minor items of the “Page information” based on the contents of the page information file, and obtains a value of the “Conversion requirement” (namely “Required” or “Not required”) corresponding to a combination of these selected minor items. Determining unit 320 determines requirement of the image conversion processing based on this obtained value.
  • the minor items of the “Output application” in determination table 322 a three items of “Printing-out”, “Scanning-out” and “Facsimile” are defined.
  • the “Printing-out” indicates a case where the setting is made so that the output image data is printed out.
  • the “Scanning-out” indicates a case where the setting is made so that the output image data is stored in hard disk 104 .
  • the “Facsimile” indicates a case where the setting is made so that the output image data is transmitted by facsimile.
  • color modes in accordance with corresponding output destinations are defined.
  • determining unit 320 determines that the image conversion processing is “Required”, it outputs a conversion instruction to image processor 305 and second preview generator 315 .
  • This conversion instruction includes the contents of the “Format of preview image data” (values of “Format information” and “Gradation information”) corresponding to determination table 322 a.
  • image processor 305 and second preview image generator 315 generate, from the input image data, the output image data or the second preview image data having the output mode specified in accordance with the “Format information” and “Gradation information” included in the conversion instruction.
  • determining unit 320 determines that the image conversion processing is “Not required”, no conversion instruction is outputted.
  • Image processor 305 upon receiving the input image data from reader 302 , performs the image processing (image conversion processing) in accordance with the conversion instruction only when the conversion instruction is received from determining unit 302 , and generates the output image data.
  • the output image data generated in image processor 305 is temporarily stored in buffer 306 .
  • Output unit 308 outputs the output image data stored in buffer 306 to printer 107 ( FIG. 2 ) and the like in response to an output instruction from input unit 318 .
  • first preview image generator 313 operates to display a preview of the output image data on operation panel 105 , when the preview display is instructed by the user.
  • second preview image generator 315 operates only when the image conversion processing is determined to be “Required” by determining unit 320 , that is, only when the conversion instruction is outputted from determining unit 320 .
  • first preview image generator 313 includes an image reducing unit 313 a and a buffer 313 b.
  • Image reducing unit 313 a reduces the input image data to generate the first preview image data that has an image size appropriate for the preview image.
  • This first preview image data generated by image reducing unit 313 a is temporarily stored in buffer 313 b, and is outputted to preview display controller 316 .
  • second preview image generator 315 generates the preview image data from the output image data stored in buffer 306 . More specifically, second preview image generator 315 reduces the output image data into the image size appropriate for the preview image to generate the second preview image data.
  • preview display controller 316 displays the preview image on operation panel 105 based on the first preview image data (first stage). Subsequently to this image, when the second preview image data is generated by second preview image generator 315 , the display on operation panel 105 is updated to the preview image based on the second preview image data (second stage).
  • preview display controller 316 maintains the display of the preview image based on the first preview image data.
  • FIGS. 22 and 23 one example of the preview display is described.
  • the preview display in a case where color input image data is outputted in monochrome is illustrated.
  • FIG. 22 shows a display example of the preview image based on the first preview image data
  • FIG. 23 shows a display example of the preview image based on the second preview image data.
  • Preview display controller 316 ( FIG. 20 ) causes a preview window as shown in FIGS. 22 and 23 to be displayed on operation panel 105 ( FIGS. 2 and 3 ).
  • This preview window is provided with preview display area 410 , and in this preview display area 410 , the preview image is displayed.
  • job display button 402 setting contents button 404 , preview button 406 and the like are arranged to the left side of the preview window.
  • button group 412 for changing a size of the preview image displayed in preview display area 410 is arranged to the right side of preview display area 410 . The operation when any one of these buttons is pressed is similar to that in FIGS. 9 and 10 , and thus, a detailed description thereof is not repeated.
  • the preview image based on the first preview image data generated by first preview image generator 313 ( FIG. 20 ) is displayed. Since the first preview image data is outputted as a color image similarly to the input image data, it is also displayed in color as the preview image.
  • image processor 304 ( FIG. 20 ) generates the output image data from the input image data.
  • second preview image generator 315 generates the second preview image data from the output image data.
  • the display on operation panel 105 is switched from the preview display shown in FIG. 21 to the preview display shown in FIG. 22 . Since the second preview image data is outputted as a monochrome image similarly to the output image data, which corresponds the input image data after the conversion, it is also displayed in monochrome as the preview image.
  • preview display controller 316 displays a message 430 of “IMAGE DATA CONVERSION IN PROCESSING” indicating that the second preview image data is being generated, until the display is switched to a preview image 480 based on the second preview image data ( FIG. 23 ).
  • preview image 470 corresponding to the input image is first displayed quickly, and subsequently, preview image 480 corresponding to the output image data obtained by converting the input image data is displayed.
  • the user can check final output without feeling stress due to time required for performing the image processing.
  • first preview image generator 313 regenerates the first preview image data from the input image data.
  • image processor 305 also performs the image processing in accordance with the user setting after the change to regenerate the output image data.
  • second preview image generator 315 regenerates the second preview image data from this regenerated output image data. In this manner, the preview images as shown in the above-described FIGS. 22 and 23 are redisplayed based on the first and second preview image data generated by first and second preview image generators 313 and 315 , respectively.
  • the regeneration processing of the preview image may not be performed.
  • a user who will output an input image data to a specific output destination operates operation panel 105 to select the input image data as an object, and to set an output mode (step S 52 ).
  • This output mode setting (user setting) is stored in RAM 103 , hard disk 104 or the like.
  • input unit 318 When the user presses start key 128 on operation panel 105 after setting the output mode, input unit 318 outputs a start instruction to CPU 101 functioning as reader 302 . In response to this start instruction, CPU 101 functioning as reader 302 reads out the specified input image data and a corresponding page information file from hard disk 104 (step S 54 ). If the user setting file including the output mode setting is stored in hard disk 104 in advance, CPU 101 also reads out the user setting file.
  • CPU 101 determines whether or not the preview display is instructed by the user (step S 56 ). If the preview display is instructed (in a case of YES in step S 56 ), CPU 101 executes a preview display subroutine (step S 58 ) to display a preview image on operation panel 105 . After the execution of this preview display subroutine, CPU 101 determines whether or not the display of the setting window is instructed by the user (step S 60 ).
  • CPU 101 displays the setting window for changing the output mode setting (user setting) on operation panel 105 (step S 62 ). Furthermore, CPU 101 determines whether or not change of the user setting is instructed on the setting window (step S 64 ).
  • CPU 101 If any change of the output mode is instructed on the setting window (in a case of YES in step S 64 ), CPU 101 reflects the change contents on the stored output mode setting (user setting) to update the contents of the output mode setting (step S 66 ). CPU 101 again executes the preview display subroutine based on the output mode setting after this change (step S 58 ) to update the preview image on operation panel 105 .
  • step S 56 determines whether or not the output of the output image data is instructed (step S 68 ).
  • CPU 101 functioning as determining unit 320 determines whether or not the image conversion processing is required based on the contents of the output mode setting and the contents of the page information file associated with the specified input image data (step S 70 ).
  • step S 70 If the image conversion processing is determined to be required (in a case of YES in step S 70 ), CPU 101 functioning as image processor 305 performs the image processing (image conversion processing) to the input image data read out in step S 54 in accordance with the specified output mode setting to generate the output image data (step S 72 ).
  • This output image data is stored in RAM 103 functioning as buffer 306 .
  • step S 70 CPU 101 functioning as image processor 305 generates the input image data read out in step S 54 as the output image data as it is (step S 74 ).
  • CPU 101 functioning as output unit 308 outputs the output image data generated in step S 72 or in step S 74 (step S 76 ). Then, a series of processing ends.
  • step S 72 If the output image data has been already generated for displaying the preview image, the processing in step S 72 or in step S 74 may be skipped.
  • step S 68 CPU 101 repeatedly executes the processing in step S 56 and later.
  • CPU 101 functioning as image reducing unit 313 a reduces the input image data read out in step S 54 of FIG. 24 to generate the first preview image data (step S 180 ).
  • This first preview image data is stored in RAM 103 functioning as buffer 313 b.
  • CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (step S 181 ).
  • CPU 101 functioning as determining unit 320 determines whether or not the image conversion processing is required based on the contents of the output mode setting and the contents of the page information file associated with the specified input image data (step S 182 ).
  • CPU 101 functioning as preview display controller 316 displays the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 (step S 183 ). Subsequently, CPU 101 functioning as image processor 305 performs the image processing (image conversion processing) to the input image data read out in step S 54 of FIG. 24 , in accordance with the specified output mode setting to generate the output image data (step S 184 ). This output image data is stored in RAM 103 functioning as buffer 306 .
  • CPU 101 functioning as second preview image generator 315 reduces the output image data generated in step S 184 to generate the second preview image data (step S 185 ).
  • CPU 101 functioning as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S 186 ).
  • CPU 101 makes the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 undisplayed. The processing then returns to step S 60 in FIG. 24 .
  • CPU 101 determines whether the image conversion processing is determined to be not required (in a case of NO in step S 182 ). If the image conversion processing is determined to be not required (in a case of NO in step S 182 ), CPU 101 generates neither of the output image data and the second preview image data, and ends the preview display subroutine with the display of the first preview image maintained. The processing then returns to step S 60 in FIG. 24 .
  • the preview image based on the first preview image data generated from the input image data is first displayed quickly, and subsequently to this image, if the image conversion processing is required, the second preview image data is generated from the output image data after the image conversion, and the preview image based on this second preview image data is displayed.
  • This can alleviate stress that the user feels due to the time required for the preview display, and the contents relating to the desired image conversion processing can be set quickly.
  • Embodiment 2 of the present invention a configuration in which the generation processing of the second preview image data corresponding to the output image data is modified is illustrated. Basically, configurations other than the configuration relating to the generation of the second preview image data are similar to those of the above-described Embodiment 1 or 2, and thus, a detailed description thereof is not repeated. ⁇ Control Structure>
  • a second preview image generator 315 # is provided in place of second preview image generator 315 in the control structure of MFP 2 according to Embodiment 2 shown in FIG. 20 .
  • the other units are similar to those in FIG. 20 , and a detailed description thereof is not repeated.
  • image processor 305 While in MFP 2 according to Embodiment 2, image processor 305 temporarily generates the output image data for displaying a preview image on operation panel 105 , in MFP 2 # according to the modification of Embodiment 2, a preview image can be displayed without the generation of the output image data by image processor 305 .
  • second preview image generator 315 # generates the second preview image data based on the first preview image data generated by image reducing unit 313 a included in first preview image generator 313 .
  • second preview image generator 315 # performs the image processing (image conversion processing) equivalent to that of image processor 305 to the first preview image data stored in buffer 313 b, in accordance with the specified output mode setting to generate the second preview image data.
  • the second preview image data is generated from the first preview image data, which has a smaller image size than that of the input image data.
  • an amount of processing relating to the generation of the second preview image data can be reduced, so that the preview display can be further speeded up.
  • second preview image generator 315 # regenerates the second preview image data from the first preview image data stored in buffer 313 b of the first preview image generator 313 .
  • Image reducing unit 313 a does not need to regenerate the first preview image, unless the specified input image data is changed.
  • FIG. 27 shows a flowchart showing the processing according to the modification of the present embodiment of the preview display subroutine shown in FIG. 24 (step S 58 ).
  • step S 58 the same symbols are given to those having the processing contents similar to those of the processing steps shown in FIG. 25 .
  • CPU 101 functioning as image reducing unit 313 a reduces the input image data read out in step S 54 in FIG. 24 to generate the first preview image data (step S 180 ).
  • This first preview image data is stored in RAM 103 functioning as buffer 313 b.
  • CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image (step S 181 ).
  • CPU 101 functioning as determining unit 320 determines whether or not the image conversion processing is required based on the contents of the output mode setting and the contents of the page information file associated with the specified input image data (step S 182 ).
  • CPU 101 functioning as preview display controller 316 displays the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 (step S 183 ).
  • CPU 101 functioning as second preview image generator 315 # performs the image processing (image conversion processing) to the first preview image data stored in RAM 103 in accordance with the specified output mode setting to generate the second preview image data (step S 185 A).
  • CPU 101 functioning as the preview as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S 186 ).
  • CPU 101 makes the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 undisplayed.
  • the processing returns to steps S 60 in FIG. 24 .
  • step S 182 CPU 101 does not generate the second preview image data, and ends the preview display subroutine with the display of the first preview image maintained. The processing returns to step S 60 in FIG. 24 .
  • the preview image based on the second preview image data can be more quickly displayed.
  • the image processing apparatus according to the present invention may be implemented using a personal computer on which a document creation application and the like are executed.
  • installing an image processing program according to the present invention in the personal computer allows the personal computer to function as the image processing apparatus according to the present invention.
  • the document creation application executed in the personal computer may generate input image data as an object.
  • the image processing program according to the present invention may also read out necessary modules in a predetermined sequence and at predetermined timing among program modules provided as a part of the operating system so as to cause the modules to execute the processing.
  • the above-described modules may not be included in the program itself, but the processing may be executed in cooperation with the operating system.
  • the program not including the above-described modules can also be included by the program according to the present invention.
  • the image processing program according to the present invention may also be provided by being incorporated in a part of another program. Also, in this case, the modules included in the above-described another program are not included in the program itself, but the processing is executed in cooperation with the other program.
  • the above-described program incorporated in the other program can also be included by the program according to the present invention.
  • a provided program product is installed in a program storage such as a hard disk to be executed.
  • the program product includes the program itself, and a storage medium in which the program is stored.

Abstract

On an operation panel, a preview image based on first preview image data generated by a first preview image generator is displayed (first stage), and then, a preview image based on second preview image data generated by a second preview image generator is displayed (second stage). An image reducing unit reduces input image data into an image size appropriate for the preview image to generate third preview image data. When image synthesis processing is set as user setting, an image processing unit changes, in accordance with the user setting, a display aspect of at least a portion of an area on the third preview image data corresponding to an area on the input image data in which another image data (a fixed pattern or the like) is to be synthesized.

Description

  • This application is based on Japanese Patent Application No. 2008-135830 filed with the Japan Patent Office on May 23, 2008, the entire content of which is hereby incorporated by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to an image processing apparatus, an image processing method, and an image processing program, which are capable of displaying a preview of image generated by image processing before outputting the image data.
  • 2. Description of the Related Art
  • With recent progress of information and communication technology, the amount of printed-out paper has increased. Meanwhile, it is preferable from an environmental point of view to reduce wasteful printing-out as much as possible, thereby achieving resource saving. Therefore, among image processing apparatuses such as a multi function peripheral (hereinafter, also referred to as “MFP”), there are ones with a function of displaying a print image prior to printing-out the same on paper, so called preview display function.
  • For example, in Japanese Laid-Open Patent Publication No. 10-126606, there is disclosed an image processing apparatus in which when a preview of an image obtained by operating a document is displayed on a display device, and if editing processing is instructed to a predetermined specified area of the image, an outer frame of the specified area is displayed, and processing contents within the area are also displayed as specific textual information.
  • Moreover, in Japanese Laid-Open Patent Publication No. 2007-036809, there is disclosed an image forming apparatus that displays a document scanning image with a staple position set on a preview screen. On this preview screen, the staple position and a screen area are simultaneously displayed at high speed with the image area shown simply.
  • In recent years, processing such as image processing and image editing has been increasingly sophisticated. For such sophisticated image processing, relatively much time is often required, and thus, there has been a problem that time from an operation by a user for displaying a preview image to actual display of the preview image on a display device is long.
  • SUMMARY OF THE INVENTION
  • The present invention is achieved to solve the above-described problem, and an object thereof is to provide an image processing apparatus, an image processing method and a storage medium that stores an image processing program, which are capable of quickly displaying a preview of an output image.
  • An image processing apparatus according to an aspect of the present invention includes a display, and an input unit for receiving an operation by a user for user setting, an image processor for generating, by image-processing first image data in accordance with the user setting, second image data, and a controller for providing a preview display on the display prior to outputting the second image data. The controller includes a first image generator for generating first preview image data from the first image data, and for displaying a first preview image on the display based on the generated first preview image data, and a second image generator for generating second preview image data corresponding to the second image data, and for updating the preview display on the display from the first preview image to a second preview image based on the generated second preview image data.
  • Preferably, the image-processing includes image synthesis processing of synthesizing third image data on the first image data to thereby generate the second image data, and the first image generator generates the first preview image data that is changed in a screen appearance of an area corresponding to an area on the first image data in which the third image data is to be synthesized.
  • More preferably, the second image generator generates the second preview image data from the second image data generated by the image processor.
  • Alternatively, more preferably, the first image generator generates third preview image data having a smaller image size from the first image data, stores the generated third preview image data, and generates the first preview image data from the third preview image data, and the second image generator generates the second preview image data from the third preview image data stored by the first image generator.
  • More preferably, the second image generator regenerates, in response to change of the user setting relating to the image synthesis processing, the second preview image data from the third preview image data stored by the first image generator.
  • Alternatively, more preferably, the first image generator generates the first preview image data by executing at least any one of adding a frame indicating the area in which the third image data is to be synthesized, changing a characteristic value of a pixel included in the area in which the third image data is to be synthesized, and replacing the area in which the third image data is to be synthesized by a predetermined pattern image.
  • Moreover, preferably, the image-processing includes image conversion processing of converting the first image data to the second image data having an output mode specified by the user setting, the image processor determines requirement of the image conversion processing based on an attribute of the first image data and the user setting, and executes the image conversion processing to generate the second image data when the image conversion processing is determined to be required.
  • More preferably, the second image generator generates the second preview image data from the generated second image data when the image conversion processing to the first image data is executed by the image processor.
  • Alternatively, more preferably, the first image generator generates the first preview image data having a smaller image size from the first image data, and stores the generated first preview image data, and the second image generator image-converts the first preview image data stored by the first image generator to generate the second preview image data.
  • More preferably, the second image generator regenerates, in response to change of the user setting relating to the image conversion processing, the second preview image data from the first preview image data stored by the first image generator.
  • Moreover, preferably, the controller causes the display to display, in addition to the preview display, that generation of the second preview image data is in processing in at least a part of a period between the time the first preview image is displayed and the time the displayed first preview image is updated to the second preview image.
  • According to another aspect of the present invention, there is provided an image processing method in an image processing apparatus having a display and an input unit. The present image processing method includes the steps of generating, by image-processing first image data in accordance with user setting, second image data, and providing a preview display on the display prior to outputting the second image data. The step of providing the preview display includes the steps of generating first preview image data from the first image data, displaying a first preview image on the display based on the generated first preview image data, generating second preview image data corresponding to the second image data, and updating the preview display on the display from the first preview image to a second preview image based on the generated second preview image data.
  • Preferably, the image-processing includes image synthesis processing of synthesizing third image data on the first image data to thereby generate the second image data, and the step of displaying the first preview image includes the step of generating the first preview image data that is changed in a screen appearance of a portion of an area corresponding to an area on the first image data in which the third image data is to be synthesized.
  • More preferably, the step of displaying the second preview image data includes the step of generating the second preview image data includes the step of generating the second preview image data from the second image data.
  • Alternatively, more preferably, the step of generating the first preview image data includes the steps of generating third preview image data having a smaller image size from the first image data, storing the generated third preview image data, and generating the first preview image data from the third preview image data, and the step of generating the second preview image data includes the step of generating the second preview image data from the stored third preview image data.
  • More preferably, the present image processing method further includes the step of regenerating, in response to change of the user setting relating to the image synthesis processing, the second preview image data from the stored third preview image data.
  • Alternatively, more preferably, the step of displaying the first preview image includes the step of generating the first preview image data by executing at least any one of adding a frame indicating the area in which the third image data is to be synthesized, changing a characteristic value of a pixel included in the area in which the third image data is to be synthesized, and replacing the area in which the third image data is to be synthesized by a predetermined pattern image.
  • Moreover, preferably, the image-processing includes image-conversion processing of converting the first image data to the second image data having an output mode specified by the user setting, the step of generating the second image data includes the steps of determining requirement of the image conversion processing based on an attribute of the first image data and the user setting, and executing the image conversion processing to generate the second image data when the image conversion processing is determined to be required.
  • More preferably, the step of generating the second preview image data includes the step of generating the second preview image data from the generated second image data when the image conversion processing to the first image data is executed.
  • Alternatively, more preferably, the steps of generating the first preview image data includes the steps of generating the first preview image data having a smaller image size from the first image data, and storing the generated first preview image data, and the step of generating the second preview image data includes the step of image-converting the stored first preview image data to generate the second preview image data.
  • More preferably, the present image processing method includes the step of regenerating, in response to change of the user setting relating to the image conversion processing, the second preview image data from the stored first preview image data.
  • Moreover, preferably, the step of providing the preview display further includes the step of displaying that generation of the second preview image data is in processing in at least a part of a period between the time the first preview image is displayed and the time the displayed first preview image is updated to the second preview image.
  • According to still another aspect of the present invention, there is provided a computer-readable medium that stores an image processing program for executing an image processing method in a computer having a display and an input unit. The image processing program causes the computer to execute the steps of generating, by image-processing first image data in accordance with user setting, second image data, and providing a preview display on the display prior to outputting the second image data. The step of providing the preview display including the steps of generating first preview image data from the first image data, displaying a first preview image on the display based on the generated first preview image data, generating second preview image data corresponding to the second image data, and updating the preview display on the display from the first preview image to a second preview image based on the generated second preview image data.
  • According to the present invention, the preview display of the output image can be performed quickly.
  • The foregoing and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a schematic configuration diagram of an overall system including an MFP according to Embodiment 1 of the present invention.
  • FIG. 2 is a schematic configuration diagram of hardware of the MFP according to Embodiment 1 of the present invention.
  • FIG. 3 is diagram showing a representative exterior appearance of an operation panel of the MFP according to Embodiment 1 of the present invention.
  • FIG. 4 is a schematic configuration diagram of hardware of a personal computer according to Embodiment 1 of the present invention.
  • FIGS. 5A and 5B are diagrams showing one example of a result of stamp processing executed in the MFP according to Embodiment 1 of the present invention.
  • FIG. 6 is a diagram showing another example of a result of the stamp processing executed in the MFP according to Embodiment 1 of the present invention.
  • FIGS. 7A and 7B are diagrams showing one example of a result of overlay processing executed in the MFP according to Embodiment 1 of the present invention.
  • FIG. 8 is a block diagram showing a control structure in the MFP according to Embodiment 1 of the present invention.
  • FIG. 9 is a diagram showing a screen example of a first stage of preview display according to Embodiment 1 of the present invention.
  • FIG. 10 is a diagram showing a screen example of a second stage of preview display according to Embodiment 1 of the present invention.
  • FIGS. 11A to 11C are diagrams showing a generation processing example of first preview image data according to Embodiment 1 of the present invention.
  • FIG. 12 is a diagram showing a first screen example for performing setting relating to image synthesis processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 13 is a diagram showing a second screen example for performing setting relating to the image synthesis processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 14 is a diagram showing a third screen example for performing setting relating to the image synthesis processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 15 is a diagram showing one example of contents of a user setting file stored in the MFP according to Embodiment 1 of the present invention.
  • FIG. 16 is a flowchart showing overall processing in the MFP according to Embodiment 1 of the present invention.
  • FIG. 17 is a flowchart showing processing of a preview display subroutine (step S8) shown in FIG. 16.
  • FIG. 18 is a block diagram showing a control structure in the MFP according to a modification of Embodiment 1 of the present invention.
  • FIG. 19 is a flowchart showing processing of the preview display subroutine (step S8) shown in FIG. 16, according to the modification of Embodiment 1 of the present invention.
  • FIG. 20 is a block diagram showing a control structure in an MFP according to Embodiment 2 of the present invention.
  • FIG. 21 is a diagram showing one example of contents of a user setting file and a page information file according Embodiment 2 of the present invention.
  • FIG. 22 is a diagram showing a screen example of a first stage of preview display according to Embodiment 2 of the present invention.
  • FIG. 23 is a diagram showing a screen example of a second stage of the preview display according to Embodiment 2 of the present invention.
  • FIG. 24 is a flowchart showing overall processing in the MFP according to Embodiment 2 of the present invention.
  • FIG. 25 is a flowchart showing processing of a preview display subroutine (step S58) shown in FIG. 24.
  • FIG. 26 is a block diagram showing a control structure in an MFP according to a modification of Embodiment 2 of the present invention.
  • FIG. 27 is a flowchart showing processing of the preview display subroutine (step S58) shown in FIG. 24, according to the modification of Embodiment 2 of the present invention.
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Referring to the drawings, detailed descriptions of embodiments of the present invention are given. For the same or corresponding portions in drawings, the same symbols are given thereto, and descriptions thereof are not repeated.
  • In the embodiments described below of the present invention, as a representative example of an image processing apparatus according to the present invention, a multi function peripheral (hereinafter, also referred to as MFP) having a plurality of functions such as a copy function (monochrome and/or color), printing function, facsimile transmission/reception function, and image scanning function is illustrated. As will be described later, the image processing apparatus according to the present invention may be implemented by a personal computer or the like.
  • Embodiment 1
  • <System Configuration>
  • In a system shown in FIG. 1, an MFP 1 according to Embodiment 1 of the present invention and at least one personal computer PC are configured so as to be capable of intercommunicating data through a network NW. MFP 1 can perform image processing in accordance with user setting to image data scanned by an image scanner (described later) mounted thereon, image data received from personal computer PC or another server device (not shown), image data of a facsimile received through a telephone line not shown or the like, and so on (hereinafter, collectively referred to as “input image data”) to thereby generate an image data (hereinafter, referred to as “output image data”). The image data transmitted from personal computer PC may be created by a document creating application executed in the personal computer.
  • Furthermore, MFP 1, in accordance with a user operation, can perform processing such as printing-out of the output image data onto paper, transmission of the output image data by facsimile, storage in a recording medium of the output image data, download of the output image data to personal computer PC, upload of the output image data to the server device, and the like. Herein, the “output” of the output image data collectively refers to processing of outputting the output image data itself or substance of the output image data outside MFP 1 as the image processing apparatus.
  • <Configuration of MFP>
  • Referring to FIG. 2, MFP 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a hard disk 104, an operation panel 105, an image scanner 106, a printer 107, and a network interface 108, and the respective units are interconnected through an internal bus 110.
  • CPU 101 is a processor that provides an image processing method according to the present embodiment by reading out, in RAM 103, a program stored in ROM 102, hard disk 104, or the like in advance to execute the same. ROM 102 stores the program to be executed in CPU 101, various setting values and the like in a nonvolatile manner. RAM 103 is a volatile storage device representatively including DRAM (Dynamic Random Access Memory), temporarily storing the program to be executed in a controller 100, data necessary for the execution of the program, and the like. Particularly, RAM 103 temporarily stores image data generated in a process of image processing described later. Hard disk 104 stores input image data scanned in image scanner 106, input image data externally inputted through network NW or the like. When the storage function of the input image data by hard disk 104 is focused on, hard disk 104 is also referred to as “Box”.
  • Operation panel 105 is a user interface for receiving various user operations and displaying various types of information to a user.
  • FIG. 3 shows a representative exterior appearance of operation panel 105 of MFP 1 according to Embodiment 1 of the present invention. Referring to FIG. 3, operation panel 105 includes a plurality of operation keys such as ten keys 124, a start key 128 and a stop key 130, and a touch panel 122.
  • When the user presses start key 128, a function having been selected in MFP 1 is executed, and when the user presses stop key 130, a function being executed is ceased or stopped.
  • Touch panel 122 includes a liquid crystal display (LCD) for displaying various types of information in MFP 1, and a pressure-sensitive panel that is arranged on the liquid crystal display and receives a user operation by sensing its pressure. Specifically, in touch panel 122, various types of information are displayed to the user, and buttons and icons for receiving respective operations to MFP 1 are displayed. When the pressure-sensitive panel senses that a user operation is performed in a position corresponding to any of the buttons, a command corresponding to that button is issued to CPU 101 (FIG. 2) and the like. Particularly, MFP 1 according to the present embodiment can display a preview image of the output image data on touch panel 122 prior to outputting the output image data.
  • Again, referring to FIG. 1, image scanner 106 scans image information from a document to generate input image data. Specifically, image scanner 106 irradiates light from a light source to the document placed on a platen glass, and receives the light reflected from the document by an image pickup element or the like to thereby obtain the image information of the document. Alternatively, image scanner 106 may include a document feeder tray, a delivery roller, a resist roller, a carrier drum, a paper discharge tray, and the like so as to enable successive document scanning. The input image data generated from the image information obtained by image scanner 106 is stored in hard disk 104 or the like.
  • In accordance with a user operation through operation panel 105, printer 107 prints out the input image data stored in hard disk 104 or the like, or the output image data generated by performing image processing in accordance with user setting to the input image data. Specifically, printer 107 includes a photoreceptor drum, a charger, an exposure unit, a developing unit, a transfer unit, a static eliminator, a fixing device, a cleaning device and the like, and these mechanisms operate in series to thereby provide print processing.
  • Network interface 108 provides data intercommunication with another MFP 1, personal computer or the like through network NW.
  • Now, an overview of operation from generation of the output image data from the input image data stored in hard disk 104 to output thereof is described. First, the user operates operation panel 105 to thereby provide user setting from operation panel 105 to CPU 101. In this user setting, specification of the input image to be subjected to image processing, contents of the image processing, and the like are included. In response to this user setting, CPU 101 reads out the specified input image data from hard disk 104, and performs the image processing to this read input image data in accordance with the user setting to generate the output image data. This output image data is temporarily stored in RAM 103.
  • At this time, when preview display is instructed by the user, CPU 101 displays a preview corresponding to the output image data on operation panel 105 prior to outputting the generated output image data (for example, prior to printing-out). Preview display denotes displaying an output image of the output image data, and generally, a resolution of the display is set to be lower than that of the output image data. The processing relating to this preview display will be described later. “Prior to outputting the output image data”, the output image data may not be generated actually. Namely, the output image data may be generated after the preview display ends.
  • The user checks this preview display, and determines whether or not the corresponding output image data is to be outputted. When an instruction of image output is given by the user, CPU 101 outputs the output image data to printer 107 and the like.
  • <Configuration of Personal Computer>
  • FIG. 4 is a schematic configuration diagram of hardware of personal computer PC according to Embodiment 1 of the present invention. In personal computer PC, typically, a known operating system (OS) is installed.
  • Referring to FIG. 4, personal computer PC includes a CPU 201 that executes the operating system, and any application, a RAM (Random Access Memory) 203 that temporarily stores data necessary for the processing in CPU 201, and a hard disk 204 that stores the operating system and the program executed in CPU 201 in a nonvolatile manner. The program executed on personal computer PC is read from a CD-ROM (Compact Disk-Read Only Memory) 206 a, a flexible disk (FD) 207 a or the like, by a CD-ROM drive 206 or a flexible disk (FD) drive 207, respectively.
  • CPU 201 receives a command through an input unit 202 made up of a keyboard, a mouse and the like, and displays an output result obtained by the execution of the program, on a display 205. Moreover, CPU 201 can intercommunicate data with MFP 1 through a network interface 208 made up of a LAN card or the like. The respective units are interconnected through an internal bus 209.
  • The program for executing the image processing according to the present invention may be installed in personal computer PC to execute the program on personal computer PC. In this case, personal computer PC corresponds to the image processing apparatus according to the present invention.
  • <Image Synthesis Processing>
  • In MFP 1 according to Embodiment 1 of the present invention, as one example of the image processing, image synthesis processing of synthesizing another image data on the input image data to thereby generate the output image data is enabled. Hereinafter, this image synthesis processing is described. More specifically, as a representative example of the image synthesis processing, stamp processing of synthesizing accessory information of a document, a fixed pattern and the like in a predetermined printing position, and overlay processing of superimposing a plurality of pieces of image data to generate one piece of image data are described.
  • (1) Stamp Processing
  • The stamp processing is processing of specifying a printing position (synthesis area) within the input image data, and adding a textual image or a fixed pattern in the printing position to generate output image data. As one example of this textual image, a date/time, page number, numbering (serial number) and the like are included. As one example of the fixed pattern, “Urgent”, “Confidential” and the like are included.
  • FIGS. 5A and 5B show output image data 10 in which a textual image 14 indicating a date/time is synthesized on input image data 12, as one example of a result of the stamp processing executed in MFP 1 according to Embodiment 1 of the present invention.
  • As enlarged in FIG. 5 A, textual image 14 indicates “20 Sep. 2007” as the date, and “9:28 PM” as the time. The date/time indicated by textual image 14 may indicate a time and date when the output image is generated, or may indicate a time and date when the input image data is generated. Preferably, the contents of the date/time are configured so that the user can freely set them. Moreover, characters to be added may be selected from ones predetermined by the user, or may be freely inputted by the user.
  • As shown in FIG. 5B, textual image 14 as describe above is added to a header portion at the upper left of input image data 12 as one example. The printing position of this textual image 14 can be freely set by the user as will be described later.
  • FIG. 6 shows output image data 20 in which a fixed pattern 24 is added to input image data 22, as another example of a result of the stamp processing executed in MFP 1 according to Embodiment 1 of the present invention.
  • As shown in FIG. 6, output image data 20 is obtained by adding fixed pattern 24 indicating “URGENT” at the upper right of input image data 22.
  • (2) Overlay Processing
  • The overlay processing is processing of superimposing a plurality of pieces of image data to generate one piece of image data, and in many cases, a plurality of pieces of input image data selected by the user are superimposed to generate one piece of output image data.
  • FIGS. 7A and 7B show processing of generating output image data 30 from input image data 32 scanned from a document, and input image data 34, which is a predefined form, as one example of a result of the overlay processing executed in MFP 1 according to Embodiment 1 of the present invention.
  • As shown in FIG. 7A, generally, the plurality of pieces of input image data used in the overlay processing have almost the same size as one another. By adding pixel information of corresponding pixels of both the pieces of input image data, the pixel information of the respective pixels making up the output image data is processed. This overlay processing generates output image data 30 as shown in FIG. 7B.
  • <Control Structure>
  • Referring to FIG. 8, MFP 1 according to the present embodiment includes, as a control structure, a reader 302, an image processor 304, a buffer 306, an output unit 308, a pattern storage 310, a first preview image generator 312, a second preview image generator 314, a preview display controller 316, and an input unit 318. In this control structure, buffer 306 is typically implemented by allocating a specific area of RAM 103, and pattern storage 310 is implemented by allocating a specific area of hard disk 104. The other units are typically implemented by CPU 101 executing a control program. All or some included in the control structure may be implemented by hardware.
  • Input unit 318 outputs a corresponding internal command to a corresponding unit in accordance with an operation (user operation) of operation panel 105 (FIGS. 2 and 3) by the user. Specifically, input unit 318 outputs a start instruction to reader 302 in accordance with the user operation, outputs user setting to image processor 304 and first preview image generator 312, and outputs an output instruction to output unit 308.
  • Reader 302, in response to the start instruction from input unit 318, selectively reads out a specified one from input image data stored in hard disk 104 (FIG. 2). The source from which reader 302 reads out the input image data is not limited to hard disk 104. Moreover, when the above-described overlay processing is instructed, reader 302 reads out a plurality of pieces of input image data. Reader 302 then outputs the read one or plurality of pieces of input image data to image processor 304 and first preview image generator 312.
  • Upon receiving the input image data from reader 302, image processor 304 performs image processing (image synthesis processing) in accordance with the user setting received from input unit 318 to generate the output image data. When the synthesis of a fixed pattern is instructed in the user setting, the necessary fixed pattern is obtained from pattern storage 310.
  • Pattern storage 310 has stored one or a plurality of fixed patterns in advance, and responds to a request from image processor 304 with the necessary fixed pattern.
  • The output image data generated in image processor 304 is temporarily stored in buffer 306.
  • Output unit 308 outputs the output image data stored in buffer 306 to printer 107 (FIG. 2) or the like in response to an output instruction from input unit 318.
  • Meanwhile, first preview image generator 312, second preview image generator 314 and preview display controller 316 operate so as to display a preview screen of the output image data on operation panel 105 (FIGS. 2 and 3) when the preview display is instructed by the user.
  • Second preview image generator 314 generates preview image data from the output image data stored in buffer 306. The preview image data generated by this second preview image generator 314 is for simply displaying an output image, and an image size thereof is smaller than that of the output image data. This preview image can be generated only after the output image data is generated by image processor 304.
  • Meanwhile, first preview image generator 312 generates a preview image by reducing the input image data read out by reader 302. This preview image generated by first preview image generator 312 is tentatively displayed on operation panel 105 until the generation of the preview image by second preview image generator 314 has been completed.
  • Namely, on operation panel 105, the preview display based on the preview image data generated by first preview image generator 312 (first stage) is provided, and then, the preview display based on the preview image data generated by second preview image generator 314 (second stage) is provided. Hereinafter, the preview image generated by first preview image generator 312 is also referred to as a “first preview image”, and the preview image generated by second preview image generator 314 is also referred to as a “second preview image”.
  • More specifically, first preview image generator 312 includes an image reducing unit 312 a, a buffer 312 b, and an image processing unit 312 c. Image reducing unit 312 a reduces the input image data to generate third preview image data that has an image size appropriate for the preview image. This third preview image data generated by image reducing unit 312 a is temporarily stored in buffer 312 b.
  • When the image synthesis processing is set as the user setting, image processing unit 312 c, in accordance with the user setting, changes a screen appearance of at least a portion of an area on the third preview image data corresponding to an area on the input image data in which another image data (the fixed pattern or the like) is to be synthesized. Image processing unit 312 c outputs the third preview image data in which the screen appearance of the object area has been changed is outputted as the first preview image data.
  • In this change processing of the screen appearance, image processing unit 312 c specifies the area on the input image data to be subjected to the image synthesis processing, based on a type, a size, a printing position and the like of the pattern to be synthesized, which are included in the user setting. Image processing unit 312 c specifies the area on the third preview image data corresponding to this specified area to change the screen appearance for all or a portion thereof.
  • In this manner, first preview image generator 312 generates the preview image having the screen appearance enabling identification as to which area of the input image is to be subjected to the synthesis processing, until the second preview image data is generated by second preview image generator 314. Such processing relating to the generation of the first preview image data in first preview image generator 312 is made simpler than the image synthesis processing in image processor 304, which enables quick preview display without making the user feel stress.
  • Preview display controller 316, when the first preview image data is generated by first preview image generator 312, displays the preview on operation panel 105 based on the first preview image data. Subsequently to this image, when second preview image generator 314 generates the second preview image data, preview display controller 316 updates the display on operation panel 105 with the preview display based on the second preview image data.
  • If the image synthesis processing is not set as the user setting, and when the preview display is instructed by the user, image processing unit 312 c outputs the third preview image data as the first preview image as it is without performing the change processing of screen appearance for the third preview image data. At this time, second preview image generator 314 does not generate the second preview image data.
  • <Preview Display>
  • Hereinafter, referring to FIGS. 9 and 10, an example of the preview display is described. In FIGS. 9 and 10, preview display when the stamp processing shown in FIG. 6 is executed is illustrated as one example of the image synthesis processing according to the user setting.
  • FIG. 9 shows a display example of the preview image based on the first preview image data, and FIG. 10 shows a display example of the preview image based on the second preview image data.
  • Preview display controller 316 (FIG. 8) causes a preview window as shown in FIGS. 9 and 10 to be displayed on operation panel 105 (FIGS. 2 and 3). A job display button 402, a setting contents button 404, a preview button 406 and the like are arranged to the left side of this preview window. When job display button 402 and setting contents button 404 is pressed by the user, the display contents of operation panel 105 are changed to a job display window and a setting contents window not shown, respectively. In this job display window, jobs in processing or waiting for processing in MFP 1 are displayed in a list. In the setting contents window, as will be described later, change of various types of the user setting is acceptable. The preview window shown in FIGS. 9 and 10 is also displayed by pressing preview button 406 while another window is being displayed.
  • As shown in FIGS. 9 and 10, in the preview window, a preview display area 410 is provided, and a preview image is displayed within this preview display area 410. A button group 412 for changing a size of the preview image displayed in preview display area 410 is arranged to the right side of preview display area 410. When any button of button group 412 is pressed, preview display controller 316 (FIG. 8) enlarges or reduces the preview image, corresponding to the button.
  • Referring to FIG. 9, when the user first presses preview button 406, the preview image based on the first preview image data generated by first preview image generator 312 (FIG. 8) is displayed. As described above, in the first preview image data, the screen appearance of at least a portion of the area corresponding to the area on the input image data in which another image data (fixed pattern or the like) is to be synthesized is changed. As one example of the above-described change of the screen appearance, FIG. 9 shows a preview image 420 in which a frame 422 indicating the area where the fixed pattern is to be synthesized is added.
  • On the other hand, after displaying the preview as shown in FIG. 9, image processor 304 (FIG. 8) generates the output image data from the input image data, and second preview image generator 314 (FIG. 8) generates the second preview image data from the output image data. When the generation of the second preview image data has been completed, the display on operation panel 105 is switched from the preview display shown in FIG. 9 to the preview display shown in FIG. 10.
  • Referring to FIG. 10, in preview display area 410, a preview image 424 in which a fixed pattern 426 of “Urgent” has been synthesized on the input image is displayed.
  • Moreover, after preview image 420 is displayed based on the first preview image data (FIG. 9), preview display controller 316 displays a message 430 of “IMAGE SYNTHESIS IN PROCESSING” indicating that the second preview image data is being generated until the display is switched to the display of preview image 424 based on the second preview image data (FIG. 10).
  • As described above, if the user instructs the preview display, preview image 420 in which frame 422 indicating the area where the fixed pattern is to be synthesized is added to the input image is quickly displayed, and subsequently, preview image 424 corresponding to the output image data in which the fixed pattern has been synthesized is displayed Thus, the user can check final output without feeling stress due to the time required for the image processing.
  • <First Preview Image>
  • In FIG. 9, the processing for generating the first preview image data in which the frame indicating the area to be synthesized is added has been described. Hereinafter, referring to FIGS. 11A to 11C, variation of the processing for generating the above-described first preview image data is illustrated.
  • FIG. 11A shows the first preview image data in which a frame 422A indicating the area to be synthesized is added. A size, a shape, a printing position and the like of this frame 422A are changed as needed by first preview image generator 312 in accordance with the fixed pattern to be synthesized.
  • FIG. 11B shows the first preview image data in which characteristic values of pixels included in an area 422B to be synthesized are changed. Specifically, the first preview image data is changed in color information such as lightness, luminance, hue and the like of the pixels included in area 422B in accordance with a predetermined rule. Typically, the first preview image data in which the lightness of the pixels included in area 422B is increased is generated.
  • FIG. 11C shows the first preview image data in which an area 422C to be synthesized is replaced by a predetermined pattern image. Specifically, in the first preview image data, the predetermined pattern stored in advance is read out, and area 422C is replaced by the predetermined pattern.
  • <User Setting Relating to Image Synthesis Processing>
  • After the above-described preview display as shown in FIGS. 9 and 10, and/or prior to the preview display, the user can also perform setting relating to the image processing (image synthesis processing). Referring to FIGS. 12 to 14, such a setting method relating to the image synthesis processing is illustrated.
  • FIG. 12 shows a first screen example for performing the setting relating to the image synthesis processing in MFP 1 according to Embodiment 1 of the present invention. FIG. 13 shows a second screen example for performing the setting relating to the image synthesis processing in MFP 1 according to Embodiment 1 of the present invention. FIG. 14 shows a third screen example for performing the setting relating to the image synthesis processing in MFP 1 according to Embodiment 1 of the present invention.
  • When the user presses setting contents button 404 in the preview window (FIG. 10), the display contents on operation panel 105 are switched to a setting window as shown in FIG. 12. Before displaying the setting window shown in FIG. 12, a setting window for selecting a desired one from a plurality of types of image processing including the image synthesis processing may be displayed.
  • In the setting window shown in FIG. 12, a list display area 442 is arranged so that the user can select a desired one from the plurality of types of image synthesis processing. In this list display area 442, processing contents executable as the image synthesis processing are displayed in a list. More specifically, in list display area 442, there are arranged a “DATE/TIME” button for adding a date/time to the input image data, a “PAGE” button for adding a page number to the input image data, a “NUMBERING” button for adding a serial number to the image input data, a “FIXED STAMP” button for adding a fixed pattern to the input image data, a “WATERMARK” button for adding a background pattern to the input image data and the like.
  • When the user setting has been already made (as one example, in the image synthesize of the fixed pattern as shown in FIG. 10), the corresponding button (in this case, the “FIXED STAMP” button) may be displayed so as to be differentiated from the other buttons in the screen appearance.
  • When the user presses the “FIXED STAMP” button in this setting window shown in FIG. 12, the display contents on operation panel 105 are switched to a setting window as shown in FIG. 13.
  • The setting window shown in FIG. 13 is for setting more detailed contents of the “FIXED STAMP” processing. Specifically, in the setting window shown in FIG. 13, printing- position display areas 444 and 452, and list display areas 450 and 454 are arranged. In printing-position display area 444, a total of nine areas resulting from vertically dividing the printing area into three and horizontally dividing the same into three are displayed graphically, and an indicator is displayed in an area corresponding to a position set by the user for synthesizing the fixed stamp among these nine areas. Moreover, in printing-position display area 452, the position set by the user for synthesizing the fixed stamp is displayed in a text.
  • In list display area 450, fixed patterns selectable in the “FIXED STAMP” processing are displayed in a list. Moreover, in list display area 454 is displayed a button for selecting an object page on which the selected pattern is to be printed. More specifically, in list display area 454, there are arranged an “ONLY FRONT COVER” button for setting printing of the fixed stamp only on a first page of the input image data, and an “ALL PAGES” button for setting printing of the fixed stamp on all pages of the input image data.
  • When the user presses printing-position display area 444 or printing-position display area 452 in the setting window shown in FIG. 13, the display contents on operation panel 105 are switched to a setting window as shown in FIG. 14.
  • The setting window shown in FIG. 14 is for setting the printing position of the fixed stamp. Specifically, in the setting window shown in FIG. 14, printing-position display area 444, a printing-position specifying area 446, and a fine-adjustment display area 448 are arranged. Printing-position display area 444 is similar to that displayed in the setting window in FIG. 13. In printing-position specifying area 446, nine printing positions are selectably displayed in a list, corresponding to the nine areas displayed graphically in printing-position display area 444.
  • Moreover, in fine-adjustment display area 448, statuses of the fine adjustment to any of the areas selected in printing-position specifying area 446 (e.g., “upper left”) are displayed. Moreover, in fine-adjustment display area 448, an “adjustment change” button for selecting a setting window (not shown) for performing the above-described fine adjustment is also displayed.
  • The user can perform the setting relating to the image synthesizing processing by performing a desired operation to the setting window as shown in FIGS. 12 to 14. The user presses a “close” button 456 to thereby reflect the setting contents.
  • <User Setting File>
  • The contents set by the user on the setting windows as shown in FIGS. 12 to 14 are outputted to image processor 304 (FIG. 8) and the like through input unit 318 (FIGS. 8). These contents of the user setting may be temporarily stored in RAM 103 (FIG. 2) or may be stored in hard disk 104 (FIG. 2) as a file (user setting file).
  • In a case where the user setting file is stored in hard disk 104, the file is preferably associated with the input image data to which the user setting is applied. This configuration allows the corresponding user setting file to be read out together with the input image data, when the user selects the input image data of interest.
  • FIG. 15 shows one example of the contents of the user setting file stored in MFP 1 according to Embodiment 1 of the present invention.
  • Referring to FIG. 15, a “BOX FILE ID” for specifying the associated input image data is defined in the user setting file. Moreover, in the user setting file, items such as a “DATE/TIME”, “PAGE NUMBER”, “HEADER/FOOTER”, “STAMP”, “OVERLAY SYNTHESIS” and the like are provided for specifying requirement for the respective processing items.
  • In the user setting file shown in FIG. 15, since the “DATE/TIME” is “ON”, items for specifying more detailed contents of the synthesis processing of the date/time, such as a “SYNTHESIS POSITION”, a “CHARACTER SIZE”, a “SYNTHESIS COLOR” and the like, are further provided.
  • The above-described contents of the user setting file may be set by another apparatus such as personal computer PC, besides the embodiment in which the user operates operation panel 105 to set them. Typically, on a document creating application executed by personal computer PC, the above-described user setting file may be outputted concurrently with the creation of the input image data from a document. At this time, the contents of the user setting file can be set on a printer driver installed in personal computer PC.
  • Alternatively, a Web-based user interface may be provided. In this case, CPU 101 of MFP 1 executes a program for providing a Web server, and this Web server provides a Web-based interface for receiving the user setting on a browser application on personal computer PC connected through network.
  • <Regeneration Processing of Preview Image>
  • When the user checks the preview image as shown in FIG. 10, and then, performs operations to the setting windows as shown in FIGS. 12 to 14 to change the user setting relating to the image synthesis processing, a preview image is regenerated.
  • Again, referring to FIG. 8, when the user setting is changed, first preview image generator 312 regenerates the first preview image data based on the input image data. On the other hand, image processor 304 also performs the image processing in accordance with the user setting after the change to regenerate the output image data. Furthermore, second preview image generator 314 regenerates the second preview image data from this regenerated output image data. Thus, the preview images as shown in FIG. 9 and FIG. 10 are redisplayed based on the first and second preview image data generated by first and second preview image generators 312 and 314, respectively.
  • In this manner, since the preview image after setting change is quickly displayed on operation panel 105, the user can set the contents of the desired image synthesis processing while checking the final output.
  • <Overall Processing>
  • Next, referring to FIGS. 2, 8 and 16, overall processing relating to the above-described image synthesis processing is described.
  • A user who will perform some image synthesis processing to an input image data to output output image data operates operation panel 105 to select an input image as an object, and inputs user setting relating to the image synthesis processing (step S2). This user setting is stored in RAM 103, hard disk 104 or the like.
  • After inputting the user setting, when the user presses start key 128 on operation panel 105, input unit 318 outputs a start instruction to CPU 101 functioning as reader 302. In response to this start instruction, CPU 101 functioning as reader 302 reads out the specified input image data from hard disk 104 (step S4). If a user setting file is stored in hard disk 104 in advance, CPU 101 also reads out the user setting file corresponding to the input image data together with the specified input image data.
  • Subsequently, CPU 101 determines whether or not the preview display is instructed by the user (step S6). If the preview display is instructed (in a case of YES in step S6), CPU 101 executes a preview display subroutine (step S8) to display a preview image on operation panel 105. After the execution of this preview display subroutine, CPU 101 determines whether or not the display of the setting windows is instructed by the user (step S10).
  • If the display of the setting window is instructed by the user (in a case of YES in step S10), CPU 101 displays the setting windows as shown in FIGS. 12 to 14 (step S12). Furthermore, CPU 101 determines whether or not change of the user setting is instructed on any of the setting windows (step S14).
  • If any change of the user setting is instructed on the setting window (in a case of YES in step S14), CPU 101 reflects the change contents on the user setting stored in RAM 103 or the like to update the contents of the user setting (step S16). CPU 101 again executes the preview display subroutine based on the changed setting (step S8) to update the preview image on operation panel 105.
  • On the other hand, if the preview display is not instructed (in a case of NO in step S6), if the display of the setting window is not instructed (in a case of NO in step S10), or if the change of the user setting is not instructed on the setting window (in a case of NO in step S14), CPU 101 determines whether or not the output of the output image data is instructed (step S18).
  • If the output of the output image data is instructed (in a case of YES in step S18), CPU 101 functioning as image processor 304 performs the image processing (image synthesis processing) to the input image data read out in step S4 in accordance with the user setting to generate the output image data (step S20). This output image data is stored in RAM 103 functioning as buffer 306. Subsequently, CPU 101 functioning as output unit 308 outputs the output image data generated in step S12 (step S22). Then, a series of processing ends. If the output image data has been already generated for displaying the preview image, the processing in step S20 may be skipped.
  • On the other hand, if the output of the output image data is not instructed (in a case of NO in step S18), CPU 101 repeatedly executes the processing in step S6 and later.
  • <Preview Display Processing>
  • Referring to FIGS. 2, 8 and 17, CPU 101 functioning as image reducing unit 312 a reduces the input image data read out in step S4 in FIG. 16 to generate the third preview image data (step S80). This third preview image data is stored in RAM 103 functioning as buffer 312 b. Subsequently, CPU 101 functioning as image processing unit 312 c determines whether or not the image synthesis processing is set as the user setting (step S81).
  • If the image synthesis processing is not set as the user setting (in a case of NO in step S81), CPU 101 functioning as image processing unit 312 c outputs the third preview image data stored in RAM 103 as the first preview image data. CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (the same as the third preview image data) (step S82). Then, the preview display subroutine ends, and the processing returns to step S10 in FIG. 16.
  • On the other hand, if the image synthesis processing is set as the user setting (in a case of YES in step S81), CPU 101 functioning as image processing unit 312 c changes the screen appearance of a predetermined area of the third preview image data based on the contents of the user setting to generate the first preview image data (step S83). CPU 101 functioning as preview display controller 316 then displays the first preview image on operation panel 105 based on this first preview image data (step S84). Furthermore, CPU 101 displays the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 (step S85).
  • Subsequently, CPU 101 functioning as image processor 304 performs the image processing (image synthesis processing) to the input image data read out in step S4 in FIG. 16, in accordance with the user setting to generate the output image data (step S86). This output image data is stored in RAM 103 functioning as buffer 306.
  • Furthermore, CPU 101 functioning as second preview image generator 314 reduces the output image data generated in step S85 to generate second preview image data (step S87). CPU 101 functioning as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S88). At this time, CPU 101 makes the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 undisplayed.
  • This ends the preview display subroutine, and the processing returns to step S10 in FIG. 16.
  • Functional Effect in the Present Embodiment
  • According to Embodiment 1 of the present invention, in the preview display of the output image data, the preview image based on the first preview image data generated from the input image data is first displayed quickly, and subsequently to this image, the preview image based on the second preview image data generated from the output image data is displayed. This can alleviate stress that the user feels due to time required for the preview display.
  • Moreover, according to Embodiment 1 of the present invention, since in the first preview image data, the frame indicating an area to be subjected to the image synthesis, and the like are added, the user can, in advance, visually confirm the area where a fixed pattern or the like is synthesized. Thus, the user can quickly set the contents of the desired image synthesis processing while checking the final output.
  • Modification of Embodiment 1
  • As a modification of Embodiment 1 of the present invention, a configuration in which the generation processing of the second preview image data corresponding to the output image data is modified is illustrated. Basically, configurations other than the configuration relating to the generation of the second preview image data are similar to those of the above-described Embodiment 1, and thus, a detailed description thereof is not repeated.
  • <Control Structure>
  • Referring to FIG. 18, in a control structure of an MFP 1# according to the modification of Embodiment 1 of the present invention, a second preview image generator 314# is provided in place of second preview image generator 314 in the control structure of MFP 1 according to Embodiment 1 shown in FIG. 8. The other units are similar to those in FIG. 8, and thus, a detailed description thereof is not repeated.
  • While in MFP 1 according to Embodiment 1, image processor 304 temporarily generates the output image data for displaying a preview image on operation panel 105, in MFP 1# according to the modification of Embodiment 1, a preview image can be displayed without the generation of the output image data by image processor 304.
  • Referring to FIG. 18, specifically, second preview image generator 314# generates the second preview image data based on the third preview image data generated by image reducing unit 312 a included in first preview image generator 312. Namely, second preview image generator 314# performs the image processing (image synthesis processing) equivalent to that of image processor 304 to the third preview image data stored in buffer 312 b, in accordance with the user setting to generate the second preview image data. If the synthesis of a fixed pattern is instructed in the user setting, second preview image generator 314# also obtains the necessary fixed pattern from pattern storage 310.
  • As described above, in MFP 1# according to the modification of Embodiment 1, the second preview image data is generated from the third preview image data, which has a smaller image size than that of the input image data (and the output image data). Thus, an amount of processing relating to the generation of the second preview image data can be reduced, so that the preview display can be further speeded up.
  • <Regeneration Processing of Preview Image>
  • Similarly to the above-described Embodiment 1, when the user setting is changed after the preview image data corresponding to the output image data is displayed, a preview image is regenerated.
  • Specifically, when the user setting relating to the image synthesis processing is changed, first preview image generator 312 regenerates the first preview image data from the input image data, and second preview image generator 314# regenerates the second preview image data from the third preview image data restored in buffer 312 b.
  • <Preview Display Processing>
  • The contents of the overall processing in MFP 1# according to the modification of the present embodiment are similar to those in the above-described flowchart shown in FIG. 16, except for the processing contents of the preview display subroutine (step S8), and thus a detailed description thereof is not repeated.
  • FIG. 19 is a flowchart showing the processing according to the modification of the present embodiment of the preview display subroutine shown in FIG. 16 (step S8). Among processing steps shown in FIG. 19, the same symbols are given to those having the processing contents similar to those in the processing steps shown in FIG. 17.
  • Referring to FIGS. 2, 18 and 19, CPU 101 functioning as image reducing unit 312 a reduces the input image data read out in step S4 of FIG. 16 to generate the third preview image data (step S80). This third preview image data is stored in RAM 103 functioning as buffer 312 b. Subsequently, CPU 101 functioning as image processing unit 312 c determines whether or not the image synthesis processing is set as the user setting (step S81).
  • If the image synthesis processing is not set as the user setting (in a case of NO in step S81), CPU 101 functioning as image processing unit 312 c outputs the third preview image data stored in RAM 103 as the first preview image data. CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (the same as the third preview image data) (step S82). Then, the preview display subroutine ends, and the processing returns to step S10 in FIG. 16.
  • On the other hand, if the image synthesis processing is set as the user setting (in a case of YES in step S81), CPU 101 functioning as image processing unit 312 c changes the screen appearance of a predetermined area of the third preview image data based on the contents of the user setting to generate the first preview image data (step S83). CPU 101 functioning as preview display controller 316 then displays the first preview image on operation panel 105 based on this first preview image data (step S84). Furthermore, CPU 101 displays the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 (step S85).
  • Subsequently, CPU 101 functioning as second preview image processor 314# performs the image processing (image synthesis processing) to the third preview image data stored in RAM 103, in accordance with the user setting to generate the second preview image data (step S87A). CPU 101 functioning as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S88). At this time, CPU 101 makes the message of “IMAGE SYNTHESIS IN PROCESSING” on operation panel 105 undisplayed.
  • This ends the preview display subroutine, and the processing returns to step S10 in FIG. 16.
  • Functional Effect in Modification of the Present Embodiment
  • According to the modification of Embodiment 1 of the present invention, in addition to the effect in the above-described Embodiment 1, the preview image based on the second preview image data can be displayed more quickly.
  • Embodiment 2
  • While in the above-described Embodiment 1, the configuration in which the image synthesis processing is executed as one example of the image processing is illustrated, in Embodiment 2 described below, a configuration in which image conversion processing of converting the input image data to second image data having a specified output mode is executed is illustrated as one example of the image processing.
  • For example, assuming a case where color input image data is printed out as a monochrome image, it is necessary that the input image data is converted to monochrome image data and then, is subjected to printing processing. Thus, in an MFP according to Embodiment 2, the conversion processing from the input image data to the output image data having a specific output mode is enabled.
  • The overall system according to Embodiment 2, a hardware configuration of an MFP 2 according to Embodiment 2 and the like are similar to those in the above-described Embodiment 1, and thus, a detailed description thereof is not repeated.
  • <Control Structure>
  • Referring to FIG. 20, MFP 2 according to Embodiment 2 of the present invention includes, as a control structure, reader 302, an image processor 305, buffer 306, output unit 308, a first preview image generator 313, a second preview image generator 315, preview display controller 316, input unit 318, a determining unit 320, and a determination table storage 322. In this control structure, buffer 306 is typically implemented by allocating a specific area of RAM 103, and determination table storage 322 is implemented by allocating a specific area of hard disk 104. The other units are typically implemented by CPU 101 executing a control program. All or some included in the control structure may be implemented by hardware.
  • Input unit 318 outputs a corresponding internal command to the corresponding unit in accordance with an operation (user operation) of operation panel 105 (FIGS. 2 and 3) by the user. Specifically, input unit 318 outputs a start instruction to reader 302, outputs user setting to determining unit 320, and outputs an output instruction to output unit 308 in accordance with the user operation. In this user setting, the setting of an output mode of output image data is included. The output mode indicates an attribute of the output image data (e.g., image format, image gradation or the like). In the present embodiment, as one example, the output mode setting includes two items of “output application” and “output color”.
  • Reader 302, in response to a start instruction from input unit 318, selectively reads out a specified input image data from hard disk 104 (FIG. 2). As will be described later, in hard disk 104, a page information file in which attributes (typically, image format, image gradation and the like) of the input image data are described has been stored in association with the input image data. This page information file is also generated at the time of generation of the input image data. The contents of the page information file may be incorporated in a portion of the input image data, and in this case, the input image data and the page information file can be dealt with as integrated data (file). Details of this page information file will be described later. Moreover, in a case where image scanner 106 (FIG. 2) scans a document and generates the input image data, the contents of the page information file may be concurrently outputted from image scanner 106.
  • Reader 302 outputs the read input image data to image processor 305 and first preview image generator 313, and outputs the read page information file to determining unit 320.
  • Referring to FIG. 21, a “BOX FILE ID” for specifying the input image data to be subjected to the image processing is defined in a user setting file according to Embodiment 2 of the present invention. Moreover, in the user setting file, the two items of “OUTPUT APPLICATION” and “OUTPUT COLOR” for specifying the output mode are also defined. Furthermore, in the user setting file, a “PAGE NUMBER” of the input image data to be subjected to the image processing is defined, and the association with the page information file is defined for each page.
  • In the page information file for each page, a “PAGE INFORMATION ID” for specifying the page of interest is defined, and “IMAGE FORMAT INFORMATION” and “IMAGE GRADATION INFORMATION” as the attributes of each page are defined.
  • The contents of the user setting file may be set by another apparatus such as personal computer PC and the like, besides the aspect in which the user operates operation panel 105 for setting. Alternatively, a Web-based interface may be provided.
  • Determining unit 320 determines requirement for the image conversion processing, based on the contents of the output mode setting included in the user setting (values of the “OUTPUT APPLICATION” and the “OUTPUT COLOR”), and the contents of the page information file associated with the specified input image data. In this determination, determining unit 320 refers to a determination table 322 a stored in determination table storage 322.
  • Hereinafter, one example of the contents of determination table 322 a is shown.
  • TABLE 1
    Page information Format of preview image data
    User setting (Output mode) Format Gradation Format Gradation Conversion
    Output application Output color information information information information requirement
    Printing-out Full color RGB 256 gradations RGB 256 gradations Not required
    YMCK 256 gradations YMCK 256 gradations Not required
    YMCK  2 gradations YMCK  2 gradations Not required
    Gray scale 256 gradations Gray scale 256 gradations Not required
    Black RGB 256 gradations Gray scale 256 gradations Required
    YMCK 256 gradations Gray scale 256 gradations Required
    YMCK  2 gradations Gray scale  2 gradations Required
    Gray scale 256 gradations Gray scale 256 gradations Not required
    Scanning-out Full color RGB 256 gradations RGB 256 gradations Not required
    YMCK 256 gradations YMCK 256 gradations Not required
    YMCK  2 gradations YMCK  2 gradations Not required
    Gray scale 256 gradations Gray scale 256 gradations Not required
    Gray scale RGB 256 gradations RGB 256 gradations Not required
    YMCK 256 gradations YMCK 256 gradations Not required
    YMCK  2 gradations YMCK  2 gradations Not required
    Gray scale 256 gradations Gray scale 256 gradations Not required
    Monochrome RGB 256 gradations Gray scale  2 gradations Required
    binary YMCK 256 gradations Gray scale  2 gradations Required
    YMCK  2 gradations Gray scale  2 gradations Required
    Gray scale 256 gradations Gray scale  2 gradations Required
    Facsimile Monochrome RGB 256 gradations Gray scale  2 gradations Required
    binary YMCK 256 gradations Gray scale  2 gradations Required
    YMCK  2 gradations Gray scale  2 gradations Required
    Gray scale 256 gradations Gray scale  2 gradations Required
  • In this determination table 322 a, a total of four major items of “User setting (Output mode)”, “Page information”, “Format of preview image data”, and “Conversion requirement” are defined. Determining unit 322 selects corresponding minor items of the “User setting (Output mode)” based on the contents of the user setting, selects corresponding minor items of the “Page information” based on the contents of the page information file, and obtains a value of the “Conversion requirement” (namely “Required” or “Not required”) corresponding to a combination of these selected minor items. Determining unit 320 determines requirement of the image conversion processing based on this obtained value.
  • As the minor items of the “Output application” in determination table 322 a, three items of “Printing-out”, “Scanning-out” and “Facsimile” are defined. Among these, the “Printing-out” indicates a case where the setting is made so that the output image data is printed out. The “Scanning-out” indicates a case where the setting is made so that the output image data is stored in hard disk 104. The “Facsimile” indicates a case where the setting is made so that the output image data is transmitted by facsimile. Moreover, as the minor items of the “Output color”, color modes in accordance with corresponding output destinations are defined.
  • If determining unit 320 determines that the image conversion processing is “Required”, it outputs a conversion instruction to image processor 305 and second preview generator 315. This conversion instruction includes the contents of the “Format of preview image data” (values of “Format information” and “Gradation information”) corresponding to determination table 322 a. Namely, image processor 305 and second preview image generator 315 generate, from the input image data, the output image data or the second preview image data having the output mode specified in accordance with the “Format information” and “Gradation information” included in the conversion instruction. On the other hand, if determining unit 320 determines that the image conversion processing is “Not required”, no conversion instruction is outputted.
  • Image processor 305, upon receiving the input image data from reader 302, performs the image processing (image conversion processing) in accordance with the conversion instruction only when the conversion instruction is received from determining unit 302, and generates the output image data. The output image data generated in image processor 305 is temporarily stored in buffer 306.
  • Output unit 308 outputs the output image data stored in buffer 306 to printer 107 (FIG. 2) and the like in response to an output instruction from input unit 318.
  • On the other hand, first preview image generator 313, second preview image generator 315 and preview display controller 316 operate to display a preview of the output image data on operation panel 105, when the preview display is instructed by the user.
  • Particularly, second preview image generator 315 according to the present embodiment operates only when the image conversion processing is determined to be “Required” by determining unit 320, that is, only when the conversion instruction is outputted from determining unit 320.
  • More specifically, first preview image generator 313 includes an image reducing unit 313 a and a buffer 313 b. Image reducing unit 313 a reduces the input image data to generate the first preview image data that has an image size appropriate for the preview image. This first preview image data generated by image reducing unit 313 a is temporarily stored in buffer 313 b, and is outputted to preview display controller 316.
  • Meanwhile, if the conversion instruction is outputted from determining unit 320, second preview image generator 315 generates the preview image data from the output image data stored in buffer 306. More specifically, second preview image generator 315 reduces the output image data into the image size appropriate for the preview image to generate the second preview image data.
  • When the first preview image data is generated by first preview image generator 313, preview display controller 316 displays the preview image on operation panel 105 based on the first preview image data (first stage). Subsequently to this image, when the second preview image data is generated by second preview image generator 315, the display on operation panel 105 is updated to the preview image based on the second preview image data (second stage).
  • As described above, if no conversion instruction is outputted from determining unit 320, the second preview image data is not generated by second preview image generator 315, and thus, in this case, preview display controller 316 maintains the display of the preview image based on the first preview image data.
  • <Preview Display>
  • Hereinafter, referring to FIGS. 22 and 23, one example of the preview display is described. In FIGS. 22 and 23, as one example of the image conversion processing, the preview display in a case where color input image data is outputted in monochrome is illustrated.
  • FIG. 22 shows a display example of the preview image based on the first preview image data, and FIG. 23 shows a display example of the preview image based on the second preview image data.
  • Preview display controller 316 (FIG. 20) causes a preview window as shown in FIGS. 22 and 23 to be displayed on operation panel 105 (FIGS. 2 and 3). This preview window is provided with preview display area 410, and in this preview display area 410, the preview image is displayed.
  • Moreover, job display button 402, setting contents button 404, preview button 406 and the like are arranged to the left side of the preview window. Furthermore, button group 412 for changing a size of the preview image displayed in preview display area 410 is arranged to the right side of preview display area 410. The operation when any one of these buttons is pressed is similar to that in FIGS. 9 and 10, and thus, a detailed description thereof is not repeated.
  • Referring to FIG. 22, first, when the user presses preview button 406, the preview image based on the first preview image data generated by first preview image generator 313 (FIG. 20) is displayed. Since the first preview image data is outputted as a color image similarly to the input image data, it is also displayed in color as the preview image.
  • On the other hand, after the preview display as shown in FIG. 22, if the image conversion processing is determined to be “Required”, image processor 304 (FIG. 20) generates the output image data from the input image data. Subsequently, second preview image generator 315 generates the second preview image data from the output image data. When the generation of the second preview image data has been completed, the display on operation panel 105 is switched from the preview display shown in FIG. 21 to the preview display shown in FIG. 22. Since the second preview image data is outputted as a monochrome image similarly to the output image data, which corresponds the input image data after the conversion, it is also displayed in monochrome as the preview image.
  • Moreover, after a preview image 470 based on the first preview image data is displayed (FIG. 22), preview display controller 316 (FIG. 20) displays a message 430 of “IMAGE DATA CONVERSION IN PROCESSING” indicating that the second preview image data is being generated, until the display is switched to a preview image 480 based on the second preview image data (FIG. 23).
  • As described above, when the user instructs the preview display and when the image conversion processing is required, preview image 470 corresponding to the input image is first displayed quickly, and subsequently, preview image 480 corresponding to the output image data obtained by converting the input image data is displayed. Thus, the user can check final output without feeling stress due to time required for performing the image processing.
  • <Regeneration Processing of Preview Image>
  • When the user checks the preview image as shown in FIG. 23, and then, changes the user setting relating to the image conversion processing, a preview image is regenerated.
  • Again, referring to FIG. 20, when the user setting is changed, first preview image generator 313 regenerates the first preview image data from the input image data. On the other hand, image processor 305 also performs the image processing in accordance with the user setting after the change to regenerate the output image data. Furthermore, second preview image generator 315 regenerates the second preview image data from this regenerated output image data. In this manner, the preview images as shown in the above-described FIGS. 22 and 23 are redisplayed based on the first and second preview image data generated by first and second preview image generators 313 and 315, respectively.
  • In this manner, since the preview image after setting change is quickly displayed on operation panel 105, the user can set the contents of the desired image conversion processing while checking the final output.
  • Whether it is before or after the user setting relating to the image conversion processing, if the image conversion processing is determined to be not required, the regeneration processing of the preview image may not be performed.
  • <Overall Processing>
  • Next, referring to FIGS. 2, 20 and 24, overall processing relating to the above-described image conversion processing is described.
  • A user who will output an input image data to a specific output destination operates operation panel 105 to select the input image data as an object, and to set an output mode (step S52). This output mode setting (user setting) is stored in RAM 103, hard disk 104 or the like.
  • When the user presses start key 128 on operation panel 105 after setting the output mode, input unit 318 outputs a start instruction to CPU 101 functioning as reader 302. In response to this start instruction, CPU 101 functioning as reader 302 reads out the specified input image data and a corresponding page information file from hard disk 104 (step S54). If the user setting file including the output mode setting is stored in hard disk 104 in advance, CPU 101 also reads out the user setting file.
  • Subsequently, CPU 101 determines whether or not the preview display is instructed by the user (step S56). If the preview display is instructed (in a case of YES in step S56), CPU 101 executes a preview display subroutine (step S58) to display a preview image on operation panel 105. After the execution of this preview display subroutine, CPU 101 determines whether or not the display of the setting window is instructed by the user (step S60).
  • If the display of the setting window is instructed by the user (in a case of YES in step S60), CPU 101 displays the setting window for changing the output mode setting (user setting) on operation panel 105 (step S62). Furthermore, CPU 101 determines whether or not change of the user setting is instructed on the setting window (step S64).
  • If any change of the output mode is instructed on the setting window (in a case of YES in step S64), CPU 101 reflects the change contents on the stored output mode setting (user setting) to update the contents of the output mode setting (step S66). CPU 101 again executes the preview display subroutine based on the output mode setting after this change (step S58) to update the preview image on operation panel 105.
  • On the other hand, if the preview display is not instructed (in a case of NO in step S56), if the display of the setting window is not instructed by the user (in a case of NO in step S60), or if no change of the user setting is instructed on the setting window (in a case of NO in step S64), CPU 101 determines whether or not the output of the output image data is instructed (step S68).
  • If the output of the output image data is instructed (in a case of YES in step S68), CPU 101 functioning as determining unit 320 determines whether or not the image conversion processing is required based on the contents of the output mode setting and the contents of the page information file associated with the specified input image data (step S70).
  • If the image conversion processing is determined to be required (in a case of YES in step S70), CPU 101 functioning as image processor 305 performs the image processing (image conversion processing) to the input image data read out in step S54 in accordance with the specified output mode setting to generate the output image data (step S72). This output image data is stored in RAM 103 functioning as buffer 306.
  • On the other hand, if the image conversion processing is determined to be not required (in a case of NO in step S70), CPU 101 functioning as image processor 305 generates the input image data read out in step S54 as the output image data as it is (step S74).
  • Subsequently, CPU 101 functioning as output unit 308 outputs the output image data generated in step S72 or in step S74 (step S76). Then, a series of processing ends.
  • If the output image data has been already generated for displaying the preview image, the processing in step S72 or in step S74 may be skipped.
  • On the other hand, if the output of the output image data is not instructed (in a case of NO in step S68), CPU 101 repeatedly executes the processing in step S56 and later.
  • <Preview Display Processing>
  • Referring to FIGS. 2, 20 and 25, CPU 101 functioning as image reducing unit 313 a reduces the input image data read out in step S54 of FIG. 24 to generate the first preview image data (step S180). This first preview image data is stored in RAM 103 functioning as buffer 313 b. CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image data (step S181).
  • Subsequently, CPU 101 functioning as determining unit 320 determines whether or not the image conversion processing is required based on the contents of the output mode setting and the contents of the page information file associated with the specified input image data (step S182).
  • If the image conversion processing is determined to be required (in a case of YES in step S182), CPU 101 functioning as preview display controller 316 displays the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 (step S183). Subsequently, CPU 101 functioning as image processor 305 performs the image processing (image conversion processing) to the input image data read out in step S54 of FIG. 24, in accordance with the specified output mode setting to generate the output image data (step S184). This output image data is stored in RAM 103 functioning as buffer 306.
  • Furthermore, CPU 101 functioning as second preview image generator 315 reduces the output image data generated in step S184 to generate the second preview image data (step S185). CPU 101 functioning as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S186). At this time, CPU 101 makes the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 undisplayed. The processing then returns to step S60 in FIG. 24.
  • On the other hand, if the image conversion processing is determined to be not required (in a case of NO in step S182), CPU 101 generates neither of the output image data and the second preview image data, and ends the preview display subroutine with the display of the first preview image maintained. The processing then returns to step S60 in FIG. 24.
  • Functional Effect in the Present Embodiment
  • According to Embodiment 2 of the present invention, in the preview display of the output image data, the preview image based on the first preview image data generated from the input image data is first displayed quickly, and subsequently to this image, if the image conversion processing is required, the second preview image data is generated from the output image data after the image conversion, and the preview image based on this second preview image data is displayed. This can alleviate stress that the user feels due to the time required for the preview display, and the contents relating to the desired image conversion processing can be set quickly.
  • Modification of Embodiment 2
  • As a modification of Embodiment 2 of the present invention, a configuration in which the generation processing of the second preview image data corresponding to the output image data is modified is illustrated. Basically, configurations other than the configuration relating to the generation of the second preview image data are similar to those of the above-described Embodiment 1 or 2, and thus, a detailed description thereof is not repeated. <Control Structure>
  • Referring to FIG. 26, in a control structure of an MFP 2# according to the modification of Embodiment 2 of the present invention, a second preview image generator 315# is provided in place of second preview image generator 315 in the control structure of MFP 2 according to Embodiment 2 shown in FIG. 20. The other units are similar to those in FIG. 20, and a detailed description thereof is not repeated.
  • While in MFP 2 according to Embodiment 2, image processor 305 temporarily generates the output image data for displaying a preview image on operation panel 105, in MFP 2# according to the modification of Embodiment 2, a preview image can be displayed without the generation of the output image data by image processor 305.
  • Referring to FIG. 26, specifically, second preview image generator 315# generates the second preview image data based on the first preview image data generated by image reducing unit 313 a included in first preview image generator 313. Namely, second preview image generator 315# performs the image processing (image conversion processing) equivalent to that of image processor 305 to the first preview image data stored in buffer 313 b, in accordance with the specified output mode setting to generate the second preview image data.
  • As described above, in MFP 2# according to the modification of Embodiment 2, the second preview image data is generated from the first preview image data, which has a smaller image size than that of the input image data. Thus, an amount of processing relating to the generation of the second preview image data can be reduced, so that the preview display can be further speeded up.
  • <Regeneration Processing of Preview Image>
  • Similarly to the above-described Embodiment 2, when the user setting is changed after the preview image data corresponding to the output image data is displayed, a preview image is regenerated.
  • Specifically, when the user setting relating to the image conversion processing is changed, second preview image generator 315# regenerates the second preview image data from the first preview image data stored in buffer 313 b of the first preview image generator 313. Image reducing unit 313 a does not need to regenerate the first preview image, unless the specified input image data is changed.
  • <Preview Display Processing>
  • The contents of the overall processing in MFP 2# according to the modification of Embodiment 2 are similar to those in the above-described flowchart shown in FIG. 24, except for the processing contents of the preview display subroutine (step S58), and thus a detailed description thereof is not repeated.
  • FIG. 27 shows a flowchart showing the processing according to the modification of the present embodiment of the preview display subroutine shown in FIG. 24 (step S58). Among processing steps shown in FIG. 27, the same symbols are given to those having the processing contents similar to those of the processing steps shown in FIG. 25.
  • Referring to FIGS. 2, 20 and 27, CPU 101 functioning as image reducing unit 313 a reduces the input image data read out in step S54 in FIG. 24 to generate the first preview image data (step S180). This first preview image data is stored in RAM 103 functioning as buffer 313 b. CPU 101 functioning as preview display controller 316 displays the first preview image on operation panel 105 based on this first preview image (step S181).
  • Subsequently, CPU 101 functioning as determining unit 320 determines whether or not the image conversion processing is required based on the contents of the output mode setting and the contents of the page information file associated with the specified input image data (step S182).
  • If the image conversion processing is determined to be required (in a case of YES in step S182), CPU 101 functioning as preview display controller 316 displays the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 (step S183). Subsequently, CPU 101 functioning as second preview image generator 315# performs the image processing (image conversion processing) to the first preview image data stored in RAM 103 in accordance with the specified output mode setting to generate the second preview image data (step S185A). CPU 101 functioning as the preview as preview display controller 316 switches the display on operation panel 105 from the first preview image based on the first preview image data to the second preview image based on the second preview image data (step S186). At this time, CPU 101 makes the message of “IMAGE DATA CONVERSION IN PROCESSING” on operation panel 105 undisplayed. The processing returns to steps S60 in FIG. 24.
  • On the other hand, if the image conversion processing is determined to be not required (in a case of NO in step S182), CPU 101 does not generate the second preview image data, and ends the preview display subroutine with the display of the first preview image maintained. The processing returns to step S60 in FIG. 24.
  • Functional Effect in Modification of the Present Embodiment
  • According to the modification of Embodiment 2 of the present invention, in addition to the effect in the above-described Embodiment 2, the preview image based on the second preview image data can be more quickly displayed.
  • Other Embodiments
  • In the above-described embodiments, the configurations in which the image processing apparatus according to the present invention is implemented by the MFP are illustrated, the image processing apparatus according to the present invention may be implemented using a personal computer on which a document creation application and the like are executed. In this case, installing an image processing program according to the present invention in the personal computer allows the personal computer to function as the image processing apparatus according to the present invention. The document creation application executed in the personal computer may generate input image data as an object.
  • Furthermore, the image processing program according to the present invention may also read out necessary modules in a predetermined sequence and at predetermined timing among program modules provided as a part of the operating system so as to cause the modules to execute the processing. In this case, the above-described modules may not be included in the program itself, but the processing may be executed in cooperation with the operating system. The program not including the above-described modules can also be included by the program according to the present invention.
  • The image processing program according to the present invention may also be provided by being incorporated in a part of another program. Also, in this case, the modules included in the above-described another program are not included in the program itself, but the processing is executed in cooperation with the other program. The above-described program incorporated in the other program can also be included by the program according to the present invention.
  • A provided program product is installed in a program storage such as a hard disk to be executed. The program product includes the program itself, and a storage medium in which the program is stored.
  • Furthermore, some or all of the functions implemented by the image processing program according to the present invention may be configured by dedicated hardware.
  • Although the present invention has been described and illustrated in detail, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, the scope of the present invention being interpreted by the terms of the appended claims.

Claims (23)

1. An image processing apparatus comprising:
a display:
an input unit for receiving an operation by a user for user setting;
an image processor for generating, by image-processing first image data in accordance with said user setting, second image data; and
a controller for providing a preview display on said display prior to outputting said second image data, wherein
said controller including;
a first image generator for generating first preview image data from said first image data, and for displaying a first preview image on said display based on the generated first preview image data, and
a second image generator for generating second preview image data corresponding to said second image data, and for updating said preview display on said display from said first preview image to a second preview image based on the generated second preview image data.
2. The image processing apparatus according to claim 1, wherein
said image-processing includes image synthesis processing of synthesizing third image data on said first image data to generate said second image data, and
said first image generator is configured to generate said first preview image data that is changed in a screen appearance of a portion of an area corresponding to an area on said first image data in which said third image data is to be synthesized.
3. The image processing apparatus according to claim 2, wherein
said second image generator is configured to generate said second preview image data from said second image data generated by said image processor.
4. The image processing apparatus according to claim 2, wherein
said first image generator is further configured to;
generate third preview image data having a smaller image size from said first image data,
store the generated third preview image data, and
generate said first preview image data from said third preview image data, and
said second image generator is configured to generate said second preview image data from said third preview image data stored by said first image generator.
5. The image processing apparatus according to claim 4, wherein
said second image generator is further configured to regenerate, in response to change of said user setting relating to the image synthesis processing, said second preview image data from said third preview image data stored by said first image generator.
6. The image processing apparatus according to claim 2, wherein
said first image generator is configured to generate said first preview image data by executing at least any one of;
adding a frame indicating the area in which said third image data is to be synthesized,
changing a characteristic value of a pixel included in the area in which said third image data is to be synthesized, and
replacing the area in which said third image data is to be synthesized by a predetermined pattern image.
7. The image processing apparatus according to claim 1, wherein
said image-processing includes image conversion processing of converting said first image data to said second image data having an output mode specified by said user setting,
said image processor is configured to,
determine requirement of the image conversion processing based on an attribute of said first image data and said user setting, and
execute the image conversion processing to generate said second image data when the image conversion processing is determined to be required.
8. The image processing apparatus according to claim 7, wherein
said second image generator is configured to generate said second preview image data from the generated second image data when the image conversion processing to said first image data is executed by said image processor.
9. The image processing apparatus according to claim 7, wherein
said first image generator is configured to;
generate said first preview image data having a smaller image size from said first image data, and
store the generated first preview image data, and
said second image generator is configured to image-convert said first preview image data stored by said first image generator to generate said second preview image data.
10. The image processing apparatus according to claim 9, wherein
said second image generator is configured to regenerate, in response to change of said user setting relating to the image conversion processing, said second preview image data from said first preview image data stored by said first image generator.
11. The image processing apparatus according to claim 1, wherein
said controller is configured to cause said display to display, in addition to said preview display, that generation of said second preview image data is in processing in at least a part of a period between the time said first preview image is displayed and the time the displayed first preview image is updated to said second preview image.
12. An image processing method in an image processing apparatus including a display and an input unit, comprising the steps of:
generating, by image-processing first image data in accordance with user setting, second image data; and
providing a preview display on said display prior to outputting said second image data, wherein
said step of providing said preview display including the steps of:
generating first preview image data from said first image data,
displaying a first preview image on said display based on the generated first preview image data,
generating second preview image data corresponding to said second image data, and
updating said preview display on said display from said first preview image to a second preview image based on the generated second preview image data.
13. The image processing method according to claim 12, wherein
said image-processing includes image synthesis processing of synthesizing third image data on said first image data to generate said second image data, and
said step of displaying said first preview image includes the step of generating said first preview image data that is changed in a screen appearance of a portion of an area corresponding to an area on said first image data in which said third image data is to be synthesized.
14. The image processing method according to claim 13, wherein
said step of generating said second preview image data includes the step of generating said second preview image data from said second image data.
15. The image processing method according to claim 13, wherein
said step of generating said first preview image data includes the steps of;
generating third preview image data having a smaller image size from said first image data,
storing said generated third preview image data, and
generating said first preview image data from said third preview image data, and
said step of generating said second preview image data includes the step of generating said second preview image data from the stored third preview image data.
16. The image processing method according to claim 15, further comprising the step of:
regenerating, in response to change of said user setting relating to the image synthesis processing, said second preview image data from the stored third preview image data.
17. The image processing method according to claim 13, wherein
said step of displaying said first preview image includes the step of generating said first preview image data by executing at least any one of;
adding a frame indicating the area in which said third image data is to be synthesized,
changing a characteristic value of a pixel included in the area in which said third image data is to be synthesized, and
replacing the area in which said third image data is to be synthesized by a predetermined pattern image.
18. The image processing method according to claim 12, wherein
said image-processing includes image conversion processing of converting said first image data to said second image data having an output mode specified by said user setting,
said step of generating said second image data includes the steps of;
determining requirement of the image conversion processing based on an attribute of said first image data and said user setting, and
executing the image conversion processing to generate said second image data when the image conversion processing is determined to be required.
19. The image processing method according to claim 18, wherein
said step of generating said second preview image data includes the step of generating said second preview image data from the generated second image data when the image conversion processing to said first image data is executed.
20. The image processing method according to claim 18, wherein
said step of generating said first preview image data includes the steps of;
generating said first preview image data having a smaller image size from said first image data, and
storing the generated first preview image data, and
said step of generating the second preview image data includes the step of image-converting the stored first preview image data to generate said second preview image data.
21. The image processing method according to claim 20, further comprising the step of:
regenerating, in response to change of said user setting relating to the image conversion processing, said second preview image data from the stored first preview image data.
22. The image processing method according to claim 12, wherein
said step of providing said preview display further includes the step of displaying that generation of said second preview image data is in processing in at least a part of a period between the time said first preview image is displayed and the time the displayed first preview image is updated to said second preview image.
23. A computer-readable medium that stores an image processing program for executing an image processing method in a computer having a display and an input unit, said image processing program causing said computer to execute the steps of:
generating, by image-processing first image data in accordance with user setting, second image data; and
providing a preview display on said display prior to outputting said second image data, wherein
said step of providing said preview display including the steps of;
generating first preview image data from said first image data,
displaying a first preview image on said display based on the generated first preview image data,
generating second preview image data corresponding to said second image data, and
updating said preview display on said display from said first preview image to a second preview image based on the generated second preview image data.
US12/468,328 2008-05-23 2009-05-19 Image processing apparatus with preview display function, image processing method, and image processing program Active 2032-11-04 US8861022B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2008135830A JP4752868B2 (en) 2008-05-23 2008-05-23 Image processing apparatus, image processing method, and image processing program
JP2008-135830 2008-05-23

Publications (2)

Publication Number Publication Date
US20090290182A1 true US20090290182A1 (en) 2009-11-26
US8861022B2 US8861022B2 (en) 2014-10-14

Family

ID=41341878

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/468,328 Active 2032-11-04 US8861022B2 (en) 2008-05-23 2009-05-19 Image processing apparatus with preview display function, image processing method, and image processing program

Country Status (2)

Country Link
US (1) US8861022B2 (en)
JP (1) JP4752868B2 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020097433A1 (en) * 2001-01-19 2002-07-25 Chang William Ho Method of operating an information apparatus and software for carrying out the method
CN102109967A (en) * 2009-12-28 2011-06-29 兄弟工业株式会社 Printer
US20120084644A1 (en) * 2010-09-30 2012-04-05 Julien Robert Content preview
US20120243024A1 (en) * 2011-03-25 2012-09-27 Brother Kogyo Kabushiki Kaisha Information Processing Devices and Information Processing Processes
US20120324352A1 (en) * 2011-06-15 2012-12-20 Konica Minolta Business Technologies, Inc. Client server system and client device of client server system
US8711408B2 (en) 2000-11-20 2014-04-29 Flexiworld Technologies, Inc. Smart television system having methods or means for accessing paid or subscribed digital content from the internet
US9092177B2 (en) 2000-11-01 2015-07-28 Flexiworld Technologies, Inc. Smart phones that include a digital camera, a touch sensitive screen, support for voice activated commands, and support to at least part of a protocol within IEEE 802.11 standards
US9990168B2 (en) * 2016-02-16 2018-06-05 Ricoh Company, Ltd. Recording medium, information processing apparatus, and information processing method
US10860290B2 (en) 2000-11-01 2020-12-08 Flexiworld Technologies, Inc. Mobile information apparatuses that include a digital camera, a touch sensitive screen interface, support for voice activated commands, and a wireless communication chip or chipset supporting IEEE 802.11
US10915296B2 (en) 2000-11-01 2021-02-09 Flexiworld Technologies, Inc. Information apparatus that includes a touch sensitive screen interface for managing or replying to e-mails
US11204729B2 (en) 2000-11-01 2021-12-21 Flexiworld Technologies, Inc. Internet based digital content services for pervasively providing protected digital content to smart devices based on having subscribed to the digital content service
US11272164B1 (en) * 2020-01-17 2022-03-08 Amazon Technologies, Inc. Data synthesis using three-dimensional modeling

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5627485B2 (en) * 2011-01-28 2014-11-19 京セラドキュメントソリューションズ株式会社 Image processing apparatus, image forming apparatus, and image processing method
JP6045560B2 (en) * 2014-12-22 2016-12-14 シャープ株式会社 Image processing apparatus and display method
JP6281520B2 (en) * 2015-03-31 2018-02-21 京セラドキュメントソリューションズ株式会社 Image forming apparatus
WO2016181716A1 (en) * 2015-05-08 2016-11-17 京セラドキュメントソリューションズ株式会社 Image formation device
JP6250618B2 (en) * 2015-12-10 2017-12-20 シャープ株式会社 Image forming apparatus and preview display method of image forming apparatus
JP2017226178A (en) * 2016-06-24 2017-12-28 富士ゼロックス株式会社 Display device, image forming apparatus, and program
JP6309070B2 (en) * 2016-11-14 2018-04-11 シャープ株式会社 Image processing device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5847848A (en) * 1994-07-06 1998-12-08 Canon Kabushiki Kaisha Image processing apparatus which previews both input and edited image data
US20070133073A1 (en) * 2005-12-13 2007-06-14 Haruo Shida Information processing apparatus, computer program product and preview image display method
US20080007482A1 (en) * 2006-07-06 2008-01-10 Sharp Kabushiki Kaisha Display apparatus and electronic apparatus having the display apparatus
US20080218776A1 (en) * 2007-03-07 2008-09-11 Junichi Takami Image processing apparatus, computer program product, and preview image displaying method
US7986298B1 (en) * 2005-12-19 2011-07-26 Adobe Systems Incorporated Identifying changes to an image file
US8086961B2 (en) * 2006-12-05 2011-12-27 Ricoh Company, Ltd. Image processing apparatus, image forming apparatus, and computer program product

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10126606A (en) 1996-10-23 1998-05-15 Canon Inc Image processor and its method
JP2001014130A (en) * 1999-06-28 2001-01-19 Canon Inc Display controller, display control method and storage medium
JP2003208300A (en) * 2002-01-15 2003-07-25 Minolta Co Ltd File managing program, recording medium with its program recorded, and file managing method
JP4211360B2 (en) * 2002-11-12 2009-01-21 セイコーエプソン株式会社 Print preview image generation device
JP2004192394A (en) * 2002-12-12 2004-07-08 Canon Inc Information processor
JP2006215745A (en) * 2005-02-02 2006-08-17 Canon Inc Printing control device and printing control method
JP2007036809A (en) * 2005-07-28 2007-02-08 Ricoh Co Ltd Image forming apparatus
JP2007048214A (en) * 2005-08-12 2007-02-22 Canon Inc Print preview display method and print system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5847848A (en) * 1994-07-06 1998-12-08 Canon Kabushiki Kaisha Image processing apparatus which previews both input and edited image data
US20070133073A1 (en) * 2005-12-13 2007-06-14 Haruo Shida Information processing apparatus, computer program product and preview image display method
US7986298B1 (en) * 2005-12-19 2011-07-26 Adobe Systems Incorporated Identifying changes to an image file
US20080007482A1 (en) * 2006-07-06 2008-01-10 Sharp Kabushiki Kaisha Display apparatus and electronic apparatus having the display apparatus
US8086961B2 (en) * 2006-12-05 2011-12-27 Ricoh Company, Ltd. Image processing apparatus, image forming apparatus, and computer program product
US20080218776A1 (en) * 2007-03-07 2008-09-11 Junichi Takami Image processing apparatus, computer program product, and preview image displaying method

Cited By (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10740066B2 (en) 2000-11-01 2020-08-11 Flexiworld Technologies, Inc. Output devices that establish wireless connection with an information apparatus subsequent to having been wirelessly discovered by the information apparatus
US10761791B2 (en) 2000-11-01 2020-09-01 Flexiworld Technologies, Inc. Wireless printing devices that provide printing services over a network without a need for a client device of the printing device to use, at the client device, a printer specific printer driver
US11416197B2 (en) 2000-11-01 2022-08-16 Flexiworld Technologies, Inc. Wireless controllers connectable to televisions, wireless televisions, wireless output controllers, or wireless output devices for receiving digital content from one or more servers over the internet
US11096056B2 (en) 2000-11-01 2021-08-17 Flexiworld Technologies, Inc. Output devices, such as televisions, output controllers, or audio output devices, that are setup to wirelessly receive digital content from a digital content service over the internet or from a wireless information apparatus that is in the same network as the output devices
US11029903B2 (en) 2000-11-01 2021-06-08 Flexiworld Technologies, Inc. Output systems, such as television controllers, televisions, display devices, or audio output devices, operable for playing digital content wirelessly received either from a digital content service over the internet or wirelessly received from a client device that is in the same network as the output system
US10915296B2 (en) 2000-11-01 2021-02-09 Flexiworld Technologies, Inc. Information apparatus that includes a touch sensitive screen interface for managing or replying to e-mails
US10873856B2 (en) 2000-11-01 2020-12-22 Flexiworld Technologies, Inc. Printing devices supporting printing over air or printing over a wireless network
US10140073B2 (en) 2000-11-01 2018-11-27 Flexiworld Technologies, Inc. Wireless devices that establish a wireless connection with a mobile information apparatus by wirelessly detecting, within physical proximity, the mobile information apparatus
US10866773B2 (en) 2000-11-01 2020-12-15 Flexiworld Technologies, Inc. Information apparatus for playing digital content that is received from a digital content service provided over the internet
US10860290B2 (en) 2000-11-01 2020-12-08 Flexiworld Technologies, Inc. Mobile information apparatuses that include a digital camera, a touch sensitive screen interface, support for voice activated commands, and a wireless communication chip or chipset supporting IEEE 802.11
US10846031B2 (en) 2000-11-01 2020-11-24 Flexiworld Technologies, Inc. Software application for a mobile device to wirelessly manage or wirelessly setup an output system or output device for service
US9037088B2 (en) 2000-11-01 2015-05-19 Flexiworld Technologies, Inc. Smart phone that includes a wireless communication unit compatible with at least one protocol within bluetooth and/or IEEE802.11 standards for wireless transmission of audio digital content from the smart phone to a wireless audio output device for voice output or music playing
US10768871B2 (en) 2000-11-01 2020-09-08 Flexiworld Technologies, Inc. Wireless output devices or wireless controllers for establishing wireless connectivity and for receiving digital content
US10642576B2 (en) 2000-11-01 2020-05-05 Flexiworld Technologies, Inc. Mobile information apparatus that includes wireless communication circuitry for discovery of an output device for outputting digital content at the wirelessly discovered output device
US9092177B2 (en) 2000-11-01 2015-07-28 Flexiworld Technologies, Inc. Smart phones that include a digital camera, a touch sensitive screen, support for voice activated commands, and support to at least part of a protocol within IEEE 802.11 standards
US9110622B2 (en) 2000-11-01 2015-08-18 Flexiworld Technologies, Inc. Internet-pads that include a digital camera, a touch sensitive screen interface, and support for voice activated commands
US10592201B2 (en) 2000-11-01 2020-03-17 Flexiworld Technologies, Inc. Mobile information apparatus supporting mobile payment having security based, at least in part, on device identification number, password or pin code, data encryption, and short physical distance wireless communication
US10592202B2 (en) 2000-11-01 2020-03-17 Flexiworld Technologies, Inc. Mobile information apparatus supporting mobile payment that includes security based, at least partly, on user pushbutton, user biometrics, data encryption, and short physical distance wireless communication
US9383956B2 (en) 2000-11-01 2016-07-05 Mattel, Inc. Smart phones that include touch sensitive screen and supporting voice activated commands for managing or replying to E-mails
US10489096B2 (en) 2000-11-01 2019-11-26 Flexiworld Technologies, Inc. Information apparatus and application for receiving digital content from a digital content service over the internet and for playing at least part of the received digital content at an output device
US9798516B2 (en) 2000-11-01 2017-10-24 Flexiworld Technologies, Inc. Smart phones that support wireless printing of emails over air to a wireless printer in a wireless local area network
US10481847B2 (en) 2000-11-01 2019-11-19 Flexiworld Technologies, Inc. Information apparatus and software applications supporting output of digital content over a network to a registered output device
US10481846B2 (en) 2000-11-01 2019-11-19 Flexiworld Technologies, Inc. Software applications and information apparatus for printing over air or for printing over a network
US10387087B2 (en) 2000-11-01 2019-08-20 Flexiworld Technologies, Inc. Output systems or audio output devices that include an interface operable by a user to initiate wireless discovery for establishing wireless connections with mobile devices
US10162596B2 (en) 2000-11-01 2018-12-25 Flexiworld Technologies, Inc. Portable electronic device configured to receive voice activated commands and to wirelessly manage or drive an output device
US10152285B2 (en) 2000-11-01 2018-12-11 Flexiworld Technologies, Inc. Mobile information apparatus that includes voice commands for playing digital content that is received from a digital content service provided over the internet
US11204729B2 (en) 2000-11-01 2021-12-21 Flexiworld Technologies, Inc. Internet based digital content services for pervasively providing protected digital content to smart devices based on having subscribed to the digital content service
US10037178B2 (en) 2000-11-01 2018-07-31 Flexiworld Technologies, Inc. Wireless output devices or wireless controllers that support wireless device discovery for establishing wireless connectivity
US10126991B2 (en) 2000-11-01 2018-11-13 Flexiworld Technologies, Inc. Output systems, information apparatus, or internet appliances supporting voice commands for receiving and for playing selected digital content from a service over a network
US10140072B2 (en) 2000-11-01 2018-11-27 Flexiworld Technologies, Inc. Sound output system or internet appliance that supports voice activated commands, and that plays audio data received from a service over a network
US10133527B2 (en) 2000-11-20 2018-11-20 Flexiworld Technologies, Inc. Wireless devices that communicate, via short range wireless communication, with a mobile client device for establishing services of the wireless device with a server over the internet
US10606535B2 (en) 2000-11-20 2020-03-31 Flexiworld Technologies, Inc. Internet based digital content services that provide content upload, content storage, content sharing, and content playlist selection; and smart devices with access to the internet based digital content services
US8711408B2 (en) 2000-11-20 2014-04-29 Flexiworld Technologies, Inc. Smart television system having methods or means for accessing paid or subscribed digital content from the internet
US9971555B2 (en) 2000-11-20 2018-05-15 Flexiworld Technologies, Inc. Internet based digital content services that provide content upload, content storage, content sharing, content playlist selection, content editing, or content download; and smart phones, information pads, smart televisions and printers with access to the internet based digital content services
US9965233B2 (en) 2000-11-20 2018-05-08 Flexiworld Technologies, Inc. Digital content services or stores over the internet that transmit or stream protected or encrypted digital content to connected devices and applications that access the digital content services or stores
US11169756B2 (en) 2000-11-20 2021-11-09 Flexijet Technologies, Inc. Method for capturing, storing, accessing, and outputting digital content
US10303411B2 (en) 2000-11-20 2019-05-28 Pebble Tide Llc Method for capturing, storing, accessing, and outputting digital content
US10346114B2 (en) 2000-11-20 2019-07-09 Flexiworld Technologies, Inc. Digital content services over the internet that transmit or stream protected digital content to mobile devices, display devices, audio output devices, printing devices, televisions, or television controllers
US8964220B2 (en) 2000-11-20 2015-02-24 Flexiworld Technologies, Inc. Mobile devices supporting wireless synchronization over a wireless Network compatible, at least partly, with IEEE 802.11 standard(s)
US10261739B2 (en) 2000-11-20 2019-04-16 Pebble Tide Llc System for capturing and outputting digital content over a network that includes the internet
US9836259B2 (en) 2000-11-20 2017-12-05 Flexiworld Technologies, Inc. Televisions, output controllers, or speakers that are setup to wirelessly connect to a network and to receive digital content from a digital content service over the network
US9389822B2 (en) 2000-11-20 2016-07-12 Flexiworld Technologies, Inc. Mobile information apparatus that include support for receiving video digital content over the internet from a service, and for wireless displaying or playing over air at least part of the received video digital content from the mobile information apparatus to televisions, television controllers, display devices, or projection devices
US9298407B2 (en) 2000-11-20 2016-03-29 Flexiworld Technologies, Inc. Mobile information apparatus that are configurable to include applications for playing audio digital content received over the internet from subscribed audio digital content service(s)
US10140071B2 (en) 2001-01-19 2018-11-27 Flexiworld Technologies, Inc. Printers, printer controllers, printer software, or printer firmware for supporting wireless printing or printing over air
US9841935B2 (en) 2001-01-19 2017-12-12 Flexiworld Technologies, Inc. Wireless television or controller wire connectable to a television for receiving and rendering digital content
US9836257B2 (en) * 2001-01-19 2017-12-05 Flexiworld Technologies, Inc. Mobile information apparatus that includes intelligent wireless display, wireless direct display, or transfer of digital content for playing over air the digital content at smart televisions, television controllers, or audio output devices
US20020097433A1 (en) * 2001-01-19 2002-07-25 Chang William Ho Method of operating an information apparatus and software for carrying out the method
US9069510B2 (en) 2001-01-19 2015-06-30 Flexiworld Technologies, Inc. Touch sensitive screen information apparatus that includes close proximity or near distance radio frequency field communication
US9042811B2 (en) 2001-01-19 2015-05-26 Flexiworld Technologies, Inc. Specification of smart wireless television for rendering digital content
US10841798B2 (en) 2001-01-19 2020-11-17 Flexiworld Technologies, Inc. Information apparatus or client software that wirelessly discovers, within short range, one or more output devices for establishing a wireless connection
US9036181B2 (en) 2001-01-19 2015-05-19 Flexiworld Technologies, Inc. Wireless printing device for printing digital content received via wireless communication compatible, at least partly, with IEEE 802.11 or Bluetooth
US8989064B2 (en) 2001-01-19 2015-03-24 Flexiworld Technologies, Inc. Wireless controller wire connectable to output devices such as televisions for accessing digital content and for wireless communication with mobile information apparatus
US20110157627A1 (en) * 2009-12-28 2011-06-30 Brother Kogyo Kabushiki Kaisha Printer
EP2339449A3 (en) * 2009-12-28 2013-03-20 Brother Kogyo Kabushiki Kaisha Printer
CN102109967A (en) * 2009-12-28 2011-06-29 兄弟工业株式会社 Printer
US9134941B2 (en) * 2009-12-28 2015-09-15 Brother Kogyo Kabushiki Kaisha Printer
US20120084644A1 (en) * 2010-09-30 2012-04-05 Julien Robert Content preview
US20120243024A1 (en) * 2011-03-25 2012-09-27 Brother Kogyo Kabushiki Kaisha Information Processing Devices and Information Processing Processes
US20120324352A1 (en) * 2011-06-15 2012-12-20 Konica Minolta Business Technologies, Inc. Client server system and client device of client server system
US9990168B2 (en) * 2016-02-16 2018-06-05 Ricoh Company, Ltd. Recording medium, information processing apparatus, and information processing method
US11272164B1 (en) * 2020-01-17 2022-03-08 Amazon Technologies, Inc. Data synthesis using three-dimensional modeling

Also Published As

Publication number Publication date
US8861022B2 (en) 2014-10-14
JP4752868B2 (en) 2011-08-17
JP2009282853A (en) 2009-12-03

Similar Documents

Publication Publication Date Title
US8861022B2 (en) Image processing apparatus with preview display function, image processing method, and image processing program
JP4704288B2 (en) Image processing apparatus and program
JP4631925B2 (en) Image processing apparatus, image processing method, and image processing program
US8407591B2 (en) Image processing apparatus, computer program product, and preview image displaying method
US8086961B2 (en) Image processing apparatus, image forming apparatus, and computer program product
JP4419152B2 (en) Image forming system and image forming method
JP2007188054A (en) Image forming apparatus, program, and item setting processing method
US8599406B2 (en) Image forming apparatus, printing method and printing program for receiving an image from a server via a network and printing the image corresponding to area displayed on display unit to correspond to a user&#39;s designated sheet size
EP2278449A2 (en) Apparatus, method, system and storage medium for setting print status
US20080278758A1 (en) Image processing system, computer program product, and image processing method
US8891129B2 (en) Image forming apparatus having real-size preview function, method of controlling the same, and storage medium
US8576428B2 (en) Image forming apparatus forms an output image from an image-repeated image
JP5462557B2 (en) Image processing apparatus and control method thereof
JP2008269325A (en) Printer and print system
JP4577132B2 (en) Image output system
JP6917285B2 (en) Image forming device
JP2014017636A (en) Image reader and program
US8437046B2 (en) Image processing apparatus and method for outputting an image subjected to pseudo-halftone processing
JP4591208B2 (en) Image forming apparatus
JP4784635B2 (en) Image processing apparatus, image forming apparatus, and program
JP2008213406A (en) Printing processor, printing processing method, and its program
JP2014127923A (en) Image processing program, image processor and control method of image processor
JP2023018850A (en) program
US20130063775A1 (en) Image forming apparatus capable of providing actual-size preview, method of controlling the same, and storage medium
JP4821645B2 (en) Image processing system, image processing apparatus, and image processing program

Legal Events

Date Code Title Description
AS Assignment

Owner name: KONICA MINOLTA BUSINESS TECHNOLOGIES, INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HASHIMOTO, MASAYA;UCHIDA, HISASHI;TAMAI, YOSHIYUKI;AND OTHERS;REEL/FRAME:022702/0771

Effective date: 20090427

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8