WO2003005446A1 - Imaging system and methodology employing reciprocal space optical design - Google Patents
Imaging system and methodology employing reciprocal space optical design Download PDFInfo
- Publication number
- WO2003005446A1 WO2003005446A1 PCT/US2002/021392 US0221392W WO03005446A1 WO 2003005446 A1 WO2003005446 A1 WO 2003005446A1 US 0221392 W US0221392 W US 0221392W WO 03005446 A1 WO03005446 A1 WO 03005446A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sensor
- image
- size
- illumination
- analysis
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 97
- 238000000034 method Methods 0.000 title claims abstract description 77
- 230000003287 optical effect Effects 0.000 title claims description 81
- 238000013461 design Methods 0.000 title description 62
- 238000005286 illumination Methods 0.000 claims abstract description 55
- 238000012546 transfer Methods 0.000 claims abstract description 34
- 230000008569 process Effects 0.000 claims abstract description 30
- 239000012620 biological material Substances 0.000 claims description 52
- 238000004458 analytical method Methods 0.000 claims description 44
- 239000002245 particle Substances 0.000 claims description 33
- 238000005259 measurement Methods 0.000 claims description 16
- 238000013507 mapping Methods 0.000 claims description 15
- 238000007689 inspection Methods 0.000 claims description 12
- 238000004519 manufacturing process Methods 0.000 claims description 11
- 239000010409 thin film Substances 0.000 claims description 11
- 238000012544 monitoring process Methods 0.000 claims description 9
- 239000004065 semiconductor Substances 0.000 claims description 7
- 238000004513 sizing Methods 0.000 claims description 7
- 230000001427 coherent effect Effects 0.000 claims description 6
- 230000007547 defect Effects 0.000 claims description 6
- 239000000835 fiber Substances 0.000 claims description 5
- 241000276498 Pollachius virens Species 0.000 claims description 4
- 238000002347 injection Methods 0.000 claims description 4
- 239000007924 injection Substances 0.000 claims description 4
- 238000000386 microscopy Methods 0.000 claims description 4
- 230000007170 pathology Effects 0.000 claims description 4
- 230000001413 cellular effect Effects 0.000 claims description 3
- 238000005272 metallurgy Methods 0.000 claims description 2
- 238000003860 storage Methods 0.000 abstract description 5
- 238000012634 optical imaging Methods 0.000 abstract description 3
- 238000012545 processing Methods 0.000 description 31
- 210000004027 cell Anatomy 0.000 description 27
- 239000000463 material Substances 0.000 description 16
- 230000006870 function Effects 0.000 description 13
- 230000005540 biological transmission Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 239000000758 substrate Substances 0.000 description 9
- 230000000694 effects Effects 0.000 description 8
- 230000009467 reduction Effects 0.000 description 8
- 238000004422 calculation algorithm Methods 0.000 description 7
- 238000012512 characterization method Methods 0.000 description 7
- 230000002159 abnormal effect Effects 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000005284 excitation Effects 0.000 description 6
- 239000010408 film Substances 0.000 description 6
- 238000005457 optimization Methods 0.000 description 6
- 230000002829 reductive effect Effects 0.000 description 6
- 238000011160 research Methods 0.000 description 6
- 230000000052 comparative effect Effects 0.000 description 5
- 238000003745 diagnosis Methods 0.000 description 5
- 230000000737 periodic effect Effects 0.000 description 5
- 238000004886 process control Methods 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 241000193738 Bacillus anthracis Species 0.000 description 4
- 241000894006 Bacteria Species 0.000 description 4
- 238000013459 approach Methods 0.000 description 4
- 238000000576 coating method Methods 0.000 description 4
- 150000001875 compounds Chemical class 0.000 description 4
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 4
- 238000007493 shaping process Methods 0.000 description 4
- 230000003595 spectral effect Effects 0.000 description 4
- 210000001519 tissue Anatomy 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000002596 correlated effect Effects 0.000 description 3
- 201000010099 disease Diseases 0.000 description 3
- 239000000975 dye Substances 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 238000011049 filling Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 210000005260 human cell Anatomy 0.000 description 3
- 238000007654 immersion Methods 0.000 description 3
- 210000000554 iris Anatomy 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- QSHDDOUJBYECFT-UHFFFAOYSA-N mercury Chemical compound [Hg] QSHDDOUJBYECFT-UHFFFAOYSA-N 0.000 description 3
- 229910052753 mercury Inorganic materials 0.000 description 3
- 230000000116 mitigating effect Effects 0.000 description 3
- 230000005855 radiation Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- IJGRMHOSHXDMSA-UHFFFAOYSA-N Atomic nitrogen Chemical compound N#N IJGRMHOSHXDMSA-UHFFFAOYSA-N 0.000 description 2
- 241000606161 Chlamydia Species 0.000 description 2
- 206010035664 Pneumonia Diseases 0.000 description 2
- 210000001744 T-lymphocyte Anatomy 0.000 description 2
- 230000004913 activation Effects 0.000 description 2
- 210000001789 adipocyte Anatomy 0.000 description 2
- 239000000443 aerosol Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000000481 breast Anatomy 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 210000001612 chondrocyte Anatomy 0.000 description 2
- 210000001072 colon Anatomy 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 238000003708 edge detection Methods 0.000 description 2
- 210000002889 endothelial cell Anatomy 0.000 description 2
- 210000003979 eosinophil Anatomy 0.000 description 2
- 210000002919 epithelial cell Anatomy 0.000 description 2
- 235000013305 food Nutrition 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000000265 homogenisation Methods 0.000 description 2
- 208000015181 infectious disease Diseases 0.000 description 2
- 229910052500 inorganic mineral Inorganic materials 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 210000003734 kidney Anatomy 0.000 description 2
- 210000000265 leukocyte Anatomy 0.000 description 2
- 239000007788 liquid Substances 0.000 description 2
- 210000004185 liver Anatomy 0.000 description 2
- 210000004072 lung Anatomy 0.000 description 2
- 210000004698 lymphocyte Anatomy 0.000 description 2
- 210000002752 melanocyte Anatomy 0.000 description 2
- 239000011707 mineral Substances 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 210000000496 pancreas Anatomy 0.000 description 2
- 238000011192 particle characterization Methods 0.000 description 2
- 229920006267 polyester film Polymers 0.000 description 2
- 239000000843 powder Substances 0.000 description 2
- 102000004169 proteins and genes Human genes 0.000 description 2
- 108090000623 proteins and genes Proteins 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 2
- 210000003491 skin Anatomy 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 210000000130 stem cell Anatomy 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000010896 thin film analysis Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000002792 vascular Effects 0.000 description 2
- 241000186361 Actinobacteria <class> Species 0.000 description 1
- 206010003210 Arteriosclerosis Diseases 0.000 description 1
- 201000001320 Atherosclerosis Diseases 0.000 description 1
- 241000589151 Azotobacter Species 0.000 description 1
- 208000004429 Bacillary Dysentery Diseases 0.000 description 1
- 241000193755 Bacillus cereus Species 0.000 description 1
- 208000035143 Bacterial infection Diseases 0.000 description 1
- 241000606125 Bacteroides Species 0.000 description 1
- 241000588832 Bordetella pertussis Species 0.000 description 1
- 241000589969 Borreliella burgdorferi Species 0.000 description 1
- 208000003508 Botulism Diseases 0.000 description 1
- 206010006500 Brucellosis Diseases 0.000 description 1
- 241000722910 Burkholderia mallei Species 0.000 description 1
- 206010069747 Burkholderia mallei infection Diseases 0.000 description 1
- 206010069748 Burkholderia pseudomallei infection Diseases 0.000 description 1
- 241000589876 Campylobacter Species 0.000 description 1
- 241000589875 Campylobacter jejuni Species 0.000 description 1
- 241000222122 Candida albicans Species 0.000 description 1
- 206010007134 Candida infections Diseases 0.000 description 1
- 201000009030 Carcinoma Diseases 0.000 description 1
- 206010008631 Cholera Diseases 0.000 description 1
- 241000223782 Ciliophora Species 0.000 description 1
- 241000193403 Clostridium Species 0.000 description 1
- 241000223205 Coccidioides immitis Species 0.000 description 1
- 206010010741 Conjunctivitis Diseases 0.000 description 1
- 201000007336 Cryptococcosis Diseases 0.000 description 1
- 241000221204 Cryptococcus neoformans Species 0.000 description 1
- 241000195493 Cryptophyta Species 0.000 description 1
- 241000192700 Cyanobacteria Species 0.000 description 1
- 241000192091 Deinococcus radiodurans Species 0.000 description 1
- 206010012735 Diarrhoea Diseases 0.000 description 1
- 241000196324 Embryophyta Species 0.000 description 1
- 241000194033 Enterococcus Species 0.000 description 1
- 241000588724 Escherichia coli Species 0.000 description 1
- 241000233866 Fungi Species 0.000 description 1
- 201000003641 Glanders Diseases 0.000 description 1
- 206010018612 Gonorrhoea Diseases 0.000 description 1
- 241000606768 Haemophilus influenzae Species 0.000 description 1
- 241000590002 Helicobacter pylori Species 0.000 description 1
- 201000002563 Histoplasmosis Diseases 0.000 description 1
- 241000588747 Klebsiella pneumoniae Species 0.000 description 1
- 241000186660 Lactobacillus Species 0.000 description 1
- 241001148567 Lawsonia intracellularis Species 0.000 description 1
- 208000004023 Legionellosis Diseases 0.000 description 1
- 206010024229 Leprosy Diseases 0.000 description 1
- 206010024238 Leptospirosis Diseases 0.000 description 1
- 241000186781 Listeria Species 0.000 description 1
- 206010024641 Listeriosis Diseases 0.000 description 1
- 208000016604 Lyme disease Diseases 0.000 description 1
- 201000009906 Meningitis Diseases 0.000 description 1
- 241000192041 Micrococcus Species 0.000 description 1
- 241000186359 Mycobacterium Species 0.000 description 1
- 241000186362 Mycobacterium leprae Species 0.000 description 1
- 241000187479 Mycobacterium tuberculosis Species 0.000 description 1
- 241000863434 Myxococcales Species 0.000 description 1
- 241000588653 Neisseria Species 0.000 description 1
- 241000588650 Neisseria meningitidis Species 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- 206010029443 Nocardia Infections Diseases 0.000 description 1
- 206010029444 Nocardiosis Diseases 0.000 description 1
- 208000008469 Peptic Ulcer Diseases 0.000 description 1
- 201000005702 Pertussis Diseases 0.000 description 1
- 241000605861 Prevotella Species 0.000 description 1
- 241000589516 Pseudomonas Species 0.000 description 1
- 206010037151 Psittacosis Diseases 0.000 description 1
- 240000004808 Saccharomyces cerevisiae Species 0.000 description 1
- 241001354013 Salmonella enterica subsp. enterica serovar Enteritidis Species 0.000 description 1
- 206010040070 Septic Shock Diseases 0.000 description 1
- 241000607715 Serratia marcescens Species 0.000 description 1
- 241000607768 Shigella Species 0.000 description 1
- 206010040550 Shigella infections Diseases 0.000 description 1
- 206010041736 Sporotrichosis Diseases 0.000 description 1
- 241000191967 Staphylococcus aureus Species 0.000 description 1
- 238000012896 Statistical algorithm Methods 0.000 description 1
- 241000293876 Thiomargarita namibiensis Species 0.000 description 1
- 206010044248 Toxic shock syndrome Diseases 0.000 description 1
- 231100000650 Toxic shock syndrome Toxicity 0.000 description 1
- 241000589884 Treponema pallidum Species 0.000 description 1
- 208000037386 Typhoid Diseases 0.000 description 1
- 241000607626 Vibrio cholerae Species 0.000 description 1
- 208000036142 Viral infection Diseases 0.000 description 1
- 241000700605 Viruses Species 0.000 description 1
- 241000607447 Yersinia enterocolitica Species 0.000 description 1
- 241000607479 Yersinia pestis Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 239000000853 adhesive Substances 0.000 description 1
- 230000001070 adhesive effect Effects 0.000 description 1
- 230000001155 adrenomedullary effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000004164 analytical calibration Methods 0.000 description 1
- 230000033115 angiogenesis Effects 0.000 description 1
- 210000004102 animal cell Anatomy 0.000 description 1
- 230000003667 anti-reflective effect Effects 0.000 description 1
- 239000003963 antioxidant agent Substances 0.000 description 1
- 230000003078 antioxidant effect Effects 0.000 description 1
- 235000006708 antioxidants Nutrition 0.000 description 1
- 208000011775 arteriosclerosis disease Diseases 0.000 description 1
- 230000003143 atherosclerotic effect Effects 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 210000003719 b-lymphocyte Anatomy 0.000 description 1
- 229940065181 bacillus anthracis Drugs 0.000 description 1
- 208000022362 bacterial infectious disease Diseases 0.000 description 1
- 210000003651 basophil Anatomy 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 235000013361 beverage Nutrition 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004820 blood count Methods 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000002449 bone cell Anatomy 0.000 description 1
- 229940074375 burkholderia mallei Drugs 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 201000003984 candidiasis Diseases 0.000 description 1
- 150000001720 carbohydrates Chemical class 0.000 description 1
- 235000014633 carbohydrates Nutrition 0.000 description 1
- 239000006229 carbon black Substances 0.000 description 1
- 210000004413 cardiac myocyte Anatomy 0.000 description 1
- 230000002612 cardiopulmonary effect Effects 0.000 description 1
- 210000003321 cartilage cell Anatomy 0.000 description 1
- 239000004568 cement Substances 0.000 description 1
- 210000003169 central nervous system Anatomy 0.000 description 1
- 239000000919 ceramic Substances 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 201000003486 coccidioidomycosis Diseases 0.000 description 1
- 238000002485 combustion reaction Methods 0.000 description 1
- 210000001608 connective tissue cell Anatomy 0.000 description 1
- 210000004087 cornea Anatomy 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 239000008271 cosmetic emulsion Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 230000008021 deposition Effects 0.000 description 1
- 210000002249 digestive system Anatomy 0.000 description 1
- 206010013023 diphtheria Diseases 0.000 description 1
- 208000035475 disorder Diseases 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 210000003743 erythrocyte Anatomy 0.000 description 1
- 210000003527 eukaryotic cell Anatomy 0.000 description 1
- 230000005279 excitation period Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 210000004996 female reproductive system Anatomy 0.000 description 1
- 210000002950 fibroblast Anatomy 0.000 description 1
- 210000003811 finger Anatomy 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000002073 fluorescence micrograph Methods 0.000 description 1
- 238000000799 fluorescence microscopy Methods 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 239000007789 gas Substances 0.000 description 1
- 208000001786 gonorrhea Diseases 0.000 description 1
- 229940047650 haemophilus influenzae Drugs 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 208000019622 heart disease Diseases 0.000 description 1
- 229940037467 helicobacter pylori Drugs 0.000 description 1
- 210000003494 hepatocyte Anatomy 0.000 description 1
- 210000003630 histaminocyte Anatomy 0.000 description 1
- 210000004408 hybridoma Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000000338 in vitro Methods 0.000 description 1
- 238000001727 in vivo Methods 0.000 description 1
- 201000001371 inclusion conjunctivitis Diseases 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 229910010272 inorganic material Inorganic materials 0.000 description 1
- 239000011147 inorganic material Substances 0.000 description 1
- 230000003834 intracellular effect Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 210000003125 jurkat cell Anatomy 0.000 description 1
- 210000002510 keratinocyte Anatomy 0.000 description 1
- 210000003292 kidney cell Anatomy 0.000 description 1
- 229940045505 klebsiella pneumoniae Drugs 0.000 description 1
- 229940039696 lactobacillus Drugs 0.000 description 1
- 230000003902 lesion Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 150000002632 lipids Chemical class 0.000 description 1
- 210000005229 liver cell Anatomy 0.000 description 1
- 201000004792 malaria Diseases 0.000 description 1
- 210000004995 male reproductive system Anatomy 0.000 description 1
- 230000003211 malignant effect Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 201000001441 melanoma Diseases 0.000 description 1
- 201000004015 melioidosis Diseases 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000010327 methods by industry Methods 0.000 description 1
- 239000000693 micelle Substances 0.000 description 1
- 244000005700 microbiome Species 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000002433 mononuclear leukocyte Anatomy 0.000 description 1
- 210000004400 mucous membrane Anatomy 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 210000002346 musculoskeletal system Anatomy 0.000 description 1
- 208000025113 myeloid leukemia Diseases 0.000 description 1
- 208000010125 myocardial infarction Diseases 0.000 description 1
- 210000000107 myocyte Anatomy 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 208000015122 neurodegenerative disease Diseases 0.000 description 1
- 210000000440 neutrophil Anatomy 0.000 description 1
- 229910052757 nitrogen Inorganic materials 0.000 description 1
- 210000003924 normoblast Anatomy 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000011368 organic material Substances 0.000 description 1
- 201000000901 ornithosis Diseases 0.000 description 1
- 210000000963 osteoblast Anatomy 0.000 description 1
- 210000002997 osteoclast Anatomy 0.000 description 1
- 210000001672 ovary Anatomy 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 208000011906 peptic ulcer disease Diseases 0.000 description 1
- 238000005293 physical law Methods 0.000 description 1
- 230000001766 physiological effect Effects 0.000 description 1
- 239000000049 pigment Substances 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 238000007747 plating Methods 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 210000001236 prokaryotic cell Anatomy 0.000 description 1
- 210000002307 prostate Anatomy 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 210000004994 reproductive system Anatomy 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 201000005113 shigellosis Diseases 0.000 description 1
- 210000002363 skeletal muscle cell Anatomy 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 208000006379 syphilis Diseases 0.000 description 1
- 210000001550 testis Anatomy 0.000 description 1
- 231100000027 toxicology Toxicity 0.000 description 1
- 206010044325 trachoma Diseases 0.000 description 1
- 230000008733 trauma Effects 0.000 description 1
- 210000004881 tumor cell Anatomy 0.000 description 1
- 201000008297 typhoid fever Diseases 0.000 description 1
- 241001515965 unidentified phage Species 0.000 description 1
- 210000003932 urinary bladder Anatomy 0.000 description 1
- 208000019206 urinary tract infection Diseases 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 229940118696 vibrio cholerae Drugs 0.000 description 1
- 230000003612 virological effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
- 229940098232 yersinia enterocolitica Drugs 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/14625—Optical elements or arrangements associated with the device
Definitions
- the present invention relates generally to image and optical systems, and more particularly to a system and method to facilitate imaging performance via an image transfer medium that projects characteristics of a sensor to an object field of view.
- Microscopes facilitate creating a large image of a tiny object. Greater magnification can be achieved if the light from an object is made to pass through two lenses compared to a simple microscope with one lens.
- a compound microscope has two or more converging lenses, placed in line with one another, so that both lenses refract the light in turn. The result is to produce an image that is magnified more than either lens could magnify alone.
- Light illuminating the object first passes through a short focal length lens or lens group, called the objective, and then travels on some distance before being passed through a longer focal length lens or lens group, called the eyepiece.
- a lens group is often simply referred to singularly as a lens.
- the first lens or objective is usually a small lens with a very small focal length.
- a specimen or object is placed in the path of a light source with sufficient intensity to illuminate as desired.
- the objective lens is then lowered until the specimen is very close to, but not quite at the focal point of the lens.
- the second lens or eyepiece has a longer focal length and is placed in the microscope so that the image produced by the objective lens falls closer to the eyepiece than one focal length (that is, inside the focal point of the lens).
- the image from the objective lens now becomes the object for the eyepiece lens.
- the second lens refracts the light in such a way as to produce a second image that is virtual, inverted and magnified. This is the final image seen by the eye of the observer.
- common infinity space or infinity corrected design microscopes employ objective lenses with infinite conjugate properties such that the light leaving the objective is not focused, but is a flux of parallel rays which do not converge until after passing through a tube lens where the projected image is then located at the focal point of the eyepiece for magnification and observation.
- Many microscopes such as the compound microscope described above, are designed to provide images of certain quality to the human eye through an eyepiece. Connecting a Machine Vision Sensor, such as a Charge Coupled Device (CCD) sensor, to the microscope so that an image may be viewed on a monitor presents difficulties. This is because the image quality provided by the sensor and viewed by a human eye decreases, as compared to an image viewed by a human eye directly through an eyepiece.
- CCD Charge Coupled Device
- the present invention relates to a system and methodology that facilitates imaging performance of optical imaging systems.
- many orders of performance enhancement can be realized over conventional systems (e.g., greater effective resolved magnification, larger working distances, increased absolute spatial resolution, increased spatial field of view, increased depth of field, Modulation Transfer Function of about 1, oil immersion objectives and eye pieces not required).
- an image transfer medium e.g., one or more lenses, fiber optical media, or other media
- a sensor having one or more receptors (e.g., pixels)
- the receptors of the sensor are effectively scaled (e.g., "mapped”, “sized”, “projected”, “matched”, “reduced") to occupy an object field of view at about the scale or size associated with a diffraction limited point or spot within the object field of view.
- k-space a band-pass filtering of spatial frequencies in what is known as Fourier space or "k-space” is achieved such that the projected size (projection in a direction from the sensor toward object space) of the receptor is filled in k-space.
- the image transfer medium is adapted, configured and/or selected such that a transform into k-space is achieved, wherein an a priori design determination causes k-space or band-pass frequencies of interest to be substantially preserved throughout and frequencies above and below the k-space frequencies to be mitigated.
- the frequencies above and below the k-space frequencies tend to cause blurring and contrast reduction and are generally associated with conventional optical system designs which define intrinsic constraints on a Modulation Transfer Function and "optical noise".
- This further illustrates that the systems and methods of the present invention are in contravention or opposition to conventional geometric paraxial ray designs. Consequently, many known optical design limitations associated with conventional systems are mitigated by the present invention.
- a "k-space" design, system and methodology which defines a "unit-mapping" of the Modulation Transfer
- the k-space design projects image plane pixels or receptors forward to the object plane to promote an optimum theoretical relationship. This is defined by a substantially one-to-one correspondence between image sensor receptors and projected object plane units (e.g., units defined by smallest resolvable points or spots in the object field of view) that are matched according to the receptor size.
- the k-Space design defines that "unit-mapping” or “unit-matching” acts as an effective "Intrinsic Spatial Filter” which implies that spectral components of both an object and an image in k-space (also referred to as "reciprocal-space”) are substantially matched or quantized. Advantages provided by the k-space design result in a system and methodology capable of much higher effective resolved magnification with concomitantly related and much increased Field Of View,
- One aspect of the present invention relates to an optical system that includes an optical sensor having an array of light receptors having a pixel pitch.
- a lens optically associated with the optical sensor is configured with optical parameters functionally related to the pitch and a desired resolution of the optical system. As a result, the lens is operative to substantially map a portion of an object having the desired resolution along the optical path to an associated one of the light receptors.
- Another aspect of the present invention relates to a method of designing an optical system. The method includes selecting a sensor with a plurality of light receptors having a pixel pitch. A desired minimum spot size resolution is selected for the system and a lens configured or an extant lens selected with optical parameters based on the pixel pitch and the desired minimum spot size is provided so as to map the plurality of light receptors to part of the image according to the desired resolution.
- Fig. 1 is a schematic block diagram illustrating an imaging system in accordance with an aspect of the present invention.
- Fig. 2 is a diagram illustrating a k-space system design in accordance with an aspect of the present invention.
- Fig. 3 is a diagram of an exemplary system illustrating sensor receptor matching in accordance with an aspect of the present invention.
- Fig. 4 is a graph illustrating sensor matching considerations in accordance with an aspect of the present invention.
- Fig. 5 is a graph illustrating a Modulation Transfer Function in accordance with an aspect of the present invention.
- Fig. 6 is a graph illustrating a figure of merit relating to a Spatial Field Number in accordance with an aspect of the present invention.
- Fig. 7 is a flow diagram illustrating an imaging methodology in accordance with an aspect of the present invention.
- Fig. 8 is a flow diagram illustrating a methodology for selecting optical parameters in accordance with an aspect of the present invention.
- Fig. 9 is a schematic block diagram illustrating an exemplary imaging system in accordance with an aspect of the present invention.
- Fig. 10 is a schematic block diagram illustrating a modular imaging system in accordance with an aspect of the present invention.
- FIG. 11-13 illustrate alternative imaging systems in accordance with an aspect of the present invention.
- Figs. 14-18 illustrate exemplary applications in accordance with the present invention.
- the present invention relates to an optical and/or imaging system and methodology.
- a k-space filter is provided that can be configured from an image transfer medium such as optical media that correlates image sensor receptors to an object field of view.
- image transfer medium such as optical media that correlates image sensor receptors to an object field of view.
- illumination sources can also be employed to achieve one or more operational goals and for versatility of application.
- the k-space design of the imaging system of the present invention promotes capture and analysis (e.g., automated and/or manual) of images having a high Field Of View (FOV) at substantially high Effective Resolved Magnification as compared to conventional systems.
- FOV Field Of View
- NA Numerical Aperture
- DOF Depth Of Field
- an objective lens to object distance e.g., Working Distance
- a Working Distance can be maintained in operation at low and high power effective resolved magnification imaging, wherein typical spacing can be achieved at about 0.1 mm or more and about 20 mm or less, as opposed to conventional microscopic systems which can require significantly smaller (as small as 0.01 mm) object to objective lens distances for comparable (e.g., similar order of magnitude) Effective Resolved Magnification values.
- the Working Distance is about 0.5 mm or more and about 10 mm or less. It is to be appreciated that the present invention is not limited to operating at the above working distances. In many instances the above working distances are employed, however, in some instances, smaller or larger distances are employed.
- oil immersion or other Index of Refraction matching media or fluids for objective lenses are generally not required (e.g., substantially no improvement to be gained) at one or more effective image magnification levels of the present invention yet, still exceeding effective resolved magnification levels achievable in conventional microscopic optical design variations including systems employing "infinity-corrected" objective lenses.
- the k-space design of the present invention defines that a small "Blur Circle” or diffraction limited point/spot at the object plane is determined by parameters of the design to match image sensor receptors or pixels with a substantially one-to-one correspondence by "unit-mapping" of object and image spaces for associated object and image fields. This enables the improved performance and capabilities of the present invention.
- One possible theory of the k-space design results from the mathematical concept that since the Fourier Transform of both an object and an image is formed in k-space (also called "reciprocal space"), the sensor should be mapped to the object plane in k-space via optical design techniques and component placement in accordance with the present invention.
- transforms or models can be utilized to configure and/or select one or more components in accordance with the present invention.
- wavelet transforms LaPlace (s-transforms), z-transforms as well as other transforms can be similarly employed.
- the k-space design methodology is unlike conventional optical systems designed according to geometric, paraxial ray-trace and optimization theory, since the k-space optimization facilitates that the spectral components of the object (e.g., tissue sample, particle, semiconductor) and the image are the same in k-space, and thus quantized. Therefore, there are substantially no inherent limitations imposed on a Modulation
- Transfer Function describing contrast versus resolution and absolute spatial resolution in the present invention.
- Quantization for example, in k-space yields a substantially unitary Modulation Transfer Function not realized by conventional systems. It is noted that high MTF, Spatial Resolution, and effective resolved image magnification can be achieved with much lower magnification objective lenses with desirable lower
- Numerical Apertures e.g., generally less than about 5 Ox with a numerical aperture of generally less than about 0.7
- Numerical Apertures through "unit-mapping" of projected pixels in an "Intrinsic Spatial Filter” provided by the k-space design.
- infinity-corrected objectives can be employed with associated optical component and illumination, as well as spectrum varying components, polarization varying components, and/or contrast or phase varying components. These components can be included in an optical path-length between an objective and the image lens within an "infinity space”. Optical system accessories and variations can thus be positioned as interchangeable modules in this geometry.
- the k-space design in contrast to conventional microscopic imagers that utilize "infinity-corrected" objectives, enables the maximum optimization of the infinity space geometry by the "unit-mapping" concept. This implies that there is generally no specific limit to the number of additional components that can be inserted in the "infinity space” geometry as in conventional microscopic systems that typically specify no more than 2 additional components without optical correction.
- the present invention also enables a "base-module" design that can be configured and reconfigured in operation for a plurality of different applications if necessary to employ either transmissive or reflected illumination, if desired.
- the systems of the present invention can be employed in a plurality of opto-mechanical designs that are robust since the k-space design is substantially not sensitive to environmental and mechanical vibration and thus generally does not require heavy structural mechanical design and isolation from vibration associated with conventional microscopic imaging instruments.
- Other features can include digital image processing, if desired, along with storage (e.g., local database, image data transmissions to remote computers for storage/analysis) and display of the images produced in accordance with the present invention (e.g., computer display, printer, film, and other output media).
- storage e.g., local database, image data transmissions to remote computers for storage/analysis
- display of the images produced in accordance with the present invention e.g., computer display, printer, film, and other output media.
- Remote signal processing of image data can be provided, along with communication and display of the image data via associated data packets that are communicated over a network or other medium, for example.
- the imaging system 10 includes a sensor 20 having one or more receptors such as pixels or discrete light detectors (See e.g., illustrated below in Fig. 3) operably associated with an image transfer medium 30.
- the image transfer medium 30 is adapted or configured to scale the proportions of the sensor 20 at an image plane established by the position of the sensor 20 to an object field of view illustrated at reference numeral 34.
- a planar reference 36 of X and Y coordinates is provided to illustrate the scaling or reduction of the apparent or virtual size of the sensor 20 to the object field of view 34.
- Direction arrows 38 and 40 illustrate the direction of reduction of the apparent size of the sensor 20 toward the object field of view 34.
- the object field of view 34 established by the image transfer medium 30 is related to the position of an object plane 42 that includes one or more items under microscopic examination (not shown).
- the sensor 20 can be substantially any size, shape and/or technology (e.g., digital sensor, analog sensor, Charge Coupled Device (CCD) sensor, CMOS sensor, Charge Injection Device (CID) sensor, an array sensor, a linear scan sensor) including one or more receptors of various sizes and shapes, the one or more receptors being similarly sized or proportioned on a respective sensor to be responsive to light (e.g., visible, non-visible) received from the items under examination in the object field of view 34.
- the sensor 20 provides an output 44 that can be directed to a local or remote storage such as a memory (not shown) and displayed from the memory via a computer and associated display, for example, without substantially any intervening digital processing (e.g., straight bit map from sensor memory to display), if desired.
- a local or remote storage such as a memory (not shown) and displayed from the memory via a computer and associated display, for example, without substantially any intervening digital processing (e.g., straight bit map from sensor memory to display), if desired.
- local or remote signal processing of the image data received from the sensor 20 can also occur.
- the output 44 can be converted to electronic data packets and transmitted to a remote system over a network and/or via wireless transmissions systems and protocols for further analysis and/or display.
- the output 44 can be stored in a local computer memory before being transmitted to a subsequent computing system for further analysis and/or display.
- the scaling provided by the image transfer medium 30 is determined by a novel k- space configuration or design within the medium that promotes predetermined k-space frequencies of interest and mitigates frequencies outside the predetermined frequencies. This has the effect of a band-pass filter of the spatial frequencies within the image transfer medium 30 and notably defines the imaging system 10 in terms of resolution rather than magnification. As will be described in more detail below, the resolution of the imaging system 10 determined by the k-space design promotes a plurality of features in a displayed or stored image such as having high effective resolved magnification, high absolute spatial resolution, large depth of field, larger working distances, and a unitary Modulation Transfer Function as well as other features.
- a "pitch" or spacing is determined between adjacent receptors on the sensor 20, the pitch related to the center-to-center distance of adjacent receptors and about the size or diameter of a single receptor.
- the pitch of the sensor 20 defines the Nyquist "cut-off frequency band of the sensor. It is this frequency band that is promoted by the k-space design, whereas other frequencies are mitigated.
- a small or diffraction limited spot or point 50 is illustrated at the object plane 42.
- the diffraction limited point 50 represents the smallest resolvable object determined by optical characteristics within the image transfer medium 30 and is described in more detail below.
- a scaled receptor 54 depicted in front of the field of view 34 for exemplary purposes, and having a size determined according to the pitch of the sensor 20, is matched or scaled to be about the same size in the object field of view 34 as the diffraction limited point 50.
- the size of any given receptor at the sensor 20 is effectively reduced in size via the image transfer medium 30 to be about the same size (or matched in size) to the size of the diffraction limited point 50.
- This also has the effect of filling the object field of view 34 with substantially all of the receptors of the sensor 20, the respective receptors being suitably scaled to be similar in size to the diffraction limited point 50.
- the matching/mapping of sensor characteristics to the smallest resolvable object or point within the.object .field, of view 34 defines the imaging system 10 in terms of absolute spatial resolution and thus, enhances the operating performance of the system.
- An illumination source 60 can be provided with the present invention in order that photons from that source can be transmitted through and/or reflected from objects in the field of view 34 to enable activation of the receptors in the sensor 20. It is noted that the present invention can potentially be employed without an illumination source 60 if potential self-luminous objects (e.g., fluorescent or phosphorescent biological or organic material sample, metallurgical, mineral, and/or other inorganic material and so forth) emit enough radiation to activate the sensor 60.
- Light Emitting Diodes provide an effective illumination source 60 in accordance with the present invention. Substantially any illumination source 60 can be applied including coherent and non-coherent sources, visible and non-visible wavelengths.
- the sensor 20 would also be suitably adapted.
- an infrared or ultraviolet source an infrared or ultraviolet sensor 20 would be employed, respectively.
- Other illumination sources 60 can include wavelength-specific lighting, broad-band lighting, continuous lighting, strobed lighting, Kohler illumination, Abbe illumination, phase- contrast illumination, darkfield illumination, brightfield illumination, and Epi illumination.
- Transmissive or reflective lighting techniques e.g., specular and diffuse
- a system 100 illustrates an image transfer medium in accordance with an aspect of the present invention.
- the image transfer medium 30 depicted in Fig.l can be provided according to the k-space design concepts described above and more particularly via a k-space filter 110 adapted, configured and/or selected to promote a band of predetermined k-space frequencies 114 and to mitigate frequencies outside of this band. This is achieved by determining a pitch "P" - which is the distance between adjacent receptors 116 in a sensor (not shown) and sizing optical media within the filter 110 such that the pitch "P" of the receptors 116 is matched in size with a diffraction-limited spot 120.
- the diffraction-limited spot 120 can be determined from the optical characteristics of the media in the filter 110.
- the Numerical Aperture of an optical medium defines the smallest object or spot that can be resolved by the lens.
- the filter 110 performs a k-space transformation such that the size of the pitch is effectively matched, "unit-mapped", projected, correlated, and/or reduced to the size or scale of the diffraction limited spot 120.
- a plurality of optical configurations can be provided to achieve the k-space filter 110.
- One such configuration can be provided by an aspherical lens 124 adapted such to perform the k-space transformation and reduction from sensor space to object space.
- Yet another configuration can be provided by a multiple lens arrangement 128, wherein the lens combination is selected to provide the filtering and scaling.
- Still yet another configuration can employ a fiber optic taper 132 or image conduit, wherein multiple optical fibers or array of fibers are configured in a funnel-shape to perform the mapping of the sensor to the object field of view. It is noted that the fiber optic taper 132 is generally in physical contact between the sensor and the object under examination (e.g., contact with microscope slide).
- Another possible k-space filter 110 arrangement employs a holographic (or other diffractive or phase structure) optical element 136, wherein a substantially flat optical surface is configured via a hologram (or other diffractive or phase structure) (e.g., computer-generated, optically generated, and/or other method) to provide the mapping in accordance with the present invention.
- a holographic (or other diffractive or phase structure) optical element 136 wherein a substantially flat optical surface is configured via a hologram (or other diffractive or phase structure) (e.g., computer-generated, optically generated, and/or other method) to provide the mapping in accordance with the present invention.
- the k-space optical design as enabled by the k-space filter 110 is based upon the "effective projected pixel-pitch" of the sensor, which is a figure derived from following ("projecting") the physical size of the sensor array elements back through the optical system to the object plane.
- conjugate planes and optical transform spaces are matched to the Nyquist cut-off of the effective receptor or pixel size. This maximizes the effective resolved image magnification and the Field Of View as well as the Depth Of Field and the Absolute Spatial Resolution.
- a novel application of optical theory is provided that does not rely on conventional geometric optical design parameters of paraxial ray-tracing which govern conventional optics and imaging combinations. This can further be described in the following manner.
- a Fourier transform of an object and an image is formed (by an optical system) in k-space (also referred to as "reciprocal-space"). It is this transform that is operated on for image optimization by the k-space design of the present invention.
- the optical media employed in the present invention can be designed with standard, relatively non-expensive "off-the-shelf components having a configuration which defines that the object and image space are "unit-mapped” or "unit-matched” for substantially all image and object fields.
- a small Blur-circle or diffraction-limited spot 120 at the object plane is defined by the design to match the pixels in the image plane (e.g., at the image sensor of choice) with substantially one-to-one correspondence and thus the Fourier transforms of pixelated arrays can be matched.
- the present invention is defined such that it constructs an Intrinsic Spatial Filter such as the k-space filter 110.
- Such a design definition and implementation enables the spectral components of both the object and the image in k-space to be about the same or quantized.
- This also defines that the Modulation Transfer Function (MTF) (the comparison of contrast to spatial resolution) of the sensor is matched to the MTF of the object Plane.
- MTF Modulation Transfer Function
- Fig. 3 illustrates an optical system 200 in accordance with an aspect of the present invention.
- the system 200 includes a sensor 212 having a plurality of receptors or sensor pixels 214.
- the sensor 212 is an M by N array of sensor pixels 214, having
- M rows and N columns (e.g., 640 x 480, 512 x 512, 1280 x 1024, and so forth), M and N being integers respectively.
- a rectangular sensor 212 having generally square pixels is depicted, it is to be understood and appreciated that the sensor can be substantially any shape (e.g., circular, elliptical, hexagonal, rectangular, and so forth).
- respective pixels 214 within the array can also be substantially any shape or size, the pixels in any given array 212 being similarly sized and shaped in accordance with an aspect of the present invention.
- the sensor 212 can be substantially any technology (e.g., digital sensor, analog sensor, Charge Coupled Device (CCD) sensor, CMOS sensor, Charge Injection Device (CID) sensor, an array sensor, a linear scan sensor) including one or more receptors (or pixels) 214.
- each of the pixels 214 is similarly sized or proportioned and responsive to light (e.g., visible, non-visible) received from the items under examination, as described herein.
- the sensor 212 is associated with a lens network 216, which is configured based on performance requirements of the optical system and the pitch size of sensor 212.
- the lens network 216 is operative to scale (or project) proportions (e.g., pixels 214) of the sensor 212 at an image plane established by the position of the sensor 212 to an object field of view 220 in accordance with an aspect of the present invention.
- the object field of view 220 is related to the position of an object plane 222 that includes one or more items (not shown) under examination.
- the sensor 212 receives light from the object field of view 220, the sensor 212 provides an output 226 that can be directed to a local or remote storage such as a memory (not shown) and displayed from the memory via a computer and associated display, for example, without substantially any intervening digital processing (e.g., straight bit map from sensor memory to display), if desired. It is noted that local or remote signal processing of the image data received from the sensor 212 can also occur.
- the output 226 can be converted to electronic data packets and transmitted to a remote system over a network for further analysis and/or display.
- the output 226 can be stored in a local computer memory before being transmitted to a subsequent computing system for further analysis and/or display.
- the k-space design of the lens network 216 promotes predetermined k-space frequencies of interest and mitigates frequencies outside the predetermined frequency band. This has the effect of a band-pass filter of the spatial frequencies within the lens network 216 and notably defines the imaging system 200 in terms of resolution rather than magnification.
- the resolution of the imaging system 200 determined by the k-space design promotes a plurality of features in a displayed or stored image, such as having high "Effective Resolved Magnification" (a figure of merit described in following), with related high absolute spatial resolution, large depth of field, larger working distances, and a unitary Modulation
- a "pitch" or spacing 228 is determined between adjacent receptors 214 on the sensor 212.
- the pitch (e.g., pixel pitch) corresponds to the center-to-center distance of adjacent receptors, indicated at 228, which is about the size or diameter of a single receptor when the sensor includes all equally sized pixels.
- the pitch 228 defines the Nyquist "cut-off frequency band of the sensor 212. It is this frequency band that is promoted by the k-space design, whereas other frequencies are mitigated.
- a point 230 of a desired smallest resolvable spot size is illustrated at the object plane 222.
- the point 230 can represent the smallest resolvable object determined by optical characteristics of the lens network 216. That is, the lens network is configured to have optical characteristics (e.g., magnification, numerical aperture) so that respective pixels 214 are matched or scaled to be about the same size in the object field of view 220 as the desired minimum resolvable spot size of the point 230.
- optical characteristics e.g., magnification, numerical aperture
- a scaled receptor 232 is depicted in front of the field of view 220 as having a size determined according to the pitch 228 of the sensor 212, which is about the same as the point 230.
- the lens network 216 is designed to effectively reduce the size of each given receptor (e.g., pixel) 214 at the sensor 212 to be about the same size (e.g., matched in size) to the size of the point 230, which is typically the minimum spot size resolvable by the system 210.
- the point 230 can be selected to a size representing the smallest resolvable object determined by optical characteristics within the lens network 216 as determined by diffraction rules (e.g., diffraction limited spot size).
- the lens network 216 thus can be designed to effectively scale each pixel 214 of the sensor 212 to any size that is equal to or greater than the diffraction limited size.
- the resolvable spot size can be selected to provide for any desired image resolution that meets such criteria.
- the lens network 216 is designed to provide the magnification to scale the pixels 214 to the object field of view 220 accordingly. This has the effect of filling the object field of view 220 with substantially all of the receptors of the sensor 212, the respective receptors being suitably scaled to be similar in size to the point 230, which corresponds to the desired resolvable spot size.
- the matching/mapping of sensor characteristics to the desired (e.g., smallest) resolvable object or point 230 within the object field of view 220 defines the imaging system 200 in terms of absolute spatial resolution and enhances the operating performance of the system in accordance with an aspect of the present invention.
- the lens network 216 includes an objective lens 234 and a secondary lens 236.
- the objective lens 234 can be set at infinite conjugate to the secondary lens
- the lenses 234 and 236 are related to each other so as to achieve a reduction from sensor space defined at the sensor array 220 to object space defined at the object plane 222. It is noted that substantially all of the pixels 214 are projected into the object field of view 220, which is defined by the objective lens 234. For example, the respective pixels 214 are scaled through the objective lens 234 to about the dimensions of the desired minimum resolvable spot size. In this example, the desired resolution at the image plane 222 is one micron. Thus, a magnification often times is operative to back project a ten micron pixel to the object plane 222 and reduce it to a size of one micron.
- the reduction in size of the array 212 and associated pixels 214 can be achieved by selecting the transfer lens 236 to have a focal length "D2" (from the array 212 to the transfer lens 236) of about 150 millimeters and by selecting the objective lens to have a focal length "Dl" (from the objective lens 236 to the object plane 222) of about 15 millimeters, for example.
- the pixels 214 are effectively reduced in size to about 1.0 micron per pixel, thus matching the size of the of the desired resolvable spot 230 and filling the object field of view 220 with a "virtually-reduced" array of pixels. It is to be understood and appreciated that other arrangements of one or more lenses can be employed to provide the desired scaling..
- optical media e.g., lens network 216
- lens network 216 can be designed, in accordance with an aspect of the present invention, with standard, relatively inexpensive "off-the- shelf components having a configuration that defines that the object and image space are "unit-mapped” or "unit-matched” for substantially all image and object fields.
- the lens network 216 and, in particular the objective lens 234, performs a Fourier transform of an object and an image in k-space (also referred to as "reciprocal-space"). It is this transform that is operated on for image optimization by the k-space design of the present invention.
- a small Blur-circle or Airy disk at the object plane is defined by the design to match the pixels in the image plane (e.g., at the image sensor of choice) with substantially one-to-one correspondence with the Airy disk and thus the Fourier transforms of pixilated arrays can be matched.
- the Airy disk is scaled through the lens network 216 to be about the same size as the receptor or pixel pitch.
- the lens network 216 is defined so as to construct an Intrinsic Spatial Filter (e.g., a k-space filter).
- an Intrinsic Spatial Filter e.g., a k-space filter.
- Such a design definition and implementation enables the spectral components of both the object and the image in k-space to be about the same or quantized.
- a Modulation Transfer Function (MTF) the comparison of contrast to spatial resolution
- k-space is defined as the region between the objective lens 234 and the secondary lens 236. It is to be appreciated that substantially any optical media, lens type and/or lens combination that reduces, maps and/or projects the sensor array 212 to the object field of view 220 in accordance with unit or k-space mapping as described herein is within the scope of the present invention.
- conventional objective lenses sized according to conventional geometric paraxial ray techniques, are generally sized according to the magnification, Numeric Aperture, focal length and other parameters provided by the objective.
- the objective lens would be sized with a greater focal length than subsequent lenses that approach or are closer to the sensor (or eyepiece in conventional microscope) in order to provide magnification of small objects.
- the k-space design of the present invention operates in an alternative manner to conventional geometrical paraxial ray design principles. That is, the objective lens 234 and the secondary lens 236 operate to provide a reduction in size of the sensor array 212 to the object field of view 220, as demonstrated by the relationship of the lenses.
- An illumination source 240 can be provided with the present invention in order that photons from that source can be transmitted through and/or reflected from objects in the field of view 234 to enable activation of the receptors in the sensor 212. It is noted that the present invention can potentially be employed without an illumination source 240 if potential self-luminous objects (e.g., objects or specimens with emissive characteristics as previously described) emit enough radiation to activate the sensor 12. Substantially any illumination source 240 can be applied including coherent and non-coherent sources, visible and non- visible wavelengths. However, for non-visible wavelength sources, the sensor 212 would also be suitably adapted. For example, for an infrared or ultraviolet source, an infrared or ultraviolet sensor 212 would be employed, respectively.
- potential self-luminous objects e.g., objects or specimens with emissive characteristics as previously described
- Suitable illumination sources 240 can include wavelength-specific lighting, broad-band lighting, continuous lighting, strobed lighting, Kohler illumination, Abbe illumination, phase-contrast illumination, darkfield illumination, brightfield illumination, Epi illumination, and the like. Transmissive or reflective (e.g., specular and diffuse) lighting techniques can also be applied.
- Fig. 4 illustrates a graph 300 of mapping characteristics and comparison between projected pixel size on the X-axis and diffraction-limited spot resolution size "R" on the Y-axis.
- An apex 310 of the graph 300 corresponds to unit mapping between projected pixel size and the diffraction limited spot size, which represents an optimum relationship between a lens network and a sensor in accordance with the present invention.
- the objective lens 234 (Fig. 3) should generally not be selected such that the diffraction-limited size "R" of the smallest resolvable objects are smaller than a projected pixel size. If so, "economic waste” can occur wherein more precise information is lost (e.g., selecting an object lens more expensive than required, such as having a higher numerical aperture). This is illustrated to the right of a dividing line 320 at reference 330 depicting a projected pixel 340 larger that two smaller diffraction spots 350. In contrast, where an objective is selected with diffraction-limited performance larger than the projected pixel size, blurring and empty magnification can occur.
- the diameter of the lenses in the system as illustrated in Fig. 3, for example, should be sized such that when a Fourier Transform is performed from object space to sensor space, spatial frequencies of interest that are in the band pass region described above (e.g., frequencies utilized to define the size and shape of a pixel) are substantially not attenuated. This generally implies that larger diameter lenses (e.g., about 10 to 100 millimeters) should be selected to mitigate attenuation of the spatial frequencies of interest.
- a Modulation Transfer function 400 is illustrated in accordance with the present invention.
- modulation percentage from 0 to 100% is illustrated defining percentage of contrast between black and white.
- Absolution Spatial Resolution is illustrated in terms of microns of separation.
- a line 410 illustrates that modulation percentage remains substantially constant at about 100% over varying degrees of spatial resolution.
- the Modulation Transfer Function is about 1 for the present invention up to about a limit imposed by the signal to noise sensitivity of the sensor.
- a conventional optics design For illustrative purposes, a conventional optics design
- Modulation Transfer Function is illustrated by line 420 which may be an exponential curve with generally asymptotic limits characterized by generally decreasing spatial resolution with decreasing modulation percentage (contrast).
- Fig. 6 illustrates a quantifiable Figure of Merit (FOM) for the present invention defined as dependent on two primary factors: Absolute Spatial Resolution (R A , in microns), depicted on the Y axis and the Field Of View (F, in microns) depicted on the X axis of a graph 500.
- FOM Figure of Merit
- a line 510 illustrates that the FOM remains substantially constant across the field of view and over different values of absolute spatial resolution which is an enhancement over conventional systems.
- Figs. 7, 8, 14, 15, and 16 illustrate methodologies to facilitate imaging performance in accordance with the present invention. While, for purposes of simplicity of explanation, the methodologies may be shown and described as a series of acts, it is to be understood and appreciated that the present invention is not limited by the order of acts, as some acts may, in accordance with the present invention, occur in different orders and/or concurrently with other acts from that shown and described herein. For example, those skilled in the art will understand and appreciate that a methodology could alternatively be represented as a series of interrelated states or events, such as in a state diagram. Moreover, not all illustrated acts may be required to implement a methodology in accordance with the present invention.
- lenses are selected having diffraction-limited characteristics at about the same size of a pixel in order to provide unit-mapping and optimization of the k-space design.
- lens characteristics are also selected to mitigate reduction of spatial frequencies within k-space. As described above, this generally implies that larger diameter optics are selected in order to mitigate attenuation of desired k-space frequencies of interest.
- a lens configuration is selected such that pixels, having a pitch "P", at the image plane defined by the position of a sensor are scaled according to the pitch to an object field of view at about the size of a diffraction-limited spot (e.g., unit-mapped) within the object field of view.
- an image is generated by outputting data from a sensor for real-time monitoring and/or storing the data in memory for direct display to a computer display and/or subsequent local or remote image processing and/or analysis within the memory.
- Fig. 8 illustrates a methodology that can be employed to design an optical/imaging system in accordance with an aspect of the present invention. The methodology begins at
- the sensor array includes a matrix of receptor pixels having a known pitch size, usually defined by the manufacturer.
- the sensor can be substantially any shape (e.g., rectangular, circular, square, triangular, and so forth). By way of illustration, assume that a sensor of 640x480 pixels having a pitch size of 10 ⁇ m is chosen. It is to be understood and appreciated that an optical system can be designed for any type and/or size of sensor array in accordance with an aspect of the present invention.
- an image resolution corresponds to the smallest desired resolvable spot size at the image plane.
- the image resolution can be defined based on the application(s) for which the optical system is being designed, such as any resolution that is greater than or equal to a smallest diffraction limited size.
- resolution becomes a selectable design parameter that can be tailored to provide desired image resolution for virtually any type of application.
- most conventional systems tend to limit resolution according to Rayleigh diffraction, which provides that intrinsic spatial resolution of the lenses cannot exceed limits of diffraction for a given wavelength.
- magnification is functionally related to the pixel pitch of the sensor array and the smallest resolvable spot size.
- M magnification
- Eq. 1 provides an optical system of power ten. That is, the lens system is configured to back-project each 10 ⁇ m pixel to the object plane and reduce respective pixels to the resolvable spot size of 1 micron.
- the methodology of Fig. 8 also includes a determination of a Numerical Aperture at 730.
- the Numerical Aperture (NA) is determined according to well-established diffraction rules that relate NA of the objective lens to the minimum resolvable spot size determined at 710 for the optical system.
- NA can be based on the following equation:
- NA Eq. 2 y
- ⁇ is the wavelength of light being used in the optical system
- v is the minimum spot size (e.g., determined at 710).
- aNA 0.25 satisfies Eq. 2. It is noted that relatively inexpensive commercially available objectives of power 10 provide numerical apertures of 0.25.
- NA wavelength
- resolution resolution
- the determination at 730 is not limited to any particular equation but instead simply obeys known general physical laws in which NA is functionally related to the wavelength and resolution.
- the lens parameters have been designed according to the selected sensor (700)
- the corresponding optical components can be arranged to provide an optical system (740) in accordance with an aspect of the present invention.
- the optical system is designed around a discrete sensor that has known fixed dimensions.
- the methodology can provide a far more straight-forward, robust, and inexpensive optical system design approach to "back-project" the sensor size onto the object plane and calculate a magnification factor.
- a second part of the methodology facilitates that the optics that provide the magnification have a sufficient NA to optically resolve a spot of similar dimensions as the back-projected pixel.
- an optical system designed in accordance with an aspect of the present invention can utilize custom and/or off-the-shelf components.
- inexpensive optics can be employed in accordance with an aspect of the present invention to obtain suitable results, but well-corrected microscope optics are relatively inexpensive. If custom-designed optics are utilized, in accordance with an aspect of the present invention, then the range of permissible magnifications and numerical apertures becomes substantial, and some performance gains can be realized over the use of off-the-shelf optical components.
- a plurality of related imaging applications can be enabled and enhanced by the present invention.
- these applications can include but are not limited to imaging, control, inspection, microscopy and/or other automated analysis such as: (1) Bio-medical analysis (e.g., cell colony counting, histology, frozen sections, cellular cytology, Haematology, pathology, oncology, fluorescence, interference, phase and many other clinical microscopy applications);
- Bio-medical analysis e.g., cell colony counting, histology, frozen sections, cellular cytology, Haematology, pathology, oncology, fluorescence, interference, phase and many other clinical microscopy applications
- Particle Sizing Applications e.g., Pharmaceutical manufacturers, paint manufacturers, cosmetics manufacturers, food process engineering, and others
- Air quality monitoring and airborne particulate measurement e.g., clean room certification, environmental certification, and so forth
- Imaging technologies such as cameras, copiers, FAX machines and medical systems.
- FIGs. 9, 10,11, 12, and 13 illustrate possible example systems that can be constructed employing the concepts previously described above in relation to Figs. 1 -8.
- Fig. 9 is a flow diagram of light paths in an imaging system 800 adapted in accordance with the present invention.
- the system 800 employs a light source 804 emitting illuminating light that is received by a light condenser 808. Output from the light condenser 808 can be directed by a fold mirror 812 to a microscope condenser 816 that projects illuminating light onto a slide stage 820, wherein an object (not shown, positioned on top of, or within the slide stage) can be imaged in accordance with the present invention.
- the slide stage 820 can be automatically positioned (and/or manually) via a computer 824 and associated slide feed 828 in order to image one or more objects in a field of view defined by an objective lens 832.
- the objective lens 832 and/or other components depicted in the system 800 may be adjusted manually and/or automatically via the computer 824 and associated controls (not shown) (e.g., servo motors, tube slides, linear and/or rotary position encoders, optical, magnetic, electronic, or other feedback mechanisms, control software, and so forth) to achieve different and/or desired image characteristics (e.g., magnification, focus, which objects appear in field of view, depth of field and so forth).
- controls e.g., servo motors, tube slides, linear and/or rotary position encoders, optical, magnetic, electronic, or other feedback mechanisms, control software, and so forth
- image characteristics e.g., magnification, focus, which objects appear in field of view, depth of field and so forth.
- Light output from the objective lens 832 can be directed through an optional beam splitter 840, wherein the beam splitter 840 is operative with an alternative epi- illumination section 842 (to light objects from above slide stage 820) including light shaping optics 844 and associated light source 848.
- Light passing through the beam splitter 840 is received by an image forming lens 850.
- Output from the image forming lens 850 can be directed to a CCD or other imaging sensor or device 854 via a fold mirror
- the CCD or other imaging sensor or device 854 converts the light received from the object to digital information for transmission to the computer 824, wherein the object image can be displayed to a user in real-time and/or stored in memory at 864.
- the digital information defining the image captured by the CCD or other imaging sensor or device 854 can be routed as bit-map information to the display/memory 864 by the computer 824.
- image processing such as automatic comparisons with predetermined samples or images can be performed to determine an identity of and/or analyze the object under examination. This can also include employment of substantially any type of image processing technology or software that can be applied to the captured image data within the memory 864.
- Fig. 10 is a system 900 depicting an exemplary modular approach to imaging design in accordance with an aspect of the present invention.
- the system 900 can be based on a sensor array 910 (e.g., provided in off-the-shelf camera) with a pixel pitch of approximately 8 microns (or other dimension), for example, wherein array sizes can vary from 640x480 to 1280x1024 (or other dimensions as noted above).
- the system 900 includes a modular design wherein a respective module is substantially isolated from another module, thus, mitigating alignment tolerances.
- the modules can include:
- a camera/sensor module including an image-forming lens 916 and/or fold mirror 918;
- a light-shaping module 930 including a condenser 934
- system 900 can advantageously employ commercially- available components such as for example:
- the image-forming lens 916 can be provided in order to facilitate the injection of light (via a light-forming path) into an optical path for epi-illumination.
- the light-forming path for epi-illumination can include:
- a light source 950 such as an LED driven from a current-stabilised supply
- the optic 964 provides a 50% reflectivity on a first surface (at an inclination of 45 degrees), and is broadband antireflection coated on a second surface.
- the sub-stage lighting module 940 is provided by an arrangement that is substantially similar to that of the epi-illumination described above for example:
- a light source 970 an LED driven from a current-stabilised supply
- a transmission hologram associated with light source 970 for the purposes of source homogenisation and the imposition of a spatial virtual-source; • (e.g., POC light shaping diffuser polyester film 30-degree FWHM)
- a collection lens 974 employed to maximize the light gathered from the virtual source 970, and to match the k-space characteristics of the source to that of the imaging optics;
- a relay lens employed to accurately position the image of the variable aperture 980 onto the object plane (at slide 990), thereby, along with suitable placement of a holographic diffuser, thus, achieving Kohler illumination.
- a computer 994 and associated display/memory 998 is provided to display in real-time and/or store/process digital image data captured in accordance with the present invention.
- Fig. 11 illustrates a system 1000 in accordance with an aspect of the present invention.
- a sub-stage lighting module 1010 e.g., Kohler, Abbe
- a transmissive slide 1020 object under examination not shown
- an achromatic objective lens 1030 receives light from the slide and directs the light to an image capture module at 1040.
- the achromatic objective lens 1030 and/or slide 1020 can be manually and/or automatically controlled to position the object(s) under examination and/or position the objective lens.
- Fig. 12 illustrates a system 1100 in accordance with an aspect of the present invention.
- a top-stage or epi-illumination lighting module 1110 can project light to an opaque slide 1120 (object under examination not shown), wherein an objective lens 1130 (can be compound lens device or other type) receives light from the slide and directs the light to an image capture module at 1040.
- the objective lens 1130 and/or slide 1120 can be manually and/or automatically controlled to position the object(s) under examination and/or position the objective lens.
- Fig. 13 depicts a system 1200 that is similar to the system 1000 in Fig. 11 except that a compound objective lens 1210 is employed in place of an achromatic objective lens.
- the imaging systems and processes described above in connection with Figs. 1-13 may thus be employed to capture/process an image of a sample, wherein the imaging systems are coupled to a processor or computer that reads the image generated by the imaging systems and compares the image to a variety of images in an on-board data store in any number of current memory technologies.
- the computer can include an analysis component to perform the comparison.
- Some of the many algorithms employed in image processing include, but are not limited to convolution (on which many others are based), FFT, DCT, thinning (or skeletonisation), edge detection and contrast enhancement. These are usually implemented in software but may also use special purpose hardware for speed. FFT (fast
- DCT discrete cosine transform
- image processing There are a various extant programming languages designed for image processing which include but are not limited to those such as IDL, Image Pro, Matlab, and many others. There are also no specific limits to the special and custom image processing algorithms that may be written to perform functional image manipulations and analyses.
- the k-space design of the present invention also allows for direct optical correlation of the Fourier Frequency information contained in the image with stored information to perform real-time optically correlated image processed analyses of a given sample object.
- Fig. 14 illustrates a particle sizing application 1300 that can be employed with the systems and processes previously described.
- Particle sizing can include real-time, closed/open loop monitoring, manufacturing with, and control of particles in view of automatically determined particles sizes in accordance with the k-space design concepts previously described. This can include automated analysis and detection techniques for various particles having similar or different sizes (n different sizes, n being an integer) and particle identification of m-shaped/dimensioned particles, m being an integer).
- desired particle size detection and analysis can be achieved via a direct measurement approach.
- Direct measurement generally does not create a model but rather provides a metrology and morphology of the imaged particles in any given sample. This mitigates processing of modelling algorithms, statistical algorithms, and other modelling limitations presented by current technology. Thus, an issue becomes one of sample handling and form that enhances the accuracy and precision of measurements since the particle data is directly imaged and measured rather than modelled, if desired.
- particle size image parameters are determined.
- basic device design can be configured for imaging at desired Absolute Spatial Resolution per pixel and Effective Resolved Magnification as previously described. These parameters determine field of view (FOV), depth of field (DOF), and working distance (WD), for example.
- Real-time measurement can be achieved by asynchronous imaging of a medium at selected timing intervals, in real-time at common video rates, and/or at image capture rates as desired. Real-time imaging can also be achieved by capturing images at selected times for subsequent image processing.
- Asynchronous imaging can be achieved by capturing images at selected times by pulsing an instrument illumination at selected times and duty cycles for subsequent image processing.
- a sample introduction process is selected for automated (or manual) analysis.
- Samples can be introduced into an imaging device adapted in accordance with the present invention in any of the following (but not limited to) imaging processes: 1) All previously described methods and transmissive media as well as:
- samples may be opaque and presented on an opaque "carrier" (automated and/or manual) without substantial regard to the material analyzed.
- a process control and/or monitoring system is configured. Real-time, closed loop and/or open loop monitoring, manufacturing with (e.g., closing loop around particle size), and control of processes by direct measurement of particle characteristics (e.g., size, shape, morphology, cross section, distribution, density, packing fraction, and other parameters can be automatically determined).
- particle characteristics e.g., size, shape, morphology, cross section, distribution, density, packing fraction, and other parameters can be automatically determined.
- direct measurement techniques are performed on a given particle sample, that automated algorithms and/or processing can also be applied to the imaged sample if desired.
- a direct measurement-based particle characterization device can be installed at substantially any given point in a manufacturing process to monitor and communicate particle characteristics for process control, quality control, and so forth by direct measurement.
- a plurality of different sample types can be selected for analysis.
- particle samples in any of the aforementioned forms can be introduced in continuous flow, periodic, and/or asynchronous processes for direct measurement in a device as part of a process closed-feedback-loop system to control, record, and/or communicate particle characteristics of a given sample type (can also include open loop techniques if desired).
- Asynchronous and/or synchronous (the first defines imaging with a triggering signal sent by an event, or trigger signal initiated by an event or object generating a trigger signal to initiate imaging, the second defines imaging with a timing signal sent to trigger illumination.
- Asynchronous and/or synchronous imaging can be achieved by pulsing an illumination source to coincide with the desired image field with substantially any particle flow rate.
- This can be controlled by a computer, for example, and/or by a "trigger” mechanism, either mechanical, optical, and/or electronic, to "flash” solid state illumination on and off with a given duty cycle so that the image sensor captures, displays and records the image for processing and analysis.
- a "trigger” mechanism either mechanical, optical, and/or electronic
- This provides a straight-forward process of illuminating and imaging given that it effectively can be timed to "stop the action" - or rather, “freeze” the motion of the flowing particles in the medium.
- this enables that a sample within the image field to capture particles within the field for subsequent image processing and analysis.
- Real-time (or substantially real time), closed loop and/or open loop monitoring, manufacturing with, and control of processes by k-space-based, direct measurement of particle characterization at 1340 is applicable to a broad range of processes including (but not limited to): Ceramics, metal powders, pharmaceuticals, cement, minerals, ores, coatings, adhesives, pigments, dyes, carbon black, filter materials, explosives, food preparations, health & cosmetic emulsions, polymers, plastics, micelles, beverages - and many more particle-based substances requiring process monitoring and control.
- Other applications include but are not limited to:
- analyses can be metrologic (direct measurement based) and/or comparative (data-base) based.
- Comparative analyses can include comparisons to a database of image data for known particles and/or variants thereof.
- Advanced image processing can characterize and catalog images in real-time and/or periodic sample-measurements. Data can be discarded and/or recorded as desired, whereas data matching known sample characteristics can begin a suitable selected response, for example.
- a device adapted in accordance with the present invention can be linked for communication in any data transmission process. This can included wireless, broadband, phone modem, standard telecom, Ethernet or other network protocols (e.g., Internet, TCP/IP, Bluetooth, cable TV transmissions as well as others).
- a k-space system is adapted in accordance with the present invention having a light system that includes a low intensity light source at 1410, such as a Light Emitting Diode (LED), emitting light having a wavelength of about 250 to about 400 nm (e.g., ultraviolet light).
- a low intensity light source at 1410 such as a Light Emitting Diode (LED)
- LED Light Emitting Diode
- the LED can be employed to provide for epi-illumination, trans- illumination as described herein (or other type).
- an LED also enables waveguide illumination in which the UV excitation wavelength is introduced onto a planar surface supporting the object under test at 1420, such that evanescent- wave coupling of the UV light can excite fluorophores within the object.
- the UV light can be provided at about a right angle to a substrate on which the object lies.
- the LED (or other light source or combinations thereof) can emit light for a predetermined time period and/or be controlled in a strobe-like manner emitting pulses at a desired rate.
- excitation is applied to the object for the period determined at 1430.
- automated and/or manual analysis is performed on the object during (and/or thereabout) the excitation period.
- Fluorescence is a condition of a material (organic or inorganic) in which the material continues to emit light while absorbing excitation light. Fluorescence can be an inherent property of a material (e-g-, auto-fluorescence) or it can be induced, such as by employing flurochrome stains or dyes. The dye can have an affinity to a particular protein or other receptiveness so as to facilitate discovering different conditions associated with the object. In one particular example, fluorescence microscopy and/or digital imaging provides a manner in which to study various materials that exhibit secondary fluorescence.
- the UV LED (or other source) can produce intense flashes of UV radiation for a short time period, with an image being constructed by a sensor (sensor adapted to the excitation wavelength) a short time later (e.g., milliseconds to seconds).
- This mode can be employed to investigate the time decay characteristics of the fluorescent components of the object (or sample) being tested. This may be important where two parts of the object (or different samples) may respond (e.g., fluoresce substantially the same under continuous illumination, but may have differing emission decay characteristics.
- the light from the light source can cause at least a portion of the object under test to emit light, generally not in the ultraviolet wavelength. Because at least a portion of the object fluoresces, pre- or post-fluorescence images can be correlated relative to those obtained during fluorescence of the object to ascertain different characteristics of the object.
- the light sources can be mercury or xenon arc (burner) lamps, which produce high-intensity illumination powerful enough to image fluorescence specimens.
- these types of light sources typically have short operating lives (e.g., 10-100 hours).
- a power supply for such conventional light sources often includes a timer to help track the number of use hours, as arc lamps tend to become inefficient and are more likely to shatter, if utilized beyond their rated lifetime.
- mercury burners generally do not provide even intensity across the spectrum from ultraviolet to infrared, as much of the intensity of the mercury burner is expended in the near ultraviolet. This often requires precision filtering to remove undesired light wavelengths. Accordingly, it will be appreciated that using a UV LED, in accordance with an aspect of the present invention, provides a substantially even intensity at a desired UV wavelength to mitigate power consumption and heat generated through its use. Additionally, the replacement cost of a LED light source is significantly less than conventional lamps. Fig.
- Films and thin films can be characterized in general terms as thin layers (varying from molecular thickness(es) to significant microscopic to macroscopic thickness(es) of some material, or multiple materials, deposited in a manner suitable to respective materials onto various substrates of choice and can include (but are not limited to) any of the following: metallic coating (e.g., reflective, including partial, opaque, and transmissive), optical coatings (e.g., interference, transmission, anti-reflective, pass-band, blocking, protective, multi-coat, and so forth), plating (e.g., metallic, oxide, chemical, anti-oxidant, thermal, and so forth), electrically conductive (e.g., macro and micro-circuit deposited and constructed), optically conductive (e.g., deposited optical materials of varying index of refraction, micro- and macro-optical "circuits.”).
- metallic coating e.g., reflective, including partial, opaque, and transmissive
- optical coatings e.g., interference, transmission, anti-
- This can also include other coatings and layered film and film-like materials on any substrate which can be characterized by deposition in various manners so as to leave a desired layer of some material(s) on said substrate in a desired thickness, consistency, continuity, uniformity, adhesion, and other parameters associated with any given deposited film.
- Associated thin film analysis can include detection of micro bubbles, voids, microscopic debris, depositing flaws, and so forth.
- a k-space system is configured for thin film analysis in accordance with an aspect of the present invention.
- the application of a k-space imaging device to the problem of thin-film inspection and characterization can be employed in identifying and characterizing flaws in a thin film or films for example.
- Such a system can be adapted to facilitate:
- a k-space device can be configured for imaging at desired Absolute Spatial Resolution (ASR) per pixel and desired Effective Resolved Magnification (ERM). These parameters facilitate determining FOV, DOF, and WD, for example.
- ASR Absolute Spatial Resolution
- ERM Effective Resolved Magnification
- This can include objective-based design configurations and/or achromat-design configurations (e.g., for wide FOV and moderate ERM, and ASR).
- Illumination can be selected based on inspection parameters as trans-illumination and/or epi-illumination, for example.
- a substrate is mounted in an imager in such a manner as to be scanned by:
- asynchronous imaging at selected timing intervals and/or in real-time for respective scanned areas (e.g., determined by FOV) of substrate at common video rates and/or at image capture rates can be provided. Images of indexed and/or scanned areas can be captured with desired frequency for subsequent image processing.
- samples can be introduced into the device manually and/or in an automated manner from a "feed" such as from a conveyor system.
- Typical operational parameters can include (but are not limited to:
- Images from a device adapted in accordance with the present invention can be processed in accordance with substantially any hardware and/or software process.
- Software-based image processing can be achieved by custom software and/or commercially available software since the image file formats are digital formats (e.g., bit maps of captured films).
- analyses can be metrologic (direct measurement based) and/or comparative (data-base) based.
- Comparative analyses can include comparisons to a database of image data for known films and/or variants thereof.
- Advanced image processing can characterize and catalog images in real-time and/or periodic sample- measurements.
- Data can be discarded and/or recorded as desired, whereas data matching known sample characteristics can begin a suitable selected response, for example.
- a device adapted in accordance with the present invention can be linked for communication in any data transmission process. This can included wireless, broadband, phone modem, standard telecom, Ethernet or other network protocols (e.g., Internet, TCP/IP, Bluetooth, cable TV transmissions as well as others).
- an imaging system adapted as described above provides high effective resolved magnification and high spatial resolution among other features of biological material and methods that can be combined to provide improved biological material imaging systems and methods.
- the biological material imaging systems and methods of the present invention enable the production of improved images (higher effective magnification, improved resolution, improved depth of field, and the like) leading to the identification of biological materials as well as the classification of biological materials (for example as normal or abnormal).
- Biomaterial includes microorganisms (organisms too small to be observed with the unaided eye) such as bacteria, virus, protozoans, fungi, and ciliates; cell material from organisms such cells (lysed, intracellular material, or whole cells), proteins, antibodies, lipids, and carbohydrates, tagged or untagged; and portions of organisms such as clumps of cells (tissue samples), blood, pupils, irises, finger tips, teeth, portions of the skin, hair, mucous membranes, bladder, breast, male/female reproductive system components, muscle, vascular components, central nervous system components, liver, bone, colon, pancreas, and the like. Since the biological material imaging system of the present invention can employ a relatively large working distance, portions of the human body may be directly examined without the need for removing a tissue sample.
- microorganisms organisms too small to be observed with the unaided eye
- cell material from organisms such cells (lysed, intracellular material, or whole cells), proteins, antibodies, lipids
- Cells include human cells, non-human animal cells, plant cells, and synthetic/research cells.
- Cells include prokaryotic and eukaryotic cells. Cells may be healthy, cancerous, mutated, damaged, or diseased.
- non-human cells examples include anthrax, Actinomycetes spp., Azotobacter, Bacillus anthracis, Bacillus cereus, Bacteroides species, Bordetella pertussis, Borrelia burgdorferi, Campylobacter jejuni, Chlamydia species, Clostridium species, Cyanobacteria, Deinococcus radiodurans, Escherichia coli, Enterococcus, Haemophilus influenzae, Helicobacter pylori, Klebsiella pneumoniae, Lactobacillus spp., Lawsonia intracellularis, Legionellae, Listeria spp., Micrococcus spp., Mycobacterium leprae, Mycobacterium tuberculosis, Myxobacteria, Neisseria gonorrheoeae, Neisseria meningitidis, Prevotella spp., Pseudomonas spp., Salmonella
- biological material are those that cause illness such as colds, infections, malaria, chlamydia, syphilis, gonorrhea, conjunctivitis, anthrax, meningitis, botulism, diarrhea, brucellosis, campylobacter, candidiasis, cholera, coccidioidomycosis, cryptococcosis, diphtheria, pneumonia, foodborne infections, glanders (burkholderia mallei), influenzae, leprosy, histoplasmosis, legionellosis, leptospirosis, listeriosis, melioidosis, nocardiosis, nontuberculosis mycobacterium, peptic ulcer disease, pertussis, pneumonia, psittacosis, salmonella enteritidis, shigellosis, sporotrichosis, strep throat, toxic shock syndrome, trachoma, typhoid fever, urinary tract infections,
- human cells include fibroblast cells, skeletal muscle cells, neutrophil white blood cells, lymphocyte white blood cells, erythroblast red blood cells, osteoblast bone cells, chondrocyte cartilage cells, basophil white blood cells, eosinophil white blood cells, adipocyte fat cells, invertebrate neurons (Helix aspera), mammalian neurons, adrenomedullary cells, melanocytes, epithelial cells, endothelial cells; tumor cells of all types (particularly melanoma, myeloid leukemia, carcinomas of the lung, breast, ovaries, colon, kidney, prostate, pancreas and testes), cardiomyocytes, endothelial cells, epithelial cells, lymphocytes (T-cell and B cell), mast cells, eosinophils, vascular intimal cells, hepatocytes, leukocytes including mononuclear leukocytes, stem cells such as haemopoetic, neural, skin, lung, kidney, liver
- T cells T cells, NIH3T3 cells, CHO, COS, etc.
- a useful source of cell lines and other biological material may be found in ATCC Cell Lines and Hybridomas, Bacteria and Bacteriophages, Yeast, Mycology and Botany, and Protists: Algae and Protozoa, and others available from American Type Culture Co. (Rockville, Md.), all of which are herein incorporated by reference. These are non- limiting examples as a litany of cells and other biological material can be listed.
- the present invention also provides improved systems and methods of diagnosis.
- the present invention also provides methods for detection and characterization of medical pathologies such as cancer, pathologies of musculoskeletal systems, digestive systems, reproductive systems, and the alimentary canal, in addition to atherosclerosis, angiogenesis, arteriosclerosis, inflamation, atherosclerotic heart disease, myocardial infarction, trauma to arterial or veinal walls, neurodegenerative disorders, and cardiopulmonary disorders.
- the present invention also provides methods for detection and characterization of viral and bacterial infections.
- the present invention also enables assessing the effects of various agents or physiological activities on biological materials, in both in vitro and in vivo systems.
- the present invention enables assessment of the effect of a physiological agent, such as a drug, on a population of cells or tissue grown in culture.
- the biological material imaging system of the present invention enables computer driven control or automated process control to obtain data from biological material samples.
- a computer or processor coupled with the biological material imaging system, contains or is coupled to a memory or data base containing images of biological material, such as diseased cells of various types.
- biological material imaging system secures images from a given biological material sample, and the images are compared with images in the memory, such as images of diseased cells in the memory.
- the computer/processor performs a comparison analysis of collected image data and stored image data, and based on the results of the analysis, formulates a determination of the identity of a given biological material; of the classification of a given biological material (normal/abnormal, cancerous/non-cancerous, benign/malignant, infected/not infected, and the like); and/or of a condition (diagnosis).
- the computer/processor determines that a sufficient degree of similarity is present between particular images from a biological material sample and saved images (such as of diseased cells or of the same biological material), then the image is saved and data associated with the image may be generated. If the computer/processor determines that a sufficient degree of similarity is not present between particular image of a biological material sample and saved images of diseased cells/particular biological material, then the biological material sample is repositioned and additional images are compared with images in the memory. It is to be appreciated that statistical methods can be applied by the computer/processor to assist in the determination that a sufficient degree of similarity is present between particular images from a biological material sample and saved images of biological material. Any suitable correlation means, memory, operating system, analytical component, and software/hardware may be employed by the computer/processor.
- an exemplary aspect of an automated biological material imaging system 1600 in accordance with one aspect of the present invention enabling computer driven control or automated process control to obtain data from biological material samples is shown.
- An imaging system 1602 described/configured in connection with Figs. 1-16 above may be employed to capture an image of a biological material 1604.
- the imaging system 1602 is coupled to a processor 1606 and/or computer that reads the image generated by the imaging system 1602 and compares the image to a variety of images in the data store 1608.
- the processor 1606 contains an analysis component to make the comparison.
- Some of the many algorithms used in image processing include convolution (on which many others are based), FFT, DCT, thinning (or skeletonisation), edge detection and contrast enhancement. These are usually implemented in software but may also use special purpose hardware for speed.
- FFT fast Fourier transform
- DCT discrete cosine transform
- DCT discrete cosine transform
- the data store 1608 contains one or more sets of predetermined images.
- the images may include normal images of various biological materials and/or abnormal images of various biological materials (diseased, mutated, physically disrupted, and the like).
- the images stored in the data store 1608 provide a basis to determine whether or not a given captured image is similar or not similar (or the degree of similarity) to the stored images.
- the automated biological material imaging system 1600 can be employed to determine if a biological material sample is normal or abnormal.
- the automated biological material imaging system 1600 can identify the presence of diseased cells, such as cancerous cells, in a biological material sample, thereby facilitating diagnosis of a given disease or condition.
- the automated biological material imaging system 1600 can diagnose the illnesses/diseases listed above by identifying the presence of an illness causing biological material (such as an illness causing bacteria described above) and/or determining that a given biological material is infected with an illness causing entity such as a bacteria or determining that a given biological material is abnormal (cancerous).
- the automated biological material imaging system 1600 can be employed to determine the identity of a biological material of unknown origin.
- the automated biological material imaging system 1600 can identify a white powder as containing anthrax.
- the automated biological material imaging system 1600 can also facilitate processing biological material, such as performing white blood cell or red blood cell counts on samples of blood, for example.
- the computer/processor 1606 may be coupled to a controller which controls a servo motor or other means of moving the biological material sample within an object plane so that remote/hands free imaging is facilitated. That is, motors, adjusters, and/or other mechanical means can be employed to move the biological material sample slide within the object field of view.
- Real time imaging facilitates at least one of rapid diagnosis, data collection/generation, and the like.
- the biological material imaging system is directed to a portion of a human (such as lesion on an arm, haze on the cornea, and the like) and images formed.
- the images can be sent to a computer/processor (or across network such as Internet), which is instructed to identify the possible presence of a particular type of diseased cell (an image of which is stored in memory).
- a computer/processor instructs the system to remove/destroy the diseased cell, for example, employing a laser, liquid nitrogen, cutting instrument, and/or the like.
- Fig. 18 depicts a high-level machine vision system 1800 in accordance with the subject invention.
- the system 1800 includes an imaging system 10 (Fig. 1) in accordance with the subject invention.
- the imaging system 10 is discussed in substantial detail supra and thus further discussion regarding details related thereto is omitted for sake of brevity.
- the imaging system 10 can be employed to collect data relating to a product or process
- the imaging system 10 as noted above provides for collecting image data at a granularity not achievable by many conventional systems. Moreover, the robust image data provided by the subject imaging system 10 can afford for highly effective machine vision inspection of the product or process 1810. For example, minute product defects typically not detectable by many conventional machine vision systems can be detected by the subject system 1800 as a result of the image data collected by the imaging system 10.
- the controller 1810 can be any suitable controller or control system employed in com ection with a fabrication scheme, for example.
- the controller 1810 can employ the collected image data to reject a defective product or process, revise a product or process, accept a product or process, etc. as is common to machine-vision based control systems. It is to be appreciated that the system 1800 can be employed in any suitable machine-vision based environment, and all such applications of the subject invention are intended to fall within the scope of the hereto appended claims.
- the subject system 1800 could be employed in connection with semiconductor fabrication where device and/or process tolerances are critical to manufacturing consistent reliable semiconductor-based products.
- the product 1810 could represent a semiconductor wafer, for example, and the imaging system 1800 could be employed to collect data (e.g., critical dimensions, thicknesses, potential defects, other physical aspects...) relating to devices being formed on the wafer.
- the controller 1820 can employ the collected data to reject the wafer because of various defects, modify a process in connection with fabricating devices on the wafer, accept the wafer, etc.
Abstract
Description
Claims
Priority Applications (10)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
BR0210852-6A BR0210852A (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal spatial optical design |
JP2003511312A JP2005534946A (en) | 2001-07-06 | 2002-07-03 | Imaging system and method using inverse space optical design |
EP02756399A EP1405346A4 (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design |
CA2453049A CA2453049C (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design |
MXPA04000167A MXPA04000167A (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design. |
NZ530988A NZ530988A (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design |
KR1020047000181A KR100941062B1 (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design |
IL15970002A IL159700A0 (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design |
AU2002322410A AU2002322410B8 (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design |
IL159700A IL159700A (en) | 2001-07-06 | 2004-01-04 | Imaging system and methodology employing reciprocal space optical design |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/900,218 | 2001-07-06 | ||
US09/900,218 US6664528B1 (en) | 2001-07-06 | 2001-07-06 | Imaging system and methodology employing reciprocal space optical design |
US10/166,137 | 2002-06-10 | ||
US10/166,137 US6884983B2 (en) | 2002-06-10 | 2002-06-10 | Imaging system for examining biological material |
US10/189,326 | 2002-07-02 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2003005446A1 true WO2003005446A1 (en) | 2003-01-16 |
Family
ID=26861993
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2002/021392 WO2003005446A1 (en) | 2001-07-06 | 2002-07-03 | Imaging system and methodology employing reciprocal space optical design |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2003005446A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006088109A1 (en) * | 2005-02-21 | 2006-08-24 | Olympus Corporation | Weak-light specimen imaging unit and weak-light specimen imaging device |
US7410805B2 (en) | 2003-07-30 | 2008-08-12 | The Boeing Company | Aerosol detection system using optical and mass discrimination |
CN104391370A (en) * | 2014-11-04 | 2015-03-04 | 温州生物材料与工程研究所 | Flat field scanning lens working face and surgery microscope working surface imaging switching system |
US11857373B2 (en) | 2016-10-04 | 2024-01-02 | The Regents Of The University Of California | Multi-frequency harmonic acoustography for target identification and border detection |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5198653A (en) * | 1992-05-04 | 1993-03-30 | Hughes Aircraft Company | Wide FOV retro-null outgoing wavefront sensor |
US5973844A (en) * | 1996-01-26 | 1999-10-26 | Proxemics | Lenslet array systems and methods |
US6248988B1 (en) * | 1998-05-05 | 2001-06-19 | Kla-Tencor Corporation | Conventional and confocal multi-spot scanning optical microscope |
-
2002
- 2002-07-03 WO PCT/US2002/021392 patent/WO2003005446A1/en active Search and Examination
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5198653A (en) * | 1992-05-04 | 1993-03-30 | Hughes Aircraft Company | Wide FOV retro-null outgoing wavefront sensor |
US5973844A (en) * | 1996-01-26 | 1999-10-26 | Proxemics | Lenslet array systems and methods |
US6248988B1 (en) * | 1998-05-05 | 2001-06-19 | Kla-Tencor Corporation | Conventional and confocal multi-spot scanning optical microscope |
Non-Patent Citations (1)
Title |
---|
See also references of EP1405346A4 * |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7410805B2 (en) | 2003-07-30 | 2008-08-12 | The Boeing Company | Aerosol detection system using optical and mass discrimination |
WO2006088109A1 (en) * | 2005-02-21 | 2006-08-24 | Olympus Corporation | Weak-light specimen imaging unit and weak-light specimen imaging device |
US7630065B2 (en) | 2005-02-21 | 2009-12-08 | Olympus Corporation | Low-light specimen image pickup unit and low-light specimen image pickup apparatus |
JP4884369B2 (en) * | 2005-02-21 | 2012-02-29 | オリンパス株式会社 | Weak light sample imaging unit, weak light sample imaging device, and weak light sample imaging method |
EP2594983A1 (en) * | 2005-02-21 | 2013-05-22 | Olympus Corporation | Low-light specimen image pickup unit and low-light specimen image pickup apparatus |
CN104391370A (en) * | 2014-11-04 | 2015-03-04 | 温州生物材料与工程研究所 | Flat field scanning lens working face and surgery microscope working surface imaging switching system |
US11857373B2 (en) | 2016-10-04 | 2024-01-02 | The Regents Of The University Of California | Multi-frequency harmonic acoustography for target identification and border detection |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2453049C (en) | Imaging system and methodology employing reciprocal space optical design | |
AU2002322410A1 (en) | Imaging system and methodology employing reciprocal space optical design | |
ZA200400961B (en) | Imaging system and methodology employing reciprocal space optical design. | |
US6998596B2 (en) | Imaging system for examining biological material | |
US7692131B2 (en) | Imaging system and methodology with projected pixels mapped to the diffraction limited spot | |
US7338168B2 (en) | Particle analyzing system and methodology | |
US7863552B2 (en) | Digital images and related methodologies | |
US7248716B2 (en) | Imaging system, methodology, and applications employing reciprocal space optical design | |
US7109464B2 (en) | Semiconductor imaging system and related methodology | |
US7105795B2 (en) | Imaging system, methodology, and applications employing reciprocal space optical design | |
US7385168B2 (en) | Imaging system, methodology, and applications employing reciprocal space optical design | |
US7288751B2 (en) | Imaging system, methodology, and applications employing reciprocal space optical design | |
JP2012506060A (en) | Automated scanning cytometry using chromatic aberration for multi-plane image acquisition. | |
US7439478B2 (en) | Imaging system, methodology, and applications employing reciprocal space optical design having at least one pixel being scaled to about a size of a diffraction-limited spot defined by a microscopic optical system | |
Arpa et al. | Single lens off-chip cellphone microscopy | |
US7132636B1 (en) | Imaging system and methodology employing reciprocal space optical design | |
US8634067B2 (en) | Method and apparatus for detecting microscopic objects | |
WO2003005446A1 (en) | Imaging system and methodology employing reciprocal space optical design | |
Pushpa et al. | Advances in Microscopy and Its Applications with Special Reference to Fluorescence Microscope: An Overview | |
ZHANG et al. | Diffuser Modulation Enables Quantitative Lensless Microscopy |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 159700 Country of ref document: IL |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2003511312 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2453049 Country of ref document: CA Ref document number: 1020047000181 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: PA/a/2004/000167 Country of ref document: MX |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2002756399 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2004/00961 Country of ref document: ZA Ref document number: 200400961 Country of ref document: ZA Ref document number: 530988 Country of ref document: NZ |
|
WWE | Wipo information: entry into national phase |
Ref document number: 00158/KOLNP/2004 Country of ref document: IN Ref document number: 158/KOLNP/2004 Country of ref document: IN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 20028171802 Country of ref document: CN |
|
WWP | Wipo information: published in national office |
Ref document number: 2002756399 Country of ref document: EP |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
DPE2 | Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101) |