Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
VIS-OCT Brings
Vascular Network into Focus
www.photonics.com
VIEWER
ʱųåƼŅƚųÆå±ƚƋĜüƚĬĜĵ±čåŸƵĜƋĘÏŅĬĬå±čƚåŸØ
ÏŅĬĬ±ÆŅų±ƋŅųŸ±ĹÚåƴåĹü±ĵĜĬƼƚŸĜĹčƋĘ埱ĵåĘĜčĘ
ŞåųüŅųĵ±ĹÏåFĵ±ųĜŸųåĹÚåųĜĹč±ŸƼŅƚʱƴåĜĹƋĘåĬ±Æţ
And take that high performance Imaris rendering with
ƼŅƚƵĘåųåƴåųƼŅƚčŅ×ĘŅĵåØÏŅĹüåųåĹÏåŸØŸ±ÆƱƋĜϱĬŸØŅų
±ĹƼŅüƼŅƚųŅƋĘåųåƻÏĜƋĜĹčƋų±ƴåĬŸţ
K imaris.com/viewer
® www.photonics.com
NEWS
10 • BIOSCAN
BioPhotonics editors curate the most significant headlines for photonics
in the life sciences — and take you deeper inside the news.
Featured stories include:
• Wearable NIRS device reveals how seals prepare to dive
• Two-photon microscope captures brain activity at record speed
• Terahertz imaging system on a chip offers speed and portability
17 • RAPIDSCAN
10 • Prellis Biologics receives $8.7M, reports tissue printing progress
• Olympus invites entries for Global Light Microscopy Image of the Year
FEATURES
22 • VIS-OCT OPENS EYES TO NEW MEDICAL APPROACHES
by Hao F. Zhang, Northwestern University, and Kieren Patel, Opticent Health
Attention and investment could revolutionize applications in visioning
and treatment of eye-related diseases.
®
www.photonics.com
BioPhotonics Editor Douglas J. Farmer
Editorial Staff
Editor-in-Chief Michael D. Wheeler
Senior Editor Susan M. Petrie
Senior Editor Douglas J. Farmer
Associate Editor Joel P. Williams
Multimedia/Web Editor Robin J. Riley
Chief Copy Editor Carol A. McKenna
Copy Editors Cheryl L. Hulseapple, Bill D. Latimer
Contributing Editors Hank Hogan, Farooq Ahmed,
Marie Freebody
Creative Staff
Senior Art Director Lisa N. Comstock
BioPhotonics Art Director Suzanne L. Schmidt
Creative Designer Devon A. Unwin
Designer Dina J. Oliveira NEW
Digital Media & IT Staff
Director of Publishing Operations Kathleen A. Alibozek CELESTA
7-LINE LASER LIGHT ENGINE
Digital & IT Development Manager Brian L. LeMire
Digital Project Manager Alan W. Shepherd
Digital Developer & IT Support Brian A. Bilodeau IT JUST KEEPS GETTING
B RIG HTE R …
Digital Designer Brian W. Healey
Computer Specialist & Digital Support Angel L. Martinez
Corporate Staff
President/CEO Thomas F. Laurin
Vice President Kristina A. Laurin
Vice President Erik W. Laurin
Internal Audit Officer Mollie M. Armstrong
Controller Lynne M. Lemanski
Accounts Receivable Manager Kathleen G. Paczosa
Business Manager Elaine M. Filiault
HR/Office Assistant Carol J. Atwater
Administrative Assistant Marge C. Rivard
Business Staff
Director of Audience Development Heidi L. Miller
Vice President of Sales Matthew M. Beebe
Advertising Production Manager Rebecca L. Pontier
Trade Show Coordinator Allison M. Mikaniewicz
Assistant Circulation Manager Melissa J. Liebenow
Circulation Assistants Alice M. White, Kimberly M. LaFleur,
Theresa A. Horn
Traffic Manager Daniel P. Weslowski • Spectral breadth: 405, 446,
477, 520, 546, 638, 749nm
• Power: ~1000mW/color,
~7W total
T
Mark A. Anastasio, Ph.D.
he benefits of optical coherence tomography (OCT) have long been known as an
Professor of Biomedical Engineering
imaging tool in ophthalmology, enabling the examination of the eye at microscopic
Washington University in St. Louis
resolution. But what may not be widely appreciated is that the use of visible light
sources can improve upon the results of this well-developed technique in the detection
David Benaron, M.D. and understanding of various eye-related diseases such as macular degeneration and
Professor, Medicine (consulting) glaucoma.
Founder, Stanford Biomedical Optics program While most commercial OCT and OCTA (angiography) systems use NIR light for
Stanford University School of Medicine economic and technical reasons, broadband visible light sources have expanded from 400
CEO, Spectros Corp. to 2000 nm or more. This has enabled the imaging of the complete vascular network and
all five of the outer retinal layers. With resulting higher resolution and imaging contrasts
at the tissue level generated with VIS-OCT made available to clinicians and researchers,
Stephen A. Boppart, M.D., Ph.D. conditions like blood oxygen saturation can be measured as never before.
Bliss Professor of Engineering In our cover story, professor Hao F. Zhang of Northwestern University and Kieren
Electrical and Computer Patel, a founder of Opticent Health, reflect on the many possibilities for ophthalmology
Engineering, Bioengineering and Medicine
brought to the forefront with VIS-OCT. More investment in VIS-OCT is needed, they
Beckman Institute for Advanced
Science and Technology
write on page 22, to bring down costs and excite clinicians about its application.
University of Illinois at Urbana-Champaign
Also featured in this issue:
• In lens-free microscopy, a light source is placed right on top of an image sensor. An
Aydogan Ozcan, Ph.D. algorithm helps translate the pattern caught by the sensor to achieve enough resolution
Chancellor’s Professor, Electrical & Computer that the image can be studied and virtually dissected. Contributing editor Hank Hogan
Engineering Department talks to experts in the field, who reveal that challenges remain to fully implementing
University of California, Los Angeles lens-free microscopy in the laboratory and field. Without the need for lenses, the micro-
HHMI Professor, The Howard Hughes scopes can be made smaller and less expensive than other types. Read more on page 28.
Medical Institute • Keeping with the core technologies of microscopy, guest authors Pablo Blinder, Lior
Golgher, and Hagai Har-Gil of Tel Aviv University write that open-source photon count-
ing can reveal details of a specimen while removing much of the noise. PySight, an open-
Adam Wax, Ph.D.
source application, has been developed to implement this technology in standard micro-
Professor of Biomedical Engineering
scopes, eliminating the need for extensive training or upgrades. Using a depth-scanning
Duke University
varifocal lens, researchers were able to acquire a large volume of images, capturing what
Founder and President, Lumedica
is occurring in a specimen in real time. Read more on page 38.
• When searching for a suitable camera to take advantage of the dynamic developments
within the spectrum of fluorescence microscopy, prospective buyers should consider a
number of factors, Felix Asche of Basler points out. Basic choices — including optical
format and resolution; CCD, CMOS, sCMOS, or BSI; monochrome or color; global
shutter versus rolling shutter; sensitivity and dynamic range; image quality and noise;
and cooling — all weigh on the search to acquire a camera for purposes in a range of
industrial settings. Asche explains that with SONY’s discontinuation of CCD camera
components, opportunities exist for companies to chart new ground in the life sciences.
Get an inside look at some of these changes on page 32.
• And in our “Biopinion” for this issue, Jasmin Schaefer, Iain Johnson, and Claudia
Jaffe of Lumencor Inc. examine the need for strong, high-quality light sources for mi-
croscopy, a feature they argue is too often overlooked in medical and industrial applica-
tions. Solid-state lighting has been available for the last half-century, they point out,
but there are many medical and manufacturing settings where, for whatever reason,
it has not been embraced. With the right light source, test results can prove to be more
reliable and less expensive at the same time. See page 7 to learn more about the authors’
perspectives.
doug.farmer@photonics.com
A
s scientists engage in the development and manufacture service providers alike. We commonly observe that users of fluo-
of high-performance lighting, we find it frustrating to en- rescence microscopes evaluate the performance of a light source
counter a lack of appreciation for the illumination source based on the camera exposure time required to acquire an image
in the successful application of light microscopy. Like that other of a fluorescent specimen. Yet this is a fundamentally unsound
pervasive illumination source, the sun, microscope light sources practice, because many factors determine the exposure time
are commonly taken for granted. It often seems they only draw and only some of them directly relate to the output of the light
attention when they are absent. This is unfortunate, as it not only source. Onboard monitoring systems allow the performance of
leaves many users unaware of the benefits of modern solid-state the light source to be evaluated directly and independently of the
illumination technologies, but it leaves them reliant on archaic microscope, camera, and specimen.
incandescent bulbs and mercury arc lamps. In conclusion, it is our opinion that users of fluorescence
We cannot help but observe how stark the contrast is with the microscopy and other optical imaging techniques should keep
technologies on the detection side of the microscope. During in mind that although the light source may be hidden in plain
the last 30 years, emulsion film recording has been completely sight, overlooking its importance may result in missed oppor-
displaced by solid-state digital cameras. While solid-state light- tunities. The potential exists today for improved data quality,
ing has been around for more than 50 years, we have yet to see better operational reliability and throughput, cleaner techniques,
its full appreciation or similarly broad adoption in academic cost-effective operation, and illumination that is customized
spheres, biotech laboratories, hospitals, and clinical labs, or by to the requirements of the application. To fully employ today’s
biotech equipment manufacturers. solid-state illumination, users need to pay mindful attention to
The benefits of solid-state light sources are significant. the uniqueness these state-of-the-art products offer versus their
Their nonreliance on mercury and other hazardous substances all-too-familiar and pervasive bulb-containing predecessors.
and their minimal operation and maintenance costs are well
documented. A typical HBO100W bulb used in fluorescence Meet the authors
microscopy contains about 20 mg of mercury and has a surface Jasmin Schaefer, technical support specialist at Lumencor Inc., earned
temperature of 800 °C and an internal pressure of 30 to 75 bar her Master of Science degree in biomedical engineering from Oregon
(400 to 1100 psi) under typical operating conditions. Under such Health and Science University in Portland, Ore. There she developed
challenging conditions, operational lifetime is only 200 to 300 a fluorescence imaging method for rapid intraoperative tumor margin
assessment. At Lumencor, she works under Iain Johnson to aid research-
hours. In stark contrast, LEDs used in lighting systems with ad-
ers and internal sales staff with technical support. Her background in
equate heat dissipation operate at ambient temperature and pres- fluorescence imaging has been an asset when it comes to understanding
sure and are capable of more than 10,000 hours of user operation customer applications and while troubleshooting issues that may crop up
(equivalent to 5 years of 40-hour weeks). Solid-state illuminators with Lumencor light engines.
also provide superior light output stability with respect to wave-
length and power, and on both a frame-to-frame and day-to-day Iain Johnson, Ph.D., director of technical support
basis. This is of value for quantitative comparisons where im- at Lumencor, is a biochemist with expertise
ages are acquired at various intervals in a time-lapse sequence. in the biophysics of fluorescence microscopy.
Solid-state light sources facilitate application-specific custom- With numerous patents and publications to his
ization of illumination. The traditional “top-down” illumination credit, he is steeped in the physical chemistry of
fluorescent and luminescent probes. For many
approach starts with a spectral distribution that is physically
years he has been a faculty member at the annual
invariant (e.g., the atomic emission of mercury vapor). Such University of British Columbia 3D Microscopy
output spectra are adapted to application requirements by selec- course as well as with Molecular Probes/Invit-
tive blocking and attenuation of the superfluous wavelengths and rogen/Life Technologies and his own consulting
optical power. Yet the more modern approach assembles discrete firm. He is responsible for technical support of both internal sales staff
solid-state light sources such as LEDs and laser diodes within and cutting-edge researchers around the world.
an electronic control framework. Such contemporary designs
enable the user by optimally matching application requirements Claudia Jaffe, Ph.D., is co-founder and execu-
in terms of the spectral distribution, angular distribution, and tive vice president at Lumencor. She earned her
radiant flux (power). doctorate in bioanalytical chemistry from the
University of Pittsburgh. She has developed,
The electronic control systems of today’s solid-state illumina-
published, and patented a variety of electro-
tors are increasingly sophisticated. They provide not only the chemical and photoelectrochemical sensors and
basic output control functions (color band selection, output on/ bioanalytical chips, focusing her efforts on high
off, and intensity adjustment) but also real-time performance throughput analyses employing enzymology,
monitoring and feedback control. These control systems can now immunology, and genomics. At Lumencor, she is
incorporate Ethernet connectivity, allowing performance data to an inventor in nearly all of the company’s patents
be accessed remotely for diagnostic purposes. This will facilitate and the leader of new business development. She supervises sales and
improved troubleshooting, providing a benefit to users and marketing as well.
BioPhotonics
BioPhotonics •
• May/June
September 2018
2019 7
7
Increase system
performance
with customized
solutions, from
prototyping through
high volume production.
Learn more at
www.semrock.com/CustomOEM
NEW!
that can, on command, manipulate spe-
cific loops that are rapid, reversible, and
able to work on the target regions with a
minimum of disturbance to neighboring
sequences. The ability to engineer the Optical Beam Combiner
loops and mechanisms that determine the
timing and quantity of genome expression
• 4 channel ultra high speed LED light source
means that researchers will be able to • Advanced control methods (USB, TTL, Ring buffer)
mimic those mechanisms in experimental • Supported in nearly all 3rd party software suites
conditions, making LADL a valuable tool • Liquid light guide output
for studying the role of genome folding on
a variety of diseases and disorders.
“It is critical to understand the genome
structure-function relationship on short
timescales because the spatiotemporal
regulation of gene expression is essential
to faithful human development and
because the misexpression of genes often
goes wrong in human disease,” professor
Jennifer Phillips-Cremins said. “The en-
gineering of genome topology with light
opens up new possibilities to understand-
LAMBDA 421
ing the cause and effect of this relation- The Lambda 421 optical beam combiner is a new, patented, concept for combining
ship. Moreover, we anticipate that over multiple LEDs or any light guide delivered light sources into a single common output
the long term, the use of light will allow beam. Each separate light source is collimated before entering the optical path through
us to target specific human tissues and a bandpass filter. The filters for each light source also function as mirrors that reflect the
even to control looping in specific neuron collimated beams from the previous light sources.
subtypes in the brain.”
The research was published in Nature
Methods (https://doi.org/10.1038/s41592-
019-0436-5). PHONE: 415.883.0128 | FAX: 415.883.0572 | EMAIL: INFO@SUTTER.COM | WWW.SUTTER.COM
of catalysts that helped render hydroqui- as unlabeled proteins, neurotransmitters, including energy science, cell biology,
none nontoxic. and chemical warfare agents,” professor neuroscience, and nanotechnology.”
“This highly generalizable technique Peng Chen said. “Therefore, we expect The research was published in Nature
can be broadly applied to image various COMPEITS to be a breakthrough technol- Chemistry (https://doi.org/10.1038/
classes of nonfluorescent systems, such ogy with profound impacts on many fields s41557-019-0288-8).
Ditch Piezo
For a Low Cost Way to Focus
K&ͲϱǁŝƚŚŵďĞĚĚĞĚŽŶƚƌŽůƐĂŶĚхϱŵŵdƌĂǀĞů
“Provides Ăůů ƚŚĞ ďĞŶĞĮƚƐ ŽĨ ƉŝĞnjŽ ŝŶ ƚĞƌŵƐ ŽĨ ƐƉĞĞĚ
ĂŶĚƌĞƐŽůƵƟŽŶ͘͘͘ǁŝƚŚ ŶŽŶĞŽĨƚŚĞůŝŵŝƚĂƟŽŶƐ”
Olympus invites entries for Global Light Microscopy Image of the Year
Olympus has announced its first Global
Image of the Year Life Science Light
Microscopy Award, expanding upon its
established Image of the Year European
Life Science Light Microscopy Award.
Those interested in entering the contest
may do so through Jan. 31, 2020. Winners
of the contest will be selected by a jury
and announced in March 2020.
The jury consists of global representa-
tives from both science and the arts, in-
cluding photographer Ron Caplain; Geoff
Williams, a bioimaging facility manager
at Brown University; Urs Ziegler, the head
of a microscopy imaging facility at the
University of Zürich; Stefan Terjung, the
operational manager of an advanced light
microscopy facility at EMBL Heidelberg; The 2018 European Life Science Light Microscopy Award’s winning image was taken by Håkan Kvanström
Hiroaki Misono, a graduate school profes- and shows the shell of a marine snail covered in algae and cyanobacteria. Courtesy of Olympus.
sor of brain science at Doshisha Univer-
sity; Zhu Xueliang, a professor at the
Shanghai Institute of Biochemistry and Three images may be uploaded per awarded in addition to the global prize.
Cell Biology, Chinese Academy of Sci- contestant along with a brief explanation, Participants can win a CX43 microscope
ences; Yalin Wang, director of Biomedi- including the equipment used. Entries with a DP27 digital camera, X Line objec-
cal Research Core Facilities at Westlake will be evaluated based on artistic and tives, or an OM-D E-M5 Mark II camera.
University, Hangzhou, China; and Wendy visual aspects, scientific impact, and For more information or to enter, visit
Salmon, a light microscopy specialist of a microscope proficiency. Regional prizes www.olympus-lifescience.com/ioty.
bioimaging facility at MIT. in Asia, Europe, and the Americas will be
SCANLAB appoints
Sonner R&D director
Christian Sonner, SCANLAB’s newly appointed Thomas Hümmer (center) was awarded €6000 ($6728) for the development of a highly sensitive
head of R&D. Courtesy of SCANLAB. microscope. Courtesy of the Center for NanoScience.
6.2%
— expected compound annual
growth rate of the photodynamic Courtesy of TOPTICA.
therapy market by 2029, according
to Persistence Market Research Laser developer and producer TOPTICA
Photonics has expanded into China with
a head office in Shanghai and a branch
office in Beijing to provide sales, service,
and application support for its full range
of technologies.
Five years ago, BioPhotonics reported the func- TOPTICA Photonics China was
tional use of diffuse optical tomography (DOT), established to serve the needs of the
a technique that had previously been very limited Chinese academic and industrial sectors
in its application. The technique allowed for the in the markets of quantum technologies,
imaging of brain activity without radiation. Since biophotonics, materials processing, and
then, researchers have developed DOT further, test and measurement, and joins offices in
bringing its resolution and effectiveness closer Germany, the U.S., and Japan.
to that of magnetic resonance imaging, which Juergen Stuhler, chairman of the board
remains the gold standard of brain imaging. of directors and general manager of TOP-
2014
TICA Photonics China, said the company
can now offer customers in China direct
sales and services for picosecond and
femtosecond seeders.
The method has been in the “We now have the ability to support
works for more than a decade, and supply customers in the areas of
quantum technology, tunable and single-
but until recently, it was limited to small regions frequency diode lasers, frequency combs,
of the brain. Now DOT can cover two-thirds of the wavemeters, light engines for laser light
microscopy, and terahertz systems for
head, imaging brain processes in multiple regions industrial metrology and security applica-
and networks, including those involved tions,” he said.
TOPTICA was founded in 1998 near
with language processing and daydreaming. Munich and built its reputation on deliv-
— BioPhotonics Bioscan, September 2014
ering high-end specifications.
www.xenoncorp.com
$48.6B
— size of the global medical
imaging market by 2025, according
to Zion Market Research
Spectral Evolution
moves to expanded facilities
Spectral Evolution has moved operations to expanded facili- Coherence Matters.
ties in Haverhill, Mass., to provide more space for engineer-
ing, and test and manufacturing.
HIGH PERFORMANCE L ASERS
Established in 2004, Spectral Evolution is a manufacturer
of laboratory and hand-held portable spectrometers, spectro-
radiometers, and spectrophotometers.
$768M
— expected size of the global
fluorescence microscopy market
by 2023, according to BCC Research
F
irst reported in 1991 by Huang and
colleagues1, OCT has become an
important imaging tool for ophthal-
mology following innovations over the
past three decades. OCT noninvasively
provides 3D in vivo optical biopsy with
microscopic resolution in the eye at a
depth range up to the choroid2. Besides
3D anatomical imaging, OCT can also
provide functional information. The most
Figure 1. Number of scientific publications on VIS-OCT. Data obtained from Web of Science
notable functional extension is OCT
and Google Scholar (a). Annual NIH research support for VIS-OCT awarded by the end of 2018.
angiography (OCTA), which can map Data obtained from NIH RePORT (b).
the microvasculature in the eye without
contrast agent and is being investigated in
clinical ophthalmology. izing the complete vascular network, importantly, OCTA is compatible with
OCTA opens up a new window on bet- including the multilayer inner retinal most existing OCT systems and can be
ter managing a wide variety of blinding capillary network and deep choroidal ves- implemented through a software upgrade.
diseases through noninvasively visual- sels, without using extrinsic labels. More All commercial OCT systems, to
Figure 3. VIS-OCT B-scan image of human retina. ELM: external limiting membrane. Courtesy of Ian Rubinoff/Northwestern University.
blood, VIS-OCT angiogram (VIS-OCTA) anatomic layers are clearly imaged with image from a healthy human eye. Figure
can be achieved in the same manner as ultrahigh axial resolution. 3a shows the image from the fovea, and
the modern OCTA. The angiographic Researchers from UC Davis and Figure 3b shows the magnified view of
image from the same volume as Figure Northwestern University have ap- the area highlighted by a red square. All
2a is shown in Figure 2b. All three layers plied VIS-OCT to image human eyes five outer retinal layers — including the
of the capillaries are clearly visualized to measure retinal hemoglobin oxygen inner/outer segment junction (IS/OS), the
at the single capillary level. Figure 2c saturation and ultrafine inner and outer cone outer segment tips (COST), the rod
shows a high-definition B-scan image retinal anatomical sublayers (sidebar). outer segment tips (ROST), the retinal
from a mouse eye, where all of the micro- Figure 3 shows a high-definition B-scan pigment epithelium (RPE), and Bruch’s
Figure 4. Method to extract sO2 from single retinal vessels (a). Pseudo-colored sO2 map overlaid on VIS-OCT angiogram (b). En face image of segmented RNFL/
GCL (c). Spectroscopic VIS-OCT image stack (d). Images (a) and (c) adapted from Reference 3; (b) adapted from Reference 5; (d) adapted from Reference 9.
insight into ultrastructural damage well variety of blinding diseases. More OCT light source; thus, new light sources are
before RNFL thinning occurs9. research groups and physician scientists needed through continuous technology
VIS-OCT represents one of the most are needed to explore its full potential. In innovations.
exciting new imaging directions for addition, the cost of VIS-OCT systems
clinical ophthalmology. With superior needs to come down to be comparable Meet the authors
resolution and the ability to generate to existing commercial OCTs and to Hao F. Zhang, Ph.D., is professor of biomedical
accurate functional information, VIS- facilitate broad clinical adoption. Reduc- engineering and ophthalmology at North-
OCT is likely to change diagnostic and ing the price of VIS-OCT is predomi- western University. His lab focuses on new
prognostic treatment protocols for a nately constrained by the high cost of its technologies of optical coherence tomography
and single-molecule imaging, as well the
application of these technologies to biology
and medicine. He received his doctoral degree
in biomedical engineering from Texas A&M
University and postdoctoral training at Wash-
W
ith advancements in image “The device [a lens-free microscope] is at once. Therefore, the lens-free approach
processing and sensors, lens- 10× smaller than a regular microscope. is well suited to needle-in-a-haystack
free microscopy is ready for But the image, on the contrary, is 100× problems, such as detecting cancer or
a closer look by researchers, industry, larger than any [other] microscope image,” other diseases. The small size, low cost,
and consumers. Compared to tradi- said Cédric Allier, a project manager and ruggedness of lens-free microscopes
tional benchtop microscopes, lens-free with the Grenoble, France-based research also make them useful for hand-held
techniques can cost less, reduce instru- organization CEA-Leti. and portable devices that are capable of
ment size, enlarge the field of view, and The large field and depth of view makes detecting medical problems or performing
improve throughput. it possible to look at perhaps 10,000 cells environmental monitoring in the field.
Above: Aydogan Ozcan displays hand-held, lens-free microscopes. The black one (left) is installed on a phone and uses the phone’s CMOS imager for lens-free
microscopy of a specimen. The white prototype (right) is a stand-alone hand-held lens-free microscope that is controlled by a laptop using a USB cable. This
stand-alone version weighs less than 50 g. Courtesy of Ozcan Lab/UCLA.
Several small companies and startups the microscope. In 2010, readily available Allier said. Tests have shown the two
are either actively producing lens-free image sensors had a roughly 5-µm pixel methods provide comparable results, and
products or plan to do so soon. If lens-free size. By 2015, this had dropped to 1.7 µm, the automated approach doesn’t require
methods offer the cost, performance, and making it possible to image cells. The skilled personnel in its operation.
usability necessary to achieve commercial pixel size continues to shrink and is now After their initial papers on lens-free
success, these products promise to boost as small as 0.8 µm. imaging, Ozcan’s UCLA group produced
public health by identifying waterborne What’s more, over the last few years, a 2010 Optics Express paper describing
toxins, airborne pollutants, and infectious increasingly powerful GPUs, or graph- much better resolution results than those
diseases in the field. ics processing units, have shortened the set by pixel size. The investigators did
image processing time. A half decade ago this by shifting the aperture, and there-
How technology has changed it may have taken an hour to do this pro- fore the illumination center, in small steps
In a conventional microscope, light cessing for a 2D image, Allier recalled. across the object. They then combined the
interacting with a target is collected and “Today it takes less than 30 seconds, shifted holograms into the final image.
focused by lenses. Lens-free imaging, thanks to the GPU and the fancy algo- “This method computationally divides
as the name implies, eliminates such rithm we’ve developed,” he said. This each pixel into smaller pixels to be able
bulk optics. Instead, based on a concept speed makes 2D lens-free microscopy to reach the diffraction limit of light,”
that first appeared in papers co-authored acceptable for clinical work. Ozcan said. He added that later work
by Aydogan Ozcan, a UCLA electrical These microscopes use a monochro- showed shifting the sensor achieved the
engineering and bioengineering professor, matic, narrowband LED that shines same effect.
these on-chip microscopes have a light through a 100-µm diameter pinhole, in This pixel-segmenting technique does
source located centimeters from a speci- CEA-Leti’s version. This source is coher- require the capturing and processing of
men that sits directly atop a CMOS image ent enough without the cost or power more data, and a more complex micro-
sensor. requirements of a laser. scope than otherwise would be the case.
The light is partially coherent, giving IPRASENSE, a company based in But in addition to offering higher resolu-
rise to an interference pattern captured by Montpellier, France, was founded to tion, the stepped approach also reduces
the sensor. Processing this holographic commercialize the CEA-Leti technology, speckle noise that arises from wavelength-
data using an appropriate algorithm de- including the holographic reconstruction scale object surface roughness and
signed specifically for the task creates an algorithms, acquisition setup, and soft- reduces unwanted reflection interference,
image suitable for viewing and analysis. ware as well as the data analysis chain. improving image quality.
The software also makes it possible to The almost 7-year-old company has a line
focus digitally rather than mechanically. of cell-culture monitoring equipment that Marketplace applications
A key to making this setup work is the uses lens-free microscopy and automated Ozcan’s group has explored a range of
image sensor, according to Allier, who algorithms to rapidly count cells and possible microscopy applications, includ-
has been working on lens-free techniques determine their viability. ing portable units that count and classify
for a decade. He said the pixel size of the The automated approach is about algae in seawater. These could provide a
sensor helps determine the resolution of 10× faster than the manual equivalent, faster and more field-friendly means to
In lens-free imaging, computational algorithms combine low-resolution holographic data (left) to create a high-resolution hologram (center), which then
undergoes reconstruction into a microscopic image (right). Courtesy of Euan McLeod/University of Arizona.
same time good resolution, with ‘good’ McLeod noted that some imaging health problems, particularly infectious
meaning micron or submicron resolution,” methods present challenges to lens-free diseases in the field. The new micro-
McLeod said. microscopy. Fluorescence-based tech- scopes, with their ability to rapidly and
Another recent entrant into lens-free niques, for instance, can be problematic efficiently screen cells, could also benefit
microscopy is imec, the Leuven, because light emitted by the specimen is research and drug development.
Belgium-based research organization. incoherent with the illumination, thereby On the consumer side, lens-free
At the 2017 SPIE BiOS conference in destroying the interference that forms the microscopy could lead to hand-held
San Francisco, imec investigators basis for holographic imaging. devices that enable people to measure and
reported on the development of a lens- Another issue that needs to be further monitor air quality by imaging airborne
free holographic microscope built using addressed is imaging speed. According particles, dust, mold, and allergens. The
a 1.12-µm-pixel sensor that achieved to CEA-Leti’s Allier, lens-free 3D imag- microscopes could similarly monitor
micron-resolution imaging. However, ing today is too slow for anything but water-quality issues. There have already
citing ongoing confidential research and demonstrations. It takes an hour, for ex- been demonstrations of such possibilities.
active work in this area, an imec spokes- ample, to complete the image processing For example, Ozcan’s group reported, in
person said no further details or updates of a mosquito wing or other objects of a 2010 Lab on a Chip paper, on a cell-
were available. about 5 cubic millimeters volume. In the phone attachment that operates using this
The University of Arizona’s McLeod future, faster GPUs should speed up this technology.
noted that lens-free methods rival the process. Machine learning could also According to Allier, further develop-
resolution possible with traditional lead to the development of new, more ments that improve device performance,
benchtop microscopes. In the past, light- efficient, and faster image reconstruction such as speeding up lens-free 3D imag-
induced artifacts were an issue. However, algorithms. ing, could spur new uses for lens-free
he said these resolution-robbing effects There are several ways in which the microscopy.
can be eliminated by shifting the light continuing evolution of lens-free micros- “This will open up new applications
source location or its wavelength and copy could have an impact, particularly that we haven’t thought of,” he said.
capturing multiple images. Software in applications where the new technology hank@hankhogan.com
can then combine the data and remove offers an advantage over traditional forms
artifacts, thereby improving image clarity of microscopy. On the clinical side, lens-
and usefulness. free methods may make it easier to detect
F
luorescence microscopy is a very overall costs increase when larger optical The newer CMOS technology has spread
broadly used term covering numerous formats such as the F-mount are used. through consumer sensor markets for
applications. It ranges from basic life The most common mount is the C-mount, many years and has recently become com-
science applications such as time-lapse which (with up to 1.1-in. sensors) delivers petitive. Noise levels are now comparable
cell viability assays — in which dead very good optical performance, as well as or even better than with the traditional
cells are counted as they start to fluoresce most products and solutions at a reason- and commonly used CCD sensors, en-
by intrusion of a fluorochrome that cannot able price. The smaller S-mount is a good abling the new technology to deliver
enter intact living cells — to sophisticated choice when size-restricted and low-cost higher speed, higher resolution, and less
techniques where only very few photons instruments are developed. Squared sen- power consumption/heat dissipation at
or single molecules are detected and sors are preferred to capture the maxi- lower prices into medical and life sciences
localized by specific high-end hardware mum image content. applications.
and software. It can be quite complex to Because the sensor takes over a central Scientific CMOS (sCMOS) cameras
design an optical imaging system that role in an imaging system, the selection were introduced in 2010 through the col-
perfectly fits a specific application. And at regarding certain performance specifica- laboration of three companies working
the same time, instrument manufacturers tions is of major importance. to provide better performance (mainly
are facing pressure to keep the costs down through faster CMOS-like readout speeds
in the medical and life sciences markets. CCD, CMOS, sCMOS, and BSI and higher dynamic range) compared to
From its beginning in the late 1970s, aging CCD technology, which contin-
Optical format and resolution CCD (charge-coupled device) technol- ued to provide a superior noise behavior
Looking at the visible wavelength ogy has been strongly established and is and brought higher image quality and
range, the optical setup considerations still available in high-end microscopy sensitivity. CMOS sensor development
regarding format, magnification, and cameras. Sony, the leading manufacturer is still rapidly accelerating. Recently, a
resolution do not significantly differ from of CCDs globally, has discontinued this technology called backside illumination
normal light microscopy applications technology, and instrument manufactur- (BSI) found its way into industrial im-
and are therefore not described here. ers using CCDs are being forced to find age sensors. BSI significantly improves
However, it is important to know that the alternative cameras for their systems. the pixels’ quantum efficiency. Coming
from the smartphone market with its of traditional CCD technology will tail is needed to calculate color information of
demand for smaller pixels, this technol- off. For instrument manufacturers and the image using a process called debayer-
ogy involved reversing the orientation of their current and future products, cameras ing. As the color filters block a certain
the pixel structure to present the light- with CMOS sensors are acknowledged as amount of light, fewer photons reach the
sensitive photodiode directly below the the better choice. photon-reactive area of the pixel. In addi-
microlenses. With this design the metal tion to the Bayer pattern on the sensors,
wiring structures no longer inhibit the Monochrome or color the IR-cut filter in color cameras presents
incident photons, improving the so-called For fluorescence applications, mono- a limiting factor because it blocks light
fill factor (the relation of the photoactive chrome cameras are usually preferred of approximately 650 to 700 nm upward
and nonphotoactive area) of the pixels because of the higher quantum efficiency. (Figure 3).
(Figure 1). The technical factor driving this dif- Typically, images with multiple fluores-
However, BSI sensors can have other ference is that in color cameras, Bayer cence markers for specific detection and
additional noise sources contributing microfilters on each pixel let only certain co-localization of molecules of interest
to the dark current. Dark current is the wavelengths pass through. This filtering are made from separate images using
leakage of electrons during exposure.
This can make these sensors less suitable
for longer exposure times. Furthermore,
state-of-the-art frontside-illuminated
(FSI) sensors can still be a better choice
in certain applications, showing excellent
performance also in low-light conditions
(Figure 2).
Beyond CCD and CMOS, a few ad-
ditional high-end sensor types are also
on the market, such as EMCCD (electron
multiplying CCD) and ICCD (intensified
CCD). However, these cameras are gener-
ally not considered for large products
today, as the technology is too expensive
and serves mostly niche applications.
CMOS technology will continue to
evolve in the years to come; fluorescence
microscopy can be expected to be domi- Figure 3. Because of red, green, and blue color filters on the pixels, the quantum efficiency is lower
nated by this state-of-the-art technology in a color camera compared to a monochrome camera. In addition, color cameras typically come
in the future, while further developments with an IR-cut filter blocking light of ~650 to 700 nm upward.
Figure 5. Comparison of the noise behavior (temporal dark noise) of Figure 6. Comparison of the noise behavior (with dark current noise) of
CCD and CMOS cameras with an exposure time of 10 ms. CCD and CMOS cameras with an exposure time of 4 s.
ferent pixels. It can be caused by the pixel the current state-of-the-art interfaces that have not found their way into series vision
electronics or by inconsistent tempera- are feasible for integration into fluores- products as yet.
tures over the sensor area. Standardized cence microscopy-based systems. For Integration of new standards typically
quantification measures of these noise both interfaces, vision standards are requires new accessories or peripherals,
types are the DSNU (dark signal nonuni- available that provide specifications de- which adds a delay in availability that can
formity), which describes the deviation veloped by leading camera manufacturers negatively affect time to market because
of generated electrons without any light to improve vision system design, effort, of the limited range of established prod-
signal, and the PRNU (photoresponse and performance for the camera integra- ucts.
nonuniformity), describing the pixel-to- tors.
pixel deviation at a certain light level. USB 3.2 Gen 1 is the common and Cooling
By setting cutoff values on pixel-to-pixel established plug-and-play interface of- The temperature of the sensor has a
deviations, one can further differentiate fering the easiest possible integration, central impact on dark current, which
and describe outlying pixels as defect enabling data rates of 380 MB/s (e.g., decreases the SNR and image quality —
pixels, such as hot pixels, that show high 75 fps at 5 MP) — sufficient for the especially when light signals are weak
gray values without a corresponding majority of applications and with cable and longer exposure times are required.
signal. Certain camera manufacturers lengths of up to a few meters, including Cooling of cameras is therefore an impor-
already correct defect pixels during qual- power supply, and also supporting mul- tant topic, but not necessarily mandatory
ity control by interpolation of neighboring ticamera integration. GigE is used when in fluorescence imaging. As cooling
pixels so integrators are not impaired by longer cable lengths and a more precise measures significantly affect the total cost
these artifacts. synchronization of multiple cameras is of ownership, the majority of cameras are
There are several different interfaces required. The bandwidth of GigE is 3.8× only passively cooled, which is already
on the market. To decide which interface slower (100 MB/s) than that of USB 3.0, sufficient for applications with strong
is required, one should look at the follow- but 5 GigE and 10 GigE are becoming fluorescence signals. Still, the design of
ing points, depending on the individual available in forms that enable higher these cameras has an impact on the sensor
application: data/image rate, cable length, data rates of 500 MB/s and 1000 MB/s. temperature.
standardization, integration effort, and For USB 3.0, new versions with up to Heat production should be avoided by
costs. The interface technologies USB 3.0 fourfold higher bandwidth have already designing the operation with low power
(renamed 3.2 Gen 1) and GigE represent been published as well. However, they consumption, and heat should be ef-
ficiently transported to the outside via the to improve image quality in low-light an increasingly used tool in the life sci-
internal hardware design (by the camera conditions. ences, making structures and processes
manufacturer) and through mounting One example is the defect pixel correc- visible. And because of the discontinu-
the camera to a further heat-dissipating tion. During the final testing procedures ation of this product group by Sony, the
carrier (by the camera integrator). For ac- at Basler AG, the camera is tested at dif- dominant global supplier, manufacturers
tive cooling of the sensor, thermoelectric ferent exposure times, and defect pixels in the medical and life sciences need to
(Peltier) elements are used, and normally are located and saved inside the camera’s replace the CCD cameras integrated in
an integrated fan removes the heat that is cache. In operation mode, the values of their instruments. Providing excellent
generated by the Peltier element. The fan defect pixels can be interpolated by the performance at reasonable prices, un-
also helps to prevent condensation on or weighted sum of the neighbor pixels. This cooled cameras with CMOS sensors can
freezing of camera parts when their tem- helps improve image quality and SNR. be the right choice.
peratures are below ambient. If vibrations Another firmware feature is called
(which can arise from the fan) need to be “long exposure mode.” In this mode, the Meet the author
prevented in the system, some cameras camera produces less heat during expo- Felix Asche, Ph.D., is product market manager
can even be water-cooled. The longer sure and thereby runs at a lower internal for the Basler AG MED ace camera series.
the exposure time, the lower the cooling sensor temperature, enabling a lower After studying biology, he completed his
needs to be. Due to these variabilities, it is noise level. The feature also compensates doctorate at the Bernhard Nocht Institute for
not possible to list concisely the condi- for sensor glow. In conclusion, checking Tropical Medicine; he then worked for a lead-
tions of the applications at which cooling the availability of firmware features in ing diagnostics manufacturer as product man-
measures are actually required. But for the manufacturer’s documentation may be ager in the area of clinical chemistry for the
many applications it can be assumed that helpful for finding the right fluorescence D/A/CH (Germany, Austria, and Switzerland)
up to levels of several seconds, the noise camera. region. Before joining Basler in 2016, he was
caused by the dark current of modern The current CMOS sensor generations a product manager in the area of automation
high-quality CMOS sensors does not have make applications possible that were for- for seven years for a leading German global
a significant negative influence. merly impossible without the investment manufacturer of medical lab diagnostics.
Beyond the summarized hardware and of multiple thousands of euros in a CCD
sensor specifications, cameras can pro- camera. These new possibilities become
vide firmware features that are designed more important as fluorescence becomes
A
surgeon removing a malignant photon counting using sensitive single- to record the activity of individual cells
tumor1, a security agent detecting pixel photodetectors. Consequently, free deep inside the living murine cortex,
harmful molecules at a stadium2, and open-source software recently de- with minimal perturbation to the imaged
an autonomous car avoiding a collision3, veloped for neuroscientific research may animal. Although TPLSM has become
a weather satellite spotting hurricane find its way to assisting clinicians and the gold standard for imaging under these
formations4, a neuroscientist tracking researchers in otherwise unrelated fields. challenging conditions, overcoming exist-
neuronal activity deep within the brain5 Functional imaging at the cellular level ing trade-offs inherent with this technique
— all of these situations involve quickly in the living brain is commonly achieved will expand the scope of the scientific
identifying small optical signals buried with two-photon laser-scanning micros- questions that could be asked.
within a large noisy volume. Efforts copy (TPLSM), which enables research- In particular, as a point-scanning
made by many to achieve this difficult ers to face the challenges imposed by technique, TPLSM forces microscopists
goal have led to a “convergent evolution” scattering of turbid media6. For example, to balance between imaging rate (pixel
toward a common solution: time-tagged using this technique, researchers are able dwell time) and the size of the field of
References
1. S.R. Kantelhardt et al. (2016). In vivo multiphoton tomography and
fluorescence lifetime imaging of human brain tumor tissue. J Neu-
rooncol, Vol. 127, Issue 3, pp. 473-482.
2. A.C. Geiger et al. (2019). Sparse-sampling methods for hyperspectral
infrared microscopy. Proc SPIE, Image Sensing Technologies: Mate-
rials, Devices, Systems, and Applications VI, Vol. 10980, p. 1098016.
3. F. Zhang et al. (2017). Adaptive strategy for CPPM single-photon
collision avoidance LIDAR against dynamic crosstalk. Opt Express,
Vol. 25, Issue 11, pp. 12237-12250.
4. T. Markus et al. (2017). The ice, cloud, and land elevation satellite-2
(ICESat-2): science requirements, concept, and implementation.
Remote Sens Environ, Vol. 190, pp. 260-273.
5. H. Har-Gil et al. (2018). Pysight: plug and play photon counting for
fast continuous volumetric intravital microscopy. Optica, Vol. 5,
Issue 9, pp. 1104-1112.
6. N. Ji et al. (2016). Technologies for imaging neural activity in large
volumes. Nat Neurosci, Vol. 19, pp. 1154-1164.
7. S. Moon et al. (2008). Analog single-photon counter for high-speed
scanning microscopy. Opt Express, Vol. 16, Issue 18, pp. 13990-
14003.
8. W. Becker, ed. (2015). Advanced Time-Correlated Single Photon
Counting Applications. Springer Series in Chemical Physics,
Vol. 111.
9. M. Alemohammad et al. (2018). Widefield compressive multiphoton
microscopy. Opt Lett, Vol. 43, Issue 12, pp. 2989-2992.
10. S. Wang et al. (2019). Polymerization-enhanced two-photon
photosensitization for precise photodynamic therapy. ACS Nano,
Vol. 13, Issue 3, pp. 3095-3105.
Sections include:
$69
▪ Optical Coherence
Tomography
330 pages, 48 articles
▪ Photoacoustic Imaging
▪ Optical Spectroscopy
▪ Fluorescence
Microscopy
▪ Multiphoton Microscopy
▪ Superresolution
Microscopy
www.photonics.com/store
Cytometry System ▶
The Aurora advanced-flow cytometry system
from Cytek Biosciences Inc. is now available
with five lasers, enabling users to see more
than 30 colors from a single sample. The system
provides ease of use, a high performance-to-
price ratio, design flexibility in experiments, and Solar Cell Research Equipment ▲
high-quality data. Optical filters do not need to The Academic Research Line of solar cell
be changed, and use of any fluorochromes are printing, testing, and imaging equipment
excited by the onboard lasers. Going beyond 30 from infinityPV APS provides a framework
colors opens the door to simplified workflows, for research within organic and perovskite
large cost savings, and access to a greater solar cells. The Research Laboratory Coater
choice of dyes and specificities for applications (RLC), the UV-LED ISOSun SMU, and the Aca-
that require deep profiling of cell populations demic LBIC can be operated on the desktop,
in a single sample. Applications include im- in a fume cupboard, or in a glovebox. The
munology, immuno-oncology, leukemia and systems are upward compatible, and it is
lymphoma labs, cancer/stem cell research, and possible to upgrade the basic system to the
extracellular vesicle research. most advanced version at any given point.
products@cytekbio.com info@infinitypv.com
Street address:
Laurin Publishing
100 West Street
Pittsfield, MA 01201
Voice: +1 413-499-0514
Fax: +1 413-442-3180
advertising@photonics.com
Fax: +1 413-445-4829
circulation@photonics.com
A team of Princeton University biologists and engineers led by Zemer Gitai bioengineered a real-time bacteria speedometer by linking a flow-detecting gene
in Pseudomonas aeruginosa to one for illumination: The faster the flow, the brighter the glow. They discovered that flow detection occurs independent of force,
prompting new questions about how bacteria sense their environments. Courtesy of Matilda Luk/Princeton University Office of Communications.
high resolution
5120 x 5120 pixel
true charge domain
global shutter
appropriate for
long exposure times
deep cooled
down to -20° C
compact
design
oSPIM diSPIM
Oblique Single Plane Dual Inverted Selective
Illumination Microscope Plane Illumination
Microscope
CRISP
PZ-2000FT Series Autofocus
Automated Stage with System
Piezo Z-Axis Top Plate
Oblique Single Plane Dual Inverted Selective Plane PZ-2000FT SERIES Automated Stage CRISP Autofocus System
Illumination Microscope (oSPIM) Illumination Microscopy (diSPIM) with Piezo Z-Axis Top Plate The CRISP substantially eliminates
The oSPIM is an excellent platform The diSPIM is an extremely cell-friendly The PZ2000-FT Stage is a perfect solution focus drift in high-power microscopy
for light sheet imaging of samples in method for imaging live specimens as it for your super resolution microscopy applications by sensing minute changes
standard culture dishes. The light sheet is only illuminates the region of the sample applications. The stage is capable of XY between the objective lens and the
generated using the inverted microscope that is being captured and minimizes resolutions down to the 10-20 nm range specimen’s cover slip. It also allows a
and imaged from above using a tilted phototoxicity and photobleaching by and Z resolutions to the 1nm range. specimen to remain accurately focused
water dipping objective with NA as high ~7-10 fold compared to confocal based It is also capable for use with rapid for hours at a time with an accuracy of
as 1.1 (<300 nm transverse resolution). systems. It also provides acquisition rates z-sectioning and autofocus systems. 5% of the objective depth of focus and
The inverted microscope is also available up to 200 images per second (2-5 volumes maintains focus while scanning in XY.
for conventional imaging modalities per second) with isotropic resolution of
(e.g. confocal, wide field, or TIRF) 330 nm resolution with Nikon 40X NA 0.8.
Visit us at the Society for Neuroscience 2019 Annual Meeting | October 19th – 23rd | Chicago, IL | Booth 855
www.asiimaging.com | info@asiimaging.com | (800) 706-2284 or (541) 461-8181
Follow us on: Facebook.com/ASIImaging | @ASIImaging