Development of a High-speed Super-resolution Confocal Scanner

Similar documents
Point Spread Function. Confocal Laser Scanning Microscopy. Confocal Aperture. Optical aberrations. Alternative Scanning Microscopy

INTRODUCTION TO MICROSCOPY. Urs Ziegler THE PROBLEM

High-speed 1-frame ms scanning confocal microscope with a microlens and Nipkow disks

Introduction to light microscopy

Introduction to light microscopy

Bio 407. Applied microscopy. Introduction into light microscopy. José María Mateos. Center for Microscopy and Image Analysis

5/4/2015 INTRODUCTION TO LIGHT MICROSCOPY. Urs Ziegler MICROSCOPY WITH LIGHT. Image formation in a nutshell. Overview of techniques

3D light microscopy techniques

6/3/15. The Anatomy of a Digital Image. Representative Intensities. Specimen: (molecular distribution)

Shreyash Tandon M.S. III Year

Confocal and 2-photon Imaging. October 15, 2010

Supplementary Information. Stochastic Optical Reconstruction Microscopy Imaging of Microtubule Arrays in Intact Arabidopsis thaliana Seedling Roots

MOM#3: LIGHT SHEET MICROSCOPY (LSM) Stanley Cohen, MD

Instant super-resolution imaging in live cells and embryos via analog image processing

Development of a new multi-wavelength confocal surface profilometer for in-situ automatic optical inspection (AOI)

Introduction to light microscopy

Introduction to light microscopy

Practical Flatness Tech Note

Opterra II Multipoint Scanning Confocal Microscope. Innovation with Integrity

Invitation for a walk through microscopy. Sebastian Schuchmann Jörg Rösner

Digital Camera Technologies for Scientific Bio-Imaging. Part 2: Sampling and Signal

Basics of confocal imaging (part I)

Confocal Microscopy. Kristin Jensen

Maria Smedh, Centre for Cellular Imaging. Maria Smedh, Centre for Cellular Imaging

Technology Note ZEISS LSM 880 with Airyscan

BASICS OF CONFOCAL IMAGING (PART I)

Light Microscopy. Upon completion of this lecture, the student should be able to:

Confocal Microscopy. (Increasing contrast and resolu6on using op6cal sec6oning) Lecture 7. November 2017

Why and How? Daniel Gitler Dept. of Physiology Ben-Gurion University of the Negev. Microscopy course, Michmoret Dec 2005

Microscopy. CS/CME/BioE/Biophys/BMI 279 Nov. 2, 2017 Ron Dror

Final Exam, 150 points PMB 185: Techniques in Light Microscopy

TRAINING MANUAL. Multiphoton Microscopy LSM 510 META-NLO

Examination, TEN1, in courses SK2500/SK2501, Physics of Biomedical Microscopy,

EUV microscopy - a user s perspective Dimitri Scholz EUV,

3D light microscopy techniques

Confocal Microscopy and Related Techniques

Precision-tracking of individual particles By Fluorescence Photo activation Localization Microscopy(FPALM) Presented by Aung K.

Resolution. Diffraction from apertures limits resolution. Rayleigh criterion θ Rayleigh = 1.22 λ/d 1 peak at 2 nd minimum. θ f D

Imaging Retreat - UMASS Customized real-time confocal and 2-photon imaging

An opening a = λ would put the first minima at θ = 90

Test procedures Page: 1 of 5

Operation Guide for the Leica SP2 Confocal Microscope Bio-Imaging Facility Hunter College October 2009

VISUAL PHYSICS ONLINE DEPTH STUDY: ELECTRON MICROSCOPES

Application Note. The New 2D Superresolution Mode for ZEISS Airyscan 120 nm Lateral Resolution without Acquiring a Z-stack

Administrative details:

Reflecting optical system to increase signal intensity. in confocal microscopy

Katarina Logg, Kristofer Bodvard, Mikael Käll. Dept. of Applied Physics. 12 September Optical Microscopy. Supervisor s signature:...

III III 0 IIOI DID IIO 1101 I II 0II II 100 III IID II DI II

Microscopic Structures

ANSWER KEY Lab 2 (IGB): Bright Field and Fluorescence Optical Microscopy and Sectioning

FLUORESCENCE MICROSCOPY. Matyas Molnar and Dirk Pacholsky

Opterra. Multipoint Scanning Confocal Microscope. Innovation with Integrity. Cell-Friendly, High-Speed, High-Resolution Imaging

High resolution extended depth of field microscopy using wavefront coding

SETTING UP OF A TOTAL INTERNAL REFLECTION FLUORESCENT MICROSCOPE (TIRFM) SYSTEM: A DETAILED OVERVIEW

Nature Methods: doi: /nmeth Supplementary Figure 1. Schematic of 2P-ISIM AO optical setup.

D2.1 Operating 2D STED Microscope

Light microscopy BMB 173, Lecture 14, Feb. 21, 2018

IC 2 S High Performance Objectives

Applications of Optics

Education in Microscopy and Digital Imaging

Training Guide for Leica SP8 Confocal/Multiphoton Microscope

Multiphoton Microscopy

Travel to New Dimensions- LSM 880. The Resolution of a Microscope is limited. The Resolution of a Microscope is limited. Image. Image. Object.

Akinori Mitani and Geoff Weiner BGGN 266 Spring 2013 Non-linear optics final report. Introduction and Background

Fundamentals of Light Microscopy II: Fluorescence, Deconvolution, Confocal, Multiphoton, Spectral microscopy. Integrated Microscopy Course

Enhancement of the lateral resolution and the image quality in a line-scanning tomographic optical microscope

Chapter 2 The Study of Microbial Structure: Microscopy and Specimen Preparation

Rapid Adaptive Optical Recovery of Optimal Resolution over Large Volumes

More fancy SPIM, Even fancier SPIM

Rates of excitation, emission, ISC

Multi-channel imaging cytometry with a single detector

Supplementary Figure S1. Schematic representation of different functionalities that could be

Circular Dichroism Microscopy Free from Commingling Linear Dichroism via Discretely Modulated Circular Polarization

Supplementary Figure 1. Effect of the spacer thickness on the resonance properties of the gold and silver metasurface layers.

Single-photon excitation of morphology dependent resonance

NanoSpective, Inc Progress Drive Suite 137 Orlando, Florida

Confocal, hyperspectral, spinning disk

Fabrication of Probes for High Resolution Optical Microscopy

Femtosecond laser microfabrication in. Prof. Dr. Cleber R. Mendonca

S200 Course LECTURE 1 TEM

Advanced Optical Microscopy lecture. 03. December 2012 Kai Wicker

Heisenberg) relation applied to space and transverse wavevector

Lab4 Hanbury Brown and Twiss Setup. Photon Antibunching

Fast, high-contrast imaging of animal development with scanned light sheet based structured-illumination microscopy

Microscopy Live Animal Imaging

Multicolor 4D Fluorescence Microscopy using Ultrathin Bessel Light sheets

Optics and Lasers. Matt Young. Including Fibers and Optical Waveguides

Flatness of Dichroic Beamsplitters Affects Focus and Image Quality

:... resolution is about 1.4 μm, assumed an excitation wavelength of 633 nm and a numerical aperture of 0.65 at 633 nm.

HOW MY 1983 IDEA FOR A SUPER-RESOLVING SINGLE-MOLECULE FLUORESCENCE MICROSCOPE INDEPENDENTLY WON THE 2014 NOBEL PRIZE IN CHEMISTRY

Advanced Optical Microscopy

This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore.

Confocal Imaging Through Scattering Media with a Volume Holographic Filter

Microscopy. The dichroic mirror is an important component of the fluorescent scope: it reflects blue light while transmitting green light.

Improving the Collection Efficiency of Raman Scattering

Microscopy. Matti Hotokka Department of Physical Chemistry Åbo Akademi University

Bi/BE 227 Winter Assignment #3. Adding the third dimension: 3D Confocal Imaging

Lecture 23 MNS 102: Techniques for Materials and Nano Sciences

Εισαγωγική στην Οπτική Απεικόνιση

Introduction to Light Microscopy. (Image: T. Wittman, Scripps)

Transcription:

Development of a High-speed Super-resolution Confocal Scanner Takuya Azuma *1 Takayuki Kei *1 Super-resolution microscopy techniques that overcome the spatial resolution limit of conventional light microscopy have been developed and are increasingly used for advanced research in various fields including cell biology. However, their temporal resolution is still low, so it is difficult to observe the dynamic behaviors of living cells. Furthermore, these existing techniques have restrictions on the dyes that can be used and the specimens that can be observed. Therefore, there is an increasing need for a versatile super-resolution microscopy technique that can visualize the fine structures of living cells with high temporal resolution. To meet this need, Yokogawa has developed a high-speed super-resolution confocal scanner based on its confocal scanner unit (CSU), which is proven to be ideal for observing living cells. This paper outlines the technologies implemented in this new scanner and its applications. INTRODUCTION In the 19th century, Ernst Abbe, a German physicist, found that the spatial resolution (ability to distinguish two nearby microstructures as separate objects) of optical microscopes has a theoretical limit due to the wave nature of light (diffraction limit). Ever since, it has been believed that optical microscopes using visible light cannot observe structures smaller than about 200 nm. Recently, however, innovations in optics and the clever use of the characteristics of fluorescent dyes have led to multiple technologies for super-resolution microscopy that enable high spatial resolution beyond the diffraction limit (1)(2)(3)(4). With a limited spatial resolution, conventional optical microscopes are barely able to observe the distribution of cell organella. In contrast, super-resolution microscopes can observe the fine structures of these organella. In 2014, three pioneering physicists in super-resolution microscopy technologies were awarded the Nobel Prize in Chemistry. Their technologies enhanced the use of super-resolution microscopes in a wide range of fields, including cell biology. As technology develops, the scope of research in cell biology is expanding from fixed cells to living cells, and there is an increasing need to observe fine objects such as cell organella and to localize proteins. Yokogawa released the CSU10 confocal scanner unit with a microlens-enhanced Nipkow disk in 1996. Since then, the CSU series has been used *1 R&D Department, Life Science Center, Measurement Business Headquarters in many research institutes worldwide, and has contributed greatly to the development of biology. Meanwhile, based on the technologies implemented in the CSU, Yokogawa has developed a high-speed super-resolution confocal scanner that enables leading researchers to observe the dynamic behaviors of living cells in detail at high speed. SUPER-RESOLUTION MICROSCOPE TECHNOLOGIES Super-resolution technologies today are categorized into three major types: single molecule localization microscopies (PALM and STORM) (1)(3), stimulated emission depletion microscopy (STED) (2), and structured illumination microscopy (SIM) (4). In single molecule localization microscopy, fluorescent molecules in a sample are located sequentially with a precision of several tens of nanometers, and the data is used to construct a super-resolution image. This method features high spatial resolution close to that of electron microscopy. However, several thousand to several ten thousand images must be captured to locate all fluorescent molecules. Therefore, the temporal resolution (the minimum interval between two measurements) is low; it typically takes a few minutes to several dozen minutes. Thus, this method is not suited for observing living cells that keep moving, and is used mainly for fixed samples. In addition, the method is not versatile because it needs special fluorescent dyes with controllable photoactivities. In stimulated emission depletion microscopy, the first laser pulse excites fluorescent molecules, and the second pulse from another laser selectively depletes the fluorescence 33 Yokogawa Technical Report English Edition Vol. 60 No. 2 (2017) 85

r Development of a High-speed Super-resolution Confocal Scanner of molecules surrounding the excitation focal spot by stimulated emission with the center focal spot left active to emit fluorescence. As a result, fluorescence is limited to each focal spot that is smaller than the diffraction limit. These focal spots are raster scanned across the sample to generate a superresolution image. This method delivers a spatial resolution of several tens of nanometers, but the temporal resolution is low; it takes a few seconds to a few minutes. In addition, the method needs special dyes with high stimulated emission efficiency. Phototoxicity and bleaching due to the irradiation by intense laser pulses are also problematic. Thus, this method is not suited for observing living cells, either. In structured illumination microscopy, a sample is illuminated by excitation light having stripe patterns. Multiple images are captured with the directions and phases of the stripe pattern varied, and the data is used to generate a superresolution image. This method achieves a spatial resolution of about 100 nm and a temporal resolution of about 1 second. However, the temporal resolution is still not satisfactory for studying the dynamic behaviors of living cells. In addition, the method is not suited for 3D observation of thick cell tissues. As described above, each method is not practical for the 3D observation of living cells and tissues. Therefore, a new super-resolution microscope technology has been awaited. HIGH-SPEED SUPER-RESOLUTION CONFOCAL SCANNER To meet this need, Yokogawa has developed a high-speed super-resolution confocal scanner based on the technologies of the CSU, which has been used as the standard tool for observing living cells. The principle, configuration, and results of a performance evaluation of the scanner are outlined below. Principle The imaging characteristic of an optical microscope is expressed by a point spread function, which represents the image of an infinitely small point after passing through the microscope. The distribution of the point spread function, called Airy disk, arises from the diffraction of light (Figure 1). The left part of Figure 1 shows the intensity distribution of an Airy disk on the focal plane, and the right part shows the cross-sectional intensity distribution along the optical axis. Figure 2 schematically shows the optical system of a confocal microscope. For simplicity, the illuminating and imaging optics are drawn separately. The image I p(r, s), which obtained at the position r+s on the pinhole plane when the confocal scanning point is at r, is expressed by Equation (1), where E is the point spread function for the illuminating optics, U is the point spread function for the imaging optics, and c is the sample distribution function. Point light source r Illuminating optics Objective lens Point spread function for the illuminating optics E Figure 2 Confocal optical system Figure 3 shows the point spread functions. The point spread function for the illuminating optics has the peak of the Airy disk at the position r, while the point spread function for the imaging optics has the peak at the position r+s. The effective point spread function for a confocal optics is the product of the point spread functions for the illuminating optics and the imaging optics. For simplicity, the two point spread functions are assumed to have the same shape. In this case, the effective point spread function has its peak at the mid point between the two peaks, r+s/2, as shown in Figure 3. Therefore, the image I p(r, s) is considered to be most probably coming from the position r+s/2 on the sample plane. In the conventional method, the image I p(r, s) is imaged and recorded at the position r+s on an imaging element. Thus, the image on the imaging element is shifted by s/2 from the most probable point, r+s/2, on the sample plane. This deteriorates the spatial resolution. Point spread function for the illuminating optics Sample plane Sample distribution function c Imaging optics Objective lens Pinhole plane r + s Point spread function for the imaging optics U Point spread function for the imaging optics (1) Effective point spread function r+s r+s/2 Figure 3 Effective point spread function Figure 1 Airy disk Therefore, it is beneficial to shift the imaging point of I p(r, s) from r+s to r+s/2 on the imaging element (5). In other 86 Yokogawa Technical Report English Edition Vol. 60 No. 2 (2017) 34

words, the imaging point on the imaging element, r+s, in the conventional method is shifted by -s/2. In this case, the image I c(r) on the imaging element obtained by scanning the sample plane is expressed by: From Equation (2), the effective point spread function after shifting the imaging point,, is expressed by: By Fourier-transforming Equation (3), the optical transfer function (k) is obtained: where, k is the spatial frequency vector, and,, and are Fourier transforms of T c, U, and E, respectively. The image I c(r) has a two times wider spatial frequency band than the image from a conventional microscope whose optical transfer function is (k). However, high-frequency components in (k) are attenuated as compared to those in (k/2), which is the optical transfer function corresponding to the case of doubled spatial resolution. Therefore, the apparent improvement in spatial resolution is only 2 times in the images obtained in this way. When a deconvolution process is applied to the original images to restore the highfrequency components, it is possible to obtain super-resolution images with about two times higher spatial resolution than the diffraction limit. Configuration The principle described above is applied to the CSU. Figure 4 shows the configuration of the same optical system implemented in the high-speed super-resolution confocal scanner (6). The confocal scanner employs the confocal scanning method with two spinning disks, each of which has a pinhole array and a microlens array, as in the existing CSUs (7)(8)(9). A major difference from the existing units is the second microlens array on the back of the pinhole array. These microlenses are designed to double the convergence angle of the incident light from the sample (see the inset in Figure 4), which has the effect of optically shifting the imaging point on the pinhole plane by s/2 toward the pinhole center. Since an image is captured by the imaging element after being optically shifted at each pinhole, the captured image features super resolution with a doubled spatial frequency bandwidth. Moreover, by rotating the disks at 4000 rpm, the superresolution images can be captured at a rate of up to 1/200 sec. This method enables easy-to-use microscopes for real-time observation of super-resolution images, and is expected to improve the efficiency of experiments. In addition, this method works well with any fluorescent (2) (3) (4) dye, and is suited for 3D observation of thick cell tissues thanks to its capability of obtaining optical tomographic images using the confocal effect. Thus, this method outperforms other super-resolution microscopies in terms of versatility. In this configuration, a pinhole array and microlens arrays are formed in an integrated manner on a disk. This integrated structure ensures high machining accuracy and thus generates high-quality super-resolution images. The integrated structure also ensures high stability and robustness at the same level as the CSUs. Imaging element Figure 4 Configuration of optical system Performance Evaluation Figure 5 shows the results of evaluating the spatial resolution of a conventional epifluorescence system and a prototype of the high-speed super-resolution confocal scanner. Fluorescent beads with a diameter of 100 nm were scattered on a sample plate, which was then set on a microscope and excited by a laser with a wavelength of 488 nm. Images of fluorescent beads were taken with an oil immersion objective lens of 100 magnification (numerical aperture: 1.4). The full-width at halfmaximum of each brightness profile was measured for all point images, from which the spatial resolution was calculated. Spatial resolution [nm] Dichroic mirror Relay lens Fluorescence filter θ 2θ Epifluorescence system Excitation light Imaging lens Figure 5 Evaluation of spatial resolution The spatial resolution of the image obtained by the epifluorescence system was about 220 nm. In contrast, that Spindle motor Objective lens Sample Before deconvolution Confocal scanner Microlens array Pinhole array Second microlens array After deconvolution High-speed super-resolution confocal scanner 35 Yokogawa Technical Report English Edition Vol. 60 No. 2 (2017) 87

Development of a High-speed Super-resolution Confocal Scanner of the images obtained by the high-speed super-resolution confocal scanner was about 160 nm before deconvolution (about 40% higher than that of the conventional system) and about 110 nm after deconvolution (two times higher). Images of fiber-like microtubules with a diameter of about 25 nm were also taken by both devices. Figure 6(A) shows images taken by a conventional epifluorescence system, and Figure 6(B) shows images taken by the high-speed superresolution confocal scanner. In each figure, images before deconvolution (left) and after deconvolution (right) are shown. The profile of part of each image where two microtubules are close to each other (indicated by the yellow line) is shown in Figure 6(C). The two microtubules at the positions 350 nm and 540 nm were clearly distinguished by the high- speed super-resolution confocal scanner while they were not recognized separately by the epifluorescence system. From the results above, we confirmed that our high-speed super-resolution confocal scanner can depict microstructures of living organisms, which are beyond the diffraction limit and cannot be seen by conventional optical microscopes. Figure 7 shows images of mitochondria in a living cell. The upper part is the whole image and the lower part is images of the area enclosed by a yellow rectangle, successively taken at 1/10 second intervals. These images show that our highspeed super-resolution confocal scanner can observe the fine structure of mitochondria at a temporal resolution of more than an order of magnitude higher than existing super-resolution microscopy technologies. 1 µm Before deconvolution 10 µm After deconvolution (A) Epifluorescence images Before deconvolution After deconvolution (B) High-speed super-resolution confocal scanner images Epifluorescence system (before deconvolution) Relative brightness 1 Epifluorescence system (after deconvolution) 0.8 High-speed super-resolution confocal scanner (before deconvolution) 0.6 High-speed super-resolution confocal scanner (after deconvolution) 0.4 0.2 0 0 200 400 600 800 1000 Distance [nm] (C) Resolution profiles Figure 7 Images of mitochondria (Imaging was guided by Dr. Kaoru Katoh, Ph.D., Molecular Neurobiology Group, Neuroscience Research Institute, National Figure 6 Evaluation of spatial resolution 88 Institute of Advanced Industrial Science and Technology) Yokogawa Technical Report English Edition Vol. 60 No. 2 (2017) 36

CONCLUSION This paper outlined Yokogawa s commitment to developing super-resolution microscopy technologies that overcome the limit of spatial resolution. Electron microscopes are adequate for observing the microstructures of fixed cells, but cannot clarify the dynamics of life. Optical microscopes have significant advantages that electron microscopes do not have: living cells can be observed and a number of fluorescent probes are available for visualizing life phenomena. Preferably, these advantages should also be retained in super-resolution microscopy technologies. The high-speed super-resolution confocal scanner developed by Yokogawa has spatial and temporal resolutions that enable detailed observation of the dynamic behaviors of living cells, and its versatility allows various samples and fluorescent probes to be used. Thus, Yokogawa s technology is ideal for observing the details of dynamic life phenomena, making the best use of the advantages of optical microscopes. Yokogawa will expedite commercialization of the high-speed super-resolution confocal scanner, and will contribute to the study of life phenomena as well as research and development in the fields of drug discovery and medical treatment. REFERENCES (1) W. E. Moerner, L. Kador, Optical detection and spectroscopy of single molecules in a solid, Physical Review Letters, Vol. 62, No. 21, 1989, pp. 2535-2538 (2) S.W. Hell, J. Wichmann, Breaking the diffraction resolution limit by stimulated emission: stimulated-emission-depletion fluorescence microscopy, Optics Letters, Vol. 19, Issue 11, 1994, pp. 780-782 (3) E. Betzig, G. H. Patterson, et al., Imaging Intracellular Fluorescent Proteins at Nanometer Resolution, Science, Vol. 313, Issue 5793, 2006, pp. 1642-1645 (4) M. G. L. Gustafsson, Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy, Journal of Microscopy, Vol. 198, No. 2, 2000, pp. 82-87 (5) C. J. R. Sheppard, Super-resolution in confocal imaging, Optik, Vol. 80, Issue 2, 1988, pp. 53-54 (6) T. Azuma, T. Kei, Super-resolution spinning-disk confocal microscopy using optical photon reassignment, Optics Express, Vol. 23, Issue 11, 2015, pp. 15003-15011 (7) Takeo Tanaami, Yumiko Sugiyama, et al., High-speed Confocal Laser Microscopy Yokogawa Technical Report English Edition, No. 19, 1994, pp. 7-10 (8) Shin-ichiro Kawamura, Hideomi Negishi, et al., Confocal Laser Microscope Scanner and CCD Camera, Yokogawa Technical Report English Edition, No. 33, 2002, pp. 17-20 (9) Hideo Hirukawa, Hiroshi Nakayama, et al., New Technologies for CSU-X1 Confocal Scanner Unit, Yokogawa Technical Report English Edition, No. 45, 2008, pp. 21-26 * CSU is a registered trademark of Yokogawa Electric Corporation. 37 Yokogawa Technical Report English Edition Vol. 60 No. 2 (2017) 89

90 Yokogawa Technical Report English Edition Vol. 60 No. 2 (2017) 38