{"id":278,"date":"2016-08-13T13:46:25","date_gmt":"2016-08-13T17:46:25","guid":{"rendered":"https:\/\/sites.bu.edu\/tianlab\/?page_id=278"},"modified":"2022-08-23T19:51:49","modified_gmt":"2022-08-23T23:51:49","slug":"digital-holographic-imaging","status":"publish","type":"page","link":"https:\/\/sites.bu.edu\/tianlab\/publications\/digital-holographic-imaging\/","title":{"rendered":"Digital Holographic Imaging"},"content":{"rendered":"<p><a href=\"https:\/\/www.nature.com\/articles\/s41377-022-00730-x\"><strong>Adaptive 3D descattering with a dynamic synthesis network<\/strong><\/a><br \/>\nWaleed Tahir, Hao Wang, Lei Tian<br \/>\n<em><strong>Light: Science &amp; Applications<\/strong><\/em>\u00a011, 42, 2022<\/p>\n<p><strong><span><span style=\"color: #993300;\"><span style=\"color: #0000ff;\">\u2b51<\/span><em>\u00a0<\/em><\/span><\/span><a href=\"https:\/\/github.com\/bu-cisl\/DynamicSyntesisNetwork\">Github Project<\/a><\/strong><\/p>\n<p>Deep learning has been broadly applied to imaging in scattering applications. A common framework is to train a &#8220;descattering&#8221; neural network for image recovery by removing scattering artifacts. To achieve the best results on a broad spectrum of scattering conditions, individual &#8220;expert&#8221; networks have to be trained for each condition. However, the performance of the expert sharply degrades when the scattering level at the testing time differs from the training. An alternative approach is to train a &#8220;generalist&#8221; network using data from a variety of scattering conditions. However, the generalist generally suffers from worse performance as compared to the expert trained for each scattering condition. Here, we develop a drastically different approach, termed dynamic synthesis network (DSN), that can dynamically adjust the model weights and adapt to different scattering conditions. The adaptability is achieved by a novel architecture that enables dynamically synthesizing a network by blending multiple experts using a gating network. Notably, our DSN adaptively removes scattering artifacts across a continuum of scattering conditions regardless of whether the condition has been used for the training, and consistently outperforms the generalist. By training the DSN entirely on a multiple-scattering simulator, we experimentally demonstrate the network&#8217;s adaptability and robustness for 3D descattering in holographic 3D particle imaging. We expect the same concept can be adapted to many other imaging applications, such as denoising, and imaging through scattering media. Broadly, our dynamic synthesis framework opens up a new paradigm for designing highly adaptive deep learning and computational imaging techniques.<\/p>\n<p><img loading=\"lazy\" src=\"\/tianlab\/files\/2021\/07\/DSN-636x219.png\" alt=\"\" width=\"636\" height=\"219\" class=\"size-medium wp-image-1717 aligncenter\" srcset=\"https:\/\/sites.bu.edu\/tianlab\/files\/2021\/07\/DSN-636x219.png 636w, https:\/\/sites.bu.edu\/tianlab\/files\/2021\/07\/DSN-1024x353.png 1024w, https:\/\/sites.bu.edu\/tianlab\/files\/2021\/07\/DSN-768x264.png 768w, https:\/\/sites.bu.edu\/tianlab\/files\/2021\/07\/DSN-1536x529.png 1536w, https:\/\/sites.bu.edu\/tianlab\/files\/2021\/07\/DSN.png 1699w\" sizes=\"(max-width: 636px) 100vw, 636px\" \/><\/p>\n<p><a href=\"https:\/\/www.osapublishing.org\/oe\/fulltext.cfm?uri=oe-29-22-35078&amp;id=460496\"><strong>Roadmap on digital holography<br \/>\n<\/strong><\/a>Bahram Javidi, Artur Carnicer, Arun Anand, George Barbastathis, Wen Chen, Pietro Ferraro, J. W. Goodman, Ryoichi Horisaki, Kedar Khare, Malgorzata Kujawinska, Rainer A. Leitgeb, Pierre Marquet, Takanori Nomura, Aydogan Ozcan, YongKeun Park, Giancarlo Pedrini, Pascal Picart, Joseph Rosen, Genaro Saavedra, Natan T. Shaked, Adrian Stern, Enrique Tajahuerce, <strong>Lei Tian<\/strong>, Gordon Wetzstein, and Masahiro Yamaguchi<br \/>\n<em><strong>Optics Express<\/strong><\/em> Vol. 29, Issue 22, pp. 35078-35118 (2021).<\/p>\n<p xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\">This Roadmap article on digital holography provides an overview of a vast array of research activities in the field of digital holography. The paper consists of a series of 25 sections from the prominent experts in digital holography presenting various aspects of the field on sensing, 3D imaging and displays, virtual and augmented reality, microscopy, cell identification, tomography, label-free live cell imaging, and other applications. Each section represents the vision of its author to describe the significant progress, potential impact, important developments, and challenging issues in the field of digital holography.<\/p>\n<p><a href=\"https:\/\/www.osapublishing.org\/oe\/fulltext.cfm?uri=oe-29-11-17159&amp;id=451212\"><strong>Large-scale holographic particle 3D imaging with the beam propagation model<\/strong><\/a><br \/>\nHao Wang, Waleed Tahir, Jiabei Zhu, Lei Tian<br \/>\n<em><strong>Opt. Express<\/strong><\/em>\u00a029<span>, 17159-17172 (2021)<\/span><\/p>\n<p><strong><span><span style=\"color: #993300;\"><span style=\"color: #0000ff;\">\u2b51<\/span><em>\u00a0<\/em><\/span><\/span><a href=\"https:\/\/github.com\/bu-cisl\/Large-Scale-3D-Holographic-Imaging-with-Beam-Propagation\">Github Project<\/a><\/strong><\/p>\n<p>We develop a novel algorithm for large-scale holographic reconstruction of 3D particle fields. Our method is based on a multiple-scattering beam propagation method (BPM) combined with sparse regularization that enables recovering dense 3D particles of high refractive index contrast from a single hologram. We show that the BPM-computed hologram generates intensity statistics closely matching with the experimental measurements and provides up to 9\u00d7 higher accuracy than the single-scattering model. To solve the inverse problem, we devise a computationally efficient algorithm, which reduces the computation time by two orders of magnitude as compared to the state-of-the-art multiple-scattering-based technique. We demonstrate superior reconstruction accuracy in both simulations and experiments under different scattering strengths. We show that the BPM reconstruction significantly outperforms the single-scattering method in particular for deep imaging depths and high particle densities.<\/p>\n<p><img loading=\"lazy\" src=\"\/tianlab\/files\/2021\/04\/BPM-DH-636x338.png\" alt=\"\" width=\"500\" height=\"266\" class=\"aligncenter wp-image-1625\" srcset=\"https:\/\/sites.bu.edu\/tianlab\/files\/2021\/04\/BPM-DH-636x338.png 636w, https:\/\/sites.bu.edu\/tianlab\/files\/2021\/04\/BPM-DH-768x409.png 768w, https:\/\/sites.bu.edu\/tianlab\/files\/2021\/04\/BPM-DH.png 780w\" sizes=\"(max-width: 500px) 100vw, 500px\" \/><\/p>\n<p><a href=\"https:\/\/doi.org\/10.1117\/1.AP.1.3.036003\"><strong>Holographic particle-localization under multiple scattering<\/strong><\/a><br \/>\nWaleed Tahir, Ulugbek S. Kamilov, Lei Tian<br \/>\n<em><strong>Advanced Photonics<\/strong><\/em>, 1(3), 036003 (2019).<\/p>\n<p><span>We introduce a computational framework that incorporates multiple scattering for large-scale three-dimensional (3-D) particle localization using single-shot in-line holography. Traditional holographic techniques rely on single-scattering models that become inaccurate under high particle densities and large refractive index contrasts. Existing multiple scattering solvers become computationally prohibitive for large-scale problems, which comprise millions of voxels within the scattering volume. Our approach overcomes the computational bottleneck by slicewise computation of multiple scattering under an efficient recursive framework. In the forward model, each recursion estimates the next higher-order multiple scattered field among the object slices. In the inverse model, each order of scattering is recursively estimated by a nonlinear optimization procedure. This nonlinear inverse model is further supplemented by a sparsity promoting procedure that is particularly effective in localizing 3-D distributed particles. We show that our multiple-scattering model leads to significant improvement in the quality of 3-D localization compared to traditional methods based on single scattering approximation. Our experiments demonstrate robust inverse multiple scattering, allowing reconstruction of 100 million voxels from a single 1-megapixel hologram with a sparsity prior. The performance bound of our approach is quantified in simulation and validated experimentally. Our work promises utilization of multiple scattering for versatile large-scale applications.<\/span><\/p>\n<p><img loading=\"lazy\" src=\"\/tianlab\/files\/2018\/08\/figure_7-636x348.png\" alt=\"\" width=\"636\" height=\"348\" class=\"size-medium wp-image-884 aligncenter\" srcset=\"https:\/\/sites.bu.edu\/tianlab\/files\/2018\/08\/figure_7-636x348.png 636w, https:\/\/sites.bu.edu\/tianlab\/files\/2018\/08\/figure_7-768x420.png 768w, https:\/\/sites.bu.edu\/tianlab\/files\/2018\/08\/figure_7-1024x560.png 1024w, https:\/\/sites.bu.edu\/tianlab\/files\/2018\/08\/figure_7.png 1378w\" sizes=\"(max-width: 636px) 100vw, 636px\" \/><\/p>\n<p><a href=\"https:\/\/www.osapublishing.org\/oe\/abstract.cfm?uri=oe-25-1-250\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Compressive holographic video<\/strong><\/a><br style=\"clear: both;\" \/>Zihao Wang, Leonidas Spinoulas, Kuan He, Lei Tian, Oliver Cossairt, Aggelos K. Katsaggelos, and Huaijin Chen<br style=\"clear: both;\" \/><em><strong>Opt. Express<\/strong><\/em>\u00a025<span>, 250-262 (2017)<\/span>.<\/p>\n<p><span>Compressed sensing has been discussed separately in spatial and temporal domains. Compressive holography has been introduced as a method that allows 3D tomographic reconstruction at different depths from a single 2D image. Coded exposure is a temporal compressed sensing method for high speed video acquisition. In this work, we combine compressive holography and coded exposure techniques and extend the discussion to 4D reconstruction in space and time from one coded captured image. In our prototype, digital in-line holography was used for imaging macroscopic, fast moving objects. The pixel-wise temporal modulation was implemented by a digital micromirror device. In this paper we demonstrate 10\u00d7 temporal super resolution with multiple depths recovery from a single image. Two examples are presented for the purpose of recording subtle vibrations and tracking small particles within 5 ms.<\/span><\/p>\n<p><img loading=\"lazy\" src=\"\/tianlab\/files\/2017\/01\/DHV.jpeg\" alt=\"dhv\" width=\"500\" height=\"241\" class=\"aligncenter wp-image-576 size-full\" \/><\/p>\n<p><strong><a href=\"http:\/\/www.opticsinfobase.org\/oe\/abstract.cfm?uri=oe-22-8-9774\" target=\"_blank\" rel=\"noopener noreferrer\">Compressive holographic two-dimensional localization with 1\/30<sup>2<\/sup> subpixel accuracy<br \/>\n<\/a><\/strong>Y. Liu, Lei Tian, C. Hsieh, G. Barbastathis<br \/>\n<span style=\"line-height: 1.5;\"><em><strong>Optics Express<\/strong><\/em> 22, 9774-9782 (2014).<\/span><\/p>\n<p>We propose the use of compressive holography for two\u2013dimensional (2D) subpixel motion localization. Our approach is based on computational implementation of edge\u2013extraction using a Fourier\u2013plane spiral phase mask, followed by compressive reconstruction of the edge of the object. Using this technique and relatively low\u2013cost computer and piezo motion stage to establish ground truth for the motion, we demonstrated localization within 1\/30th of a camera pixel in each linear dimension.<\/p>\n<p><img loading=\"lazy\" src=\"\/tianlab\/files\/2016\/08\/subpixel2D-636x341.png\" alt=\"subpixel2D\" width=\"450\" height=\"241\" class=\"aligncenter wp-image-128\" srcset=\"https:\/\/sites.bu.edu\/tianlab\/files\/2016\/08\/subpixel2D-636x341.png 636w, https:\/\/sites.bu.edu\/tianlab\/files\/2016\/08\/subpixel2D.png 1024w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/p>\n<p><strong><a href=\"http:\/\/www.opticsinfobase.org\/ol\/abstract.cfm?uri=ol-37-16-3357\" target=\"_blank\" rel=\"noopener noreferrer\">Scanning-free compressive holography for object localization with subpixel accuracy<br \/>\n<\/a><\/strong>Y. Liu, Lei Tian, J. W. Lee, H. Y. H. Huang, M. S. Triantafyllou, G. Barbastathis<br \/>\n<span style=\"line-height: 1.5;\"><em><strong>Optics Letters<\/strong><\/em> 37, 3357-3359 (2012).<\/span><\/p>\n<p>We propose quantitative localization measurement of a known object with subpixel accuracy using compressive holography. We analyze the theoretical optimal solution in the compressive sampling framework and experimentally demonstrate localization accuracy of 1\/45 pixel, in good agreement with the analysis.<\/p>\n<p><img loading=\"lazy\" src=\"\/tianlab\/files\/2016\/08\/subpixel1D-621x636.png\" alt=\"subpixel1D\" width=\"400\" height=\"409\" class=\"aligncenter wp-image-127\" srcset=\"https:\/\/sites.bu.edu\/tianlab\/files\/2016\/08\/subpixel1D-621x636.png 621w, https:\/\/sites.bu.edu\/tianlab\/files\/2016\/08\/subpixel1D.png 940w\" sizes=\"(max-width: 400px) 100vw, 400px\" \/><\/p>\n<p><a href=\"http:\/\/www.opticsinfobase.org\/ao\/abstract.cfm?uri=ao-49-9-1549\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>Quantitative measurement of size and three-dimensional position of fast moving bubbles in air-water mixture flows using digital holography<\/strong><\/a><br \/>\nLei Tian, N. Loomis, J. Dominguez-Caballero, G. Barbastathis<br \/>\n<em><strong>Applied Optics<\/strong><\/em> 49, 1549 (2010).<\/p>\n<p>We present a digital in-line holographic imaging system for measuring the size and three-dimensional position of fast-moving bubbles in air\u2013water mixture flows. The captured holograms are numerically processed by performing a two-dimensional projection followed by local depth estimation to quickly and efficiently obtain the size and position information of multiple bubbles simultaneously. Statistical analysis on measured bubble size distributions shows that they follow lognormal or gamma distributions.<\/p>\n<p><img loading=\"lazy\" src=\"\/tianlab\/files\/2016\/08\/BUBBLE-636x379.png\" alt=\"BUBBLE\" width=\"600\" height=\"358\" class=\"aligncenter wp-image-116\" srcset=\"https:\/\/sites.bu.edu\/tianlab\/files\/2016\/08\/BUBBLE-636x379.png 636w, https:\/\/sites.bu.edu\/tianlab\/files\/2016\/08\/BUBBLE-1024x611.png 1024w, https:\/\/sites.bu.edu\/tianlab\/files\/2016\/08\/BUBBLE.png 1264w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Adaptive 3D descattering with a dynamic synthesis network Waleed Tahir, Hao Wang, Lei Tian Light: Science &amp; Applications\u00a011, 42, 2022 \u2b51\u00a0Github Project Deep learning has been broadly applied to imaging in scattering applications. A common framework is to train a &#8220;descattering&#8221; neural network for image recovery by removing scattering artifacts. To achieve the best results [&hellip;]<\/p>\n","protected":false},"author":12228,"featured_media":0,"parent":133,"menu_order":7,"comment_status":"closed","ping_status":"closed","template":"page-templates\/no-sidebars.php","meta":[],"_links":{"self":[{"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/pages\/278"}],"collection":[{"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/users\/12228"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/comments?post=278"}],"version-history":[{"count":15,"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/pages\/278\/revisions"}],"predecessor-version":[{"id":1982,"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/pages\/278\/revisions\/1982"}],"up":[{"embeddable":true,"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/pages\/133"}],"wp:attachment":[{"href":"https:\/\/sites.bu.edu\/tianlab\/wp-json\/wp\/v2\/media?parent=278"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}