Searched for: in-biosketch:yes
person:knollf01
Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge
Knoll, Florian; Murrell, Tullie; Sriram, Anuroop; Yakubova, Nafissa; Zbontar, Jure; Rabbat, Michael; Defazio, Aaron; Muckley, Matthew J; Sodickson, Daniel K; Zitnick, C Lawrence; Recht, Michael P
PURPOSE/OBJECTIVE:To advance research in the field of machine learning for MR image reconstruction with an open challenge. METHODS:We provided participants with a dataset of raw k-space data from 1,594 consecutive clinical exams of the knee. The goal of the challenge was to reconstruct images from these data. In order to strike a balance between realistic data and a shallow learning curve for those not already familiar with MR image reconstruction, we ran multiple tracks for multi-coil and single-coil data. We performed a two-stage evaluation based on quantitative image metrics followed by evaluation by a panel of radiologists. The challenge ran from June to December of 2019. RESULTS:We received a total of 33 challenge submissions. All participants chose to submit results from supervised machine learning approaches. CONCLUSIONS:The challenge led to new developments in machine learning for image reconstruction, provided insight into the current state of the art in the field, and highlighted remaining hurdles for clinical adoption.
PMID: 32506658
ISSN: 1522-2594
CID: 4505052
Rapid mono and biexponential 3D-T1Ï mapping of knee cartilage using variational networks
Zibetti, Marcelo V W; Johnson, Patricia M; Sharafi, Azadeh; Hammernik, Kerstin; Knoll, Florian; Regatte, Ravinder R
In this study we use undersampled MRI acquisition methods to obtain accelerated 3D mono and biexponential spin-lattice relaxation time in the rotating frame (T1Ï) mapping of knee cartilage, reducing the usual long scan time. We compare the accelerated T1Ï maps obtained by deep learning-based variational network (VN) and compressed sensing (CS). Both methods were compared with spatial (S) and spatio-temporal (ST) filters. Complex-valued fitting was used for T1Ï parameters estimation. We tested with seven in vivo and six synthetic datasets, with acceleration factors (AF) from 2 to 10. Median normalized absolute deviation (MNAD), analysis of variance (ANOVA), and coefficient of variation (CV) were used for analysis. The methods CS-ST, VN-S, and VN-ST performed well for accelerating monoexponential T1Ï mapping, with MNAD around 5% for AF = 2, which increases almost linearly with the AF to an MNAD of 13% for AF = 8, with all methods. For biexponential mapping, the VN-ST was the best method starting with MNAD of 7.4% for AF = 2 and reaching MNAD of 13.1% for AF = 8. The VN was able to produce 3D-T1Ï mapping of knee cartilage with lower error than CS. The best results were obtained by VN-ST, improving CS-ST method by nearly 7.5%.
PMCID:7645759
PMID: 33154515
ISSN: 2045-2322
CID: 4662942
Using Deep Learning to Accelerate Knee MRI at 3T: Results of an Interchangeability Study
Recht, Michael P; Zbontar, Jure; Sodickson, Daniel K; Knoll, Florian; Yakubova, Nafissa; Sriram, Anuroop; Murrell, Tullie; Defazio, Aaron; Rabbat, Michael; Rybak, Leon; Kline, Mitchell; Ciavarra, Gina; Alaia, Erin F; Samim, Mohammad; Walter, William R; Lin, Dana; Lui, Yvonne W; Muckley, Matthew; Huang, Zhengnan; Johnson, Patricia; Stern, Ruben; Zitnick, C Lawrence
OBJECTIVE:Deep Learning (DL) image reconstruction has the potential to disrupt the current state of MR imaging by significantly decreasing the time required for MR exams. Our goal was to use DL to accelerate MR imaging in order to allow a 5-minute comprehensive examination of the knee, without compromising image quality or diagnostic accuracy. METHODS:A DL model for image reconstruction using a variational network was optimized. The model was trained using dedicated multi-sequence training, in which a single reconstruction model was trained with data from multiple sequences with different contrast and orientations. Following training, data from 108 patients were retrospectively undersampled in a manner that would correspond with a net 3.49-fold acceleration of fully-sampled data acquisition and 1.88-fold acceleration compared to our standard two-fold accelerated parallel acquisition. An interchangeability study was performed, in which the ability of 6 readers to detect internal derangement of the knee was compared for the clinical and DL-accelerated images. RESULTS:The study demonstrated a high degree of interchangeability between standard and DL-accelerated images. In particular, results showed that interchanging the sequences would result in discordant clinical opinions no more than 4% of the time for any feature evaluated. Moreover, the accelerated sequence was judged by all six readers to have better quality than the clinical sequence. CONCLUSIONS:An optimized DL model allowed for acceleration of knee images which performed interchangeably with standard images for the detection of internal derangement of the knee. Importantly, readers preferred the quality of accelerated images to that of standard clinical images.
PMID: 32755163
ISSN: 1546-3141
CID: 4557132
Artificial Intelligence Explained for Nonexperts
Razavian, Narges; Knoll, Florian; Geras, Krzysztof J
Artificial intelligence (AI) has made stunning progress in the last decade, made possible largely due to the advances in training deep neural networks with large data sets. Many of these solutions, initially developed for natural images, speech, or text, are now becoming successful in medical imaging. In this article we briefly summarize in an accessible way the current state of the field of AI. Furthermore, we highlight the most promising approaches and describe the current challenges that will need to be solved to enable broad deployment of AI in clinical practice.
PMID: 31991447
ISSN: 1098-898x
CID: 4294102
Improving the Speed of MRI with Artificial Intelligence
Johnson, Patricia M; Recht, Michael P; Knoll, Florian
Magnetic resonance imaging (MRI) is a leading image modality for the assessment of musculoskeletal (MSK) injuries and disorders. A significant drawback, however, is the lengthy data acquisition. This issue has motivated the development of methods to improve the speed of MRI. The field of artificial intelligence (AI) for accelerated MRI, although in its infancy, has seen tremendous progress over the past 3 years. Promising approaches include deep learning methods for reconstructing undersampled MRI data and generating high-resolution from low-resolution data. Preliminary studies show the promise of the variational network, a state-of-the-art technique, to generalize to many different anatomical regions and achieve comparable diagnostic accuracy as conventional methods. This article discusses the state-of-the-art methods, considerations for clinical applicability, followed by future perspectives for the field.
PMID: 31991448
ISSN: 1098-898x
CID: 4294112
fastMRI: A Publicly Available Raw k-Space and DICOM Dataset of Knee Images for Accelerated MR Image Reconstruction Using Machine Learning
Knoll, Florian; Zbontar, Jure; Sriram, Anuroop; Muckley, Matthew J; Bruno, Mary; Defazio, Aaron; Parente, Marc; Geras, Krzysztof J; Katsnelson, Joe; Chandarana, Hersh; Zhang, Zizhao; Drozdzalv, Michal; Romero, Adriana; Rabbat, Michael; Vincent, Pascal; Pinkerton, James; Wang, Duo; Yakubova, Nafissa; Owens, Erich; Zitnick, C Lawrence; Recht, Michael P; Sodickson, Daniel K; Lui, Yvonne W
A publicly available dataset containing k-space data as well as Digital Imaging and Communications in Medicine image data of knee images for accelerated MR image reconstruction using machine learning is presented.
PMCID:6996599
PMID: 32076662
ISSN: 2638-6100
CID: 4312462
End-to-End Variational Networks for Accelerated MRI Reconstruction [PrePrint]
Sriram, Anuroop; Zbontar, Jure; Murrell, Tullie; Defazio, Aaron; Zitnick, C Lawrence; Yakubova, Nafissa; Knoll, Florian; Johnson, Patricia
The slow acquisition speed of magnetic resonance imaging (MRI) has led to the development of two complementary methods: acquiring multiple views of the anatomy simultaneously (parallel imaging) and acquiring fewer samples than necessary for traditional signal processing methods (compressed sensing). While the combination of these methods has the potential to allow much faster scan times, reconstruction from such undersampled multi-coil data has remained an open problem. In this paper, we present a new approach to this problem that extends previously proposed variational methods by learning fully end-to-end. Our method obtains new state-of-the-art results on the fastMRI dataset for both brain and knee MRIs
ORIGINAL:0014688
ISSN: 2331-8422
CID: 4534332
Inferring Maps of Cellular Structures from MRI Signals using Deep Learning [PrePrint]
Liang, Zifei; Lee, Choong Heon; Arefin< Tanzil M; Dong, Zijun; Walczak, Piotr; Shi, Song-Hai; Knoll, Florian; Ge, Yulin; Ying, Leslie; Zhang, Jiangyang
H MRI maps brain anatomy and pathology non-invasively through contrasts generated by exploiting inhomogeneities in tissue micro-environments. Inferring histopathological information from MRI findings, however, remains challenging due to the absence of direct links between MRI signals and specific tissue compartments. Here, we show that convolutional neural networks, developed using co-registered multi-contrast MRI and histological data of the mouse brain, can generate virtual histology from MRI results. Our networks provide maps that mirror histological stains for axons and myelin with enhanced specificity compared to existing MRI markers. Furthermore, by introducing random perturbations to the inputs, the relative contribution of each MRI contrast within the networks can be estimated and guide the optimization of MRI acquisition. We anticipate our method to be a starting point for translation of MRI results into easy-to-understand virtual histology for neurobiologists and provide resources for developing novel MRI contrasts
ORIGINAL:0014698
ISSN: 2692-8205
CID: 4534442
Deep-Learning Methods for Parallel Magnetic Resonance Imaging Reconstruction: A Survey of the Current Approaches, Trends, and Issues [Editorial]
Knoll, Florian; Hammernik, Kerstin; Zhang, Chi; Moeller, Steen; Pock, Thomas; Sodickson, Daniel K.; Akcakaya, Mehmet
ISI:000510210500016
ISSN: 1053-5888
CID: 4305312
Image reconstruction for interrupted-beam X-ray CT on diagnostic clinical scanners
Muckley, Matthew John; Chen, Baiyu; Vahle, Thomas; O'Donnell, Thomas; Knoll, Florian; Sodickson, Aaron; Sodickson, Daniel; Otazo, Ricardo
Low-dose X-ray CT is a major research area with high clinical impact. Compressed sensing using view-based sparse sampling and sparsity-promoting regularization has shown promise in simulations, but these methods can be difficult to implement on diagnostic clinical CT scanners since the X-ray beam cannot be switched on and off rapidly enough. An alternative to view-based sparse sampling is interrupted-beam sparse sampling. SparseCT is a recently-proposed interrupted-beam scheme that achieves sparse sampling by blocking a portion of the beam using a multislit collimator. The use of a multislit collimator necessitates a number of modifications to the standard compressed sensing reconstruction pipeline. In particular, we find that SparseCT reconstruction is feasible within a model-based image reconstruction framework that incorporates data fidelity weighting to consider penumbra effects and source jittering to consider the effect of partial source obstruction. Here, we present these modifications and demonstrate their application in simulations and real-world prototype scans. In simulations compared to conventional low-dose acquisitions, SparseCT is able to achieve smaller normalized root-mean square differences than tube-current reduction at larger dose reduction levels. In prototype experiments, we successfully apply our reconstruction modifications and maintain image resolution at the quarter-dose reduction level. The SparseCT design requires only small hardware modifications to current diagnostic clinical scanners, opening up new possibilities for CT dose reduction.
PMID: 31258151
ISSN: 1361-6560
CID: 3967802