Faculty Bibliography

3D imaging enables accurate diagnosis by providing spatial information about organ anatomy. However, using 3D images to train AI models is computationally challenging because they consist of 10x or 100x more pixels than their 2D counterparts. To be trained with high-resolution 3D images, convolutional neural networks resort to downsampling them or projecting them to 2D. We propose an effective alternative, a neural network that enables efficient classification of full-resolution 3D medical images. Compared to off-the-shelf convolutional neural networks, our network, 3D Globally-Aware Multiple Instance Classifier (3D-GMIC), uses 77.98%-90.05% less GPU memory and 91.23%-96.02% less computation. While it is trained only with image-level labels, without segmentation labels, it explains its predictions by providing pixel-level saliency maps. On a dataset collected at NYU Langone Health, including 85,526 patients with full-field 2D mammography (FFDM), synthetic 2D mammography, and 3D mammography, 3D-GMIC achieves an AUC of 0.831 (95% CI: 0.769-0.887) in classifying breasts with malignant findings using 3D mammography. This is comparable to the performance of GMIC on FFDM (0.816, 95% CI: 0.737-0.878) and synthetic 2D (0.826, 95% CI: 0.754-0.884), which demonstrates that 3D-GMIC successfully classified large 3D images despite focusing computation on a smaller percentage of its input compared to GMIC. Therefore, 3D-GMIC identifies and utilizes extremely small regions of interest from 3D images consisting of hundreds of millions of pixels, dramatically reducing associated computational challenges. 3D-GMIC generalizes well to BCS-DBT, an external dataset from Duke University Hospital, achieving an AUC of 0.848 (95% CI: 0.798-0.896).

Background and aim Pancreatic ductal adenocarcinoma (PDAC) is a highly lethal disease with lack of effective early detection strategies. There is an incomplete understanding of who is at risk for PDAC development and the contribution of heritability to that risk. Further, efforts at biomarker development for detection of early stage disease have been hampered by small sample sizes, lack of coordination, and inadequate access to high quality clinical data and biospecimens in relevant clinical populations. The PRECEDE Consortium was established to serve as a collaborative international network of PDAC clinical and research centers to accelerate early detection advances by standardizing collection of clinical data and biospecimens from patients at increased risk for PDAC. The consortium goal is to increase the overall survival rate for PDAC to 50% in 10 years by enabling transformative biomarker-driven discoveries in early detection of high-risk premalignant lesions and early stage cancers. Method The PRECEDE Consortium (NCT04970056; precedestudy. org) launched in 2019 and began enrollment in May, 2020. Data and biospecimen sharing are required for centers to join the consortium, which is facilitated through use of standardized data and biospecimen collection, and a centralized database (PRECEDELink) managed by a data coordinating center (Arbor Research). Imaging and clinical sequencing data will be stored and analyzed via a PRECEDE solution in the Amazon Web Services cloud. Participants age 18-90 are enrolled into one of seven cohorts based on personal and/or family history of PDAC and carrier status of pathogenic germline variants (PGV) in cancer predisposition genes (CPG). Three-generation pedigrees are collected at enrolment from participants, and standardized clinical germline testing is offered. Blood sample collection for DNA, plasma, and serum is completed at enrollment, and repeated annually for individuals meeting guidelines for annual surveillance. Results To date, 26 clinical sites have enrolled 2370 participants, with a target of 10,000 participants enrolled from 100 sites over the next 5 years. Among enrolled patients, 55% meet criteria for annual surveillance by MRI or endoscopic ultrasound. Demographics of the cohort to date: 56% female; 73% white; 35% CPG PGV carriers; 32% meet criteria for familial pancreatic cancer. Conclusions The PRECEDE Consortium study is a large international, longitudinal, prospective cohort study designed to accelerate the pace and scale of early diagnosis. Planned projects will address modifiers of risk, penetrance of disease, creating comprehensive risk models for clinical decision-making, and development and validation of biomarker assays. The PRECEDE Consortium provides a unique, innovative platform to bring together key stakeholders (academia, patients, public and private sector) to effect progress

BACKGROUND:Emerging data suggest screening mammography may be effective in detecting breast cancer early in high-risk men. We evaluated current screening recommendations as a risk management strategy in men at elevated risk for breast cancer. PATIENTS AND METHODS/METHODS:This institutional review board-approved, Health Insurance Portability and Accountability Act (HIPAA)-compliant study reviewed consecutive men who underwent genetic counseling and multigene panel testing (MGPT) for breast cancer risk assessment at our institution between 2012 and 2018. Patient risk factors, test indications, and MGPT outcomes were recorded, then correlated with screening recommendations by either clinical breast examination or screening mammography. Recommendation consistency among practitioners was evaluated. Patient adherence to screening mammography (defined as undergoing screening mammography as recommended) was assessed. Statistical analysis was performed at the 2-sided 5% significance level. RESULTS:A total of 414 asymptomatic men underwent both genetic counseling and MGPT (mean age, 47 years; range, 18-91 years) for breast cancer risk assessment. Of this group, 18 (4.3%) of 414 had a personal history of breast cancer, and 159 (38.4%) of 414 had a family history of breast cancer before MGPT. Among 112 men with positive MGPT results, BRCA1/2 mutations were the most common (56.3%, 63/112). Most BRCA mutation carriers (80.9%, 51/63) were recommended clinical breast examination only. Only 5.9% (2/34) BRCA2 and 10.3% (3/29) BRCA1 carriers were recommended screening mammograms (7.9%, 5/63 of all BRCA carriers). Among men with a personal history of breast cancer, only 9 (50%) of 18 were recommended screening mammograms. Overall adherence to screening mammogram in men was 71.4% (10/14), which ultimately yielded two cancers. Breast cancer screening recommendations varied widely among practitioners, with some recommending clinical breast examination only, and others also recommending mammography. CONCLUSION/CONCLUSIONS:Men who are found to be at an elevated risk for breast cancer after undergoing genetic counseling and testing currently receive relatively inconsistent screening recommendations.

We present a deep convolutional neural network for breast cancer screening exam classification, trained and evaluated on over 200,000 exams (over 1,000,000 images). Our network achieves an AUC of 0.895 in predicting the presence of cancer in the breast, when tested on the screening population. We attribute the high accuracy to a few technical advances. (i) Our network's novel two-stage architecture and training procedure, which allows us to use a high-capacity patch-level network to learn from pixel-level labels alongside a network learning from macroscopic breast-level labels. (ii) A custom ResNet-based network used as a building block of our model, whose balance of depth and width is optimized for high-resolution medical images. (iii) Pretraining the network on screening BI-RADS classification, a related task with more noisy labels. (iv) Combining multiple input views in an optimal way among a number of possible choices. To validate our model, we conducted a reader study with 14 readers, each reading 720 screening mammogram exams, and show that our model is as accurate as experienced radiologists when presented with the same data. We also show that a hybrid model, averaging the probability of malignancy predicted by a radiologist with a prediction of our neural network, is more accurate than either of the two separately. To further understand our results, we conduct a thorough analysis of our network's performance on different subpopulations of the screening population, the model's design, training procedure, errors, and properties of its internal representations. Our best models are publicly available at https://github.com/nyukat/breastcancerclassifier.

OBJECTIVES/OBJECTIVE:F-FDG uptake on whole-body PET-CT with MR findings and compare the degree of FDG activity between symptomatic and asymptomatic knees. MATERIALS AND METHODS/METHODS:Retrospective database query was performed using codes for knee MRI as well as whole-body PET-CT. Patients with malignant disease involving the knee or hardware were excluded. Patients who had both studies performed within 1 year between 2012 and 2017 were included for analysis. Knee joint osteoarthrosis, meniscal and ligamentous integrity, presence of joint effusion, and synovitis were assessed and recorded. Bone marrow edema lesions (BMELs) were identified, segmented, and analyzed using volumetric analysis. SUVmax was assessed over the suprapatellar joint space, intercondylar notch and Hoffa's fat pad. Symptomatic and asymptomatic knees were compared in patients with unilateral symptoms. RESULTS:Twenty-two cases (20 patients) with mean age 63.3 years (range, 36-91 years) were included. Two patients had bilateral pain. The most FDG avid regions in both symptomatic and asymptomatic knees were the intercondylar notch (SUVmax = 1.84 vs. 1.51), followed by suprapatellar pouch (SUVmax = 1.74 vs. 1.29) and Hoffa's fat pad (SUVmax = 1.01 vs. 0.87). SUVmax was significantly associated with cartilage loss (mean modified Outerbridge score) (r = 0.60, p = 0.003) and degree of synovitis (r = 0.48, p = 0023). Overall, mean SUVmax was significantly higher in the presence of a meniscal tear (1.83 ± 0.67 vs. 1.22 ± 0.40, p = 0.030). Nine patients had BMELs (volume: range = 0.6-27.8, mean = 7.79) however there was no significant association between BMEL volume and SUVmax. CONCLUSIONS:Higher FDG activity correlates with intra-articular derangement and the intercondylar notch represents the most metabolically active region of the knee.

PURPOSE: To characterize recent magnetic resonance imaging (MRI) technical development and innovation based on data regarding MRI-related patents awarded in 2016. METHODS: The US Patent and Trademark Office website was searched for patents awarded in 2016 and an abstract containing "magnetic resonance." Patent characteristics were summarized. An MRI physicist classified patents' themes. RESULTS: A total of 423 MRI-related patents were awarded in 2016. Among these, 29% had 1 inventor, 24% had 2 inventors, and 47% had >/=2 inventors. Mean interval between patents being filed and awarded was 1389 +/- 559 days (range: 167-4029). Most common countries of patents' first assignee were USA (40%), Germany (24%), Netherlands (10%), and Japan (10%). In all, 3% included assignees with different countries (most common collaborators USA and Germany). Patents' first assignee had an industry affiliation in 76% vs an academic affiliation in 21% (4% indeterminate); and 3% had industry-academia collaboration. Patents' most common themes were coils (n = 77), sequence design (n = 65), and noncoil scanner hardware (n = 41). These top themes were similar for USA, international, and industry-based patents; however, for academic-based patents, the most common themes were sequence design, reconstruction, and exogenous agents. Less common themes included image analysis, postprocessing, spectroscopy, relaxometry, diffusion, motion correction, radiation therapy, implants, wireless devices, and positron emission tomography-MRI. CONCLUSION: Most MRI-related patents were by non-US inventors. A large majority had industry affiliation; minimal industry-academic collaboration was observed. Patents from industry and academic inventors had distinct top focuses: hardware and software, respectively. Awareness of the most recent years' MRI patents may provide insights into forthcoming clinical translations and help guide ongoing research and entrepreneurism.