BIOIMAGING 2023 Abstracts


Full Papers
Paper Nr: 1
Title:

Particle Tracking with Neighbourhood Similarities: A New Method for Super Resolution Ultrasound Imaging

Authors:

Andrew Mobberley, Georgios Papageorgiou, Mairead Butler, Evangelos D. Kanoulas, Julian Keanie, Daniel Good, Kevin Gallagher, Alan McNeil, Vassilis Sboros and Weiping Lu

Abstract: Single particle tracking (SPT) is a method for the observation of the motion of individual particles within a medium. It is broadly used to quantify the dynamics of particle flow, such as molecules/proteins in life sciences. In this paper, we will improve the performance of SPT by considering the local neighbourhood dynamical and structural information of a particle when it is tracked in a medium through consecutive frames, referred to as particle tracking with neighbourhood similarities (PTNS). This method is applied to track microbubbles in contrast enhanced ultrasound. We will test the method on synthetic data for method validation before applying to animal and human prostate data. We show that PTNS can make a significant improvement in the tracking performance in synthetic data, and in animal data it was able to accurately produce complex structures. In human prostate data, we find that by varying the control parameters we can inspect different behaviours of the tracks and from that understand the characteristics of the blood vessels they travel along.
Download

Paper Nr: 2
Title:

SalienceNet: An Unsupervised Image-to-Image Translation Method for Nuclei Saliency Enhancement in Microscopy Images

Authors:

Emmanuel Bouilhol, Edgar Lefevre, Thierno Barry, Florian Levet, Anne Beghin, Virgile Viasnoff, Xareni Galindo, Rémi Galland, Jean-Baptiste Sibarita and Macha Nikolski

Abstract: Automatic segmentation of nuclei in low-light microscopy images remains a difficult task, especially for high-throughput experiments where the need for automation is strong. Low saliency of nuclei with respect to the background, variability of their intensity together with low signal-to-noise ratio in these images constitute a major challenge for mainstream algorithms of nuclei segmentation. In this work we introduce SalienceNet, an unsupervised deep learning-based method that uses the style transfer properties of cycleGAN to transform low saliency images into high saliency images, thus enabling accurate segmentation by downstream analysis methods, and that without need for any parameter tuning. We have acquired a novel dataset of organoid images with soSPIM, a microscopy technique that enables the acquisition of images in low-light conditions. Our experiments show that SalienceNet increased the saliency of these images up to the desired level. Moreover, we evaluated the impact of SalienceNet on segmentation for both Otsu thresholding and StarDist and have shown that enhancing nuclei with SalienceNet improved segmentation results using Otsu thresholding by 30% and using StarDist by 26% in terms of IOU when compared to segmentation of non-enhanced images. Together these results show that SalienceNet can be used as a common preprocessing step to automate nuclei segmentation pipelines for low-light microscopy images.
Download

Paper Nr: 3
Title:

Improving Mitosis Detection via UNet-Based Adversarial Domain Homogenizer

Authors:

Tirupati S. Chandra, Sahar A. Nasser, Nikhil C. Kurian and Amit Sethi

Abstract: The effective counting of mitotic figures in cancer pathology specimen is a critical task for deciding tumor grade and prognosis. Automated mitosis detection through deep learning-based image analysis often fails on unseen patient data due to domain shifts in the form of changes in stain appearance, pixel noise, tissue quality, and magnification. This paper proposes a domain homogenizer for mitosis detection that attempts to alleviate domain differences in histology images via adversarial reconstruction of input images. The proposed homogenizer is based on a U-Net architecture and can effectively reduce domain differences commonly seen with histology imaging data. We demonstrate our domain homogenizer’s effectiveness by showing a reduction in domain differences between the preprocessed images. Using this homogenizer with a RetinaNet object detector, we were able to outperform the baselines of the 2021 MIDOG challenge in terms of average precision of the detected mitotic figures.
Download

Paper Nr: 5
Title:

Measurement of Platelet Aggregation in Ageing Samples and After in-Vitro Activation

Authors:

Christian Klenk, David E. Fresacher, Stefan Röhrl, Dominik Heim, Manuel Lengl, Simon Schumann, Martin Knopp, Klaus Diepold, Stefan Holdenrieder and Oliver Hayden

Abstract: Blood cell aggregates are gaining importance as a possible biomarker for various diseases. However, due to technical limitations of common analysers, mostly only interactions between leukocytes and platelets are measured directly as aggregates. Interactions between platelets are usually only measured indirectly after using an activation assay or by analysing surface proteins. Here, an imaging flow cytometer is used to measure and characterize platelet-aggregates directly in whole blood samples. Influences of sample ageing and in-vitro activation with adenosine diphosphate (ADP) was investigated for blood anticoagulated with either EDTA, citrate, heparin or hirudin. Here, the number of platelet-aggregates and their composition was measured. Blood anticoagulated with hirudin and EDTA showed a stable number of aggregates within a timeframe of 240 minutes. While no aggregate concentration changes were observed in EDTA blood after activation with ADP, a clear increase in aggregates was seen in hirudin, citrate and heparin blood. This effect is also observable when looking at the composition of the clots. However, after an initial spike a large number of aggregates disintegrate within a time frame of nine minutes. This effect is particularly prominent for large aggregates containing six or more platelets.
Download

Short Papers
Paper Nr: 4
Title:

Explainable Feature Learning with Variational Autoencoders for Holographic Image Analysis

Authors:

Stefan Röhrl, Lukas Bernhard, Manuel Lengl, Christian Klenk, Dominik Heim, Martin Knopp, Simon Schumann, Oliver Hayden and Klaus Diepold

Abstract: Digital holographic microscopy (DHM) has a high potential to be a new platform technology for medical diagnostics on a cellular level. The resulting quantitative phase images of label-free cells, however, are widely unfamiliar to the bio-medical community and lack in their degree of detail compared to conventionally stained microscope images. Currently, this problem is addressed using machine learning with opaque end-to-end models or inadequate handcrafted morphological features of the cells. In this work we present a modified version of the variational Autoencoder (VAE) to provide a more transparent and interpretable access to the quantitative phase representation of cells, their distribution and their classification. We can show a satisfying performance in the presented hematological use cases compared to classical VAEs or morphological features.
Download

Paper Nr: 6
Title:

In Vitro Quantification of Cellular Spheroids in Patterned Petri Dishes

Authors:

Jonas Schurr, Andreas Haghofer, Marian Fürsatz, Hannah Janout, Sylvia Nürnberger and Stephan Winkler

Abstract: Cell Spheroids are of high interest for clinical cell applications and cell screening. To allow the extraction of early readout parameters a high amount of image data of petri dishes is created. To support automated analyses of spheroids in petri dish images we present a method for analysing and quantification of spheroids in its development stages. The algorithm is based on multiple image processing algorithms and neural networks. With an evolutionary strategy, engraved grid cells on petri dish are extracted and on top a Unet is used for the segmentation and quantification of different cell compartment states. The measured f1-scores for the different states are 0.77 for monolayer grid cells, 0.86 for starting formation grid cells and 0.85 for spheroids. As we describe in this study we can provide thorough analyses of cell spheroid in petri dishes, by automating the quantification process.
Download

Paper Nr: 7
Title:

Automatic Spine Segmentation in CT Scans

Authors:

Gabor Revy, Daniel Hadhazi and Gabor Hullam

Abstract: The segmentation of the spine can be an essential step in computer-aided diagnosis. Current methods aiming to handle this problem generally employ an explicit model of some type. However, to create an adequately robust model, a high amount of properly labeled diverse data is required. This is not always accessible. In this research, we suggest an explicit model-free algorithm for spine segmentation. Our approach utilizes expert algorithms that are built on medical expert knowledge to create a spine segmentation from thoracic CT scans. Our system achieves an IoU (intersection over union) value of 0.7103±0.051 (mean±std) and a DSC (Dice similarity coefficient) of 0.8295±0.0343 on a subset of the CTSpine1K dataset.
Download

Paper Nr: 9
Title:

Prediction of Thyroid Malignancy Using Contextual Semantic Interpretability from Sonograms

Authors:

Ahana R. Choudhury, Radu P. Mihail and Sorin D. Chiriac

Abstract: The gold standard in thyroid nodule malignancy diagnosis consists of ultrasound (US or sonogram) guided fine needle aspiration biopsy. This procedure is ordered based on an assessment of malignancy risk by a trained radiologist, who uses US images and relies on experience and heuristics that are difficult to effectively systematize into a working algorithm. Artificial Intelligence (AI) methods for malignancy detection in sonograms are designed to either perform segmentation (highlight entire thyroid gland and/or nodule) or output a probability of malignancy. There is a gap between AI methods trained to perform a specific task using a black-box method, and the sonogram features (e.g.,: shape, size, echogenicity, echotexture) that a radiologist looks at. We aim to bridge this gap, using AI to reveal saliency in sonograms for features that are easily understood by clinicians. We propose a deep-learning model that performs two tasks important to radiologists: sonogram feature saliency detection, as well as probability of malignancy. We perform both a quantitative and qualitative evaluation of our method using an open dataset, the Thyroid Digital Image Database (TDID). Our framework achieves 72% accuracy in the task of classifying thyroid nodules as benign or malignant.
Download

Paper Nr: 10
Title:

EGFR Mutation Prediction of Lung Biopsy Images Using Deep Learning

Authors:

Ravi K. Gupta, Shivani Nandgaonkar, Nikhil C. Kurian, Tripti Bameta, Subhash Yadav, Rajiv K. Kaushal, Swapnil Rane and Amit Sethi

Abstract: The standard diagnostic procedure for targeted therapies in lung cancer treatment involve cancer detection, histological subtyping, and subsequent detection of key driver mutations, such as epidermal growth factor receptor (EGFR). Even though molecular profiling can uncover the driver mutation, the process is expensive and time-consuming. Deep learning-based image analysis offers a more economical alternative for discovering driver mutations directly from whole slide images (WSIs) of tissue samples stained using hematoxylin and eosin (H&E). In this work, we used customized deep learning pipelines with weak supervision to identify the morphological correlates of EGFR mutation from hematoxylin and eosin-stained WSIs, in addition to detecting tumor and histologically subtyping it. We demonstrate the effectiveness of our pipeline by conducting rigorous experiments and ablation studies on two lung cancer datasets – the cancer genome atlas (TCGA) and a private dataset from India. With our pipeline, we achieved an average area under the curve (AUC) of 0.964 for tumor detection and 0.942 for histological subtyping between adenocarcinoma and squamous cell carcinoma on the TCGA dataset. For EGFR detection, we achieved an average AUC of 0.864 on the TCGA dataset and 0.783 on the dataset from India. Our key findings are the following. Firstly, there is no particular advantage of using feature extractor layers trained on histology if there are differences in magnification. Secondly, selecting patches with high cellularity, presumably capturing tumor regions, is not always helpful, as the sign of a disease class may be present in the tumor-adjacent stroma. And finally, color normalization is still an alternative worth trying when compared to color jitter, even though their origins lie in opposing approaches to dealing with stain color variation.
Download

Paper Nr: 13
Title:

Mathematical Morphology Based Volumetric Analysis of Bone Density Around Implant in Post-Operational Follow-up of Per-Trochanteric Fractures

Authors:

Robertas Petrolis, Vėtra Markevičiūtė, Šarūnas Tarasevičius, Deepak Raina, Lars Lidgren, Saulius Lukoševičius and Algimantas Kriščiukaitis

Abstract: Per trochanteric fractures are common in an ageing population with osteoporosis and account for about half of all hip fractures. Treatment of per trochanteric fractures with extramedullary or intramedullary implants is challenging especially in unstable fractures. In order to improve the mechanical anchorage of the screw and prevent re-operations, various attempts have been made to reinforce the fragile bone with polymer based injectable materials. However, volumetric control of delivered material and/or measurement of bone density in post-operative follow-up remains challenging. This study presents the basic principles of a new algorithm for CT based volumetric analysis of the bone density in the region adjacent to the implant in the femoral head in comparison to the non-operated hip. The method was also used to track long term bone density changes at 3 to 6 months of follow up.
Download

Paper Nr: 15
Title:

LipoPose: Adapting Cellpose to Lipid Nanoparticle Segmentation

Authors:

Semanti Basu, Peter Bajcsy, Thomas Cleveland, Manuel J. Carrasco and R. I. Bahar

Abstract: The goal of this study is to precisely localize lipid nanoparticles (LNPs) from cryogenic electron microscopy (cryoEM) images. LNPs found in cryoEM images are characterized by nonuniform shapes with varying sizes and textures. Moreover, there is no publicly available training dataset for LNP segmentation/detection. Thus, accurate supervised localization must overcome the challenges posed by heterogeneity of LNPs and nonexistent large training datasets. We evaluate benchmarks in closely related areas such as particle-picking and cell-segmentation in the context of LNP localization. Our experimental results demonstrate that, of the benchmarks tested, Cellpose is the best suited to LNP localization. We further adapt Cellpose to segmentation of heterogenous particles of unknown size distribution by introducing a novel optimization pipeline to remove uncertainty in Cellpose’s inference diameter parameter selection. The overall workflow speeds up the process of manually annotating LNPs by approximately 5X.
Download

Paper Nr: 16
Title:

Skin Tone via Device-Independent Colour Space

Authors:

Leah DeVos, Gennadi Saiko and Alexandre Douplik

Abstract: Background: Skin colour is essential to skin and wound assessment as it brings valuable information about skin physiology and pathology. An approach, which can help deconvolute and isolate various mechanisms affecting skin colour, could be helpful to drive the rPPG utility beyond its current applications. Aim: The present work aims to create a framework that links skin colour with melanin content. Material and methods: The model consists of two parts. First, the model’s core connects tissue chromophore concentrations with changes in tissue reflectance. Seven-layer tissue models and Monte Carlo simulations were used to obtain the tissue reflectance spectra. In the second step, the tissue reflectance is convoluted with the responsivity of a sensor (tristimulus response in the case of the human eye) and the light source’s emission spectrum. Results: The model allows linking melanin content with skin colour. Conclusion: The model can be helpful for the interpretation of the amplitudes of various components of the rPPG signal.
Download

Paper Nr: 17
Title:

Retinal Image Segmentation with Small Datasets

Authors:

Nchongmaje Ndipenoch, Alina Miron, Zidong Wang and Yongmin Li

Abstract: Many eye diseases like Diabetic Macular Edema (DME), Age-related Macular Degeneration (AMD), and Glaucoma manifest in the retina, can cause irreversible blindness or severely impair the central version. The Optical Coherence Tomography (OCT), a 3D scan of the retina with high qualitative information about the retinal morphology, can be used to diagnose and monitor changes in the retinal anatomy. Many Deep Learning (DL) methods have shared the success of developing an automated tool to monitor pathological changes in the retina. However, the success of these methods depends mainly on large datasets. To address the challenge from very small and limited datasets, we proposed a DL architecture termed CoNet (Coherent Network) for joint segmentation of layers and fluids in retinal OCT images on very small datasets (less than a hundred training samples). The proposed model was evaluated on the publicly available Duke DME dataset consisting of 110 B-Scans from 10 patients suffering from DME. Experimental results show that the proposed model outperformed both the human experts’ annotation and the current state-of-the-art architectures by a clear margin with a mean Dice Score of 88% when trained on 55 images without any data augmentation.
Download

Paper Nr: 18
Title:

Simulating Ultrasound Images from CT Scans

Authors:

Sahar A. Nasser and Amit Sethi

Abstract: Anatomical information in ultrasound (US) imaging has not been exploited fully because its wave interference pattern (WIP) has been viewed as speckle noise. We tested the idea that more information can be retrieved by disentangling the WIP rather than discarding it as noise. We numerically solved the forward model of generating US images from computed tomography (CT) images by solving wave-equations using the Stride library. By doing so, we have paved the way for using deep neural networks to be trained on the data generated by the forward model to simulate the solution of the inverse problem, which is generating the CT-style and CT-quality images from a real US image. We demonstrate qualitative features of the generated images that are rich in anatomical details and realism.
Download

Paper Nr: 19
Title:

Foreground Extraction in Histo-Pathological Image by Combining Mathematical Morphology Operations and U-Net

Authors:

Jia Li, Junling He, Jingmin Long, Chenxu Wang, Jesper Kers and Fons J. Verbeek

Abstract: In recent years, computational pathology is rapidly developing. This resulted in various artificial intelligence approaches that have been proposed and applied to images common to the pathology practice, i.e. Whole Slide Images. It is very important to pre-process these images for a deep learning classifier because they are simply too large to feed into such a network. In order to get useful information from these images, we propose a new background removal method for the extracted Regions Of Interest in these images. We combine traditional morphology image operators and a U-Net framework. Firstly, we pre-process the images by using Contrast Limited Adaptive Histogram Equalization and thresholding. Then we predict the mask by using pre-trained U-Net weights. Finally, we use morphological opening and propagation operators on the predicted mask to refine the masks. The experiments based on different types of staining (H&E, PAS, and JONES silver) show the effectiveness of our method compared to 3 state-of-the-art models.
Download