| 1. |
- Ayyalasomayajula, Kalyan Ram, 1980-, et al.
(författare)
-
CalligraphyNet: Augmenting handwriting generation with quill based stroke width
- 2019
-
Annan publikation (övrigt vetenskapligt/konstnärligt)abstract
- Realistic handwritten document generation garners a lot ofinterest from the document research community for its abilityto generate annotated data. In the current approach we haveused GAN-based stroke width enrichment and style transferbased refinement over generated data which result in realisticlooking handwritten document images. The GAN part of dataaugmentation transfers the stroke variation introduced by awriting instrument onto images rendered from trajectories cre-ated by tracking coordinates along the stylus movement. Thecoordinates from stylus movement are augmented with thelearned stroke width variations during the data augmentationblock. An RNN model is then trained to learn the variationalong the movement of the stylus along with the stroke varia-tions corresponding to an input sequence of characters. Thismodel is then used to generate images of words or sentencesgiven an input character string. A document image thus cre-ated is used as a mask to transfer the style variations of the inkand the parchment. The generated image can capture the colorcontent of the ink and parchment useful for creating annotated data.
|
|
| 2. |
- Ayyalasomayajula, Kalyan Ram, 1980-
(författare)
-
Learning based segmentation and generation methods for handwritten document images
- 2019
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Computerized analysis of handwritten documents is an active research area in image analysis and computer vision. The goal is to create tools that can be available for use at university libraries and for researchers in the humanities. Working with large collections of handwritten documents is very time consuming and many old books and letters remain unread for centuries. Efficient computerized methods could help researchers in history, philology and computer linguistics to cost-effectively conduct a whole new type of research based on large collections of documents. The thesis makes a contribution to this area through the development of methods based on machine learning. The passage of time degrades historical documents. Humidity, stains, heat, mold and natural aging of the materials for hundreds of years make the documents increasingly difficult to interpret. The first half of the dissertation is therefore focused on cleaning the visual information in these documents by image segmentation methods based on energy minimization and machine learning. However, machine learning algorithms learn by imitating what is expected of them. One prerequisite for these methods to work is that ground truth is available. This causes a problem for historical documents because there is a shortage of experts who can help to interpret and interpret them. The second part of the thesis is therefore about automatically creating synthetic documents that are similar to handwritten historical documents. Because they are generated from a known text, they have a given facet. The visual content of the generated historical documents includes variation in the writing style and also imitates degradation factors to make the images realistic. When machine learning is trained on synthetic images of handwritten text, with a known facet, in many cases they can even give an even better result for real historical documents.
|
|
| 3. |
|
|
| 4. |
|
|
| 5. |
- Andersson, Axel, et al.
(författare)
-
Cell Segmentation of in situ Transcriptomics Data using Signed Graph Partitioning
- 2023
-
Ingår i: Graph-Based Representations in Pattern Recognition. - Cham : Springer. - 9783031427947 - 9783031427954 ; , s. 139-148
-
Konferensbidrag (refereegranskat)abstract
- The locations of different mRNA molecules can be revealed by multiplexed in situ RNA detection. By assigning detected mRNA molecules to individual cells, it is possible to identify many different cell types in parallel. This in turn enables investigation of the spatial cellular architecture in tissue, which is crucial for furthering our understanding of biological processes and diseases. However, cell typing typically depends on the segmentation of cell nuclei, which is often done based on images of a DNA stain, such as DAPI. Limiting cell definition to a nuclear stain makes it fundamentally difficult to determine accurate cell borders, and thereby also difficult to assign mRNA molecules to the correct cell. As such, we have developed a computational tool that segments cells solely based on the local composition of mRNA molecules. First, a small neural network is trained to compute attractive and repulsive edges between pairs of mRNA molecules. The signed graph is then partitioned by a mutex watershed into components corresponding to different cells. We evaluated our method on two publicly available datasets and compared it against the current state-of-the-art and older baselines. We conclude that combining neural networks with combinatorial optimization is a promising approach for cell segmentation of in situ transcriptomics data. The tool is open-source and publicly available for use at https://github.com/wahlby-lab/IS3G.
|
|
| 6. |
- Andersson, Axel
(författare)
-
Computational Methods for Image-Based Spatial Transcriptomics
- 2024
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Why does cancer develop, spread, grow, and lead to mortality? To answer these questions, one must study the fundamental building blocks of all living organisms — cells. Like a well-calibrated manufacturing unit, cells follow precise instructions by gene expression to initiate the synthesis of proteins, the workforces that drive all living biochemical processes.Recently, researchers have developed techniques for imaging the expression of hundreds of unique genes within tissue samples. This information is extremely valuable for understanding the cellular activities behind cancer-related diseases. These methods, collectively known as image-based spatial transcriptomics (IST) techniques, use fluorescence microscopy to combinatorically label mRNA species (corresponding to expressed genes) in tissue samples. Here, automatic image analysis is required to locate fluorescence signals and decode the combinatorial code. This process results in large quantities of points, marking the location of expressed genes. These new data formats pose several challenges regarding visualization and automated analysis.This thesis presents several computational methods and applications related to data generated from IST methods. Key contributions include: (i) A decoding method that jointly optimizes the detection and decoding of signals, particularly beneficial in scenarios with low signal-to-noise ratios or densely packed signals; (ii) a computational method for automatically delineating regions with similar gene compositions — efficient, interactive, and scalable for exploring patterns across different scales; (iii) a software enabling interactive visualization of millions of gene markers atop Terapixel-sized images (TissUUmaps); (iv) a tool utilizing signed-graph partitioning for the automatic identification of cells, independent of the complementary nuclear stain; (v) A fast and analytical expression for a score that quantifies co-localization between spatial points (such as located genes); (vi) a demonstration that gene expression markers can train deep-learning models to classify tissue morphology.In the final contribution (vii), an IST technique features in a clinical study to spatially map the molecular diversity within tumors from patients with colorectal liver metastases, specifically those exhibiting a desmoplastic growth pattern. The study unveils novel molecular patterns characterizing cellular diversity in the transitional region between healthy liver tissue and the tumor. While a direct answer to the initial questions remains elusive, this study sheds illuminating insights into the growth dynamics of colorectal cancer liver metastases, bringing us closer to understanding the journey from development to mortality in cancer.
|
|
| 7. |
- Andersson, Axel, et al.
(författare)
-
Points2Regions : Fast, interactive clustering of imaging-based spatial transcriptomics data
-
Annan publikation (övrigt vetenskapligt/konstnärligt)abstract
- Imaging-based spatial transcriptomics techniques generate image data that, once processed, results in a set of spatial points with categorical labels for different mRNA species. A crucial part of analyzing downstream data involves the analysis of these point patterns. Here, biologically interesting patterns can be explored at different spatial scales. Molecular patterns on a cellular level would correspond to cell types, whereas patterns on a millimeter scale would correspond to tissue-level structures. Often, clustering methods are employed to identify and segment regions with distinct point-patterns. Traditional clustering techniques for such data are constrained by reliance on complementary data or extensive machine learning, limiting their applicability to tasks on a particular scale. This paper introduces 'Points2Regions', a practical tool for clustering spatial points with categorical labels. Its flexible and computationally efficient clustering approach enables pattern discovery across multiple scales, making it a powerful tool for exploratory analysis. Points2Regions has demonstrated efficient performance in various datasets, adeptly defining biologically relevant regions similar to those found by scale-specific methods. As a Python package integrated into TissUUmaps and a Napari plugin, it offers interactive clustering and visualization, significantly enhancing user experience in data exploration. In essence, Points2Regions presents a user-friendly and simple tool for exploratory analysis of spatial points with categorical labels.
|
|
| 8. |
- Blache, Ludovic, et al.
(författare)
-
SoftCut: : A Virtual Planning Tool for Soft Tissue Resection on CT Images
- 2018
-
Ingår i: Medical Image Understanding and Analysis. - Cham : Springer. - 9783319959207 ; , s. 299-310
-
Konferensbidrag (refereegranskat)abstract
- With the increasing use of three-dimensional (3D) models and Computer Aided Design (CAD) in the medical domain, virtual surgical planning is now frequently used. Most of the current solutions focus on bone surgical operations. However, for head and neck oncologic resection, soft tissue ablation and reconstruction are common operations. In this paper, we propose a method to provide a fast and efficient estimation of shape and dimensions of soft tissue resections. Our approach takes advantage of a simple sketch-based interface which allows the user to paint the contour of the resection on a patient specific 3D model reconstructed from a computed tomography (CT) scan. The volume is then virtually cut and carved following this pattern. From the outline of the resection defined on the skin surface as a closed curve, we can identify which areas of the skin are inside or outside this shape. We then use distance transforms to identify the soft tissue voxels which are closer from the inside of this shape. Thus, we can propagate the shape of the resection inside the soft tissue layers of the volume. We demonstrate the usefulness of the method on patient specific CT data.
|
|
| 9. |
- Breznik, Eva
(författare)
-
Image Processing and Analysis Methods for Biomedical Applications
- 2023
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- With new technologies and developments medical images can be acquired more quickly and at a larger scale than ever before. However, increased amount of data induces an overhead in the human labour needed for its inspection and analysis. To support clinicians in decision making and enable swifter examinations, computerized methods can be utilized to automate the more time-consuming tasks. For such use, methods need be highly accurate, fast, reliable and interpretable. In this thesis we develop and improve methods for image segmentation, retrieval and statistical analysis, with applications in imaging-based diagnostic pipelines. Individual objects often need to first be extracted/segmented from the image before they can be analysed further. We propose methodological improvements for deep learning-based segmentation methods using distance maps, with the focus on fully-supervised 3D patch-based training and training on 2D slices under point supervision. We show that using a directly interpretable distance prior helps to improve segmentation accuracy and training stability.For histological data in particular, we propose and extensively evaluate a contrastive learning and bag of words-based pipeline for cross-modal image retrieval. The method is able to recover correct matches from the database across modalities and small transformations with improved accuracy compared to the competitors. In addition, we examine a number of methods for multiplicity correction on statistical analyses of correlation using medical images. Evaluation strategies are discussed and anatomy-observing extensions to the methods are developed as a way of directly decreasing the multiplicity issue in an interpretable manner, providing improvements in error control. The methods presented in this thesis were developed with clinical applications in mind and provide a strong base for further developments and future use in medical practice.
|
|
| 10. |
- Breznik, Eva, et al.
(författare)
-
Multiple comparison correction methods for whole-body magnetic resonance imaging
- 2020
-
Ingår i: Journal of Medical Imaging. - : SPIE-Intl Soc Optical Eng. - 2329-4302 .- 2329-4310. ; 7:1
-
Tidskriftsartikel (refereegranskat)abstract
- Purpose: Voxel-level hypothesis testing on images suffers from test multiplicity. Numerous correction methods exist, mainly applied and evaluated on neuroimaging and synthetic datasets. However, newly developed approaches like Imiomics, using different data and less common analysis types, also require multiplicity correction for more reliable inference. To handle the multiple comparisons in Imiomics, we aim to evaluate correction methods on whole-body MRI and correlation analyses, and to develop techniques specifically suited for the given analyses. Approach: We evaluate the most common familywise error rate (FWER) limiting procedures on whole-body correlation analyses via standard (synthetic no-activation) nominal error rate estimation as well as smaller prior-knowledge based stringency analysis. Their performance is compared to our anatomy-based method extensions. Results: Results show that nonparametric methods behave better for the given analyses. The proposed prior-knowledge based evaluation shows that the devised extensions including anatomical priors can achieve the same power while keeping the FWER closer to the desired rate. Conclusions: Permutation-based approaches perform adequately and can be used within Imiomics. They can be improved by including information on image structure. We expect such method extensions to become even more relevant with new applications and larger datasets.
|
|
