| 1. |
- Eldén, Lars, et al.
(author)
-
A Newton-Grassmann method for computing the best multilinear rank-(r1,r2,r3) approximation of a tensor
- 2009
-
In: SIAM Journal on Matrix Analysis and Applications. - : Society for Industrial & Applied Mathematics (SIAM). - 0895-4798 .- 1095-7162. ; 32:2, s. 248-271
-
Journal article (peer-reviewed)abstract
- We derive a Newton method for computing the best rank-$(r_1,r_2,r_3)$ approximation of a given $J\times K\times L$ tensor $\mathcal{A}$. The problem is formulated as an approximation problem on a product of Grassmann manifolds. Incorporating the manifold structure into Newton's method ensures that all iterates generated by the algorithm are points on the Grassmann manifolds. We also introduce a consistent notation for matricizing a tensor, for contracted tensor products and some tensor-algebraic manipulations, which simplify the derivation of the Newton equations and enable straightforward algorithmic implementation. Experiments show a quadratic convergence rate for the Newton–Grassmann algorithm.
|
|
| 2. |
|
|
| 3. |
- Eldén, Lars, et al.
(author)
-
Perturbation Theory and Optimality Conditions for the Best Multilinear Rank Approximation of a Tensor
- 2011
-
In: SIAM Journal on Matrix Analysis and Applications. - : SIAM. - 0895-4798 .- 1095-7162. ; 32:4, s. 1422-1450
-
Journal article (peer-reviewed)abstract
- The problem of computing the best rank-(p,q,r) approximation of a third order tensor is considered. First the problem is reformulated as a maximization problem on a product of three Grassmann manifolds. Then expressions for the gradient and the Hessian are derived in a local coordinate system at a stationary point, and conditions for a local maximum are given. A first order perturbation analysis is performed using the Grassmann manifold framework. The analysis is illustrated in a few examples, and it is shown that the perturbation theory for the singular value decomposition is a special case of the tensor theory.
|
|
| 4. |
|
|
| 5. |
- Elden, Lars, et al.
(author)
-
The maximum likelihood estimate in reduced-rank regression
- 2005
-
In: Numerical Linear Algebra with Applications. - : Wiley. - 1070-5325 .- 1099-1506. ; 12:8, s. 731-741
-
Journal article (peer-reviewed)abstract
- In previous work by Stoica and Viberg the reduced-rank regression problem is solved in a maximum likelihood sense. The present paper proposes an alternative numerical procedure. The solution is written in terms of the principal angles between subspaces spanned by the data matrices. It is demonstrated that the solution is meaningful also in the case when the maximum likelihood criterion is not valid. A numerical example is given. Copyright (c) 2005 John Wiley & Sons, Ltd.
|
|
| 6. |
- Kucher, Kostiantyn, Dr. 1989-, et al.
(author)
-
Visualization of Swedish News Articles: A Design Study
- 2024
-
In: Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP '24). - : SciTePress. ; , s. 670-677
-
Conference paper (peer-reviewed)abstract
- The amount of available text data has increased rapidly in the past years, making it difficult for many users to find relevant information. To solve this, natural language processing (NLP) and text visualization methods have been developed, however, they typically focus on English texts only, while the support for low-resource languages is limited. The aim of this design study was to implement a visualization prototype for exploring a large number of Swedish news articles (made available by industrial collaborators), including the temporal and relational data aspects. Sketches of three visual representations were designed and evaluated through user tests involving both our collaborators and end-users (journalists). Next, an NLP pipeline was designed in order to support dynamic and hierarchical topic modeling. The final part of the study resulted in an interactive visualization prototype that uses a variation of area charts to represent topic evolution. The prototype was evaluated thr ough an internal case study and user tests with two groups of participants with the background in journalism and NLP. The evaluation results reveal the participants’ preference for the representation focusing on top topics rather than the topic hierarchy, while suggestions for future work relevant for Swedish text data visualization are also provided.
|
|
| 7. |
- Lindgren, David, et al.
(author)
-
Rank Reduction and Volume Minimization Approach to State-Space Subspace System Identification
- 2006
-
In: Signal Processing. - : Elsevier. - 0165-1684 .- 1872-7557. ; 86:11, s. 3275-3285
-
Journal article (peer-reviewed)abstract
- In this paper we consider the reduced rank regression problemsolved by maximum-likelihood-inspired state-space subspace system identification algorithms. We conclude that the determinant criterion is, due to potential rank-deficiencies, not general enough to handle all problem instances. The main part of the paper analyzes the structure of the reduced rank minimization problem and identifies signal properties in terms of geometrical concepts. A more general minimization criterion is considered, rank reduction followed by volume minimization. A numerically sound algorithm for minimizing this criterion is presented and validated on both simulated and experimental data.
|
|
| 8. |
|
|
| 9. |
- Lu, Zhengdong, et al.
(author)
-
Supervised Link Prediction Using Multiple Sources
- 2010
-
In: Proceedings of the IEEE International Conference on Data Mining (ICDM). ; , s. 923-928
-
Conference paper (peer-reviewed)abstract
- Link prediction is a fundamental problem in social network analysis and modern-day commercial applications such as Facebook and Myspace. Most existing research approaches this problem by exploring the topological structure of a social network using only one source of information. However, in many application domains, in addition to the social network of interest, there are a number of auxiliary social networks and/or derived proximity networks available. The contribution of the paper is twofold: (1) a supervised learning framework that can effectively and efficiently learn the dynamics of social networks in the presence of auxiliary networks; (2) a feature design scheme for constructing a rich variety of path-based features using multiple sources, and an effective feature selection strategy based on structured sparsity. Extensive experiments on three real-world collaboration networks show that our model can effectively learn to predict new links using multiple sources, yielding higher prediction accuracy than unsupervised and singlesource supervised models.
|
|
| 10. |
- Savas, Berkant, 1977-
(author)
-
Algorithms in data mining : reduced rank regression and classification by tensor methods
- 2005
-
Licentiate thesis (other academic/artistic)abstract
- In many fields of science, engineering, and economics large amounts of data are stored and there is a need to analyze these data in order to extract information for various purposes. Data mining is a general concept involving different tools for performing this kind of analysis. The development of mathematical models and efficient algorithms is of key importance. In this thesis, which consists of three appended manuscripts, we discuss algorithms for reduced rank regression and for classification in the context of tensor theory.The first two manuscripts deal with the reduced rank regression problem, which is encountered in the field of state-space subspace system identification. More specifically the problem iswhere A and B are given matrices and we want to find X under a certain rank condition that minimizes the determinant. This problem is not properly stated since it involves implicit assumptions on A and B so that (B - XA)(B - XA)T is never singular. This deficiency of the determinant criterion is fixed by generalizing the minimization criterion to rank reduction and volume minimization of the objective matrix. The volume of a matrix is defined as the product of its nonzero singular values. We give an algorithm that solves the generalized problem and identify properties of the input and output signals causing singularity on the objective matrix.Classification problems occur in many applications. The task is to determine the label or class of an unknown object. The third appended manuscript concerns with classification of hand written digits in the context of tensors or multidimensional data arrays. Tensor theory is also an area that attracts more and more attention because of the multidimensional structure of the collected data in a various applications. Two classification algorithms are given based on the higher order singular value decomposition (HOSVD). The main algorithm makes a data reduction using HOSVD of 98%- 99% prior the construction of the class models. The models are computed as a set of orthonormal bases spanning the dominant subspaces for the different classes. An unknown digit is expressed as a linear combination of the basis vectors. The amount of computations is fairly low and the performance reasonably good, 5% in error rate.
|
|
