| 1. |
- Barua, Arnab, et al.
(författare)
-
Second-Order Learning with Grounding Alignment : A Multimodal Reasoning Approach to Handle Unlabelled Data
- 2024
-
Ingår i: International Conference on Agents and Artificial Intelligence. - : Science and Technology Publications, Lda. ; , s. 561-572
-
Konferensbidrag (refereegranskat)abstract
- Multimodal machine learning is a critical aspect in the development and advancement of AI systems. However, it encounters significant challenges while working with multimodal data, where one of the major issues is dealing with unlabelled multimodal data, which can hinder effective analysis. To address the challenge, this paper proposes a multimodal reasoning approach adopting second-order learning, incorporating grounding alignment and semi-supervised learning methods. The proposed approach illustrates using unlabelled vehicular telemetry data. During the process, features were extracted from unlabelled telemetry data using an autoencoder and then clustered and aligned with true labels of neurophysiological data to create labelled and unlabelled datasets. In the semi-supervised approach, the Random Forest (RF) and eXtreme Gradient Boosting (XGBoost) algorithms are applied to the labelled dataset, achieving a test accuracy of over 97%. These algorithms are then used to predict labels for the unlabelled dataset, which is later added to the labelled dataset to retrain the model. With the additional prior labelled data, both algorithms achieved a 99% test accuracy. Confidence in predictions for unlabelled data was validated using counting samples based on the prediction score and Bayesian probability. RF and XGBoost scored 91.26% and 97.87% in counting samples and 98.67% and 99.77% in Bayesian probability, respectively.
|
|
| 2. |
- Barua, Arnab, et al.
(författare)
-
A Systematic Literature Review on Multimodal Machine Learning : Applications, Challenges, Gaps and Future Directions
- 2023
-
Ingår i: IEEE Access. - : Institute of Electrical and Electronics Engineers Inc.. - 2169-3536. ; 11, s. 14804-14831
-
Forskningsöversikt (refereegranskat)abstract
- Multimodal machine learning (MML) is a tempting multidisciplinary research area where heterogeneous data from multiple modalities and machine learning (ML) are combined to solve critical problems. Usually, research works use data from a single modality, such as images, audio, text, and signals. However, real-world issues have become critical now, and handling them using multiple modalities of data instead of a single modality can significantly impact finding solutions. ML algorithms play an essential role in tuning parameters in developing MML models. This paper reviews recent advancements in the challenges of MML, namely: representation, translation, alignment, fusion and co-learning, and presents the gaps and challenges. A systematic literature review (SLR) was applied to define the progress and trends on those challenges in the MML domain. In total, 1032 articles were examined in this review to extract features like source, domain, application, modality, etc. This research article will help researchers understand the constant state of MML and navigate the selection of future research directions.
|
|
| 3. |
- Barua, Arnab, et al.
(författare)
-
Entropy-driven cell decision-making predicts ‘fluid-to-solid’ transition in multicellular systems
- 2020
-
Ingår i: New Journal of Physics. - : Institute of Physics (IOP). - 1367-2630. ; 22:12, s. 123034-123034
-
Tidskriftsartikel (refereegranskat)abstract
- Cellular decision making allows cells to assume functionally different phenotypes in response to microenvironmental cues, with or without genetic change. It is an open question, how individual cell decisions influence the dynamics at the tissue level. Here, we study spatio-temporal pattern formation in a population of cells exhibiting phenotypic plasticity, which is a paradigm of cell decision making. We focus on the migration/resting and the migration/proliferation plasticity which underly the epithelial-mesenchymal transition and the go or grow dichotomy. We assume that cells change their phenotype in order to minimize their microenvironmental entropy following the LEUP (Least microEnvironmental Uncertainty Principle) hypothesis. In turn, we study the impact of the LEUP-driven migration/resting and migration/proliferation plasticity on the corresponding multicellular spatio-temporal dynamics with a stochastic cell-based mathematical model for the spatio-temporal dynamics of the cell phenotypes. In the case of the go or rest plasticity, a corresponding mean-field approximation allows to identify a bistable switching mechanism between a diffusive (fluid) and an epithelial (solid) tissue phase which depends on the sensitivity of the phenotypes to the environment. For the go or grow plasticity, we show the possibility of Turing pattern formation for the ‘solid’ tissue phase and its relation with the parameters of the LEUP-driven cell decisions.
|
|
| 4. |
- Barua, Arnab, et al.
(författare)
-
Multi-scale Data Fusion and Machine Learning for Vehicle Manoeuvre Classification
- 2023
-
Ingår i: ICSET 2023 - 2023 IEEE 13th International Conference on System Engineering and Technology, Proceeding. - : Institute of Electrical and Electronics Engineers Inc.. - 9798350340891 ; , s. 296-301
-
Konferensbidrag (refereegranskat)abstract
- Vehicle manoeuvre analysis is vital for road safety as it helps understand driver behaviour, traffic flow, and road conditions. However, classifying data from in-vehicle acquisition systems or simulators for manoeuvre recognition is complex, requiring data fusion and machine learning (ML) algorithms. This paper proposes a hybrid approach that combines multivariate multiscale entropy (MMSE) and one-dimensional convolutional neural networks (1D-CNNs). MMSE is utilised for early feature extraction and data fusion, and the extracted features are classified using 1D-CNNs, achieving an impressive 87% test accuracy in multiclass classification. This paper provides insights into improving vehicle manoeuvre classification using advanced ML techniques and data fusion methods to handle complex data sets effectively. Ultimately, this approach can enhance the understanding of driver behaviour, inform policy decisions, and develop more effective strategies to enhance road safety.
|
|
| 5. |
- Giorgi, Andrea, et al.
(författare)
-
Neurophysiological mental fatigue assessment for developing user-centered Artificial Intelligence as a solution for autonomous driving
- 2023
-
Ingår i: Frontiers in Neurorobotics. - : FRONTIERS MEDIA SA. - 1662-5218. ; 17
-
Tidskriftsartikel (refereegranskat)abstract
- The human factor plays a key role in the automotive field since most accidents are due to drivers' unsafe and risky behaviors. The industry is now pursuing two main solutions to deal with this concern: in the short term, there is the development of systems monitoring drivers' psychophysical states, such as inattention and fatigue, and in the medium-long term, there is the development of fully autonomous driving. This second solution is promoted by recent technological progress in terms of Artificial Intelligence and sensing systems aimed at making vehicles more and more accurately aware of their "surroundings." However, even with an autonomous vehicle, the driver should be able to take control of the vehicle when needed, especially during the current transition from the lower (SAE < 3) to the highest level (SAE = 5) of autonomous driving. In this scenario, the vehicle has to be aware not only of its "surroundings" but also of the driver's psychophysical state, i.e., a user-centered Artificial Intelligence. The neurophysiological approach is one the most effective in detecting improper mental states. This is particularly true if considering that the more automatic the driving will be, the less available the vehicular data related to the driver's driving style. The present study aimed at employing a holistic approach, considering simultaneously several neurophysiological parameters, in particular, electroencephalographic, electrooculographic, photopletismographic, and electrodermal activity data to assess the driver's mental fatigue in real time and to detect the onset of fatigue increasing. This would ideally work as an information/trigger channel for the vehicle AI. In all, 26 professional drivers were engaged in a 45-min-lasting realistic driving task in simulated conditions, during which the previously listed biosignals were recorded. Behavioral (reaction times) and subjective measures were also collected to validate the experimental design and to support the neurophysiological results discussion. Results showed that the most sensitive and timely parameters were those related to brain activity. To a lesser extent, those related to ocular parameters were also sensitive to the onset of mental fatigue, but with a delayed effect. The other investigated parameters did not significantly change during the experimental session.
|
|
| 6. |
- Mustafa, Adil, et al.
(författare)
-
Machine learning based microfluidic sensing device for viscosity measurements
- 2023
-
Ingår i: SENSORS & DIAGNOSTICS. - : ROYAL SOC CHEMISTRY. - 2635-0998. ; 2:6, s. 1509-1520
-
Tidskriftsartikel (refereegranskat)abstract
- A microfluidic sensing device utilizing fluid-structure interactions and machine learning algorithms is demonstrated. The deflection of microsensors due to fluid flow within a microchannel is analysed using machine learning algorithms to calculate the viscosity of Newtonian and non-Newtonian fluids. Newtonian fluids (glycerol/water solutions) within a viscosity range of 5-100 cP were tested at flow rates of 15-105 mL h-1 (gamma = 60.5-398.4 s-1) using a sample volume of 80-400 mu L. The microsensor deflection data were used to train machine learning algorithms. Two different machine learning (ML) algorithms, support vector machine (SVM) and k-nearest neighbour (k-NN), were employed to determine the viscosity of unknown Newtonian fluids and whole blood samples. An average accuracy of 89.7% and 98.9% is achieved for viscosity measurement of unknown solutions using SVM and k-NN algorithms, respectively. The intelligent microfluidic viscometer presented here has the potential for automated, real-time viscosity measurements for rheological studies. An increase in microsensor deflection with an increase in blood viscosity during coagulation.
|
|
