| 61. |
- Banaee, Hadi, 1986-, et al.
(author)
-
Towards NLG for Physiological Data Monitoring with Body Area Networks
- 2013
-
In: 14th European Workshop on Natural Language Generation. ; , s. 193-197
-
Conference paper (peer-reviewed)abstract
- This position paper presents an on-goingwork on a natural language generationframework that is particularly tailored fornatural language generation from bodyarea networks. We present an overview ofthe main challenges when considering thistype of sensor devices used for at homemonitoring of health parameters. The paperpresents the first steps towards the implementationof a system which collectsinformation from heart rate and respirationusing a wearable sensor.
|
|
| 62. |
- Barua, Arnab, et al.
(author)
-
A Systematic Literature Review on Multimodal Machine Learning : Applications, Challenges, Gaps and Future Directions
- 2023
-
In: IEEE Access. - : Institute of Electrical and Electronics Engineers Inc.. - 2169-3536. ; 11, s. 14804-14831
-
Research review (peer-reviewed)abstract
- Multimodal machine learning (MML) is a tempting multidisciplinary research area where heterogeneous data from multiple modalities and machine learning (ML) are combined to solve critical problems. Usually, research works use data from a single modality, such as images, audio, text, and signals. However, real-world issues have become critical now, and handling them using multiple modalities of data instead of a single modality can significantly impact finding solutions. ML algorithms play an essential role in tuning parameters in developing MML models. This paper reviews recent advancements in the challenges of MML, namely: representation, translation, alignment, fusion and co-learning, and presents the gaps and challenges. A systematic literature review (SLR) was applied to define the progress and trends on those challenges in the MML domain. In total, 1032 articles were examined in this review to extract features like source, domain, application, modality, etc. This research article will help researchers understand the constant state of MML and navigate the selection of future research directions.
|
|
| 63. |
- Barua, Arnab, et al.
(author)
-
Multi-scale Data Fusion and Machine Learning for Vehicle Manoeuvre Classification
- 2023
-
In: ICSET 2023 - 2023 IEEE 13th International Conference on System Engineering and Technology, Proceeding. - : Institute of Electrical and Electronics Engineers Inc.. - 9798350340891 ; , s. 296-301
-
Conference paper (peer-reviewed)abstract
- Vehicle manoeuvre analysis is vital for road safety as it helps understand driver behaviour, traffic flow, and road conditions. However, classifying data from in-vehicle acquisition systems or simulators for manoeuvre recognition is complex, requiring data fusion and machine learning (ML) algorithms. This paper proposes a hybrid approach that combines multivariate multiscale entropy (MMSE) and one-dimensional convolutional neural networks (1D-CNNs). MMSE is utilised for early feature extraction and data fusion, and the extracted features are classified using 1D-CNNs, achieving an impressive 87% test accuracy in multiclass classification. This paper provides insights into improving vehicle manoeuvre classification using advanced ML techniques and data fusion methods to handle complex data sets effectively. Ultimately, this approach can enhance the understanding of driver behaviour, inform policy decisions, and develop more effective strategies to enhance road safety.
|
|
| 64. |
- Barua, Arnab, et al.
(author)
-
Second-Order Learning with Grounding Alignment : A Multimodal Reasoning Approach to Handle Unlabelled Data
- 2024
-
In: International Conference on Agents and Artificial Intelligence. - : Science and Technology Publications, Lda. ; , s. 561-572
-
Conference paper (peer-reviewed)abstract
- Multimodal machine learning is a critical aspect in the development and advancement of AI systems. However, it encounters significant challenges while working with multimodal data, where one of the major issues is dealing with unlabelled multimodal data, which can hinder effective analysis. To address the challenge, this paper proposes a multimodal reasoning approach adopting second-order learning, incorporating grounding alignment and semi-supervised learning methods. The proposed approach illustrates using unlabelled vehicular telemetry data. During the process, features were extracted from unlabelled telemetry data using an autoencoder and then clustered and aligned with true labels of neurophysiological data to create labelled and unlabelled datasets. In the semi-supervised approach, the Random Forest (RF) and eXtreme Gradient Boosting (XGBoost) algorithms are applied to the labelled dataset, achieving a test accuracy of over 97%. These algorithms are then used to predict labels for the unlabelled dataset, which is later added to the labelled dataset to retrain the model. With the additional prior labelled data, both algorithms achieved a 99% test accuracy. Confidence in predictions for unlabelled data was validated using counting samples based on the prediction score and Bayesian probability. RF and XGBoost scored 91.26% and 97.87% in counting samples and 98.67% and 99.77% in Bayesian probability, respectively.
|
|
| 65. |
- Barua, Shaibal, et al.
(author)
-
Automated EEG Artifact Handling with Application in Driver Monitoring
- 2017
-
In: IEEE journal of biomedical and health informatics. - : Institute of Electrical and Electronics Engineers Inc.. - 2168-2194 .- 2168-2208.
-
Journal article (peer-reviewed)abstract
- Automated analyses of electroencephalographic (EEG) signals acquired in naturalistic environments is becoming increasingly important in areas such as brain computer interfaces and behaviour science. However, the recorded EEG in such environments is often heavily contaminated by motion artifacts and eye movements. This poses new requirements on artifact handling. The objective of this paper is to present an automated EEG artifacts handling algorithm which will be used as a pre-processing step in a driver monitoring application. The algorithm, named ARTE (Automated aRTifacts handling in EEG), is based on wavelets, independent component analysis and hierarchical clustering. The algorithm is tested on a dataset obtained from a driver sleepiness study including 30 drivers and 540 30-minute 30-channel EEG recordings. The algorithm is evaluated by a clinical neurophysiologist, by quantitative criteria (signal quality index, mean square error, relative error and mean absolute error), and by demonstrating its usefulness as a pre-processing step in driver monitoring, here exemplified with driver sleepiness classification. All results are compared with a state of the art algorithm called FORCe. The quantitative and expert evaluation results show that the two algorithms are comparable and that both algorithms significantly reduce the impact of artifacts in recorded EEG signals. When artifact handling is used as a pre-processing step in driver sleepiness classification, the classification accuracy increased by 5% when using ARTE and by 2% when using FORCe. The advantage with ARTE is that it is data driven and does not rely on additional reference signals or manually defined thresholds, making it well suited for use in dynamic settings where unforeseen and rare artifacts are commonly encountered.
|
|
| 66. |
|
|
| 67. |
- Barua, Shaibal, et al.
(author)
-
Automatic driver sleepiness detection using EEG, EOG and contextual information
- 2019
-
In: Expert systems with applications. - : Elsevier Ltd. - 0957-4174 .- 1873-6793. ; 115, s. 121-135
-
Journal article (peer-reviewed)abstract
- The many vehicle crashes that are caused by driver sleepiness each year advocates the development of automated driver sleepiness detection (ADSD) systems. This study proposes an automatic sleepiness classification scheme designed using data from 30 drivers who repeatedly drove in a high-fidelity driving simulator, both in alert and in sleep deprived conditions. Driver sleepiness classification was performed using four separate classifiers: k-nearest neighbours, support vector machines, case-based reasoning, and random forest, where physiological signals and contextual information were used as sleepiness indicators. The subjective Karolinska sleepiness scale (KSS) was used as target value. An extensive evaluation on multiclass and binary classifications was carried out using 10-fold cross-validation and leave-one-out validation. With 10-fold cross-validation, the support vector machine showed better performance than the other classifiers (79% accuracy for multiclass and 93% accuracy for binary classification). The effect of individual differences was also investigated, showing a 10% increase in accuracy when data from the individual being evaluated was included in the training dataset. Overall, the support vector machine was found to be the most stable classifier. The effect of adding contextual information to the physiological features improved the classification accuracy by 4% in multiclass classification and by and 5% in binary classification.
|
|
| 68. |
- Barua, Shaibal, et al.
(author)
-
Classifying drivers' cognitive load using EEG signals
- 2017
-
In: Studies in Health Technology and Informatics. - : IOS Press. - 0926-9630 .- 1879-8365. - 9781614997603 ; 237, s. 99-106
-
Journal article (peer-reviewed)abstract
- A growing traffic safety issue is the effect of cognitive loading activities on traffic safety and driving performance. To monitor drivers' mental state, understanding cognitive load is important since while driving, performing cognitively loading secondary tasks, for example talking on the phone, can affect the performance in the primary task, i.e. driving. Electroencephalography (EEG) is one of the reliable measures of cognitive load that can detect the changes in instantaneous load and effect of cognitively loading secondary task. In this driving simulator study, 1-back task is carried out while the driver performs three different simulated driving scenarios. This paper presents an EEG based approach to classify a drivers' level of cognitive load using Case-Based Reasoning (CBR). The results show that for each individual scenario as well as using data combined from the different scenarios, CBR based system achieved approximately over 70% of classification accuracy.
|
|
| 69. |
- Barua, Shaibal, et al.
(author)
-
Clustering based Approach for Automated EEG Artifacts Handling
- 2015
-
In: Frontiers in Artificial Intelligence and Applications, vol. 278. - 9781614995883 ; , s. 7-16
-
Conference paper (peer-reviewed)abstract
- Electroencephalogram (EEG), measures the neural activity of the central nervous system, which is widely used in diagnosing brain activity and therefore plays a vital role in clinical and Brain-Computer Interface application. However, analysis of EEG signal is often complex since the signal recoding often contaminates with noises or artifacts such as ocular and muscle artifacts, which could mislead the diagnosis result. Therefore, to identify the artifacts from the EEG signal and handle it in a proper way is becoming an important and interesting research area. This paper presents an automated EEG artifacts handling approach, where it combines Independent Component Analysis (ICA) with a 2nd order clustering approach. Here, the 2nd order clustering approach combines the Hierarchical and Gaussian Picture Model clustering algorithm. The effectiveness of the proposed approach has been examined and observed on real EEG recording. According to result, the artifacts in the EEG signals are identified and removed successfully where the clean EEG signal shows acceptable considering visual inspection.
|
|
| 70. |
- Barua, Shaibal, et al.
(author)
-
Distributed Multivariate Physiological Signal Analytics for Driver´s Mental State Monitoring
- 2018
-
In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 225. - Cham : Springer International Publishing. - 9783319762128 ; , s. 26-33
-
Conference paper (peer-reviewed)abstract
- This paper presents a distributed data analytics approach for drivers’ mental state monitoring using multivariate physiological signals. Driver’s mental states such as cognitive distraction, sleepiness, stress, etc. can be fatal contributing factors and to prevent car crashes these factors need to be understood. Here, a cloud-based approach with heterogeneous sensor sources that generates extremely large data sets of physiological signals need to be handled and analyzed in a big data scenario. In the proposed physiological big data analytics approach, for driver state monitoring, heterogeneous data coming from multiple sources i.e., multivariate physiological signals are used, processed and analyzed to aware impaired vehicle drivers. Here, in a distributed big data environment, multi-agent case-based reasoning facilitates parallel case similarity matching and handles data that are coming from single and multiple physiological signal sources.
|
|
