| 1. |
- Ickin, Selim, et al.
(author)
-
Catching the download train : Energy-efficient file downloading on smartphones
- 2014
-
Conference paper (peer-reviewed)abstract
- The most energy-consuming applications in battery life-constrained smartphones are the ones that comprise data transmission, especially via the 3G interface. Scheduling download activities on smartphones is especially necessary, if there are multiple asynchronous downloads scattered over a long duration. The latter scenario highly increases the energy consumption of smartphones. In this paper, we investigate energy consumption with the focus on file downloading while scheduling multiple file downloads in two scenarios: serialized and parallel. We repeat the experiments on a single smartphone via its 3G and also via WiFi tethering via another smartphone. We assess the performance of the two scenarios via measurement of power consumption and corresponding download duration in a realistic environment.
|
|
| 2. |
- Ickin, Selim, et al.
(author)
-
Demonstrating the Stalling Events with Instantaneous Total Power Consumption in Smartphone-based Live Video Streaming
- 2012
-
Conference paper (peer-reviewed)abstract
- The smartphone usage nearly tripled 2011 according to Cisco Virtual Networking Index. There is a high demand of energy for using popular mobile applications, which run on smartphones with limited battery life. Video streaming applications are widely used on mobile devices, and their high power consumption exhibits high variance during a live streaming session, due to varying conditions on network and application levels. Recent studies focus on the averaged power consumption statistics, while there is lack of observation on the fluctuations of the instantaneous total power consumption of the smart- phones. Network based applications consume power at all layers of the communication stack, and any fluctuation in the total power consumption during a video streaming can reveal a possible misbehaviour such as a stalling event. Until now, these events are investigated in Quality of Experience (QoE) studies through installation of high-energy demanding and hard-to-deploy network measurement tools on users’ mobile devices. In this paper, we demonstrate an ex- periment, where a user experiences a stalling event on the smartphone and observes the live instantaneous power consumption values through Mobile Power Monitoring Tool (MPMT) and Software Visualisa- tion Tool (SVT), simultaneously. We confer that the instantaneous total power consumption likely reveals the misbehaviours such as stalls during a video play- out in live video streaming on smartphones that can facilitate energy efficient QoE studies.
|
|
| 3. |
- Gustarini, Mattia, et al.
(author)
-
Evaluation of Challenges in Human Subject Studies “In-the-Wild” Using Subjects’ Personal Smartphones
- 2013
-
Conference paper (peer-reviewed)abstract
- The experimental setting of Human Mobile Computer Interaction (HCI) studies is moving from the controlled laboratory to the user’s daily-life environments, while employing the users’ own smartphones. These studies are challenging for both new and expert researchers in human subject studies in the HCI field. Within the last three years, we conducted three different smartphone- based user studies. From these studies, we have derived key challenges that we successfully overcame during their execution. In this paper, we present the outcomes and explain the adopted solutions for the challenges identified in the design, development and execution, and data analysis phases during the user studies. Our goal is to give newcomers and junior researchers a practical view on our conducted studies, and help practitioners to reflect on their own studies and possibly apply the proposed solutions.
|
|
| 4. |
- Ickin, Selim
(author)
-
Energy metrics unique enough for smartphone-based video QoE evaluation?
- 2012
-
In: Dagstuhl Reports. - Dagstuhl, Germany : Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik.
-
Conference paper (other academic/artistic)abstract
- This report documents the program and the outcomes of Dagstuhl Seminar 12181 "Quality of Experience: From User Perception to Instrumental Metrics". As follow-up of the Dagstuhl Seminar 09192 "From Quality of Service to Quality of Experience", it focused on the further development of an agreed definition of the term Quality of Experience (QoE) in collaboration with the COST Action IC1003 "Qualinet", as well as inventories of possibilities to measure QoE (beyond the usual user polls) and to exploit feedback between users and systems that reflects QoE issues. The report furthermore describes the mode of work throughout the seminar, with focus on personal statements by the participants, results of the group works, and open challenges.
|
|
| 5. |
- Ickin, Selim, et al.
(author)
-
Factors influencing quality of experience of commonly-used mobile applications
- 2012
-
In: IEEE Communications Magazine. - : IEEE. - 0163-6804. ; 50:4. Special Issue on QoE Man- agement in Emerging Multimedia Services, s. 48-56
-
Journal article (peer-reviewed)abstract
- Increasingly, we use mobile applications and services in our daily life activities, to support our needs for information, communication or leisure. However, user acceptance of a mobile application depends on at least two conditions; the application’s perceived experience and the appropriateness of the application to the user’s context and needs. Yet, we have a weak understanding of a mobile user’s Quality of Experience (QoE) and the factors influencing it. This paper presents 4 week long, 29 Android phone users study, where we collected both QoE and underlying network’s Quality of Service (QoS) measures through a combination of user, application and network data on the user’s phones. We aimed to derive and improve the understanding of users’ QoE for a set of widely used mobile applications in users’ natural environments and different daily context. We present data acquired in the study and discuss implications for mobile applications design.
|
|
| 6. |
- Ickin, Selim
(author)
-
Identification of Influential Factors on Android Smartphone-Based Video Quality of Experience
- 2013
-
Licentiate thesis (other academic/artistic)abstract
- Mobile handheld devices have become friends in people’s daily lives. Frequent usage of available applications, especially video streaming, causes exponential growth in mobile IP traffic. Service providers and application developers need to know the tradeoff between the end-to-end (e2e) performance and cost since, not fully met expectations of customers from those applications cause reduced usage of services, revenue, and growth in the churn rate. The user-centric approach, which involves users into the assessment of the performance of a particular service or application, has become important within the inter-disciplinary research field Quality of Experience (QoE). The ultimate goal is to obtain simplified QoE models on particular applications based on the underlying network-based performance metrics as well as other non-technical metrics related to the end-user. Android smartphones that use open-source code and well-documented Application Programming Interfaces (API), facilitate researchers to do low-level and network-based performance analysis on end-user mobile devices while considering user feedback. In this thesis, the influential factors for Android smartphone-based QoE are studied. The relation between the quantified user-perceived QoE metric, i.e., Mean Opinion Score (MOS), and the artifacts in real-time video streaming such as blockiness and jerkiness caused by network-level metrics, e.g., Packet Delay Variation (PDV), Maximal Burst Size (MBS), and video bit rate are identified. Challenges in assessing the user-perceived QoE of video with the focus on memory effects are discussed. The relation between the objective metric of user reaction time and the user-perceived QoE is presented. Furthermore, different methods to assess end-user-perceived QoE such as Day Reconstruction Method (DRM), Experience Sampling Method (ESM), and preliminary online survey are described. Further influential factors, e.g., context, user routines, user lifestyle, and Quality of Service (QoS) metrics such as Round Trip Time (RTT) and Server Response Time (SRT), are studied. The thesis is concluded with preliminary findings that relate the instantaneous total power consumption to the jerkiness of a real-time video stream with evidences such as stalling events.
|
|
| 7. |
- Ickin, Selim, et al.
(author)
-
On the Choice of Performance Metrics for User-Centric Seamless Communication
- 2010
-
Conference paper (peer-reviewed)abstract
- Being connected to a wireless access point is not enough; in addition, adequate per-application performance is expected. To achieve high user perception, it is necessary to adapt the ongoing connection to the frequently changing network conditions. Not only collecting Quality of Service (QoS) metrics but analyzing these on a per-technology basis is vital and so far not questioned much. In particular, for each type of network, a specific performance metric that correlates well with the user ratings can be identified.
|
|
| 8. |
- Ickin, Selim
(author)
-
Quality of Experience on Smartphones : Network, Application, and Energy Perspectives
- 2015
-
Doctoral thesis (other academic/artistic)abstract
- Smartphones have become crucial enablers for users to exploit online services such as learning, leisure, communicating, and socializing. The user-perceived quality of applications and services is an important factor to consider, in order to achieve lean resource management, to prevent user churn and revenue depletion of service or network providers. This is often studied within the scope of Quality of Experience (QoE), which has attracted researchers both in academia and industry. The objective of this thesis is to study the most important factors influencing QoE on smartphones and synthesize solutions for intervention. The temporal impairments during a real-time energy-hungry video streaming are studied. The aim is to quantify the influence of temporal impairments on the user-perceived video QoE at the network and application level together with energy measurements, and also to propose solutions to reduce smartphone energy consumption without degrading the user’s QoE on the smartphone for both user-interactive, e.g., video, and non-interactive cases. QoE measurements on smartphones are performed throughout in-the-wild user studies. A set of quantitative Quality of Experience (QoE) assessment tools are implemented and deployed for automatic data logging at the network- and application-level. Online momentary survey, Experience Sampling Method (ESM) software, and Day Reconstruction Method (DRM) along weekly face-to-face user interviews are employed. The subjective QoE is obtained through qualitative feedback including Mean Opinion Score (MOS) as well as in-situ indications of poor experiences by users. Additionally, energy measurements on smartphones are conducted in controlled-lab environment with the Monsoon device. The QoE of smartphone applications and services perceived by users depends on many factors including anomalies in the network, application, and also the energy consumption. At the network-level, high packet delay variation causes long video freezes that eventually impact negatively the end-user perceived quality. The freezes can be quantified as large time gaps in-between the displayed pictures during a video stream at the application-level. We show that the inter-picture time in cellular-based video stream can be represented via two-state exponential ON/OFF models. We show models representing the non-linear relationship between the QoE and the mean inter-picture time. It is shown that energy measurements help to reveal the temporal impairments in video stream enabling energy consumption as a QoE indicator. Next, energy waste and saving during temporal impairments are identified. Additionally, other video streaming use cases, e.g., “download first and watch later”, are studied and appropriate energy-saving download scheduling mechanisms are recommended. The possibility for decreasing energy consumption when the smartphone screen is OFF, while maintaining QoE, is revealed. We first show exponential models to represent user’s interaction with smartphone, then propose a NyxEnergySaver software, to control the cellular network interface in a personalized manner to save smartphone energy. According to our findings, more than 30% smartphone energy can be saved without impacting the user-perceived QoE.
|
|
| 9. |
- Ickin, Selim, et al.
(author)
-
Studying the challenges in assessing the perceived quality of mobile-phone based video
- 2012
-
Conference paper (peer-reviewed)abstract
- Evaluating video Quality of Experience (QoE) on a mobile phone has not yet been studied much. It is common that the data collected through user studies in mobile platform involves high fluctuation of user ratings without obvious reasons related to variation in network level. User disparity, user's various intermediate or previous experiences, video bitrate, and the objective measure of criticality are a few of the reasons that need to be identified with a well-designed user experiment. We present an experiment procedure to understand better the perceived quality of video in mobile platform. First, we investigate the reliability of the data, and identify unreliable users. Then, we investigate the psychological influence factors of previous experiences on the recent perceived quality known as the memory effect, and the influence of the bitrate on the time it takes for users to react and evaluate the video quality, i.e., user response time.
|
|
| 10. |
- Ickin, Selim, et al.
(author)
-
VLQoE : Video QoE instrumentation on the smartphone
- 2015
-
In: Multimedia tools and applications. - : Springer. - 1380-7501 .- 1573-7721. ; 74:2, s. 381-411
-
Journal article (peer-reviewed)abstract
- The usage of network-demanding applications is growing rapidly such as video streaming on mobile terminals. However, network and/or service providers might not guarantee the perceived quality for video streaming that demands high packet transmission rate. In order to satisfy the user expectations and to minimize user churn, it is important for network operators to infer the end-user perceived quality in video streaming. Today, the most reliable method to obtain end-user perceived quality is through subjective tests, and the preferred location is the user interface as it is the closest point of application to the end-user. The end-user perceived quality on video streaming is highly influenced by occasional freezes; technically the extraordinary time gaps between two consecutive pictures that are displayed to the user, i.e., high inter-picture time. In this paper, we present a QoE instrumentation for video streaming, VLQoE. We added functionality to the VLC player to record a set of metrics from the user interface, application-level, network-level, and from the available sensors of the device. To the best of our knowledge, VLQoE is the first tool of its kind that can be used in user experiments for video streaming. By using the tool, we present a two state model based on the inter-picture time, for the HTTP- and RTSP-based video streaming via 3.5G. Next, we studied the influence of inter-picture time on the user perceived quality through out a user study. We investigated the minimum user perceived inter-picture time, and the user response time.
|
|
