Software Logs for Machine Learning in a DevOps Environment

System logs perform a critical function in software-intensive systems as logs record the state of the system and significant events in the system at important points in time. Unfortunately, log entries are typically created in an ad-hoc, unstructured and uncoordinated fashion, limiting their usefulness for analytics and machine learning. In a DevOps environment, especially, unmanaged evolution in log data structure causes frequent disruption of operations in automated data pipelines, dashboards and analytics. In this paper, we present the main challenges of contemporary approaches to generating, storing and managing the evolution of system logs data for large, complex, software-intensive systems based on an in-depth case study at a world-leading telecommunications company. Second, we present an approach for generating and managing the evolution of log data in a DevOps environment that does not suffer from the aforementioned challenges and is optimized for use in machine learning. Third, we provide validation of the approach based on expert interviews that confirm that the approach addresses the identified challenges and problems.

Bosch, Jan,1967Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)janbo (författare)
Telefonaktiebolaget L M EricssonChalmers tekniska högskola (creator_code:org_t)

Ingår i:Proceedings - 46th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2020, s. 29-33

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Annan data och i ...

TEKNIK OCH TEKNOLOGIER: TEKNIK OCH TEKNO ...; och Elektroteknik oc ...; och Datorsystem

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.