Software systems Codes Systematics Task analysis Runtime Industries Maintenance engineering
Background: Logging practices provide the ability to record valuable runtime information of software systems to support operations tasks such as service monitoring and troubleshooting. However, current logging practices face common challenges. On the one hand, although the importance of logging practices has been broadly recognized, most of them are still conducted in an arbitrary or ad-hoc manner, ending up with questionable or inadequate support to perform these tasks. On the other hand, considerable research effort has been carried out on logging practices, however, few of the proposed techniques or methods have been widely adopted in industry. Objective: This study aims to establish a comprehensive understanding of the research state of logging practices, with a focus on unveiling possible problems and gaps which further shed light on the potential future research directions. Method: We carried out a systematic mapping study on logging practices with 56 primary studies. Results: This study provides a holistic report of the existing research on logging practices by systematically synthesizing and analyzing the focus and inter-relationship of the existing research in terms of issues, research topics and solution approaches. Using 3W1H - W hy to log , W here to log , W hat to log and H ow well is the logging -as the categorization standard, we find that: (1) the best known issues in logging practices have been repeatedly investigated; (2) the issues are often studied separately without considering their intricate relationships; (3) the Where and What questions have attracted the majority of research attention while little research effort has been made on the Why and How well questions; and (4) the relationships between issues, research topics, and approaches regarding logging practices appear many-to-many, which indicates a lack of profound understanding of the issues in practice and how they should be appropriately tackled. Conclusions: This study indicates a need to advance the state of research on logging practices. For example, more research effort should be invested on why to log to set the anchor of logging practices as well as on how well is the logging to close the loop. In addition, a holistic process perspective should be taken into account in both the research and the adoption related to logging practices.
Details
Title
Logging Practices in Software Engineering: A Systematic Mapping Study
Creators
Shenghui Gu - Nanjing University
Guoping Rong - Nanjing University
He Zhang - Nanjing University
Haifeng Shen - Australian Catholic University
Publication Details
IEEE transactions on software engineering, Vol.49(2), pp.902-923
Publisher
IEEE
Grant note
2019YFE0105500 / National Key Research and Development Program of China
BE2021002-2 / Key Research and Development Program of Jiangsu Province
62072227 / National Natural Science Foundation of China (10.13039/501100001809)
BZ2020017 / Intergovernmental Bilateral Innovation Project of Jiangsu Province
309494 / Norges Forskningsråd; Research Council of Norway (10.13039/501100005416)
Identifiers
991013173313202368
Copyright
This work is licensed under a Creative Commons Attribution 4.0 License.
Academic Unit
Faculty of Science and Engineering
Language
English
Resource Type
Journal article
Logging Practices in Software Engineering: A Systematic Mapping Study