An evaluation study on log parsing and its use in log mining
Refereed conference paper presented and published in conference proceedings


Times Cited
Altmetrics Information
.

Other information
AbstractLogs, which record runtime information of modern systems, are widely utilized by developers (and operators) in system development and maintenance. Due to the ever-increasing size of logs, data mining models are often adopted to help developers extract system behavior information. However, before feeding logs into data mining models, logs need to be parsed by a log parser because of their unstructured format. Although log parsing has been widely studied in recent years, users are still unaware of the advantages of different log parsers nor the impact of them on subsequent log mining tasks. Thus they often re-implement or even re-design a new log parser, which would be time-consuming yet redundant. To address this issue, in this paper, we study four log parsers and package them into a toolkit to allow their reuse. In addition, we obtain six insightful findings by evaluating the performance of the log parsers on five datasets with over ten million raw log messages, while their effectiveness on a real-world log mining task has been thoroughly examined.
All Author(s) ListHe P., Zhu J., He S., Li J., Lyu M.R.
Name of Conference46th IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2016
Start Date of Conference28/06/2016
End Date of Conference01/07/2016
Place of ConferenceToulouse
Country/Region of ConferenceFrance
Proceedings TitleDependable Systems and Networks (DSN), 2016 46th Annual IEEE/IFIP International Conference on
Detailed descriptionorganized by IEEE/IFIP,
Year2016
Month10
Day3
Pages654 - 661
eISBN9781467388917
eISSN2158-3927
LanguagesEnglish-United Kingdom

Last updated on 2021-08-01 at 01:06