|
ИСТИНА |
Войти в систему Регистрация |
ФНКЦ РР |
||
Search for anomalies in the computational jobs of the ATLAS experiment with the application of visual analyticsстатья Исследовательская статья Электронная публикация
- Авторы: Grigorieva M.A., Alekseev A.A., Galkin T.P., Korchuganova T.A., Milman I.E., Pilyugin V.V., Titov M.A.
- Сборник: Selected Papers of the 8th International Conference "Distributed Computing and Grid-technologies in Science and Education"
- Серия: CEUR Workshop Proceedings (CEUR-WS.org)
- Том: 2267
- Год издания: 2018
- Место издания: CEUR-WS.org
- Первая страница: 99
- Последняя страница: 103
- Аннотация: ATLAS is the largest experiment at the LHC. It generates vast volumes of scientific data accompanied with auxiliary metadata, representing all stages of data processing, Monte-Carlo simulation, properties of detector and computing environment. Terabytes of metadata was accumulated by the workflow and data management, and metadata archiving systems. These metadata can help physicists carrying out studies to evaluate in advance the duration of their analysis jobs. As these jobs are executed in a heterogeneous distributed and dynamically changing infrastructure, their duration varies across computing centers and depends on many factors. Ensuring the uniformity in job execution requires searching for anomalies and analyzing the reasons of non-trivial job execution behavior to predict and avoid the recurrence in future. Detailed analysis of large volume of job execution benefits from application of machine learning and visual analysis methods. The approach of visual analytics technique was demonstrated on the analysis of jobs archive. The proposed method allowed to identify computing sites having non-trivial job execution process, and the visual cluster analysis showed parameters affecting or indicating possible time delays. Further work will concentrate on increasing of the amount of analyzed jobs and the development of interactive visual models, facilitating the interpretation of analysis results.
- Добавил в систему: Григорьева Мария Александровна