Tracing task‐based runtime systems: Feedbacks from the StarPU case

• Published in: Concurrency and computation Vol. 36; no. 3
• Main Authors: Denis, Alexandre, Jeannot, Emmanuel, Swartvagher, Philippe, Thibault, Samuel
• Format: Journal Article
• Language: English
• Published: Hoboken Wiley Subscription Services, Inc 01-02-2024; Wiley
• Subjects: Clock synchronization; Computer Science; Distributed, Parallel, and Cluster Computing; Tracing; Clock synchronization; Tracing systems; Distributed clocks; Task-based runtime systems; High-performance computing
• ISSN: 1532-0626; 1532-0634
• DOI: 10.1002/cpe.7920

Summary Given the complexity of current supercomputers and applications, being able to trace application executions to understand their behavior is not a luxury. As constraints, tracing systems have to be as little intrusive as possible in the application code and performances, and be precise enough in the collected data. In this article, we present how works the tracing system used by the task‐based runtime system StarPU . We study the different sources of performance overhead coming from the tracing system and how to reduce these overheads. Then, we evaluate the accuracy of distributed traces with different clock synchronization techniques. Finally, we summarize our experiments and conclusions with the lessons we learned to efficiently trace applications, and the list of characteristics each tracing system should feature to be competitive. The reported experiments and implementation details comprise a feedback of integrating into a task‐based runtime system state‐of‐the‐art techniques to efficiently and precisely trace application executions. We highlight the points every application developer or end‐user should be aware of to seamlessly integrate a tracing system or just trace application executions.