Parallel and Distributed Systems Group

Computer Science Department of Telecom SudParis

StarPU: A Unified Platform for Task Scheduling on Heterogeneous Multicore Architectures

Reading group: Etienne Deveaux presented "StarPU: A Unified Platform for Task Scheduling on Heterogeneous Multicore Architectures" (EuroPar'09) at 1D19 the 2/12/2022 at 10h30.

Abstract

In the field of HPC, the current hardware trend is to design multiprocessor architectures that feature heterogeneous technologies such as specialized coprocessors (e.g., Cell/BE SPUs) or data-parallel accelerators (e.g., GPGPUs). Approaching the theoretical performance of these architectures is a complex issue. Indeed, substantial efforts have already been devoted to efficiently offload parts of the computations. However, designing an execution model that unifies all computing units and associated embedded memory remains a main challenge.

We have thus designed STAR PU, an original runtime system providing a high-level, unified execution model tightly coupled with an expressive data management library. The main goal of S TARPU is to provide numerical kernel designers with a convenient way to generate parallel tasks over heterogeneous hardware on the one hand, and easily develop and tune powerful scheduling algorithms on the other hand. We have developed several strategies that can be selected seamlessly at run time, and we have demonstrated their efficiency by analyzing the impact of those scheduling policies on several classical linear algebra algorithms that take advantage of multiple cores and GPUs at the same time. In addition to substantial improvements regarding execution times, we obtained consistent superlinear parallelism by actually exploiting the heterogeneous nature of the machine.