Dynamic Decision Making in GPUs Using MSHRs
Join us for our upcoming Future Computing Seminar Series
Speaker: external pageProf. Masoumeh Ebrahimi, KTH Royal Institute of Technology, Sweden
Date: February 15th, 2023, 10:00 CET
Where: ETZ E 7
Abstract:
The emerging new applications, such as data mining and graph analysis, demand extra processing power at the hardware level. Conventional static task scheduling is no longer able to meet the requirements of such complicated applications. This inefficiency is a major concern when the application is supposed to run on a Graphics Processing Unit (GPU), where millions of instructions should be distributed among a limited number of processing cores. A non-optimal scheduling strategy leads to unfair load distribution among the GPU's processing cores. Consequently, while busy cores are stalled due to the lack of resources, waiting for their data from the main memory, other cores are idle, waiting for busy cores to complete their tasks. This leads to a significant number of stall and idle cycles, limiting the GPU performance to a large extent. In this presentation, I describe our perspective to near-data processing in GPU and then introduce a solution to balance the load among the GPU processing cores based on run-time information obtained from the Miss Status Holding Register (MSHR) tables, helping to move from static to dynamic task scheduling.
Speaker Bio:
Prof. Masoumeh (Azin) Ebrahimi is an Associate Professor at KTH Royal Institute of Technology, Sweden, Adjunct Professor at University of Turku, Finland, and Researcher at Ericsson, Sweden. She received her Ph.D. degree (with Honors) from the University of Turku, Finland, in 2013, and the joint M.B.A. degree from the University of Turku and the EIT-ICT School in 2015. Her main areas of interest include on-chip/off-chip interconnection networks, neural network accelerators, and distributed learning. She has published more than 100 articles in refereed journals, edited books and refereed conference proceedings, and is a co-inventor of 7 patents. She actively acts as Guest Editor, Organizer, and Program Chair in different venues and conferences