Type of Document Dissertation Author Rafique, Muhammad Mustafa URN etd-09272011-232811 Title An Adaptive Framework for Managing Heterogeneous Many-Core Clusters Degree PhD Department Computer Science Advisory Committee
Advisor Name Title Butt, Ali R. A. Committee Chair Cameron, Kirk W. Committee Member Feng, Wu-Chun Committee Member Nazhandali, Leyla Committee Member Nikolopoulos, Dimitrios S. Committee Member Tilevich, Eli Committee Member Keywords
- Heterogeneous Computing
- High-Performance Computing
- Resource Sharing
- Resource Management and Scheduling
- Programming Models
Date of Defense 2011-09-22 Availability unrestricted AbstractThe computing needs and the input and result datasets of modern scientific and enterprise applications are growing exponentially. To support such applications, High-Performance Computing (HPC) systems need to employ thousands of cores and innovative data management. At the same time, an emerging trend in designing HPC systems is to leverage specialized asymmetric multicores, such as IBM Cell and AMD Fusion APUs, and commodity computational accelerators, such as programmable GPUs, which exhibit excellent price to performance ratio as well as the much needed high energy efficiency. While such accelerators have been studied in detail as stand-alone computational engines, integrating the accelerators into large-scale distributed systems with heterogeneous computing resources for data-intensive computing presents unique challenges and trade-offs. Traditional programming and resource management techniques cannot be directly applied to many-core accelerators in heterogeneous distributed settings, given the complex and custom instruction sets architectures, memory hierarchies and I/O characteristics of different accelerators. In this dissertation, we explore the design space of using commodity accelerators, specifically IBM Cell and programmable GPUs, in distributed settings for data-intensive computing and propose an adaptive framework for programming and managing heterogeneous clusters.
The proposed framework provides a MapReduce-based extended programming model for heterogeneous clusters, which distributes tasks between asymmetric compute nodes by considering workload characteristics and capabilities of individual compute nodes. The framework provides efficient data prefetching techniques that leverage general-purpose cores to stage the input data in the private memories of the specialized cores. We also explore the use of an advanced layered-architecture based software engineering approach and provide mixin-layers based reusable software components to enable easy and quick deployment of heterogeneous clusters. The framework also provides multiple resource management and scheduling policies under different constraints, e.g., energy-aware and QoS-aware, to support executing concurrent applications on multi-tenant heterogeneous clusters. When applied to representative applications and benchmarks, our framework yields significantly improved performance in terms of programming efficiency and optimal resource management as compared to conventional, hand-tuned, approaches to program and manage accelerator-based heterogeneous clusters.
Filename Size Approximate Download Time (Hours:Minutes:Seconds)
28.8 Modem 56K Modem ISDN (64 Kb) ISDN (128 Kb) Higher-speed Access Rafique_MM_D_2011.pdf 1.84 Mb 00:08:31 00:04:23 00:03:50 00:01:55 00:00:09
If you have questions or technical problems, please Contact DLA.