Copyright © 2007 The Institute of Electronics, Information and Communication Engineers
Regular Section -- Papers -- Computer Systems |
Dynamic Task Flow Scheduling for Heterogeneous Distributed Computing: Algorithm and Strategy*
1 The author is with the School of Information Science, JAIST, Nomi-shi, 923–1292 Japan. E-mail: sun-wei{at}jaist.ac.jp, 2 The author is with the Peta-Scale Computing Research Center, Fujitsu Laboratories Ltd., Kawasaki-shi, 211–8588 Japan., 3 The author is with the Center of Information Science, JAIST, Nomi-shi, 923–1292 Japan.
 |
Abstract |
|---|
Heterogeneous distributed computing environments are well suited to meet the fast increasing computational demands. Task scheduling is very important for a heterogeneous distributed system to satisfy the large computational demands of applications. The performance of a scheduler in a heterogeneous distributed system normally has something to do with the dynamic task flow, that is, the scheduler always suffers from the heterogeneity of task sizes and the variety of task arrivals. From the long-term viewpoint it is necessary and possible to improve the performance of the scheduler serving the dynamic task flow. In this paper we propose a task scheduling method including a scheduling strategy which adapts to the dynamic task flow and a genetic algorithm which can achieve the short completion time of a batch of tasks. The strategy and the genetic algorithm work with each other to enhance the scheduler's efficiency and performance. We simulated a task flow with enough tasks, the scheduler with our strategy and algorithm, and the schedulers with other strategies and algorithms. We also simulated a complex scenario including the variant arrival rate of tasks and the heterogeneous computational nodes. The simulation results show that our scheduler achieves much better scheduling results than the others, in terms of the average waiting time, the average response time, and the finish time of all tasks.
Key Words: heterogeneous distributed computing, task scheduling, task flow, genetic algorithm, scheduling strategy
Manuscript received June 28, 2006. Manuscript revised November 20, 2006.
* This research is conducted as a program for the "21st Century COE Program" by Ministry of Education, Culture, Sports, Science and Technology, Japan.