A highly configurable and efficient simulator for job schedulers on supercomputers

Abstract

The supercomputers maintained by the Jülich Supercomputing Centre (JSC) are run in batch mode and are shared among all active users. Jobs are submitted to the job schedulerwhich determines for each job the time of execution. It manages run- ning and waiting jobssorts them by a given priority and executes the jobs by fitting them into the current system state. For users it is often difficult to comprehend the job scheduler’s algorithm. Thusa prediction of the future system allocation of cur- rently running and queued jobs is valuable. It helps users to plan job submissions and supports administrators by optimising the system load. This paper summarises the design and implementation of a configurable simulation for various job schedulers. The developed simulation program called JuFo focuses on the job schedulers Loadleveler and Moab as these are the most important batch sys- tems for the supercomputers provided by the JSC. A major design goal is to keep the simulation independent from special job schedulerswhich is achieved by the generic configuration of JuFo. Finallya test framework is developedwhich allows for evalu- ating the accuracy of the generated schedules.