Details

Autor(en) / Beteiligte

• Sfiligoi, I

Titel

Estimating job runtime for CMS analysis jobs

Ist Teil von

• Journal of physics. Conference series, 2014-01, Vol.513 (3), p.32087-5

Ort / Verlag

Bristol: IOP Publishing

Erscheinungsjahr

2014

Link zum Volltext

Quelle

EZB Electronic Journals Library

Beschreibungen/Notizen

• The basic premise of pilot systems is to create an overlay scheduling system on top of leased resources. And by definition, leases have a limited lifetime, so any job that is scheduled on such resources must finish before the lease is over, or it will be killed and all the computation is wasted. In order to effectively schedule jobs to resources, the pilot system thus requires the expected runtime of the users' jobs. Past studies have shown that relying on user provided estimates is not a valid strategy, so the system should try to make an estimate by itself. This paper provides a study of the historical data obtained from the Compact Muon Solenoid (CMS) experiment's Analysis Operations submission system. Clear patterns are observed, suggesting that making prediction of an expected job lifetime range is achievable with high confidence level in this environment.