Sie befinden Sich nicht im Netzwerk der Universität Paderborn. Der Zugriff auf elektronische Ressourcen ist gegebenenfalls nur via VPN oder Shibboleth (DFN-AAI) möglich. mehr Informationen...
Computer networks (Amsterdam, Netherlands : 1999), 2021-01, Vol.184, p.107686, Article 107686
2021

Details

Autor(en) / Beteiligte
Titel
Scheduling coflows of multi-stage jobs under network resource constraints
Ist Teil von
  • Computer networks (Amsterdam, Netherlands : 1999), 2021-01, Vol.184, p.107686, Article 107686
Ort / Verlag
Amsterdam: Elsevier B.V
Erscheinungsjahr
2021
Link zum Volltext
Quelle
ScienceDirect Journals (5 years ago - present)
Beschreibungen/Notizen
  • As an emerging network abstraction, coflow greatly improves the communication performance of data-parallel computing jobs. Many existing studies have focused on the design of coflow scheduling to minimize the completion time of jobs. However, they treat the underlying network as a large non-blocking switch without considering the constraints of network resources, which may increase network bottlenecks, reduce link capacity utilization, and extend job completion time. In this paper, we take network resource constraints into account and study how to schedule coflows in multi-stage jobs with the objective of minimizing the total weighted job completion time. We first formalize this multi-stage job scheduling problem as nonlinear programming and prove its NP-hardness. By introducing a priority order of jobs using a linear programming relaxation-based approach, we propose a polynomial-time algorithm with a performance guarantee, which can achieve a constant approximation ratio in many typical scenarios. Simulation results based on a Facebook trace show that, compared with a state-of-the-art approach, our algorithm can shorten the average weighted job completion time by up to 48.46% and run faster by up to 19.12×.
Sprache
Englisch
Identifikatoren
ISSN: 1389-1286
eISSN: 1872-7069
DOI: 10.1016/j.comnet.2020.107686
Titel-ID: cdi_proquest_journals_2509308412

Weiterführende Literatur

Empfehlungen zum selben Thema automatisch vorgeschlagen von bX