BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Memento EPFL//
BEGIN:VEVENT
SUMMARY:Fast\, accurate and flexible cluster scheduling with Firmament
DTSTART:20150617T151500
DTSTAMP:20260414T234958Z
UID:227f6376ec16dab4664cf0ca0bfd6993c1088ff27a36b771c951487f
CATEGORIES:Conferences - Seminars
DESCRIPTION:Malte Schwarzkopf\, University of Cambridge (UK)\nScheduling w
 ork on "warehouse-scale" clusters in modern data centres\nis a challenging
  undertaking: thousands of tasks must be placed\nrapidly\, and may interac
 t in complex ways on the cluster substrate\nconsisting of thousands of man
 y-core servers. Moreover\, existing\nschedulers typically tightly couple p
 olicy and implementation. An\nideal cluster scheduler would flexibly suppo
 rt used-defined scheduling\npolicies\, ensure high machine utilisation\, a
 void pathological\ninterference on shared resources\, and find the optimal
  assignments quickly.\nIn this talk\, I explain how we square this circle 
 in our Firmament\nscheduler. Firmament models the scheduling problem as an
  incremental\nminimum-cost\, maximum-flow optimisation. This approach cons
 iders all\npossible assignments concurrently and makes placement decisions
  that\nare optimal for the given scheduling policy. By modelling tasks'\np
 references and interactions as costs on a flow network representing\nthe c
 luster topology\, Firmament simultaneously optimises for multiple objectiv
 es.\nVia two case-studies\, I illustrate how this enables practical\, usef
 ul\nscheduling policies to be expressed concisely. To scale to large\nclus
 ters\, Firmament solves the optimisation problem incrementally. On\na Goog
 le cluster of 12\,500 machines\, this takes 200ms on average\, a\n10x impr
 ovement over solving the problem from scratch.\nUsing test-bed experiments
  on a physical cluster and trace-driven\nsimulation on a Google cluster\, 
 I show that Firmament is a flexible\nscheduling platform (supporting many 
 different policies) which makes\naccurate\, high-quality decisions (optima
 l with regards to the policy)\nat interactive time-scales (sub-second even
  at Google-scale).
LOCATION:BC 420 https://plan.epfl.ch/?room==BC%20420
STATUS:CONFIRMED
END:VEVENT
END:VCALENDAR