From reviews-return-2572-apmail-mesos-reviews-archive=mesos.apache.org@mesos.apache.org Tue Jun 9 17:31:23 2015 Return-Path: X-Original-To: apmail-mesos-reviews-archive@minotaur.apache.org Delivered-To: apmail-mesos-reviews-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E5F26187D1 for ; Tue, 9 Jun 2015 17:31:23 +0000 (UTC) Received: (qmail 13918 invoked by uid 500); 9 Jun 2015 17:31:23 -0000 Delivered-To: apmail-mesos-reviews-archive@mesos.apache.org Received: (qmail 13896 invoked by uid 500); 9 Jun 2015 17:31:23 -0000 Mailing-List: contact reviews-help@mesos.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: reviews@mesos.apache.org Delivered-To: mailing list reviews@mesos.apache.org Received: (qmail 13878 invoked by uid 99); 9 Jun 2015 17:31:23 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Jun 2015 17:31:23 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id 7BE0E1DF932; Tue, 9 Jun 2015 17:31:22 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============7429051532051285677==" MIME-Version: 1.0 Subject: Re: Review Request 35164: Added callback to the QoS Controller to retrieve usages from the monitor. From: "Bartek Plotka" To: "Niklas Nielsen" , "Vinod Kone" , "Szymon Konefal" , "Jie Yu" Cc: "Bartek Plotka" , "mesos" Date: Tue, 09 Jun 2015 17:31:22 -0000 Message-ID: <20150609173122.27736.16743@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: "Bartek Plotka" X-ReviewGroup: mesos X-ReviewRequest-URL: https://reviews.apache.org/r/35164/ X-Sender: "Bartek Plotka" References: <20150609003415.27735.65476@reviews.apache.org> In-Reply-To: <20150609003415.27735.65476@reviews.apache.org> Reply-To: "Bartek Plotka" X-ReviewRequest-Repository: mesos --===============7429051532051285677== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit > On June 9, 2015, 12:34 a.m., Jie Yu wrote: > > I think the interface of getting resource usage is going to change per discussion here: > > https://issues.apache.org/jira/browse/MESOS-2818 > > Niklas Nielsen wrote: > The new proposal doesn't mention changing the callback, does it? > > Jie Yu wrote: > The new protobuf message is what needed by the resource estimator: > ``` > message ResourceUsage { > message Executor { > optional ExecutorInfo executor_info = 1; > repeated Resource allocated = 2; > repeated ResourceStatistics statistics = 3; > } > > repeated Resource total = 1; // Slave's total resources. > repeated Executor executors = 2; // Per-executor allocated/usage information. > } > ``` > > So we'll need to change the interface accordingly. > > Niklas Nielsen wrote: > To rephrase, it is because we no longer have a list of ResourceUsages? Can you advise how to change accordingly? > Please make these kind of blocking comments actionable. We have traditionally spent way to much time getting blocked in the 11th hour (either having to redo completely or drop). We have to redo this for the resource estimator anyway; so that can be done in a single pass (moving from the previous pattern to the new one). > > Any recommendations? > > Jie Yu wrote: > > To rephrase, it is because we no longer have a list of ResourceUsages? > > Yes. > > I'll probably wait until the new interfaces are out and rebase since this is a relatively small patch. I'll get the changes out today. > > Although, I am ok if you want to commit this one (i'll need to rebase mine). Niklas +1 The only change will be s/list// for this patch and resource Estimator is todo anyway. Can we ship it and change when MESOS-2818 patch is ready? - Bartek ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/35164/#review87106 ----------------------------------------------------------- On June 5, 2015, 11:44 p.m., Bartek Plotka wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/35164/ > ----------------------------------------------------------- > > (Updated June 5, 2015, 11:44 p.m.) > > > Review request for mesos, Jie Yu, Niklas Nielsen, Szymon Konefal, and Vinod Kone. > > > Bugs: MESOS-2823 > https://issues.apache.org/jira/browse/MESOS-2823 > > > Repository: mesos > > > Description > ------- > > Passed callback to the QoS Controller to retrieve ResourceUsage from Resource Monitor on demand. > > This is neccessary, since QoS Controller needs data (current statistics for each executor) on which it will base its potential corrections. > > > Diffs > ----- > > include/mesos/slave/qos_controller.hpp 1d89acfd9c742b044674e0a0815f9f01eccb69b3 > src/slave/qos_controller.hpp b37798303561eb79aee202b9c110794517eeed06 > src/slave/qos_controller.cpp 81c4b3e658902be0438f42d9e86911e424828a73 > src/slave/slave.cpp 054929b156374a8929ac9fffb032045f13c3eb43 > src/tests/mesos.hpp 087953d6bc716f11c315a0736f06f712d7f69417 > > Diff: https://reviews.apache.org/r/35164/diff/ > > > Testing > ------- > > make check > > > Thanks, > > Bartek Plotka > > --===============7429051532051285677==--