mesos-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Meng Zhu <m...@mesosphere.io>
Subject Review Request 69098: Added a benchmark to compare quota and nonquota allocation performance.
Date Sat, 20 Oct 2018 06:05:37 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69098/
-----------------------------------------------------------

Review request for mesos, Benjamin Mahler and Gastón Kleiman.


Bugs: MESOS-6630
    https://issues.apache.org/jira/browse/MESOS-6630


Repository: mesos


Description
-------

This benchmark evaluates the performance difference between nonquota
and quota settings. In both settings, the same allocations are made
for fair comparison.


Diffs
-----

  src/tests/hierarchical_allocator_benchmarks.cpp bf9167b63747f7b8a402d950947028436307082a



Diff: https://reviews.apache.org/r/69098/diff/1/


Testing
-------

Non-optimized build benchmark output: (more comprehensive evaluation result across versions
coming soon)

[ RUN      ] NonQuotaVsQuotaParam/HierarchicalAllocator_BENCHMARK_WithNonQuotaVsQuotaParam.NonQuotaVsQuota/0
Added 20 agents in 7.75017ms
Added 20 frameworks in 18.32336ms
Benchmark setup: 20 agents, 10 roles, 20 frameworks
Start nonQuota allocation
Made 20 allocations in 17.017677ms for nonquota roles
Start Quota allocation
Made 20 allocations in 50.428526ms for quota roles
[       OK ] NonQuotaVsQuotaParam/HierarchicalAllocator_BENCHMARK_WithNonQuotaVsQuotaParam.NonQuotaVsQuota/0
(99 ms)


[ RUN      ] NonQuotaVsQuotaParam/HierarchicalAllocator_BENCHMARK_WithNonQuotaVsQuotaParam.NonQuotaVsQuota/1
Added 200 agents in 45.158088ms
Added 200 frameworks in 649.806597ms
Benchmark setup: 200 agents, 100 roles, 200 frameworks
Start nonQuota allocation
Made 200 allocations in 293.943471ms for nonquota roles
Start Quota allocation
Made 200 allocations in 1.945455585secs for quota roles
[       OK ] NonQuotaVsQuotaParam/HierarchicalAllocator_BENCHMARK_WithNonQuotaVsQuotaParam.NonQuotaVsQuota/1
(2974 ms)


[ RUN      ] NonQuotaVsQuotaParam/HierarchicalAllocator_BENCHMARK_WithNonQuotaVsQuotaParam.NonQuotaVsQuota/2
Added 2000 agents in 310.070738ms
Added 2000 frameworks in 49.139360942secs
Benchmark setup: 2000 agents, 1000 roles, 2000 frameworks
Start nonQuota allocation
Made 2000 allocations in 19.216226126secs for nonquota roles
Start Quota allocation
Made 2000 allocations in 3.00175930081667mins for quota roles
[       OK ] NonQuotaVsQuotaParam/HierarchicalAllocator_BENCHMARK_WithNonQuotaVsQuotaParam.NonQuotaVsQuota/2
(250392 ms)


Thanks,

Meng Zhu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message