mesos-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James Peach <>
Subject Review Request 68587: Fixed fetcher deadlock with duplicate URIs.
Date Fri, 31 Aug 2018 16:47:16 GMT

This is an automatically generated e-mail. To reply, visit:

Review request for mesos, Gilbert Song and Joseph Wu.

Bugs: MESOS-9172

Repository: mesos


If a fetch request contains duplicate URIs that are not already
in the cache, the fetcher would erroneously expect that some other
fetch process is going to download that cache entry. It will then
wait for a Future that will never complete.

The fix is to track whether the cache entry was created in this
fetch, and in that case to simply allow the duplicate URI. In
the fetcher, we check the cache before downloading so that a URIs
can be fetched to distinct output files without being downloaded
multiple times.


  src/launcher/fetcher.cpp ef8d7ebdcf6d5d15459fd3392cb99774f078347a 
  src/slave/containerizer/fetcher.cpp 17f5388200c8341936cb4d7f8da67b5f286b727d 
  src/tests/fetcher_tests.cpp f3ea7092635c88b9dddcc2998a4c7350fb56110c 



make check (Fedora 28)


James Peach

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message