mesos-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ilya Pronin <>
Subject Re: Review Request 67914: Updated XFS disk isolator to reclaim project IDs after disk GC.
Date Fri, 13 Jul 2018 21:59:39 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated July 13, 2018, 2:59 p.m.)

Review request for mesos and James Peach.

Bugs: MESOS-9007

Repository: mesos

Description (updated)

Currently upon container destruction its project ID is unallocated by
the isolator and removed from the container work directory. However due
to API limitations we can't unset project IDs on symlinks that may exist
inside the directory. Because of that the project may still exist until
the container directory is garbage collected. If the project ID is
reused for a new container, any lingering symlinks that still have that
project ID will contribute to disk usage of the new container. Typically
symlinks don't take much space, but still this leads to inaccuracy in
disk space usage accounting.

This patch postpones project ID reclaiming until sandbox GC time. The
isolator periodically checks if sandboxes of terminated containers still
exist and deallocates project IDs of the ones that were removed. This
mechanism can be improved in the future if we introduce a way for the
isolators to learn about disk GCs.

Diffs (updated)

  src/slave/containerizer/mesos/isolators/xfs/disk.hpp 0891f7709aa4f98758a727856d58e6177d46adca

  src/slave/containerizer/mesos/isolators/xfs/disk.cpp 25f52a43b34b141bdaf7c448817423cf4264e22a

  src/slave/flags.hpp eeb9708f9ec76d83b6719541f4a012544c7c0cbe 
  src/slave/flags.cpp 58cdc0f1100fe244e5bf1036e1ccf39478d5d478 
  src/tests/containerizer/xfs_quota_tests.cpp bee0c2db7adc1dc7d774f9152931130093fe5b50 




Added `ROOT_XFS_QuotaTest.ProjectIDReclaiming` test that verifies that project ID is reclaimed
and reused after sandbox GC. Ran `sudo make check`.


Ilya Pronin

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message