From 4f590990b040cc764cb9f3af2a15ace86c2cc4d3 Mon Sep 17 00:00:00 2001 From: =?utf8?q?Barbora=20An=C4=8Dincov=C3=A1?= Date: Tue, 28 Nov 2017 14:02:31 +0100 Subject: [PATCH] doc: Add section about MDS cache limits Signed-off-by: Bara Ancincova (bara@redhat.com) --- doc/cephfs/cache-size-limits.rst | 15 +++++++++++++++ doc/cephfs/index.rst | 1 + 2 files changed, 16 insertions(+) create mode 100644 doc/cephfs/cache-size-limits.rst diff --git a/doc/cephfs/cache-size-limits.rst b/doc/cephfs/cache-size-limits.rst new file mode 100644 index 00000000000..4ea41443bcd --- /dev/null +++ b/doc/cephfs/cache-size-limits.rst @@ -0,0 +1,15 @@ +Understanding MDS Cache Size Limits +=================================== + +This section describes ways to limit MDS cache size. + +You can limit the size of the Metadata Server (MDS) cache by: + +* *A memory limit*: A new behavior introduced in the Luminous release. Use the `mds_cache_memory_limit` parameters. We recommend to use memory limits instead of inode count limits. +* *Inode count*: Use the `mds_cache_size` parameter. By default, limiting the MDS cache by inode count is disabled. + +In addition, you can specify a cache reservation by using the `mds_cache_reservation` parameter for MDS operations. The cache reservation is limited as a percentage of the memory or inode limit and is set to 5% by default. The intent of this parameter is to have the MDS maintain an extra reserve of memory for its cache for new metadata operations to use. As a consequence, the MDS should in general operate below its memory limit because it will recall old state from clients in order to drop unused metadata in its cache. + +The `mds_cache_reservation` parameter replaces the `mds_health_cache_threshold` in all situations except when MDS nodes sends a health alert to the Monitors indicating the cache is too large. By default, `mds_health_cache_threshold` is 150% of the maximum cache size. + +Be aware that the cache limit is not a hard limit. Potential bugs in the CephFS client or MDS or misbehaving applications might cause the MDS to exceed its cache size. The `mds_health_cache_threshold` configures the cluster health warning message so that operators can investigate why the MDS cannot shrink its cache. diff --git a/doc/cephfs/index.rst b/doc/cephfs/index.rst index c63364fd5cb..61f77f44aef 100644 --- a/doc/cephfs/index.rst +++ b/doc/cephfs/index.rst @@ -84,6 +84,7 @@ authentication keyring. Deployment best practices Administrative commands + Understanding MDS Cache Size Limits POSIX compatibility Experimental Features CephFS Quotas -- 2.47.3