From: Patrick Donnelly Date: Tue, 28 Apr 2026 22:25:44 +0000 (-0700) Subject: doc/start/os-recommendations: update for Umbrella and future releases X-Git-Url: http://git-server-git.apps.pok.os.sepia.ceph.com/?a=commitdiff_plain;h=ad50013d874a187d36b9a031183fafba5c8def96;p=ceph.git doc/start/os-recommendations: update for Umbrella and future releases Overhaul the OS recommendations documentation to reflect deployment practices and map out the support matrices for upcoming releases through Ceph X (24.x). Key changes include: * Emphasized container-based deployments: Added a new section strongly recommending containerized deployments via `cephadm` over legacy package-based installations to simplify upgrades and avoid host-level dependency conflicts. * Expanded support tables: Updated the Platforms and Container Hosts tables to include Umbrella (21.x), Vampire (22.x), W (23.x), and X (24.x). Removed EOL releases like Reef. * Added EOL visibility: Included End-of-Life dates for Linux distributions and anticipated EOL dates for Ceph releases to help administrators plan lifecycle events. * Updated OS targets: Added support tracking for Ubuntu 24.04 (Noble), Ubuntu 26.04, Ubuntu 28.04, Rocky Linux 10, and Rocky Linux 11. * Addressed CentOS transition: Added a warning that CentOS 10+ will no longer be built or tested by upstream. Documented that Rocky Linux 10 is the new default container base image for Umbrella, while clarifying that the bare-metal host OS can remain any supported distribution. * Added horizontal upgrade guidance: Introduced a new section outlining safe "horizontal" bare-metal OS upgrade paths (e.g., CentOS 9 to Rocky 10, Ubuntu 22.04 to 24.04) so users can safely migrate their nodes outside of Ceph version upgrade windows. AI-Assisted: Gemini Pro, through numerous prompts Signed-off-by: Patrick Donnelly --- diff --git a/doc/start/os-recommendations.rst b/doc/start/os-recommendations.rst index 0632c7c64a22..da0589c08cfd 100644 --- a/doc/start/os-recommendations.rst +++ b/doc/start/os-recommendations.rst @@ -4,6 +4,21 @@ OS Recommendations ==================== +Recommended Deployment Method: Containers via Cephadm +===================================================== + +The Ceph project strongly prefers and natively supports container-based +releases deployed via :ref:`cephadm `. While legacy package-based +installations (via ``.deb`` or ``.rpm``) are still supported, containerized +deployments are preferred for all new and existing clusters. + +Container-based deployments offer significant advantages, particularly +regarding cluster upgrades. Because Ceph and its dependencies are packaged into +immutable container images, you avoid host-level OS package conflicts, +dependency nightmares, and broken libraries. This decoupled architecture allows you +to upgrade your Ceph cluster seamlessly, independently of the underlying host +operating system's package manager. + Ceph Dependencies ================= @@ -50,28 +65,45 @@ distribution that includes a supported kernel and supported system startup framework, for example ``sysvinit`` or ``systemd``. Ceph is sometimes ported to non-Linux systems but these are not supported by the core Ceph effort. -+---------------+-------------------+----------------+---------------+ -| | Tentacle (20.2.z) | Squid (19.2.z) | Reef (18.2.z) | -+===============+===================+================+===============+ -| CentOS 9 | A | A | A | -+---------------+-------------------+----------------+---------------+ -| Debian 12 | C | C | C | -+---------------+-------------------+----------------+---------------+ -| Ubuntu 20.04 | | | A | -+---------------+-------------------+----------------+---------------+ -| Ubuntu 22.04 | A | A | A | -+---------------+-------------------+----------------+---------------+ -| MS Windows | D | D | D | -+---------------+-------------------+----------------+---------------+ - -- **A**: Ceph provides packages and has done comprehensive tests on the - software in them. -- **B**: Ceph provides packages and has done basic tests on the software - in them. -- **C**: Ceph provides packages only. No tests have been done on - these releases. -- **D**: Client packages are available from an external site but are not - maintained or tested by the core Ceph team. ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Distribution | Distribution EOL | Squid (19.2.z) | Tentacle (20.2.z) | Umbrella (21.x) | Vampire (22.x) | W (23.x) | X (24.x) | +| | | EOL: Sept 2026 | EOL: May 2027 | EOL: May 2028 | EOL: May 2029 | EOL: May 2030 | EOL: May 2031 | ++================+=========================+================+===================+=================+================+================+================+ +| CentOS 9 | `May 2027 `_ | A | A | Ae | | | | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Rocky 10 | `May 2035 `_ | | A in v20.2.2 | A | A | A | A | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Rocky 11 | May 2038* | | | | | | A | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Debian 12 | `Jun 2028 `_ | C | C | C | | | | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Debian 13 | `Jun 2030 `_ | | | C | C | C | C | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 22.04 | `Jun 2027 `_ | A | A | A | | | | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 24.04 | `Jun 2029 `_ | | Upcoming | A | A | A | | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 26.04 | `May 2031 `_ | | | | A | A | A | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 28.04 | Jun 2033* | | | | | | A | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| MS Windows | Varies | D | D | D | D | D | D | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ + + +**Table legend:** + +- **A**: Ceph provides packages and has done comprehensive tests on the software in them. +- **B**: Ceph provides packages and has done basic tests on the software in them. +- **C**: Ceph provides packages only. No tests have been done on these releases. +- **D**: Client packages are available from an external site but are not maintained or tested by the core Ceph team. +- **Ae**: It is expected that CentOS 9.stream will EOL before the Umbrella Ceph release is EOL. This means that CentOS 9.stream RPMs will no longer be generated for new minor releases of Umbrella when that occurs because CentOS deactivates its public repositories. It is strongly recommended to migrate to Rocky 10 or another supported distribution before that occurs. + +.. note:: Dates marked with * are anticipated based on standard 10-year Enterprise Linux lifecycles and 5-year Ubuntu LTS lifecycles. + +.. note:: Releases in the future are included for anticipated OS support and are not final. + +.. warning:: Starting with CentOS 10 Stream and onwards, CentOS will no longer be built for or tested on by the upstream Ceph project. Container Hosts --------------- @@ -79,13 +111,81 @@ Container Hosts This table shows the operating systems that support Ceph's official container images. -+---------------+-------------------+----------------+------------------+ -| | Tentacle (20.2.z) | Squid (19.2.z) | Reef (18.2.z) | -+===============+===================+================+==================+ -| CentOS 9 | H | H | H | -+---------------+-------------------+----------------+------------------+ -| Ubuntu 22.04 | H | H | H | -+---------------+-------------------+----------------+------------------+ ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Distribution | Distribution EOL | Squid (19.2.z) | Tentacle (20.2.z) | Umbrella (21.x) | Vampire (22.x) | W (23.x) | X (24.x) | +| | | EOL: Sept 2026 | EOL: May 2027 | EOL: May 2028 | EOL: May 2029 | EOL: May 2030 | EOL: May 2031 | ++================+=========================+================+===================+=================+================+================+================+ +| CentOS 9 | `May 2027 `_ | H | H | H | | | | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Rocky 10 | `May 2035 `_ | | H in v20.2.2 | H | H | H | H | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Rocky 11 | May 2038* | | | | | | H | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 22.04 | `Jun 2027 `_ | H | H | H | | | | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 24.04 | `Jun 2029 `_ | | Upcoming | H | H | H | | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 26.04 | `May 2031 `_ | | | | H | H | H | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ +| Ubuntu 28.04 | Jun 2033* | | | | | | H | ++----------------+-------------------------+----------------+-------------------+-----------------+----------------+----------------+----------------+ + +**Table legend:** - **H**: Ceph tests this distribution as a container host. +.. warning:: This does not indicate that the container image is built on that distribution. It means the container image is tested to run on that distribution. + + +Umbrella Container Base Image +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +Starting with the Umbrella release, the default base image for official Ceph +containers is Rocky Linux 10. Prior to Umbrella, CentOS 9 Stream had been used. + +As a cluster administrator, you **do not** need to run Rocky Linux 10 as the +host operating system to use these containers. The Rocky 10 base image is used +strictly for static package management and to bundle Ceph's internal +dependencies within the isolated container boundary. Because ``cephadm`` +leverages standard container runtimes (Podman or Docker), the Ceph container +will run smoothly on any supported container host OS (such as Ubuntu 24.04 or +CentOS 9), completely isolated from the host's native package manager. + + +Host Distribution Upgrades (Horizontal Paths) +============================================= + +When managing the lifecycle of your hardware, you will eventually need to +upgrade the underlying host operating system to avoid hitting an End-of-Life +(EOL) situation where packages cannot be upgraded. It is highly recommended to +plan these horizontal upgrades when the same version of Ceph packages exists +for both the old and new host operating system. + +Attempting to upgrade the host OS and the Ceph version simultaneously greatly +increases the risk of downtime and complicates troubleshooting. Ensure that +your current Ceph release supports both the old and new host operating systems +before beginning a horizontal node-by-node OS upgrade. + +Anticipated Horizontal OS Upgrade Paths +--------------------------------------- + ++--------------------------------------+--------------------------------------+---------------------------+ +| Current OS (EOL) | Target OS (EOL) | Ideal Ceph Release Window | ++======================================+======================================+===========================+ +| CentOS 9 (`May 2027 `_) | Rocky 10 (`May 2035 `_) | Tentacle, Umbrella | ++--------------------------------------+--------------------------------------+---------------------------+ +| Ubuntu 22.04 (`Jun 2027 `_) | Ubuntu 24.04 (`Jun 2029 `_) | Tentacle, Umbrella | ++--------------------------------------+--------------------------------------+---------------------------+ +| Ubuntu 24.04 (`Jun 2029 `_) | Ubuntu 26.04 (`May 2031 `_) | Vampire, W | ++--------------------------------------+--------------------------------------+---------------------------+ +| Ubuntu 26.04 (`May 2031 `_) | Ubuntu 28.04 (Jun 2033*) | X, Y | ++--------------------------------------+--------------------------------------+---------------------------+ +| Rocky 10 (`May 2035 `_) | Rocky 11 (May 2038*) | X, Y | ++--------------------------------------+--------------------------------------+---------------------------+ + + +.. _CentOS: https://www.centos.org/cl-vs-cs/ +.. _Debian_b: https://www.debian.org/releases/bookworm/ +.. _Debian_t: https://www.debian.org/releases/trixie/ +.. _Rocky: https://github.com/rocky-linux/wiki.rockylinux.org/blob/main/docs/rocky/version.md +.. _Ubuntu: https://ubuntu.com/about/release-cycle