{"id":13085,"date":"2022-06-08T18:31:40","date_gmt":"2022-06-08T15:31:40","guid":{"rendered":"https:\/\/kifarunix.com\/?p=13085"},"modified":"2024-04-07T16:42:45","modified_gmt":"2024-04-07T13:42:45","slug":"install-and-setup-ceph-storage-cluster-on-ubuntu-2204","status":"publish","type":"post","link":"https:\/\/kifarunix.com\/install-and-setup-ceph-storage-cluster-on-ubuntu-2204\/","title":{"rendered":"Install and Setup Ceph Storage Cluster on Ubuntu 22.04"},"content":{"rendered":"\n<p>Follow through this post to learn how to install and setup Ceph storage cluster on Ubuntu 22.04. Ceph is a scalable distributed storage system designed for cloud infrastructure and web-scale&nbsp;<a href=\"https:\/\/docs.ceph.com\/docs\/master\/glossary\/#term-ceph-object-storage\" target=\"_blank\" rel=\"noreferrer noopener\">object storage<\/a>. It can also be used to provide&nbsp;<a href=\"https:\/\/docs.ceph.com\/docs\/master\/glossary\/#term-ceph-block-device\" target=\"_blank\" rel=\"noreferrer noopener\">Ceph Block Storage<\/a>&nbsp;as well as&nbsp;<a href=\"https:\/\/docs.ceph.com\/docs\/master\/glossary\/#term-ceph-file-system\" target=\"_blank\" rel=\"noreferrer noopener\">Ceph File System storage<\/a>.<\/p>\n\n\n\n<p>As of this blog post update, CEPH Reef is the current stable <a href=\"https:\/\/docs.ceph.com\/en\/latest\/releases\/\" target=\"_blank\" rel=\"noreferrer noopener\">release<\/a>.<\/p>\n\n\n\n<div class=\"wp-block-rank-math-toc-block\" id=\"rank-math-toc\"><h2>Table of Contents<\/h2><nav><ul><li><a href=\"#install-and-configure-ceph-storage-cluster-on-ubuntu-22-04\">Install and Configure Ceph Storage Cluster on Ubuntu 22.04<\/a><ul><li><a href=\"#the-ceph-storage-cluster-daemons\">The Ceph Storage Cluster Daemons<\/a><\/li><li><a href=\"#ceph-storage-cluster-deployment-methods\">Ceph Storage Cluster Deployment Methods<\/a><\/li><li><a href=\"#ceph-depolyment-requirements\">Ceph Depolyment Requirements<\/a><\/li><li><a href=\"#prepare-ceph-nodes-for-ceph-storage-cluster-deployment-on-ubuntu-22-04\">Prepare Ceph Nodes for Ceph Storage Cluster Deployment on Ubuntu 22.04<\/a><ul><li><a href=\"#our-ceph-storage-cluster-deployment-architecture\">Our Ceph Storage Cluster Deployment Architecture<\/a><\/li><li><a href=\"#ceph-storage-nodes-hardware-requirements\">Ceph Storage Nodes Hardware Requirements<\/a><\/li><li><a href=\"#attach-storage-disks-to-ceph-osd-nodes\">Attach Storage Disks to Ceph OSD Nodes<\/a><\/li><li><a href=\"#run-system-update\">Run System Update<\/a><\/li><li><a href=\"#set-hostnames-and-update-hosts-file\">Set Hostnames and Update Hosts File<\/a><\/li><li><a href=\"#set-time-synchronization\">Set Time Synchronization<\/a><\/li><li><a href=\"#install-ssh-server-on-each-node\">Install SSH Server on Each Node<\/a><\/li><li><a href=\"#install-python-3\">Install Python3<\/a><\/li><li><a href=\"#create-ceph-deployment-user-on-ceph-admin-node\">Create Ceph Deployment User on Ceph Admin Node<\/a><\/li><li><a href=\"#install-docker-ce-on-each-node\">Install Docker CE on Each Node<\/a><\/li><li><a href=\"#enable-root-login-on-other-nodes-from-ceph-admin-node\">Enable Root Login on Other Nodes from Ceph Admin Node<\/a><\/li><\/ul><\/li><li><a href=\"#setup-ceph-storage-cluster-on-ubuntu-22-04\">Setup Ceph Storage Cluster on Ubuntu 22.04<\/a><ul><li><a href=\"#install-cephadm-utility-on-ceph-admin-node\">Install\u00a0cephadm\u00a0Utility on Ceph Admin Node<\/a><\/li><li><a href=\"#initialize-ceph-cluster-monitor-on-ceph-admin-node\">Initialize Ceph Cluster Monitor On Ceph Admin Node<\/a><\/li><li><a href=\"#enable-ceph-cli\">Enable Ceph CLI<\/a><\/li><li><a href=\"#copy-ssh-keys-to-other-ceph-nodes\">Copy SSH Keys to Other Ceph Nodes<\/a><\/li><li><a href=\"#drop-into-ceph-cli\">Drop into Ceph CLI<\/a><\/li><li><a href=\"#add-ceph-monitor-node-to-ceph-cluster\">Add Ceph Monitor Node to Ceph Cluster<\/a><\/li><li><a href=\"#add-ceph-osd-nodes-to-ceph-cluster\">Add Ceph OSD Nodes to Ceph Cluster<\/a><\/li><li><a href=\"#list-ceph-cluster-nodes\">List Ceph Cluster Nodes;<\/a><\/li><li><a href=\"#attach-logical-storage-volumes-to-ceph-osd-nodes\">Attach Logical Storage Volumes to Ceph OSD Nodes<\/a><\/li><li><a href=\"#check-ceph-cluster-health\">Check Ceph Cluster Health<\/a><\/li><\/ul><\/li><li><a href=\"#accessing-ceph-admin-web-user-interface\">Accessing Ceph Admin Web User Interface<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"install-and-configure-ceph-storage-cluster-on-ubuntu-22-04\">Install and Configure Ceph Storage Cluster on Ubuntu 22.04<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"the-ceph-storage-cluster-daemons\">The Ceph Storage Cluster Daemons<\/h3>\n\n\n\n<p>Ceph Storage Cluster&nbsp;is made up of different daemons eas performing specific role.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Ceph Object Storage Daemon (OSD,&nbsp;<\/strong><code><strong>ceph-osd<\/strong><\/code><strong>)<\/strong>\n<ul class=\"wp-block-list\">\n<li>It provides ceph object data store.<\/li>\n\n\n\n<li>It also performs data replication , data recovery, rebalancing and provides storage information to Ceph Monitor.<\/li>\n\n\n\n<li>At least an OSD is required per storage device.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Ceph Monitor (<\/strong><code><strong>ceph-mon<\/strong><\/code><strong>)<\/strong>\n<ul class=\"wp-block-list\">\n<li>It maintains maps of the entire Ceph cluster state including monitor map, manager map, the OSD map, and the CRUSH map.<\/li>\n\n\n\n<li>manages authentication between daemons and clients.<\/li>\n\n\n\n<li>A Ceph cluster must contain a minimum of three running monitors in order to be both redundant and highly-available.&nbsp; If you have five or more nodes, it is recommended to run five monitors.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Ceph Manager<\/strong>&nbsp;(<strong><code>ceph-mgr<\/code><\/strong>)\n<ul class=\"wp-block-list\">\n<li>keeps track of runtime metrics and the current state of the Ceph cluster, including storage utilization, current performance metrics, and system load.<\/li>\n\n\n\n<li>manages and exposes Ceph cluster web dashboard and API.<\/li>\n\n\n\n<li>At least two managers are required for HA.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Ceph Metadata Server (MDS):<\/strong>\n<ul class=\"wp-block-list\">\n<li>Manages metadata for the Ceph File System (CephFS). Coordinates metadata access and ensures consistency across clients.<\/li>\n\n\n\n<li>One or more, depending on the requirements of the CephFS.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>RADOS Gateway (RGW):<\/strong>\n<ul class=\"wp-block-list\">\n<li>Also called \u201cCeph Object Gateway\u201d<\/li>\n\n\n\n<li>is a component of the Ceph storage system that provides object storage services with a RESTful interface. RGW allows applications and users to interact with Ceph storage using industry-standard APIs, such as the S3 (Simple Storage Service) API (compatible with Amazon S3) and the Swift API (compatible with OpenStack Swift).<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"ceph-storage-cluster-deployment-methods\">Ceph Storage Cluster Deployment Methods<\/h3>\n\n\n\n<p>There are different methods you can use to deploy Ceph storage cluster.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code><strong>cephadm<\/strong><\/code> leverages container technology (specifically, Docker containers) to deploy and manage Ceph services on a cluster of machines.<\/li>\n\n\n\n<li><strong><code>Rook<\/code><\/strong>&nbsp;deploys and manages Ceph clusters running in Kubernetes, while also enabling management of storage resources and provisioning via Kubernetes APIs.<\/li>\n\n\n\n<li><strong><code>ceph-ansible<\/code><\/strong>&nbsp;deploys and manages Ceph clusters using Ansible.<\/li>\n\n\n\n<li>ceph-salt&nbsp;installs Ceph using Salt and cephadm.<\/li>\n\n\n\n<li>jaas.ai\/ceph-mon&nbsp;installs Ceph using Juju.<\/li>\n\n\n\n<li>Installs Ceph via <a href=\"https:\/\/github.com\/openstack\/puppet-ceph\" target=\"_blank\" rel=\"noreferrer noopener\">Puppet<\/a>.<\/li>\n\n\n\n<li>Ceph can also be&nbsp;<a href=\"https:\/\/docs.ceph.com\/en\/latest\/install\/index_manual\/#install-manual\" target=\"_blank\" rel=\"noopener\">installed manually<\/a>.<\/li>\n<\/ul>\n\n\n\n<p>Use of cephadm and rooks are the recommended methods for deploying Ceph storage cluster.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"ceph-depolyment-requirements\">Ceph Depolyment Requirements<\/h3>\n\n\n\n<p>Depending on the deployment method you choose, there are different requirements for deploying Ceph storage cluster<\/p>\n\n\n\n<p>In this tutorial, we will use cephadm to install Ceph on Ubuntu 22.04<\/p>\n\n\n\n<p>Below are the requirements for deploying Ceph storage cluster via cephadm;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Python 3<\/li>\n\n\n\n<li>Systemd<\/li>\n\n\n\n<li>Podman or <a href=\"#install-docker-ce-on-ubuntu-22.04\">Docker for running containers<\/a> (<strong>we use docker in this setup<\/strong>)<\/li>\n\n\n\n<li><a href=\"https:\/\/kifarunix.com\/install-and-setup-ntp-server-on-ubuntu-22-04-debian-11\/\" target=\"_blank\" rel=\"noreferrer noopener\">Time synchronization (such as chrony or NTP)<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/docs.ceph.com\/en\/latest\/ceph-volume\/lvm\/prepare\/\" target=\"_blank\" rel=\"noreferrer noopener\">LVM2<\/a> for provisioning storage devices. You can still use raw disks or raw paritions WITHOUT filesystem if you want.<\/li>\n<\/ul>\n\n\n\n<p>All the required dependencies are installed automatically by the bootstrap process.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"prepare-ceph-nodes-for-ceph-storage-cluster-deployment-on-ubuntu-22-04\">Prepare Ceph Nodes for Ceph Storage Cluster Deployment on Ubuntu 22.04<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"our-ceph-storage-cluster-deployment-architecture\">Our Ceph Storage Cluster Deployment Architecture<\/h4>\n\n\n\n<p>The diagram below depicts our ceph storage cluster deployment architecture. In a typical production environment, you would have at least 3 monitor nodes as well as at least 3 OSDs.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"880\" height=\"700\" src=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2022\/02\/ceph-architecture-1.png\" alt=\"install and setup Ceph storage cluster\" class=\"wp-image-11663\" title=\"\" srcset=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2022\/02\/ceph-architecture-1.png?v=1645335159 880w, https:\/\/kifarunix.com\/wp-content\/uploads\/2022\/02\/ceph-architecture-1-768x611.png?v=1645335159 768w\" sizes=\"(max-width: 880px) 100vw, 880px\" \/><\/figure>\n\n\n\n<p>If your cluster nodes are in the same network subnet, <strong>cephadm<\/strong> will automatically add up to five monitors to the subnet, as new hosts are added to the cluster.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"ceph-storage-nodes-hardware-requirements\">Ceph Storage Nodes Hardware Requirements<\/h4>\n\n\n\n<p>Check the <a href=\"https:\/\/docs.ceph.com\/en\/latest\/start\/hardware-recommendations\/\" target=\"_blank\" rel=\"noreferrer noopener\">hardware recommendations page<\/a> for the Ceph storage cluster nodes hardware requirements.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"attach-storage-disks-to-ceph-osd-nodes\">Attach Storage Disks to Ceph OSD Nodes<\/h4>\n\n\n<div class=\"gb-container gb-container-b2481987\">\n\n<p>Each Ceph OSD node in our architecture above has unallocated LVM logical volumes of 100 GB each. Check <a href=\"https:\/\/kifarunix.com\/how-to-create-an-lvm-logical-volume\/\" target=\"_blank\" rel=\"noreferrer noopener\">how to create Logical volumes in Linux<\/a>.<\/p>\n\n<\/div>\n\n\n<pre class=\"wp-block-code\"><code>vdisplay ceph-vg<\/code><\/pre>\n\n\n\n<p>Sample output;<\/p>\n\n\n\n<pre class=\"scroll-box\"><code>  --- Logical volume ---\n  LV Path                \/dev\/ceph-vg\/ceph-lv\n  LV Name                ceph-lv\n  VG Name                ceph-vg\n  LV UUID                bxP17M-313C-sxsz-LIPf-xPoC-vXFg-KxgEE0\n  LV Write Access        read\/write\n  LV Creation host, time ceph-osd2, 2023-11-15 17:39:40 +0000\n  LV Status              available\n  # open                 0\n  <strong>LV Size                <100.00 GiB<\/strong>\n  Current LE             25599\n  Segments               1\n  Allocation             inherit\n  Read ahead sectors     auto\n  - currently set to     256\n  Block device           253:1\n<\/code><\/pre>\n\n\n\n<p>As already mentioned, you can use raw devices instead.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"run-system-update\">Run System Update<\/h4>\n\n\n\n<p>On all the nodes, update your system package cache.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>apt update<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"set-hostnames-and-update-hosts-file\">Set Hostnames and Update Hosts File<\/h4>\n\n\n\n<p>To begin with, setup up your nodes hostnames;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>hostnamectl set-hostname ceph-admin<\/code><\/pre>\n\n\n\n<p><strong>Set the respective hostnames on other nodes.<\/strong><\/p>\n\n\n\n<p>If you are not using DNS for name resolution, then update the hosts file accordingly.<\/p>\n\n\n\n<p>For example, in our setup, each node hosts file should contain the lines below;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>less \/etc\/hosts<\/code><\/pre>\n\n\n\n<pre class=\"scroll-sz\"><code>...\n192.168.122.240 ceph-admin\n192.168.122.45 ceph-mon\n192.168.122.231 ceph-osd1\n192.168.122.49 ceph-osd2\n<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"set-time-synchronization\">Set Time Synchronization<\/h4>\n\n\n\n<p>Ensure that the time on <strong>all the nodes<\/strong> is synchronized. Thus install Chrony on each and set it up such that all nodes uses the same NTP server.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>apt install chrony -y<\/code><\/pre>\n\n\n\n<p>Edit the Chrony configuration and set your NTP server by replacing the NTP server pools with your NTP server address.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>vim \/etc\/chrony\/chrony.conf<\/code><\/pre>\n\n\n\n<p>Define your NTP Server. Replace <strong>ntp.kifarunix-demo.com<\/strong> with your respective NTP server address.<\/p>\n\n\n\n<pre class=\"scroll-sz\"><code>...\n# pool ntp.ubuntu.com        iburst maxsources 4\n# pool 0.ubuntu.pool.ntp.org iburst maxsources 1\n# pool 1.ubuntu.pool.ntp.org iburst maxsources 1\n# pool 2.ubuntu.pool.ntp.org iburst maxsources 2\n<strong>pool ntp.kifarunix-demo.com iburst<\/strong>\n...\n<\/code><\/pre>\n\n\n\n<p>Restart Chronyd<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>systemctl restart chronyd<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"install-ssh-server-on-each-node\">Install SSH Server on Each Node<\/h4>\n\n\n\n<p>Ceph deployment through cephadm utility requires that an SSH server is installed on all the nodes.<\/p>\n\n\n\n<p>Ubuntu 22.04 comes with SSH server already installed. If not, install and start it as follows;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>apt install openssh-server<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>systemctl enable --now sshd<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"install-python-3\">Install Python3<\/h4>\n\n\n\n<p>Python is required to deploy Ceph on Ubuntu 22.04. Python 3 is installed by default on Ubuntu 22.04<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"create-ceph-deployment-user-on-ceph-admin-node\">Create Ceph Deployment User on Ceph Admin Node<\/h4>\n\n\n\n<p><strong>On the ceph admin node<\/strong>, create a ceph user with sudo rights required for installing ceph packages and configurations as shown below. Do not use the username&nbsp;<code>ceph<\/code>&nbsp;as it is reserved.<\/p>\n\n\n\n<p>Replace&nbsp;<code>cephadmin<\/code>&nbsp;username accordingly.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>useradd -m -s \/bin\/bash cephadmin<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>passwd cephadmin<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>echo \"cephadmin ALL=(ALL:ALL) NOPASSWD:ALL\" &gt;&gt; \/etc\/sudoers.d\/cephadmin<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>visudo -cf \/etc\/sudoers.d\/cephadmin<\/code><\/pre>\n\n\n\n<p>If you, <strong><code>\/etc\/sudoers.d\/cephadmin: parsed OK<\/code><\/strong>, then proceed. Otherwise, fix any error.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>chmod 0440 \/etc\/sudoers.d\/cephadmin<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"install-docker-ce-on-each-node\">Install Docker CE on Each Node<\/h4>\n\n\n\n<p id=\"install-docker-on-each-osd-nodes\">The cephadm utility is used to bootstrap a Ceph cluster and to manage ceph daemons deployed with systemd and Docker containers.<\/p>\n\n\n\n<p>Thus, <strong>on each Node<\/strong>, run the command below to install Docker CE;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo apt update<\/code><\/pre>\n\n\n\n<pre class=\"scroll-sz\"><code>sudo apt install apt-transport-https \\\n\tca-certificates \\\n\tcurl \\\n\tgnupg-agent \\\n\tsoftware-properties-common -y\n<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>curl -fsSL https:\/\/download.docker.com\/linux\/ubuntu\/gpg | \\\nsudo gpg --dearmor &gt; \/etc\/apt\/trusted.gpg.d\/docker-ce.gpg<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>echo \"deb &#91;arch=amd64] https:\/\/download.docker.com\/linux\/ubuntu $(lsb_release -sc) stable\" &gt; \/etc\/apt\/sources.list.d\/docker-ce.list<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo apt update<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo apt install docker-ce docker-ce-cli containerd.io -y<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo systemctl enable --now docker<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"enable-root-login-on-other-nodes-from-ceph-admin-node\">Enable Root Login on Other Nodes from Ceph Admin Node<\/h4>\n\n\n\n<p>In order to add other nodes to the Ceph cluster using Ceph Admin Node, you will have to use the root user account.<\/p>\n\n\n\n<p>Thus, on the Ceph Monitor, Ceph OSD nodes, enable root login from the Ceph Admin node;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>vim \/etc\/ssh\/sshd_config<\/code><\/pre>\n\n\n\n<p>Add the configs below, replacing the IP address for Ceph Admin accordingly.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>Match Address 192.168.122.240\n        PermitRootLogin yes<\/code><\/pre>\n\n\n\n<p>Reload ssh;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>systemctl reload sshd<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"setup-ceph-storage-cluster-on-ubuntu-22-04\">Setup Ceph Storage Cluster on Ubuntu 22.04<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"install-cephadm-utility-on-ceph-admin-node\">Install&nbsp;<code>cephadm<\/code>&nbsp;Utility on Ceph Admin Node<\/h4>\n\n\n\n<p><strong>On the Ceph admin node<\/strong>, you need to install the cephadm utility.<\/p>\n\n\n\n<p><em><a href=\"https:\/\/docs.ceph.com\/en\/latest\/cephadm\/#cephadm\" target=\"_blank\" rel=\"noopener\">Cephadm<\/a>&nbsp;installs and manages a Ceph cluster using containers and systemd, with tight integration with the CLI and dashboard GUI.<\/em><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><em>cephadm only supports Octopus and newer releases.<\/em><\/li>\n\n\n\n<li><em>cephadm is fully integrated with the new orchestration API and fully supports the new CLI and dashboard features to manage cluster deployment.<\/em><\/li>\n\n\n\n<li><em>cephadm requires container support (podman or docker) and Python 3<\/em>.<\/li>\n<\/ul>\n\n\n\n<p>To install cephadm on Ubuntu 22.04, you can EITHER do it using apt or simply downloading the binary and install it on the system.<\/p>\n\n\n\n<p>The method to use will depend on the versions of Ceph version you are deploying. For example, we are installing Ceph Reef in this guide. Ceph Reef, which is currently, as of this post update, version 18.2.0.<\/p>\n\n\n\n<p>If you check the cephadm utility provided by the default repos, it is a lower version;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>apt-cache policy cephadm<\/code><\/pre>\n\n\n\n<pre class=\"scroll-box\"><code>cephadm:\n  Installed: (none)\n  Candidate: 17.2.6-0ubuntu0.22.04.1\n  Version table:\n     17.2.6-0ubuntu0.22.04.1 500\n        500 http:\/\/de.archive.ubuntu.com\/ubuntu jammy-updates\/universe amd64 Packages\n     17.2.5-0ubuntu0.22.04.3 500\n        500 http:\/\/de.archive.ubuntu.com\/ubuntu jammy-security\/universe amd64 Packages\n     17.1.0-0ubuntu3 500\n        500 http:\/\/de.archive.ubuntu.com\/ubuntu jammy\/universe amd64 Packages\n<\/code><\/pre>\n\n\n\n<p>The surest way to install the latest version of cephadm is via installing the Ceph package repository;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>wget -q -O- 'https:\/\/download.ceph.com\/keys\/release.asc' | \\\ngpg --dearmor -o \/etc\/apt\/trusted.gpg.d\/cephadm.gpg<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>echo deb https:\/\/download.ceph.com\/debian-reef\/ $(lsb_release -sc) main \\\n&gt; \/etc\/apt\/sources.list.d\/cephadm.list<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>apt update<\/code><\/pre>\n\n\n\n<p>Confirm the version;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>apt-cache policy cephadm<\/code><\/pre>\n\n\n\n<pre class=\"scroll-box\"><code>cephadm:\n  Installed: (none)\n  Candidate: 18.2.0-1jammy\n  Version table:\n     18.2.0-1jammy 500\n        500 https:\/\/download.ceph.com\/debian-reef jammy\/main amd64 Packages\n     17.2.6-0ubuntu0.22.04.1 500\n        500 http:\/\/de.archive.ubuntu.com\/ubuntu jammy-updates\/universe amd64 Packages\n     17.2.5-0ubuntu0.22.04.3 500\n        500 http:\/\/de.archive.ubuntu.com\/ubuntu jammy-security\/universe amd64 Packages\n     17.1.0-0ubuntu3 500\n        500 http:\/\/de.archive.ubuntu.com\/ubuntu jammy\/universe amd64 Packages\n\n<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>apt install cephadm<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"initialize-ceph-cluster-monitor-on-ceph-admin-node\">Initialize Ceph Cluster Monitor On Ceph Admin Node<\/h4>\n\n\n\n<p>Your nodes are now ready to deploy a Ceph storage cluster. To begin with, switch to <strong><code>cephadmin<\/code><\/strong> user;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>su - cephadmin<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>whoami<\/code><\/pre>\n\n\n\n<p>Output;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>cephadmin<\/code><\/pre>\n\n\n\n<p>It is now time to bootstrap the Ceph cluster in order to create the first Ceph monitor daemon on Ceph admin node. Thus, run the command below, substituting the IP address with that of the Ceph admin node accordingly.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo cephadm bootstrap --mon-ip 192.168.122.240<\/code><\/pre>\n\n\n\n<pre class=\"scroll-box\"><code>Creating directory \/etc\/ceph for ceph.conf\nVerifying podman|docker is present...\nVerifying lvm2 is present...\nVerifying time synchronization is in place...\nUnit chrony.service is enabled and running\nRepeating the final host check...\npodman (\/usr\/bin\/podman) version 3.4.4 is present\nsystemctl is present\nlvcreate is present\nUnit chrony.service is enabled and running\nHost looks OK\nCluster fsid: 70d227de-83e3-11ee-9dda-ff8b7941e415\nVerifying IP 192.168.122.240 port 3300 ...\nVerifying IP 192.168.122.240 port 6789 ...\nMon IP `192.168.122.240` is in CIDR network `192.168.122.0\/24`\nMon IP `192.168.122.240` is in CIDR network `192.168.122.0\/24`\nInternal network (--cluster-network) has not been provided, OSD replication will default to the public_network\nPulling container image quay.io\/ceph\/ceph:v18...\nCeph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)\nExtracting ceph user uid\/gid from container image...\nCreating initial keys...\nCreating initial monmap...\nCreating mon...\nWaiting for mon to start...\nWaiting for mon...\nmon is available\nAssimilating anything we can from ceph.conf...\nGenerating new minimal ceph.conf...\nRestarting the monitor...\nSetting mon public_network to 192.168.122.0\/24\nWrote config to \/etc\/ceph\/ceph.conf\nWrote keyring to \/etc\/ceph\/ceph.client.admin.keyring\nCreating mgr...\nVerifying port 9283 ...\nVerifying port 8765 ...\nVerifying port 8443 ...\nWaiting for mgr to start...\nWaiting for mgr...\nmgr not available, waiting (1\/15)...\nmgr not available, waiting (2\/15)...\nmgr not available, waiting (3\/15)...\nmgr is available\nEnabling cephadm module...\nWaiting for the mgr to restart...\nWaiting for mgr epoch 5...\nmgr epoch 5 is available\nSetting orchestrator backend to cephadm...\nGenerating ssh key...\nWrote public SSH key to \/etc\/ceph\/ceph.pub\nAdding key to root@localhost authorized_keys...\nAdding host ceph-admin...\nDeploying mon service with default placement...\nDeploying mgr service with default placement...\nDeploying crash service with default placement...\nDeploying ceph-exporter service with default placement...\nDeploying prometheus service with default placement...\nDeploying grafana service with default placement...\nDeploying node-exporter service with default placement...\nDeploying alertmanager service with default placement...\nEnabling the dashboard module...\nWaiting for the mgr to restart...\nWaiting for mgr epoch 9...\nmgr epoch 9 is available\nGenerating a dashboard self-signed certificate...\nCreating initial admin user...\nFetching dashboard port number...\nCeph Dashboard is now available at:\n\n\t     URL: https:\/\/ceph-admin:8443\/\n\t    User: admin\n\tPassword: hnrpt41gff\n\nEnabling client.admin keyring and conf on hosts with \"admin\" label\nSaving cluster configuration to \/var\/lib\/ceph\/70d227de-83e3-11ee-9dda-ff8b7941e415\/config directory\nEnabling autotune for osd_memory_target\nYou can access the Ceph CLI as following in case of multi-cluster or non-default config:\n\n\tsudo \/usr\/sbin\/cephadm shell --fsid 70d227de-83e3-11ee-9dda-ff8b7941e415 -c \/etc\/ceph\/ceph.conf -k \/etc\/ceph\/ceph.client.admin.keyring\n\nOr, if you are only running a single cluster on this host:\n\n\tsudo \/usr\/sbin\/cephadm shell \n\nPlease consider enabling telemetry to help improve Ceph:\n\n\tceph telemetry on\n\nFor more information see:\n\n\thttps:\/\/docs.ceph.com\/en\/latest\/mgr\/telemetry\/\n\nBootstrap complete.\n<\/code><\/pre>\n\n\n\n<p>According to the <a href=\"https:\/\/docs.ceph.com\/en\/latest\/cephadm\/install\/#running-the-bootstrap-command\" target=\"_blank\" rel=\"noreferrer noopener\">documentation<\/a>, the bootstrap command;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><em>Create a monitor and manager daemon for the new cluster on the localhost.<\/em><\/li>\n\n\n\n<li><em>Generate a new SSH key for the Ceph cluster and add it to the root user\u2019s&nbsp;<code>\/root\/.ssh\/authorized_keys<\/code>&nbsp;file.<\/em><\/li>\n\n\n\n<li><em>Write a copy of the public key to&nbsp;<code>\/etc\/ceph\/ceph.pub<\/code>.<\/em><\/li>\n\n\n\n<li><em>Write a minimal configuration file to&nbsp;<code>\/etc\/ceph\/ceph.conf<\/code>. This file is needed to communicate with the new cluster.<\/em><\/li>\n\n\n\n<li><em>Write a copy of the&nbsp;<code>client.admin<\/code>&nbsp;administrative (privileged!) secret key to&nbsp;<code>\/etc\/ceph\/ceph.client.admin.keyring<\/code>.<\/em><\/li>\n\n\n\n<li><em>Add the&nbsp;<code>_admin<\/code>&nbsp;label to the bootstrap host. By default, any host with this label will (also) get a copy of&nbsp;<code>\/etc\/ceph\/ceph.conf<\/code>&nbsp;and&nbsp;<code>\/etc\/ceph\/ceph.client.admin.keyring<\/code>.<\/em><\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"enable-ceph-cli\">Enable Ceph CLI<\/h4>\n\n\n\n<p>When bootstrap command completes, a command for accessing Ceph CLI is provided. Execute that command to access Ceph CLI;<\/p>\n\n\n\n<pre class=\"scroll-sz\"><code>sudo \/usr\/sbin\/cephadm shell \\\n\t--fsid 70d227de-83e3-11ee-9dda-ff8b7941e415 \\\n\t-c \/etc\/ceph\/ceph.conf \\\n\t-k \/etc\/ceph\/ceph.client.admin.keyring\n<\/code><\/pre>\n\n\n\n<p>This drops you onto Ceph CLI;<\/p>\n\n\n\n<p>You can run the ceph commands eg to check the Ceph status;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>ceph -s<\/code><\/pre>\n\n\n\n<pre class=\"scroll-box\"><code>  cluster:\n    id:     70d227de-83e3-11ee-9dda-ff8b7941e415\n    health: HEALTH_WARN\n            mon ceph-admin is low on available space\n            OSD count 0 < osd_pool_default_size 3\n \n  services:\n    mon: 1 daemons, quorum ceph-admin (age 61m)\n    mgr: ceph-admin.ykkdly(active, since 59m)\n    osd: 0 osds: 0 up, 0 in\n \n  data:\n    pools:   0 pools, 0 pgs\n    objects: 0 objects, 0 B\n    usage:   0 B used, 0 B \/ 0 B avail\n    pgs:\n<\/code><\/pre>\n\n\n\n<p>You can exit the ceph CLI by pressing <strong>Ctrl+D<\/strong> or  type <strong>exit<\/strong> and press ENTER.<\/p>\n\n\n\n<p>There are other ways in which you can access the Ceph CLI. For example, you can run Ceph CLI commands using cephadm command.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo cephadm shell -- ceph -s<\/code><\/pre>\n\n\n\n<p><em>Or You could install Ceph CLI tools on the host;<\/em><\/p>\n\n\n\n<pre class=\"wp-block-code\"><code><em>sudo cephadm add-repo --release <\/em>reef<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code><em>sudo cephadm install ceph-common<\/em><\/code><\/pre>\n\n\n\n<p><em>With this method, then you can just ran the Ceph commands easily;<\/em><\/p>\n\n\n\n<pre class=\"wp-block-code\"><code><em>sudo ceph -s<\/em><\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"copy-ssh-keys-to-other-ceph-nodes\">Copy SSH Keys to Other Ceph Nodes<\/h4>\n\n\n\n<p>Copy the SSH key generated by the bootstrap command to Ceph Monitor, OSD1 and OSD2 root user account. Ensure Root Login is permitted on the Ceph monitor node.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ssh-copy-id -f -i \/etc\/ceph\/ceph.pub root@ceph-mon<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ssh-copy-id -f -i \/etc\/ceph\/ceph.pub root@ceph-osd1<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ssh-copy-id -f -i \/etc\/ceph\/ceph.pub root@ceph-osd2<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"drop-into-ceph-cli\">Drop into Ceph CLI<\/h4>\n\n\n\n<p>You can drop into the Ceph CLI to execute the next commands.<\/p>\n\n\n\n<pre class=\"scroll-sz\"><code>sudo \/usr\/sbin\/cephadm shell \\\n\t--fsid 70d227de-83e3-11ee-9dda-ff8b7941e415 \\\n\t-c \/etc\/ceph\/ceph.conf \\\n\t-k \/etc\/ceph\/ceph.client.admin.keyring\n<\/code><\/pre>\n\n\n\n<p>Or if you installed the ceph-common package, no need to drop into the cli as you can directly execute the ceph commands from the terminal.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"add-ceph-monitor-node-to-ceph-cluster\">Add Ceph Monitor Node to Ceph Cluster<\/h4>\n\n\n\n<p>At this point, we have just provisioned Ceph Admin node only. You can list all the hosts known to the Ceph ochestrator (ceph-mgr) using the command below<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch host ls<\/code><\/pre>\n\n\n\n<p>Sample output;<\/p>\n\n\n\n<pre class=\"scroll-sz\"><code>HOST        ADDR             LABELS  STATUS  \nceph-admin  192.168.122.240  _admin          \n1 hosts in cluster\n<\/code><\/pre>\n\n\n\n<p>So next, add the Ceph Monitor node to the cluster.<\/p>\n\n\n\n<p>Assuming you have copied the Ceph SSH public key, execute the command below to add the Ceph Monitor to the cluster;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch host add ceph-mon<\/code><\/pre>\n\n\n\n<p>Sample command output;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>Added host 'ceph-mon' with addr '192.168.122.45'<\/code><\/pre>\n\n\n\n<p>Next, label the host with its role (<em>remember our ceph-monitor also doubles up as an OSD, hence label mon\/osd0 below<\/em>);<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch host label add ceph-mon mon\/osd0<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"add-ceph-osd-nodes-to-ceph-cluster\">Add Ceph OSD Nodes to Ceph Cluster<\/h4>\n\n\n\n<p>Similarly, add the OSD Nodes to the cluster;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch host add ceph-osd1<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch host add ceph-osd2<\/code><\/pre>\n\n\n\n<p>Define their respective labels;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>for i in {1..2}; do sudo ceph orch host label add ceph-osd$i osd$i; done<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"list-ceph-cluster-nodes\">List Ceph Cluster Nodes;<\/h4>\n\n\n\n<p>You can list the Ceph cluster nodes;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch host ls<\/code><\/pre>\n\n\n\n<p>Sample output;<\/p>\n\n\n\n<pre class=\"scroll-box\"><code>HOST        ADDR             LABELS    STATUS  \nceph-admin  192.168.122.240  _admin            \nceph-mon    192.168.122.45   mon\/osd0          \nceph-osd1   192.168.122.231  osd1              \nceph-osd2   192.168.122.49   osd2              \n4 hosts in cluster\n<\/code><\/pre>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"attach-logical-storage-volumes-to-ceph-osd-nodes\">Attach Logical Storage Volumes to Ceph OSD Nodes<\/h4>\n\n\n\n<p>In our setup, we have unallocated logical volume of 100GB on each OSD node to be used as a backstore for OSD daemons.<\/p>\n\n\n\n<p>To attach the logical volumes to the OSD node, run the command below.&nbsp;<strong>Replace ceph-vg\/ceph-lv<\/strong>&nbsp;with Volume group and logical volume names accordingly. Otherwise, <a href=\"https:\/\/kifarunix.com\/how-to-deploy-ceph-storage-cluster-on-almalinux\/\" target=\"_blank\" rel=\"noreferrer noopener\">use the raw device path<\/a>.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch daemon add osd ceph-mon:ceph-vg\/ceph-lv<\/code><\/pre>\n\n\n\n<p>Command output;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>Created osd(s) 0 on host 'ceph-mon'<\/code><\/pre>\n\n\n\n<p>Repeat the same for the other OSD nodes.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch daemon add osd ceph-osd1:ceph-vg\/ceph-lv<\/code><\/pre>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph orch daemon add osd ceph-osd2:ceph-vg\/ceph-lv<\/code><\/pre>\n\n\n\n<p>The Ceph Nodes are now ready for OSD use.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"check-ceph-cluster-health\">Check Ceph Cluster Health<\/h4>\n\n\n\n<p>To verify the health status of the ceph cluster, simply execute the command&nbsp;<code>ceph s<\/code>&nbsp;on the admin node or even on each OSD node (if you have installed cephadm\/ceph commands there).<\/p>\n\n\n\n<p>To check Ceph cluster health status from the admin node;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo ceph -s<\/code><\/pre>\n\n\n\n<p>Sample output;<\/p>\n\n\n\n<pre class=\"scroll-box\"><code>  cluster:\n    id:     70d227de-83e3-11ee-9dda-ff8b7941e415\n    health: HEALTH_OK\n \n  services:\n    mon: 4 daemons, quorum ceph-admin,ceph-mon,ceph-osd1,ceph-osd2 (age 28m)\n    mgr: ceph-admin.ykkdly(active, since 100m), standbys: ceph-mon.grwzmv\n    osd: 3 osds: 3 up (since 15m), 3 in (since 16m)\n \n  data:\n    pools:   1 pools, 1 pgs\n    objects: 2 objects, 449 KiB\n    usage:   81 MiB used, 300 GiB \/ 300 GiB avail\n    pgs:     1 active+clean \n<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"accessing-ceph-admin-web-user-interface\">Accessing Ceph Admin Web User Interface<\/h3>\n\n\n\n<p>The bootstrap commands give a url and credentials to use to access the Ceph admin web user interface;<\/p>\n\n\n\n<pre class=\"scroll-sz\"><code>Ceph Dashboard is now available at:\n\n\t     URL: https:\/\/ceph-admin:8443\/\n\t    User: admin\n\tPassword: hnrpt41gff\n<\/code><\/pre>\n\n\n\n<p>Thus, open the browser and navigate to the URL above. Or you can even use the cephadm node IP address if you want..<\/p>\n\n\n\n<p>Open the port on firewall if any is running.<\/p>\n\n\n\n<p>Enter the provided credential and reset your admin password and proceed to login to Ceph Admin UI.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1383\" height=\"850\" src=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-18-login-page.png?v=1700079083\" alt=\"\" class=\"wp-image-19276\" title=\"\" srcset=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-18-login-page.png?v=1700079083 1383w, https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-18-login-page-768x472.png?v=1700079083 768w\" sizes=\"(max-width: 1383px) 100vw, 1383px\" \/><\/figure>\n\n\n\n<p>If you want, you can activate the <a href=\"https:\/\/docs.ceph.com\/en\/latest\/mgr\/telemetry\/#telemetry-module\" target=\"_blank\" rel=\"noreferrer noopener\">telemetry module<\/a> by clicking <strong>Activate<\/strong> button or just from the CLI;<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>sudo cephadm shell -- ceph telemetry on --license sharing-1-0<\/code><\/pre>\n\n\n\n<p>Go through other Ceph menu to see more about Ceph.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1911\" height=\"714\" src=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2022\/02\/ceph-admin-UI.png\" alt=\"Install and Setup Ceph Storage Cluster on Ubuntu 22.04\" class=\"wp-image-11665\" title=\"\" srcset=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2022\/02\/ceph-admin-UI.png?v=1645335335 1911w, https:\/\/kifarunix.com\/wp-content\/uploads\/2022\/02\/ceph-admin-UI-768x287.png?v=1645335335 768w, https:\/\/kifarunix.com\/wp-content\/uploads\/2022\/02\/ceph-admin-UI-1536x574.png?v=1645335335 1536w\" sizes=\"(max-width: 1911px) 100vw, 1911px\" \/><\/figure>\n\n\n\n<p>Ceph Dashboard;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1391\" height=\"850\" src=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-dashboard.png?v=1700079159\" alt=\"\" class=\"wp-image-19277\" title=\"\" srcset=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-dashboard.png?v=1700079159 1391w, https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-dashboard-768x469.png?v=1700079159 768w\" sizes=\"(max-width: 1391px) 100vw, 1391px\" \/><\/figure>\n\n\n\n<p>Under the Cluster Menu, you can see quite other details; hosts, disks, OSDs etc.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1389\" height=\"848\" src=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-cluster.png?v=1700079270\" alt=\"\" class=\"wp-image-19278\" title=\"\" srcset=\"https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-cluster.png?v=1700079270 1389w, https:\/\/kifarunix.com\/wp-content\/uploads\/2023\/11\/ceph-reef-cluster-768x469.png?v=1700079270 768w\" sizes=\"(max-width: 1389px) 100vw, 1389px\" \/><\/figure>\n\n\n\n<p>There you go. That marks the end of our tutorial on how to install and setup Ceph storage cluster on Ubuntu 22.04.<\/p>\n\n\n\n<p>Reference<\/p>\n\n\n\n<p><a href=\"https:\/\/docs.ceph.com\/en\/latest\/cephadm\/install\/#deploying-a-new-ceph-cluster\" target=\"_blank\" rel=\"noreferrer noopener\">Deploying a new ceph cluster<\/a><\/p>\n\n\n\n<p>Other Tutorials<\/p>\n\n\n\n<p><a href=\"https:\/\/kifarunix.com\/install-and-setup-glusterfs-on-ubuntu\/\" target=\"_blank\" rel=\"noreferrer noopener\">Install and setup GlusterFS on Ubuntu 22.04\/Ubuntu 20.04<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/kifarunix.com\/easily-install-and-configure-samba-file-server-on-ubuntu-22-04\/\" target=\"_blank\" rel=\"noreferrer noopener\">Easily Install and Configure Samba File Server on Ubuntu 22.04<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Follow through this post to learn how to install and setup Ceph storage cluster on Ubuntu 22.04. Ceph is a scalable distributed storage system designed<\/p>\n","protected":false},"author":1,"featured_media":11667,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rank_math_lock_modified_date":false,"footnotes":""},"categories":[39,1338,121],"tags":[5356,5358,5355,5357],"class_list":["post-13085","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-storage","category-ceph","category-howtos","tag-ceph-cluster-ubuntu-22-04","tag-install-ceph-ubuntu-22-04","tag-setup-ceph-storage-ubuntu-22-04","tag-ubuntu-22-04-ceph-cluster","generate-columns","tablet-grid-50","mobile-grid-100","grid-parent","grid-50","resize-featured-image"],"_links":{"self":[{"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/posts\/13085"}],"collection":[{"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/comments?post=13085"}],"version-history":[{"count":21,"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/posts\/13085\/revisions"}],"predecessor-version":[{"id":22081,"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/posts\/13085\/revisions\/22081"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/media\/11667"}],"wp:attachment":[{"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/media?parent=13085"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/categories?post=13085"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kifarunix.com\/wp-json\/wp\/v2\/tags?post=13085"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}