]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Prashant D [Tue, 21 Dec 2021 19:39:51 +0000 (14:39 -0500)]
doc/rados/operations: Document health check OSD_FILESTORE
Signed-off-by: Prashant D <pdhange@redhat.com>
Sridhar Seshasayee [Wed, 8 Dec 2021 07:36:28 +0000 (13:06 +0530)]
osd, mon/OSDMonitor: Force the scheduler type to 'wpq' for filestore OSDs
The 'mclock_scheduler' is not supported for filestore OSDs. Enforce the
usage of 'wpq' scheduler for such OSDs to avoid issues.
Also, in this scenario, the override of various config settings for the
'mclock_scheduler' are not performed.
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
Prashant D [Fri, 12 Nov 2021 13:44:27 +0000 (13:44 +0000)]
mon/OSDMonitor: Raise health warning for filestore osds
Filestore will be deprecated in Quincy, considering
that BlueStore has been the default objectstore for
quite some time.
Fixes: https://tracker.ceph.com/issues/49275
Signed-off-by: Prashant D <pdhange@redhat.com>
Sebastian Wagner [Wed, 5 Jan 2022 09:27:21 +0000 (10:27 +0100)]
Merge pull request #44193 from adk3798/agent-upgrade
mgr/cephadm: speed up upgrade when using agent
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Sebastian Wagner [Wed, 5 Jan 2022 09:26:01 +0000 (10:26 +0100)]
Merge pull request #44266 from adk3798/http-reconfig
mgr/cephadm: reconfig agents over http
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Sebastian Wagner [Wed, 5 Jan 2022 09:21:03 +0000 (10:21 +0100)]
Merge pull request #44367 from sebastian-philipp/osd-count-fix-again
mgr/cephadm: Fix count for OSDs with OSD specs
Reviewed-by: Adam King <adking@redhat.com>
Sebastian Wagner [Wed, 5 Jan 2022 09:19:43 +0000 (10:19 +0100)]
Merge pull request #44374 from fmount/ingress_vip
mgr/cephadm: spec.virtual_ip param should be used by the ingress daemon
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Alfonso Martínez [Wed, 5 Jan 2022 09:04:58 +0000 (10:04 +0100)]
Merge pull request #44442 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-simplebar-angular-2.3.6
mgr/dashboard: bump simplebar-angular from 2.3.0 to 2.3.6 in /src/pybind/mgr/dashboard/frontend
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Samuel Just [Wed, 5 Jan 2022 05:53:24 +0000 (21:53 -0800)]
Merge pull request #44361 from xxhdx1985126/wip-53612
crimson/os/seastore/cache: add lba nodes' logical begin addresses to extent_info_t
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Samuel Just [Wed, 5 Jan 2022 04:53:50 +0000 (20:53 -0800)]
Merge pull request #44458 from cyx1231st/wip-seastore-cleanup-with-empty-transactions
crimson/os/seastore: cleanup with empty transactions
Reviewed-by: Samuel Just <sjust@redhat.com>
Venky Shankar [Wed, 5 Jan 2022 04:23:25 +0000 (09:53 +0530)]
Merge pull request #44268 from lxbsz/mds-fix1
mds: set hb to NULL after the memory released
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Yingxin Cheng [Fri, 17 Dec 2021 05:43:50 +0000 (13:43 +0800)]
crimson/os/seastore: cleanup with empty transactions
* Add logs to identify OSD operation that submits transaction;
* Mark empty transactions as debug log;
* Misc cleanup;
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yuri Weinstein [Tue, 4 Jan 2022 22:43:05 +0000 (14:43 -0800)]
Merge pull request #44329 from ljflores/wip-telemetry-last-additions
mgr/telemetry: add heap stats and pool application to the perf channel
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Yuri Weinstein [Tue, 4 Jan 2022 22:42:41 +0000 (14:42 -0800)]
Merge pull request #43716 from kamoltat/wip-ksirivad-autoscale-global-flag
mgr/autoscaler: Introduce noautoscale flag
Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Laura Flores [Tue, 4 Jan 2022 17:21:59 +0000 (11:21 -0600)]
Merge pull request #44433 from sebastian-schmid/master
docs/start: fixes typo in hardware recommendation docs
Alfonso Martínez [Tue, 4 Jan 2022 16:24:44 +0000 (17:24 +0100)]
Merge pull request #43580 from rhcs-dashboard/cephadm_box-docs
cephadm/box: DiD box documentation
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: sebastian-philipp <sewagner@redhat.com>
Alfonso Martínez [Tue, 4 Jan 2022 16:22:56 +0000 (17:22 +0100)]
Merge pull request #43763 from rhcs-dashboard/cephadm_box
cephadm/box: Cephadm Docker in Docker dev box
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Alfonso Martínez [Tue, 4 Jan 2022 16:19:48 +0000 (17:19 +0100)]
Merge pull request #44449 from rhcs-dashboard/api-docs-e2e-test
mgr/dashboard: add test coverage for API docs (SwaggerUI)
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Sebastian Schmid [Sat, 1 Jan 2022 16:33:10 +0000 (17:33 +0100)]
docs/start: fixes typo and empty headline in hardware recommendation docs
Signed-off-by: Sebastian Schmid <mail@sebastian-schmid.de>
Alfonso Martínez [Tue, 4 Jan 2022 16:15:26 +0000 (17:15 +0100)]
Merge pull request #44428 from rhcs-dashboard/e2e-improvement
mgr/dashboard: stabilizing the cephadm dashboard e2e
Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Sebastian Wagner [Tue, 4 Jan 2022 15:11:54 +0000 (16:11 +0100)]
Merge pull request #44453 from sebastian-philipp/mypy-cheroot-import-ssl-fix
mgr/dashboard: cheroot now ships type hints
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Nizamudeen A [Thu, 30 Dec 2021 08:28:58 +0000 (13:58 +0530)]
mgr/dashboard: stabilizing the cephadm dashboard e2e
Reordering the tests and adding some more tests to verify the cluster is
healthy before proceeding to do some complex tasks like maintenance and
drain host
Fixes: https://tracker.ceph.com/issues/53742
Signed-off-by: Nizamudeen A <nia@redhat.com>
Sebastian Wagner [Tue, 4 Jan 2022 13:56:12 +0000 (14:56 +0100)]
mgr/dashboard: cheroot now ships type hints
Now we need to prevent mypy frm complainign about a duplicated import.
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
Venky Shankar [Tue, 4 Jan 2022 09:45:41 +0000 (15:15 +0530)]
Merge pull request #44067 from MrFreezeex/dirfrags-test
qa/suites/fs: add prefetch_dirfrags false to thrasher suite
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Tue, 4 Jan 2022 09:44:59 +0000 (15:14 +0530)]
Merge pull request #44255 from lxbsz/syncfs-44916
client: fix sync fs to force flush mdlog for all sessions
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Pere Diaz Bou [Tue, 4 Jan 2022 09:10:15 +0000 (10:10 +0100)]
cephadm/box: remove unnecessary bash files
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Venky Shankar [Tue, 4 Jan 2022 09:09:22 +0000 (14:39 +0530)]
Merge pull request #43618 from kotreshhr/recover-symlink
mds: Store symlink target in first data object
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Tue, 4 Jan 2022 09:07:59 +0000 (14:37 +0530)]
Merge pull request #44246 from yongseokoh/fix-prefetch-dirfrags
mds: split _prefetch_dirfrags to avoid heartbeat timeout during up:rejoin
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Tue, 4 Jan 2022 09:06:07 +0000 (14:36 +0530)]
Merge pull request #43236 from mchangir/mgr/snap_schedule-fix-db-connection-concurrent-usage
mgr/snap_schedule: fix db connection concurrent usage
Reviewed-by: Venky Shankar <vshankar@redhat.com>
dependabot[bot] [Mon, 3 Jan 2022 16:50:17 +0000 (16:50 +0000)]
mgr/dashboard: bump simplebar-angular
Bumps simplebar-angular from 2.3.0 to 2.3.6.
---
updated-dependencies:
- dependency-name: simplebar-angular
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Alfonso Martínez [Mon, 3 Jan 2022 16:47:13 +0000 (17:47 +0100)]
Merge pull request #44407 from ceph/dependabot/npm_and_yarn/src/pybind/mgr/dashboard/frontend/swagger-ui-4.1.3
build(deps): bump swagger-ui from 4.1.2 to 4.1.3 in /src/pybind/mgr/dashboard/frontend
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Alfonso Martínez [Mon, 3 Jan 2022 16:43:07 +0000 (17:43 +0100)]
mgr/dashboard: add test coverage for API docs (SwaggerUI)
Fixes: https://tracker.ceph.com/issues/53756
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Kefu Chai [Mon, 3 Jan 2022 15:31:24 +0000 (23:31 +0800)]
Merge pull request #44354 from tchaikov/cmake-cleanup
cmake: use new CMP0127 policy
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Laura Flores [Mon, 3 Jan 2022 15:16:32 +0000 (09:16 -0600)]
Merge pull request #43337 from ljflores/wip-bluestore-zero-detection
os/bluestore: detect unnecessary zeroes in bufferlist when data is written
Alfonso Martínez [Mon, 3 Jan 2022 13:17:27 +0000 (14:17 +0100)]
Merge pull request #44187 from rhcs-dashboard/wip-configure_dependabot-master
mgr/dashboard: configure dependabot
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Ilya Dryomov [Mon, 3 Jan 2022 09:06:06 +0000 (10:06 +0100)]
Merge pull request #44130 from LittleFox94/wip-doc-rbd-default-object-size
doc: how to change default rbd object size
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Nizamudeen A [Thu, 30 Dec 2021 05:55:58 +0000 (11:25 +0530)]
Merge pull request #44398 from rhcs-dashboard/e2e-script-improvement
mgr/dashboard: dashboard cephadm e2e improvement
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Nizamudeen A [Fri, 24 Dec 2021 05:39:37 +0000 (11:09 +0530)]
mgr/dashboard: dashboard cephadm e2e improvement
Fixes: https://tracker.ceph.com/issues/53742
Signed-off-by: Nizamudeen A <nia@redhat.com>
Yingxin [Wed, 29 Dec 2021 05:01:50 +0000 (13:01 +0800)]
Merge pull request #44403 from cyx1231st/wip-fix-crimson-args
crimson/osd: fix and improve args processing
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Tue, 28 Dec 2021 16:31:03 +0000 (00:31 +0800)]
Merge pull request #44396 from cyx1231st/wip-seastore-fix-seastar-runner
crimson/test: fix SeastarRunner when app is not started
Reviewed-by: Xuehan Xu <xuxuehan@360.cn>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Tue, 28 Dec 2021 11:55:41 +0000 (19:55 +0800)]
Merge pull request #44274 from fengchunsong/dpdk-dfx
msg/async/dpdk: add commands to obtain the NIC status and statistics
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Chunsong Feng [Fri, 10 Dec 2021 08:59:41 +0000 (08:59 +0000)]
msg/async/dpdk:add commands to obtain the NIC status and statistics
Commands are added to obtain the network adapter status and statistics
for debugging network adapter packet loss and mbuf insufficiency issues.
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe <hanfengzhe@hisilicon.com>
fengchunsong [Mon, 27 Dec 2021 23:53:19 +0000 (07:53 +0800)]
Merge pull request #44276 from fengchunsong/dpdk-affinity
common/numa: Skip the DPDK thread when setting NUMA affinity
Mara Sophie Grosch [Mon, 29 Nov 2021 14:00:23 +0000 (15:00 +0100)]
doc: add docs for rbd_default_order
Adds documentation how to change default rbd object size. With the
previous option `--order` it was easy to guess the config name for the
default value, with the current option name `--object-size` thats hard
to guess.
Also extends the documentation for rbd_default_order to include
* how object-size is derived from the configured value
* allowed range of the value
In the first version of this commit I also added min and max for this
parameter (12/25, matching the object size range in `man 8
rbd`/Striping/object-size), but this made some tests fail, since some
seem to set values outside this range (and probably are fine since
included for some time already). To have this a doc-change only, I
removed the range.
Signed-off-by: Mara Sophie Grosch <littlefox@lf-net.org>
Patrick Donnelly [Mon, 27 Dec 2021 17:55:30 +0000 (12:55 -0500)]
Merge PR #44342 into master
* refs/pull/44342/head:
mds: trigger stray reintegration when loading dentry
qa: test that scrub causes reintegration
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Chunsong Feng [Mon, 27 Dec 2021 13:03:21 +0000 (13:03 +0000)]
common/numa: Skip the DPDK thread when setting NUMA affinity
The CPU affinity of the DPDK thread has been set during DPDK initialization.
Do not modify the DPDK affinity when setting NUMA affinity.
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe <hanfengzhe@hisilicon.com>
Chunsong Feng [Fri, 10 Dec 2021 10:18:36 +0000 (10:18 +0000)]
msg/async: refactory rename_thread for DPDKStack
The thread_name of the DPDK thread has been set during DPDK initialization.
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe <hanfengzhe@hisilicon.com>
Ilya Dryomov [Mon, 27 Dec 2021 11:29:07 +0000 (12:29 +0100)]
Merge pull request #44243 from ideepika/wip-deepika-iscsi
qa/rbd: update the cephadm required distro
Reviewed-by: Melissa Li <melissali@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Yingxin Cheng [Fri, 24 Dec 2021 08:16:04 +0000 (16:16 +0800)]
crimson/osd: print message when customize parameters
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Fri, 24 Dec 2021 08:14:29 +0000 (16:14 +0800)]
crimson/osd: allow seastar application to print its helps
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Fri, 24 Dec 2021 08:12:13 +0000 (16:12 +0800)]
crimson/osd: --help-seastar does no longer belong to unknown_args
Now that app_template handles --help-seastar, and prints out all
app-level usages if --help is included in command line options. There is
no need to add a dedicated --help-seastar by ourselves and translate it
to --help.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Kefu Chai [Mon, 27 Dec 2021 09:14:58 +0000 (17:14 +0800)]
Merge pull request #44411 from tchaikov/wip-crimson-doc
doc: remove references to SEASTAR_DEFAULT_ALLOCATOR
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Kefu Chai [Sun, 26 Dec 2021 13:46:41 +0000 (21:46 +0800)]
Merge pull request #44333 from rzarzynski/wip-crimson-fix-recovery-discarding
crimson/osd: implement op discarding for pglog-based recovery.
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Kefu Chai [Sun, 26 Dec 2021 12:41:33 +0000 (20:41 +0800)]
Merge pull request #44275 from fengchunsong/dpdk-nic
msg/async/dpdk: add NIC whitelist configuration
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Sun, 26 Dec 2021 12:04:40 +0000 (20:04 +0800)]
Merge pull request #44285 from fengchunsong/dpdk-rte-init
msg/async/dpdk: handle DPDK initialization failure properly
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Chunsong Feng [Sat, 11 Dec 2021 01:11:18 +0000 (01:11 +0000)]
msg/async/dpdk:add the handling of DPDK initialization failure
If rte_eal_init returns with failure,the waiting msgr-worker thread is
woken up for exception handling.
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe <hanfengzhe@hisilicon.com>
Kefu Chai [Sun, 26 Dec 2021 05:11:06 +0000 (13:11 +0800)]
doc: remove references to SEASTAR_DEFAULT_ALLOCATOR
now that https://github.com/scylladb/seastar/commit/
067681b70172ab4a6676431b623e8bd0caab6dc8
has been merged upstream, and our src/seastar submodule includes
this commit. there is no need to worry that the seastar's lockless
allocator does not work with seastar::alien anymore.
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
Yingxin Cheng [Fri, 24 Dec 2021 03:05:30 +0000 (11:05 +0800)]
crimson/test: fix SeastarRunner when app is not started
Support the case when the SeastarRunner isn't able to start the app,
for example, when start with --help.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Chunsong Feng [Fri, 10 Dec 2021 02:27:58 +0000 (02:27 +0000)]
msg/async/dpdk: add NIC whitelist configuration
Each DPDK process uses some exclusive network adapters.The network adapters to
be used are specified in the whitelist to prevent data sharing between multiple
DPDK process.The following is an example:
1)Configure a single NIC.
-a 0000:7d:010 or --allow=0000:7d:010
2)Configure the Bond Network Adapter
ms_dpdk_port_options=--allow=0000:7d:01.0 --allow=0000:7d:02.6
--vdev=net_bonding0,mode=2,slave=0000:7d:01.0,slave=0000:7d:02.6
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Han Fengzhe <hanfengzhe@hisilicon.com>
Kefu Chai [Sat, 25 Dec 2021 08:44:07 +0000 (16:44 +0800)]
Merge pull request #44404 from inspur-wyq/wip-doc-mgr-zabbix
doc/mgr/zabbix.rst: fix typos
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
dependabot[bot] [Fri, 24 Dec 2021 15:39:49 +0000 (15:39 +0000)]
build(deps): bump swagger-ui in /src/pybind/mgr/dashboard/frontend
Bumps [swagger-ui](https://github.com/swagger-api/swagger-ui) from 4.1.2 to 4.1.3.
- [Release notes](https://github.com/swagger-api/swagger-ui/releases)
- [Commits](https://github.com/swagger-api/swagger-ui/compare/v4.1.2...v4.1.3)
---
updated-dependencies:
- dependency-name: swagger-ui
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
wangyunqing [Fri, 24 Dec 2021 09:10:11 +0000 (17:10 +0800)]
doc/mgr/zabbix.rst: fix typos
Signed-off-by: wangyunqing <wangyunqing@inspur.com>
Yingxin [Fri, 24 Dec 2021 03:41:02 +0000 (11:41 +0800)]
Merge pull request #44378 from cyx1231st/wip-seastore-onode-cleanup
crimson/os/seastore: fix potential leak for onodes to live across transactions
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Laura Flores [Fri, 24 Dec 2021 01:19:43 +0000 (01:19 +0000)]
test/objectstore: write unit tests for zero block detection
Unit tests include ZeroBlockDetectionSmall{Append/Overwrite} and ZeroBlockDetectionBig{Append/Overwrite}.
Signed-off-by: Laura Flores <lflores@redhat.com>
Laura Flores [Fri, 24 Dec 2021 01:18:13 +0000 (01:18 +0000)]
os/bluestore: detect unnecessary zeros in _do_write_big()
Bluestore's `_do_write()` method handles writing data from bufferlists. Currently, it writes data from bufferlists without checking for unnecessary zeros. The lack zero detection may negatively impact performance.
In _do_write_big, we also check if a bufferlist is made up of zeros and avoid writing it if so.
Two new counters, `l_bluestore_write_big_skipped_blobs` and `l_bluestore_write_big_skipped_bytes`, have been introduced to help us count how many zero blocks and bytes from _do_write_big() have been skipped.
Signed-off-by: Laura Flores <lflores@redhat.com>
Laura Flores [Fri, 24 Dec 2021 01:15:33 +0000 (01:15 +0000)]
os/bluestore: detect unnecessary zeros in _do_write_small()
Bluestore's `_do_write()` method handles writing data from bufferlists. Currently, it writes data from bufferlists without checking for unnecessary zeros. The lack zero detection may negatively impact performance.
In _do_write_small(), we check if a bufferlist is made up of zeros and avoid writing it if so.
Two new counters, `l_bluestore_write_small_skipped` and l_bluestore_write_small_skipped_bytes`, have been introduced to help us count how many zero blocks and bytes from _do_write_small() have been skipped.
Signed-off-by: Laura Flores <lflores@redhat.com>
Yuri Weinstein [Fri, 24 Dec 2021 00:44:43 +0000 (16:44 -0800)]
Merge pull request #44311 from ifed01/wip-ifed-cleanup-onode-pin
os/bluestore: get rid of fake onode nref increment for pinned entry
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Yuri Weinstein [Fri, 24 Dec 2021 00:44:06 +0000 (16:44 -0800)]
Merge pull request #44303 from 5cs/fix-new-state-weight
mon/OSDMonitor: fix incorrect op between osd state and weight
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Neha Ojha [Thu, 23 Dec 2021 23:34:22 +0000 (15:34 -0800)]
Merge pull request #44391 from anthonyeleven/anthonyeleven/correct-quay-url
doc/install: Update quay.io URL for ceph-ci builds
Reviewed-by: Neha Ojha <nojha@redhat.com>
Anthony D'Atri [Thu, 23 Dec 2021 20:11:25 +0000 (12:11 -0800)]
doc/install: Update quay.io URL for ceph-ci builds
Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
Yuri Weinstein [Thu, 23 Dec 2021 22:02:39 +0000 (14:02 -0800)]
Merge pull request #44352 from SMIL-Infra/journald
common: fix fmt::format_to deprecated warning
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yuri Weinstein [Thu, 23 Dec 2021 22:02:16 +0000 (14:02 -0800)]
Merge pull request #42896 from ifed01/wip-ifed-bluefs-improve-log
os/bluestore: dump alloc unit size on bluefs allocation failure.
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Yuri Weinstein [Thu, 23 Dec 2021 22:00:25 +0000 (14:00 -0800)]
Merge pull request #44353 from tchaikov/wip-str-map
common/str_map: reimplement get_str_list() using for_each_pair
Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Thu, 23 Dec 2021 21:59:36 +0000 (13:59 -0800)]
Merge pull request #44330 from rzarzynski/wip-osd-drop-includes
osd: drop unnecessary recovery / scrub includes from OSD.cc.
Reviewed-by: Neha Ojha <nojha@redhat.com>
Ernesto Puerta [Thu, 23 Dec 2021 16:23:18 +0000 (17:23 +0100)]
Merge pull request #44364 from rhcs-dashboard/e2e-fixups
mgr/dashboard: fix timeout error in dashboard cephadm e2e job
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Patrick Donnelly [Thu, 23 Dec 2021 13:52:10 +0000 (08:52 -0500)]
Merge PR #44322 into master
* refs/pull/44322/head:
mds: skip directory size checks for reintegration
qa: test reintegration with directory limits
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Kefu Chai [Thu, 23 Dec 2021 13:22:37 +0000 (21:22 +0800)]
Merge pull request #44375 from wjwithagen/wjw-fix-missing-utility
common: add missing #include <utility>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Nizamudeen A [Mon, 20 Dec 2021 09:14:29 +0000 (14:44 +0530)]
mgr/dashboard: fix timeout error in dashboard cephadm e2e job
1. Fix the timeout error happening in the dashboard e2e job
2. Take care of the flaky force maintenance check
Most of the time our test is getting timed out while searching for an item
in the table. Its because `.clear().type()` is not clearing the content
in the search field sometimes and that creates a wrong data to be
entered into the search field and it starts searching based on this
wrong name. To avoid this I am explicitly clearing the search area
before typing.
Fixes: https://tracker.ceph.com/issues/53672
Signed-off-by: Nizamudeen A <nia@redhat.com>
Kefu Chai [Thu, 23 Dec 2021 02:31:32 +0000 (10:31 +0800)]
Merge pull request #44365 from tchaikov/wip-seastar
seastar: pick up upstream change which includes cryptopp fix
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Kamoltat [Wed, 22 Dec 2021 21:42:52 +0000 (21:42 +0000)]
docs: Added noautoscale to docs + release notes
Updated the docs in
https://docs.ceph.com/en/latest/rados/operations/placement-groups/
and updated the release notes to reflect noautoscale flag.
Signed-off-by: Kamoltat <ksirivad@redhat.com>
Kamoltat [Wed, 8 Dec 2021 15:15:50 +0000 (15:15 +0000)]
qa: Added workunit test for noautoscale flag
set and unset the noautoscale flag,
evaluate if the results are what
we expected. As well as, evaluate
if the flag is correct when we
create new pools.
Signed-off-by: Kamoltat <ksirivad@redhat.com>
Kamoltat [Wed, 8 Dec 2021 15:13:38 +0000 (15:13 +0000)]
pybind/mgr/autoscaler: Introduce noautoscale flag
`noautoscale` flag is a feature where the
user can choose to flip the switch between
turning autoscale `on` and `off` for all
pools with a single command.
`osd pool set noautoscale` will turn all
autoscale mode`off` for all pools.
`osd pool unset noautoscale` will turn all
autoscale mode `on` for all pools.
Signed-off-by: Kamoltat <ksirivad@redhat.com>
Laura Flores [Thu, 16 Dec 2021 07:04:51 +0000 (07:04 +0000)]
mgr/telemetry: define an actual function for stats_per_pg
This creates uniformity among the other functions, and makes it
so we can easily edit the content of this function if needed.
Signed-off-by: Laura Flores <lflores@redhat.com>
Laura Flores [Thu, 16 Dec 2021 06:56:26 +0000 (06:56 +0000)]
mgr/telemetry: add application to stats_per_pool
Signed-off-by: Laura Flores <lflores@redhat.com>
Laura Flores [Wed, 15 Dec 2021 20:46:35 +0000 (20:46 +0000)]
mgr/telemetry: add heap_stats
Signed-off-by: Laura Flores <lflores@redhat.com>
Patrick Donnelly [Wed, 22 Dec 2021 19:08:26 +0000 (14:08 -0500)]
Merge PR #44324 into master
* refs/pull/44324/head:
qa: set quincy require-osd-release to avoid health warning
Reviewed-by: Neha Ojha <nojha@redhat.com>
Patrick Donnelly [Wed, 22 Dec 2021 19:05:03 +0000 (14:05 -0500)]
Merge PR #44313 into master
* refs/pull/44313/head:
mds: support '~mds{rank number}' for dump tree
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Wed, 22 Dec 2021 19:03:37 +0000 (14:03 -0500)]
Merge PR #43881 into master
* refs/pull/43881/head:
osdc: add set_error in BufferHead, when split set_error to right
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Neha Ojha [Wed, 22 Dec 2021 18:48:00 +0000 (10:48 -0800)]
Merge pull request #44372 from DimitriPapadopoulos/codespell_examples
examples: typos found by codespell
Reviewed-by: Laura Flores <lflores@redhat.com>
Neha Ojha [Wed, 22 Dec 2021 18:06:28 +0000 (10:06 -0800)]
Merge pull request #44241 from kamoltat/wip-ksirivad-pool-bulk-flag
mon: osd pool create <pool-name> with --bulk flag
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Neha Ojha [Wed, 22 Dec 2021 17:23:22 +0000 (09:23 -0800)]
Merge pull request #44385 from trociny/wip-53677
qa/tasks: improve backfill_toofull test
Reviewed-by: Neha Ojha <nojha@redhat.com>
Ernesto Puerta [Wed, 22 Dec 2021 16:09:42 +0000 (17:09 +0100)]
Merge pull request #44360 from SMIL-Infra/fix-ios-frontend
mgr/dashboard: fix white screen on Safari
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: huww98 <NOT@FOUND>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Josh Durgin [Wed, 22 Dec 2021 15:25:13 +0000 (07:25 -0800)]
Merge pull request #43598 from ideepika/wip-opentelemetry
migrate from using opentracing-cpp to opentelemetry-cpp static as distributed tracing API
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Francesco Pantano [Tue, 21 Dec 2021 08:46:39 +0000 (09:46 +0100)]
The spec.virtual_ip parameter should be used when it's defined for the ingress daemon
When the ingress spec is built a virtual_ip parameter is provided in the spec and it's
expected to see the haproxy instance using the defined value.
The defined VIP is properly configured using the keepalived instance and, as per doc [1],
the ingress should be able to use this value as entrypoint for the haproxy frontend.
This patch also introduces a basic unit test for the IngressService with the purpose of
validating the config files generated for both haproxy and keepalived.
[1] https://docs.ceph.com/en/latest/cephadm/services/rgw/#high-availability-service-for-rgw
Fixes: https://tracker.ceph.com/issues/53684
Signed-off-by: Francesco Pantano <fpantano@redhat.com>
Ernesto Puerta [Wed, 22 Dec 2021 12:04:14 +0000 (13:04 +0100)]
Merge pull request #44334 from aclamk/wip-aclamk-better-bluestore-perf
os/bluestore: Better readability of perf output
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Dimitri Papadopoulos [Wed, 8 Dec 2021 11:43:27 +0000 (12:43 +0100)]
examples: typos found by codespell
Signed-off-by: Dimitri Papadopoulos <dpo.ceph@mail.com>
Neha Ojha [Tue, 21 Dec 2021 19:57:01 +0000 (11:57 -0800)]
Merge pull request #44317 from aclamk/aclamk-fix-bluefs-import
Fix ceph-bluestore-tool bluefs-import command
Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
Yuri Weinstein [Tue, 21 Dec 2021 18:04:54 +0000 (10:04 -0800)]
Merge pull request #44328 from yaarith/gather_crashinfo-indexerror
mgr/telemetry: check that backtrace is not empty when redacting
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Yuri Weinstein [Tue, 21 Dec 2021 18:04:25 +0000 (10:04 -0800)]
Merge pull request #44327 from yaarith/gather_device_report-indexerror
mgr/telemetry: catch also IndexError in gather_device_report()
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Yuri Weinstein [Tue, 21 Dec 2021 18:03:31 +0000 (10:03 -0800)]
Merge pull request #44314 from locallocal/master
osd: remove unused variable legacy_infos_oid in the function PG::peek_map_epoch
Reviewed-by: Neha Ojha <nojha@redhat.com>