]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Ilya Dryomov [Wed, 6 Oct 2021 21:14:32 +0000 (23:14 +0200)]
librbd: clarify rbd_read_from_replica_policy vs older options
If rbd_read_from_replica_policy is set appropriately, setting
rbd_balance/localize_snap_reads or rbd_balance/localize_parent_reads
is redundant.
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
Ilya Dryomov [Wed, 6 Oct 2021 21:14:22 +0000 (23:14 +0200)]
librados: OPERATION_BALANCE/LOCALIZE_READS comment is outdated
With the introduction of min_last_complete_ondisk on the OSD side,
it is safe to use these for non-immutable data.
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
Neha Ojha [Wed, 6 Oct 2021 16:26:16 +0000 (09:26 -0700)]
Merge pull request #42964 from trociny/wip-52448
osd: re-cache peer_bytes on every peering state activate
Reviewed-by: Neha Ojha <nojha@redhat.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:17:49 +0000 (20:17 -0400)]
Merge PR #43399 into master
* refs/pull/43399/head:
mgr/volumes/fs/operations: fix various flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:17:19 +0000 (20:17 -0400)]
Merge PR #43398 into master
* refs/pull/43398/head:
mgr/volumes/fs: fix flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:16:50 +0000 (20:16 -0400)]
Merge PR #43397 into master
* refs/pull/43397/head:
mgr/volumes/fs: fix flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:16:19 +0000 (20:16 -0400)]
Merge PR #43395 into master
* refs/pull/43395/head:
mgr/volumes/fs/operations/versions: fix various flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:15:47 +0000 (20:15 -0400)]
Merge PR #43392 into master
* refs/pull/43392/head:
mgr/volumes/fs/operations: fix various flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:15:18 +0000 (20:15 -0400)]
Merge PR #43391 into master
* refs/pull/43391/head:
mgr/volumes/fs/vol_spec.py: fix flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:14:49 +0000 (20:14 -0400)]
Merge PR #43390 into master
* refs/pull/43390/head:
mgr/volumes/fs/operations : Fix flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:14:06 +0000 (20:14 -0400)]
Merge PR #43387 into master
* refs/pull/43387/head:
mgr/volumes: fix various flake8 issues
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:13:34 +0000 (20:13 -0400)]
Merge PR #43375 into master
* refs/pull/43375/head:
mgr/volumes/fs: add extra blank line
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Wed, 6 Oct 2021 00:12:44 +0000 (20:12 -0400)]
Merge PR #43357 into master
* refs/pull/43357/head:
mgr/nfs: stick to lazy evaluation of logger messages
mgr/nfs: change _cmd_rgw_export_create_rgw() name
mgr/nfs: don't log fsal keys
mgr/nfs: Add more debug log messages
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Yuri Weinstein [Tue, 5 Oct 2021 14:49:03 +0000 (07:49 -0700)]
Merge pull request #42977 from amathuria/wip-amathuri-scrub-duration
osd/scrub: Add scrub duration to pg dump stats
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Deepika Upadhyay [Tue, 5 Oct 2021 08:30:50 +0000 (14:00 +0530)]
Merge pull request #43175 from ideepika/wip-supress-jaeger-cmake-logs
cmake,rgw: use jaeger-base target, as a dependency for building dbstore
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Josh Durgin [Mon, 4 Oct 2021 18:02:06 +0000 (11:02 -0700)]
Merge pull request #43410 from zdover23/wip-doc-2021-10-04-min-hardware-typo
docs/start: fix min. hardware rec. typo
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Zac Dover [Mon, 4 Oct 2021 16:33:49 +0000 (02:33 +1000)]
docs/start: fix min. hardware rec. typo
The minimum hardware recommendations said that we
recommended a minimum of "24GB+ per daemon".
I changed this to read "2-4GB+ per daemon".
Reddit actually caught this one:
https://www.reddit.com/r/ceph/comments/q14ey2/cephs_mon_minimum_requirements/
Signed-off-by: Zac Dover <zac.dover@gmail.com>
Deepika Upadhyay [Mon, 4 Oct 2021 08:10:48 +0000 (13:40 +0530)]
cmake,rgw: use jaeger-base target, as a dependency for building dbstore
* dbstore also has tracing dependencies and missing linking for libraries
* use `using` keyword in common/tracer.cc to silence unused method
warnings
* log building of external project jaegertracing, opentracing into build
file, (done to reduce external project build verbosity)
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
Sage Weil [Sun, 3 Oct 2021 18:42:45 +0000 (13:42 -0500)]
Merge pull request #43402 from liewegas/doc-general-rep
doc/foundation: Martin is new general member rep
Patrick Donnelly [Sat, 2 Oct 2021 16:27:40 +0000 (12:27 -0400)]
Merge PR #43383 into master
* refs/pull/43383/head:
doc: fixed typo in terminology
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Sage Weil [Sat, 2 Oct 2021 15:49:46 +0000 (10:49 -0500)]
doc/foundation: Martin is new general member rep
Signed-off-by: Sage Weil <sage@newdream.net>
crossbears [Fri, 1 Oct 2021 22:39:21 +0000 (18:39 -0400)]
mgr/volumes/fs/operations: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51390
Signed-off-by: Zoey <jingyasu@my.yorku.ca>
Eunice Lee [Fri, 1 Oct 2021 21:51:49 +0000 (14:51 -0700)]
mgr/volumes/fs/vol_spec.py: fix flake8 issues
Fixes: https://tracker.ceph.com/issues/51384
Signed-off-by: Eunice Lee <eunice337@gmail.com>
Hargun Kaur [Fri, 1 Oct 2021 22:39:33 +0000 (22:39 +0000)]
mgr/volumes/fs: fix flake8 issues
Fixes: https://tracker.ceph.com/issues/51407
Signed-off-by: Hargun Kaur <hargunalone@gmail.com>
Gokcen Iskender [Fri, 1 Oct 2021 22:16:07 +0000 (15:16 -0700)]
mgr/volumes/fs/operations/versions: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51403
Signed-off-by: Gokcen Iskender <gokceng@gmail.com>
Eunice Lee [Fri, 1 Oct 2021 22:11:28 +0000 (15:11 -0700)]
mgr/volumes/fs: fix flake8 issues
Fixes: https://tracker.ceph.com/issues/51381
Signed-off-by: Eunice Lee <eunice337@gmail.com>
Gokcen Iskender [Fri, 1 Oct 2021 21:59:06 +0000 (14:59 -0700)]
mgr/volumes/fs/operations: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51398
Signed-off-by: Gokcen Iskender <gokceng@gmail.com>
Anuradha Kulkarni [Fri, 1 Oct 2021 19:25:37 +0000 (15:25 -0400)]
mgr/volumes/fs/operations : Fix flake8 issues
Fixes : https://tracker.ceph.com/issues/51396
Signed-off-by: Anuradha Kulkarni <anuradhak1990@gmail.com>
Almen Ng [Fri, 1 Oct 2021 18:00:20 +0000 (14:00 -0400)]
mgr/volumes: fix various flake8 issues
Fixes: https://tracker.ceph.com/issues/51380
Signed-off-by: Almen Ng <almen000509@gmail.com>
Ernesto Puerta [Fri, 1 Oct 2021 16:13:09 +0000 (18:13 +0200)]
Merge pull request #41255 from rhcs-dashboard/angular-11-upgrade
mgr/dashboard: Angular v11 Migration
Reviewed-by: aaryanporwal <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Ernesto Puerta [Fri, 1 Oct 2021 16:12:11 +0000 (18:12 +0200)]
Merge pull request #42716 from sshambar/bug-52002
mgr/dashboard,prometheus: fix handling of server_addr
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
Reviewed-by: sshambar <NOT@FOUND>
zdover23 [Fri, 1 Oct 2021 14:22:22 +0000 (00:22 +1000)]
Merge pull request #43277 from anthonyeleven/anthonyeleven/fix-47839
ceph: add example BlueStore migration via the ceph-objectstore-tool dup op
Reviewed-by: Zac Dover <zac.dover@gmail.com>
Jos Collin [Thu, 9 Sep 2021 12:49:30 +0000 (18:19 +0530)]
doc: fixed typo in terminology
Signed-off-by: Jos Collin <jcollin@redhat.com>
Aishwarya Mathuria [Tue, 24 Aug 2021 14:55:02 +0000 (20:25 +0530)]
osd/scrub: Add scrub duration to pg dump stats
Addition of a new column, SCRUB_DURATION, to the pg stats that stores the time taken for a PG scrub.
Fixes: https://tracker.ceph.com/issues/52605
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
Nizamudeen A [Thu, 30 Sep 2021 11:48:14 +0000 (17:18 +0530)]
mgr/dashboard: Remove i18n Warning about duplicate id
Fixes: https://tracker.ceph.com/issues/50268
Signed-off-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Thu, 30 Sep 2021 07:47:15 +0000 (13:17 +0530)]
mgr/dashboard: Taking care of deprecation warnings and other errors
1. deprecation group is deprecated: This API is not typesafe and can result in issues with Closure Compiler renaming. Use the `FormBuilder#group` overload with `AbstractControlOptions` instead.
2. cypress/integration/rgw/users.po.ts(113,23): error TS2345: Argument of type 'void' is not assignable to parameter of type 'string'.
3. Cannot find module 'isomorphic-form-data' from 'node_modules/swagger-ui/dist/swagger-ui.js'
Fixes: https://tracker.ceph.com/issues/50268
Signed-off-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Tue, 29 Jun 2021 09:30:34 +0000 (15:00 +0530)]
mgr/dashboard: Angular v11 Migration
Fixes: https://tracker.ceph.com/issues/50268
Signed-off-by: Nizamudeen A <nia@redhat.com>
Manasvi Goyal [Thu, 30 Sep 2021 20:08:31 +0000 (01:38 +0530)]
mgr/volumes/fs: add extra blank line
Fixes: https://tracker.ceph.com/issues/51392
Signed-off-by: Manasvi Goyal <mg.manasvi@gmail.com>
Patrick Donnelly [Thu, 30 Sep 2021 16:50:54 +0000 (12:50 -0400)]
Merge PR #43323 into master
* refs/pull/43323/head:
mgr/volumes/fs: add extra blank line
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Patrick Donnelly [Thu, 30 Sep 2021 16:49:37 +0000 (12:49 -0400)]
Merge PR #43322 into master
* refs/pull/43322/head:
mgr/volumes/fs: add extra blank line
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
Yuri Weinstein [Thu, 30 Sep 2021 14:52:30 +0000 (07:52 -0700)]
Merge pull request #36733 from majianpeng/rocksdb-remove-redundant-perfcount
kv/RocksdbStore: remove perfcounter l_rocksdb_gets.
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Yuri Weinstein [Thu, 30 Sep 2021 14:51:32 +0000 (07:51 -0700)]
Merge pull request #34624 from zhouyh-orcadt/fix_optracker_coredump
common/TrackedOp: fix osd reboot optracker coredump
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Kefu Chai [Thu, 30 Sep 2021 14:16:51 +0000 (22:16 +0800)]
Merge pull request #43355 from rzarzynski/wip-crimson-write_meta
crimson/osd: write the 'osd_key' meta on OSD::mkfs().
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Thu, 30 Sep 2021 14:14:11 +0000 (22:14 +0800)]
Merge pull request #43364 from rzarzynski/wip-crimson-canceliores-on-stop
crimson/osd: cancel IO reservations on PG::stop().
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Radoslaw Zarzynski [Thu, 30 Sep 2021 09:53:50 +0000 (09:53 +0000)]
crimson/osd: cancel IO reservations on PG::stop().
`PG::request_{local,remote}_recovery_reservation()` dynamically allocates
up to 2 instances of `LambdaContext<T>` and transfers their ownership to
the `AsyncReserver<T, F>`. This is expressed in raw pointers (`new` and
`delete`) notion. Further analysis shows the only place where `delete`
for these objects is called is the `AsyncReserver::cancel_reservation()`.
In contrast to the classical OSD, crimson doesn't invoke the method when
stopping a PG during the shutdown sequence. This would explain the
following ASan issue observed at Sepia:
```
Direct leak of 576 byte(s) in 24 object(s) allocated from:
#0 0x7fa108fc57b0 in operator new(unsigned long) (/lib64/libasan.so.5+0xf17b0)
#1 0x55723d8b0b56 in non-virtual thunk to crimson::osd::PG::request_local_background_io_reservation(unsigned int, std::unique_ptr<PGPeeringEvent, std::default_delete<PGPeeringEvent> >, std::unique_ptr<PGPeeringEvent, std::default_delete<PGPeeringEvent> >) (/usr/bin/ceph-osd+0x24d95b56)
#2 0x55723f1f66ef in PeeringState::WaitDeleteReserved::WaitDeleteReserved(boost::statechart::state<PeeringState::WaitDeleteReserved, PeeringState::ToDelete, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::my_context) (/usr/bin/ceph-osd+0x266db6ef)
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Sebastian Wagner [Thu, 30 Sep 2021 10:01:54 +0000 (12:01 +0200)]
Merge pull request #43202 from karmab/kcli_doc
doc: update kcli information
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Sebastian Wagner [Thu, 30 Sep 2021 08:29:00 +0000 (10:29 +0200)]
Merge pull request #43356 from tchaikov/wip-doc-cephadm
doc/cephadm/services: unindent note section
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Ramana Raja [Thu, 30 Sep 2021 01:13:09 +0000 (21:13 -0400)]
mgr/nfs: stick to lazy evaluation of logger messages
Signed-off-by: Ramana Raja <rraja@redhat.com>
Varsha Rao [Mon, 16 Aug 2021 05:46:45 +0000 (11:16 +0530)]
mgr/nfs: change _cmd_rgw_export_create_rgw() name
To maintain uniformity in naming, modify _cmd_rgw_export_create_rgw() name to
_cmd_nfs_export_create_rgw().
Signed-off-by: Varsha Rao <varao@redhat.com>
Varsha Rao [Mon, 16 Aug 2021 05:39:18 +0000 (11:09 +0530)]
mgr/nfs: don't log fsal keys
FSAL keys are written to export objects. Don't log it, instead log the initial
export before generating keys and user config object mostly will not contain
export block. It's okay to log user config object content.
Signed-off-by: Varsha Rao <varao@redhat.com>
Kefu Chai [Wed, 29 Sep 2021 23:22:09 +0000 (07:22 +0800)]
doc/cephadm/services: unindent note section
before this change the note on "apply" command is embedded in the note
on "_no_schedule". and they are not related. so let's move the former
out. also, highlight the yaml file sample in YAML.
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
Radoslaw Zarzynski [Wed, 29 Sep 2021 20:12:18 +0000 (20:12 +0000)]
crimson/osd: write the 'ready' meta on OSD::mkfs().
This is for the compliance with the classical OSD. No problem
with lack of this file has been identified yet.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Wed, 29 Sep 2021 20:00:20 +0000 (20:00 +0000)]
crimson/osd: write the 'osd_key' meta on OSD::mkfs().
This commit fixes an issue identified during the Rook-crimson effort.
Missing the `write_meta()` on `osd_key` made the CephX inoperational
because of imposibility to load the keyring. Disabling CephX in turn
caused the auth method negotation to fail when reaching out to a monitor.
```
ERROR 2021-09-28 21:19:46,598 [shard 0] none - auth: unable to find a keyring on /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory
ERROR 2021-09-28 21:19:46,598 [shard 0] none - AuthRegistry(0x7fa38c322b68) no keyring found at /var/lib/ceph/osd/ceph-0/keyring, disabling cephx
...
INFO 2021-09-28 21:19:46,601 [shard 0] monc - get_auth_request(con=[client.?(temp_mon_client) 172.17.0.1:0/
2910147961 @63138 >> mon.? v2:10.108.187.31:3300/0], auth_method=0)
INFO 2021-09-28 21:19:46,601 [shard 0] monc - get_auth_request no methods is supported
...
WARN 2021-09-28 21:20:06,612 [shard 0] monc - cannot establish the active_con with any mon
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Samuel Just [Wed, 29 Sep 2021 19:29:23 +0000 (12:29 -0700)]
Merge pull request #43340 from athanatos/sjust/wip-seastore-throttle
crimson/seastore: fix segment_cleaner blocked_io_wake crash
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Sage Weil [Wed, 29 Sep 2021 18:38:47 +0000 (14:38 -0400)]
Merge PR #43287 into master
* refs/pull/43287/head:
mgr/rook, qa/tasks/rook: change rgw daemon service name
mgr/rook: fix placement_spec_to_node_selector
mgr/rook: orch rm no longer uses rook api delete
qa/tasks/rook: fix cluster deletion hanging due to CephObjectStore CR
mgr/rook: use default replication size in orch apply rgw
mgr/rook: add placement specs to apply rgw
Reviewed-by: Sage Weil <sage@redhat.com>
Ernesto Puerta [Wed, 29 Sep 2021 18:23:23 +0000 (20:23 +0200)]
Merge pull request #43255 from rhcs-dashboard/fix-49344-master
qa/mgr/dashboard: add extra wait to test
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Kefu Chai [Wed, 29 Sep 2021 15:22:24 +0000 (23:22 +0800)]
Merge pull request #43341 from pdvian/wip-doc-mon-bootstrap
doc/dev/mon-bootstrap: fix typo
Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
karmab [Fri, 17 Sep 2021 06:18:16 +0000 (08:18 +0200)]
doc: update kcli information
Kefu Chai [Wed, 29 Sep 2021 14:54:15 +0000 (22:54 +0800)]
Merge pull request #42353 from ifed01/wip-ifed-fix-invalid-offset-repair
os/bluestore: fix writing to invalid offset when repairing
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Kefu Chai [Wed, 29 Sep 2021 14:52:11 +0000 (22:52 +0800)]
Merge pull request #39062 from fyzard1991/master
mon/OSDMonitor:Make the pg_num check more accurate
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Wed, 29 Sep 2021 14:50:02 +0000 (22:50 +0800)]
Merge pull request #43289 from tchaikov/wip-52705
os/bluestore: list obj which equals to pend
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Xinze Chi <xinze@xsky.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Ernesto Puerta [Wed, 29 Sep 2021 11:36:45 +0000 (13:36 +0200)]
Merge pull request #42821 from rhcs-dashboard/force-maintenance-workflow
mgr/dashboard: Move force maintenance test to the workflow test suite
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Sebastian Wagner [Wed, 29 Sep 2021 10:37:44 +0000 (12:37 +0200)]
Merge pull request #43246 from Daniel-Pivonka/cephadm-iscsi-trust-mgr-ips
mgr/cephadm: populate trusted_ip_list in iscsi-gateway.cfg with mgr ips
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Sebastian Wagner [Wed, 29 Sep 2021 10:37:02 +0000 (12:37 +0200)]
Merge pull request #43309 from guits/iscsi_fixes
cephadm/iscsi: fix a typo
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Sebastian Wagner [Wed, 29 Sep 2021 10:36:42 +0000 (12:36 +0200)]
Merge pull request #43319 from guits/workaround_tcmurunner_log
cephadm: modify iscsi containers bindmount
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Sebastian Wagner [Wed, 29 Sep 2021 10:36:06 +0000 (12:36 +0200)]
Merge pull request #43321 from adk3798/remove-exporter
mgr/cephadm: remove cephadm exporter code
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Yuval Lifshitz [Wed, 29 Sep 2021 09:32:55 +0000 (12:32 +0300)]
Merge pull request #43226 from TRYTOBE8TME/wip-rgw-amqp-minor-nit
src/test: Minor nit from PR #43025
Samuel Just [Wed, 29 Sep 2021 01:46:25 +0000 (18:46 -0700)]
crimson/os/seastore/transaction_manager: limit callers to reserve_projected_usage
Adds an exclusive stage for obtaining projected usage as well as an
unordered one for submitting ool writes. This should allow for a
straightforward wait-list when io is blocked while still allowing
concurrent submission of ool writes otherwise.
Fixes: https://tracker.ceph.com/issues/52698
Signed-off-by: Samuel Just <sjust@redhat.com>
Samuel Just [Wed, 29 Sep 2021 01:43:02 +0000 (18:43 -0700)]
crimson/os/seastore/segment_cleaner: track projected usage for in progress operations
We're going to want to permit multiple transactions to be writing
concurrently. Replace await_hard_limits() with a mechanism that
remembers bytes that will be used by in-progress operations.
Signed-off-by: Samuel Just <sjust@redhat.com>
Prashant D [Wed, 29 Sep 2021 06:13:56 +0000 (07:13 +0100)]
doc/dev/mon-bootstrap: fix typo
Signed-off-by: Prashant D <pdhange@redhat.com>
Samuel Just [Wed, 29 Sep 2021 03:26:21 +0000 (20:26 -0700)]
crimson/os/seastore/segment_manager/block: add debugging to remaining invarg case
Signed-off-by: Samuel Just <sjust@redhat.com>
Samuel Just [Wed, 29 Sep 2021 03:25:55 +0000 (20:25 -0700)]
crimson/os/seastore/segment_manager/block: add method name debug prefix
Signed-off-by: Samuel Just <sjust@redhat.com>
Varsha Rao [Mon, 16 Aug 2021 05:20:48 +0000 (10:50 +0530)]
mgr/nfs: Add more debug log messages
Fixes: https://tracker.ceph.com/issues/52274
Signed-off-by: Varsha Rao <varao@redhat.com>
Samuel Just [Wed, 29 Sep 2021 00:38:13 +0000 (17:38 -0700)]
Merge pull request #43327 from cyx1231st/wip-seastore-ool-metrics
crimson/os/seastore: introduce ool related metrics with misc improvements
Reviewed-by: Samuel Just <sjust@redhat.com>
Samuel Just [Wed, 29 Sep 2021 00:12:18 +0000 (17:12 -0700)]
crimson/common/operation: add UnorderedStage
Signed-off-by: Samuel Just <sjust@redhat.com>
Samuel Just [Wed, 29 Sep 2021 00:11:49 +0000 (17:11 -0700)]
crimson/os/seastore/transaction: make for_each_fresh_block const
Signed-off-by: Samuel Just <sjust@redhat.com>
Samuel Just [Tue, 28 Sep 2021 22:01:00 +0000 (22:01 +0000)]
crimson/os/seastore/segment_cleaner: make used_bytes unsigned
Signed-off-by: Samuel Just <sjust@redhat.com>
Neha Ojha [Tue, 28 Sep 2021 17:01:28 +0000 (10:01 -0700)]
Merge pull request #43302 from ronen-fr/wip-rf-osd-psik
osd: add a missing comma in a list of strings
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Neha Ojha [Tue, 28 Sep 2021 17:00:02 +0000 (10:00 -0700)]
Merge pull request #43303 from ronen-fr/wip-rf-osd-modulu
osd: fix the truncation of an int by int division
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Ernesto Puerta [Tue, 28 Sep 2021 16:37:45 +0000 (18:37 +0200)]
Merge pull request #43132 from p-se/monitoring-grafana-piechart-update
monitoring: update grafana-piechart-panel plugin
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
Sage Weil [Tue, 28 Sep 2021 14:58:24 +0000 (10:58 -0400)]
Merge PR #43177 into master
* refs/pull/43177/head:
osd/PrimaryLogPG: drop ops when pool has EIO flag
osdc/Objecter: set SUPPORTSPOOLEIO flag on all ops
ceph_test_rados_api_aio: test pool EIO flag
osdc/Objecter: return EIO for new linger ops
osdc/Objecter: return EIO for existing ops and linger ops
osdc/Objecter: return EIO for new ops
osd,mon: add EIO pool flag
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Kefu Chai [Tue, 28 Sep 2021 14:56:57 +0000 (22:56 +0800)]
Merge pull request #43320 from pdvian/wip-doc-cephx-fixtypo
doc/dev/cephx: fix typo
Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Tue, 28 Sep 2021 14:49:58 +0000 (22:49 +0800)]
Merge pull request #43316 from smithfarm/wip-spdk-tw
rpm: enable system_pmdk bcond for SUSE builds
Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Fri, 24 Sep 2021 15:33:03 +0000 (23:33 +0800)]
os/bluestore: list obj which equals to pend
otherwise we could have failures like
scrub : stat mismatch, got 3/4 objects, 1/2 clones, 3/4 dirty, 3/4 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 49/56 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes."
where the numbers of scrubbed object, clones, dirty and omap are always
less than the total number of corresponding numbers, if the PG contains
object(s) whose hash happens to be 0xffffffff.
in this change, if the calculated hash of the upper bound is greater
than the maximum possible number represented by uint32_t, in addition to
setting the hash of the upper bound hobj to 0xffffffff, we also set the
nspace of hobj of the upper bound to "\xff", so that the upper bound
is greater than an hobj whose hash happens to be 0xfffffff. please note,
the nspace of "\xff" is not an ascii string, so it's not likely to be
less than a real-world nspace of an hobj.
with this new *greater* upper bound, we are able to include the previous
missing hobj when listing the objects in a PG. so the scrub won't be
annoyed when the number of objects does not match.
Fixes: https://tracker.ceph.com/issues/52705
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
Kefu Chai [Wed, 22 Sep 2021 16:42:33 +0000 (00:42 +0800)]
os/bluestore: use scope_guard to log latency
simpler this way, and avoid using `goto`.
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
Sebastian Wagner [Tue, 28 Sep 2021 09:20:47 +0000 (11:20 +0200)]
Merge pull request #43150 from sebastian-philipp/doc-cephadm-serves-sub-tree
doc/cephadm: move services under doc/cephadm/services ?
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Nizamudeen A [Tue, 17 Aug 2021 16:56:52 +0000 (22:26 +0530)]
mgr/dashboard: Move force maintenance test to the workflow test suite
Fixes: https://tracker.ceph.com/issues/52276
Signed-off-by: Nizamudeen A <nia@redhat.com>
Deepika Upadhyay [Tue, 28 Sep 2021 08:45:41 +0000 (14:15 +0530)]
Merge pull request #43221 from badone/wip-install-deps-new-pip-resolver
install-deps.sh: Use legacy pip resolver
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yingxin Cheng [Tue, 28 Sep 2021 07:38:52 +0000 (15:38 +0800)]
crimson/os/seastore: introduce ool related metrics with misc improvements
* The number of ool records written;
* Write overhead from journal/ool records;
* Wasted writes from invalided ool records;
* Wasted writes from erased inline extents;
* Distinguish ool and inline extents from metrics;
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Tue, 28 Sep 2021 07:10:23 +0000 (15:10 +0800)]
crimson/os/seastore/transaction: count fresh blocks separately
Correct get_num_fresh_blocks() to be accurate under the effect of
delayed allocations.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Tue, 28 Sep 2021 07:02:54 +0000 (15:02 +0800)]
crimson/os/seastore/transaction: cleanup comments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Tue, 28 Sep 2021 06:54:22 +0000 (14:54 +0800)]
crimson/os/seastore/cache: misc cleanup
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Tue, 28 Sep 2021 06:48:09 +0000 (14:48 +0800)]
crimson/os/seastore: cleanup, consolidate metrics about transactional efforts
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Tue, 28 Sep 2021 06:31:17 +0000 (14:31 +0800)]
crimson/os/seastore: cleanup, reset cache metrics as a whole
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Daniel Pivonka [Tue, 21 Sep 2021 20:04:51 +0000 (16:04 -0400)]
mgr/cephadm: populate trusted_ip_list in iscsi-gateway.cfg with mgr ips
Iscsi gateways do not show "UP" in dashboard without this
fixes: https://tracker.ceph.com/issues/52692
Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
Joseph Sawaya [Thu, 23 Sep 2021 15:07:23 +0000 (11:07 -0400)]
mgr/rook, qa/tasks/rook: change rgw daemon service name
This commit changes the rgw daemon service name format from
rgw.<realm name>.<zone name> to rgw.<resource_name> and changes the daemon
removal in the QA accordingly. This also gets rid of the Rook API when
describing services.
Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
Joseph Sawaya [Wed, 22 Sep 2021 20:49:56 +0000 (16:49 -0400)]
mgr/rook: fix placement_spec_to_node_selector
This commit takes care of the edge case where a completely empty
placement spec is passed to the function.
Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
Joseph Sawaya [Wed, 22 Sep 2021 20:46:14 +0000 (16:46 -0400)]
mgr/rook: orch rm no longer uses rook api delete
This commit changes orch rm to no longer use the rook api to delete the daemon
but instead directly delete the corresponding CR using the kubernetes api.
Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
Joseph Sawaya [Tue, 21 Sep 2021 13:41:28 +0000 (09:41 -0400)]
qa/tasks/rook: fix cluster deletion hanging due to CephObjectStore CR
This commit fixes the issue where the cluster deletion hangs in the QA
while a CephObjectStore CR is still up by removing all rgw/nfs/mds/rbd-mirror
daemons before tearing down the rest of the cluster.
Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
Joseph Sawaya [Tue, 7 Sep 2021 13:06:08 +0000 (09:06 -0400)]
mgr/rook: use default replication size in orch apply rgw
This commit changes `orch apply rgw` to use the osd_pool_default_size
when setting the replication size for the data pool and metadata pool
of the rgw daemon. This commit also adds `orch apply rgw` to the Rook
QA.
Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>