]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 years agodoc/glossary: add "FQDN" entry 49425/head
Zac Dover [Wed, 14 Dec 2022 05:59:51 +0000 (15:59 +1000)]
doc/glossary: add "FQDN" entry

Add "FQDN" definition to doc/glossary.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit e919941036c6576d7085ea7fa611011cccd17fa9)

2 years agoMerge pull request #49398 from zdover23/wip-doc-2022-12-13-backport-49396-to-pacific
colemitchell [Tue, 13 Dec 2022 04:56:33 +0000 (23:56 -0500)]
Merge pull request #49398 from zdover23/wip-doc-2022-12-13-backport-49396-to-pacific

pacific: doc/glossary - add "secrets"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/glossary - add "secrets" 49398/head
Zac Dover [Tue, 13 Dec 2022 04:39:35 +0000 (14:39 +1000)]
doc/glossary - add "secrets"

Add "secrets" to doc/glossary.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit a36409d3de77b37788a07ebf1380514c8bffd6ad)

2 years agoMerge PR #47891 into pacific
Patrick Donnelly [Mon, 12 Dec 2022 20:52:00 +0000 (15:52 -0500)]
Merge PR #47891 into pacific

* refs/pull/47891/head:
qa: add a upgrade test suite from nautilus and test the new getvxattr op
qa: make filesystem to be compatible with nautilus for blocklist
qa: make filesystem to be compatible with nautilus when creating pools
test/libcephfs: add newops test case
client: fail the request if the peer MDS doesn't support getvxattr op
mds: add CEPHFS_FEATURE_OP_GETVXATTR feature bit support
mds: notify clients if the session has already opened
Rename/re-symlink whitelist_*.yaml

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2 years agoMerge pull request #49363 from adk3798/tox-upgrade-fixes-pacific
Adam King [Mon, 12 Dec 2022 17:35:37 +0000 (12:35 -0500)]
Merge pull request #49363 from adk3798/tox-upgrade-fixes-pacific

pacific: pybind/mgr: fixup after upgrading tox versions

Reviewed-by: Laura Flores <lflores@redhat.com>
2 years agoMerge pull request #49385 from zdover23/wip-doc-2022-12-12-backport-49383-to-pacific
colemitchell [Mon, 12 Dec 2022 04:37:25 +0000 (23:37 -0500)]
Merge pull request #49385 from zdover23/wip-doc-2022-12-12-backport-49383-to-pacific

pacific: doc/rados: add prompts to user-management.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rados: add prompts to user-management.rst 49385/head
Zac Dover [Mon, 12 Dec 2022 04:22:40 +0000 (14:22 +1000)]
doc/rados: add prompts to user-management.rst

Add unselectable prompts to doc/rados/operations/user-management.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 46f9506e4ce5fbf0db7ca06f638df7678a382760)

2 years agoMerge pull request #49378 from zdover23/wip-doc-2022-12-11-backport-49376-to-pacific
colemitchell [Sat, 10 Dec 2022 21:36:18 +0000 (16:36 -0500)]
Merge pull request #49378 from zdover23/wip-doc-2022-12-11-backport-49376-to-pacific

pacific: doc/install: update clone-source.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/install: update clone-source.rst 49378/head
Zac Dover [Sat, 10 Dec 2022 20:25:13 +0000 (06:25 +1000)]
doc/install: update clone-source.rst

Beef up clone-source.rst. Repair semantics. Add internal references. Fix
a broken "git submodule foreach git clean -fdx" command.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 344ef1553e4d0ec86153252891a194097548c602)

2 years agoqa: teuthology branch reference "master" -> "main" 49363/head
Adam King [Sat, 10 Dec 2022 16:35:27 +0000 (11:35 -0500)]
qa: teuthology branch reference "master" -> "main"

We dropped "master" branch for "main" a while back.
No reason I can see not to reflect that here.

Signed-off-by: Adam King <adking@redhat.com>
2 years agoqa: drop import-tasks test
Adam King [Sat, 10 Dec 2022 16:33:58 +0000 (11:33 -0500)]
qa: drop import-tasks test

We had already dropped this in main and quincy
and it's causing failures in pacific now.

Signed-off-by: Adam King <adking@redhat.com>
2 years agomgr/pybind: fix mypy arg parsing
Adam King [Fri, 9 Dec 2022 16:10:36 +0000 (11:10 -0500)]
mgr/pybind: fix mypy arg parsing

On the new tox version it is treating each line as a new command
so it will do something like "mypy --config-file=../../mypy.ini"
as one command and then "-m balancer" as a totally separate command.
The first one immediately fails as it doesn't include any modules
to test. Adding backslashes to the ends of the lines gets it to
handle the lines as one long command

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 8e5840ff2c5815897e3eaeb136927971ad6f5384)

Conflicts:
src/pybind/mgr/requirements-required.txt

2 years agopybind/mgr: fix tox autopep8 args
Adam King [Fri, 9 Dec 2022 16:25:01 +0000 (11:25 -0500)]
pybind/mgr: fix tox autopep8 args

Similar to mypy, we now need a backslash to signal
a newline doesn't mean to start a new command

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 2ecd74cdac098b3b4cdd209c10ce00f050aa8a8a)

Conflicts:
src/pybind/mgr/tox.ini

2 years agoMerge pull request #49372 from zdover23/wip-doc-2022-12-10-backport-49368-to-pacific
colemitchell [Sat, 10 Dec 2022 04:56:20 +0000 (23:56 -0500)]
Merge pull request #49372 from zdover23/wip-doc-2022-12-10-backport-49368-to-pacific

pacific: doc/rados: add prompts to upmap.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #49370 from zdover23/wip-doc-2022-12-10-backport-49367-to-pacific
colemitchell [Sat, 10 Dec 2022 04:54:06 +0000 (23:54 -0500)]
Merge pull request #49370 from zdover23/wip-doc-2022-12-10-backport-49367-to-pacific

pacific: doc/rados: add prompts to stretch-mode.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc/rados: add prompts to upmap.rst 49372/head
Zac Dover [Sat, 10 Dec 2022 04:34:46 +0000 (14:34 +1000)]
doc/rados: add prompts to upmap.rst

Add unselectable prompts to doc/rados/operations/upmap.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 06d8ac91b2e3f235088940565e9d7e003edc964a)

2 years agodoc/rados: add prompts to stretch-mode.rst 49370/head
Zac Dover [Sat, 10 Dec 2022 04:15:45 +0000 (14:15 +1000)]
doc/rados: add prompts to stretch-mode.rst

Add unselectable prompts to doc/rados/operations/stretch-mode.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit bafe76c20488006ced7d9a2f6b82a54540dd7a89)

2 years agoMerge pull request #49366 from zdover23/wip-doc-2022-12-10-backport-49364-to-pacific
colemitchell [Sat, 10 Dec 2022 03:57:19 +0000 (22:57 -0500)]
Merge pull request #49366 from zdover23/wip-doc-2022-12-10-backport-49364-to-pacific

pacific: doc/rbd: remove typo and ill-formed command

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rbd: remove typo and ill-formed command 49366/head
Zac Dover [Sat, 10 Dec 2022 03:20:17 +0000 (13:20 +1000)]
doc/rbd: remove typo and ill-formed command

Ingest Ilya Dryomov's comments here https://github.com/ceph/ceph/pull/49340/files#r1044365857

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 8df894b753ce15852cd72d5be22e2286a053b6e8)

2 years agoMerge pull request #48070 from pdvian/wip-scrub-msg
Yuri Weinstein [Fri, 9 Dec 2022 18:54:24 +0000 (10:54 -0800)]
Merge pull request #48070 from pdvian/wip-scrub-msg

pacific: osd/scrub: Reintroduce scrub starts message

Reviewed-by: Laura Flores <lflores@redhat.com>
2 years agoqa: add pytest to deps of py3 env
Kefu Chai [Thu, 8 Dec 2022 14:34:38 +0000 (22:34 +0800)]
qa: add pytest to deps of py3 env

otherwise it is mising when running test, and we'd have following
failure:

py3: exit 2 (0.00 seconds) /home/jenkins-build/build/workspace/ceph-pull-requests/qa> pytest --assert=plain test_import.py

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 127dd54db84afb90ae20fdc7c4ecdcbf789aec25)

Conflicts:
qa/tox.ini

2 years agoMerge pull request #49170 from aclamk/wip-58102-pacific
Yuri Weinstein [Fri, 9 Dec 2022 18:52:25 +0000 (10:52 -0800)]
Merge pull request #49170 from aclamk/wip-58102-pacific

pacific: [bluestore] Improve deferred write decision

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2 years agoMerge pull request #48915 from ifed01/wip-ifed-bluefs-op-inc-pac
Yuri Weinstein [Fri, 9 Dec 2022 18:51:35 +0000 (10:51 -0800)]
Merge pull request #48915 from ifed01/wip-ifed-bluefs-op-inc-pac

pacific: os/bluestore: incremental update mode for bluefs log

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #48803 from kamoltat/wip-ksirivad-backport-pacific-47340
Yuri Weinstein [Fri, 9 Dec 2022 18:50:24 +0000 (10:50 -0800)]
Merge pull request #48803 from kamoltat/wip-ksirivad-backport-pacific-47340

pacific:mon/OSDMonitor: Added extra check before mon.go_recovery_stretch_mode()

Reviewed-by: Neha Ojha <nojha@redhat.com>
2 years agoMerge pull request #48255 from k0ste/wip-57258-pacific
Yuri Weinstein [Fri, 9 Dec 2022 18:49:47 +0000 (10:49 -0800)]
Merge pull request #48255 from k0ste/wip-57258-pacific

pacific:  msg: reset ProtocolV2's frame assembler in appropriate thread

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoMerge pull request #48254 from k0ste/wip-56722-pacific
Yuri Weinstein [Fri, 9 Dec 2022 18:49:15 +0000 (10:49 -0800)]
Merge pull request #48254 from k0ste/wip-56722-pacific

pacific: msg: fix deadlock when handling existing but closed v2 connection

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoqa: set locale to C.UTF-8 in tox.ini
Kefu Chai [Thu, 8 Dec 2022 06:42:42 +0000 (14:42 +0800)]
qa: set locale to C.UTF-8 in tox.ini

as ansible is using UTF-8 encoded characters in the file names, so,
to avoid failures like:

  File "/home/jenkins-build/build/workspace/ceph-pull-requests/qa/.tox/py3/lib/python3.10/site-packages/pip/_internal/utils/unpacking.py", line 217, in untar_file
    with open(path, "wb") as destfp:
UnicodeEncodeError: 'latin-1' codec can't encode characters in position 137-140: ordinal not in range(256)

we have to set a locale which is able to handle UTF-8.

see also https://github.com/ceph/teuthology/pull/1671

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit bc2b551e9fc94697aee42de34de03d0a2a819850)

2 years agopybind/mgr: drop cython from requires
Kefu Chai [Thu, 8 Dec 2022 10:25:20 +0000 (18:25 +0800)]
pybind/mgr: drop cython from requires

cython is not required for running tox commands.

this should address the test failure like:

ROOT: will run in automatically provisioned tox, host /home/jenkins-build/build/workspace/ceph-pull-requests/build/mgr-virtualenv/bin/python3.10 is missing [requires (has)]: cython

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit c9cc795d02682f550098e517a01cf2adc7502906)

Conflicts:
src/pybind/mgr/tox.ini

2 years agocephadm: drop cython from requires
Kefu Chai [Thu, 8 Dec 2022 10:23:32 +0000 (18:23 +0800)]
cephadm: drop cython from requires

cython is not required for launching the tox environment.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 8b20bb8ca2b8f110a030a2f3fffd849faa125948)

2 years ago*: s/whitelist_externals/allowlist_externals/
Kefu Chai [Thu, 8 Dec 2022 06:53:33 +0000 (14:53 +0800)]
*: s/whitelist_externals/allowlist_externals/

as allowlist_externals was introduced in
tox v4.0. see
https://github.com/tox-dev/tox/commit/5e33fda1a40ffb4973de3d607a572891eb3cb2d2 , but
this option was backported to 3.18 as an alias of whitelist_externals, so we don't need
to specify the minversion to 4.0 in this change.

as we started using tox 4.0 and up (v4.0.2 in specific). tox complains
and fails like:

alerts-lint: failed with promtool is not allowed, use allowlist_externals to allow it
  alerts-lint: FAIL code 1 (9.25 seconds)

see https://tox.wiki/en/latest/faq.html#tox-4-removed-tox-ini-keys
and https://tox.wiki/en/latest/config.html#allowlist_externals

it'd be nice to use a more inclusive language also. so, in this change,
s/whitelist_externals/allowlist_externals/ in all tox.ini in this
project.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 34e2e33870b1ce381f9cd3eead882daa7b640b81)

2 years agoMerge pull request #49195 from idryomov/wip-57066-pacific
Yuri Weinstein [Fri, 9 Dec 2022 15:41:30 +0000 (07:41 -0800)]
Merge pull request #49195 from idryomov/wip-57066-pacific

pacific: cls/rbd: update last_read in group::snap_list

Reviewed-by: Mykola Golub <mgolub@suse.com>
2 years agoMerge pull request #49357 from zdover23/wip-doc-2022-12-09-backport-49342-to-pacific
colemitchell [Fri, 9 Dec 2022 07:11:02 +0000 (02:11 -0500)]
Merge pull request #49357 from zdover23/wip-doc-2022-12-09-backport-49342-to-pacific

pacific: doc/rbd: refine "Removing a Block Device Image"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rbd: refine "Removing a Block Device Image" 49357/head
Zac Dover [Fri, 9 Dec 2022 01:16:27 +0000 (11:16 +1000)]
doc/rbd: refine "Removing a Block Device Image"

Refine and add unselectable prompts to "Removing a Block Device Image"
in doc/rbd/rados-rbd-cmds.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 3a6284a49bf41030bb20a5714b0dfce92928438b)

2 years agoMerge pull request #49355 from zdover23/wip-doc-2022-12-09-backport-49343-to-pacific
colemitchell [Fri, 9 Dec 2022 07:04:42 +0000 (02:04 -0500)]
Merge pull request #49355 from zdover23/wip-doc-2022-12-09-backport-49343-to-pacific

pacific: doc/rbd: refine "Restoring a Block Device Image"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge pull request #49353 from zdover23/wip-doc-2022-12-09-backport-49341-to-pacific
colemitchell [Fri, 9 Dec 2022 07:02:26 +0000 (02:02 -0500)]
Merge pull request #49353 from zdover23/wip-doc-2022-12-09-backport-49341-to-pacific

pacific: doc/rbd: refine "Resizing a Block Device Image"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge pull request #49351 from zdover23/wip-doc-2022-12-09-backport-49340-to-pacific
colemitchell [Fri, 9 Dec 2022 07:00:07 +0000 (02:00 -0500)]
Merge pull request #49351 from zdover23/wip-doc-2022-12-09-backport-49340-to-pacific

pacific: doc/rbd: refine "Retrieving Image Information"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rbd: refine "Restoring a Block Device Image" 49355/head
Zac Dover [Fri, 9 Dec 2022 01:31:07 +0000 (11:31 +1000)]
doc/rbd: refine "Restoring a Block Device Image"

Refine and add unselectable prompts to "Restoring a Block Device Image"
in doc/rbd/rados-rbd-cmds.rst.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 8fb4edb92d82019065a884d63a71ca68e8c8de6a)

2 years agoMerge pull request #49349 from zdover23/wip-doc-2022-12-09-backport-49339-to-pacific
colemitchell [Fri, 9 Dec 2022 06:56:11 +0000 (01:56 -0500)]
Merge pull request #49349 from zdover23/wip-doc-2022-12-09-backport-49339-to-pacific

pacific: doc/rbd: refine "Listing Block Device Images"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rbd: refine "Resizing a Block Device Image" 49353/head
Zac Dover [Fri, 9 Dec 2022 01:02:31 +0000 (11:02 +1000)]
doc/rbd: refine "Resizing a Block Device Image"

Refine and add unselectable prompts to "Resizing a Block Device Image"
in doc/rbd/rados/rbd-cmds.rst.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 078bec94d08529c87766c12055c365fc53d356a2)

2 years agodoc/rbd: refine "Retrieving Image Information" 49351/head
Zac Dover [Fri, 9 Dec 2022 00:25:55 +0000 (10:25 +1000)]
doc/rbd: refine "Retrieving Image Information"

Refine the text and prompts in "Retrieving Image Information" in
doc/rbd/rados-rbd-cmds.rst.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit d418037b3817b62cee4cb151ab84bb24c676b117)

2 years agoMerge pull request #49347 from zdover23/wip-doc-2022-12-09-backport-49338-to-pacific
colemitchell [Fri, 9 Dec 2022 06:52:01 +0000 (01:52 -0500)]
Merge pull request #49347 from zdover23/wip-doc-2022-12-09-backport-49338-to-pacific

pacific: doc/rbd: refine "Creating a Block Device Image"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rbd: refine "Listing Block Device Images" 49349/head
Zac Dover [Fri, 9 Dec 2022 00:21:47 +0000 (10:21 +1000)]
doc/rbd: refine "Listing Block Device Images"

Refine the text and prompts in "Listing Block Device Images" in
doc/rbd/rados-rbd-cmds.rst.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit ad3c93535fbb614d593f74806fdfccdd60a1696f)

2 years agodoc/rbd: refine "Creating a Block Device Image" 49347/head
Zac Dover [Thu, 8 Dec 2022 23:53:14 +0000 (09:53 +1000)]
doc/rbd: refine "Creating a Block Device Image"

Refine the English and prompts in "Creating a Block Device Image" in
doc/rbd/rados-rbd-cmds.rst.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 20b14437d6847fefdd3435bc9ec7a8b5580968f8)

2 years agoMerge pull request #49144 from pluser/wip-58039-pacific
Yuri Weinstein [Thu, 8 Dec 2022 20:59:17 +0000 (12:59 -0800)]
Merge pull request #49144 from pluser/wip-58039-pacific

pacific: osd: add created_at meta

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2 years agoMerge pull request #49139 from ljflores/wip-58116-pacific
Laura Flores [Thu, 8 Dec 2022 19:23:13 +0000 (13:23 -0600)]
Merge pull request #49139 from ljflores/wip-58116-pacific

pacific: qa/workunits/rados: specify redirect in curl command

2 years agoMerge pull request #48647 from kotreshhr/wip-48642-pacific
Yuri Weinstein [Thu, 8 Dec 2022 15:42:15 +0000 (07:42 -0800)]
Merge pull request #48647 from kotreshhr/wip-48642-pacific

pacific: qa: Fix test_subvolume_snapshot_info_if_orphan_clone

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #49319 from zdover23/wip-doc-2022-12-08-backport-49306-to-pacific
zdover23 [Thu, 8 Dec 2022 11:38:57 +0000 (21:38 +1000)]
Merge pull request #49319 from zdover23/wip-doc-2022-12-08-backport-49306-to-pacific

pacific: doc/rbd: refine "Create a Block Device User"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc/rbd: refine "Create a Block Device User" 49319/head
Zac Dover [Wed, 7 Dec 2022 14:43:31 +0000 (00:43 +1000)]
doc/rbd: refine "Create a Block Device User"

Refine "Create a Block Device User", after suggestions made by Ilya
Dryomov in https://github.com/ceph/ceph/pull/49301#pullrequestreview-1208285685

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit b6cc04e0bc1a30df7434b1fc857846750e714b31)

2 years agoMerge pull request #49308 from zdover23/wip-doc-2022-12-08-backport-49282-to-pacific
zdover23 [Thu, 8 Dec 2022 05:22:53 +0000 (15:22 +1000)]
Merge pull request #49308 from zdover23/wip-doc-2022-12-08-backport-49282-to-pacific

pacific: doc/rbd: refine "Create a Block Device Pool"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2 years agodoc/rbd: refine "Create a Block Device Pool" 49308/head
Zac Dover [Tue, 6 Dec 2022 13:14:49 +0000 (23:14 +1000)]
doc/rbd: refine "Create a Block Device Pool"

Refine the "Create a Block Device Pool" section of
doc/rbd/rados-rbd-cmds.rst.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 987d3163a1d15b0f5e2870cf4d1d63e38bec9a34)

2 years agoMerge pull request #48453 from lxbsz/wip-57836
Yuri Weinstein [Wed, 7 Dec 2022 15:56:36 +0000 (07:56 -0800)]
Merge pull request #48453 from lxbsz/wip-57836

pacific: mds: wait unlink to finish to avoid conflict when creating same entries

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #48443 from trociny/wip-57821-pacific
Yuri Weinstein [Wed, 7 Dec 2022 15:55:57 +0000 (07:55 -0800)]
Merge pull request #48443 from trociny/wip-57821-pacific

pacific: cephfs-data-scan: make scan_links more verbose

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #48262 from batrick/i57671
Yuri Weinstein [Wed, 7 Dec 2022 15:55:29 +0000 (07:55 -0800)]
Merge pull request #48262 from batrick/i57671

 pacific: mds: damage table only stores one dentry per dirfrag

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #48253 from dparmar18/wip-57665-pacific
Yuri Weinstein [Wed, 7 Dec 2022 15:55:01 +0000 (07:55 -0800)]
Merge pull request #48253 from dparmar18/wip-57665-pacific

pacific: mds/Server: Do not abort MDS on unknown messages

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #48133 from lxbsz/wip-57571
Yuri Weinstein [Wed, 7 Dec 2022 15:54:05 +0000 (07:54 -0800)]
Merge pull request #48133 from lxbsz/wip-57571

pacific: client: do not uninline data for read

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #49301 from zdover23/wip-doc-2022-12-07-backport-49283-to-pacific
zdover23 [Wed, 7 Dec 2022 14:33:42 +0000 (00:33 +1000)]
Merge pull request #49301 from zdover23/wip-doc-2022-12-07-backport-49283-to-pacific

pacific: doc/rbd: refine "Create a Block Device User"

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2 years agodoc/rbd: refine "Create a Block Device User" 49301/head
Zac Dover [Tue, 6 Dec 2022 14:20:24 +0000 (00:20 +1000)]
doc/rbd: refine "Create a Block Device User"

Refine "Create a Block Device User" in doc/rbd/rados-rbd-cmds.rst.

https://tracker.ceph.com/issues/57001

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 51bc43845f03956b26c2a65fbd89a5654b860093)

2 years agotest/store_test: add tests for deferred writes 49170/head
Adam Kupczyk [Thu, 13 Oct 2022 17:55:13 +0000 (17:55 +0000)]
test/store_test: add tests for deferred writes

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 6eb5ea7ea8652eafd84e56a773bd53363b7f205f)

Conflict:
  Modified l_bluestore_* perf names to pacific's names.
  Included fmt.

2 years agoMerge pull request #48221 from mchangir/wip-55748-pacific
Yuri Weinstein [Tue, 6 Dec 2022 15:55:47 +0000 (07:55 -0800)]
Merge pull request #48221 from mchangir/wip-55748-pacific

pacific: mgr/snap_schedule: remove subvol interface

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2 years agoMerge pull request #48734 from joscollin/wip-57974-pacific
Yuri Weinstein [Tue, 6 Dec 2022 15:43:30 +0000 (07:43 -0800)]
Merge pull request #48734 from joscollin/wip-57974-pacific

pacific: cephfs-top: make cephfs-top display scrollable

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #45451 from cfsnyder/wip-52958-pacific
Casey Bodley [Tue, 6 Dec 2022 15:03:23 +0000 (10:03 -0500)]
Merge pull request #45451 from cfsnyder/wip-52958-pacific

pacific: radosgw-admin: 'reshard list' doesn't log ENOENT errors

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #49276 from zdover23/wip-doc-2022-12-06-backport-49270-to-pacific
zdover23 [Tue, 6 Dec 2022 13:36:10 +0000 (23:36 +1000)]
Merge pull request #49276 from zdover23/wip-doc-2022-12-06-backport-49270-to-pacific

pacific: doc/rados: add prompts to placement-groups.rst (3)

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge pull request #49274 from zdover23/wip-doc-2022-12-06-backport-49269-to-pacific
zdover23 [Tue, 6 Dec 2022 13:35:41 +0000 (23:35 +1000)]
Merge pull request #49274 from zdover23/wip-doc-2022-12-06-backport-49269-to-pacific

pacific: doc/rados: add prompts to placement-groups.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge pull request #49272 from zdover23/wip-doc-2022-12-06-backport-49268-to-pacific
zdover23 [Tue, 6 Dec 2022 13:35:13 +0000 (23:35 +1000)]
Merge pull request #49272 from zdover23/wip-doc-2022-12-06-backport-49268-to-pacific

pacifc: doc/rados: add prompts to placement-groups.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rados: add prompts to placement-groups.rst (3) 49276/head
Zac Dover [Tue, 6 Dec 2022 07:13:44 +0000 (17:13 +1000)]
doc/rados: add prompts to placement-groups.rst (3)

Add unselectable prompts to doc/rados/operations/placement-groups.rst (3
of 3).

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit eb24e24e99e76adae954fc56f509b8adc7217a16)

2 years agodoc/rados: add prompts to placement-groups.rst 49274/head
Zac Dover [Tue, 6 Dec 2022 07:07:18 +0000 (17:07 +1000)]
doc/rados: add prompts to placement-groups.rst

Add unselectable prompts to doc/rados/operations/placement-groups.rst.
(2 of 3)

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 8574cfb847bb555bc724a6bd44a815f83e3dd364)

2 years agodoc/rados: add prompts to placement-groups.rst 49272/head
Zac Dover [Tue, 6 Dec 2022 06:56:02 +0000 (16:56 +1000)]
doc/rados: add prompts to placement-groups.rst

Add unselectable prompts to doc/rados/operations/placement-groups.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit ec38804d5a9007bbccb3d841f4e882d7c7a5951b)

2 years agoMerge pull request #49266 from zdover23/wip-doc-2022-12-06-backport-49264-to-pacific
colemitchell [Tue, 6 Dec 2022 06:17:13 +0000 (01:17 -0500)]
Merge pull request #49266 from zdover23/wip-doc-2022-12-06-backport-49264-to-pacific

pacific: doc/glossary: add matter to "RBD"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/glossary: add matter to "RBD" 49266/head
Zac Dover [Tue, 6 Dec 2022 04:15:43 +0000 (14:15 +1000)]
doc/glossary: add matter to "RBD"

Clarify that "RBD" and "Ceph Block Device" and "RADOS Block Device" all
refer to the same thing.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit acdb2a6ee357f3b662580d6d7bc815af08af730e)

2 years agoos/bluestore/bluefs: Add tracking of bluefs log in noop replay mode 48915/head
Adam Kupczyk [Wed, 15 Dec 2021 09:59:55 +0000 (09:59 +0000)]
os/bluestore/bluefs: Add tracking of bluefs log in noop replay mode

Keep updating bluefs log when printing content of bluefs replay log.
Without this modification we only have initial content of log.
Log can be printed by 'ceph-bluestore-tool bluefs-log-dump'.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 2292a4d85a6c26be69b3cda8ba885a0cb23b2224)

2 years agoos/bluestore/bluefs: Sync BlueFS log with its allocation delta
Adam Kupczyk [Wed, 24 Nov 2021 17:55:05 +0000 (18:55 +0100)]
os/bluestore/bluefs: Sync BlueFS log with its allocation delta

BlueFS log is the only file that we can append to.
When we append to file we must take into consideration previously commited allocations,
otherwise update will be miscalculated.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit ae5c5b7655535887ef56c96af62a1bf99f4c1d13)

2 years agotest/objectstore/bluefs_test: Add test for continuation of previous BlueFS log
Adam Kupczyk [Wed, 24 Nov 2021 17:52:35 +0000 (18:52 +0100)]
test/objectstore/bluefs_test: Add test for continuation of previous BlueFS log

Added test that verifies that in update mode we properly pick up delta.
BlueFS log is the only file that can be appended to, but it is done in very indirect way.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit baed63ab124fb14a92fa52a035111d5e122e4be6)

2 years agoos/bluefs: allow incremental file metadata updates in bluefs log
Igor Fedotov [Fri, 30 Jul 2021 11:02:26 +0000 (14:02 +0300)]
os/bluefs: allow incremental file metadata updates in bluefs log

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 821aadaaa92b4aa5920cd4bbbb59024ab55ea5d7)

2 years agoos/bluestore/bluefs: Cleanup allocation consistency check code
Adam Kupczyk [Wed, 11 Aug 2021 13:41:34 +0000 (15:41 +0200)]
os/bluestore/bluefs: Cleanup allocation consistency check code

When bluefs_log_replay_check_allocations is set _replay performs checks if
allocations/deallocations of extents are valid and properly aligned.
The changes include:
- now deallocations are also checked for valid alignment (more sanity checks)
- bluefs log read from super is checked once - before reading any transaction

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #47875 from ifed01/wip-ifed-bluefs-import-pac
Igor Fedotov [Mon, 5 Dec 2022 23:48:31 +0000 (02:48 +0300)]
Merge pull request #47875 from ifed01/wip-ifed-bluefs-import-pac

pacific: os/bluestore: add bluefs-import command

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #49142 from cbodley/wip-58119
Yuri Weinstein [Mon, 5 Dec 2022 23:47:47 +0000 (15:47 -0800)]
Merge pull request #49142 from cbodley/wip-58119

pacific: rgw: initialize rgw_log_entry::identity_type

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2 years agoMerge pull request #46499 from NitzanMordhai/wip-55768-pacific
Yuri Weinstein [Mon, 5 Dec 2022 17:51:22 +0000 (09:51 -0800)]
Merge pull request #46499 from NitzanMordhai/wip-55768-pacific

pacific: librados/watch_notify: reconnect after socket injection

Reviewed-by: Neha Ojha <nojha@redhat.com>
2 years agoMerge pull request #48553 from vshankar/tr-57875
Yuri Weinstein [Mon, 5 Dec 2022 16:56:06 +0000 (08:56 -0800)]
Merge pull request #48553 from vshankar/tr-57875

pacific: client: use parent directory POSIX ACLs for snapshot dir

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh HR khiremat@redhat.com
2 years agoMerge pull request #48544 from ronen-fr/wip-rf-acting-pacific
Yuri Weinstein [Mon, 5 Dec 2022 16:55:26 +0000 (08:55 -0800)]
Merge pull request #48544 from ronen-fr/wip-rf-acting-pacific

pacific: osd/scrub: use the actual active set when requesting replicas

Reviewed-by: Samuel Just <sjust@redhat.com>
2 years agoMerge pull request #48521 from ajarr/wip-57880-pacific
Yuri Weinstein [Mon, 5 Dec 2022 16:54:36 +0000 (08:54 -0800)]
Merge pull request #48521 from ajarr/wip-57880-pacific

pacific:  src/mds: increment directory inode's change attr by one

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh HR khiremat@redhat.com
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #48468 from neesingh-rh/wip-57848-pacific
Yuri Weinstein [Mon, 5 Dec 2022 16:53:43 +0000 (08:53 -0800)]
Merge pull request #48468 from neesingh-rh/wip-57848-pacific

pacific: mgr/volumes: Add human-readable flag to volume info command

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2 years agoMerge pull request #48278 from ifed01/wip-ifed-fix-57687
Yuri Weinstein [Mon, 5 Dec 2022 16:52:24 +0000 (08:52 -0800)]
Merge pull request #48278 from ifed01/wip-ifed-fix-57687

pacific: os/bluestore: use direct write in BlueStore::_write_bdev_label

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #48250 from ifed01/wip-ifed-fix-57121-pac
Yuri Weinstein [Mon, 5 Dec 2022 16:51:37 +0000 (08:51 -0800)]
Merge pull request #48250 from ifed01/wip-ifed-fix-57121-pac

pacific: osd: set per_pool_stats true when OSD has no PG

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #49255 from zdover23/wip-doc-2022-12-06-backport-49252-to-pacific
colemitchell [Mon, 5 Dec 2022 16:50:42 +0000 (11:50 -0500)]
Merge pull request #49255 from zdover23/wip-doc-2022-12-06-backport-49252-to-pacific

pacific: doc/glossary: add DAS

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge pull request #48168 from ifed01/wip-ifed-fix-blufs-unlink-fsync-pac
Yuri Weinstein [Mon, 5 Dec 2022 16:44:58 +0000 (08:44 -0800)]
Merge pull request #48168 from ifed01/wip-ifed-fix-blufs-unlink-fsync-pac

pacific: os/bluestore: do not signal deleted dirty file to bluefs log

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #48167 from ifed01/wip-ifed-fix-alloc-dump-pac
Yuri Weinstein [Mon, 5 Dec 2022 16:44:26 +0000 (08:44 -0800)]
Merge pull request #48167 from ifed01/wip-ifed-fix-alloc-dump-pac

pacific: os/bluestore:  proper locking for Allocators' dump methods

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #45408 from ifed01/wip-ifed-fix-bluefs-log-size
Yuri Weinstein [Mon, 5 Dec 2022 16:42:19 +0000 (08:42 -0800)]
Merge pull request #45408 from ifed01/wip-ifed-fix-bluefs-log-size

pacific: os/bluestore: fix improper bluefs log size tracking in volume selector

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc/glossary: add DAS 49255/head
Zac Dover [Mon, 5 Dec 2022 13:43:29 +0000 (23:43 +1000)]
doc/glossary: add DAS

Add a definition for "DAS" (directly attached storage).

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit a1f53a0fc0314c5c8a5cb0cb6d47acf20a4e52d0)

2 years agoMerge pull request #49054 from idryomov/wip-57872-pacific
Yuri Weinstein [Mon, 5 Dec 2022 15:59:53 +0000 (07:59 -0800)]
Merge pull request #49054 from idryomov/wip-57872-pacific

pacific: librbd/cache/pwl: fix clean vs bytes_dirty cache state inconsistency

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2 years agoqa: rbd_groups.sh: change interpreter to bash 49195/head
Ilya Dryomov [Sun, 4 Dec 2022 10:40:24 +0000 (11:40 +0100)]
qa: rbd_groups.sh: change interpreter to bash

Commit e0da2a4e8cae ("qa/workunits/rbd: Add test to list snapshots of
consistency group") added bash-specific syntax.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 8f712733af25ddaa3d7a55c571042ef70ecf9454)

2 years agoMerge pull request #49245 from zdover23/wip-doc-2022-12-05-backport-49241-to-pacific
colemitchell [Mon, 5 Dec 2022 03:23:35 +0000 (22:23 -0500)]
Merge pull request #49245 from zdover23/wip-doc-2022-12-05-backport-49241-to-pacific

pacific: doc/rados: add prompts to monitoring.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge pull request #49247 from zdover23/wip-doc-2022-12-05-backport-49243-to-pacific
colemitchell [Mon, 5 Dec 2022 03:22:37 +0000 (22:22 -0500)]
Merge pull request #49247 from zdover23/wip-doc-2022-12-05-backport-49243-to-pacific

pacific: doc/rados: add prompts to pg-repair.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rados: add prompts to pg-repair.rst 49247/head
Zac Dover [Mon, 5 Dec 2022 02:44:01 +0000 (12:44 +1000)]
doc/rados: add prompts to pg-repair.rst

Add unselectable prompts to doc/rados/operations/pg-repair.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit e09007c106fc63f9559706f8fae714fe0cc09d6b)

2 years agodoc/rados: add prompts to monitoring.rst 49245/head
Zac Dover [Mon, 5 Dec 2022 02:30:35 +0000 (12:30 +1000)]
doc/rados: add prompts to monitoring.rst

Add unselectable prompts to doc/rados/operations/monitoring.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 7f2872b776ca3ba40e9097ef00504f5527c7e297)

2 years agoqa: add a upgrade test suite from nautilus and test the new getvxattr op 47891/head
Xiubo Li [Wed, 3 Aug 2022 00:29:18 +0000 (08:29 +0800)]
qa: add a upgrade test suite from nautilus and test the new getvxattr op

For new OPs the old ceph may will crash the MDSs when receiving
unknow OPs. As a workaround the new clients will check the sessions
feature bits to decide to send the new OPs or not.

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit eae0a16002798e69936f67edf8266fbc9d82bf12)

2 years agoqa: make filesystem to be compatible with nautilus for blocklist
Xiubo Li [Mon, 1 Aug 2022 04:29:36 +0000 (12:29 +0800)]
qa: make filesystem to be compatible with nautilus for blocklist

Old cephs, such as nautilus, will use "blacklist" instead of "blocklist".

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 1387fc7fa012af4d6a8efca2d6d37cdb2583b9da)
Conflicts:
- "osd blocklist clear" format conflict
- s/run_cluster_cmd/raw_cluster_cmd/

2 years agoqa: make filesystem to be compatible with nautilus when creating pools
Xiubo Li [Fri, 29 Jul 2022 01:16:15 +0000 (09:16 +0800)]
qa: make filesystem to be compatible with nautilus when creating pools

For old cephs, such as the nautilus, there is no --pg_num_min option.

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 2a28060adbbc1bb0d9a94413e415ef2ef2f45316)
Conflicts:
- Fixed Invalid command: missing required parameter pg_num(<int[0-]>)

2 years agotest/libcephfs: add newops test case
Xiubo Li [Fri, 29 Jul 2022 04:37:40 +0000 (12:37 +0800)]
test/libcephfs: add newops test case

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 91fcdbb58e572a5e891e986b85d70cd84f3daf7d)

2 years agoclient: fail the request if the peer MDS doesn't support getvxattr op
Xiubo Li [Tue, 12 Jul 2022 14:42:23 +0000 (22:42 +0800)]
client: fail the request if the peer MDS doesn't support getvxattr op

Just fail the request instead sending the request out, or the peer
MDS will crash.

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 953d637db4b4799b0254c55ab52d2f515d175ff3)

2 years agomds: add CEPHFS_FEATURE_OP_GETVXATTR feature bit support
Xiubo Li [Tue, 12 Jul 2022 14:33:45 +0000 (22:33 +0800)]
mds: add CEPHFS_FEATURE_OP_GETVXATTR feature bit support

For old ceph if they receive unknown OPs, they will crash the MDS
daemons directly. So we need to distiguish whether the new OPs
is supported by the peer MDSs or not.

Fixes: https://tracker.ceph.com/issues/56529
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit c7a0e71040e2a008497d4d7e2249f514bf082c92)