]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 years agorgw/rados: check_quota() uses real bucket owner 51328/head
Mykola Golub [Thu, 6 Apr 2023 15:38:02 +0000 (11:38 -0400)]
rgw/rados: check_quota() uses real bucket owner

Fixes: https://tracker.ceph.com/issues/58725
Signed-off-by: Mykola Golub <mgolub@suse.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 13299bccc6ae42579a9def4776270abd334e9efe)

2 years agoMerge pull request #51309 from zdover23/wip-doc-2023-05-02-backport-51133-to-reef
zdover23 [Tue, 2 May 2023 22:25:04 +0000 (08:25 +1000)]
Merge pull request #51309 from zdover23/wip-doc-2023-05-02-backport-51133-to-reef

reef: doc/mgr: update prompts in prometheus.rst

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2 years agoMerge pull request #50631 from trociny/wip-59130-reef
Adam King [Tue, 2 May 2023 21:48:25 +0000 (17:48 -0400)]
Merge pull request #50631 from trociny/wip-59130-reef

reef: mgr/cephadm: don't add mgr into iscsi trusted_ip_list if it's already there

Reviewed-by: Adam King <adking@redhat.com>
2 years agodoc/mgr: update prompts in prometheus.rst 51309/head
Zac Dover [Tue, 18 Apr 2023 14:28:50 +0000 (16:28 +0200)]
doc/mgr: update prompts in prometheus.rst

Update prompts in prometheus.rst so that they're unselectable.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5a90d64b343f158d43397c70c267deb4e7ef0e00)

2 years agoMerge pull request #51305 from zdover23/wip-doc-2023-05-02-backport-51299-to-reef
Anthony D'Atri [Mon, 1 May 2023 23:25:48 +0000 (19:25 -0400)]
Merge pull request #51305 from zdover23/wip-doc-2023-05-02-backport-51299-to-reef

reef: doc/radosgw: rabbitmq - push-endpoint edit

2 years agodoc/radosgw: rabbitmq - push-endpoint edit 51305/head
Zac Dover [Mon, 1 May 2023 17:14:01 +0000 (03:14 +1000)]
doc/radosgw: rabbitmq - push-endpoint edit

Remove a note that directed users to change "push-endpoint" (with a
hyphen) to "push_endpoint" (with an underscore) when using rabbitmq.

Re: https://github.com/ceph/ceph/pull/48486#issuecomment-1529925389

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e4b35de2abf00d514c76f77645c587c562bab05d)

2 years agoMerge pull request #51302 from zdover23/wip-doc-2023-05-02-backport-51296-to-reef
Anthony D'Atri [Mon, 1 May 2023 20:35:51 +0000 (16:35 -0400)]
Merge pull request #51302 from zdover23/wip-doc-2023-05-02-backport-51296-to-reef

reef: doc/rados: edit stretch-mode.rst

2 years agodoc/rados: edit stretch-mode.rst 51302/head
Zac Dover [Mon, 1 May 2023 02:29:07 +0000 (12:29 +1000)]
doc/rados: edit stretch-mode.rst

Refine and supplement the introductory and explanatory text at the top
of the /doc/rados/operations/stretch-mode.rst file.

Co-authored-by: Josh Durgin <jdurgin@redhat.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b642900abc57302e62a5064dba510c3cc5743ac0)

2 years agoMerge pull request #51289 from zdover23/wip-doc-2023-04-30-backport-51285-to-reef
Anthony D'Atri [Sat, 29 Apr 2023 20:00:57 +0000 (16:00 -0400)]
Merge pull request #51289 from zdover23/wip-doc-2023-04-30-backport-51285-to-reef

reef: doc/rados: edit stretch-mode procedure

2 years agodoc/rados: edit stretch-mode procedure 51289/head
Zac Dover [Sat, 29 Apr 2023 00:14:02 +0000 (10:14 +1000)]
doc/rados: edit stretch-mode procedure

Edit the "stretch mode" section in doc/rados/operations/stretch-mode.rst
so that the procedure is formatted as a procedure and the sentences
correctly have heads.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a19ff7a5ea9bbd24365648a90abfa1b720c5b231)

2 years agoMerge pull request #51286 from zdover23/wip-doc-2023-04-29-backport-51276-to-reef
zdover23 [Sat, 29 Apr 2023 17:32:04 +0000 (03:32 +1000)]
Merge pull request #51286 from zdover23/wip-doc-2023-04-29-backport-51276-to-reef

reef: docs: Update the Prometheus endpoint info

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodocs: Update the Prometheus endpoint info 51286/head
Paul Cuzner [Fri, 28 Apr 2023 05:21:39 +0000 (17:21 +1200)]
docs: Update the Prometheus endpoint info

This patch just tidies up some of the links and adds
an example showing how the http_sd_configs option
may be used.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 690d34ab08f22cd988828aa2097531627000907e)

2 years agoMerge pull request #51272 from zdover23/wip-doc-2023-04-28-backport-51271-to-reef
Anthony D'Atri [Fri, 28 Apr 2023 00:53:50 +0000 (20:53 -0400)]
Merge pull request #51272 from zdover23/wip-doc-2023-04-28-backport-51271-to-reef

reef: doc/rados: m-config-ref: edit "background"

2 years agodoc/rados: m-config-ref: edit "background" 51272/head
Zac Dover [Thu, 27 Apr 2023 22:35:17 +0000 (08:35 +1000)]
doc/rados: m-config-ref: edit "background"

Edit the "Background" section of doc/rados/monitor/config-ref.rst

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9223863fc83095def59b416bf70f9a828a701ccc)

2 years agoMerge pull request #51148 from zdover23/wip-doc-2023-04-20-backport-51143-to-reef
zdover23 [Thu, 27 Apr 2023 20:41:03 +0000 (06:41 +1000)]
Merge pull request #51148 from zdover23/wip-doc-2023-04-20-backport-51143-to-reef

reef: docs: warning and remove few docs section for Filestore

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agodoc/man/rbd: resurrect filestore alloc_size note 51148/head
Ilya Dryomov [Thu, 20 Apr 2023 10:05:14 +0000 (12:05 +0200)]
doc/man/rbd: resurrect filestore alloc_size note

Mistakenly removed in commit d79f2a81541c ("docs: warning and remove
few docs section for Filestore Update docs after filestore removal.").
The kernel client, however new, will continue to be able to talk to
FileStore OSDs for as long as they exist.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d3558c49bf0456a199cf55f73c5832f408462ec5)

2 years agoMerge pull request #51239 from zdover23/wip-doc-2023-04-27-backport-51154-to-reef
zdover23 [Thu, 27 Apr 2023 00:44:25 +0000 (10:44 +1000)]
Merge pull request #51239 from zdover23/wip-doc-2023-04-27-backport-51154-to-reef

reef: doc/rados/ops: edit user-management.rst (3 of x)

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/rados/ops: edit user-management.rst (3 of x) 51239/head
Zac Dover [Thu, 20 Apr 2023 08:25:00 +0000 (10:25 +0200)]
doc/rados/ops: edit user-management.rst (3 of x)

Line-edit doc/rados/user-management.rst (3 of x).

https://tracker.ceph.com/issues/58485

Follows https://github.com/ceph/ceph/pull/51140.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 97b751ed8f8917f9d4d9cbca03f224e6518836ef)

2 years agoMerge pull request #51155 from zdover23/wip-doc-2023-04-20-backport-51140-to-reef
zdover23 [Thu, 27 Apr 2023 00:09:09 +0000 (10:09 +1000)]
Merge pull request #51155 from zdover23/wip-doc-2023-04-20-backport-51140-to-reef

reef: doc/rados: edit user-management (2 of x)

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge pull request #51235 from zdover23/wip-doc-2023-04-27-backport-51204-to-reef
Anthony D'Atri [Wed, 26 Apr 2023 22:25:55 +0000 (18:25 -0400)]
Merge pull request #51235 from zdover23/wip-doc-2023-04-27-backport-51204-to-reef

reef: doc/cephfs: explain cephfs data and metadata set

2 years agodoc/cephfs: explain cephfs data and metadata set 51235/head
Zac Dover [Tue, 25 Apr 2023 07:46:53 +0000 (17:46 +1000)]
doc/cephfs: explain cephfs data and metadata set

Explain how to set application metadata for the CephFS data pool and the
CephFS metadata pool.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9152f9700420f9735533f276559af87dff97bd75)

2 years agoMerge pull request #51012 from cbodley/wip-59358
Casey Bodley [Wed, 26 Apr 2023 15:18:00 +0000 (11:18 -0400)]
Merge pull request #51012 from cbodley/wip-59358

reef: rgw/keystone: use secret key from EC2 for sigv4 streaming mode

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2 years agoMerge pull request #51220 from zdover23/wip-doc-2023-04-26-backport-51193-to-reef
Anthony D'Atri [Wed, 26 Apr 2023 00:21:53 +0000 (20:21 -0400)]
Merge pull request #51220 from zdover23/wip-doc-2023-04-26-backport-51193-to-reef

reef: doc/start: rewrite intro paragraph

2 years agodoc/start: rewrite intro paragraph 51220/head
Zac Dover [Mon, 24 Apr 2023 11:02:16 +0000 (13:02 +0200)]
doc/start: rewrite intro paragraph

Rewrite the first paragraph in doc/start/intro.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit bea01d5f1469030253a3403dbb9e2c9fa97806ac)

2 years agoMerge pull request #51022 from cbodley/wip-59151
Casey Bodley [Tue, 25 Apr 2023 18:09:41 +0000 (14:09 -0400)]
Merge pull request #51022 from cbodley/wip-59151

reef: rgw: install rgw scripts with common files rather than radosgw files

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51019 from cbodley/wip-59273
Casey Bodley [Tue, 25 Apr 2023 15:35:26 +0000 (11:35 -0400)]
Merge pull request #51019 from cbodley/wip-59273

reef: rgw/admin: 'data sync status' formats binary error repo entries

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51024 from cbodley/wip-59133
Casey Bodley [Tue, 25 Apr 2023 15:35:01 +0000 (11:35 -0400)]
Merge pull request #51024 from cbodley/wip-59133

reef: rgw/s3: DeleteObjects response uses correct delete_marker flag

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51015 from cbodley/wip-59292
Casey Bodley [Tue, 25 Apr 2023 15:11:45 +0000 (11:11 -0400)]
Merge pull request #51015 from cbodley/wip-59292

reef: qa/rgw: add rgw/upgrade suite

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2 years agoMerge pull request #51014 from cbodley/wip-59280
Casey Bodley [Tue, 25 Apr 2023 15:02:48 +0000 (11:02 -0400)]
Merge pull request #51014 from cbodley/wip-59280

reef: rgw: set init_check_compat when bucket sync status doesn't exist

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51020 from cbodley/wip-59275
Casey Bodley [Tue, 25 Apr 2023 15:01:40 +0000 (11:01 -0400)]
Merge pull request #51020 from cbodley/wip-59275

reef: rgw/sts: Fixes get_cert_url improper url path concatenation

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51145 from cbodley/wip-59493
Casey Bodley [Tue, 25 Apr 2023 14:10:17 +0000 (10:10 -0400)]
Merge pull request #51145 from cbodley/wip-59493

reef: cmake/rgw: librgw tests depend on ALLOC_LIBS

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51013 from cbodley/wip-59278
Casey Bodley [Tue, 25 Apr 2023 14:09:49 +0000 (10:09 -0400)]
Merge pull request #51013 from cbodley/wip-59278

reef: rgw: fix CopyObj crash after admin override

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51017 from cbodley/wip-59360
Casey Bodley [Tue, 25 Apr 2023 14:09:17 +0000 (10:09 -0400)]
Merge pull request #51017 from cbodley/wip-59360

reef: rgw: fix rgw cache invalidation after unregister_watch() error

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51018 from cbodley/wip-59377
Casey Bodley [Tue, 25 Apr 2023 14:09:08 +0000 (10:09 -0400)]
Merge pull request #51018 from cbodley/wip-59377

reef: rgw/civetweb: handle old clients with transfer-encoding: chunked.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51021 from cbodley/wip-59356
Casey Bodley [Tue, 25 Apr 2023 14:08:33 +0000 (10:08 -0400)]
Merge pull request #51021 from cbodley/wip-59356

reef: rgw/sse-s3: fix bucket encryption of multipart upload

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51023 from cbodley/wip-59232
Casey Bodley [Tue, 25 Apr 2023 14:08:02 +0000 (10:08 -0400)]
Merge pull request #51023 from cbodley/wip-59232

reef: rgw/notifications: support bucket notification with bucket policy

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2 years agoMerge pull request #51025 from cbodley/wip-59145
Casey Bodley [Tue, 25 Apr 2023 14:07:43 +0000 (10:07 -0400)]
Merge pull request #51025 from cbodley/wip-59145

reef: rgw: Do not duplicate query-string in ops-log

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #51026 from cbodley/wip-59028
Casey Bodley [Tue, 25 Apr 2023 14:07:31 +0000 (10:07 -0400)]
Merge pull request #51026 from cbodley/wip-59028

reef: rgw: use unique_ptr for flat_map emplace in BucketTrimWatcher

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2 years agoMerge pull request #51027 from cbodley/wip-59013
Casey Bodley [Tue, 25 Apr 2023 14:07:18 +0000 (10:07 -0400)]
Merge pull request #51027 from cbodley/wip-59013

reef: rgw/notifications: fetch object state to get size, in rgw_lc.cc

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2 years agoMerge pull request #51028 from cbodley/wip-59220
Casey Bodley [Tue, 25 Apr 2023 14:06:46 +0000 (10:06 -0400)]
Merge pull request #51028 from cbodley/wip-59220

reef: qa/rgw: unpin centos for verify suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #50880 from guits/wip-59310-reef
Guillaume Abrioux [Tue, 25 Apr 2023 08:05:09 +0000 (10:05 +0200)]
Merge pull request #50880 from guits/wip-59310-reef

reef: ceph-volume: fix issue with fast device allocs when there are multiple PVs per VG

2 years agoMerge pull request #51181 from zdover23/wip-doc-2023-04-23-backport-51177-to-reef
Anthony D'Atri [Sun, 23 Apr 2023 21:19:18 +0000 (23:19 +0200)]
Merge pull request #51181 from zdover23/wip-doc-2023-04-23-backport-51177-to-reef

reef: doc/start: edit first 150 lines of documenting-ceph

2 years agoMerge pull request #51184 from zdover23/wip-doc-2023-04-23-backport-51178-to-reef
Anthony D'Atri [Sun, 23 Apr 2023 21:15:41 +0000 (23:15 +0200)]
Merge pull request #51184 from zdover23/wip-doc-2023-04-23-backport-51178-to-reef

reef: doc/glossary: add "Placement Groups" definition

2 years agodoc/glossary: add "Placement Groups" definition 51184/head
Zac Dover [Sat, 22 Apr 2023 08:55:38 +0000 (10:55 +0200)]
doc/glossary: add "Placement Groups" definition

Add a definition of "Placement Groups" to the Glossary.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9f37ea651f9ee2c51e0705b9b58ed356f1bc56e6)

2 years agodoc/start: edit first 50 lines of documenting-ceph 51181/head
Zac Dover [Sat, 22 Apr 2023 07:03:12 +0000 (09:03 +0200)]
doc/start: edit first 50 lines of documenting-ceph

Edit the first 150 lines of doc/start/documenting-ceph.rst. This is part
of an initiative to harvest the fruits of Cephalocon 2023, at which
documentation proved to be in demand to a surprising degree.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dd37f94aa4f1de947b1eaf5d82cc529925f5823e)

2 years agoMerge pull request #51151 from rhcs-dashboard/wip-59468-reef
Nizamudeen A [Thu, 20 Apr 2023 17:39:25 +0000 (23:09 +0530)]
Merge pull request #51151 from rhcs-dashboard/wip-59468-reef

reef: mgr/dashboard: skip Create OSDs step in Cluster expansion

Reviewed-by: Pegonzal <NOT@FOUND>
2 years agodoc/rados: edit user-management (2 of x) 51155/head
Zac Dover [Tue, 18 Apr 2023 20:59:09 +0000 (22:59 +0200)]
doc/rados: edit user-management (2 of x)

Line-edit doc/rados/user-management.rst (2 of x). Some internal
references had to be removed, but these will be repaired when the next
part of this file is updated in a future PR.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e3575bb72f307a27d49fedf3692ca661e3d613a5)

2 years agomgr/dashboard: skip Create OSDs step in Cluster expansion 51151/head
Nizamudeen A [Fri, 14 Apr 2023 19:33:11 +0000 (01:03 +0530)]
mgr/dashboard: skip Create OSDs step in Cluster expansion

Its to ensure OSDs are not deployed on all hosts because that would make
the host draining impossible

Fixes: https://tracker.ceph.com/issues/59457
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 0f6d23a7aa024495a79cdedc80f7a00902115b6b)

2 years agodocs: warning and remove few docs section for Filestore
Nitzan Mordechai [Sun, 19 Feb 2023 11:33:51 +0000 (11:33 +0000)]
docs: warning and remove few docs section for Filestore
Update docs after filestore removal.

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit d79f2a81541cfa9e905aef00ad517278c2692c9c)

2 years agocmake/rgw: librgw tests depend on ALLOC_LIBS 51145/head
Casey Bodley [Thu, 13 Apr 2023 16:26:44 +0000 (09:26 -0700)]
cmake/rgw: librgw tests depend on ALLOC_LIBS

somehow this stops tcmalloc from crashing on ubuntu 20.04

Fixes: https://tracker.ceph.com/issues/59269
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit d5f97e6543906d5be898b24a1c10269ace309c76)

2 years agoMerge pull request #51125 from zdover23/wip-doc-2023-04-17-backport-50639-to-reef
zdover23 [Tue, 18 Apr 2023 14:07:39 +0000 (16:07 +0200)]
Merge pull request #51125 from zdover23/wip-doc-2023-04-17-backport-50639-to-reef

reef: doc: account for PG autoscaling being the default

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #51121 from rhcs-dashboard/wip-59465-reef
Nizamudeen A [Tue, 18 Apr 2023 13:32:03 +0000 (19:02 +0530)]
Merge pull request #51121 from rhcs-dashboard/wip-59465-reef

reef: mgr/dashboard: remove unncessary hyperlink in landing page

Reviewed-by: Pegonzal <NOT@FOUND>
2 years agoMerge pull request #51123 from zdover23/wip-doc-2023-04-17-backport-49762-to-reef
zdover23 [Tue, 18 Apr 2023 09:48:34 +0000 (11:48 +0200)]
Merge pull request #51123 from zdover23/wip-doc-2023-04-17-backport-49762-to-reef

reef: vstart: fix text format

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc: account for PG autoscaling being the default 51125/head
Conrad Hoffmann [Wed, 22 Mar 2023 22:03:57 +0000 (23:03 +0100)]
doc: account for PG autoscaling being the default

The current documentation tries really hard to convince people to set
both `osd_pool_default_pg_num` and `osd_pool_default_pgp_num` in their
configs, but at least the latter has undesirable side effects on any
Ceph version that has PG autoscaling enabled by default (at least quincy
and beyond).

Assume a cluster with defaults of `64` for `pg_num` and `pgp_num`.
Starting `radosgw` will fail as it tries to create various pools without
providing values for `pg_num` or `pgp_num`. This triggers the following
in `OSDMonitor::prepare_new_pool()`:

- `pg_num` is set to `1`, because autoscaling is enabled
- `pgp_num` is set to `osd pool default pgp_num`, which we set to `64`
- This is an invalid setup, so the pool creation fails

Likewise, `ceph osd pool create mypool` (without providing values for
`pg_num` or `pgp_num`) does not work.

Following this rationale:

- Not providing a default value for `pgp_num` will always do the right
  thing, unless you use advanced features, in which case you can be
  expected to set both values on pool creation
- Setting `osd_pool_default_pgp_num` in your config breaks pool creation
  for various cases

This commit:

- Removes `osd_pool_default_pgp_num` from all example configs
- Adds mentions of the autoscaling and how it interacts with the default
  values in various places

For each file that was touched, the following maintenance was also
performed:

- Change interternal spaces to underscores for config values
- Remove mentions of filestore or any of its settings
- Fix minor inconsistencies, like indentation etc.

There is also a ticket which I think is very relevant and fixed by this,
though it only captures part of the broader issue addressed here:

Fixes: https://tracker.ceph.com/issues/47176
Signed-off-by: Conrad Hoffmann <ch@bitfehler.net>
(cherry picked from commit 402d2eacbc67f7a6d47d8f90d9ed757fc20931a6)

2 years agovstart: fix text format 51123/head
Rongqi Sun [Tue, 17 Jan 2023 05:55:01 +0000 (13:55 +0800)]
vstart: fix text format

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
(cherry picked from commit 57dc8ce51602543d42a2f82cb829eda1c231b434)

2 years agomgr/dashboard: remove unncessary hyperlink in landing page 51121/head
Nizamudeen A [Mon, 17 Apr 2023 09:38:06 +0000 (15:08 +0530)]
mgr/dashboard: remove unncessary hyperlink in landing page

Fixes: https://tracker.ceph.com/issues/59462
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 7e7da955445ecf37bc43fc296298bd91d0d8a140)

2 years agoMerge pull request #51080 from rhcs-dashboard/wip-59452-reef
Nizamudeen A [Mon, 17 Apr 2023 13:38:33 +0000 (19:08 +0530)]
Merge pull request #51080 from rhcs-dashboard/wip-59452-reef

reef: mgr/dashboard: fix cephadm e2e expression changed error

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
2 years agoMerge pull request #51116 from zdover23/wip-doc-2023-04-17-backport-51114-to-reef
colemitchell [Mon, 17 Apr 2023 10:43:33 +0000 (12:43 +0200)]
Merge pull request #51116 from zdover23/wip-doc-2023-04-17-backport-51114-to-reef

reef: doc/radosgw: format part of s3select

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2 years agodoc/radosgw: format part of s3select 51116/head
Cole Mitchell [Mon, 17 Apr 2023 09:34:49 +0000 (05:34 -0400)]
doc/radosgw: format part of s3select

Partially format the 'Basic Workflow' section's introduction and 'Basic Functionalities' subsection in s3select. Nothing else is being fixed.

Signed-off-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
(cherry picked from commit 13cf134c0610509da52aa68e11e26f0740002bde)

2 years agoMerge pull request #51110 from zdover23/wip-doc-2023-04-16-backport-50941-to-reef
Anthony D'Atri [Sun, 16 Apr 2023 20:25:39 +0000 (22:25 +0200)]
Merge pull request #51110 from zdover23/wip-doc-2023-04-16-backport-50941-to-reef

reef: doc/foundation: Update Foundation members for April 2023

2 years agoMerge pull request #51107 from zdover23/wip-doc-2023-04-16-backport-51099-to-reef
zdover23 [Sun, 16 Apr 2023 16:24:30 +0000 (18:24 +0200)]
Merge pull request #51107 from zdover23/wip-doc-2023-04-16-backport-51099-to-reef

reef: doc/dev: format command in cephfs-mirroring

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2 years agoMerge pull request #51096 from zdover23/wip-doc-2023-04-16-backport-51062-to-reef
zdover23 [Sun, 16 Apr 2023 16:22:40 +0000 (18:22 +0200)]
Merge pull request #51096 from zdover23/wip-doc-2023-04-16-backport-51062-to-reef

reef: doc/glossary: add "Hybrid Storage"

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2 years agoMerge pull request #51092 from zdover23/wip-doc-2023-04-16-backport-51091-to-reef
zdover23 [Sun, 16 Apr 2023 16:18:43 +0000 (18:18 +0200)]
Merge pull request #51092 from zdover23/wip-doc-2023-04-16-backport-51091-to-reef

reef: doc/mgr/prometheus: fix confval reference

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2 years agodoc/foundation: Update Foundation members for April 2023 51110/head
Mike Perez [Fri, 7 Apr 2023 21:00:36 +0000 (14:00 -0700)]
doc/foundation: Update Foundation members for April 2023

Signed-off-by: Mike Perez <thingee@gmail.com>
(cherry picked from commit 759f26a99f7a1b52954e12e080304b867af81418)

2 years agodoc/dev: format command in cephfs-mirroring 51107/head
Zac Dover [Sun, 16 Apr 2023 09:11:27 +0000 (11:11 +0200)]
doc/dev: format command in cephfs-mirroring

Correctly format a command in doc/dev/cephfs-mirroring/#creating-users.

Reported by casanlin@init7.net at
https://pad.ceph.com/p/Report_Documentation_Bugs

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 408219bfca6b1e698229967e76d22d10028b7c20)

2 years agoMerge pull request #51104 from zdover23/wip-doc-2023-04-16-backport-51103-to-reef
colemitchell [Sun, 16 Apr 2023 14:43:15 +0000 (10:43 -0400)]
Merge pull request #51104 from zdover23/wip-doc-2023-04-16-backport-51103-to-reef

reef: doc/radosgw: format part of s3select

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2 years agodoc/radosgw: format part of s3select 51104/head
Cole Mitchell [Sun, 16 Apr 2023 13:13:56 +0000 (09:13 -0400)]
doc/radosgw: format part of s3select

Format the first section of s3select. Nothing else is being fixed.

Signed-off-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
(cherry picked from commit a6a84471a7af154e7ccc93f51df2fc9744dc606c)

2 years agodoc/glossary: add "Hybrid Storage" 51096/head
Zac Dover [Thu, 13 Apr 2023 12:01:44 +0000 (14:01 +0200)]
doc/glossary: add "Hybrid Storage"

Add "Hybrid Storage" to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dc8148d0727b307fb3baa30baf9dfee9bf8a247e)

2 years agodoc/mgr/prometheus: fix confval reference 51092/head
Piotr Parczewski [Sat, 15 Apr 2023 21:16:35 +0000 (23:16 +0200)]
doc/mgr/prometheus: fix confval reference

Signed-off-by: Piotr Parczewski <piotr@stackhpc.com>
(cherry picked from commit b9b75dafe248e07b21f2958023697397094cc537)

2 years agoMerge pull request #51087 from zdover23/wip-doc-2023-04-15-backport-51086-to-reef
Anthony D'Atri [Sat, 15 Apr 2023 09:46:55 +0000 (11:46 +0200)]
Merge pull request #51087 from zdover23/wip-doc-2023-04-15-backport-51086-to-reef

reef: doc/rados/ops: remove ceph-medic from monitoring

2 years agodoc/rados/ops: remove ceph-medic from monitoring 51087/head
Zac Dover [Sat, 15 Apr 2023 07:42:31 +0000 (09:42 +0200)]
doc/rados/ops: remove ceph-medic from monitoring

Remove mention of ceph-medic from doc/rados/operations/monitoring.rst,
because it is no longer supported.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 42cd28a2a639e68a44838ae4e7f875cb6bd5d97b)

2 years agomgr/dashboard: fix cephadm e2e expression changed error 51080/head
Nizamudeen A [Fri, 14 Apr 2023 06:03:16 +0000 (11:33 +0530)]
mgr/dashboard: fix cephadm e2e expression changed error

tried to fix this issue from the daemon component sometime ago several
times but it didn't work. So force ignoring the error

Fixes: https://tracker.ceph.com/issues/59444
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit f7e29e5ab85fabcf2524656bb456a2955fa8608d)

2 years agoMerge pull request #51010 from rhcs-dashboard/wip-59420-reef
Nizamudeen A [Fri, 14 Apr 2023 08:24:57 +0000 (13:54 +0530)]
Merge pull request #51010 from rhcs-dashboard/wip-59420-reef

reef: mgr/dashboard: fix eviction of all FS clients

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agoMerge pull request #51063 from zdover23/wip-doc-2023-04-13-backport-50713-to-reef
Anthony D'Atri [Thu, 13 Apr 2023 12:32:26 +0000 (08:32 -0400)]
Merge pull request #51063 from zdover23/wip-doc-2023-04-13-backport-50713-to-reef

reef: doc/glossary: improve "CephX" entry

2 years agodoc/glossary: improve "CephX" entry 51063/head
Zac Dover [Tue, 28 Mar 2023 08:42:11 +0000 (18:42 +1000)]
doc/glossary: improve "CephX" entry

Improve the glossary entry for "CephX".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 02e3a5cb763987eeaee2dd1a7543d2762aaad7fe)

2 years agoMerge pull request #50919 from idryomov/wip-rbd-reef-backports-1
Ilya Dryomov [Thu, 13 Apr 2023 12:03:55 +0000 (14:03 +0200)]
Merge pull request #50919 from idryomov/wip-rbd-reef-backports-1

reef: RBD backports (batch 1)

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2 years agoMerge pull request #51058 from rhcs-dashboard/wip-59436-reef
Nizamudeen A [Thu, 13 Apr 2023 10:10:20 +0000 (15:40 +0530)]
Merge pull request #51058 from rhcs-dashboard/wip-59436-reef

reef: mgr/dashboard: rbd-mirror force promotion

Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agoqa/suites/rbd: install qemu-utils in addition to qemu-block-extra on Ubuntu 50919/head
Ilya Dryomov [Tue, 11 Apr 2023 20:43:58 +0000 (22:43 +0200)]
qa/suites/rbd: install qemu-utils in addition to qemu-block-extra on Ubuntu

qemu-utils is usually pre-installed but, due to what appears to be
a Ubuntu packaging bug, it's not upgraded when qemu-block-extra is
installed:

  The following NEW packages will be installed:
    qemu-block-extra
  The following packages will be upgraded:
    qemu-system-common qemu-system-data qemu-system-gui qemu-system-x86

However, the version of the block driver must match exactly the version
of the qemu-img tool, so the above leads to:

  $ qemu-img convert -f qcow2 -O raw /home/ubuntu/cephtest/qemu/base.client.0.0.qcow2 rbd:rbd/client.0.0
  Failed to initialize module: /usr/lib/x86_64-linux-gnu/qemu/block-rbd.so
  Note: only modules from the same build can be loaded.
  qemu: module block-block-rbd not found, do you want to install qemu-block-extra package?
  qemu-img: Unknown protocol 'rbd'

Fixes: https://tracker.ceph.com/issues/59431
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit c529fdd63a5aae2c598078df05fe9bbef40042dc)

2 years agomgr/dashboard: rbd-mirror force promotion 51058/head
Pedro Gonzalez Gomez [Wed, 5 Apr 2023 15:42:52 +0000 (17:42 +0200)]
mgr/dashboard: rbd-mirror force promotion

resolves: https://tracker.ceph.com/issues/59327
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 9696b6a04830297c23c4cccd6e7c225f183ba0b2)

2 years agoMerge pull request #51035 from zdover23/wip-doc-2023-04-12-backport-50993-to-reef
zdover23 [Wed, 12 Apr 2023 09:41:54 +0000 (19:41 +1000)]
Merge pull request #51035 from zdover23/wip-doc-2023-04-12-backport-50993-to-reef

reef: doc/rados/operations: edit monitoring.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #50994 from guits/cv-bkp-50473-reef
Guillaume Abrioux [Wed, 12 Apr 2023 07:58:53 +0000 (09:58 +0200)]
Merge pull request #50994 from guits/cv-bkp-50473-reef

ceph-volume: update the OS before deploying Ceph (reef)

2 years agodoc/rados/operations: edit monitoring.rst 51035/head
Zac Dover [Tue, 11 Apr 2023 04:15:47 +0000 (14:15 +1000)]
doc/rados/operations: edit monitoring.rst

Line-edit the final third of doc/rados/operations/monitoring.rst.

Follows https://github.com/ceph/ceph/pull/50834.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b9ccad80608953fc0af779e8cad93971d47649b6)

2 years agoMerge pull request #51006 from rhcs-dashboard/wip-59402-reef
Nizamudeen A [Tue, 11 Apr 2023 16:11:42 +0000 (21:41 +0530)]
Merge pull request #51006 from rhcs-dashboard/wip-59402-reef

reef: mgr/dashboard: fix create osd default selected as recommended not working

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
2 years agoqa/rgw: unpin centos for verify suite 51028/head
Casey Bodley [Wed, 22 Mar 2023 17:57:57 +0000 (13:57 -0400)]
qa/rgw: unpin centos for verify suite

use a random supported distro instead of centos

Fixes: https://tracker.ceph.com/issues/54102
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4bc1f376b901f809748b751d45899e512738c934)

2 years agorgwlc/notifications: also fix etag 51027/head
yuval Lifshitz [Fri, 16 Dec 2022 19:01:06 +0000 (14:01 -0500)]
rgwlc/notifications: also fix etag

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit 7c58b2a9f3cb3f31398065d862e264bb248760bf)

2 years agorgw/notifications: fetch object state to get size, in rgw_lc.cc
Matt Benjamin [Thu, 15 Dec 2022 19:55:16 +0000 (14:55 -0500)]
rgw/notifications: fetch object state to get size, in rgw_lc.cc

Failure to call get_obj_state() leaves object size and other members
uninitialized, and appears to result in in lc delete notifications
with 0 for object size.

Fixes: https://tracker.ceph.com/issues/58287
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit b20a66767f782c06258fb0a5551ee45d6dccb91c)

2 years agorgw: use unique_ptr for flat_map emplace in BucketTrimWatcher 51026/head
Vedansh Bhartia [Thu, 2 Mar 2023 13:04:53 +0000 (18:34 +0530)]
rgw: use unique_ptr for flat_map emplace in BucketTrimWatcher

When emplacing objects into the trim notify handler of
BucketTrimWatcher, use a unique_ptr for the handler so that it is
destroyed if the emplace fails.

Though the destructor is already called, this behaviour cannot be relied
upon. std::map does not exhibit the same behaviour, and would have
leaked memory had it been used instead.

Fixes: https://tracker.ceph.com/issues/57938
Signed-off-by: Vedansh Bhartia <vedanshbhartia@gmail.com>
(cherry picked from commit 43ef4753eb338781529a7dc8360eab13d56fce85)

2 years agoDo not duplicate query-string in ops-log 51025/head
Matt Benjamin [Sat, 11 Mar 2023 19:58:54 +0000 (14:58 -0500)]
Do not duplicate query-string in ops-log

Fixes: https://tracker.ceph.com/issues/59059
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit 3f2313f0e67c444407139c80dff596c5d5b5903e)

2 years agorgw/s3: DeleteObjects response uses correct delete_marker flag 51024/head
Casey Bodley [Mon, 13 Mar 2023 17:40:02 +0000 (13:40 -0400)]
rgw/s3: DeleteObjects response uses correct delete_marker flag

use delete_marker from the DeleteOp result, not from the sal::Object

Fixes: https://tracker.ceph.com/issues/59048
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 7288cbe28035867540b68dfcbc4894e1fb50ea2e)

2 years agorgw/notifications: support bucket notification with bucket policy 51023/head
Yuval Lifshitz [Sun, 26 Mar 2023 10:02:17 +0000 (10:02 +0000)]
rgw/notifications: support bucket notification with bucket policy

following policy should be used to allow any user to get, put and delete
bucket notification on a bucket called "my-bucket":
{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "Statement",
      "Effect": "Allow",
      "Principal": "*",
      "Action": ["s3:GetBucketNotification", "s3:PutBucketNotification"],
      "Resource": "arn:aws:s3:::my-bucket"
    }
  ]
}

note that notification deletion uses the "PUT" permission.

Fixes: https://tracker.ceph.com/issues/59136
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
(cherry picked from commit e100d392a0ed4a22d8544d25299df2366e727d4c)

2 years agorgw: add unordered listing to reindex to force stats update 51022/head
J. Eric Ivancich [Sat, 18 Mar 2023 18:35:39 +0000 (14:35 -0400)]
rgw: add unordered listing to reindex to force stats update

By including an unordered listing in the script, we will complete
placing objects in the bucket index and allow stats to be updated
rather than waiting for this to happen organically at a user's
request. Unordered is preferred as it can run more efficiently.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 71b2c2a6dd288e2bb8ec73cff3e909a0f12f2b5c)

2 years agorgw: install rgw scripts with common files rather than radosgw files
J. Eric Ivancich [Wed, 15 Mar 2023 13:26:07 +0000 (09:26 -0400)]
rgw: install rgw scripts with common files rather than radosgw files

Update ceph.spec.in and debian install files so
rgw-restore-bucket-index, rgw-orphan-list, rgw-gap-list,
rgw-gap-list-comparator are installed with common files.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 637d461bf12b68d2c04f326139367dcfda0664ce)

2 years agorgw/sse-s3: fix bucket encryption of multipart upload 51021/head
Tongliang Deng [Tue, 13 Dec 2022 06:42:34 +0000 (06:42 +0000)]
rgw/sse-s3: fix bucket encryption of multipart upload

Multipart upload missing encryption when we have bucket encryption
policy. Fix it by fetching bucket encryption policy and resolving
defaults at multipart init op.

Fixes: https://tracker.ceph.com/issues/59218
Signed-off-by: Tongliang Deng <dengtongliang@gmail.com>
(cherry picked from commit 6d9e4f7924c6149d23919ef82bc09406e1290164)

2 years agosts: Fixes get_cert_url improper url path concatenation 51020/head
Mathew [Mon, 6 Mar 2023 19:13:00 +0000 (14:13 -0500)]
sts: Fixes get_cert_url improper url path concatenation

Invalid URL concatenation prevents some OpenIDConnect providers from working
with RGW and the AssumeRoleWithWebIdentity API. Invalid URLs contain a double
slash `//`. This fix ensures that an ISS is properly joined to the .well-known
path.

Fixes: https://tracker.ceph.com/issues/58890
Signed-off-by: Mathew Utter <mat@hazmat.dev>
(cherry picked from commit c71818a586f2e29fb76310cb6477f0ccee7f19bd)

2 years agorgw/admin: 'data sync status' formats binary error repo entries 51019/head
Casey Bodley [Mon, 27 Mar 2023 14:56:37 +0000 (10:56 -0400)]
rgw/admin: 'data sync status' formats binary error repo entries

Fixes: https://tracker.ceph.com/issues/59174
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 85032c74a42f1b25e8da333a1a44318f378681a9)

2 years agorgw/civetweb: handle old clients with transfer-encoding: chunked. 51018/head
Marcus Watts [Fri, 8 May 2020 05:41:35 +0000 (01:41 -0400)]
rgw/civetweb: handle old clients with transfer-encoding: chunked.

s3 clients *should* provide an x-amz-decoded-content-length field
when they use transport-encoding: chunked.  Some clients do not.
With swift we already allow chunked uploads that do not specify the
content length in advance.   This commit adds similar support
for s3.  Known client affected by this: boto2.

Fixes: https://tracker.ceph.com/issues/45789
Resolves: rhbz#2152801

Signed-off-by: Marcus Watts <mwatts@redhat.com>
(cherry picked from commit 22e9509655ca1d799df2eec535390d20f2f60256)

2 years agorgw: fix rgw cache invalidation after unregister_watch() error 51017/head
lichaochao [Tue, 28 Mar 2023 03:17:26 +0000 (05:17 +0200)]
rgw: fix rgw cache invalidation after unregister_watch() error

When a metadata osd fails, an unregister_watch() error may occur,
resulting in an rgw cache invalidation.
By adding an unregister_done flag and when a register_watch() error ,
performing a reinit() operation again,
After the first reinit() failure, the register_watch() will be performed again

Fixes: https://tracker.ceph.com/issues/59217
Signed-off-by: lichaochao <lichaochao2_yewu@cmss.chinamobile.com>
(cherry picked from commit f9aae71af3ad8eee5996c31544d98041968dbbec)

2 years agoqa/rgw: upgrade tests restrict supported distros 51015/head
Casey Bodley [Thu, 23 Mar 2023 13:29:34 +0000 (09:29 -0400)]
qa/rgw: upgrade tests restrict supported distros

Fixes: https://tracker.ceph.com/issues/59135
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit efb18eb42bb3ed7b13ba6e9594fabbc963bd7a77)

2 years agoqa/rgw: add rgw/upgrade suite
Casey Bodley [Wed, 1 Mar 2023 23:43:03 +0000 (18:43 -0500)]
qa/rgw: add rgw/upgrade suite

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 2e9f83b8d6a72888f0297fa64464b704a71094aa)

2 years agoqa/ragweed: clone into separate directory for each client
Casey Bodley [Fri, 3 Mar 2023 15:40:03 +0000 (10:40 -0500)]
qa/ragweed: clone into separate directory for each client

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 310a97f767fe2fb95895fe30e3b9f4f3f6ea5f29)