Merge pull request #46629 from anthonyeleven/anthonyeleven/46195_formatting

doc/man/8: Tweak formatting and wording in ceph.rst

Merge pull request #46362 from pdvian/wip-logm-mgrstat

mon/LogMonitor, MgrStat: Report logm and mgrstat committed version

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #46279 from jianwei1216/osd-peering-complete-log-patch

osd: add log for pg peering and activiting complete

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #46509 from aclamk/wip-pglog-test-leak

test/pglog: Fix memory leak

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #46438 from pdvian/wip-scrub-starts

osd/scrub: Reintroduce scrub starts message

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #46428 from sseshasa/wip-fix-55773-have-pending

mon/OSDMonitor: Ensure kvmon() is writeable before handling "osd new" cmd

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #45984 from trociny/wip-51835

mgr: relax "pending_service_map.epoch > service_map.epoch" assert

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #46285 from s0nea/config-fqdn-active

mgr/cephadm: try to get FQDN for active instance

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>

Merge pull request #46506 from asm0deuz/mod_iscsi_systemd

Modify how Iscsi tcmu-runner container is started within systemd

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #44894 from guits/add_dockerfile_keepalived

cephadm: change default keepalived/haproxy container images

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #46588 from guits/cluster-fsid-common

ceph-volume: make is_valid() optional

Reviewed-by: Teoman ONAY <tonay@redhat.com>

Merge pull request #46586 from SUSE/wip-suse-default-jaeger-off

ceph.spec.in: turn jaeger off by default for SUSE distros

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>

Merge pull request #46370 from rhcs-dashboard/stop-poll-page-inactive

mgr/dashboard: stop polling when page is not visible

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #46475 from rhcs-dashboard/01-hosts-failure

mgr/dashboard: fix drain e2e failure

Reviewed-by: Sarthak Gupta <sarthak.dev.0702@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #44567 from lxbsz/client_reply

client: do nothing when get a stale reply

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #46313 from zenomri/wip-omri-tracing-lua

rgw: add SetAttribute and AddEvent functions for TraceMetaTable in Lua

Reviewed-by: yuvalif

Merge pull request #46407 from melissa-kun-li/disable-create-image

mgr/dashboard: add rbd status endpoint and error page

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>

Merge pull request #46651 from zdover23/wip-doc-2022-06-13-dev-guide-essentials-master-to-main

doc/dev: s/master/main/ essentials.rst dev guide

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #46659 from anthonyeleven/anthonyeleven-46637-followup

doc/start: Polish network section of hardware-recommendations.rst

doc/start: Polish network section of hardware-recommendations.rst

Harmonize network throughput notation, minor tweaks to wording.
Followup to #46637

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

doc/dev: s/master/main/ essentials.rst dev guide

This PR changes all reference to the "master" branch
to references to the "main" branch (because we renamed
"master" to main", and the docs now need to reflect that).

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #46637 from zdover23/wip-doc-2022-06-12-start-intro-networks-rewrite

doc/start: rewrite hardware-recs networks section

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #43597 from pritha-srivastava/wip-rgw-sts-role-multisite

rgw multisite: replicate metadata for iam roles

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #46568 from yuvalif/wip-yuval-lua-counters

rgw/lua: add counters to background table

Reviewed-by: mattbenjamin
Reviewed-by: Matan-b

mgr/dashboard: fix drain e2e failure

Cypress sometimes fail to register the click and that causes the
deselect/select to not happen properly. Deselecting the row immediately
after performing the action makes it pass from cypress.

Fixes: https://tracker.ceph.com/issues/55741
Signed-off-by: Nizamudeen A <nia@redhat.com>

client: do nothing when get a stale reply

In theory when we get a stale reply from incorrect session, that
means it's buggy in MDS. Anyway we should discard it without doing
anything.

Signed-off-by: Xiubo Li <xiubli@redhat.com>

Merge pull request #44655 from lxbsz/wip-53741

mds: clear MDCache::rejoin_*_q queues before recovering file inodes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>

Merge pull request #45556 from mchangir/qa-add-subvolume-option-flavors

qa: add subvolume option flavors

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>

Merge pull request #44347 from kotreshhr/subvolumegroup-quotas

mgr/volumes: subvolumegroup quotas

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #46332 from lxbsz/qa-snap

qa: enlarge the tag number and test more for the snapshot

Reviewed-by: Venky Shankar <vshankar@redhat.com>

doc: add explanation about the new two functions and example

Signed-off-by: Omri Zeneva <ozeneva@redhat.com>

test: add unit tests

- added trace initialization
- opentelemetry linking when needed
- conditional ASSERT on SetBadAttribute, when we don't have opentelemetry (tracing sdk), we expect different result from the execute function.

Signed-off-by: Omri Zeneva <ozeneva@redhat.com>

rgw: add functionality of SetAttribute and AddEvent method in postRequest context

opentelemetry supports mainly string, int64, double and boolean for values of trace's Attributes,
so we should validate those types and static cast to the proper type, which is different than Lua types

SetAttribute Closure will be returned to lua only if the request's trace is real and not noop span or even null like what happens in preRequest Context

AddEvent method comes to give us the ability to record an event. the event can be a single string that represents the event, or event name and key-value pairs.

Signed-off-by: Omri Zeneva <ozeneva@redhat.com>

doc/start: rewrite hardware-recs networks section

This rewrites the first two-thirds of the "Networks"
section of the Hardware Recommendations page in the
Intro to Ceph document. I have tried to divide the
techincal content in this section into subsections
that foreground the various subjects covered.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #46634 from Huber-ming/pr_target_main

SubmittingPatches.rst: PRs should target "main"

Merge pull request #46583 from zdover23/wip-doc-2022-06-08-intro-hardware-recs-osd-acro-fix

doc/start: make OSD and MDS structures parallel

Merge pull request #46633 from zdover23/wip-doc-2022-06-12-start-intro-crush-para-fix

doc/start: rewrite CRUSH para

SubmittingPatches.rst: PRs should target "main"

Signed-off-by: Huber-ming <zhangsm01@inspur.com>

doc/start: make OSD and MDS structures parallel

This PR makes the "Ceph OSDs" and "MDSs" bullet points
parallel by naming "object storage daemon" before referring
to the (admittedly more common and colloquial, but surely
unknown to people who genuinely require a document called
'Intro') acronym "OSD".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/start: rewrite CRUSH para

This PR supersedes https://github.com/ceph/ceph/pull/46584
and makes changes suggested by Anthony D'Atri that improve
the coherence and consistency of the paragraph that explains
the basics of the CRUSH algorithm.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/man/8: Tweak formatting and wording in ceph.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #46200 from elacunza/doc-man-ceph-add-enable_stretch_mode

doc/man/8: Add enable_stretch_mode docs

Merge pull request #46462 from Thingee/update-foundation-mems-202205

doc: Updating Ceph Foundation members for May

Merge pull request #46195 from snosratiershad/fix-docs-double-dash-convertion-to-em-dash

doc: Disable double dashes "--" smartquotes conversion to en-dashes

doc: Disable double dashes "--" smartquotes conversion to en-dashes

Merge pull request #46604 from ljflores/wip-librados-test-fix

test/librados: modify LibRadosMiscConnectFailure.ConnectFailure to comply with new seconds unit

Merge pull request #46606 from rzarzynski/wip-55982

osd: log the number of 'dups' entries in a PG Log

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #46600 from idryomov/wip-pmdk-wno-error

cmake: pass -Wno-error when building PMDK

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #46617 from yuvalif/wip-yuval-fix-55978

rgw/lua: pass correct value to "toplevel" param

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #44648 from Huber-ming/index_cancel

rgw: delete redundant brackets

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge PR #46421 into main

* refs/pull/46421/head:
doc/dev: move option -R to a different section of doc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

osd: log the number of 'dups' entries in a PG Log

We really want to have the ability to know how many
entries `PGLog::IndexedLog::dups` has inside.
The current ways are either invasive (stopping an OSD)
or indirect (examination of `dump_mempools`).

The code comes from Nitzan Mordechai (part of
ede37edd79a9d5560dfb417ec176327edfc0e4a3).

Fixes: https://tracker.ceph.com/issues/55982
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

rgw/lua: pass correct value to "toplevel" param

Fixes: https://tracker.ceph.com/issues/55978
Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>

test/librados: modify LibRadosMiscConnectFailure.ConnectFailure to comply with new seconds unit

The unit type for `client_mount_timeout` was changed from "float" to "secs" in
983b10506dc8466a0e47ff0d320d480dd09999ec. To make this test comply with the new
seconds unit change, we need to change the value to an integer, as seconds
does not accept float values.

Fixes: https://tracker.ceph.com/issues/55971
Signed-off-by: Laura Flores <lflores@redhat.com>

rgw/lua: replace int64_t with "long long int" for the background table

lua integer is "long long int" which works with GCC 11.2.1 (fedora 36)
but fails to compile on centos8 and ubuntu focal

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>

rgw/lua: use constants for upvalue indexes

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>

rgw/lua: add atomic increment/decrement to RGW table

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

rgw/lua: support multiple types in lua background table

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #45806 from hualongfeng/qat_error_fix1

common/compressor: fix the issue that read more data

Reviewed-by: Casey Bodley <cbodley@redhat.com>

cmake: pass -Wno-error when building PMDK

It's hitting pacific with a nuisance -Werror=array-parameter= const
char * vs const char[37] mismatch.  Follow commit 91a616b26e83 ("cmake:
pass RTE_DEVEL_BUILD=n when building dpdk") and just disable -Werror.

Fixes: https://tracker.ceph.com/issues/55977
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

ceph-volume: make is_valid() optional

There are cases where `ceph-volume` doesn't have to require
a `ceph.conf` file that has the `fsid` parameter.

See: https://github.com/rook/rook/pull/10333#pullrequestreview-994958873

Fixes: https://tracker.ceph.com/issues/55970
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

mgr/dashboard: stop polling when page is not visible

Signed-off-by: Sarthak0702 <sarthak.dev.0702@gmail.com>

Merge pull request #45937 from faithuniterh/adding_go_examples

examples: Add Golang code showing object upload to Ceph RGW bucket

Reviwed-by: anthonyeleven
Reviwed-by: yuvalif

Merge pull request #45970 from faithuniterh/adding_java_examples

examples: Add Java code showing object upload to Ceph RGW bucket

Reviewed-by: anthonyeleven
Reviewed-by: yuvalif

ceph.spec.in: turn jaeger off by default for SUSE distros

Building with jaeger by default pulls in opentelemetry, and
cmake/modules/BuildOpentelemetry.cmake tries to go get
https://github.com/ideepika/opentelemetry-cpp.git at build
time, which doesn't work on SUSE's build service (no internet
access at build time).  Also, since WITH_JAEGER now defaults
to ON in CMakeLists.txt, we need to flip the logic when
setting -DWITH_JAEGER.

Fixes: 644c99826d73174e6609aa24b7297443358488b1
Fixes: 7be8be63501ba03da9b705238a9d3d3a518969ab
Signed-off-by: Tim Serong <tserong@suse.com>

Merge pull request #46564 from liu-chunmei/crimson-return-direct

crimson/osd: return directly when obc not exists.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #46585 from ceph/schedule

schedule_subset.sh: Default to ceph.git

crimson/osd: return directly when obc not exists.

if goest into do_osd_ops, will set osd_op.rval, but it
is not reuqired in some tests, this follow classic ceph do_op logic.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>

examples: Add Java code showing object upload to Ceph RGW bucket

Signed-off-by: faithuniterh <faithuniterh@tutanota.com>

schedule_subset.sh: Default to ceph.git

https://github.com/ceph/teuthology/pull/999 never got overridden in ceph.git.  We've been using a years-old checkout of teuthology for the `teuthology` user.

With the master->main change, that checkout needed to go.  Then when trying to schedule new nightlies, teuthology-suite was defaulting to ceph-ci.git which either has very old versions of the release branches (octopus, pacific, etc.) or they don't exist at all.

Signed-off-by: David Galloway <dgallowa@redhat.com>

examples: Add Golang code showing object upload to Ceph RGW bucket

Signed-off-by: faithuniterh <faithuniterh@tutanota.com>

doc/dev: move option -R to a different section of doc

It's incorrect to pass option "-R fail" to the teuthology-suite command
meant for triggering tests for first time. teuthology-suite command will
fail if "-R" is passed without "-r". Therefore, move this option and its
description from the section meant for triggering tests for first time
to the section dedicated to re-running of tests.

Signed-off-by: Rishabh Dave <ridave@redhat.com>

Merge pull request #46526 from cyx1231st/wip-seastore-fix-cache

crimson/os/seastore/cache: fix a potential leak when replace placeholder

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #46172 from cbodley/wip-54405

rgw: add 'rgw_access' log subsys for frontend http access log

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>

Merge PR #46572 into main

* refs/pull/46572/head:
script/ptl-tool: update main branch name

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #46330 from adamemerson/wip-openssl3-deprecation-warnings

build: Silence deprecation warnings from OpenSSL 3

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

Merge pull request #46238 from Huber-ming/storage_class_in_checkdiskstate

rgw: check object storage_class when check_disk_state

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #44052 from cfsnyder/wip-53367-log-access-key-ops-logs

rgw: log access key id in ops logs

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw: add 'rgw_access' log subsys for frontend http access log

this allows the log level of this http access log to be configured
separately from the 'rgw' subsystem, though the defaults are the same

Fixes: https://tracker.ceph.com/issues/54405
Signed-off-by: Casey Bodley <cbodley@redhat.com>

common: remove log subsys for deprecated 'civetweb'

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #46540 from yaarith/rook-telemetry-release-notes

PendingReleaseNotes: add a note about Rook telemetry

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

script/ptl-tool: update main branch name

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

cephadm/tests: decrease number of docker.io occurances

with haproxy/keepalived default images change, this check needs to be updated.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

cephadm: change default keepalived/haproxy container img

given that we now host haproxy and keepalived container images at
`quay.io/ceph` (keepalived and haproxy) let's use them as
defaults in cephadm.

Fixes: https://tracker.ceph.com/issues/54287
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

containers: add keepalived container image

we need to maintain a fork of keepalived container image in order
to push it to quay.io so we can get around the docker rate limitation

Fixes: https://tracker.ceph.com/issues/54287
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #46482 from ceph/feature-54330-osd-creation-workflow

mgr/dashboard: Feature 54330 osd creation workflow

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #46458 from yuvalif/wip-yuval-objecter-latency

objecter: add op latency stat and in-flight count
Reviwed-by: cbodley, adamemerson

Merge pull request #42779 from Matan-B/lua-rgw-map

rgw: Lua scripting global map feature
Reviwed-by: dang, cbodley, yuvalif, anthonyeleven, tchaikov, mattbenjamin, batrick

rgw: adding a test to check if role metadata syncs fine.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>

mgr/dashboard: add rbd status endpoint

Show "No RBD pools available" error page when accessing block/rbd if there are no rbd pools.
Add a "button_name" and "button_route" property to `ModuleStatusGuardService` config to customize the button on the error page.
Modify `ModuleStatusGuardService` to execute API calls to `/ui-api/<uiApiPath>/status` which uses the `UIRouter`.

Fixes: https://tracker.ceph.com/issues/42109
Signed-off-by: Melissa Li <melissali@redhat.com>

Merge pull request #46514 from adk3798/fqdn-autotune

mgr/cephadm: use host shortname for osd memory autotuning

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46517 from guits/cephadm-upgrade-status-is_paused

cephadm: add 'is_paused' field in orch status output

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #46539 from adk3798/master-main-cleanup2

mgr/cephadm: some master -> main cleanup

Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #44234 from lxbsz/wip-53504

client: always return ESTALE directly in handle_reply

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #44247 from neesingh-rh/fix-52982

client: Inode::hold_caps_until is time from monotonic clock now.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #46210 from vshankar/wip-54701

mds: do not assert early on when issuing client leases

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #44335 from SMIL-Infra/export-unlinked-dir

mds: fix crash when exporting unlinked dir

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>

Merge pull request #46078 from kotreshhr/fuse-directory-dacs-issue

client/fuse: Fix directory DACs overriding for root

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #46267 from tshacked/fix_24894

client: allow overwrites to file with size greater than the max_file_size

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #46371 from aliakseimakarau/fs_multifs_fix

mds/fsmap: proper update of filesystems

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>