githubmap: update contributors

Signed-off-by: Sage Weil <sage@redhat.com>

doc: Drop the output of pg query

Drop the output of pg query from the doc, as it is:
   * Very old. The doc has only one-fourth of the latest 'pg query' output.
   * Updating the latest 'pg query' output in the doc would be huge.
   * too difficult to maintain it in the doc and make it sync with the changes of the actual 'pg query' output.

However, we can insert parts of the output in the doc if necessary.

Signed-off-by: Jos Collin <jcollin@redhat.com>

doc: Update Monitoring OSDs and PGs

Updated 'Monitoring OSDs and PGs' doc with:
* Latest command output
* misc doc fixes

Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #20602 from gregsfortytwo/wip-23141-rotational

os/bluestore: correctly check all block devices to decide if journal is_rotational

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #20595 from jcsp/wip-23037

mgr: die on bind() failure

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20593 from tchaikov/wip-23121

ceph-objectstore-tool: don't destroy SnapMapper until the txn is completed

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #20540 from ovh/bp-optracker-cleanup

common/OpHistory: move insert/cleanup into separate thread

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20539 from zeichenanonym/mgr-prometheus-fix-metadata-does-not-exist

mgr: prometheus: Don't crash on OSDs without metadata

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20530 from wido/issue-23078

common/dns_resolv.cc: Query for AAAA-record if ms_bind_ipv6 is True

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20394 from liewegas/wip-pg-log-size

osd: min_pg_log_entries == max == pg_log_dups_tracked

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20290 from rzarzynski/wip-common-subsystemmap

core: make the main dout() paths faster and more maintanable

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20273 from adamemerson/wip-any-singleton-will-do

common: Switch singletons to use immobile_any and cleanups

Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20528 from tchaikov/wip-22462

mon: add MMonHealth back

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20415 from wumingqiao/wip-fallocate

filestore: include <linux/falloc.h>

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20620 from ceph/wip-rm23140

ceph-volume: adds raw device support to 'lvm list'

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20599 from dillaman/wip-librbd-devstack-tempest

qa/workunits/rbd: switch devstack tempest to 17.2.0 tag

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #20612 from fangyuxiangGL/com

rgw: download object might fail for local invariable uninitialized

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #19845 from fangyuxiangGL/escape

rgw: rework json/xml escape usage follow #19806

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20352 from yehudasa/wip-22928

rgw: use explicit index pool placement

Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #20440 from cbodley/wip-qa-rgw-beast

qa/rgw: remove some civetweb overrides for beast testing

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #20471 from mdw-at-linuxbox/wip-master-swacldel

rgw: Allow swift acls to be deleted.

Reviewed-by: Orit Wasserman <owasserm@redhat.com>

rgw: download object might fail for local invariable uninitialized

This is an omission in #20226

Fixes: http://tracker.ceph.com/issues/23146
Signed-off-by: fang yuxiang <fang.yuxiang@eisoo.com>

Merge pull request #20234 from smithfarm/wip-run-make-check

build/ops: run-make-check.sh: fix SUSE support

Reviewed-by: Kefu Chai <kchai@redhat.com>

ceph-volume: if using lvm list on a device with many lvs, show them all

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20436 from smithfarm/wip-22999

install-deps.sh: set python2 %bcond by environment

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>

Merge pull request #20611 from Leeshine/wip-rgw-22080-1

rgw: create sync-module instance when radosgw-admin sync run

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20397 from tdb/fix/perms-ocf-rbd

rbd: resource agent needs to be executable

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #20577 from Songweibin/wip-group-rename

rbd: add group rename methods

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

install-deps.sh: set python2 %bcond by environment

If there is no /usr/bin/python2 we need to set %bcond_with python2.

Fixes: http://tracker.ceph.com/issues/22999
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #20434 from smithfarm/wip-22998

build/ops: install-deps.sh: pass --no-recommends to zypper

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>

Merge pull request #20404 from smithfarm/wip-cmake-with-systemd

build/ops: change WITH_SYSTEMD default to ON

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>

build/ops: run-make-check.sh: fix SUSE support

Get /usr/bin/which from the right RPM.

Fixes: http://tracker.ceph.com/issues/22875
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #20245 from smithfarm/wip-p2p-ripout

tests: cleanup: drop upgrade/jewel-x/point-to-point-x

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20138 from smithfarm/wip-recommend-chrony

build/ops: rpm: recommend chrony instead of ntp-daemon

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #20551 from shun-s/wip-add-notify-name-print

rbd: output notifyOp request name when watching

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

log: prohibit negative values for debug_* configurables.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

log: remove SubsystemMap::m_max_name_len.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

ceph: switch to SubsystemMap::should_gather<SubV, LvlV>().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

core: resurrect the old check on dout's levels where possible.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

core: hint the dout()'s message crafting as a cold code.

The idea is to:
  1. Do not put the dout()'s crafting stuff on the hot, fall-through
     path. Cheapest branches are those that are forward and never taken.
  2. Move it to separated sections placed far away from the main path
     to be more friendly to ICache and ITLB. That is, dout_impl constructs
     a function now.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

core: make SubsystemMap more statical and optimize should_gather().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

osd: remove the PGLog::prefix_provider as it's always nullptr.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common: move subsys-dependant types to a dedicated header.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

core: dout checks ceph_subsys_* in compile time if possible.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge PR #19471 into master

* refs/pull/19471/head:
cephfs-journal-tool: support purge queue

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #20412 into master

* refs/pull/20412/head:
mds/CDir: cleanup in the lookup_exact_snap()
mds/cdir: add CDir missing state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #20468 into master

* refs/pull/20468/head:
mds: fix check of underwater dentries

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #20489 into master

* refs/pull/20489/head:
common: omit short option for id in help for clients

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge PR #20547 into master

* refs/pull/20547/head:
mds: add uptime to MDS status

Reviewed-by: Douglas Fuller <dfuller@redhat.com>

Merge PR #20553 into master

* refs/pull/20553/head:
mds: always handle SESSION_REQUEST_RENEWCAPS messages
mds: don't cleanup request that has pending remote authpin/wrlock/xlock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

rgw: create sync-module instance when radosgw-admin sync run

Signed-off-by: lvshanchun <lvshanchun@gmail.com>

Merge pull request #20532 from Songweibin/wip-du-user

rbd: filter out UserSnapshotNamespace in do_disk_usage

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20529 from Songweibin/wip-fix-nbd-map

 rbd: set a default value for options in `nbd map`

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20507 from trociny/wip-remote-rename

 librbd: make rename request complete with filtered code

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20600 from liewegas/wip-msgr-level

msg/async/AsyncConnection: less noisy debug

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #20572 from batrick/erasure-code-cephfs-doc

doc: cleanup erasure coded pool doc on cephfs use

bluestore: correctly check all block devices to decide if journal is_rotational

Fixes: http://tracker.ceph.com/issues/23141
Signed-off-by: Greg Farnum <gfarnum@redhat.com>

msg/async/AsyncConnection: less noisy debug

This spams logs of healthy OSDs.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-volume: lvm list now works with raw devices

If you used a raw device with --data to create an OSD
you can now use 'lvm list' to get information about that OSD
using the raw device name like:

ceph-volume lvm list /dev/sda

fixes http://tracker.ceph.com/issues/23140

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20571 from dzafman/wip-21833-2

Fix asserts caused by DNE pgs left behind after lots of OSD restarts

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20594 from ceph/wip-rm23004

ceph-volume: log the current running command for easier debugging

Reviewed-by: Alfredo Deza <adeza@redhat.com>

qa/workunits/rbd: switch devstack tempest to 17.2.0 tag

Fixes: http://tracker.ceph.com/issues/22961
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20560 from dillaman/wip-22960-1

librbd: minor cleanup of the IO pathway

Reviewed-by: Mykola Golub <mgolub@suse.com>

librbd: moved write same buffer assembler to common location

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: decoupled object read requests from result assembler

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: use move-semantics for object IO data payloads

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: track the originating source of a flush request

This will be used in a later cleanup to remove the IO flush handling
from ImageCtx.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: separated queued image IO requests from state machine

This breaks the tight coupling between the IO work queue and
the actual dispatch of IO requests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mgr: die on bind() failure

Previously, the daemon would get wedged if it
competed for the same port as another daemon
on the same host and lost.

Fixes: https://tracker.ceph.com/issues/23037
Signed-off-by: John Spray <john.spray@redhat.com>

ceph-objectstore-tool: do not check action_on_object_t::call()'s retval

it never fails.

Signed-off-by: Kefu Chai <kchai@redhat.com>

ceph-objectstore-tool: do not check queue_transaction()'s retval

it never fails.

Signed-off-by: Kefu Chai <kchai@redhat.com>

ceph-objectstore-tool: don't destroy SnapMapper until the txn is completed

ch->flush() only ensure that the op is dequeued from osr/collection's
queue. but the ops could be still in the flight and they could still be
holding a *weak* reference of SnapMapper. we should make sure that the
mapper is still available when they reference it,

Fixes: http://tracker.ceph.com/issues/23121
Signed-off-by: Kefu Chai <kchai@redhat.com>

ceph-volume: log the current running command for easier debugging

Fixes: http://tracker.ceph.com/issues/23004
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

osd: Remove partially created pg known as DNE

Fixes: http://tracker.ceph.com/issues/21833
Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #20567 from liewegas/wip-kill-pg-preferred

osd/osd_types: kill preferred field in pg_t

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

osd/osd_types: pg_t: remove preferred

We killed this many many years ago; remove it!

Keep the hash<pg_t> value the same just in case this leaked into some
on-disk or on-wire structure.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #20592 from ceph/ceph-volume-ssh

ceph-volume: add ANSIBLE_SSH_RETRIES=5 to functional tests

Reviewed-by: Alfredo Deza <adeza@redhat.com>

common/OpTracker: reorder fields

Reorder smaller fields around so they're aligning naturally,
regaining a few bytes of storage.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>

mon/Monitor: add missing shutdown of OpTracker

Now that it has its own processing thread, it must be shut down
explicitly or it'll sigsegv randomly.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>

mon/OSDMonitor: remove op_tracker

It's unused anyway.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>

common/OpHistory: move insert/cleanup into separate thread

Cluster that's flooded with incoming ops (and enabled optracker)
is bottlenecked by OpHistory::insert. Reduce that by:
- pushing incoming ops into separate queue that'll be processed by
  separate thread.
- using std::atomic_bool for shutdown flag so ops_history_lock doesn't
  need to be taken as often

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>

Merge pull request #20591 from idryomov/wip-krbd-latest-osdmap-on-map-test

qa: krbd latest-osdmap-on-map test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

ceph-volume: add ANSIBLE_SSH_RETRIES=5 to functional tests

Occasionally we get tests that fail because a test node becomes
'unreachable'. This should avoid those ssh connection issues we see sometimes
by increasing the amount of times ansible will try to reconnect to a node
after an ssh failure.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20152 from Rubab-Syed/add_units_to_performance_counters

mgr: add units to performance counters

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20576 from wjwithagen/wjw-fix-store_test

test: put new BlueStore tests un ifdef WITH_BLUESTORE

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

qa/run-standalone.sh: pass PYTHONPATH env var to test

otherwise ceph-mgr will refuse to start if the required python binding,
a.k.a mgr_module is not available in default sys.path.

Signed-off-by: Kefu Chai <kchai@redhat.com>

rbd: add 'group rename' action to CLI and Python API

Signed-off-by: songweibin <song.weibin@zte.com.cn>

librbd: add group rename methods

Signed-off-by: songweibin <song.weibin@zte.com.cn>

cls_rbd: add group rename operations to cls_rbd

Signed-off-by: songweibin <song.weibin@zte.com.cn>

Merge pull request #20552 from xiexingguo/wip-scrub-preempt-fixes

osd/PG: decay scrub_chunk_max too if scrub is preempted

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20555 from jdurgin/wip-min-size-default

mon/OSDMonitor: fix min_size default for replicated pools

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20549 from Songweibin/wip-cleanup

common: fix typo in options.cc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

qa: krbd latest-osdmap-on-map test

Make sure we get the latest osdmap when using an existing client.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #20562 into master

* refs/pull/20562/head:
doc:Update ceph-fuse doc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20574 from tchaikov/wip-no-more-hash-pthread-t

common/lockdep: drop hash<pthread_t> specialization

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

test: put net BlueStore tests un ifdef WITH_BLUESTORE

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #20497 from tchaikov/wip-ceph-disk-cmd-failure

ceph-disk: include output of failed command in exception

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20534 from tchaikov/wip-22413

librados: make OPERATION_FULL_FORCE the default for rados_remove()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20456 from b-ranto/wip-mgr-prom

mgr/prometheus: Skip bogus entries

Reviewed-by: Jan Fajerski <jfajerski@suse.com>

Merge pull request #19843 from ifed01/wip-ifed-bluestore-repair

os/bluestore: implement BlueStore repair

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>