doc/rbd: corrected OpenStack Cinder permissions for Glance pool

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #22342 from dillaman/wip-23516

librbd: commit IO as safe when complete if writeback cache is disabled

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #22348 from dillaman/wip-24169

rbd-mirror: ensure daemon can cleanly exit if pool is deleted

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #21812 from thmour/thmour_ceph-volume

ceph-volume: sort and align `lvm list` output

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #22367 from tchaikov/wip-cmake-rgw

cmake: rgw_common should depend on tracing headers

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>

Merge pull request #22364 from tchaikov/wip-doc

 doc: fix the links in releases/schedule.rst

Reviewed-by: Sage Weil <sage@redhat.com>

cmake: rgw_common should depend on tracing headers

see also: 4c0d3531

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22324 from cbodley/wip-rgw-cache-time-added

rgw: update ObjectCacheInfo::time_added on overwrite

Merge pull request #22327 from dillaman/wip-23512

librbd: utilize the journal disabled policy when removing images

Reviewed-by: Mykola Golub <mgolub@suse.com>

doc: fix some redirected links reported by "build-doc linkcheck"

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: fix the links in releases/schedule.rst

they were broken in e37e49b2

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21864 from LenzGr/documentation-fixes

doc: fixed restful mgr module SSL configuration commands

Reveiwed-by: John Spray <john.spray@redhat.com>

Merge pull request #22295 from jan--f/cmake-fix-ceph-test-build

cmake: fix cython target in test/CMakeFile.txt

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22317 from MahatiC/wip-doc-zipkin

doc: update blkin changes

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22332 from TommyLike/bug/fix_typo

test/encoding: Fix typo in encoding/types.h file

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22337 from tchaikov/wip-24361

osd,mon: enable level_compaction_dynamic_level_bytes for rocksdb

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #22285 from ricardoasmarques/wip-error-handling

mgr/dashboard: Log frontend errors + @UiController

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #22335 from majianpeng/bluestore-cleanup

os/bluestore: remove useless condtion.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #21689 from ovh/bp-reduce-bs-bl-rebuilds

os/bluestore/BlueFS: reduce bufferlist rebuilds during WAL writes

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #21920 from cbodley/wip-async-librados

librados: use ceph::async::Completion for asio bindings

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22056 from jiangxiyxy/Branch_master

mon: change monitor compact command to run asynchronously

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>

rbd-mirror: attempt to re-acquire leader lock if watcher recovered

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: ensure managed lock can shut down if stuck waiting for register

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

qa/workunits/rbd: dump long image directory upon rbd-mirror test failure

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #22319 from theanalyst/releases/mimic/13.2

doc: release/mimic: correct the changelog to the latest version

Merge pull request #22330 from neha-ojha/wip-async-up

osd/PG: do not choose stray osds as async_recovery_targets

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #22121 from mogeb/bluestore-mono-clock

os/bluestore: use the monotonic clock for perf counters latencies

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #22318 from rjfd/wip-dashboard-rest-methods

mgr/dashboard: rest: add support for query params

Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #18241 from hjwsm1989/wip-21756

osd: don't check overwrite flag when handling copy-get

Reviewed-by: Sage Weil <sage@redhat.com>

mon: enable level_compaction_dynamic_level_bytes for rocksdb

Fixes: http://tracker.ceph.com/issues/24361
Signed-off-by: Kefu Chai <kchai@redhat.com>

qa/tasks: rbd_mirror_thrash should wait for daemon exit before restarting

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #22174 from zhongyimao/cleanup

doc: fix typos

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

librbd: commit IO as safe when complete if writeback cache is disabled

We do not need to flush IO to ensure its safe if the writeback cache is
disabled when performing a journal replay. Instead, immediately mark the
IO as safe and let the journal's periodic commit throttle handle updating
the position.

Fixes: http://tracker.ceph.com/issues/23516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

SubmittingPatches: fix the spelling error

Signed-off-by: Mao Zhongyi <maozy.fnst@cn.fujitsu.com>

librados: fix the spelling error

Signed-off-by: Mao Zhongyi <maozy.fnst@cn.fujitsu.com>

doc: update the discarded option '--delay' in command 'rbd trash mv'

I got the following error message when I used the command '#rbd trash
mv foo --delay' as a document:

rbd: unrecognised option '--delay'

so replace the discarded option '--delay' with '--expires-at' avoid
others getting into the same doubt. In addition, some spelling mistakes
were fixed.

Signed-off-by: Mao Zhongyi <maozy.fnst@cn.fujitsu.com>

os/bluestore: remove useless condtion.

onode must not be null in this func.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>

doc: update blkin changes

Update blkin and zipkin changes to reflect current state

Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>

Merge pull request #20822 from Devp00l/table-user-config

mgr/dashboard: Store user table configurations

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

ceph-volume: sort and align output

This commit targets the `ceph-volume lvm list` command.
The output is sorted by the osd id and each device's
attributed are sorted, so the ceph operators can find
relevant information easier. The devices (block,db,..etc)
are now properly aligned.

Signed-off-by: Theofilos Mouratidis <t.mour@cern.ch>

test/encoding: Fix typo in encoding/types.h file

Fix typo in encoding/types.h fie

Signed-off-by: TommyLike <tommylikehu@gmail.com>

Merge pull request #22292 from tchaikov/wip-20924

osd,mon,msg: use intrusive_ptr for holding Connection::priv

Reviewed-by: Sage Weil <sage@redhat.com>

PG: do not choose stray osds as async_recovery_targets

Without this change, we might accept stray osds as async_recovery_targets,
and need to ensure that they get a chance to become part of the acting set
after recovery is over.

However, when choose_acting() is called in the Recovered state, we set
restrict_to_up_acting=true, which does not allow them to get back to the
acting set.

Therefore, similar to backfill, do not allow stray osds to become
async_recovery_targets.

Signed-off-by: Neha Ojha <nojha@redhat.com>

mds,osd,mon,msg: use intrusive_ptr for holding Connection::priv

See-also: http://tracker.ceph.com/issues/20924
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22010 from b-ranto/wip-expose-avgcount

Expose avgcount to the python modules

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reveiwed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22155 from tspmelo/fix-jest-coverage

mgr/dashboard: Fix Jest conflict with coverage files

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

librbd: utilize the journal disabled policy when removing images

Fixes: http://tracker.ceph.com/issues/23512
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

doc/prometheus: Mention the long running avg types

Signed-off-by: Boris Ranto <branto@redhat.com>

prometheus: Expose sum/count pairs for avgs

This patch exposes the long running avgs as sum/count pairs in the
prometheus exporter module.

Signed-off-by: Boris Ranto <branto@redhat.com>

mgr_module: Deal with long running avgs properly

We have recently started exposing long running avgs with the mgr python
modules but that only covers the total sum, not the avgcount.

With this patch, the counts for long running avgs are exposed to the
python modules allowing them to deal with the new data.

Signed-off-by: Boris Ranto <branto@redhat.com>

mgr: Expose avgcount for long running avgs

This provides a basic interface to export avg count for long running
averages.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #21711 from majianpeng/osd-reduce-safetimer

osd: combine recovery/scrub/snap sleep timer into one.

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #22085 from ifed01/wip-ifed-bs-tool-fix

tools/ceph-bluestore-tool: avoid mon/config access when calling global…

Reviewed-by: Sage Weil <sage@redhat.com>

rgw: update ObjectCacheInfo::time_added on overwrite

Fixes: http://tracker.ceph.com/issues/24346
Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #22323 from tspmelo/fix-formatter-unit-test

mgr/dashboard: Fix formatter service unit test

Reviewed-by: Ricardo Marques <rimarques@suse.com>

rgw: ObjectCache::put avoids separate find + insert

Signed-off-by: Casey Bodley <cbodley@redhat.com>

doc: release/mimic: correct the changelog to the latest version

We were still having the changelog from mimic-dev1, update this to reflect the
current state of mimic

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #22313 from b-ranto/wip-dashboard-fix-rate

dashboard: Return float if rate not available

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: Fix formatter service unit test

Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge pull request #22320 from ukernel/wip-24343

mds: properly journal root inode's snaprealm

mds: properly journal root inode's snaprealm

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: http://tracker.ceph.com/issues/24343

mgr/dashboard: Fix Jest conflict with coverage files

It seems 'jest --watch' is trying to determine the modules that are imported
inside the coverage folder.
Since this folder is not always up to date, when there are references to
nonexistent files, Jest will simply break and hang still.

I added an explicit rule for Jest to ignore this folder.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: rest: add support for query params

This change adds the support for query params in the
@RESTController.Resource nd @RESTController.Collection decorators

Signed-off-by: Ricardo Dias <rdias@suse.com>

Merge pull request #21980 from Devp00l/wip-formatting-bug-24081

mgr/dashboard: Format small numbers correctly

Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #22148 from ricardoasmarques/wip-duplicated-rbd

Prevent duplicated rows during async tasks

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #22244 from tspmelo/wip-unit-test-services

mgr/dashboard: Add unit test to the frontend services

Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #22278 from votdev/prettify_rgw

mgr/dashboard: Prettify RGW JS code

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #22287 from tchaikov/wip-hex-dec-in-logging

src: balance std::hex and std::dec manipulators

Reviewed-by: João Eduardo Luís <joao@suse.de>

mgr/dashboard: Log frontend errors in backend

Signed-off-by: Ricardo Marques <rimarques@suse.com>

cmake: fix cython target in test/CMakeFile.txt

The cython target is called cython_modules in python2 environments and
cython3_modules in python3 environments. Reflect that naming in
src/test/CMakeFile.txt. Otherwise the test target can not build in
python3 environments.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>

dashboard: Return float if rate not available

This fixes a test case issue when some of the data might not be
available during the test, yet. The test expects the second value to be
JFloat but that fails because get_rates return an int in that case.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #22307 from ukernel/wip-22240-1

mds: fix leak of MDSCacheObject::waiting

mds: fix leak of MDSCacheObject::waiting

Fixes: http://tracker.ceph.com/issues/24289
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>

Merge pull request #22240 from ukernel/wip-24289

mds: fix some memory leak

Merge pull request #22305 from yehudasa/wip-rgw-mimic

docs: update rgw info for mimic

docs: update rgw info for mimic

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

src: balance std::hex and std::dec manipulators

we're caching the "t_os.streambuf", so the fmtflags persist across
log entries. to avoid this side effects, we should do the cleanup
before finishing each log entry.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22280 from hjwsm1989/wip-osdmaptool

osdmaptool: fix wrong test_map_pgs_dump_all output

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #22157 from ceph/wip-doc-clear-config

doc/mgr: mention how to clear config setting

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>

Merge pull request #22286 from ifed01/wip-ifed-fix-release-build

cmake: enable RTTI for both debug and release RocksDB builds.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #22231 from linuxbox2/wip-get-irange

rgw: add configurable AWS-compat invalid range get behavior

Merge pull request #22203 from hydro-b/rbd-docu-fixes

doc: remove duplicate python packages

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #22259 from liewegas/wip-24322

mon/OSDMonitor: no_reply on MOSDFailure messages

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: remove duplicate python packages, explicitly ensure python script installation in path /usr/bin.
Signed-off-by: Stefan Kooman <stefan@kooman.org>
Signed-off-by: Stefan Kooman <stefan@kooman.org>

mon/OSDMonitor: no_reply on MOSDFailure ops we eventually process

Failure ops get attached to the failure report.  Once we finally process
them, mark them no_reply so that the forwarding mon will know about it.
The other paths through prepare_failure() do no_reply on the messages
that don't get logged in the failure_info_t::reporters.

Fixes: http://tracker.ceph.com/issues/24322
Signed-off-by: Sage Weil <sage@redhat.com>

mgr/dashboard: Store user table configurations

The feature stores sorting, displayed columns and the table limit for
each table, that does not forbid the auto saving feature.

Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Add UiApiController decorator

Should be used for UI specific requests.

Signed-off-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #22279 from tspmelo/wip-improve-lint-rules

mgr/dashboard: Improve max-line-length tslint rule

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #22281 from p-na/hacking-rst

mgr/dashboard: Improve `HACKING.rst`

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #22193 from liewegas/wip-mon-ranks

mon: make rank ordering explicit (not tied to mon address sort order)

Reviewed-by: Kefu Chai <kchai@redhat.com>

os/bluestore: use the monotonic clock for perf counters latencies

Signed-off-by: Mohamad Gebai <mgebai@suse.com>

Merge pull request #22275 from tchaikov/wip-24321

qa: wait longer for osd to flush pg stats

Reviewed-by: Sage Weil <sage@redhat.com>

mds: fix some memory leak

Fixes: http://tracker.ceph.com/issues/24289
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>

build/cmake: enable RTTI for both debug and release RocksDB builds.
Overwise ceph build in Release mode is failing.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>

mon/Monitor: use legacy ranks during bootstrap for initial seed monmap

We get various fabricated monmaps with epoch 0 to get things started.  Use
the legacy rank order so that we have a well-defined ordering and mon
ranks do not collide.

Signed-off-by: Sage Weil <sage@redhat.com>

mon/MonMap: use legacy rank order for all bootstrap monmaps

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #22256 into master

* refs/pull/22256/head:
unittest_addrs: check parse() return value too
common/LogEntry: remove addrs from log entry operator<<
common/LogEntry: addr -> addrs
common/LogEntry: no need for LogEntryKey encode/decode
msg/msg_types: entity_addrvec_t ctors
msg/msg_types: add entity_addrvec_t::legacy_addr() helper
msg/msg_types: some comparators for entity_addrvec_t
msg/msg_types: entity_addrvec_t parse() and operator<<

Reviewed-by: Kefu Chai <kchai@redhat.com>

mgr/dashboard: Improve `HACKING.rst`

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

Merge PR #22261 into master

* refs/pull/22261/head:
qa/suites/rados: move valgrind test to singleton-flat

Merge PR #22263 into master

* refs/pull/22263/head:
doc/releases: mimic 13.2.0

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>