]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 years agoosd/scrub: PGs that are scrubbing now update stats periodically 46855/head
Ronen Friedman [Tue, 14 Jun 2022 14:36:13 +0000 (14:36 +0000)]
osd/scrub: PGs that are scrubbing now update stats periodically

Added periodic calls to all PGs for which the OSD is the primary,
asking for a scrub statistics update.

This allows operator queries (e.g. 'pg dump pgs') to present
up-to-date scrub duration, "scrub is blocked" duration, etc'.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2 years agoMerge pull request #47476 from rosinL/fix-enoent
Yingxin [Tue, 9 Aug 2022 01:26:32 +0000 (09:26 +0800)]
Merge pull request #47476 from rosinL/fix-enoent

crimson/os/seastore: return future when no element error tolerated

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agoMerge pull request #47425 from cyx1231st/wip-seastore-backref-cleanup
Yingxin [Tue, 9 Aug 2022 01:25:17 +0000 (09:25 +0800)]
Merge pull request #47425 from cyx1231st/wip-seastore-backref-cleanup

crimson/os/seastore: backref related cleanups

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2 years agoMerge pull request #47475 from Huber-ming/stale_delete
Casey Bodley [Mon, 8 Aug 2022 14:11:09 +0000 (10:11 -0400)]
Merge pull request #47475 from Huber-ming/stale_delete

rgw: correct help message of 'reshard stale-instances delete'

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agoMerge pull request #47486 from tchaikov/wip-dashboard-newer-teuth
Kefu Chai [Mon, 8 Aug 2022 12:34:22 +0000 (20:34 +0800)]
Merge pull request #47486 from tchaikov/wip-dashboard-newer-teuth

mgr/dashboard: bump up teuthology

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agoMerge pull request #46972 from nSedrickm/button-name-accessibility-update
Ernesto Puerta [Mon, 8 Aug 2022 09:44:09 +0000 (11:44 +0200)]
Merge pull request #46972 from nSedrickm/button-name-accessibility-update

mgr/dashboard: Improve level A accessibility for buttons

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agoMerge pull request #46927 from nmshelke/fix-55762
Venky Shankar [Mon, 8 Aug 2022 08:54:27 +0000 (14:24 +0530)]
Merge pull request #46927 from nmshelke/fix-55762

mgr/volumes: filter internal directories in 'subvolumegroup ls' command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
2 years agoMerge pull request #47436 from SUSE/wip-mib-snmp-dir
Tim Serong [Mon, 8 Aug 2022 05:46:20 +0000 (15:46 +1000)]
Merge pull request #47436 from SUSE/wip-mib-snmp-dir

ceph.spec.in: ceph-mib: require snmp-mibs on SUSE distros

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Justin Caratzas <jcaratza@redhat.com>
2 years agoMerge pull request #47423 from tchaikov/wip-crimson-cmp
Kefu Chai [Mon, 8 Aug 2022 05:15:50 +0000 (13:15 +0800)]
Merge pull request #47423 from tchaikov/wip-crimson-cmp

crimson/os: rewrite ordering using std::strong_ordering

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson, test: s/std::random_shuffle/std::shuffle/ 47423/head
Kefu Chai [Sat, 6 Aug 2022 10:30:45 +0000 (18:30 +0800)]
crimson, test: s/std::random_shuffle/std::shuffle/

to silence warnings like:

../src/test/crimson/seastore/onode_tree/test_staged_fltree.cc:371:10: warning: 'random_shuffle<__gnu_cxx::__normal_iterator<std::pair<ghobject_t, crimson::os::seastore::onode::test_item_t> *, std::vector<std::pair<ghobject_t, crimson::os::seastore::onode::test_item_t>>>>' is deprecated: use 'std::shuffle' instead [-Wdeprecated-declarations]
    std::random_shuffle(kvs.begin(), kvs.end());
         ^

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agocrimson/os: rewrite ordering using std::strong_ordering
Kefu Chai [Sat, 6 Aug 2022 10:26:44 +0000 (18:26 +0800)]
crimson/os: rewrite ordering using std::strong_ordering

the goals are

1. to use std::strong_ordering mechinary for better readability
   and maintainbility
2. to remove unnecessary abstraction
3. use concept for better error message and readability.

changes:

* replace MatchKindCMP with std::strong_ordering
* replace compare_to() with operator<=>
* introduce a concept `IsFullKey` so we can use it when developing
  generic facilities to operate on both materialized key or view.
* use `IsFullKey` in place of `KeyT` when appropriate

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47485 from tchaikov/crimson-os-cleanups
Kefu Chai [Sat, 6 Aug 2022 07:52:44 +0000 (15:52 +0800)]
Merge pull request #47485 from tchaikov/crimson-os-cleanups

crimson/os: cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoMerge pull request #47487 from snosratiershad/examples/add-allow-unordered-to-list...
Anthony D'Atri [Sat, 6 Aug 2022 05:56:36 +0000 (22:56 -0700)]
Merge pull request #47487 from snosratiershad/examples/add-allow-unordered-to-list-objects-v2-extention-support

examples/boto3: add ListObjectsV2Request shape to boto3 sdk extras with AllowUnordered as member

2 years agoexamples/boto3: add ListObjectsV2Request shape to boto3 sdk extras with AllowUnordere... 47487/head
Salar Nosrati-Ershad [Sat, 6 Aug 2022 03:29:19 +0000 (07:59 +0430)]
examples/boto3: add ListObjectsV2Request shape to boto3 sdk extras with AllowUnordered as member

feat: add ListObjectsV2Request shape to boto3 sdk extras with AllowUnordered as member

feat: add list-objects-v2 unordered supports to doc

Signed-off-by: Salar Nosrati-Ershad <snosratiershad@gmail.com>
2 years agoMerge pull request #44772 from ybwang0211/Bucket-Operations-doc
Kefu Chai [Sat, 6 Aug 2022 03:57:49 +0000 (11:57 +0800)]
Merge pull request #44772 from ybwang0211/Bucket-Operations-doc

doc: Make the SYNTAX code writing of some interfaces of the api document consistent with others

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #46989 from petrutlucian94/boost_shared_mutex
Kefu Chai [Sat, 6 Aug 2022 03:00:27 +0000 (11:00 +0800)]
Merge pull request #46989 from petrutlucian94/boost_shared_mutex

common: use boost::shared_mutex on Windows

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47216 from sseshasa/wip-fix-high-cpu-util-in-process
Kefu Chai [Sat, 6 Aug 2022 02:58:37 +0000 (10:58 +0800)]
Merge pull request #47216 from sseshasa/wip-fix-high-cpu-util-in-process

osd: Handle oncommits and wait for future work items from mClock queue

Reviewed-by: Samuel Just <sjust@redhat.com>
2 years agomgr/dashboard: bump up teuthology 47486/head
Kefu Chai [Sat, 6 Aug 2022 00:24:12 +0000 (08:24 +0800)]
mgr/dashboard: bump up teuthology

to include the fix of e7c5d67e10fe29da22180f9e09b8973ae166c8fc,
see https://github.com/ceph/teuthology/pull/1746.
to address the test failure on ubuntu jammy. where we have python3.10

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agocrimson/osd: trade macro for type alias 47485/head
Kefu Chai [Fri, 5 Aug 2022 23:53:11 +0000 (07:53 +0800)]
crimson/osd: trade macro for type alias

for better readablity.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agocrimson/os: drop unused function
Kefu Chai [Wed, 3 Aug 2022 05:44:54 +0000 (13:44 +0800)]
crimson/os: drop unused function

Btree::compare(const ghobject_t &l, const ghobject_t &r) is never used,
so let's drop it.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47309 from Thingee/update-foundation-mems-202207
Kefu Chai [Fri, 5 Aug 2022 23:06:45 +0000 (07:06 +0800)]
Merge pull request #47309 from Thingee/update-foundation-mems-202207

doc: Updating Ceph Foundation members for July

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2 years agoMerge pull request #47478 from tchaikov/wip-cmake-cython
Kefu Chai [Fri, 5 Aug 2022 22:51:23 +0000 (06:51 +0800)]
Merge pull request #47478 from tchaikov/wip-cmake-cython

cmake: remove spaces in macro used for compiling cython code

Reviewed-by: Tim Serong <tserong@suse.com>
2 years agoMerge pull request #47481 from ljflores/wip-github-actions
Laura Flores [Fri, 5 Aug 2022 19:14:17 +0000 (14:14 -0500)]
Merge pull request #47481 from ljflores/wip-github-actions

.github/workflows: increase operations-per-run to 100 in stale bot

2 years ago.github/workflows: increase operations-per-run to 100 in stale bot 47481/head
Laura Flores [Fri, 5 Aug 2022 16:34:20 +0000 (11:34 -0500)]
.github/workflows: increase operations-per-run to 100 in stale bot

The stale bot's `operations-per-run`
(https://github.com/actions/stale#operations-per-run) corresponds to the max
number of API calls it is allowed to make per hour. Currently,
`operations-per-run` is set to 30, which means that the stale bot
can make up to 30 API calls per hour.

With this limit in place, the stale bot is only able to process 400 PRs at a time.
Since there are 900+ PRs in the Ceph repository, we should increase the number of
operations to cover them all. This needs to be done with care though, since GitHub
has a rate limit
(https://docs.github.com/en/rest/overview/resources-in-the-rest-api#rate-limiting)
depending on business plan.

According to GitHub's documentation on GitHub action requests
(https://docs.github.com/en/rest/overview/resources-in-the-rest-api#requests-from-github-actions),
the rate limit is 1,000 requests per hour per repository when using `GITHUB_TOKEN` (which we are).
For enterprise accounts, GitHub Enterprise Cloud's rate limit applies, and the limit is 15,000
requests per hour per repository.

Based on this information, we should be fine to increase the max `operations-per-run`
to 100. This would cover a little over 1000 PRs, which should be enough
to process the 900-some-odd PRs in the Ceph repository.

Signed-off-by: Laura Flores <lflores@redhat.com>
2 years agoMerge pull request #47459 from tchaikov/wip-cmake-debian-python
David Galloway [Fri, 5 Aug 2022 12:51:27 +0000 (08:51 -0400)]
Merge pull request #47459 from tchaikov/wip-cmake-debian-python

cmake: install pure python module to deb_system path

2 years agoMerge pull request #47397 from kalebskeithley/luamgr
kalebskeithley [Fri, 5 Aug 2022 12:27:13 +0000 (08:27 -0400)]
Merge pull request #47397 from kalebskeithley/luamgr

rgw: lua, add support for lua packages to the lua manager

2 years agocmake: remove spaces in macro used for compiling cython code 47478/head
Kefu Chai [Fri, 5 Aug 2022 08:40:41 +0000 (16:40 +0800)]
cmake: remove spaces in macro used for compiling cython code

we are facing following FTBFS on jammy + GCC-11.2 + Cython 0.29 +
CMake 3.22:

creating /home/jenkins-build/build/workspace/ceph-api/build/lib/cython_modules/temp.linux-x86_64-3.10/home/jenkins-build/build/workspace/ceph-api/build/src/pybind/cephfs
compile options: '-I/usr/include/python3.10 -I/usr/include/python3.10 -c'
extra options: '-Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -iquote/home/jenkins-build/build/workspace/ceph-api/src/include -w -Dvoid0=dead_function(void) -D__Pyx_check_single_interpreter(ARG)=ARG ## 0 -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2'
cc: /home/jenkins-build/build/workspace/ceph-api/build/src/pybind/cephfs/cephfs.c
cc: warning: ##: linker input file unused because linking not done
cc: error: ##: linker input file not found: No such file or directory
cc: warning: 0: linker input file unused because linking not done
cc: error: 0: linker input file not found: No such file or directory

it seems cython is not able to escape the space in the "extra options"
anymore, so the "##" and "0" are considered as object files passed to
compiler in addition to cephfs.c.

in this change the spaces are removed to help cython to make the right
decision.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agocrimson/os/seastore/seastore: return future when no element error tolerated 47476/head
luo rixin [Fri, 5 Aug 2022 06:55:46 +0000 (14:55 +0800)]
crimson/os/seastore/seastore: return future when no element error tolerated

OP_REMOVE etc ops will tolerate absent onode, we need return
ready future to chain the continuation, otherwise it will cause
a segmentation fault.

Signed-off-by: luo rixin <luorixin@huawei.com>
2 years agoqa: filter internal directories in 'subvolumegroup ls' command 46927/head
Nikhilkumar Shelke [Fri, 1 Jul 2022 12:13:40 +0000 (17:43 +0530)]
qa: filter internal directories in 'subvolumegroup ls' command

Internal directories: '_nogroup', '_index', '_legacy', '_deleting'
1. Internal directories should be filtered in 'subvolmegroup ls' command.
2. Internal directories should not be accepted as a group name.

Fixes: https://tracker.ceph.com/issues/55762
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2 years agomgr/volumes: filter internal directories in 'subvolumegroup ls' command
Nikhilkumar Shelke [Wed, 22 Jun 2022 09:55:23 +0000 (15:25 +0530)]
mgr/volumes: filter internal directories in 'subvolumegroup ls' command

Internal directories: '_nogroup', '_index', '_legacy', '_deleting'
1. Internal directories should be filtered in 'subvolmegroup ls' command.
2. Internal directories should not be accepted as a group name.

Fixes: https://tracker.ceph.com/issues/55762
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2 years agoMerge pull request #47470 from tchaikov/wip-win32-silence-warning
Kefu Chai [Fri, 5 Aug 2022 07:59:34 +0000 (15:59 +0800)]
Merge pull request #47470 from tchaikov/wip-win32-silence-warning

dokan: cast variable to the expected type before comparison

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2 years agorgw: correct help message of 'reshard stale-instances delete' 47475/head
Huber-ming [Fri, 5 Aug 2022 06:50:02 +0000 (14:50 +0800)]
rgw: correct help message of 'reshard stale-instances delete'

Signed-off-by: Huber-ming <zhangsm01@inspur.com>
2 years agocrimson/os/seastore/cache: backref related renames 47425/head
Yingxin Cheng [Wed, 3 Aug 2022 02:52:27 +0000 (10:52 +0800)]
crimson/os/seastore/cache: backref related renames

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore/cache: replace backref_buf_t by backref_entry_refs_t
Yingxin Cheng [Wed, 3 Aug 2022 02:06:46 +0000 (10:06 +0800)]
crimson/os/seastore/cache: replace backref_buf_t by backref_entry_refs_t

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore/cache: replace backref_cache_ref by backref_entryrefs_by_seq_t
Yingxin Cheng [Wed, 3 Aug 2022 01:20:05 +0000 (09:20 +0800)]
crimson/os/seastore/cache: replace backref_cache_ref by backref_entryrefs_by_seq_t

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore/backref_manager: cleanup scan_mapped_space
Yingxin Cheng [Mon, 1 Aug 2022 09:18:09 +0000 (17:18 +0800)]
crimson/os/seastore/backref_manager: cleanup scan_mapped_space

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore: reuse with_transaction_intr for weak trans
Yingxin Cheng [Mon, 1 Aug 2022 06:10:38 +0000 (14:10 +0800)]
crimson/os/seastore: reuse with_transaction_intr for weak trans

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore/backref_manager: decouple segment_manager_group
Yingxin Cheng [Mon, 1 Aug 2022 02:49:14 +0000 (10:49 +0800)]
crimson/os/seastore/backref_manager: decouple segment_manager_group

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agoMerge pull request #47471 from cyx1231st/wip-seastore-cleanup-paddr
Yingxin [Fri, 5 Aug 2022 06:41:10 +0000 (14:41 +0800)]
Merge pull request #47471 from cyx1231st/wip-seastore-cleanup-paddr

crimson/os/seastore: cleanups and extentions to paddr_t related classes

Reviewed-by: Samuel Just <sjust@redhat.com>
2 years agoMerge pull request #47214 from nmshelke/minor-fixes
Venky Shankar [Fri, 5 Aug 2022 06:31:13 +0000 (12:01 +0530)]
Merge pull request #47214 from nmshelke/minor-fixes

docs: minor doc fixes of showing in progress clones for a snapshot

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com
2 years agoMerge pull request #47472 from tchaikov/wip-do-cmake-with-newer-gcc
Kefu Chai [Fri, 5 Aug 2022 06:16:17 +0000 (14:16 +0800)]
Merge pull request #47472 from tchaikov/wip-do-cmake-with-newer-gcc

do_cmake:sh: use newer gcc if available

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore: introduce P_ADDR_ROOT 47471/head
Yingxin Cheng [Fri, 5 Aug 2022 02:20:06 +0000 (10:20 +0800)]
crimson/os/seastore: introduce P_ADDR_ROOT

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore: cleanup, call paddr_t's explicit function where possible
Yingxin Cheng [Thu, 4 Aug 2022 14:09:03 +0000 (22:09 +0800)]
crimson/os/seastore: cleanup, call paddr_t's explicit function where possible

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore: extend reserved device ids to 8 bits
Yingxin Cheng [Thu, 4 Aug 2022 13:19:00 +0000 (21:19 +0800)]
crimson/os/seastore: extend reserved device ids to 8 bits

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore: cleanup, introduce res_paddr_t with paddr_types_t::RESERVED
Yingxin Cheng [Thu, 4 Aug 2022 12:56:58 +0000 (20:56 +0800)]
crimson/os/seastore: cleanup, introduce res_paddr_t with paddr_types_t::RESERVED

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agodo_cmake:sh: use newer gcc if available 47472/head
Kefu Chai [Fri, 5 Aug 2022 03:48:30 +0000 (11:48 +0800)]
do_cmake:sh: use newer gcc if available

despite that we are using clang in `run-make-check.sh`, `do_cmake.sh`
is still used by some workflows like jenkins' ceph-pr-api job.
now that we've migrated to C++20, we need to use GCC-11 or up for
building the tree. GCC-11 is installed from PPA repo in
`install-deps.sh`, but to avoid interfere with the build of older
branches which do not use GCC-11, as their builds might break if
we use GCC-11 for building them. we don't use the alternative machinary
to point gcc to gcc-11, see 8f342a32ce4a236c45c67497ae34f508e032a9e1.

so, in this change, we try to use the newest GCC in system when
running `do_cmake.sh`.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoceph.spec.in: ceph-mib: specify "%dir %{_datadir}/snmp" 47436/head
Tim Serong [Wed, 3 Aug 2022 10:16:48 +0000 (20:16 +1000)]
ceph.spec.in: ceph-mib: specify "%dir %{_datadir}/snmp"

Without this, the openSUSE build fails with:

  ceph-mib-17.0.0-[...].noarch.rpm: directories not owned by a package:
    - /usr/share/snmp

Fixes: 183e3475064459fb10820b1c356875244fbc3f8a
Signed-off-by: Tim Serong <tserong@suse.com>
2 years agocrimson/os/seastore: cleanup paddr_t classes
Yingxin Cheng [Thu, 4 Aug 2022 04:07:24 +0000 (12:07 +0800)]
crimson/os/seastore: cleanup paddr_t classes

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore: cleanup segment_id_t
Yingxin Cheng [Thu, 4 Aug 2022 02:08:36 +0000 (10:08 +0800)]
crimson/os/seastore: cleanup segment_id_t

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore: cleanup DEVICE_ID_BITS
Yingxin Cheng [Thu, 4 Aug 2022 01:23:25 +0000 (09:23 +0800)]
crimson/os/seastore: cleanup DEVICE_ID_BITS

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocmake,debian: install pure python module to deb_system path 47459/head
Kefu Chai [Thu, 4 Aug 2022 13:52:43 +0000 (21:52 +0800)]
cmake,debian: install pure python module to deb_system path

in ubuntu 22.04 and debian unstable, the layout (scheme) for system
python module is named "deb_system", the default one is 'posix_local'.
and 'posix_local' installs python modules into paths like
usr/local/lib/python3.10/dist-packages/. hence dh_install fails
when it tries to find the files to be packaged under directory of
usr/lib/python3*/site-packages/.

in this change, the "deb_system" scheme is used if it is available,
and fall back to "posix_prefix" to be backward compatible with older
debian (derivative) distros.

also, update the source directories of pure python's installation
from `site-packages` to `*-packages`, to be compatible with ubuntu focal
and ubuntu jammy. as we are now using the specified scheme instead of
the default one.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agodokan: cast variable to the expected type before comparison 47470/head
Kefu Chai [Fri, 5 Aug 2022 00:17:45 +0000 (08:17 +0800)]
dokan: cast variable to the expected type before comparison

to fix the FTBFS due to following warning:

```
/home/jenkins-build/build/workspace/ceph-windows-pull-requests/ceph/build.deps/src/dokany/dokan/dokan.h:723:22: error: narrowing conversion of '-1' from 'int' to 'long unsigned int' [-Wnarrowing]
  723 | #define DOKAN_ERROR -1
      |                      ^
```

also, clean up the following warning:

```
/home/jenkins-build/build/workspace/ceph-windows-pull-requests/ceph/src/dokan/dbg.cc:142:62: warning: NULL used in arithmetic [-Wpointer-arith]
  142 |   o << "\n\tIsDirectory: " << (DokanFileInfo->IsDirectory != NULL);
      |
```

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47427 from tchaikov/wip-strong-ordering
Kefu Chai [Fri, 5 Aug 2022 00:29:35 +0000 (08:29 +0800)]
Merge pull request #47427 from tchaikov/wip-strong-ordering

include, common, osd: use std::strong_ordering machinery

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #47462 from ronen-fr/wip-rf-list-snapset
Kefu Chai [Fri, 5 Aug 2022 00:22:02 +0000 (08:22 +0800)]
Merge pull request #47462 from ronen-fr/wip-rf-list-snapset

tests/osd: fix a test to follow an output formatting change

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47461 from tchaikov/wip-wip32-deps
Kefu Chai [Thu, 4 Aug 2022 23:51:35 +0000 (07:51 +0800)]
Merge pull request #47461 from tchaikov/wip-wip32-deps

win32_deps_build.sh: bump curl to curl-7_84_0

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2 years agoMerge pull request #47468 from cbodley/wip-cmake-exporter-no-mgr
Casey Bodley [Thu, 4 Aug 2022 23:24:18 +0000 (19:24 -0400)]
Merge pull request #47468 from cbodley/wip-cmake-exporter-no-mgr

cmake: ceph-exporter fix for WITH_MGR=OFF

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2 years agocmake: ceph-exporter fix for WITH_MGR=OFF 47468/head
Casey Bodley [Thu, 4 Aug 2022 18:25:19 +0000 (14:25 -0400)]
cmake: ceph-exporter fix for WITH_MGR=OFF

removing vstart-base's unconditional dependency on ceph-exporter. it's
added conditionally just below:

if (WITH_MGR)
  add_dependencies(vstart-base ceph-mgr)
  add_dependencies(vstart-base ceph-exporter)

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agotests/osd: fix a test to follow an output formatting change 47462/head
Ronen Friedman [Thu, 4 Aug 2022 15:46:11 +0000 (15:46 +0000)]
tests/osd: fix a test to follow an output formatting change

PR#47255 modified the formatting of std::set-s. That broke
the osd-scrub-snaps.sh standalone test.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2 years agowin32_deps_build.sh: bump curl to curl-7_84_0 47461/head
Kefu Chai [Thu, 4 Aug 2022 15:06:04 +0000 (23:06 +0800)]
win32_deps_build.sh: bump curl to curl-7_84_0

to silence warnings like:

```
configure.ac:3671: warning: The macro `AC_HELP_STRING' is obsolete.
configure.ac:3671: You should run autoupdate.
```

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agodocs: minor doc fixes of showing in progress clones for a snapshot 47214/head
Nikhilkumar Shelke [Thu, 21 Jul 2022 16:58:27 +0000 (22:28 +0530)]
docs: minor doc fixes of showing in progress clones for a snapshot

Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2 years agocommon,include: drop include/cmp.h 47427/head
Kefu Chai [Wed, 3 Aug 2022 03:49:32 +0000 (11:49 +0800)]
common,include: drop include/cmp.h

it is not used anymore. so just ditch it.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agocommon: drop WRITE_{EQ,CMP}_OPERATORS_7()
Kefu Chai [Wed, 3 Aug 2022 03:40:50 +0000 (11:40 +0800)]
common: drop WRITE_{EQ,CMP}_OPERATORS_7()

the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoosd: implement three-way comparison operator for basic types
Kefu Chai [Wed, 3 Aug 2022 04:04:16 +0000 (12:04 +0800)]
osd: implement three-way comparison operator for basic types

this is the prerequisite for implementing the three-way comparison
operator for types which aggregates these basic types

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agocommon: drop WRITE_{EQ,CMP}_OPERATORS_5()
Kefu Chai [Wed, 3 Aug 2022 03:07:17 +0000 (11:07 +0800)]
common: drop WRITE_{EQ,CMP}_OPERATORS_5()

the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agocommon: drop WRITE_{EQ,CMP}_OPERATORS_4()
Kefu Chai [Wed, 3 Aug 2022 03:02:52 +0000 (11:02 +0800)]
common: drop WRITE_{EQ,CMP}_OPERATORS_4()

the default-generated comparison operators can fulfill our needs.

the order of member variables of `ghobject_t` is adjusted to match
the ordering of `ghobject_t`. the default-generated three-way
comparison operator uses the order in which the member variables
are declared to do the lexical comparison.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agolibrados, os: drop WRITE_{EQ,CMP}_OPERATORS_3()
Kefu Chai [Wed, 3 Aug 2022 02:53:04 +0000 (10:53 +0800)]
librados, os: drop WRITE_{EQ,CMP}_OPERATORS_3()

the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoinclude: drop WRITE_{EQ,CMP}_OPERATORS_2()
Kefu Chai [Wed, 3 Aug 2022 02:50:00 +0000 (10:50 +0800)]
include: drop WRITE_{EQ,CMP}_OPERATORS_2()

the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoinclude: drop WRITE_{EQ,CMP}_OPERATORS_1()
Kefu Chai [Wed, 3 Aug 2022 02:38:58 +0000 (10:38 +0800)]
include: drop WRITE_{EQ,CMP}_OPERATORS_1()

the default-generated comparison operators can fulfill our needs.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoosd/osd: do not init OSDOp::rval explicitly
Kefu Chai [Wed, 3 Aug 2022 02:37:36 +0000 (10:37 +0800)]
osd/osd: do not init OSDOp::rval explicitly

errorcode32_t's ctor can take care of this. it sets the internal value
to 0.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47449 from tchaikov/rpm-gts-11
Kefu Chai [Thu, 4 Aug 2022 13:30:51 +0000 (21:30 +0800)]
Merge pull request #47449 from tchaikov/rpm-gts-11

ceph.spec.in: build with gcc-toolset-11

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #46876 from neesingh-rh/feature_55821
Venky Shankar [Thu, 4 Aug 2022 13:10:10 +0000 (18:40 +0530)]
Merge pull request #46876 from neesingh-rh/feature_55821

mgr/volumes: add interface to check the presence of subvolumegroups/subvolumes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agocmake: disable LTO when building pmdk 47449/head
Kefu Chai [Thu, 4 Aug 2022 05:09:11 +0000 (13:09 +0800)]
cmake: disable LTO when building pmdk

See-also: https://tracker.ceph.com/issues/54473
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agodebian: use dpkg/default.mk to init popular make variables
Kefu Chai [Thu, 4 Aug 2022 06:12:34 +0000 (14:12 +0800)]
debian: use dpkg/default.mk to init popular make variables

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47263 from rhcs-dashboard/fix-host-service-instances
Nizamudeen A [Thu, 4 Aug 2022 07:28:03 +0000 (12:58 +0530)]
Merge pull request #47263 from rhcs-dashboard/fix-host-service-instances

mgr/dashboard: host list tables doesn't show all services deployed

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2 years agoMerge pull request #46213 from ceph/feature-exporter
Avan [Thu, 4 Aug 2022 06:18:54 +0000 (11:48 +0530)]
Merge pull request #46213 from ceph/feature-exporter

exporter: per node metric exporter

Reviewed-by: MrFreezeex <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2 years agoceph.spec.in: BuildRequires gcc-toolset-11-libatomic-devel for aarch64
Kefu Chai [Thu, 4 Aug 2022 03:57:05 +0000 (11:57 +0800)]
ceph.spec.in: BuildRequires gcc-toolset-11-libatomic-devel for aarch64

to address following failure when generating the building system
using CMake:

```
-- Performing Test HAVE_LIBATOMIC
-- Performing Test HAVE_LIBATOMIC - Failed
CMake Error at cmake/modules/CheckCxxAtomic.cmake:66 (message):
  Host compiler /opt/rh/gcc-toolset-11/root/usr/bin/c++ requires libatomic,
but it is not found
```

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoceph.spec.in: call %enable_devtoolset11 on centos8
Kefu Chai [Thu, 4 Aug 2022 01:00:29 +0000 (09:00 +0800)]
ceph.spec.in: call %enable_devtoolset11 on centos8

before this change %enable_devtoolset11 is called only when building
with crimson on centos8.

after this change %enable_devtoolset11 is called when building on
centos8. because we've started using gcc-toolset-11 for building
rpm packages on centos8 after the C++20 migration. so, to build
with gcc-11, we need to enable it.

also, because gcc-toolset-11 is used, we have to disable
annotated_build.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47299 from hookak/loki-dependency
Adam King [Wed, 3 Aug 2022 19:52:07 +0000 (15:52 -0400)]
Merge pull request #47299 from hookak/loki-dependency

mgr/cephadm: Add loki dependency to grafana, promtail

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agoMerge pull request #47165 from NitzanMordhai/wip-nitzan-librados-ioctx-destroy-Segmen...
Yuri Weinstein [Wed, 3 Aug 2022 15:04:58 +0000 (08:04 -0700)]
Merge pull request #47165 from NitzanMordhai/wip-nitzan-librados-ioctx-destroy-Segmentation-fault

librados: rados_ioctx_destroy check for initialized ioctx

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoMerge pull request #47138 from kamoltat/wip-ksirivad-fix-test-pool-min-size
Yuri Weinstein [Wed, 3 Aug 2022 15:03:52 +0000 (08:03 -0700)]
Merge pull request #47138 from kamoltat/wip-ksirivad-fix-test-pool-min-size

qa/tasks/ceph_manager.py: increase test_pool_min_size timeout

Reviewed-by: Neha Ojha <nojha@redhat.com>
2 years agoMerge pull request #47065 from ifed01/wip-ifed-fix-blufs-unlink-fsync
Yuri Weinstein [Wed, 3 Aug 2022 15:03:24 +0000 (08:03 -0700)]
Merge pull request #47065 from ifed01/wip-ifed-fix-blufs-unlink-fsync

os/bluestore: do not signal deleted dirty file to bluefs log

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #46838 from pdvian/wip-version-mgrupdate
Yuri Weinstein [Wed, 3 Aug 2022 15:02:33 +0000 (08:02 -0700)]
Merge pull request #46838 from pdvian/wip-version-mgrupdate

mgr: Remove service_daemon handling from MMgrUpdate

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2 years agoMerge pull request #46507 from aclamk/wip-memstore-leak
Yuri Weinstein [Wed, 3 Aug 2022 15:01:45 +0000 (08:01 -0700)]
Merge pull request #46507 from aclamk/wip-memstore-leak

os/memstore: Fix memory leak

Reviewed-by: Samuel Just <sjust@redhat.com>
2 years agoMerge pull request #44774 from rishabh-d-dave/qa-cleanup
Yuri Weinstein [Wed, 3 Aug 2022 15:01:00 +0000 (08:01 -0700)]
Merge pull request #44774 from rishabh-d-dave/qa-cleanup

qa/ceph_manager: clean up CephManager.do_rados()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2 years agoMerge pull request #47327 from rosinL/fix-op-release
Kefu Chai [Wed, 3 Aug 2022 14:27:15 +0000 (22:27 +0800)]
Merge pull request #47327 from rosinL/fix-op-release

crimson/osd/osd_operation: fix abort caused by op be deleted ahead

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47026 from lxbsz/wip-56517
Venky Shankar [Wed, 3 Aug 2022 14:18:27 +0000 (19:48 +0530)]
Merge pull request #47026 from lxbsz/wip-56517

fuse_ll: fix compile error when libfuse version is larger than 3.0

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Luis Henriques <lhenriques@suse.de>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #47412 from rzarzynski/wip-crimson-monc-nothrow-on-renewal
Kefu Chai [Wed, 3 Aug 2022 13:32:27 +0000 (21:32 +0800)]
Merge pull request #47412 from rzarzynski/wip-crimson-monc-nothrow-on-renewal

crimson/net: don't throw on failure when renewing tickets and keyrings

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47434 from guits/cv-fix-test-get-file-content
Guillaume Abrioux [Wed, 3 Aug 2022 11:28:51 +0000 (13:28 +0200)]
Merge pull request #47434 from guits/cv-fix-test-get-file-content

ceph-volume/tests: fix test_exception_returns_default

2 years agoMerge pull request #47177 from yuvalif/wip-yuval-backport-doc-fix
Yuval Lifshitz [Wed, 3 Aug 2022 11:13:52 +0000 (14:13 +0300)]
Merge pull request #47177 from yuvalif/wip-yuval-backport-doc-fix

doc: change "master" to "main" in backport doc

reviewed-by: anthonyeleven, ljflores, zdover23

2 years agoexporter: per node metric exporter 46213/head
Avan Thakkar [Mon, 1 Aug 2022 06:50:53 +0000 (12:20 +0530)]
exporter: per node metric exporter

Fixes: https://tracker.ceph.com/issues/55046
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2 years agoMerge pull request #47428 from tchaikov/wip-crimson-strong-ordering
Kefu Chai [Wed, 3 Aug 2022 10:49:10 +0000 (18:49 +0800)]
Merge pull request #47428 from tchaikov/wip-crimson-strong-ordering

crimson: use std::strong_ordering mechinary

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agoMerge pull request #46863 from bryanmontalvan/dashboard-matcher
Nizamudeen A [Wed, 3 Aug 2022 10:26:17 +0000 (15:56 +0530)]
Merge pull request #46863 from bryanmontalvan/dashboard-matcher

mgr/dashboard: Simplified silence-form matchers list layout

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agomgr/dashboard: add cephadm e2e tests for checking count for services instances 47263/head
Avan Thakkar [Wed, 3 Aug 2022 08:45:02 +0000 (14:15 +0530)]
mgr/dashboard: add cephadm e2e tests for checking count for services instances

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2 years agocrimson/os: do not use WRITE_*_OPERATORS_{3,4}() 47428/head
Kefu Chai [Wed, 3 Aug 2022 03:03:19 +0000 (11:03 +0800)]
crimson/os: do not use WRITE_*_OPERATORS_{3,4}()

the default-generated comparison operator is able to fulfill our needs
already.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 years agoceph-volume/tests: fix test_exception_returns_default 47434/head
Guillaume Abrioux [Wed, 3 Aug 2022 09:16:36 +0000 (11:16 +0200)]
ceph-volume/tests: fix test_exception_returns_default

There are cases, like running tests as root user, where this test fails
because root user can always read the file content.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2 years agodoc: change "master" to "main" in backport doc 47177/head
yuval Lifshitz [Tue, 19 Jul 2022 18:04:31 +0000 (21:04 +0300)]
doc: change "master" to "main" in backport doc

also fix the alias setting example

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2 years agoMerge pull request #47418 from rhcs-dashboard/token-logs-no-good
Nizamudeen A [Wed, 3 Aug 2022 06:55:49 +0000 (12:25 +0530)]
Merge pull request #47418 from rhcs-dashboard/token-logs-no-good

mgr/dashboard: remove token logging

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2 years agoMerge pull request #47429 from SUSE/wip-suse-gcc11-or-greater
Tim Serong [Wed, 3 Aug 2022 06:45:06 +0000 (16:45 +1000)]
Merge pull request #47429 from SUSE/wip-suse-gcc11-or-greater

ceph.spec.in: set BuildRequires: gcc-c++ >= 11 for SUSE distros

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2 years agoMerge pull request #47426 from cyx1231st/wip-seastore-silence-this
Yingxin [Wed, 3 Aug 2022 05:20:32 +0000 (13:20 +0800)]
Merge pull request #47426 from cyx1231st/wip-seastore-silence-this

crimson: capture this explicitly to silence warnings

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2 years agoceph.spec.in: set BuildRequires: gcc-c++ >= 11 for SUSE distros 47429/head
Tim Serong [Wed, 3 Aug 2022 05:20:23 +0000 (15:20 +1000)]
ceph.spec.in: set BuildRequires: gcc-c++ >= 11 for SUSE distros

This is much simpler than explicitly requiring gcc 11, and
anyway, openSUSE Tumbleweed is up to gcc 12 now.

Signed-off-by: Tim Serong <tserong@suse.com>