]>
git.apps.os.sepia.ceph.com Git - ceph-ci.git/log 
jianglong01  [Tue, 8 Jun 2021 06:00:48 +0000  (14:00 +0800)] 
mgr/cephadm: When create osd which include db, _create_daemon will be executed twice. So we should filter the db typeSigned-off-by: jianglong01 <jianglong01@qianxin.com> 
Kefu Chai  [Tue, 8 Jun 2021 01:26:43 +0000  (09:26 +0800)] 
Merge pull request #41742 from lmgdlmgd/masterReviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Tue, 8 Jun 2021 00:59:36 +0000  (08:59 +0800)] 
Merge pull request #41736 from rzarzynski/wip-crimson-alienstore-open_collection_dneReviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Tue, 8 Jun 2021 00:58:48 +0000  (08:58 +0800)] 
Merge pull request #41730 from tchaikov/wip-fc35-pythonReviewed-by: Brad Hubbard <bhubbard@redhat.com> 
靳登科  [Tue, 8 Jun 2021 00:55:20 +0000  (08:55 +0800)] 
mgr/mgr_module: correct docstring of MgrModule.get()Signed-off-by: lmgdlmgd <1105050771@qq.com> 
Andrew Schoen  [Mon, 7 Jun 2021 19:06:52 +0000  (14:06 -0500)] 
Merge pull request #40659 from PepperJo/data_allocate_fraction_v2Reviewed-by: Andrew Schoen <aschoen@redhat.com> 
Radoslaw Zarzynski  [Mon, 7 Jun 2021 16:40:06 +0000  (16:40 +0000)] 
crimson/os/alienstore: open_collection() returns nullptr if DNE.
This is an AlienStore's counterpart of 
9fbd60131b5396beb81ce745c9ccf01388f7e303 
which becomes necessary as, since 
6b66c30b2331f0d42c8a51446ab04714047084b6 ,
we call `open_collection()` to check the existence of OSD's superblock.
Without this fix the following crash happens:
```
[rzarzynski@o06 build]$ MDS=0 MGR=0 OSD=1 ../src/vstart.sh -l -n --without-dashboard --crimson
...
crimson-osd: boost/include/boost/smart_ptr/intrusive_ptr.hpp:199: T* boost::intrusive_ptr<T>::operator->() const [with T = ObjectStore::CollectionImpl]: Assertion `px != 0' failed.
Aborting on shard 0.
Backtrace:
 0# print_backtrace(std::basic_string_view<char, std::char_traits<char> >) at /home/rzarzynski/ceph1/build/boost/include/boost/stacktrace/stacktrace.hpp:129
 1# FatalSignal::signaled(int, siginfo_t const*) at /home/rzarzynski/ceph1/build/../src/crimson/common/fatal_signal.cc:80
 2# FatalSignal::install_oneshot_signal_handler<6>()::{lambda(int, siginfo_t*, void*)#1}::operator()(int, siginfo_t*, void*) const at /home/rzarzynski/ceph1/build/../src/crimson/common/fatal_signal.cc:41
 3# FatalSignal::install_oneshot_signal_handler<6>()::{lambda(int, siginfo_t*, void*)#1}::_FUN(int, siginfo_t*, void*) at /home/rzarzynski/ceph1/build/../src/crimson/common/fatal_signal.cc:36
 4# 0x00007F8BF534DB30 in /lib64/libpthread.so.0
 5# gsignal in /lib64/libc.so.6
 6# abort in /lib64/libc.so.6
 7# 0x00007F8BF3948B19 in /lib64/libc.so.6
 8# 0x00007F8BF3956DF6 in /lib64/libc.so.6
 9# boost::intrusive_ptr<ObjectStore::CollectionImpl>::operator->() const at /home/rzarzynski/ceph1/build/boost/include/boost/smart_ptr/intrusive_ptr.hpp:200
10# crimson::os::AlienStore::open_collection(coll_t const&)::{lambda(boost::intrusive_ptr<ObjectStore::CollectionImpl>)#2}::operator()(boost::intrusive_ptr<ObjectStore::CollectionImpl>) const at /home/rzarzynski/ceph1/build/../src/crimson/os/alienstore/alien_store.cc:214
11# seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > seastar::futurize<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > >::invoke<crimson::os::AlienStore::open_collection(coll_t const&)::{lambda(boost::intrusive_ptr<ObjectStore::CollectionImpl>)#2}&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >(crimson::os::AlienStore::open_collection(coll_t const&)::{lambda(boost::intrusive_ptr<ObjectStore::CollectionImpl>)#2}&, boost::intrusive_ptr<ObjectStore::CollectionImpl>&&) at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:2135
12# auto seastar::futurize_invoke<crimson::os::AlienStore::open_collection(coll_t const&)::{lambda(boost::intrusive_ptr<ObjectStore::CollectionImpl>)#2}&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >(crimson::os::AlienStore::open_collection(coll_t const&)::{lambda(boost::intrusive_ptr<ObjectStore::CollectionImpl>)#2}&, boost::intrusive_ptr<ObjectStore::CollectionImpl>&&) at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:2167
13# _ZZN7seastar6futureIN5boost13intrusive_ptrIN11ObjectStore14CollectionImplEEEE4thenIZN7crimson2os10AlienStore15open_collectionERK6coll_tEUlS5_E0_NS0_INS2_INS9_19FuturizedCollectionEEEEEEET0_OT_ENUlDpOT_E_clIJS5_EEEDaSN_ at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:1526
14# _ZN7seastar20noncopyable_functionIFNS_6futureIN5boost13intrusive_ptrIN7crimson2os19FuturizedCollectionEEEEEONS3_IN11ObjectStore14CollectionImplEEEEE17direct_vtable_forIZNS1_ISB_E4thenIZNS5_10AlienStore15open_collectionERK6coll_tEUlSB_E0_S8_EET0_OT_EUlDpOT_E_E4callEPKSE_SC_ at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/util/noncopyable_function.hh:125
15# seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>::operator()(boost::intrusive_ptr<ObjectStore::CollectionImpl>&&) const at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/util/noncopyable_function.hh:210
16# seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > std::__invoke_impl<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> >, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >(std::__invoke_other, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl>&&) at /opt/rh/gcc-toolset-9/root/usr/include/c++/9/bits/invoke.h:60
17# std::__invoke_result<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >::type std::__invoke<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >(seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl>&&) at /opt/rh/gcc-toolset-9/root/usr/include/c++/9/bits/invoke.h:97
18# std::invoke_result<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >::type std::invoke<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >(seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl>&&) at /opt/rh/gcc-toolset-9/root/usr/include/c++/9/functional:83
19# auto seastar::internal::future_invoke<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl> >(seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, boost::intrusive_ptr<ObjectStore::CollectionImpl>&&) at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:1213
20# seastar::future<boost::intrusive_ptr<ObjectStore::CollectionImpl> >::then_impl_nrvo<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>, seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > >(seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&&)::{lambda(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, seastar::future_state<boost::intrusive_ptr<ObjectStore::CollectionImpl> >&&)#1}::operator()(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, seastar::future_state<boost::intrusive_ptr<ObjectStore::CollectionImpl> >&&) const::{lambda()#1}::operator()() const at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:1575
21# void seastar::futurize<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > >::satisfy_with_result_of<seastar::future<boost::intrusive_ptr<ObjectStore::CollectionImpl> >::then_impl_nrvo<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>, seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > >(seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&&)::{lambda(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, seastar::future_state<boost::intrusive_ptr<ObjectStore::CollectionImpl> >&&)#1}::operator()(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, seastar::future_state<boost::intrusive_ptr<ObjectStore::CollectionImpl> >&&) const::{lambda()#1}>(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&&) at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:2120
22# seastar::future<boost::intrusive_ptr<ObjectStore::CollectionImpl> >::then_impl_nrvo<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>, seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > >(seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&&)::{lambda(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, seastar::future_state<boost::intrusive_ptr<ObjectStore::CollectionImpl> >&&)#1}::operator()(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, seastar::future_state<boost::intrusive_ptr<ObjectStore::CollectionImpl> >&&) const at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:1571
23# seastar::continuation<seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>, seastar::future<boost::intrusive_ptr<ObjectStore::CollectionImpl> >::then_impl_nrvo<seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>, seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > >(seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&&)::{lambda(seastar::internal::promise_base_with_type<boost::intrusive_ptr<crimson::os::FuturizedCollection> >&&, seastar::noncopyable_function<seastar::future<boost::intrusive_ptr<crimson::os::FuturizedCollection> > (boost::intrusive_ptr<ObjectStore::CollectionImpl>&&)>&, seastar::future_state<boost::intrusive_ptr<ObjectStore::CollectionImpl> >&&)#1}, boost::intrusive_ptr<ObjectStore::CollectionImpl> >::run_and_dispose() at /home/rzarzynski/ceph1/build/../src/seastar/include/seastar/core/future.hh:771
24# seastar::reactor::run_tasks(seastar::reactor::task_queue&) at /home/rzarzynski/ceph1/build/../src/seastar/src/core/reactor.cc:2237
25# seastar::reactor::run_some_tasks() at /home/rzarzynski/ceph1/build/../src/seastar/src/core/reactor.cc:2646 (discriminator 1)
26# seastar::reactor::run() at /home/rzarzynski/ceph1/build/../src/seastar/src/core/reactor.cc:2805
27# seastar::app_template::run_deprecated(int, char**, std::function<void ()>&&) at /home/rzarzynski/ceph1/build/../src/seastar/src/core/app-template.cc:207 (discriminator 7)
28# seastar::app_template::run(int, char**, std::function<seastar::future<int> ()>&&) at /home/rzarzynski/ceph1/build/../src/seastar/src/core/app-template.cc:115 (discriminator 2)
29# main at /home/rzarzynski/ceph1/build/../src/crimson/osd/main.cc:206 (discriminator 1)
30# __libc_start_main in /lib64/libc.so.6
31# _start in /home/rzarzynski/ceph1/build/bin/crimson-osd
Reactor stalled for 33157 ms on shard 0. Backtrace: 0xb14ab 0xa6cd418 0xa6a496d 0xa54fd22 0xa566e3d 0xa56383c 0xa5639fc 0xa566808 0x12b2f 0x3780e 0x21c44 0x21b18 0x2fdf5 0x7cfdf93 0x7b78622 0x7c3fcb7 0x7c1bcb2 0x7c1bdf1 0x7c4004a 0x7d913c7 0x7d875ed 0x7d777d7 0x7d5f626 0x7d47ca4 0x7d47b5a 0x7d5f770 0x7d47931 0x7d9bb74 0xa5998b5 0xa59e1ff 0xa5a3a95 0xa43546c 0xa433331 0x3f01992 0x237c2 0x3c7f9bd
../src/vstart.sh: line 28: 665993 Aborted                 (core dumped) PATH=$CEPH_BIN:$PATH "$@"
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 15:24:46 +0000  (23:24 +0800)] 
Merge pull request #41733 from rzarzynski/wip-crimson-clientreq-cleanupReviewed-by: Kefu Chai <kchai@redhat.com> 
Radoslaw Zarzynski  [Mon, 7 Jun 2021 14:30:14 +0000  (14:30 +0000)] 
crimson/osd: fix debug in ClientRequest::do_process().Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com> 
Radoslaw Zarzynski  [Mon, 7 Jun 2021 14:29:29 +0000  (14:29 +0000)] 
crimson/osd: drop unneeded lambda mutability in ClientRequest.Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com> 
Sage Weil  [Mon, 7 Jun 2021 14:03:09 +0000  (10:03 -0400)] 
Merge PR #41709 into masterReviewed-by: Juan Miguel Olmo <jolmomar@redhat.com> Reviewed-by: Kefu Chai <kchai@redhat.com> 
Sage Weil  [Mon, 7 Jun 2021 14:02:52 +0000  (10:02 -0400)] 
Merge PR #41509 into masterReviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 13:56:38 +0000  (21:56 +0800)] 
Merge pull request #41725 from tchaikov/wip-cmake-prom-warningReviewed-by: Patrick Donnelly <pdonnell@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 13:55:39 +0000  (21:55 +0800)] 
Merge pull request #41728 from tchaikov/wip-cmake-win32-cleanupReviewed-by: Patrick Donnelly <pdonnell@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 13:46:49 +0000  (21:46 +0800)] 
Merge pull request #41704 from tchaikov/wip-ceph-daemon-annReviewed-by: Sebastian Wagner <sewagner@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 13:43:52 +0000  (21:43 +0800)] 
Merge pull request #41732 from rzarzynski/wip-crimson-opsequencer-prev_op-gt-last_unblockedReviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 13:32:02 +0000  (21:32 +0800)] 
Merge pull request #41705 from tchaikov/wip-script-ceph-debug-dockerReviewed-by: Patrick Donnelly <pdonnell@redhat.com> 
Radoslaw Zarzynski  [Mon, 7 Jun 2021 13:03:51 +0000  (13:03 +0000)] 
crimson/osd: fix assertion failure in OpSequencer on replay.
Commit 
b5efdc6f1c9563357d7dfd33a8f379053592a215  has unified
the interruption handling among `InternalClientRequest` and
`ClientRequest`. Unfortunately, a call to `maybe_reset()` of
`OpSequencer` has been overlooked and dropped leading to the
`assert(prev_op > last_unblocked)` assertion failure in
`start_op()`.
This was the root cause of the following problem at Sepia:
```
rzarzynski@teuthology:/home/teuthworker/archive/rzarzynski-2021-05-26_12:20:26-rados-master-distro-basic-smithi/
6136929 $ less ./remote/smithi194/log/ceph-osd.6.log.gz
...
DEBUG 2021-05-26 20:24:53,988 [shard 0] ms - [osd.6(client) v2:172.21.15.194:6804/34047 >> client.4453 172.21.15.67:0/
3814935464 @37042] <== #1
 === osd_op(client.4453.0:5 12.6 12.
7fc1f406  (undecoded) ondisk+write+known_if_redirected e52) v8 (42)
DEBUG 2021-05-26 20:24:53,988 [shard 0] osd - client_request(id=4, detail=osd_op(client.4453.0:5 12.6 12.
7fc1f406  (undecoded) ondisk+write+known_if_redirected e52) v8): start
DEBUG 2021-05-26 20:24:53,988 [shard 0] osd - client_request(id=4, detail=osd_op(client.4453.0:5 12.6 12.
7fc1f406  (undecoded) ondisk+write+known_if_redirected e52) v8): in repeat
DEBUG 2021-05-26 20:24:53,988 [shard 0] osd - client_request(id=4, detail=osd_op(client.4453.0:5 12.6 12.
7fc1f406  (undecoded) ondisk+write+known_if_redirected e52) v8) same_interval_since: 19
DEBUG 2021-05-26 20:24:53,988 [shard 0] osd - do_recover_missing check for recovery, 12:
602f83fe :::foo:head
DEBUG 2021-05-26 20:24:53,988 [shard 0] osd - client_request(id=4, detail=osd_op(client.4453.0:5 12.6 12:
602f83fe :::foo:head {write 0~128 in=128b} snapc 0={} ondisk+write+known_if_redirected e52) v8): got obc lock
...
DEBUG 2021-05-26 20:25:21,810 [shard 0] osd - client_request(id=4, detail=osd_op(client.4453.0:5 12.6 12:
602f83fe :::foo:head {write 0~128 in=1
28b} snapc 0={} ondisk+write+known_if_redirected e52) v8): in repeat
...
DEBUG 2021-05-26 20:25:21,809 [shard 0] osd - should_abort_request operation restart, acting set changed
...
DEBUG 2021-05-26 20:25:21,813 [shard 0] osd - client_request(id=4, detail=osd_op(client.4453.0:5 12.6 12:
602f83fe :::foo:head {write 0~128 in=128b} snapc 0={} ondisk+write+known_if_redirected e52) v8) same_interval_since: 55
...
DEBUG 2021-05-26 20:25:21,813 [shard 0] osd - client_request(id=4, detail=osd_op(client.4453.0:5 12.6 12:
602f83fe :::foo:head {write 0~128 in=128b} snapc 0={} ondisk+write+known_if_redirected e52) v8) same_interval_since: 55
ceph-osd: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/
17.0.0-4622-gaa1dc559 /rpm/el8/BUILD/
ceph-17.0.0-4622-gaa1dc559 /src/crimson/osd/osd_operation_sequencer.h:52: seastar::futurize_t<Result> crimson::osd::OpSequencer::start_op(HandleT&, uint64_t, uint64_t, FuncT&&) [with HandleT = crimson::PipelineHandle; FuncT = crimson::interruptible::interruptor<InterruptCond>::wrap_function(Func&&) [with Func = crimson::osd::ClientRequest::start()::<lambda()> mutable::<lambda(Ref<crimson::osd::PG>)> mutable::<lambda()> mutable::<lambda()>; InterruptCond = crimson::osd::IOInterruptCondition]::<lambda()>; Result = crimson::interruptible::interruptible_future_detail<crimson::osd::IOInterruptCondition, seastar::future<> >; seastar::futurize_t<Result> = crimson::interruptible::interruptible_future_detail<crimson::osd::IOInterruptCondition, seastar::future<> >; uint64_t = long unsigned int]: Assertion `prev_op > last_unblocked' failed.
Aborting on shard 0.
Backtrace:
 0# 0x000055F440239C1F in ceph-osd
 1# FatalSignal::signaled(int, siginfo_t const*) in ceph-osd
 2# FatalSignal::install_oneshot_signal_handler<6>()::{lambda(int, siginfo_t*, void*)#1}::_FUN(int, siginfo_t*, void*) in ceph-osd
 3# 0x00007F4788336B20 in /lib64/libpthread.so.0
 4# gsignal in /lib64/libc.so.6
 5# abort in /lib64/libc.so.6
 6# 0x00007F4786931B09 in /lib64/libc.so.6
 7# 0x00007F478693FDE6 in /lib64/libc.so.6
 8# 0x000055F43BA3DD17 in ceph-osd
 9# 0x000055F43BA419A8 in ceph-osd
10# seastar::continuation<seastar::internal::promise_base_with_type<seastar::bool_class<seastar::stop_iteration_tag> >, seastar::noncopyable_function<seastar::future<seastar::bool_class<seastar::stop_iteration_tag> > (boost::intrusive_ptr<crimson::osd::PG>&&)>, seastar::future<boost::intrusive_ptr<crimson::osd::PG> >::then_impl_nrvo<seastar::noncopyable_function<seastar::future<seastar::bool_class<seastar::stop_iteration_tag> > (boost::intrusive_ptr<crimson::osd::PG>&&)>, seastar::future<seastar::bool_class<seastar::stop_iteration_tag> > >(seastar::noncopyable_function<seastar::future<seastar::bool_class<seastar::stop_iteration_tag> > (boost::intrusive_ptr<crimson::osd::PG>&&)>&&)::{lambda(seastar::internal::promise_base_with_type<seastar::bool_class<seastar::stop_iteration_tag> >&&, seastar::noncopyable_function<seastar::future<seastar::bool_class<seastar::stop_iteration_tag> > (boost::intrusive_ptr<crimson::osd::PG>&&)>&, seastar::future_state<boost::intrusive_ptr<crimson::osd::PG> >&&)#1}, boost::intrusive_ptr<crimson::osd::PG> >::run_and_dispose() in ceph-osd
11# 0x000055F445C5C70F in ceph-osd
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 09:50:49 +0000  (17:50 +0800)] 
do_cmake.sh: use python3.10 for fedora 35Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 09:49:24 +0000  (17:49 +0800)] 
do_cmake.sh: refactor code to set PYBUILDSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 08:00:23 +0000  (16:00 +0800)] 
cmake: let vstart-base depend on cython_rados if NOT WIN32Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 07:09:42 +0000  (15:09 +0800)] 
cmake: do not print warning in each cmake runSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Mon, 7 Jun 2021 01:52:36 +0000  (09:52 +0800)] 
Merge pull request #41695 from tchaikov/wip-crimson-net-moveReviewed-by: Amnon Hanuhov <ahanukov@redhat.com> Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com> 
Kefu Chai  [Sun, 6 Jun 2021 01:45:16 +0000  (09:45 +0800)] 
Merge pull request #41708 from tchaikov/wip-seastore-open-collReviewed-by: Samuel Just <sjust@redhat.com> 
Sage Weil  [Sat, 5 Jun 2021 20:43:36 +0000  (16:43 -0400)] 
Merge PR #41665 into masterReviewed-by: Sage Weil <sage@redhat.com> Reviewed-by: Adam King <adking@redhat.com> 
Sage Weil  [Sat, 5 Jun 2021 15:05:48 +0000  (10:05 -0500)] 
cephadm: improve is_container_running()Fixes: https://tracker.ceph.com/issues/51109 Signed-off-by: Sage Weil <sage@newdream.net> 
Kefu Chai  [Sat, 5 Jun 2021 16:06:32 +0000  (00:06  +0800)] 
Merge pull request #40652 from ronen-fr/wip-ronenf-cscrub-classReviewed-by: Josh Durgin <jdurgin@redhat.com> 
Sage Weil  [Sat, 5 Jun 2021 15:23:35 +0000  (11:23 -0400)] 
common/cmdparse: fix CephBool validation for tell commandsSigned-off-by: Sage Weil <sage@newdream.net> 
Kefu Chai  [Sat, 5 Jun 2021 13:41:00 +0000  (21:41 +0800)] 
Merge pull request #41154 from rzarzynski/wip-global-backtrace-bug-50647Reviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 13:33:00 +0000  (21:33 +0800)] 
Merge pull request #41604 from t-msn/wip-51030Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 13:26:04 +0000  (21:26 +0800)] 
Merge pull request #41501 from aclamk/wip-bluefs-safer-flushReviewed-by: Igor Fedotov <ifedotov@suse.com> 
Kefu Chai  [Sat, 5 Jun 2021 13:23:13 +0000  (21:23 +0800)] 
Merge pull request #41506 from ceph/wip-cv-batch-fixesReviewed-by: Guillaume Abrioux <gabrioux@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 13:17:24 +0000  (21:17 +0800)] 
Merge pull request #41688 from tchaikov/wip-debian-rookReviewed-by: Sebastian Wagner <sewagner@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 09:39:25 +0000  (17:39 +0800)] 
crimson/os/seastore: open_collection() returns nullptr if DNESigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 09:22:35 +0000  (17:22 +0800)] 
crimson/os/seastore: use structured bindingSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 04:19:41 +0000  (12:19 +0800)] 
script/ceph-debug-docker: s/x86_64/$(arch)/Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 03:53:50 +0000  (11:53 +0800)] 
pybind: add tox.iniSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 04:08:00 +0000  (12:08 +0800)] 
pybind/ceph_daemon: add missing type annotationsSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 03:53:03 +0000  (11:53 +0800)] 
pybind/ceph_daemon: correct type annotation of admin_socket()Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 03:40:18 +0000  (11:40 +0800)] 
pybind/ceph_daemon: fix the format string in Termsize.__repr__()Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 03:38:17 +0000  (11:38 +0800)] 
pybind/ceph_daemon: do not handle get_command_descriptions in admin_socket()Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 02:06:07 +0000  (10:06 +0800)] 
Merge pull request #41581 from tchaikov/wip-options-mgr-monReviewed-by: Neha Ojha <nojha@redhat.com> 
Kefu Chai  [Sat, 5 Jun 2021 00:44:42 +0000  (08:44 +0800)] 
Merge pull request #40073 from jmolmo/delete_service_causes_osd_removalReviewed-by: Sebastian Wagner <sewagner@redhat.com> Reviewed-by: Adam King <adking@redhat.com> 
Sage Weil  [Fri, 4 Jun 2021 17:35:46 +0000  (13:35 -0400)] 
mgr/nfs: fix 'nfs export create' argument orderSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Tue, 1 Jun 2021 20:55:44 +0000  (16:55 -0400)] 
common/cmdparse: emit proper jsonSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Tue, 1 Jun 2021 18:43:47 +0000  (14:43 -0400)] 
mon/MonCommands: add -- seperator to exampleSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Tue, 1 Jun 2021 17:39:03 +0000  (13:39 -0400)] 
qa/tasks/cephfs/test_nfs: fix export create testSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Sat, 29 May 2021 02:19:27 +0000  (22:19 -0400)] 
mgr: make mgr commands compat with pre-quincy monSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Tue, 25 May 2021 14:53:01 +0000  (10:53 -0400)] 
doc/_ext/ceph_commands: handle non-positional args in docsSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Mon, 24 May 2021 19:17:58 +0000  (15:17 -0400)] 
mgr: fix reweight-by-utilization cephbool flagSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Sun, 23 May 2021 14:47:35 +0000  (10:47 -0400)] 
mon/MonCommands: convert some CephChoices to CephBoolSigned-off-by: Sage Weil <sage@newdream.net> 
Patrick Donnelly  [Fri, 4 Jun 2021 20:07:42 +0000  (13:07 -0700)] 
Merge PR #41697 into masterReviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 17:57:03 +0000  (01:57  +0800)] 
Merge pull request #41690 from tchaikov/wip-test-alloc_agingReviewed-by: Igor Fedotov <ifedotov@suse.com> 
Kefu Chai  [Fri, 4 Jun 2021 17:23:35 +0000  (01:23  +0800)] 
Merge pull request #41698 from tchaikov/wip-qa-rookReviewed-by: Sage Weil <sage@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 17:11:13 +0000  (01:11  +0800)] 
qa/suites/orch/rook/smoke: stop testing on ubuntu 18.04Signed-off-by: Kefu Chai <kchai@redhat.com> 
Patrick Donnelly  [Fri, 4 Jun 2021 16:33:54 +0000  (09:33 -0700)] 
script: add a few more volume mounts for sepiaSigned-off-by: Patrick Donnelly <pdonnell@redhat.com> 
Patrick Donnelly  [Fri, 4 Jun 2021 16:33:30 +0000  (09:33 -0700)] 
script: drop ceph-fuse from docker debuggingSigned-off-by: Patrick Donnelly <pdonnell@redhat.com> 
Patrick Donnelly  [Fri, 4 Jun 2021 16:32:52 +0000  (09:32 -0700)] 
script: enable centos debuginfo repo for debuggingSigned-off-by: Patrick Donnelly <pdonnell@redhat.com> 
Patrick Donnelly  [Fri, 4 Jun 2021 16:31:19 +0000  (09:31 -0700)] 
script: update repo url for multi-arch builds
Brad suggested this change based on his commit [1]. Thank you!
[1] https://github.com/ceph/ceph-ansible/commit/
267cce9e8360fc8cb9c192fde2406e5dca724610 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com> 
Patrick Donnelly  [Fri, 4 Jun 2021 16:30:04 +0000  (09:30 -0700)] 
script: fetch autobuild.asc key via HTTPSSigned-off-by: Patrick Donnelly <pdonnell@redhat.com> 
Jonas Pfefferle  [Fri, 4 Jun 2021 11:22:46 +0000  (13:22 +0200)] 
python-common: data_allocate_fraction translate testSigned-off-by: Jonas Pfefferle <pepperjo@japf.ch> 
Jonas Pfefferle  [Fri, 4 Jun 2021 11:14:54 +0000  (13:14 +0200)] 
ceph-volume: data_allocate_fraction: batch testsSigned-off-by: Jonas Pfefferle <pepperjo@japf.ch> 
Kefu Chai  [Fri, 4 Jun 2021 12:19:30 +0000  (20:19 +0800)] 
crimson/net: move from out_q into sent queueSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 12:13:54 +0000  (20:13 +0800)] 
Merge pull request #41679 from AmnonHanuhov/wip-get_rid_of_pending_qReviewed-by: Yingxin Cheng <yingxin.cheng@intel.com> 
Amnon Hanuhov  [Thu, 3 Jun 2021 13:57:41 +0000  (16:57 +0300)] 
crimson/net: Use out_q instead of pending_qSigned-off-by: Amnon Hanuhov <ahanukov@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 09:15:06 +0000  (17:15 +0800)] 
Merge pull request #41631 from tchaikov/wip-keyring-decodeReviewed-by: Willem Jan Withagen <wjw@digiware.nl> Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 09:00:48 +0000  (17:00 +0800)] 
Merge pull request #41587 from cfsnyder/bugfix_47738Reviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 08:59:24 +0000  (16:59 +0800)] 
Merge pull request #41592 from tchaikov/wip-ceph-default-confffileReviewed-by: Neha Ojha <nojha@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 08:58:59 +0000  (16:58 +0800)] 
Merge pull request #41594 from tchaikov/wip/test/librados/listReviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com> Reviewed-by: Neha Ojha <nojha@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 08:57:41 +0000  (16:57 +0800)] 
Merge pull request #36941 from hoamer/patch-1Reviewed-by: Kefu Chai <kchai@redhat.com> 
hoamer  [Wed, 2 Sep 2020 07:13:12 +0000  (09:13 +0200)] 
doc/mgr/administrator: add a more precise description for creating keySigned-off-by: hoamer <kontakt@sebastian-neugebauer.de> 
Kefu Chai  [Fri, 4 Jun 2021 03:25:12 +0000  (11:25 +0800)] 
debian/control: ceph-mgr-modules-core does not Recommend ceph-mgr-rook anymoreSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Wed, 2 Jun 2021 09:54:18 +0000  (17:54 +0800)] 
test/objectstore/unittest_alloc_aging: init cctSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Wed, 2 Jun 2021 09:38:49 +0000  (17:38 +0800)] 
test/objectstore: s/TearDownTestCase/TearDownTestSuite/Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 05:50:38 +0000  (13:50 +0800)] 
Merge pull request #41652 from tchaikov/wip-qa-asock-orReviewed-by: Samuel Just <sjust@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 04:30:23 +0000  (12:30 +0800)] 
Merge pull request #41686 from t-msn/update-trace-docReviewed-by: Kefu Chai <kchai@redhat.com> 
Misono Tomohiro  [Fri, 4 Jun 2021 02:36:49 +0000  (11:36 +0900)] 
doc/dev: update how to use lttng/blkin traceSigned-off-by: Misono Tomohiro <misono.tomohiro@jp.fujitsu.com> 
Sage Weil  [Fri, 4 Jun 2021 02:04:55 +0000  (22:04 -0400)] 
Merge PR #41553 into masterReviewed-by: Kefu Chai <kchai@redhat.com> 
Sage Weil  [Fri, 4 Jun 2021 02:04:32 +0000  (22:04 -0400)] 
Merge PR #41636 into masterReviewed-by: Adam King <adking@redhat.com> Reviewed-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Fri, 4 Jun 2021 01:44:58 +0000  (09:44 +0800)] 
Merge pull request #41674 from tchaikov/wip-vstart-without-restfulReviewed-by: Josh Durgin <jdurgin@redhat.com> 
Paul Cuzner  [Wed, 2 Jun 2021 23:34:19 +0000  (11:34 +1200)] 
mgr/cephadm:fix alerts sent to wrong URLFixes: https://tracker.ceph.com/issues/51073 Signed-off-by: Paul Cuzner <pcuzner@redhat.com> 
Kefu Chai  [Thu, 3 Jun 2021 23:50:44 +0000  (07:50 +0800)] 
Merge pull request #41670 from tchaikov/wip-op-tracking-spin-off-0Reviewed-by: Samuel Just <sjust@redhat.com> 
Kefu Chai  [Thu, 3 Jun 2021 23:50:21 +0000  (07:50 +0800)] 
Merge pull request #41672 from tchaikov/wip-crimson-test-handle-futReviewed-by: Samuel Just <sjust@redhat.com> 
Patrick Donnelly  [Thu, 3 Jun 2021 20:34:54 +0000  (13:34 -0700)] 
Merge PR #41654 into masterReviewed-by: Xiubo Li <xiubli@redhat.com> Reviewed-by: Jeff Layton <jlayton@redhat.com> 
Patrick Donnelly  [Thu, 3 Jun 2021 20:33:58 +0000  (13:33 -0700)] 
Merge PR #41639 into masterReviewed-by: Patrick Donnelly <pdonnell@redhat.com> 
Patrick Donnelly  [Thu, 3 Jun 2021 20:33:27 +0000  (13:33 -0700)] 
Merge PR #41499 into masterReviewed-by: Patrick Donnelly <pdonnell@redhat.com> 
Patrick Donnelly  [Thu, 3 Jun 2021 20:23:17 +0000  (13:23 -0700)] 
Merge PR #41443 into masterReviewed-by: Patrick Donnelly <pdonnell@redhat.com> 
Patrick Donnelly  [Thu, 3 Jun 2021 20:22:23 +0000  (13:22 -0700)] 
Merge PR #39910 into masterReviewed-by: Patrick Donnelly <pdonnell@redhat.com> 
Dan Mick  [Thu, 3 Jun 2021 18:32:24 +0000  (11:32 -0700)] 
Merge pull request #41559 from dmick/wip-grafana-container
Sage Weil  [Thu, 3 Jun 2021 14:29:00 +0000  (10:29 -0400)] 
mgr/cephadm/inventory: do not try to resolve current mgr host
The CNI configuration may set up a private network for the container, which
is mapped to the hostname in /etc/hosts.  For example, my test box sets
up 10.88.0.0/24 because I was using crio + kubeadm on this host earlier
(at least I think that's why):
$ sudo podman run --rm --name test123 --entrypoint /bin/bash -it quay.ceph.io/ceph-ci/ceph:master -c "cat /etc/hosts"
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
10.88.0.8	
f9e91bf2478f  test123
In any case, we should never trust a lookup of our own hostname from inside
a container!
This isn't quite sufficient, though: if this is a single-host cluster, then
we fall back to using get_mgr_ip(). That value may be distorted by the
public_network option on the mgr, but we don't have any other good
options here, and single-node clusters are unlikely to have complex
network configs.
Refactor a bit to avoid the try/except nesting.
Signed-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Wed, 2 Jun 2021 02:31:11 +0000  (22:31 -0400)] 
pybind/mgr/mgr_module: make get_mgr_ip() return mgr's IP from mgrmapSigned-off-by: Sage Weil <sage@newdream.net> 
Sage Weil  [Wed, 2 Jun 2021 02:31:47 +0000  (22:31 -0400)] 
mgr/restful: use get_mgr_ip() instead of hostnameSigned-off-by: Sage Weil <sage@newdream.net> 
Neha Ojha  [Thu, 3 Jun 2021 15:39:22 +0000  (08:39 -0700)] 
Merge pull request #41308 from sseshasa/wip-osd-benchmark-for-mclockReviewed-by: Neha Ojha <nojha@redhat.com> Reviewed-by: Josh Durgin <jdurgin@redhat.com> 
Casey Bodley  [Thu, 3 Jun 2021 15:05:00 +0000  (11:05 -0400)] 
Merge pull request #41316 from cbodley/wip-50785Reviewed-by: Daniel Gryniewicz <dang@redhat.com> Reviewed-by: Shilpa Jagannath <smanjara@redhat.com> 
Kefu Chai  [Thu, 3 Jun 2021 14:40:26 +0000  (22:40 +0800)] 
Merge pull request #41677 from tchaikov/wip-oomReviewed-by: David Galloway <dgallowa@redhat.com> 
Casey Bodley  [Thu, 3 Jun 2021 14:28:35 +0000  (10:28 -0400)] 
Merge pull request #41668 from pleiadesian/patch-bucket-chownReviewed-by: Or Friedmann <ofriedma@redhat.com> Reviewed-by: Daniel Gryniewicz <dang@redhat.com> 
Casey Bodley  [Thu, 3 Jun 2021 14:16:30 +0000  (10:16 -0400)] 
Merge pull request #41462 from yehudasa/wip-50920Reviewed-by: Casey Bodley <cbodley@redhat.com> 
Kefu Chai  [Thu, 3 Jun 2021 12:48:53 +0000  (20:48 +0800)] 
cmake: increase the MAX_{LINK,COMPILE}_MEMSigned-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Thu, 3 Jun 2021 12:41:36 +0000  (20:41 +0800)] 
ceph.spec.in: increase the mem_per_job to 3GiB
to lower the number of jobs, we are experiencing build failures on
a builder with 48c96t, 193 free mem. the failures were caused by
OOM killer which kills the c++ compiler
[498376.128969] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/jenkins.service,task=cc1plus,pid=
1387895 ,uid=1110
[498376.145288] Out of memory: Killed process 
1387895  (cc1plus) total-vm:3323312kB, anon-rss:3164568kB, file-rss:0kB, shmem-rss:0kB, UID:1110
[498376.315185] oom_reaper: reaped process 
1387895  (cc1plus), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
[498377.882072] cc1plus invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
before this change, we use the total memory to calculate the number
of jobs, and assume that each job takes at most 2.5GiB mem. in the
case above, the # of job is 96.
after this change, we use the free memory, and increse the mem per job
to 3.0GiB. in the case above, the # of job would be 85.
Signed-off-by: Kefu Chai <kchai@redhat.com> 
Kefu Chai  [Thu, 3 Jun 2021 11:45:23 +0000  (19:45 +0800)] 
Merge pull request #41669 from tchaikov/wip-crimson-asok-dump-metricsReviewed-by: Amnon Hanuhov <ahanukov@redhat.com>