]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agoboost: include more specific asio headers 19848/head
Casey Bodley [Tue, 23 Jan 2018 15:49:31 +0000 (10:49 -0500)]
boost: include more specific asio headers

when building with gcc5 and boost 1.66, this #include <boost/asio.hpp> fails to compile:

In file included from build/boost/include/boost/asio/impl/write.hpp:25:0,
                 from build/boost/include/boost/asio/write.hpp:927,
                 from build/boost/include/boost/asio/buffered_write_stream.hpp:29,
                 from build/boost/include/boost/asio/buffered_stream.hpp:22,
                 from build/boost/include/boost/asio.hpp:41,
                 from src/common/Graylog.h:7,
                 from src/common/LogClient.cc:20:
build/boost/include/boost/asio/detail/consuming_buffers.hpp: In member function ‘boost::asio::detail::consuming_buffers<Buffer, Buffers, Buffer_Iterator>::prepared_buffers_type boost::asio::detail::consuming_buffers<Buffer, Buffers, Buffer_Iterator>::prepare(std::size_t)’:
build/boost/include/boost/asio/detail/consuming_buffers.hpp:105:50: error: parse error in template argument list
     while (next != end && max_size > 0 && result.count < result.max_buffers)
                                                  ^
src/CMakeFiles/common-objs.dir/build.make:135: recipe for target 'src/CMakeFiles/common-objs.dir/common/LogClient.cc.o' failed

see also: https://svn.boost.org/trac10/ticket/13368

this commit targets the luminous branch specifically because the issues
doesn't reproduce on master (as we require gcc7+)

Signed-off-by: Casey Bodley <cbodley@redhat.com>
8 years agocmake: add WITH_BOOST_CONTEXT option
Casey Bodley [Sun, 26 Nov 2017 20:46:26 +0000 (15:46 -0500)]
cmake: add WITH_BOOST_CONTEXT option

adds a more specific option for this boost::context dependency, which was
previously only used by the radosgw beast frontend. see
http://tracker.ceph.com/issues/20048 for more background

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit b589b73c70bc4c644b7a040d9aee5083881254b9)

Conflicts:
src/include/config-h.in.cmake (missing HAVE_GETENTROPY from
                  https://github.com/ceph/ceph/pull/17972)

8 years agocmake: remove Beast submodule and include path
Casey Bodley [Tue, 19 Dec 2017 03:23:53 +0000 (22:23 -0500)]
cmake: remove Beast submodule and include path

the beast library is included in boost 1.66

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit d85f42dd697365ad6c6be80af2e31a6415f55d5e)

Conflicts:
src/rgw/CMakeLists.txt (missing SYSTEM flag from
                 https://github.com/ceph/ceph/pull/18711)

8 years agorgw: update beast frontend for boost 1.66
Casey Bodley [Tue, 5 Dec 2017 19:43:06 +0000 (14:43 -0500)]
rgw: update beast frontend for boost 1.66

Fixes: http://tracker.ceph.com/issues/22600
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit a66a6449296d39e57724fa733ac3069fecfdcdaa)

8 years agocmake: update minimum boost version to 1.66
Casey Bodley [Mon, 18 Dec 2017 18:03:35 +0000 (13:03 -0500)]
cmake: update minimum boost version to 1.66

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 0e47a339dface3807ab0061f9ce62fe1d2654d29)

8 years agosubmodule: update Beast to ceph/ceph-master branch
Casey Bodley [Mon, 27 Nov 2017 19:16:33 +0000 (14:16 -0500)]
submodule: update Beast to ceph/ceph-master branch

pulls beast submodule up from v116 tag to v124, with an additional bug
fix for async_read_some()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit efe90765957371a78b36305727dc3eb34252ad91)

8 years agorgw: RGWEnv::set() takes std::string
Casey Bodley [Fri, 10 Nov 2017 04:20:40 +0000 (23:20 -0500)]
rgw: RGWEnv::set() takes std::string

the beast frontend will either pass a string_ref or a string_view,
depending on the boost version. we can't overload RGWEnv::set() for
both, because a call to env.set("literal") would be ambiguous

both string_ref and string_view have a to_string() member function, so
RGWEnv::set() now takes a std::string by value and moves it into the
map. this involes a single string copy, whether we pass a temporary
std::string (in beast) or a const char* (in civetweb)

Fixes: http://tracker.ceph.com/issues/22101
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 6fbd3f358a17debea8c04f976946d5f245576f31)

8 years agorgw: fix for pause in beast frontend
Casey Bodley [Thu, 19 Oct 2017 00:22:11 +0000 (20:22 -0400)]
rgw: fix for pause in beast frontend

pause_for_new_config() was only stopping the listener on pause, but
existing keepalive connections would keep trying to read. this prevented
the frontend thread calls to io_service::run() from returning to
complete the pause

Fixes: http://tracker.ceph.com/issues/21831
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit c64ac823adfb6d717570d3d3e82b89ea73dc3a77)

8 years agoqa/rgw: add beast frontend to some rgw suites
Casey Bodley [Tue, 26 Sep 2017 18:35:56 +0000 (14:35 -0400)]
qa/rgw: add beast frontend to some rgw suites

added a qa/rgw_frontend directory for civetweb.yaml and the new
beast.yaml. the rgw suites for multifs and singleton now symlink
rgw_frontend/civetweb.yaml. the multisite, tempest and verify suites
symlink rgw_frontend to test both. this doubles the number of jobs in
those suites

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 607b72f553b3d4c1ad6feba9ee7199a4d91272f1)

8 years agorgw: ask beast parser about keepalive/close
Casey Bodley [Wed, 11 Oct 2017 13:01:35 +0000 (09:01 -0400)]
rgw: ask beast parser about keepalive/close

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 5d7f154a77eb2cf82b6e4e49d20687c8ed839113)

8 years agorgw: remove boost::coroutine and context deps
Casey Bodley [Mon, 25 Sep 2017 15:13:08 +0000 (11:13 -0400)]
rgw: remove boost::coroutine and context deps

the beast frontend no longer uses stackful coroutines, so these
dependencies aren't necessary

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit b904b575042d6598a9cf74d23beecd4884e097d2)

8 years agorgw: beast frontend discards unread body before next header
Casey Bodley [Mon, 17 Jul 2017 14:12:07 +0000 (10:12 -0400)]
rgw: beast frontend discards unread body before next header

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit c6bc7e1b0cbaf553f000aaa2893fa1486fc02a75)

8 years agorgw: beast frontend uses callbacks instead of coroutines
Casey Bodley [Wed, 12 Jul 2017 15:39:26 +0000 (11:39 -0400)]
rgw: beast frontend uses callbacks instead of coroutines

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 7767d8d88aecac8e88ed4c87a187c7a2ed67cf48)

8 years agorgw: set header/body size limits on beast parser
Casey Bodley [Tue, 11 Jul 2017 20:12:02 +0000 (16:12 -0400)]
rgw: set header/body size limits on beast parser

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1f72684eb4c6fb9fd021240ae55812894afc19e9)

8 years agorgw: update beast frontend/submodule to v116
Casey Bodley [Thu, 6 Jul 2017 20:31:23 +0000 (16:31 -0400)]
rgw: update beast frontend/submodule to v116

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 746c218c620d7681f6c9d769631ee1ac0d2b5987)

8 years agorgw: fix opslog uri as per Amazon s3
Jiaying Ren [Thu, 10 Aug 2017 07:21:32 +0000 (15:21 +0800)]
rgw: fix opslog uri as per Amazon s3

According to s3[1], current Request-URI opslog entry are missing:

+ request method
+ query string
+ http version number

[1] http://docs.aws.amazon.com/AmazonS3/latest/dev/LogFormat.html

Fixes: http://tracker.ceph.com/issues/20971
Reported-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>
(cherry picked from commit 96bb12a158ab899ec219d88e140499a4e27b4ba5)

8 years agorgw: fix opslog can't record referrer when using curl as client
Jiaying Ren [Mon, 7 Aug 2017 09:30:27 +0000 (17:30 +0800)]
rgw: fix opslog can't record referrer when using curl as client

Fixes: http://tracker.ceph.com/issues/20935
Reported-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>
(cherry picked from commit 23323b7f725dc1e99e4a81512b57d342dab9a3fe)

8 years agoMerge pull request #19505 from shinobu-x/wip-22392-luminous
Jos Collin [Mon, 8 Jan 2018 17:22:30 +0000 (17:22 +0000)]
Merge pull request #19505 from shinobu-x/wip-22392-luminous

luminous: mds: tell session ls returns vanila EINVAL when MDS is not active

Reviewed-by: Jos Collin <jcollin@redhat.com>
8 years agoMerge pull request #19831 from pdvian/wip-22576-luminous
John Spray [Mon, 8 Jan 2018 16:18:12 +0000 (16:18 +0000)]
Merge pull request #19831 from pdvian/wip-22576-luminous

luminous: qa: configure zabbix properly before selftest

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Wido den Hollander <wido@42on.com>
8 years agoMerge pull request #19787 from linuxbox2/luminous-21984
Yehuda Sadeh [Mon, 8 Jan 2018 10:15:39 +0000 (12:15 +0200)]
Merge pull request #19787 from linuxbox2/luminous-21984

rgw: fix rewrite a versioning object create a new object bug

8 years agoqa: configure zabbix properly before selftest 19831/head
John Spray [Thu, 21 Dec 2017 13:27:45 +0000 (08:27 -0500)]
qa: configure zabbix properly before selftest

Even though the selftest routine doesn't care about
the settings, we should set them to avoid emitting
nasty log/health messages when enabling the module.

Fixes: http://tracker.ceph.com/issues/22514
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit c64c9ff00d2df2177135bcd2735bd7aeac625643)

8 years agoMerge pull request #19449 from smithfarm/wip-22398-luminous
Jos Collin [Fri, 5 Jan 2018 17:07:00 +0000 (17:07 +0000)]
Merge pull request #19449 from smithfarm/wip-22398-luminous

luminous: doc: man page for mount.fuse.ceph

Reviewed-by: Jos Collin <jcollin@redhat.com>
8 years agodoc: fix typo 19449/head
Jos Collin [Fri, 5 Jan 2018 14:07:31 +0000 (19:37 +0530)]
doc: fix typo

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit a925bb4520797376b4b169bbcfe613cd1fa36429)

8 years agodoc: add mount.fuse.ceph to index
Jos Collin [Fri, 5 Jan 2018 07:11:37 +0000 (12:41 +0530)]
doc: add mount.fuse.ceph to index

Added mount.fuse.ceph to index.rst

Fixes: http://tracker.ceph.com/issues/22595
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit db23f4ce30cd521b5b8909edc8c26dc87aeecd98)

8 years agodoc: doc for mount.fuse.ceph
Jos Collin [Mon, 27 Nov 2017 10:46:35 +0000 (16:16 +0530)]
doc: doc for mount.fuse.ceph

Created doc for mount.fuse.ceph.

Fixes: http://tracker.ceph.com/issues/21539
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 6c39818eaf39358cab8dd3dce579c932fba0d05d)

8 years agorgw: fix rewrite a versioning object create a new object bug 19787/head
Enming Zhang [Tue, 31 Oct 2017 07:21:21 +0000 (15:21 +0800)]
rgw: fix rewrite a versioning object create a new object bug

Fixes: http://tracker.ceph.com/issues/21984
Signed-off-by: Enming Zhang <enming.zhang@umcloud.com>
(cherry picked from commit 700a0292362128cb29586a64ef8215a07d96736b)
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
8 years agoMerge pull request #19243 from liewegas/wip-fix-statfs-luminous
Sage Weil [Wed, 3 Jan 2018 17:07:39 +0000 (11:07 -0600)]
Merge pull request #19243 from liewegas/wip-fix-statfs-luminous

mon/Monitor: fix statfs handling before luminous switchover happens

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agoMerge pull request #19746 from ceph/wip-use-installer0-luminous2
vasukulkarni [Tue, 2 Jan 2018 22:23:35 +0000 (14:23 -0800)]
Merge pull request #19746 from ceph/wip-use-installer0-luminous2

qa/tests - Added options to use both cases: mon.a and installer.0

8 years agoqa/tests - Added options to use both cases: mon.a and installer.0 19746/head
Yuri Weinstein [Tue, 2 Jan 2018 18:12:54 +0000 (10:12 -0800)]
qa/tests - Added options to use both cases: mon.a and installer.0

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 10fc85089c3bb64ced8c3a0ea17987e9ec5f46a2)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
8 years agoqa/tests: run ceph-ansible task on installer.0 role/node
Yuri Weinstein [Wed, 20 Dec 2017 21:05:22 +0000 (13:05 -0800)]
qa/tests: run ceph-ansible task on installer.0 role/node

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
(cherry picked from commit 3b2a26d919c173c887fd193f186ea56c33fcd9ae)

8 years agoMerge pull request #19741 from joscollin/luminous
Sage Weil [Tue, 2 Jan 2018 15:17:16 +0000 (09:17 -0600)]
Merge pull request #19741 from joscollin/luminous

luminous: doc: update Blacklisting and OSD epoch barrier

8 years agodoc: fix grammar mistake 19741/head
Jos Collin [Tue, 2 Jan 2018 10:47:39 +0000 (16:17 +0530)]
doc: fix grammar mistake

Fixed grammar mistake in a sentence.

Signed-off-by: Jos Collin <jcollin@redhat.com>
8 years agodoc: update Blacklisting and OSD epoch barrier
Jos Collin [Tue, 2 Jan 2018 10:41:30 +0000 (16:11 +0530)]
doc: update Blacklisting and OSD epoch barrier

Updated missing OSD epoch barrier section, which is referenced by http://docs.ceph.com/docs/luminous/cephfs/full/#hammer-and-later.

Fixes: http://tracker.ceph.com/issues/22552
Signed-off-by: Jos Collin <jcollin@redhat.com>
8 years agoMerge pull request #19721 from tchaikov/wip-luminous-boost-un-submodule
Sage Weil [Sat, 30 Dec 2017 20:12:19 +0000 (14:12 -0600)]
Merge pull request #19721 from tchaikov/wip-luminous-boost-un-submodule

luminous: boost un-submodule

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agomake-dist: exclude unused bits in boost 19721/head
Kefu Chai [Fri, 24 Nov 2017 05:56:02 +0000 (13:56 +0800)]
make-dist: exclude unused bits in boost

the docs, examples and tests are not used. so drop them. we could go
further by removing unused components in boost. but that'd be an issue
if somebody added a component in CMakeLists but forgets to update this
script. also, we need to remove boost/$component and lib/$component to
achieve this goal. this also introduces extra complicity. so leave it
for another change.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 65f91227a6b052ad60b01276d7d72dea07cbb1a4)

8 years agomake-dist: repackage boost in the correct path
Kefu Chai [Fri, 24 Nov 2017 02:27:19 +0000 (10:27 +0800)]
make-dist: repackage boost in the correct path

before this change, boost is put into ./src. after this change, it is
put into $outfile/src. i.e. something like
ceph-12.1.2-4592-gf5f2ced624/src .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 2218efa005ab871f26402b5dd33b2e599897c11f)

8 years agomake-dist,cmake: Try multiple URLs to download boost before failing
Brad Hubbard [Thu, 28 Sep 2017 05:28:53 +0000 (15:28 +1000)]
make-dist,cmake: Try multiple URLs to download boost before failing

Remove SPOF during boost download for make-dist and later cmake > 3.7

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 598556f98b65a03ad40ad076623b9cc8b507810e)

8 years agomake-dist,cmake: move boost tarball location to download.ceph.com
Sage Weil [Tue, 26 Sep 2017 21:15:17 +0000 (17:15 -0400)]
make-dist,cmake: move boost tarball location to download.ceph.com

Sourceforge is down.  Also, we can hammer our servers instead of
theirs.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 19987549e0ce526e353e24adddc7df8b1f165aab)

8 years agomake-dist: download and repackage boost
Kefu Chai [Thu, 31 Aug 2017 17:00:04 +0000 (01:00 +0800)]
make-dist: download and repackage boost

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit f04436b189376cf7b53d710ab2f2bf01d47482ad)

8 years agoboost: remove boost submodule
Kefu Chai [Tue, 30 May 2017 15:58:44 +0000 (23:58 +0800)]
boost: remove boost submodule

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 6b23056cf8d0d1bbd269bc96eef33dc27c25fd9e)

8 years agoMerge pull request #19680 from tchaikov/wip-luminous-22220
Nathan Cutler [Fri, 29 Dec 2017 17:27:43 +0000 (18:27 +0100)]
Merge pull request #19680 from tchaikov/wip-luminous-22220

luminous: install-deps.sh: revert gcc to the one shipped by distro

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #19048 from shinobu-x/wip-22196-luminous
Kefu Chai [Mon, 25 Dec 2017 17:27:04 +0000 (01:27 +0800)]
Merge pull request #19048 from shinobu-x/wip-22196-luminous

luminous: mgr[zabbix] float division by zero (osd['kb'] = 0)

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoinstall-deps.sh: update g++ symlink also 19680/head
Kefu Chai [Fri, 22 Dec 2017 14:42:16 +0000 (22:42 +0800)]
install-deps.sh: update g++ symlink also

we need to update g++ symlink also, if it points to the wrong version

http://tracker.ceph.com/issues/22220
Signed-off-by: Kefu Chai <kchai@redhat.com>
Conflicts: the libboost issue does not affect master. as master builds
     boost from source. so, it's not cherry-picked from master.
(cherry picked from commit 248a157635b46d3cf23e37ae263c62b0dc4e0e59)

8 years agoinstall-deps.sh: readlink /usr/bin/gcc not /usr/bin/x86_64-linux-gnu-gcc
Kefu Chai [Thu, 14 Dec 2017 13:01:43 +0000 (21:01 +0800)]
install-deps.sh: readlink /usr/bin/gcc not /usr/bin/x86_64-linux-gnu-gcc

See: http://tracker.ceph.com/issues/22220
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 5be6ff11e536cb492dd50dedf8a04fb9acc1222e)

8 years agoinstall-deps.sh: point gcc to the one shipped by distro
Kefu Chai [Wed, 13 Dec 2017 05:36:54 +0000 (13:36 +0800)]
install-deps.sh: point gcc to the one shipped by distro

to define a struct in a method is legal in C++11, but it causes internal
compiler error due to https://gcc.gnu.org/bugzilla/show_bug.cgi?id=82155
if we are using GCC-7. so we need to either workaround in our source
code by moving the struct definition out of the member method or revert
to a GCC without this bug. but if we go with the first route, the jewel
build still fails, because GCC-7 starts to use the new CXX11 ABI, which
is not compatible with the libboost we use in jewel. the libboost was
still built with the old ABI for backward compatibility. so let's just
fix the install-deps.sh to point gcc to the origin one.

See: http://tracker.ceph.com/issues/22220
Signed-off-by: Kefu Chai <kchai@redhat.com>
Conflicts: the libboost issue does not affect master. as master builds
 boost from source. so, it's not cherry-picked from master.
(cherry picked from commit ccc4dea90e483ea8bf6bee0721ef929e7f48ff5a)

8 years agoMerge pull request #18771 from ceph/wip-yuriw-22048-luminous
Josh Durgin [Mon, 18 Dec 2017 21:25:15 +0000 (13:25 -0800)]
Merge pull request #18771 from ceph/wip-yuriw-22048-luminous

tests - Initial checkin for luminous point-to-point upgrade

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
8 years agoMerge pull request #19522 from ceph/wip-ceph-disk-deprecation-revert
Kefu Chai [Fri, 15 Dec 2017 12:52:14 +0000 (20:52 +0800)]
Merge pull request #19522 from ceph/wip-ceph-disk-deprecation-revert

Revert "ceph-disk add deprecation warnings in favor of ceph-volume"

Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agotests - Initial checkin for luminous point-to-point upgrade 18771/head
Yuri Weinstein [Mon, 6 Nov 2017 20:22:27 +0000 (12:22 -0800)]
tests - Initial checkin for luminous point-to-point upgrade

Fixes http://tracker.ceph.com/issues/22048
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
8 years agoMerge pull request #19532 from ceph/luminous-rm22297
Andrew Schoen [Thu, 14 Dec 2017 21:03:23 +0000 (22:03 +0100)]
Merge pull request #19532 from ceph/luminous-rm22297

luminous ceph-volume handle inline comments in the ceph.conf file

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
8 years agoMerge pull request #19530 from ceph/luminous-rm22326
Andrew Schoen [Thu, 14 Dec 2017 20:50:22 +0000 (21:50 +0100)]
Merge pull request #19530 from ceph/luminous-rm22326

luminous ceph-volume: warn on missing ceph.conf file

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
8 years agoceph-volume configuration allow inlined comments for # and ; 19532/head
Alfredo Deza [Mon, 4 Dec 2017 13:22:23 +0000 (08:22 -0500)]
ceph-volume configuration allow inlined comments for # and ;

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit aec5f5042a684952c2b07922695e7675e13645ec)

8 years agoceph-volume tests verify that INI comments can be inlined
Alfredo Deza [Mon, 4 Dec 2017 13:21:29 +0000 (08:21 -0500)]
ceph-volume tests verify that INI comments can be inlined

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit fe6c4c0d6055c46baadd89723c0a2b78b5ffb7f8)

8 years agoMerge pull request #19525 from ceph/backport-19363
Alfredo Deza [Thu, 14 Dec 2017 18:48:53 +0000 (13:48 -0500)]
Merge pull request #19525 from ceph/backport-19363

luminous: ceph-volume: removed the explicit use of sudo

Reviewed-by: Alfredo Deza <adeza@redhat.com>
8 years agoceph-volume test logging ignored ceph.conf file 19530/head
Alfredo Deza [Tue, 5 Dec 2017 18:59:22 +0000 (13:59 -0500)]
ceph-volume test logging ignored ceph.conf file

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 69482d1d8059c3b264532f7623c9e6592c57b7c3)

8 years agoceph-volume main warn on inability to load ceph.conf, don't raise
Alfredo Deza [Tue, 5 Dec 2017 18:58:53 +0000 (13:58 -0500)]
ceph-volume main warn on inability to load ceph.conf, don't raise

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 44c768db0da0163340b52643122b66ecebbefe23)

8 years agoMerge pull request #19528 from ceph/luminous-rm22305
Andrew Schoen [Thu, 14 Dec 2017 17:30:52 +0000 (18:30 +0100)]
Merge pull request #19528 from ceph/luminous-rm22305

luminous ceph-volume should be able to handle multiple LVM (VG/LV) tags

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
8 years agoMerge pull request #19527 from ceph/luminous-rm22299
Andrew Schoen [Thu, 14 Dec 2017 17:26:30 +0000 (18:26 +0100)]
Merge pull request #19527 from ceph/luminous-rm22299

luminous ceph-volume Format correctly when vg/lv cannot be used

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
8 years agoMerge pull request #19526 from ceph/luminous-rm22280
Andrew Schoen [Thu, 14 Dec 2017 17:22:22 +0000 (18:22 +0100)]
Merge pull request #19526 from ceph/luminous-rm22280

luminous ceph-volume: handle leading whitespace/tabs in ceph.conf

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
8 years agoceph-volume tests.api ensure that we can handle non-ceph tags in lvs 19528/head
Alfredo Deza [Mon, 4 Dec 2017 14:56:00 +0000 (09:56 -0500)]
ceph-volume tests.api ensure that we can handle non-ceph tags in lvs

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit c98731ecede09d8d15dca99c57e331212747060e)

8 years agoceph-volume api.lvm only consider 'ceph.' tags in logical volumes
Alfredo Deza [Mon, 4 Dec 2017 14:54:35 +0000 (09:54 -0500)]
ceph-volume api.lvm only consider 'ceph.' tags in logical volumes

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit a7e7df14602a10190a2830262a67202e7ad38f49)

8 years agoceph-volume tests verify proper formatting of RuntimeError on vg/lv error 19527/head
Alfredo Deza [Fri, 1 Dec 2017 18:53:39 +0000 (13:53 -0500)]
ceph-volume tests verify proper formatting of RuntimeError on vg/lv error

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d7320313a15ad8bb948e501382269c8f33a8cb70)

8 years agoceph-volume lvm.prepare correctly format argument for vg/lv error
Alfredo Deza [Fri, 1 Dec 2017 18:53:06 +0000 (13:53 -0500)]
ceph-volume lvm.prepare correctly format argument for vg/lv error

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7c0b00615d46a9451cb3a7731594cd7864eabc07)

8 years agoceph-volume test leading whitespace is handled in configurations 19526/head
Alfredo Deza [Thu, 30 Nov 2017 13:58:37 +0000 (08:58 -0500)]
ceph-volume test leading whitespace is handled in configurations

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit ec7f8a27b8c51e1e1d02a2a13d9219bbb1a58c26)

8 years agoceph-volume trim tabbed/whitespaced configuration files when loading them
Alfredo Deza [Thu, 30 Nov 2017 13:58:04 +0000 (08:58 -0500)]
ceph-volume trim tabbed/whitespaced configuration files when loading them

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9706e8cc9eb53d0f01fc78978625c1d18bf4667e)

8 years agoceph-volume: removed the explicit use of sudo 19525/head
Andrew Schoen [Wed, 6 Dec 2017 16:40:55 +0000 (10:40 -0600)]
ceph-volume: removed the explicit use of sudo

This will allow users to run ceph-volume on systems that do
not have sudo installed.

Fixes: http://tracker.ceph.com/issues/22282
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit aee71a3f5169043f750fd768e7fea9c74309e12d)

8 years agoRevert "ceph-disk add deprecation warnings in favor of ceph-volume" 19522/head
Alfredo Deza [Thu, 14 Dec 2017 13:28:58 +0000 (08:28 -0500)]
Revert "ceph-disk add deprecation warnings in favor of ceph-volume"

This reverts commit b8bf0d047868054135592188c7ebe186181310c5.

Deprecation warnings for ceph-disk will no longer be present in any
Luminous release beyond 12.2.2 - but are still present in master and any
newer release.

Signed-off-by: Alfredo Deza <adeza@redhat.com>
8 years agopybind: return error message when ceph_mds_command() returns error 19505/head
Jos Collin [Wed, 22 Nov 2017 11:50:58 +0000 (17:20 +0530)]
pybind: return error message when ceph_mds_command() returns error

Returned the error message when ceph_mds_command() returns error.

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 941b58c968f6b0e359f279c8bc9e7decf51e75d1)

8 years agomds: Fix error message when mds not active
Jos Collin [Wed, 22 Nov 2017 11:42:43 +0000 (17:12 +0530)]
mds: Fix error message when mds not active

Fix error message for mds not active state. Also fixed the 'unrecognized command' logic by avoiding the new stringstream local object.

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 10f93cf5828afbc8ff25ef81b2437ef5c0362396)

8 years agoMerge pull request #19042 from liewegas/wip-22128
Sage Weil [Tue, 12 Dec 2017 15:04:20 +0000 (09:04 -0600)]
Merge pull request #19042 from liewegas/wip-22128

mon/OSDMonitor: fix ruleset-* to crush-* fixup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #19355 from tchaikov/wip-18589-luminous
Kefu Chai [Fri, 8 Dec 2017 02:54:12 +0000 (10:54 +0800)]
Merge pull request #19355 from tchaikov/wip-18589-luminous

luminous: build/ops: move ceph-*-tool binaries out of ceph-test subpackage

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
8 years agodebian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move 19355/head
Kefu Chai [Wed, 6 Dec 2017 02:19:09 +0000 (10:19 +0800)]
debian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move

this is a follow-up of #19328. we need to get this change into 12.2.3.
so better off do the switch somewhere after 12.2.2 which has been
tagged, and before 12.2.3, which is not tagged yet.

please note, this is not targetting master, because i want to make
sure the change number (the <num> in << 12.2.2-<num>) is correct. it
does not hurt if it's not, as long as it is ">> 12.2.2", so the replace
machinery in 12.2.3 works, and it covers the releases where the
ceph-{osdomap,kvstore,monstore}-tool are not move yet. but why don't
make it more right?

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 57bb57f76d733d6e6dea4fc0682058e4e6abe7df)

8 years agodebian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move
Sage Weil [Tue, 5 Dec 2017 03:25:16 +0000 (21:25 -0600)]
debian/control: adjust ceph-{osdomap,kvstore,monstore}-tool feature move

The backport didn't make 12.2.2, but it will be in 12.2.3.

Fixes: http://tracker.ceph.com/issues/22319
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e0c814266fe653311673e07bd7c7dbb51d866f82)

8 years agodoc: add ceph-kvstore-tool's man
liuchang0812 [Fri, 18 Aug 2017 13:52:52 +0000 (21:52 +0800)]
doc: add ceph-kvstore-tool's man

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
(cherry picked from commit 0667db4eb61338887743d17c93a61c0e89868b08)

8 years agodebian: fix package relationships after d3ac8d18
Kefu Chai [Mon, 23 Oct 2017 12:15:16 +0000 (20:15 +0800)]
debian: fix package relationships after d3ac8d18

d3ac8d18 moves ceph-client-debug from ceph-test to ceph-base without
updating the package relationships between the two involved packages.
which results in:

dpkg: error processing archive /var/cache/apt/archives/ceph-test_12.2.1-241-g43e027b-1trusty_amd64.deb (--unpack):
 trying to overwrite '/usr/bin/ceph-client-debug', which is also in package ceph-base 10.2.10-14-gcbaddae-1trusty
dpkg-deb: error: subprocess paste was killed by signal (Broken pipe)

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit ed988fc660c5da3cb97e48e82ac5b7ad8f3bcd41)

8 years agodebian: fix package relationships after 40caf6a6
Kefu Chai [Mon, 23 Oct 2017 07:26:35 +0000 (15:26 +0800)]
debian: fix package relationships after 40caf6a6

we have issues when running upgrade tests:

dpkg: error processing archive /var/cache/apt/archives/ceph-osd_13.0.0-2201-g6cc0b41-1trusty_amd64.deb (--unpack):
trying to overwrite '/usr/bin/ceph-osdomap-tool', which is also in package ceph-test 10.2.10-14-gcbaddae-1trusty

in 40caf6a6, we moves some tools from ceph-test out into ceph-osd,
ceph-mon and ceph-base respectively. but didn't update the relationships
between these packages accordingly. this causes the upgrade failure.

see https://www.debian.org/doc/debian-policy/#document-ch-relationships
for more details on "Breaks" and "Conflicts".

the reason why the package version to be replaced/conflicted is 12.2.2
is that: i assume that this change will be backported to luminous, and
the next release of it will be 12.2.2 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 50dad805d9f635f2d8085237e94ee8fd0948dd3c)

8 years agobuild/ops: deb: move ceph-*-tool binaries out of ceph-test subpackage
Nathan Cutler [Fri, 13 Oct 2017 08:34:52 +0000 (10:34 +0200)]
build/ops: deb: move ceph-*-tool binaries out of ceph-test subpackage

ceph-osdomap-tool into ceph-osd subpackage
ceph-monstore-tool into ceph-mon subpackage
ceph-kvstore-tool into the ceph-base subpackage

Fixes: http://tracker.ceph.com/issues/21762
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 40caf6a6d85fbde930b74df57a62381f6225c3fd)

8 years agobuild/ops: rpm: move ceph-*-tool binaries out of ceph-test subpackage
Nathan Cutler [Fri, 13 Oct 2017 08:34:52 +0000 (10:34 +0200)]
build/ops: rpm: move ceph-*-tool binaries out of ceph-test subpackage

ceph-osdomap-tool into ceph-osd subpackage
ceph-monstore-tool into ceph-mon subpackage
ceph-kvstore-tool into the ceph-base subpackage

Fixes: http://tracker.ceph.com/issues/21762
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit d7b493a7108a68302bc0f48337bf3c253a720266)

8 years agoMerge pull request #19299 from tchaikov/wip-pr-19196-luminous 19359/head
Alfredo Deza [Tue, 5 Dec 2017 12:01:35 +0000 (07:01 -0500)]
Merge pull request #19299 from tchaikov/wip-pr-19196-luminous

luminous: ceph-disk: fix signed integer is greater than maximum when call major

Reviewed-by: Alfredo Deza <adeza@redhat.com>
8 years agoceph-disk: fix signed integer is greater than maximum when call major 19299/head
Song Shun [Tue, 28 Nov 2017 03:28:43 +0000 (11:28 +0800)]
ceph-disk: fix signed integer is greater than maximum when call major
  fix signed integer is greater than maximum when call os.major
  using python 2.7.5 in Centos 7

Signed-off-by: Song Shun <song.shun3@zte.com.cn>
(cherry picked from commit f77934b19939796d7ab52daf4dac44846a2ad162)

8 years agoMerge remote-tracking branch 'gh/luminous' into luminous
Alfredo Deza [Fri, 1 Dec 2017 14:57:44 +0000 (09:57 -0500)]
Merge remote-tracking branch 'gh/luminous' into luminous

8 years agoMerge pull request #19001 from tchaikov/wip-pr-18848-luminous
Kefu Chai [Fri, 1 Dec 2017 05:48:29 +0000 (13:48 +0800)]
Merge pull request #19001 from tchaikov/wip-pr-18848-luminous

luminous: mgr/dashboard: fix audit log loading

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #19270 from tchaikov/wip-pr-19225-luminous
Kefu Chai [Fri, 1 Dec 2017 05:47:17 +0000 (13:47 +0800)]
Merge pull request #19270 from tchaikov/wip-pr-19225-luminous

luminous: qa/suites/rados/singleton: more whitelist

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoqa/suites/rados/singleton: more whitelist 19270/head
Kefu Chai [Wed, 29 Nov 2017 05:51:49 +0000 (13:51 +0800)]
qa/suites/rados/singleton: more whitelist

* SLOW_OPS is normal in a cluster with flattering OSDs
* so is OBJECT_MISPLACED.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 0e987665fe480530a0d1664392604713828bfa5c)

8 years ago12.2.2 v12.2.2
Jenkins Build Slave User [Thu, 30 Nov 2017 14:59:27 +0000 (14:59 +0000)]
12.2.2

8 years agoMerge pull request #19240 from tchaikov/wip-22266-luminous
Kefu Chai [Thu, 30 Nov 2017 14:26:46 +0000 (22:26 +0800)]
Merge pull request #19240 from tchaikov/wip-22266-luminous

luminous: tools/ceph_monstore_tool: rebuild initial mgrmap also

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
8 years agomon/Monitor: fix statfs handling before luminous switchover happens 19243/head
Sage Weil [Wed, 29 Nov 2017 21:20:59 +0000 (15:20 -0600)]
mon/Monitor: fix statfs handling before luminous switchover happens

After the mons are luminous but before we switch over to using the
MgrStatMonitor's new info, the version on mgrstat will generally be <<
than that of pgmon, and the client will send that version with the
request.  This means that the statfs message will perpetually appear to be
in the future and fail the is_readable() check.

Fix this with any ugly hack that resets the version to 1 if we haven't
completed the luminous upgrade yet.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #19230 from tchaikov/wip-22247-luminous
Gregory Farnum [Wed, 29 Nov 2017 21:25:14 +0000 (16:25 -0500)]
Merge pull request #19230 from tchaikov/wip-22247-luminous

luminous: mon/PGMap: Fix %USED calculation

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
8 years agoMerge pull request #19239 from ceph/luminous-bz1518264
Andrew Schoen [Wed, 29 Nov 2017 16:33:34 +0000 (10:33 -0600)]
Merge pull request #19239 from ceph/luminous-bz1518264

luminous: ceph-volume correctly fallback to bluestore when no objectstore is specified

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
8 years agotools/ceph_monstore_tool: rebuild initial mgrmap also 19240/head
Kefu Chai [Wed, 29 Nov 2017 12:21:33 +0000 (20:21 +0800)]
tools/ceph_monstore_tool: rebuild initial mgrmap also

Fixes: http://tracker.ceph.com/issues/22266
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit f63d1da4afa3463730ecbc0be29df6375b79fa8f)

8 years agoceph-volume lvm.activate correct detection and fallback of objectstore flags 19239/head
Alfredo Deza [Tue, 28 Nov 2017 14:22:19 +0000 (09:22 -0500)]
ceph-volume lvm.activate correct detection and fallback of objectstore flags

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f0ac2dfdbc0a05cff0a5edbedca91274885b7870)

8 years agoceph-volume tests.devices.lvm verify objectstore flags in activate
Alfredo Deza [Tue, 28 Nov 2017 14:21:34 +0000 (09:21 -0500)]
ceph-volume tests.devices.lvm verify objectstore flags in activate

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 8d22856d6c95ac3b45918765b382cae507a8d1a4)

8 years agoMerge pull request #19217 from liewegas/wip-p2p-app-warning-luminous
Sage Weil [Wed, 29 Nov 2017 14:43:07 +0000 (08:43 -0600)]
Merge pull request #19217 from liewegas/wip-p2p-app-warning-luminous

upgrade/jewel-x/parallel: debug fuse

8 years agomon/PGMap: Fix %USED calculation bug. 19230/head
Xiaoxi Chen [Mon, 27 Nov 2017 05:51:58 +0000 (22:51 -0700)]
mon/PGMap: Fix %USED calculation bug.

Previous code forgot to multiple raw_used_ratio to calculate
used byte.

Fixes: http://tracker.ceph.com/issues/22247
Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
(cherry picked from commit d10c6c26f9ef7372e2c95da79d23b07ce5f4e0e5)

8 years agoqa/suites/upgrade/jewel-x/point-to-point: whitelist more stuff 19217/head
Sage Weil [Tue, 28 Nov 2017 22:48:36 +0000 (16:48 -0600)]
qa/suites/upgrade/jewel-x/point-to-point: whitelist more stuff

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoqa/suites/upgrade/jewel-x/parallel: only mount ceph-fuse once
Sage Weil [Tue, 28 Nov 2017 21:02:18 +0000 (15:02 -0600)]
qa/suites/upgrade/jewel-x/parallel: only mount ceph-fuse once

Otherwise we do 4 mounts for no good reason.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoupgrade/jewel-x/parallel: debug fuse
Sage Weil [Tue, 28 Nov 2017 21:00:05 +0000 (15:00 -0600)]
upgrade/jewel-x/parallel: debug fuse

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #19216 from liewegas/wip-p2p-app-warning-luminous
Sage Weil [Tue, 28 Nov 2017 20:48:08 +0000 (14:48 -0600)]
Merge pull request #19216 from liewegas/wip-p2p-app-warning-luminous

qa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning

8 years agoqa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning 19216/head
Sage Weil [Tue, 28 Nov 2017 20:46:02 +0000 (14:46 -0600)]
qa/suites/upgrade/jewel-x/point-to-point: fix suppression of pool app warning

It's generated on the mgr.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #19205 from tchaikov/wip-22136-luminous
Kefu Chai [Tue, 28 Nov 2017 15:47:17 +0000 (23:47 +0800)]
Merge pull request #19205 from tchaikov/wip-22136-luminous

luminous: qa/ceph-disk: enlarge the simulated SCSI disk

Reviewed-by: Alfredo Deza <adeza@redhat.com>
8 years agoMerge pull request #19152 from smithfarm/wip-22235-luminous
Nathan Cutler [Tue, 28 Nov 2017 13:03:01 +0000 (14:03 +0100)]
Merge pull request #19152 from smithfarm/wip-22235-luminous

luminous: ceph-disk flake8 test fails on very old, and very new, versions of flake8

Reviewed-by: Kefu Chai <kchai@redhat.com>