]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 years agoosd/PrimaryLogPG: use legacy style for osd_skip_data_digest
Sage Weil [Sat, 14 Jul 2018 13:51:00 +0000 (08:51 -0500)]
osd/PrimaryLogPG: use legacy style for osd_skip_data_digest

This is more efficient.

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #23039 from liewegas/wip-24903-workaround-luminous
Sage Weil [Fri, 13 Jul 2018 22:12:52 +0000 (17:12 -0500)]
Merge pull request #23039 from liewegas/wip-24903-workaround-luminous

rpm,deb: fix chown to use -h

7 years agorpm,deb: fix chown to use -h 23039/head
Sage Weil [Fri, 13 Jul 2018 22:10:38 +0000 (17:10 -0500)]
rpm,deb: fix chown to use -h

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 92207c76b91c26c0558688a358ade7c0d94d1b59)

7 years agoMerge PR #23028 into luminous
Sage Weil [Fri, 13 Jul 2018 19:44:09 +0000 (14:44 -0500)]
Merge PR #23028 into luminous

* refs/pull/23028/head:
osd/PrimaryLogPG: clear data digest on WRITEFULL if skip_data_digest

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #23035 into luminous
Sage Weil [Fri, 13 Jul 2018 19:44:01 +0000 (14:44 -0500)]
Merge PR #23035 into luminous

* refs/pull/23035/head:
rpm,deb: chown bluestore block* links to ceph.ceph on install/upgrade

7 years agorpm,deb: chown bluestore block* links to ceph.ceph on install/upgrade 23035/head
Sage Weil [Fri, 13 Jul 2018 14:56:48 +0000 (09:56 -0500)]
rpm,deb: chown bluestore block* links to ceph.ceph on install/upgrade

This works around https://tracker.ceph.com/issues/24903

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 58cde3fd793c037beca6645cc30b2ae1c30e2af1)

7 years agoMerge pull request #22369 from linuxbox2/wip-luminous-rgw-cache-time-added
Matt Benjamin [Fri, 13 Jul 2018 15:53:36 +0000 (11:53 -0400)]
Merge pull request #22369 from linuxbox2/wip-luminous-rgw-cache-time-added

Wip luminous rgw cache time added

7 years agoMerge PR #22962 into luminous
Sage Weil [Fri, 13 Jul 2018 12:11:54 +0000 (07:11 -0500)]
Merge PR #22962 into luminous

* refs/pull/22962/head:
osd/PrimaryLogPG: rebuild attrs from clients

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #22976 into luminous
Sage Weil [Fri, 13 Jul 2018 12:11:48 +0000 (07:11 -0500)]
Merge PR #22976 into luminous

* refs/pull/22976/head:
qa/standalone/osd/ec-error-rollforward: reproduce bug 24597
qa/standalone/osd/repro_long_log.sh: fix test
osd/PG: do not blindly roll forward to log.head

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge PR #23007 into luminous
Sage Weil [Fri, 13 Jul 2018 12:11:43 +0000 (07:11 -0500)]
Merge PR #23007 into luminous

* refs/pull/23007/head:
qa/suites/rados/singleton/all/osd-recovery*: whitelist REQUEST_SLOW

7 years agoosd/PrimaryLogPG: clear data digest on WRITEFULL if skip_data_digest 23028/head
Sage Weil [Thu, 26 Apr 2018 14:15:50 +0000 (09:15 -0500)]
osd/PrimaryLogPG: clear data digest on WRITEFULL if skip_data_digest

If we detect we are on bluestore and should skip the data digest, we
need to clear any old digest on WRITEFULL.  This aligns us with the
WRITE behavior, which is also either an update or a clear (but never
neither!).

Fixes: https://tracker.ceph.com/issues/23871
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit fe5038c7f9577327f82913b4565712c53903ee48)

7 years agoMerge PR #22872 into luminous
Patrick Donnelly [Thu, 12 Jul 2018 19:31:29 +0000 (12:31 -0700)]
Merge PR #22872 into luminous

* refs/pull/22872/head:
doc: outline steps to take CephFS fs down

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge PR #22963 into luminous
Patrick Donnelly [Thu, 12 Jul 2018 19:28:24 +0000 (12:28 -0700)]
Merge PR #22963 into luminous

* refs/pull/22963/head:
mon/AuthMonitor: improve error message

Reviewed-by: Douglas Fuller <dfuller@redhat.com>
7 years agoqa/suites/rados/singleton/all/osd-recovery*: whitelist REQUEST_SLOW 23007/head
Sage Weil [Thu, 12 Jul 2018 13:16:03 +0000 (08:16 -0500)]
qa/suites/rados/singleton/all/osd-recovery*: whitelist REQUEST_SLOW

Signed-off-by: Sage Weil <sage@redhat.com>
7 years agoqa/standalone/osd/ec-error-rollforward: reproduce bug 24597 22976/head
Sage Weil [Wed, 11 Jul 2018 21:14:38 +0000 (16:14 -0500)]
qa/standalone/osd/ec-error-rollforward: reproduce bug 24597

This reproduces http://tracker.ceph.com/issues/24597

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 4108ebc0abae83777ebc69bda610167f39e22109)

7 years agoqa/standalone/osd/repro_long_log.sh: fix test
Sage Weil [Wed, 11 Jul 2018 12:10:28 +0000 (07:10 -0500)]
qa/standalone/osd/repro_long_log.sh: fix test

The log trimming case wasn't quite right.  Before HEAD^ we were
rolling forward too aggressively and miscalculating the can_rollforward_to,
which affected the trim_to calculation.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 4f9fdd98e2dde3979ec88a3f761d76f7b297415c)

7 years agoosd/PG: do not blindly roll forward to log.head
Sage Weil [Wed, 11 Jul 2018 01:22:49 +0000 (20:22 -0500)]
osd/PG: do not blindly roll forward to log.head

If we are told we can roll forward by the primary, we should only roll
forward as far as the primary says we can.

This probably came out of the similar case in append_log(), but notably
that roll_forward() only happens if !transaction_applied (i.e., backfill
target), and that condition is not checked here.

Fixes: http://tracker.ceph.com/issues/24597
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 858ff647ff7bd1f6277823b5185ead5ffebc05b0)

7 years agomon/AuthMonitor: improve error message 22963/head
Douglas Fuller [Mon, 20 Nov 2017 18:12:08 +0000 (13:12 -0500)]
mon/AuthMonitor: improve error message

Improve the error message for 'ceph fs authorize' where the
given entity exists but has different auth caps.

Fixes: http://tracker.ceph.com/issues/21765
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
(cherry picked from commit 447b3d4852acd2db656c973cc224fb77d3fff590)

7 years agoosd/PrimaryLogPG: rebuild attrs from clients 22962/head
Sage Weil [Wed, 4 Jul 2018 19:19:04 +0000 (14:19 -0500)]
osd/PrimaryLogPG: rebuild attrs from clients

Ensure that buffers coming in via client ops are rebuilt before populating
the PGTransaction.  This ensures that we don't pin the raw buffers for
the entire incoming message in memory.

In the past we've addressed this issue at the ObjectStore layer, but we
did not consider the attr_cache in ObjectContext.  Rebuilding the buffers
at this point will sanitize any incoming attribute before it reaches
either PGBackend or ObjectContext object_cache or the ObjectStore
implementation.

Fixes: http://tracker.ceph.com/issues/24768
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 0a0f8d5e6fa8276f06a9b7a7b18ea6f15fa8cb86)

7 years ago12.2.6 v12.2.6
Jenkins Build Slave User [Mon, 9 Jul 2018 16:18:47 +0000 (16:18 +0000)]
12.2.6

7 years agoMerge pull request #22911 from dillaman/wip-24740-luminous
Nathan Cutler [Mon, 9 Jul 2018 14:01:38 +0000 (16:01 +0200)]
Merge pull request #22911 from dillaman/wip-24740-luminous

luminous: qa/workunits/rbd: adapt import_export test to handle multiple units

Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge remote-tracking branch 'private/wip-mon-snap-caps-luminous' into luminous
Sage Weil [Mon, 9 Jul 2018 13:36:02 +0000 (08:36 -0500)]
Merge remote-tracking branch 'private/wip-mon-snap-caps-luminous' into luminous

7 years agoMerge remote-tracking branch 'private/wip-cx-luminous' into luminous
Sage Weil [Mon, 9 Jul 2018 13:12:04 +0000 (08:12 -0500)]
Merge remote-tracking branch 'private/wip-cx-luminous' into luminous

7 years agoqa/workunits/rbd: adapt import_export test to handle multiple units 22911/head
Jason Dillaman [Fri, 6 Jul 2018 17:12:53 +0000 (13:12 -0400)]
qa/workunits/rbd: adapt import_export test to handle multiple units

Fixes: http://tracker.ceph.com/issues/24740
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
7 years agoMerge pull request #22855 from jcsp/wip-luminous-cephfs-doc
John Spray [Thu, 5 Jul 2018 13:40:51 +0000 (14:40 +0100)]
Merge pull request #22855 from jcsp/wip-luminous-cephfs-doc

[luminous] doc/cephfs: remove lingering "experimental" note about multimds

Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agodoc: outline steps to take CephFS fs down 22872/head
Patrick Donnelly [Fri, 6 Apr 2018 03:06:29 +0000 (20:06 -0700)]
doc: outline steps to take CephFS fs down

Fixes: https://tracker.ceph.com/issues/23427
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 9aa13bf0b0bf20b4fcf4949af60ebfff1e8fea0a)

7 years agodoc/cephfs: remove lingering "experimental" note about multimds 22855/head
John Spray [Wed, 4 Jul 2018 16:04:09 +0000 (17:04 +0100)]
doc/cephfs: remove lingering "experimental" note about multimds

Signed-off-by: John Spray <john.spray@redhat.com>
7 years agoMerge pull request #22831 from ceph/backport-luminous-22828
Alfredo Deza [Tue, 3 Jul 2018 22:45:13 +0000 (18:45 -0400)]
Merge pull request #22831 from ceph/backport-luminous-22828

luminous: ceph-volume: provide a nice errror message when missing ceph.conf

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume: always ignore a missing ceph conf in main.py 22831/head
Andrew Schoen [Tue, 3 Jul 2018 11:45:24 +0000 (06:45 -0500)]
ceph-volume: always ignore a missing ceph conf in main.py

Now that we have a nice error message when a ceph.conf is missing
and we try to use values from it, maintaining a list of commands that
don't need ceph.conf isn't as helpful. We had actually missed 'simple
trigger' when we first implemented this causing all our luminous tests
for simple to fail when we backported.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 0487a9ac60c5ba289b7dd7c730b014a298c5998f)

7 years agoceph-volume: show a nice error message when ceph.conf is not loaded
Andrew Schoen [Mon, 2 Jul 2018 20:58:44 +0000 (15:58 -0500)]
ceph-volume: show a nice error message when ceph.conf is not loaded

If the ceph configuration file is not loaded correctly and then values
from it are used then an undescript error message is shown, e.g.

AttributeError: 'property' object has no attribute 'get'

With this change that same error condition shows the message:

RuntimeError: No valid ceph configuration file was loaded.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit e42ecb831914b07c7c8559d4556a8aabd2accd0c)

7 years agoMerge pull request #22746 from ceph/backport-luminous-22724
Alfredo Deza [Thu, 28 Jun 2018 14:47:14 +0000 (10:47 -0400)]
Merge pull request #22746 from ceph/backport-luminous-22724

luminous: ceph-volume: error on commands that need ceph.conf to operate

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoceph-volume: error on commands that need ceph.conf to operate 22746/head
Andrew Schoen [Tue, 26 Jun 2018 19:19:43 +0000 (14:19 -0500)]
ceph-volume: error on commands that need ceph.conf to operate

We had been ignoring the failure to load ceph.conf for all subcommands
but most of them require that a ceph.conf be present. This changes that
so only commands that do not need ceph.conf ignore the failure to find
it.

Fixes: http://tracker.ceph.com/issues/23941
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit de8b301ac20ae07f59a19bc1b3a083e9c010667d)

7 years agoqa/workunits/rados: test pool op permissions
Jason Dillaman [Thu, 21 Jun 2018 02:20:14 +0000 (22:20 -0400)]
qa/workunits/rados: test pool op permissions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 97e3f0aa013dad49de1a55f8025327de7e801822)
(cherry picked from commit b0d6e82a8c95380183af099a50a638f308b67090)

Conflicts:
qa/workunits/rados/test_pool_access.sh: use CEPH_KEYRING env variable

7 years agoqa/workunits/rbd: test self-managed snapshot create/remove permissions
Jason Dillaman [Tue, 5 Jun 2018 19:40:44 +0000 (15:40 -0400)]
qa/workunits/rbd: test self-managed snapshot create/remove permissions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit b12dd0bf419ae834abb31c712830fa9c4b5cda9c)
(cherry picked from commit 37926b092dd1434e8fdca4620e86c0168aa26b24)

Conflicts:
qa/workunits/rbd/permissions.sh: use CEPH_KEYRING env variable

7 years agopybind/rados: new methods for manipulating self-managed snapshots
Jason Dillaman [Tue, 5 Jun 2018 18:48:17 +0000 (14:48 -0400)]
pybind/rados: new methods for manipulating self-managed snapshots

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 21538304d78df9f3b9f54a5b3c9b6b62fc3e6b48)
(cherry picked from commit 5bd343db3903d8aca45a40436a6dc240bdc1a0f3)

7 years agomon/OSDMonitor: enforce caps for all remaining pool ops
Jason Dillaman [Thu, 21 Jun 2018 01:30:47 +0000 (21:30 -0400)]
mon/OSDMonitor: enforce caps for all remaining pool ops

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 61c06200fe59996bba2bb65fc402207bc10fd459)
(cherry picked from commit fb4526690ccd29f1a03d3cd7e5484b9e2191b04b)

7 years agomon/OSDMonitor: enforce caps when creating/deleting unmanaged snapshots
Jason Dillaman [Tue, 5 Jun 2018 17:24:48 +0000 (13:24 -0400)]
mon/OSDMonitor: enforce caps when creating/deleting unmanaged snapshots

The entity will require write access to the OSD service or permission
for the synthetic "osd pool op unmanaged-snap" command.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 4972e054b32c8200600f27564d50d443e683153e)

Conflicts:
src/mon/OSDMonitor.cc: use 'bufferlist::begin' instead of 'bufferlist::cbegin'
(cherry picked from commit 3dfb23d036c068ec5166151ed63628738d68908a)

Conflicts:
src/mon/CMakeLists.txt: added 'OSDCap.cc'

7 years agoMerge pull request #22716 from liewegas/wip-24661-luminous
Alfredo Deza [Tue, 26 Jun 2018 15:02:07 +0000 (11:02 -0400)]
Merge pull request #22716 from liewegas/wip-24661-luminous

luminous: os/bluestore: don't store/use path_block.{db,wal} from meta

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.de>
7 years agoceph-volume util make chown links affect links as well as paths 22716/head
Alfredo Deza [Fri, 8 Jun 2018 12:54:07 +0000 (08:54 -0400)]
ceph-volume util make chown links affect links as well as paths

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7f79932f2c522da222a27c15182434914ca9a738)

7 years agoceph-volume lvm.activate chown bluestore symlinks
Alfredo Deza [Fri, 8 Jun 2018 12:57:54 +0000 (08:57 -0400)]
ceph-volume lvm.activate chown bluestore symlinks

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 2a0911d04cc1eeb19ea2e1d6069095f9e2af26fe)

7 years agoos/bluestore: make bad symlink target error messages more informative
Sage Weil [Fri, 8 Jun 2018 13:34:53 +0000 (08:34 -0500)]
os/bluestore: make bad symlink target error messages more informative

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit aea215103caf669c3e289cc07f978511d61f68b0)

7 years agoos/bluestore: don't store/use path_block.{db,wal} from meta
Sage Weil [Tue, 26 Jun 2018 11:39:17 +0000 (06:39 -0500)]
os/bluestore: don't store/use path_block.{db,wal} from meta

This reverts most of 8d07fa5ad0772b4d979dc10695d230074d1f1e69.

ceph-volume goes to great lengths to ensure that the symlinks in the
osd dir are accurate.  Having these values here is an opportunity to
get them out of sync.  And that can happen very easily if the initial
mkfs was performed using a /dev/sdX device name (which is unstable
across reboots).  Even after ceph-volume corrects the symlink, bluestore
will continue to use the stale device path.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit ef510e43f0ee14b49e99beed9ae8feda6db3429a)

# Conflicts:
# src/os/bluestore/BlueStore.cc

- add_block_device has an extra arg in newer code

7 years agoMerge pull request #21368 from smithfarm/wip-23675-luminous
Yuri Weinstein [Fri, 22 Jun 2018 16:25:45 +0000 (09:25 -0700)]
Merge pull request #21368 from smithfarm/wip-23675-luminous

luminous: qa/workunits/mon/test_mon_config_key.py fails on master

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #22115 from pdvian/wip-24048-luminous
Yuri Weinstein [Fri, 22 Jun 2018 16:24:59 +0000 (09:24 -0700)]
Merge pull request #22115 from pdvian/wip-24048-luminous

luminous: crush, osd: handle multiple parents properly when applying pg upmaps

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
7 years agoMerge pull request #22215 from tchaikov/luminous-24025
Yuri Weinstein [Fri, 22 Jun 2018 16:24:18 +0000 (09:24 -0700)]
Merge pull request #22215 from tchaikov/luminous-24025

luminous: cmake/modules/BuildRocksDB.cmake: enable compressions for rocksdb

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #22269 from xiaoxichen/backport_22243
Yuri Weinstein [Fri, 22 Jun 2018 16:23:50 +0000 (09:23 -0700)]
Merge pull request #22269 from xiaoxichen/backport_22243

luminous: mon/OSDMonitor: Respect paxos_propose_interval

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #22296 from tchaikov/luminous-24321
Yuri Weinstein [Fri, 22 Jun 2018 16:22:55 +0000 (09:22 -0700)]
Merge pull request #22296 from tchaikov/luminous-24321

luminous: qa: wait longer for osd to flush pg stats

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #22366 from b-ranto/wip-branto-mgr-luminous
Yuri Weinstein [Fri, 22 Jun 2018 16:22:16 +0000 (09:22 -0700)]
Merge pull request #22366 from b-ranto/wip-branto-mgr-luminous

luminous: Sync up ceph-mgr prometheus module

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
7 years agoMerge pull request #22650 from liewegas/wip-24319-luminous
Yuri Weinstein [Fri, 22 Jun 2018 00:30:03 +0000 (17:30 -0700)]
Merge pull request #22650 from liewegas/wip-24319-luminous

luminous: os/bluestore: fix SharedBlobSet refcounting race

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #22567 from pdvian/wip-24334-luminous
Yuri Weinstein [Fri, 22 Jun 2018 00:23:44 +0000 (17:23 -0700)]
Merge pull request #22567 from pdvian/wip-24334-luminous

luminous: ARMv8 feature detection broken, leading to illegal instruction crashes

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #22568 from pdvian/wip-24351-luminous
Yuri Weinstein [Fri, 22 Jun 2018 00:23:10 +0000 (17:23 -0700)]
Merge pull request #22568 from pdvian/wip-24351-luminous

luminous: slow mon ops from osd_failure

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
7 years agoMerge pull request #22381 from pdvian/wip-24258-luminous
Yuri Weinstein [Fri, 22 Jun 2018 00:21:11 +0000 (17:21 -0700)]
Merge pull request #22381 from pdvian/wip-24258-luminous

luminous: crush: fix device_class_clone for unpopulated/empty weight-sets

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #22391 from pdvian/wip-24290-luminous
Yuri Weinstein [Fri, 22 Jun 2018 00:20:37 +0000 (17:20 -0700)]
Merge pull request #22391 from pdvian/wip-24290-luminous

luminous: common: fix typo in rados bench write JSON output

Reviewed-by: Nathan Cutler <ncutler@suse.com>
7 years agoMerge pull request #22592 from pdvian/wip-24356-luminous
Yuri Weinstein [Fri, 22 Jun 2018 00:18:27 +0000 (17:18 -0700)]
Merge pull request #22592 from pdvian/wip-24356-luminous

luminous: osd: increase default hard pg limit

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoMerge pull request #22474 from yuriw/wip-yuriw-p2p-luminous
Josh Durgin [Thu, 21 Jun 2018 23:56:16 +0000 (16:56 -0700)]
Merge pull request #22474 from yuriw/wip-yuriw-p2p-luminous

qa/tests - added tag 12.2.5. to the mix and removed -x path as unneeded

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
7 years agoqa/tests - added tag 12.2.5. to the mix and removed -x path as unneeded 22474/head
Yuri Weinstein [Fri, 8 Jun 2018 14:53:37 +0000 (07:53 -0700)]
qa/tests - added tag 12.2.5. to the mix and removed -x path as unneeded

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
7 years agoMerge pull request #22641 from ceph/backport-luminous-22627
Alfredo Deza [Thu, 21 Jun 2018 13:58:13 +0000 (09:58 -0400)]
Merge pull request #22641 from ceph/backport-luminous-22627

luminous: lvm: when osd creation fails log the exception

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #22201 from batrick/i24185
Yuri Weinstein [Wed, 20 Jun 2018 19:58:52 +0000 (12:58 -0700)]
Merge pull request #22201 from batrick/i24185

luminous: client: anchor dentries for trimming to make cap traversal safe

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
7 years agoMerge pull request #22558 from pdvian/wip-24331-luminous
Yuri Weinstein [Wed, 20 Jun 2018 19:58:02 +0000 (12:58 -0700)]
Merge pull request #22558 from pdvian/wip-24331-luminous

luminous: mon/MDSMonitor: do not send redundant MDS health messages to cluster log

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoMerge pull request #22603 from batrick/i23792
Yuri Weinstein [Wed, 20 Jun 2018 19:57:35 +0000 (12:57 -0700)]
Merge pull request #22603 from batrick/i23792

luminous: MDSMonitor: crash after assigning standby-replay daemon in multifs setup

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
7 years agoqa/suites/rados/objecstore/backends/objectstore: capture coredumps 22650/head
Sage Weil [Mon, 18 Jun 2018 20:35:38 +0000 (15:35 -0500)]
qa/suites/rados/objecstore/backends/objectstore: capture coredumps

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 55f390d0eb0c96cc563190371a35c41f103eb662)

7 years agoos/bluestore: more debug output
Sage Weil [Fri, 15 Jun 2018 19:13:14 +0000 (14:13 -0500)]
os/bluestore: more debug output

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit fd3036d2e186eb0299785c43aefe6f2ce88f244d)

7 years agoos/bluestore: print cnode from _open_collections
Sage Weil [Thu, 14 Jun 2018 19:15:20 +0000 (14:15 -0500)]
os/bluestore: print cnode from _open_collections

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b308b6b1554b3203e02e64e3963ef4901274f23f)

7 years agoos/bluestore: print cnode on fsck
Sage Weil [Fri, 15 Jun 2018 15:41:25 +0000 (10:41 -0500)]
os/bluestore: print cnode on fsck

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f3c89ef6e7ce313a2eda2136be5181735e5684d8)

7 years agoqa/suites/rados/objecstore: preserve data dir for ceph_test_objecstore
Sage Weil [Wed, 13 Jun 2018 11:55:18 +0000 (06:55 -0500)]
qa/suites/rados/objecstore: preserve data dir for ceph_test_objecstore

If we fail, preserve the data directory.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 23dd6279bb518709b0719132d850c70b7fc554a8)

7 years agoos/bluestore: fix SharedBlobSet deregister race
Sage Weil [Sun, 10 Jun 2018 20:57:31 +0000 (15:57 -0500)]
os/bluestore: fix SharedBlobSet deregister race

In commit 8c8944b2c45ca9dc5b8fd4db1590e1d24206c0b3 we fixed one narrow race
and introduced a new (probably less narrow) one:

A: put shared blob foo, nref = 0, start removing self from set
B: open_shared_blob -> lookup gets nullptr (nref==null), creates a new shared blob
  B: takes lock, sets sb_map[sbid] = newblob
A: gets lock, erases sb_map[sbid]
B: open_shared_blob -> lookup gets null, creates another new shared blob

Fix by only removing the sb_map entry for the nref=0 sb if it still points
to us.  If it doesn't, that means some new blob has shown up in its place.

Fixes: http://tracker.ceph.com/issues/24319
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 345ea53bd30426d4e6159d0866497d5a8bf6f327)

7 years agoMerge pull request #22438 from pdvian/wip-24298-luminous
Yuri Weinstein [Wed, 20 Jun 2018 16:44:42 +0000 (09:44 -0700)]
Merge pull request #22438 from pdvian/wip-24298-luminous

luminous: rgw: fix 'copy part' without 'x-amz-copy-source-range' when compressi…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #22465 from pdvian/wip-24302-luminous
Yuri Weinstein [Wed, 20 Jun 2018 16:42:22 +0000 (09:42 -0700)]
Merge pull request #22465 from pdvian/wip-24302-luminous

luminous: rgw: Allow swift acls to be deleted.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #22541 from pdvian/wip-24314-luminous
Yuri Weinstein [Wed, 20 Jun 2018 16:41:57 +0000 (09:41 -0700)]
Merge pull request #22541 from pdvian/wip-24314-luminous

luminous: test/rgw: fix for bucket checkpoints

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agoMerge pull request #22551 from smithfarm/wip-24477-luminous
Yuri Weinstein [Wed, 20 Jun 2018 16:41:30 +0000 (09:41 -0700)]
Merge pull request #22551 from smithfarm/wip-24477-luminous

luminous: Bucket lifecycles stick around after buckets are deleted

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 years agolvm: when osd creation fails log the exception 22641/head
Andrew Schoen [Tue, 19 Jun 2018 19:34:57 +0000 (14:34 -0500)]
lvm: when osd creation fails log the exception

Fixes: http://tracker.ceph.com/issues/24456
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit d622dadef09a53d24c6a7b9119051594f8da1cae)

7 years agoclient: delay dentry trimming until after cap traversal 22201/head
Patrick Donnelly [Fri, 18 May 2018 00:06:52 +0000 (17:06 -0700)]
client: delay dentry trimming until after cap traversal

Fixes: http://tracker.ceph.com/issues/24137
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 9199179799b41d9534b27bcceefc1bc9f2763bac)

Conflicts:
    src/client/Client.cc

7 years agomon: respect standby_for_fscid when choosing standby replay mds 22603/head
Yan, Zheng [Thu, 19 Apr 2018 02:44:11 +0000 (10:44 +0800)]
mon: respect standby_for_fscid when choosing standby replay mds

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit e3a38e9e89577f54c8a52fa32b3e0d14fe8e7088)

7 years agomon: fix standby replay in multimds setup
Yan, Zheng [Thu, 19 Apr 2018 02:15:23 +0000 (10:15 +0800)]
mon: fix standby replay in multimds setup

The code should break loops for two level. otherwise, in multimds setup,
a standby mds may get assigned to standby replay multiple times. This
bug may cause monitor to crash.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Fixes: http://tracker.ceph.com/issues/23658
(cherry picked from commit 8d40e21de0a115cc92e4da04ec61a34ac59145e1)

7 years agoosd: increase default hard pg limit 22592/head
Josh Durgin [Wed, 23 May 2018 16:17:04 +0000 (09:17 -0700)]
osd: increase default hard pg limit

The hard limit was too easy to hit during failure cases, especially
due to mismatched device sizes causing high variance in pgs/osd.

Fixes: https://tracker.ceph.com/issues/24243
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
(cherry picked from commit dfdedce89521f89046fb13287d9fdd683c91e242)

7 years agomon/OSDMonitor: no_reply on MOSDFailure ops we eventually process 22568/head
Sage Weil [Sun, 27 May 2018 14:55:04 +0000 (09:55 -0500)]
mon/OSDMonitor: no_reply on MOSDFailure ops we eventually process

Failure ops get attached to the failure report.  Once we finally process
them, mark them no_reply so that the forwarding mon will know about it.
The other paths through prepare_failure() do no_reply on the messages
that don't get logged in the failure_info_t::reporters.

Fixes: http://tracker.ceph.com/issues/24322
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f6128e5b53cc8a6e1e97a66794806299c5190d3c)

7 years agomon/OSDMonitor: no_reply on ignored MOSDFailure
Sage Weil [Sun, 27 May 2018 14:49:37 +0000 (09:49 -0500)]
mon/OSDMonitor: no_reply on ignored MOSDFailure

If we are ignoring the message, tell the forwarding mon to discard it's
state.

Fixes: http://tracker.ceph.com/issues/24322
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 69d9599806bfb189cb99f97f430c1b3629e10cc5)

7 years agocommon/arch/arm: Improve CPU feature check. 22567/head
Adam Kupczyk [Thu, 24 May 2018 11:25:02 +0000 (13:25 +0200)]
common/arch/arm: Improve CPU feature check.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit d998580c7dbeff5ced5e9eb1e11d160a2a8d7852)

7 years agocommon/crc/aarch64: Added cpu feature pmull and make aarch64 specific crc function...
Adam Kupczyk [Wed, 23 May 2018 13:06:19 +0000 (15:06 +0200)]
common/crc/aarch64: Added cpu feature pmull and make aarch64 specific crc function to depend on it.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 90b1c1f1c4a57a59f598cd93dc9ce8a1532db238)

7 years agomon/MDSMonitor: do not send redundant MDS health messages to cluster log 22558/head
Sage Weil [Fri, 25 May 2018 16:42:49 +0000 (11:42 -0500)]
mon/MDSMonitor: do not send redundant MDS health messages to cluster log

Fixes: http://tracker.ceph.com/issues/24308
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit a2b6d9176e0ad786bf6fe4a0a6eb9ba51f1ce720)

7 years agoMerge pull request #22109 from tchaikov/luminous-24180
Yuri Weinstein [Wed, 13 Jun 2018 22:00:56 +0000 (15:00 -0700)]
Merge pull request #22109 from tchaikov/luminous-24180

luminous: mon/LogMonitor: call no_reply() on ignored log message

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #22290 from pdvian/wip-24216-luminous
Yuri Weinstein [Wed, 13 Jun 2018 22:00:19 +0000 (15:00 -0700)]
Merge pull request #22290 from pdvian/wip-24216-luminous

luminous: common: partially revert 95fc248 to make get_process_name work

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
7 years agoMerge pull request #22308 from pdvian/wip-24214-luminous
Yuri Weinstein [Wed, 13 Jun 2018 21:59:36 +0000 (14:59 -0700)]
Merge pull request #22308 from pdvian/wip-24214-luminous

luminous: Module 'balancer' has failed: could not find bucket -14

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoMerge pull request #22414 from wido/luminous-influx
Yuri Weinstein [Wed, 13 Jun 2018 21:59:14 +0000 (14:59 -0700)]
Merge pull request #22414 from wido/luminous-influx

luminous: backport various fixes to mgr/influx module

Reviewed-by: Sage Weil <sage@redhat.com>
7 years agoqa: test for trim_caps segfault for trimmed dentries
Patrick Donnelly [Fri, 18 May 2018 02:36:42 +0000 (19:36 -0700)]
qa: test for trim_caps segfault for trimmed dentries

Test case by Yan Zheng [1].

[1] http://tracker.ceph.com/issues/24137#note-6

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit abb2fa4d5bcba7ae7318c384cd10da348f68fd78)

7 years agorgw: add tenant to shard_id in RGWDeleteLC::execute() 22551/head
weiqiaomiao [Wed, 27 Jul 2016 00:58:33 +0000 (08:58 +0800)]
rgw: add tenant to shard_id in RGWDeleteLC::execute()

in RGWDeleteLC::execute(), we should add bucket.tenant to shard_id,
otherwise, the lc entry can't delete after this op

Signed-off-by: Wei Qiaomiao <wei.qiaomiao@zte.com.cn>
(cherry picked from commit 3e7cffb17ed6a473ecbcf8475a72dd2416e077f4)

Conflicts:
src/rgw/rgw_op.cc - luminous does not have 3e528f1ee837a09e1337283a2992e81a87f1bd98

7 years agotest/rgw: fix for bucket checkpoints 22541/head
Casey Bodley [Mon, 21 May 2018 14:42:06 +0000 (10:42 -0400)]
test/rgw: fix for bucket checkpoints

both zones must complete a checkpoint before comparing their bucket contents

Fixes: http://tracker.ceph.com/issues/24212
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 438dafcd1664cbb938f9dcc86c47afe982f43e68)

7 years agoMerge pull request #22530 from ceph/backport-luminous-22062
Alfredo Deza [Tue, 12 Jun 2018 14:40:35 +0000 (10:40 -0400)]
Merge pull request #22530 from ceph/backport-luminous-22062

luminous: ceph-volume dmcrypt and activate --all documentation updates

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agodoc/man/ceph-volume explain encryption and activate all with examples 22530/head
Alfredo Deza [Thu, 17 May 2018 13:40:15 +0000 (09:40 -0400)]
doc/man/ceph-volume explain encryption and activate all with examples

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0a4cebd1dda876cfc19fbfb97c668d4dae05097c)

7 years agodoc/ceph-volume activate is able to use --all for existing OSDs
Alfredo Deza [Thu, 17 May 2018 13:05:52 +0000 (09:05 -0400)]
doc/ceph-volume activate is able to use --all for existing OSDs

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit d8b9a7c0745d6a901988a08a8218d9da585e5aa8)

Conflicts:
doc/ceph-volume/lvm/activate.rst

7 years agodoc/ceph-volume encryption is enabled with the --dmcrypt flag
Alfredo Deza [Thu, 17 May 2018 12:46:03 +0000 (08:46 -0400)]
doc/ceph-volume encryption is enabled with the --dmcrypt flag

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 72cef7acf7a9a965960ec3c7c1b99ce8e7fa3922)

7 years agodoc/ceph-volume prepapre accepts a --dmcrypt flag
Alfredo Deza [Thu, 17 May 2018 12:45:26 +0000 (08:45 -0400)]
doc/ceph-volume prepapre accepts a --dmcrypt flag

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit e97d0717d323a08a46aa997c63d2416da7e4941f)

7 years agodoc/ceph-volume activate does not need a dmcrypt flag
Alfredo Deza [Thu, 17 May 2018 12:44:41 +0000 (08:44 -0400)]
doc/ceph-volume activate does not need a dmcrypt flag

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit ac0c925c576868107e585ba458fbff956467bccb)

7 years agoMerge pull request #22510 from ceph/backport-luminous-22399
Alfredo Deza [Tue, 12 Jun 2018 10:47:51 +0000 (06:47 -0400)]
Merge pull request #22510 from ceph/backport-luminous-22399

luminous: ceph-volume tests do not include admin keyring in OSD nodes

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #22506 from ceph/backport-luminous-22437
Alfredo Deza [Tue, 12 Jun 2018 10:45:36 +0000 (06:45 -0400)]
Merge pull request #22506 from ceph/backport-luminous-22437

luminous: ceph-volume tests destroy osds on monitor hosts

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agoMerge pull request #22513 from ceph/backport-luminous-21890
Alfredo Deza [Tue, 12 Jun 2018 10:44:54 +0000 (06:44 -0400)]
Merge pull request #22513 from ceph/backport-luminous-21890

luminous: ceph-volume describe better the options for migrating away from ceph-disk

Reviewed-by: Alfredo Deza <adeza@redhat.com>
7 years agodoc/rados add an anchor to reference replacing osds 22513/head
Alfredo Deza [Tue, 8 May 2018 17:48:20 +0000 (13:48 -0400)]
doc/rados add an anchor to reference replacing osds

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0cc7bdc67ae3f2b1aeab8cc6046b6d172915e548)

7 years agodoc/ceph-volume describe the options for migrating away from ceph-disk
Alfredo Deza [Tue, 8 May 2018 17:47:48 +0000 (13:47 -0400)]
doc/ceph-volume describe the options for migrating away from ceph-disk

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 537ff9cc3b64c59f9dbb81ac3cf180460ecaa3f3)

7 years agodoc/ceph-volume high-level description of simple activate at index.rst
Alfredo Deza [Tue, 8 May 2018 17:47:11 +0000 (13:47 -0400)]
doc/ceph-volume high-level description of simple activate at index.rst

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit dd6f368158db7f102b485179166ebe73d6ea622f)

7 years agoceph-volume tests do not include admin keyring in OSD nodes 22510/head
Alfredo Deza [Mon, 4 Jun 2018 20:01:15 +0000 (16:01 -0400)]
ceph-volume tests do not include admin keyring in OSD nodes

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 08760632743040520588e1bc03adc17746ff2eca)