client: quit on failed remount during dentry invalidate test

Fixes: http://tracker.ceph.com/issues/22269
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 5b2b1d14468c290c56ee6c95ea557c99464e0098)

Conflicts:
  PendingReleaseNotes: trivial conflict
src/ceph_fuse.cc
src/client/Client.cc: i chosed to pick code from 5b2b1d1 because, to fixthe issue, we need to call _do_remount which was introduced in 5b2b1d1.

Merge pull request #20213 from dillaman/wip-21868-luminous

luminous: doc/rbd: tweaks for the LIO iSCSI gateway

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc/rbd: tweaks to the Windows iSCSI initiator directions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 997bb80ba231c4a21237485ac6780d573be992c2)

doc: Added CHAP cofiguration instructions for iSCSI

Added details to specify the CHAP username and password while
discovering/login the iSCSI target.

Signed-off-by: Ashish Singh <assingh@redhat.com>
(cherry picked from commit 2a5755e0767108aefa6ccfb8a85e5d63e8c04fe8)

doc: fix ceph-iscsi-config version number

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 3ab71020a5e420a333cb4a6b0be67ade185c1593)

doc: add ceph iscsi test kernel info

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 5c30318660eebc882326d87eec39b4fbe4cc85d7)

doc: add rbd pool requirement for gwcli

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit b56d994f3addcd9c6a7848dec9be93568cdb2d0e)

doc: add daemon-reload for rbd-target-api setup

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 4ca0d508bb9b68c791abc5799d0195f4baace455)

doc: add gwcli manual install instructions

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit f45aafed1c7a5393e712f9fbfd7479fc444ad3d8)

doc: separate gwcli install from post install setup steps

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit f80f083d0a982d7e89c77e3a6f8d71c2871a8f2c)

doc: add note to clarify trusted_ip_list use

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 3cc367dc6ebca18e884d7c75d2cd1fa7907b7139)

doc: update esx instructions

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 3806f9750d29c6d930a7c8a003902e79b99766f6)

Conflicts:
doc/rbd/iscsi-initiator-esx.rst: trivial resolution

doc: add warning about SCSI PGRs/reservations

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 62661a2e23ce98432f3c037fa9a8155a633ee182)

doc: add esx web based client images

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 78e12135eeb5829cad65cebd3c2be9df4d582b1f)

doc: remove windows based vsphere client images

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 426b562fdc1b373b72de2d69c4851be22ec12008)

doc: fix gwcli examples

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit 480f6a82a2b9dcd0179951ea16432d8d32f2c96d)

doc: Update ceph iscsi kernel/distro requirements.

Signed-off-by: Mike Christie <mchristi@redhat.com>
(cherry picked from commit f436e993d359dfdad26b7d569d555a3b3a5b798d)

doc/rbd: tweaks for the LIO iSCSI gateway

Fixes: http://tracker.ceph.com/issues/21763
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 4f227e108d40271d5d6b2b1e88659d86cbc6c914)

Merge pull request #19555 from shinobu-x/wip-22455-luminous

 luminous: balancer crush-compat sends "foo" command

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20156 from pdvian/wip-22811-luminous

luminous: mon: fix mgr using auth_client_required policy

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19481 from jan--f/wip-22421-luminous

luminous: mon: reenable timer to send digest when paxos is temporarily inactive

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19553 from shinobu-x/wip-22453-luminous

 luminous: mgr/balancer/upmap_max_iterations must be cast to integer

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19624 from shinobu-x/wip-22496-luminous

 luminous: KeyError: ('name',) in balancer rm

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19834 from pdvian/wip-22585-luminous

luminous: pybind/mgr/prometheus: fix metric type undef -> untyped

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20084 from pdvian/wip-22760-luminous

luminous: mgr: prometheus: added osd commit/apply latency metrics (#22718).

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20089 from pdvian/wip-22768-luminous

luminous: mgr: disconnect unregistered service daemon when report received

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20182 from jcsp/wip-22831

luminous: pybind/mgr/dashboard: fix reverse proxy support

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #17869 from smithfarm/wip-21479-luminous

luminous: mgr: Services reported with blank hostname

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>

Merge pull request #18832 from shinobu-x/wip-22075-luminous

luminous: mgr tests don't indicate failure if exception thrown from serve()

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #18842 from shinobu-x/wip-21863-luminous

luminous: ceph-conf: dump parsed config in plain text or as json

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #19002 from tchaikov/wip-pr-18976-luminous

luminous: udev: Fix typo in udev OSD rules file

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #19023 from pdvian/wip-22164-luminous

luminous: cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: 'NoneType' object has no attribute 'iteritems'" in cluster log

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19031 from pdvian/wip-22167-luminous

luminous: Various odd clog messages for mons

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19039 from jan--f/wip-22199-luminous

luminous: tools/crushtool: skip device id if no name exists

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #19046 from shinobu-x/wip-22189-luminous

luminous: osdc/Objecter: objecter op_send_bytes perf counter always 0

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #19059 from pdvian/wip-22176-luminous

luminous: osd: subscribe osdmaps if any pending pgs

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #19083 from smithfarm/wip-22213-luminous

luminous: On pg repair the primary is not favored as was intended

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #19084 from shinobu-x/wip-22216-luminous

 luminous: "osd status" command exception if OSD not in pgmap stats

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19118 from tangwenjun3/wip-backport-19030

luminous: os/bluestore: fix the allocate in bluefs

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Shinobu Kinjo <skinjo@redhat.com>

Merge pull request #19133 from smithfarm/wip-22194-luminous

luminous: Default kernel.pid_max is easily exceeded during recovery on high OSD-count system

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>

Merge pull request #19631 from shinobu-x/wip-22509-luminous

 luminous: osd: "sudo cp /var/lib/ceph/osd/ceph-0/fsid ..." fails

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #19839 from tchaikov/wip-22558-luminous

luminous: rpm: adjust ceph-{osdomap,kvstore,monstore}-tool feature move

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #18838 from shinobu-x/wip-21973-luminous

luminous: [test] UpdateFeatures RPC message should be included in test_notify.py

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #18840 from shinobu-x/wip-21970-luminous

luminous: [journal] tags are not being expired if no other clients are registered

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #18949 from jcsp/wip-luminous-rgw-config-desc

luminous: options.cc: document rgw config options

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #19051 from shinobu-x/wip-22185-luminous

luminous: rbd: abort in listing mapped nbd devices when running in a container

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

pybind/mgr/dashboard: fix reverse proxy support

This fixes http redirection for reverse http proxies

Fixes: http://tracker.ceph.com/issues/22557
Signed-off-by: Nick Erdmann <n@nirf.de>
(cherry picked from commit 95e1963cb5327f0699081c4c4b0b355d109ff0e3)

pybind/mgr: fix typo

Signed-off-by: Nick Erdmann <n@nirf.de>
(cherry picked from commit fdd64bb2dac33085b47c737032a525d89319c866)

pybind/mgr/mgr_module: add default param for MgrStandbyModule.get_config()

this matches its counterpart of MgrModule.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit bc7de8b124c32a2ee6910a3bac6a06f1c566a2ac)

Merge pull request #20062 from cbodley/wip-luminous-rgw-bilog-trim

luminous: rgw multisite: automated trimming for bucket index logs

Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #19848 from cbodley/wip-luminous-boost-166

luminous: backport beast frontend and boost 1.66 update

Merge pull request #19500 from shinobu-x/wip-22401-luminous

luminous: rgw: make HTTP dechunking compatible with Amazon S3

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #17816 from smithfarm/wip-hadoop-s3a

luminous: tests: qa/rgw: hadoop-s3a suite targets centos_latest

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>

Merge pull request #18972 from linuxbox2/luminous-22084

luminous: rgw: Fix swift object expiry not deleting objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #19086 from shinobu-x/wip-22210-luminous

luminous: radosgw-admin zonegroup get and zone get should return defaults when there is no realm

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #19088 from pdvian/wip-22177-luminous

luminous: rgw: check going_down() when lifecycle processing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>

Merge pull request #19636 from shinobu-x/wip-22506-luminous

luminous: rgw usage trim only trims a few entries

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #19784 from linuxbox2/luminous-20201

luminous: RGW: S3 POST policy should not require Content-Type

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

Merge pull request #19799 from smithfarm/wip-22581-luminous

luminous: rgw: multisite: 'radosgw-admin sync error list' contains temporary EBUSY errors

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #19867 from smithfarm/wip-22591-luminous

luminous: rgw: refuses upload when Content-Type missing from POST policy

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20051 from ceph/revert-19538-wip-22434-luminous

Revert "luminous: rgw: user stats increased after bucket reshard"

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20056 from linuxbox2/luminous-rgw-latchfix

luminous: rgw_file: alternate fix deadlock on lru eviction

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20073 from smithfarm/wip-22767-luminous

luminous: rgw: librgw: fix shutdown error with resources uncleaned

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20075 from smithfarm/wip-22773-luminous

luminous: rgw: file deadlock on lru evicting

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>

Merge pull request #20107 from dreamhost/wip-22792

luminous: rgw: When a system object is created exclusively, do not distribute the

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr: apply auth_service_required to client conns

Previously was using auth_cluster_required for all
connections, which meant that if someone had
disabled client cephx, they'd get BADAUTHORIZER
from their CLI when it tried to load mgr
command descriptions.

Disabling cephx on the admin CLI is odd, but the mon
tolerates it so the mgr should too.

Fixes: https://tracker.ceph.com/issues/22096
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 86ee30c33a06a13e6bb360b80dd1e41ba928147b)

mon: fix mgr using auth_client_required policy

This caused mgr daemons to fail to authenticate
when auth_client_required was set to something
different to auth_cluster_required.

Fixes: https://tracker.ceph.com/issues/22096
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 1e06fe003e50d360b5c5ce9824bba044b6406ec5)

osd: Scrub of object with only object error(s) are not logged

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 1ad05b1068ddd5d3312af45af1a60587200ddcd7)

osd: Primary shard needs to be at the front to be preferred

Caused by: cd0d8b0714d8684cf61b4650e170027ef46f489b

Fixes: http://tracker.ceph.com/issues/21907
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit b7d2f27da1a68046a688749f95093a88e6362b28)

ceph-osdomap-tool: Add compact comand option

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit b1f397f4fc3313ee0325722156759bfe32286c6b)

osd: Fixes for mark_unfound_lost

Let recovery requeue operations and release backoff
For "delete" mark object context, if present, to non-existent

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 0c106f1a46815bb769e7a503b1adb265480b6779)

ceph-objectstore-tool: Fix debug output

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 090c773fc9b7f3316ed88edd24b85a703224ddc5)

test: Remove bogus check in ceph_objectstore_tool.py

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit f918b1fac1f3cdb4cf316fb4c7afc90de49ce06e)

Merge pull request #20136 from dillaman/wip-22815-luminous

luminous: qa/workunits/rbd: switch devstack to pike release

Reviewed-by: Mykola Golub <mgolub@suse.com>

qa/workunits/rbd: switch devstack to pike release

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 7ff1e0bc2193acd009a74db81cf8e8cc8639ad12)

Merge pull request #19105 from batrick/i22228

luminous: client: anchor Inode while trimming caps

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>

Merge pull request #19360 from ukernel/luminous-22219

luminous: mds: ignore export pin for unlinked directory

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #19646 from pdvian/wip-22503-luminous

luminous: mds: properly eval locks after importing inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20055 from dzafman/wip-22724

luminous: miscounting degraded objects and PG stuck in recovery_unfound

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge branch 'luminous' into wip-22724

Merge pull request #20081 from dzafman/wip-recovering-luminous

luminous: osd/ReplicatedPG.cc: recover_replicas: object added to missing set for backfill, but is not in recovering, error!

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #18008 from ukernel/luminous-21584

luminous: mds: fix CDir::log_mark_dirty()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #18782 from ukernel/luminous-21985

luminous: mds: fix MDS_FEATURE_INCOMPAT_FILE_LAYOUT_V2 definition

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #18783 from ukernel/luminous-21975

luminous: mds: trim 'N' log segments according to how many log segments are there

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #18831 from shinobu-x/wip-22076-luminous

luminous: cephfs: "ceph tell mds" commands result in "File exists" errors on client admin socket

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #18835 from shinobu-x/wip-22074-luminous

luminous: mds: don't check gid when none specified in auth caps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #18869 from shinobu-x/wip-21952-luminous

luminous: mds: no assertion on inode being purging in find_ino_peers()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #18871 from shinobu-x/wip-21947-luminous

luminous: mds: preserve order of requests during recovery of multimds cluster

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #18912 from shinobu-x/wip-22077-luminous

luminous: src/mds/MDCache.cc: 7421: FAILED assert(CInode::count() == inode_map.size() + snap_inode_map.size())

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #19055 from shinobu-x/wip-22192-luminous

luminous: MDSMonitor: monitor gives constant "is now active in filesystem cephfs as rank" cluster log info messages

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #19326 from ukernel/luminous-22263

luminous: mds: handle client reconnect gather race

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #19480 from smithfarm/wip-22407-luminous

luminous: cephfs: client: implement delegation support in userland cephfs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge pull request #19775 from ukernel/luminous-19578

luminous: mds: track dirty dentries in separate list

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #19827 from pdvian/wip-22587-luminous

luminous: mds: reduce debugging level for balancer messages

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>

Merge pull request #20082 from smithfarm/wip-21525-luminous

luminous: cephfs: client: dual client segfault with racing ceph_shutdown

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20085 from pdvian/wip-22763-luminous

luminous: cephfs-journal-tool: add "set pool_id" option

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20086 from pdvian/wip-22765-luminous

luminous: client: avoid recursive lock in ll_get_vino

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

qa/rgw: hadoop suite targets centos_latest

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit a97d5bea42a40909aa4e9672505b9ad994cec184)

Conflicts:
    qa/suites/rgw/hadoop-s3a/s3a-hadoop.yaml (changes already backported
        via 6b5f212b9170dbd99779527b41be233b9d40b5e4)

qa/rgw: use overrides for hadoop version

instead of having two separate tasks, add v27.yaml and v28.yaml with
overrides for hadoop_version

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4a953a16d7b80d343899de39a8cf55dc761847de)

Merge pull request #18019 from ukernel/luminous-21091

luminous: mds: fix StrayManager::truncate()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>