test: add TestSessionFilter

Tests for SessionFilter, the class filters
allows session listing and eviction in the
new MDS tell commands.

Signed-off-by: John Spray <john.spray@redhat.com>

mds: implement filtered "session ls" tell command

So that one can efficiently query client session
state remotely.

Signed-off-by: John Spray <john.spray@redhat.com>

mds: call through to MDSRank in handle_command

...so that we can implement things like
session ls in MDSRankDispatcher.

Signed-off-by: John Spray <john.spray@redhat.com>

mds: add auth_name to session_info_t

Record the name of the entity who's authorisation
credentials were used during connection.  This
allows us to refer to it later when listing or
evicting sessions, for the user's benefit.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge remote-tracking branch 'gh/infernalis'

mon: fix msg leak in resend_routed_requests

MForward takes its own ref so we can drop ours.

Signed-off-by: Sage Weil <sage@redhat.com>

Mon: Fix decoded message leak when this monitor is leader

Fix #13109
Signed-off-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6139 from liewegas/wip-13283

librados: add FULL_TRY flag; EDQUOT != ENOSPC

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

librados: document new flag

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #6169 from rzarzynski/wip-13326

rgw: improve handling of already removed buckets in object expirer.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #6168 from SUSE/wip-13333-infernalis

ceph.spec.in: correctly declare systemd dependency for SLE/openSUSE

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

ceph.spec.in: correctly declare systemd dependency for SLE/openSUSE

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 7b1882f87509092380d11ec68b504a7bc1f77830)

osd/ReplicatedPG: exempt MDS from the failsafe check, too

This mimics the prior behavior.  We probably want to change this at some
point!

Signed-off-by: Sage Weil <sage@redhat.com>

rgw: improve handling of already removed buckets in object expirer.

Fixes: #13326
Backport: infernalis
Signed-off-by: Radoslaw Zarzynski <rzarzynski@github.com>

Merge pull request #5907 from dachary/wip-release-notes

release-notes: draft v0.94.4 release notes

Reviewed-by: Sage Weil <sage@redhat.com>

release-notes: draft v0.94.4 release notes

Signed-off-by: Loic Dachary <ldachary@redhat.com>

tools: ceph-release-notes handle multiple issues

* handle the case where a single pull request is associated with
  multiple pull requests
* encapsulate the quest for the original in a function for easier
  maintenance
* add the --verbose flag for debugging

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6096 from liewegas/wip-13260

osd/ReplicatedPG: preserve (some) flags when proxying reads

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #6107 from liewegas/wip-13206

osd: init started to 0

Merge pull request #6136 from liewegas/wip-13114

osd/librados: fix notify completion race

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #6137 from SUSE/wip-13324-infernalis

install-deps.sh: use %bcond_with selinux on SLE/openSUSE

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge remote-tracking branch 'jdurgin/wip-13281' into infernalis

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

install-deps.sh: use %bcond_with selinux on SLE/openSUSE

http://tracker.ceph.com/issues/13324 Fixes: #13324

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph_test_rados_api_aio: test pool full gets EDQUOT when FULL_TRY flag is set

Signed-off-by: Sage Weil <sage@redhat.com>

librados: expose OPERATION_FULL_TRY flag

Allow librados users to opt to receive ENOSPC or EDQUOT when they submit
an operation against a full cluster.  This should only be used if the
librados app can handle those errors gracefully (librbd, for example,
cannot).

Also note that this allows savvy librados users to send delete operations;
they will get either a success or EDQUOT, depending on whether the
operation results in a net drop in space utilization.

Signed-off-by: Sage Weil <sage@redhat.com>

osd: return -EDQUOT instead of -ENOSPC if it is a pool quota

The pool quota error should return EDQUOT intead of ENOSPC.

Signed-off-by: Sage Weil <sage@redhat.com>

osdc/Objecter: distinguish between multiple notify completions

We may send a notify to the cluster multiple times due to OSDMap
changes.  In some cases, earlier notify attempts may complete with
an error, while later attempts succeed.  We need to only pay
attention to the most-recently send notify's completion.

Do this by making note of the notify_id in the initial ACK (only
present when talking to newer OSDs).  When we get a notify
completion, match it against our expected notify_id (if we have
one) or else discard it.

This is important because in some cases an early notify completion
may be an error while a later one succeeds.

Note that if we are talking to an old cluster we will simply not record a
notify_id and our behavior will be the same as before (we will trust any
notify completion we get).

Fixes: #13114
Signed-off-by: Sage Weil <sage@redhat.com>

osd: reply to notify request with our unique notify_id

The OSD assigns a unique ID to each notify it queues for
processing.  Include this in the reply to the notifier so that
they can match it up with the eventual completions they receive.

This is necessary to distinguish between multiple completions
they may receive if there is PG peering and the notify is resent.
In particular, an earlier notify may return an error when a later
attempt succeeds.

This is forwards and backwards compatible: new clients will make use of
this reply payload but older clients ignore it.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge remote-tracking branch 'gh/infernalis'

Merge branch 'wip-mdscap'

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #6114 from SUSE/wip-suse-spec-fixes

ceph.spec.in: correctly declare systemd dependency for SLE/openSUSE

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #6134 from SUSE/wip-13318-infernalis

install-deps.sh: openSUSE-release/sles-release/sled-release are always present

install-deps.sh: openSUSE-release/sles-release/sled-release are always present

http://tracker.ceph.com/issues/13318 Fixes: #13318

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph_test_libcephfs: remove remaining pool name assumptions

Signed-off-by: Sage Weil <sage@redhat.com>

client: clarify setattr forced sync behavior

Signed-off-by: Sage Weil <sage@redhat.com>

qa/workunits/fs/test_auth_caps: superceded by ceph_test_libcephfs

Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_libcephfs: fix LibCephFS.OpenLayout test

We can't make assumptions about the name of the data pool.

Signed-off-by: Sage Weil <sage@redhat.com>

unittest_mds_authcap: improve user tests

Signed-off-by: Sage Weil <sage@redhat.com>

mds: drop MAY_CREATE

The check is a no-op.  We already verify the uid/gid combo is valid and
that the dir is writeable with MAY_WRITE.  The new file is always set to
the caller uid:gid.

Signed-off-by: Sage Weil <sage@redhat.com>

mds/MDSAuthCap: verify the caller_gid is valid

Verify both the caller uid and gid are a match for the given rule.

Signed-off-by: Sage Weil <sage@redhat.com>

mds: fix chown/chgrp check and tests

Signed-off-by: Sage Weil <sage@redhat.com>

mds/MDSAuthCaps: rename args for is_capable

Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_libcephfs: add AccessTest.User

Covers read/write/create.

Signed-off-by: Sage Weil <sage@redhat.com>

mds/SessionMap: fix MAY_CREATE check

It's about caller_uid/gid.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_libcephfs: make foo, path tests use unique paths, users

Signed-off-by: Sage Weil <sage@redhat.com>

qa/workunits: drop bash path tests

ceph_test_libcephfs ones are better.

Signed-off-by: Sage Weil <sage@redhat.com>

mds/SessionMap: fix check_access for stray inodes

Signed-off-by: Sage Weil <sage@redhat.com>

mds/SessionMap: move Session method definitions together

Signed-off-by: Sage Weil <sage@redhat.com>

mds/Locker: do not ack from do_cap_update

Caller (handle_client_caps) already does it if we return
false.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_libcephfs: fix update-after-unlink test

This needs to be done with a user restricted to a path.

Signed-off-by: Sage Weil <sage@redhat.com>

mds/Server: skip auth check on session-less mdr's

The mds internal requests don't have a session.

Signed-off-by: Sage Weil <sage@redhat.com>

client: do sync setattr when caller != last cap dirtier

This way we can still do cap writeback in general when the caller is not
the same as the mount_uid/gid, but we flip to a sync setattr when we have
to because the dirty caps have a different uid/gid than the current
caller.

Signed-off-by: Sage Weil <sage@redhat.com>

client: consolidate client_mount_{uid,gid} and client_{user,group}_id options

Signed-off-by: Sage Weil <sage@redhat.com>

client: add get_{uid,gid} helpers for consistent uid/gids

Signed-off-by: Sage Weil <sage@redhat.com>

add caps_dirty to setattr

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>

unittest_mds_authcaps: fix a few unit tests

The MAY_CREATE conditoin is simple: the created inode must match the caller
uid and gid.

Signed-off-by: Sage Weil <sage@redhat.com>

fix test_path_caps

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

doc:fix path-based restriction

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

test/libcephfs/access: add update_after_unlink test

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

test/libcephfs/access: add ReadOnly restriction test

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

test/libcephfs/access: add Path restriction test

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

client/Client: added client_mount_uid and gid as parameters to getattr call

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>

mds/MDSAuthCap: fix creation ownership check

Check uid too.

Signed-off-by: Sage Weil <sage@redhat.com>

mds/MDSAuthCaps: whitespace

Signed-off-by: Sage Weil <sage@redhat.com>

mds/MDSAuthCaps: only verify create git when not AUTH_UID_ANY

Signed-off-by: Sage Weil <sage@redhat.com>

mds: send cap flush ack even when access check failed.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

client: force setattr to MDS when caller's {uid,gid} are not the specified ones

Signed-off-by: Yan, Zheng <zyan@redhat.com>

client: allow specifying default caller_{uid,gid} of MClientRequest

Signed-off-by: Yan, Zheng <zyan@redhat.com>

client: add options to specify caller_{uid,gid} of MClientCaps

Signed-off-by: Yan, Zheng <zyan@redhat.com>

messages: add caller_{uid,gid} to cap msgs

Signed-off-by: Yan, Zheng <zyan@redhat.com>

test/libcephfs/access: expand example test a bit

Signed-off-by: Sage Weil <sage@redhat.com>

mds/Server: fix check_access

Pass through correct mask.  Clean up formatting.

Signed-off-by: Sage Weil <sage@redhat.com>

client: properly set caller_{uid,gid} of readdir request

save uid/gid of ll_opendir caller in dir_result_t, use the saved
uid/gid for readdir request.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

ceph_test_libcephfs: skeleton for access tests

Signed-off-by: Sage Weil <sage@redhat.com>

mds: fix Server::check_access

Signed-off-by: Yan, Zheng <zyan@redhat.com>

doc/cephfs: path-based restriction

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add check_access in _do_cap_update

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

move _check_access to SessionMap

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add _check_access for async cap updates

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add stray_prior_path for is_stray

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add stray_prior_path to store path before rename

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

mds/MDSAuthCaps: add test cases for is_capable

mds/Server: add chown and chgrp check access to setattr

mds/Server: add create access check for openc

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>

Server: add create access check for mknod and symlink

test_auth_caps: add mkdir check with mode 557

test_auth_caps: resolve bug with other bits test case

test_auth_caps: remove grp mount

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>

MDSAuthCaps: validate create access

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>

add stray_prior_path to store path before unlink

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add open check_access

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add link check_access

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add rename check_access

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add snaps(ls,mk,rm,rename) check_access

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add setlayout, setdirlayout, setxattr check_access

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

add readdir check_access

Signed-off-by: Jashan Kamboj <jashank42@gmail.com>

mds/Server: clean up check_access a bit

Signed-off-by: Sage Weil <sage@redhat.com>

MDSAuthCaps: add logic for group bits check

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>

test_auth_caps: add test for user bits

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>

mds/MDSAuthCaps: add permissions for user bits

Signed-off-by: Nishtha Rai <nishtha3rai@gmail.com>