rgw: temporarily use std::vector in place of static_vector of Boost.

We want to use boost::container::static_vector to avoid dynamic
memory allocations. However, Boost on some platforms we support
doesn't offer this container yet.

The patch can be safely reverted when we get modern enough Boost
on all our platforms.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: reuse the HTTP client of KeystoneService in RGWKeystoneAuthEngine.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw, optimization: reduce the overhead of RGWIdentityApplier::to_str().

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve error checking in Keystone-related code.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: cosmetic changes in the new auth infra.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw, optimization: switch from std::vector to std::array in auth infra.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: int -> uint32_t transition for perm and perm_mask.

This patch doesn't affect data structures. Changes were made
to the upper layers only. We rely there on the same assumption
like in case of req_state::perm_mask and RGWSubUser::perm_mask
that already are uint32_t. The assumption is presence of an
implicit conversion between int and uint32_t.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw, optimization: switch to std::string& when possible in the new auth.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw, cmake: remove rgw/rgw_swift.cc also from CMakeList.txt.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw, optimization: avoid extra allocations in RGWHTTPHeadersCollector.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw, optimization: RGWAuthEngine::get_name() returns const char*.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: switch from std::list to std::vector in rgw_acl_swift.{cc,h}.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw, optimization: further reduce allocations in RGWTempURLAuthEngine.

Also improve the accommodation of Matt Benjamin's changes in the new
TempURL infrastructure.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: reduce string copies in tempURL processing

Introduce a helper class encapsulating the temp URL HMAC computation,
and also save it for later computation.  Use the underlying HMACSHA1
implementation to compute the HMAC incrementally (saves a copy of all
the parameters).

Also avoid some other string copying in the logic prior to taking the
HMAC, in one case by remembering to use auto& in a std::map range-for
loop, and using boost::string_ref to share ReqState::request_uri and
conditionally suffix of same.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
Conflicts:
src/rgw/rgw_swift.cc

rgw: reuse ltstr_nocase in RGWHTTPHeadersCollector.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: the Keystone backend does support now Swift's cross-tenant ACLs.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: drop req_state::os_auth_token as it isn't neccessary anymore.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: implement to_str() over auth appliers.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: drop rgw_user_is_authenticated from rgw_user.{h,cc}.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: allow giving perms in Swift ACLs to an identity who don't have a local account.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: fix printing of Swift's bucket ACLs.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: add support for HTTP Referer-based ACLs of Swift API.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: ONLY refactor RGWAccessControlPolicy_SWIFT[Acct].

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: refactor rgw_acl_swift.h to not inject std namespace.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: use account ACL for request verification.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: add support for putting Swift account ACLs.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve code formatting ONLY.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: dump account ACLs in Swift responses.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: add basics for Swift Account ACLs.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve const-correctness of ACL-related code.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: eradicate rgw_swift.{h,cc}.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: eradicate rgw_swift_verify_signed_token.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: switch to the new auth infrastructure in rgw_rest_swift.cc

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: implement get_name() over RGWAuthEngine.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: introduce the Extractor concept to the auth infrastructure.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: implement Swift-specific authentication engines.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: implement RGWKeystoneAuthEngine.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: infrastructure for authentication engine-dependent ACL checks.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: share the ACL interpreter across multiple identity appliers.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: infrastructure for object-based Swift authentication.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: use RGWIdentityApplier across ACL implementation.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: enable management of admin privileges.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: decouple system user from admin user.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: split account owner from identity used for authorization.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: make use of RGWIdentityApplier as req_state::auth_identity.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: introduce RGWIdentityApplier for representing identities.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: remove get_keystone_{url,admin_token} from RGWSwift.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: switch from RGWSwift to KeystoneService admin_token/url.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: naturalize the transplanted get_keystone_{url,admin_token} in KeystoneService.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: ONLY move RGWSwift::get_keystone_{url,admin_token} to rgw_keystone.cc.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: rework handling of rgw_keystone_accepted_[admin_]roles.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: cosmetic for RGWKeystoneTokenCache::RevokeThread.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: RevokeThread is now a part of RGWKeystoneTokenCache.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: ONLY move parts of KeystoneRevokeThread's code to rgw/rgw_keystone.cc

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: implement singleton pattern over RGWKeystoneTokenCache.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: replace RGWPostHTTPData with RGW[Keystone]HTTPTransceiver.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve encapsulation and const-correctness in the RGWHTTPClient family.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: ONLY move RGWPostHTTPData's definitions to rgw_http_client.cc.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: ONLY move RGWPostHTTPData to rgw_http_client.h.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: implement RGWHTTPHeadersCollector.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: rgw_user can be now explicitly initialized with tenant and ID.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve const-correctness of rgw_open_cms_envelope.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve const-correctness of rgw_get_user_info_by_swift().

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve const-correctness of RGWHTTPArgs.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve const-correctness of KeystoneToken class.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: improve const-correctness of KeystoneToken.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

rgw: make rgw_get_user_info_by_uid to be const-correct.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Merge pull request #9037 from rzarzynski/wip-rgw-swift-quota

rgw: add support for account and container quotas of Swift API
Reviewed-by" Orit Wasserman <owasserm@redhat.com>

rgw: reuse populate_with_generic_attrs() across rgw_op.cc.Reviewed-by: Orit Wasserman <owasserm@redhat.com>

rgw: reuse populate_with_generic_attrs() across rgw_op.cc.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #9367 from Yan-waller/yj-wip-rgwfixhextobuf

rgw/common: fix error return value of hex_to_buf.
Reviewed by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #9438 from ceph/wip-cmake

cmake: rbd_mirror not linking rbd_test_mock

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9060 from mikulely/fix-rgw-multiste-doc

doc: fix rgw multiste config

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #9392 from yehudasa/wip-16072

rgw/rgw_common.cc: modify the end check in RGWHTTPArgs::sys_get

Tested-by: Orit Wasserman <owasserm@redhat.com>
http://pulpito.ceph.com/owasserm-2016-06-01_20:43:36-rgw:verify-wip-orit-testing---basic-mira/

cmake: rbd_mirror not linking rbd_test_mock

Added rbd_test_mock lib, also changed name of
journal_test to journal_test_mock to mimic
automake naming.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #9209 from yehudasa/wip-15939

rgw: aws4 fixes

verified

Merge pull request #9084 from dzafman/wip-dz-misc

Wip dz misc

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #9426 from linuxbox2/cmake-mds

cmake: change libmds back to a static library

Reviewed-by: Casey Bodley <cbodley@redhat.com>

cmake: restore static linkage (libmds)

Required by ceph-mds.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #9385 from ceph/wip-cmake-kefu

cmake: more fixes

fixes make install workflow

Merge pull request #9228 from liewegas/wip-bluestore-write

os/bluestore: new write path (checksums and compression)

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #9106 from SUSE/wip-15869

rpm: unconditionally set ceph user's primary group to ceph (SUSE)

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

cmake: install cython modules

* fix CYTHON_ADD_MODULE() macro. because python_add_module() offered by
  FindPythonLibs.cmake creates a target with name of ${name}, which conflicts
  with existing targets like "rbd" or "rados". so we can not reuse the
  name in ${name}.pyx. and instead, we should specify the target name
  explicitly.
* add distutils_install_cython_module() function to build and install
  cython modules.
* we can split build and install of cython module, but the install phase
  always tries to build the module. so keep it this way. will look at it
  later on.
* move the variables initializations into the Distutils.cmake module.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: install compressor plugins into ${pkglibdir/compressor

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: install erasure plugins into ${pkglibdir}/erasure-code

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: remove duplicated file from ceph-osd

objclass/class_api.cc is already included in libosd

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: fix dependencies on tracing headers

group the header dependencies by its tp .so, so the traced target can
depend on them by the name of ${name}-tp.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: libradosstriper's OUTPUT_NAME should be radosstriper

and s/libradosstriper/radosstriper/ otherwise the created .so
filename would be liblibradosstriper.so with the default prefix.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: install the artifacts the packaging requires

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: install init script to etc/init.d

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: add the autoconf path variables back

* partially revert 7a602ec.
* the directory variables created by automake, like "prefix", "bindir",
  and "libdir", are used for generating configuration_file() for substitution,
  and they should have the same names with ones from autotools.
* also fix the ${pkglibdir}, it should be the ${libdir}/${PACKAGE}. so
  the plugins are not installed into ${libdir}, in which the installed shared
  objects are supposed to be shared with other applications.
* install shared libraries into ${CMAKE_INSTALL_LIBDIR} instead of
  ${prefix}/lib. this complies to what ceph.spec.in requires:
  ceph.spec.in expects the shared libraries to be installed into
  ${_libdir}, and ${_libdir} is /usr/lib64 on an amd64 machine.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: install ceph-post-file

and related pubkey for sftp

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: add ceph-brag

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: project name should be "ceph"

so it would be easier to figure out paths, also
CMAKE_INSTALL_DOCDIR is composed using the PROJECT_NAME also.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: install ceph-{detect-init,disk}

add a cmake module named Distutils.cmake for setting up python modules
using setup.py.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: add ceph_rgw_{json,multi}parser

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: compile and install ceph-bluefs-tool

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: s/ceph_test_xattr_bench/ceph_xattr_bench/

to match with automake and packager

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: rename ceph-psim to ceph_psim

to match with automake and packager

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: fix bash_completion install path

Signed-off-by: Kefu Chai <kchai@redhat.com>

os/bluestore: fsck: check for dup overlay keys

Signed-off-by: Sage Weil <sage@redhat.com>