mon/OSDMonitor: do not encode osdmap with MSG_ADDR2 until kraken flag is set

Signed-off-by: Sage Weil <sage@redhat.com>

cls_lock: encode client-facing addrs with client features

This struct goes back to the client, not to disk.  This was done
incorrectly in e40dd920dc2c3f685bb0ae6a0ecda6792afab18f.

Signed-off-by: Sage Weil <sage@redhat.com>

objclass: expose client features to cls ops

Signed-off-by: Sage Weil <sage@redhat.com>

message/MMonProbe: reencode monmap for non-addr2 clients

Signed-off-by: Sage Weil <sage@redhat.com>

message/MMonMap: reencode MonMap for old (non-addr2) clients

Signed-off-by: Sage Weil <sage@redhat.com>

messages/MMDSMap: reencode MDSMap for old (non-addr2) clients

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: parse ull args

Signed-off-by: Sage Weil <sage@redhat.com>

messages/MOSDMap: reencode if missing MSG_ADDR2 feature

Signed-off-by: Sage Weil <sage@redhat.com>

msg: set addr type when creating from scratch

Signed-off-by: Sage Weil <sage@redhat.com>

cls/lock: set test entity_addr_t types

Signed-off-by: Sage Weil <sage@redhat.com>

test/librbd/exclusive_lock: use entity_addr_t::parse, not inet_pton

Otherwise the entity_addr_t type doesn't get set.

Signed-off-by: Sage Weil <sage@redhat.com>

test_addrs: adding some addr unittest cases

Some unittest need a new constructor, add a
entity_addr_t(__u32 _type, __u32 _nonce).

Signed-off-by: Zhao Junwang <zhjwpku@gmail.com>

msg: add a decode_legacy_addr_after_marker helper

This can eliminates duplication between entity_addr_t::decode()
and entity_addrvec::decode().

Signed-off-by: Zhao Junwang <zhjwpku@gmail.com>

msg: add entity_addrvec_t

Signed-off-by: Zhao Junwang <zhjwpku@gmail.com>

msg/msg_types: add TYPE_MSGR2

Unused so far.

Signed-off-by: Sage Weil <sage@redhat.com>

msg/msg_types: add type accessors

Signed-off-by: Sage Weil <sage@redhat.com>

msg/msg_types: prefix addr with type; - for none

Previously entityt_addr_t() rendered as ":/0".  Now it is
"-".

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async: fix bind

Signed-off-by: Sage Weil <sage@redhat.com>

msg/simple: fix bind

Signed-off-by: Sage Weil <sage@redhat.com>

msg: change entity_addr_t encode/decode

Signed-off-by: Zhao Junwang <zhjwpku@gmail.com>

features: define the new ADDR2 feature

Signed-off-by: Zhao Junwang <zhjwpku@gmail.com>

msg: remove some useless 'break'

Signed-off-by: Zhao Junwang <zhjwpku@gmail.com>

msg/async: fix learned_addr

Signed-off-by: Sage Weil <sage@redhat.com>

msg/simple: fix learned_addr

There is a type in entity_addr_t that needs to get set
too.

Signed-off-by: Sage Weil <sage@redhat.com>

mon/OSDMonitor: health warn if require_{jewel,kraken} flags aren't set

We want to prompt users to set these flags as soon as their
upgrades complete.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11536 from liewegas/wip-fullbit-dump

mds: fix EMetaBlob::fullbit xattr dump

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #11533 from ifed01/wip-kstore-rmcoll-fix

os/kstore: rmcoll fix to satisfy store_test

Reviewed-by: Sage Weil <sage@redhat.com>

mds: fix EMetaBlob::fullbit xattr dump

- show xattr names!
- bound the values

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11525 from wjwithagen/wip-wjw-freebsd-getopt

tools/ceph-monstore-update-crush.sh: FreeBSD getopt is not compatible…

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11524 from wjin/filestore_perfcounter

os/filestore: clean filestore perfcounters

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11518 from umullan/uday

doc: fix broken links

Merge pull request #11522 from wjwithagen/wip-wjw-freebsd-readable.sh

FreeBSD:test/encoding/readable.sh": fix nproc and ls -v calls

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11528 from jcsp/wip-vstart-1osd

vstart: decrease pool size if <3 OSDs

Reviewed-by: Sage Weil <sage@redhat.com>

os/bluestore: proper set resulting pnext to avoid returning local var

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

os/kstore: fix KStore rm_coll handler to behave similar to bluestore one

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #10325 from snakeAngel2015/rgw-support-s3subuser

rgw: add suport for creating S3 type subuser of admin rest api
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

os/kstore: uniform Collection implementation with BlueStore one

Signed-off-by:Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #11481 from ddiss/cmake_rgw_deps

cmake: check WITH_RADOSGW for fcgi and expat dependencies

Reviewed-by: Kefu Chai <kchai@redhat.com>

vstart: decrease pool size if <3 OSDs

Makes it easy to do OSD=1 for e.g. doing cephfs
stuff where we don't care much about the OSDs
behaviour.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #10239 from weiqiaomiao/wqm-wip-setolh

rgw: should assign 'olh_bl" to state.attrset[RGW_ATTR_OLH_ID_TAG] instead of 'bl'
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #11324 from yehudasa/wip-14589

rgw: dump objects in RGWBucket::check_object_index()
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

tools/ceph-monstore-update-crush.sh: FreeBSD getopt is not compatible, use the one from packages

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #11432 from hansbogert/patch-3

doc: Update install-ceph-gateway.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>

Fixes: #17587
doc: Fixing the broken link which was refactored for authentication as part of other PR
Signed-off-by: uday udaymjl@gmail.com

os/filestore: clean filestore perfcounters

Move filestore perfcounters from objectstore to filestore itself
and change internal index name.

Signed-off-by: Wei Jin <wjin.cn@gmail.com>

Merge pull request #11027 from liewegas/wip-denc

fast denc encoding

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Allen Samuels <allen.samuels@sandisk.com>

Merge remote-tracking branch 'gh/kraken'

cmake: find GIT_VER variables if there is no .git dir

find CEPH_GIT_VER & CEPH_GIT_NICE_VER if there is no
ceph/.git dir by parsing ceph/src/.git_version.

scenario is for building from source tarballs generated
by make-dist, since make-dist generates .git_version
by running make_version, and then packs .git_version
into the tarball.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit c5c6b59f296f0ace3a6cfd939027118e82ab50a4)

Merge pull request #11502 from liewegas/wip-bluestore-keybug

os/bluestore: fix escaping of chars > 0x80

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

os/kstore: fix escaping of chars > 0x80 in keys

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: fix escaping of odd chars >0x80 in keys

Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_objectstore: test unprintable chars

Signed-off-by: Sage Weil <sage@redhat.com>

FreeBSD:test/encoding/readable.sh": fix nproc and ls -v calls

 Neither of these is available in FreeBSD.
 But sort -n is Posix, and does the same ATM.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #11521 from markhpc/wip-send_inline

msg/async: set ms_async_send_inline to false to improve small randread iops

Set ms_async_send_inline to false to improve small randread iops.

Signed-off-by: Mark Nelson <mnelson@redhat.com>

Merge pull request #11262 from jcsp/wip-17270-master

Revert "osdc: After write try merge bh."

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

11.0.2

Merge pull request #11211 from ceph/wip-no-recordlock-test

test: temporarily remove fork()ing flock tests

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Fixes: #17587
doc: Fixing the broken link which was refactored for authentication as part of other PR
Signed-off-by: uday udaymjl@gmail.com

Fixes: #17587
doc: Fixing the broken link which was refactored for authentication as part of other PR
Signed-off-by: uday udaymjl@gmail.com

Merge pull request #11440 from ceph/wip-jlayton-linkref

client: don't take extra target inode reference in ll_link

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #11421 from ceph/wip-jlayton-cephfs

Small pile of random cephfs fixes and cleanup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #11515 from badone/wip-find_best_info-typos

osd: Fix typos in PG::find_best_info

Reviewed-by: xiexingguo <xie.xingguo@zte.com.cn>

osd: Fix typos in PG::find_best_info

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #11513 from badone/clear_primary_state-typo

osd: fix typo in PG::clear_primary_state

Merge pull request #11514 from xiexingguo/xxg-wip-bluestore-1015

os/bluestore: formatting nits

Reviewed-by: Sage Weil <sage@redhat.com>

osd: fix typo in PG::clear_primary_state

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

buffer: make iterator copy to ptr handle len==0

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: fix * zero placement

Back in 46522cf0d27ad7d236f61bf132c915210754a0f4 we broke the newline
placement for the * lines.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: don't dump usage on every error

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: add hexdump command

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: do deep encode of onode

Avoid an inevitable rebuild() since we have to pass this to rocksdb as a
single memory buffer anyway.

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: add a 'deep' append mode

Do the copy up-front.  This is useful if we know our target buffer must
be a contiguous buffer (e.g., because it will be passed to a kv store).

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: log onode component sizes

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: contiguous_appender::get_logical_offset

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: write into page-aligned buffers from rocksdb

The BlueRocksEnv uses the append(const char *, size_t) appender.  Ensure
that this data is copied into a page-aligned buffer, and that we "pad" the
write out with the remainder of the page.

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: add page_aligned_appender

Signed-off-by: Sage Weil <sage@redhat.com>

unittest_bluefs: use append(const char*, size_t)

The bufferlist one is for internal use only.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: convert internal types to denc

Signed-off-by: Sage Weil <sage@redhat.com>

osd: denc_traits for osd_reqid_t

Signed-off-by: Sage Weil <sage@redhat.com>

msg/msg_types: denc_traits for entity_name_t

Signed-off-by: Sage Weil <sage@redhat.com>

include/interval_set: define denc_traits for interval_set<T>

Signed-off-by: Sage Weil <sage@redhat.com>

include/fs_types: conditional denc_traits for inodeno_t

Signed-off-by: Sage Weil <sage@redhat.com>

include/object: conditional denc_traits for snapid_t

Signed-off-by: Sage Weil <sage@redhat.com>

include/denc: _nohead variants for containers

Signed-off-by: Sage Weil <sage@redhat.com>

include/denc: new-style encoding framework

#include it from encoding.h so that we can make old STL container helpers
conditional on a new-style helper not being available.

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: implement bufferptr::iterator

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: implement bufferlist::contiguous_appender

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: fix whitespace

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: implement ptr::end_c_str()

Signed-off-by: Sage Weil <sage@redhat.com>

include/small_encoding: rewrite lowz in terms of generic varint

Signed-off-by: Sage Weil <sage@redhat.com>

include/small_encoding: rewrite small_{encode,decode}_signed_varint in terms of varint

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: add iterator copy_shallow() to ptr

If the length resides within the bufferlist's current ptr, return a ptr
to the same buffer.

Signed-off-by: Sage Weil <sage@redhat.com>

buffer: rename iterator copy() to copy_deep()

Current callers expect a deep copy; be explicit about it.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: use encode/decode functions instead of class methods

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: AuthMonitor::Incremental is featured

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: PGMap[::Incremental] requires features to encode

Signed-off-by: Sage Weil <sage@redhat.com>

declare encode/decode for various types that are missing it

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11443 from wjwithagen/wip-wjw-freebsd-cmake-options

do_freebsd.sh: Set options for debug building.

Reviewed-by: Kefu Chai <kchai@redhat.com>

./do_freebsd.sh: remove pipe to get correct return value

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>