]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoMerge pull request #32167 from rzarzynski/wip-fips-zeroize-memset_bzero_nautilus
Neha Ojha [Mon, 13 Jan 2020 17:45:45 +0000 (09:45 -0800)]
Merge pull request #32167 from rzarzynski/wip-fips-zeroize-memset_bzero_nautilus

nautilus: common: FIPS: audit and switch some memset & bzero users

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31332 from joscollin/wip-41182-nautilus
Yuri Weinstein [Mon, 13 Jan 2020 16:29:07 +0000 (08:29 -0800)]
Merge pull request #31332 from joscollin/wip-41182-nautilus

nautilus: mgr/volumes: fs subvolume resize command

5 years agoMerge pull request #31302 from smithfarm/wip-42142-nautilus
Yuri Weinstein [Mon, 13 Jan 2020 16:28:18 +0000 (08:28 -0800)]
Merge pull request #31302 from smithfarm/wip-42142-nautilus

nautilus: mds: split the dir if the op makes it oversized, because some ops maybe in flight

5 years agoMerge pull request #31084 from smithfarm/wip-42424-nautilus
Yuri Weinstein [Mon, 13 Jan 2020 16:27:47 +0000 (08:27 -0800)]
Merge pull request #31084 from smithfarm/wip-42424-nautilus

nautilus: tests: whitelist "Error recovering journal" for cephfs-data-scan

5 years agoMerge pull request #31083 from smithfarm/wip-42422-nautilus
Yuri Weinstein [Mon, 13 Jan 2020 16:27:10 +0000 (08:27 -0800)]
Merge pull request #31083 from smithfarm/wip-42422-nautilus

nautilus: tests/cephfs.py: allow client mount to reset fully

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #31081 from smithfarm/wip-42158-nautilus
Yuri Weinstein [Mon, 13 Jan 2020 16:25:59 +0000 (08:25 -0800)]
Merge pull request #31081 from smithfarm/wip-42158-nautilus

nautilus: cephfs: osdc/objecter: Fix last_sent in scientific format and add age to ops

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30769 from smithfarm/wip-41888-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 20:19:41 +0000 (12:19 -0800)]
Merge pull request #30769 from smithfarm/wip-41888-nautilus

nautilus: cephfs: "client: fix lazyio_synchronize() to update file size" and "libcephfs: Add Tests for LazyIO"

5 years agoMerge pull request #30767 from smithfarm/wip-42147-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 20:18:54 +0000 (12:18 -0800)]
Merge pull request #30767 from smithfarm/wip-42147-nautilus

nautilus: cephfs: mds returns -5(EIO) error when the deleted file does not exist

5 years agoMerge pull request #30766 from smithfarm/wip-42145-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 20:18:13 +0000 (12:18 -0800)]
Merge pull request #30766 from smithfarm/wip-42145-nautilus

nautilus: cephfs: client: remove Inode.dir_contacts field and handle bad whence value to llseek gracefully

5 years agoMerge pull request #30764 from smithfarm/wip-42121-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 20:17:43 +0000 (12:17 -0800)]
Merge pull request #30764 from smithfarm/wip-42121-nautilus

nautilus: cephfs: client: add procession of SEEK_HOLE and SEEK_DATA in lseek

5 years agoMerge pull request #30763 from smithfarm/wip-42040-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 20:17:01 +0000 (12:17 -0800)]
Merge pull request #30763 from smithfarm/wip-42040-nautilus

nautilus: cephfs: client: _readdir_cache_cb() may use the readdir_cache already clear

5 years agoMerge pull request #30762 from smithfarm/wip-42035-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 20:16:26 +0000 (12:16 -0800)]
Merge pull request #30762 from smithfarm/wip-42035-nautilus

nautilus: cephfs: client: EINVAL may be returned when offset is 0

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #30761 from smithfarm/wip-41899-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 20:15:42 +0000 (12:15 -0800)]
Merge pull request #30761 from smithfarm/wip-41899-nautilus

nautilus: mds: "apply configuration changes through MDSRank" and "recall caps from quiescent sessions" and "drive cap recall while dropping cache"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31518 from trociny/wip-42726-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 16:13:59 +0000 (08:13 -0800)]
Merge pull request #31518 from trociny/wip-42726-nautilus

nautilus: rbd-mirror: clone v2 mirroring improvements

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32133 from dillaman/wip-43212-nautilus
Yuri Weinstein [Fri, 10 Jan 2020 16:13:03 +0000 (08:13 -0800)]
Merge pull request #32133 from dillaman/wip-43212-nautilus

nautilus: mgr/dashboard: block mirroring page results in internal server error

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoMerge pull request #32520 from sseshasa/wip-43495-nautilus
Yuri Weinstein [Thu, 9 Jan 2020 16:56:51 +0000 (08:56 -0800)]
Merge pull request #32520 from sseshasa/wip-43495-nautilus

nautilus: mon/OSDMonitor: Don't update mon cache settings if rocksdb is not used

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #32056 from smithfarm/wip-42735-nautilus
Yuri Weinstein [Thu, 9 Jan 2020 16:55:00 +0000 (08:55 -0800)]
Merge pull request #32056 from smithfarm/wip-42735-nautilus

nautilus: rgw: allow reshard log entries for non-existent buckets to be cancelled

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agoMerge pull request #32055 from smithfarm/wip-42733-nautilus
Yuri Weinstein [Thu, 9 Jan 2020 16:54:36 +0000 (08:54 -0800)]
Merge pull request #32055 from smithfarm/wip-42733-nautilus

nautilus: rgw: auto-clean reshard queue entries for non-existent buckets

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agoMerge pull request #31683 from smithfarm/wip-42840-nautilus
Yuri Weinstein [Thu, 9 Jan 2020 16:54:12 +0000 (08:54 -0800)]
Merge pull request #31683 from smithfarm/wip-42840-nautilus

nautilus: rgw: when resharding store progress json

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agoMerge pull request #32058 from smithfarm/wip-43161-nautilus
Yuri Weinstein [Thu, 9 Jan 2020 16:53:36 +0000 (08:53 -0800)]
Merge pull request #32058 from smithfarm/wip-43161-nautilus

nautilus: rgw: url encode common prefixes for List Objects response

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge remote-tracking branch 'origin/nautilus-saved' into nautilus
Yuri Weinstein [Thu, 9 Jan 2020 00:13:09 +0000 (00:13 +0000)]
Merge remote-tracking branch 'origin/nautilus-saved' into nautilus

6 years ago14.2.6 v14.2.6
Jenkins Build Slave User [Wed, 8 Jan 2020 18:36:54 +0000 (18:36 +0000)]
14.2.6

6 years agodoc: update inf/infinite option for subvolume resize 31332/head
Jos Collin [Sat, 26 Oct 2019 16:02:33 +0000 (21:32 +0530)]
doc: update inf/infinite option for subvolume resize

Fixes: https://tracker.ceph.com/issues/42479
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit e5bad7d4a6fa598042e718924fadbddf9ac64e55)

6 years agodoc: fs subvolume resize command
Jos Collin [Thu, 17 Oct 2019 14:25:47 +0000 (19:55 +0530)]
doc: fs subvolume resize command

Fixes: https://tracker.ceph.com/issues/41182
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 04b6b737153940c852c4b6771fb53a74a0c73bbe)

6 years agoqa/tasks/cbt: install python3 deps
Kefu Chai [Fri, 27 Dec 2019 11:03:24 +0000 (19:03 +0800)]
qa/tasks/cbt: install python3 deps

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 299375852a4b3210cf5b95d3559d69080f14339f)

Conflicts:
qa/tasks/cbt.py: install python36-* instead of python3-*
packages. as in EL7, python packages is still versioned using minor
version, and they don't "Provide" python3-*.

6 years agomon/OSDMonitor: Don't update mon cache settings if rocksdb is not used 32520/head
Sridhar Seshasayee [Fri, 3 Jan 2020 09:26:13 +0000 (14:56 +0530)]
mon/OSDMonitor: Don't update mon cache settings if rocksdb is not used

Currently any update to mon cache config settings like 'mon_memory_target'
or 'rocksdb_cache_size' will cause a crash in case rocksdb and priority
cache manager is not being used.

If rocksdb (and therefore priority cache manager) is not being used, then
the update to the mon caches is ignored. Also, reduce the log levels of
some important log messages to help in debugging.

Fixes: https://tracker.ceph.com/issues/43454
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
(cherry picked from commit b9e7a7af98ca284f4febc37fede58345ecb8a1d1)

6 years agoMerge pull request #32436 from tchaikov/nautilus-cbt-py3
Kefu Chai [Tue, 7 Jan 2020 01:34:25 +0000 (09:34 +0800)]
Merge pull request #32436 from tchaikov/nautilus-cbt-py3

nautilus: qa/tasks/cbt: install python3 deps

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoqa/tasks/cbt: install python3 deps 32436/head
Kefu Chai [Fri, 27 Dec 2019 11:03:24 +0000 (19:03 +0800)]
qa/tasks/cbt: install python3 deps

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 299375852a4b3210cf5b95d3559d69080f14339f)

Conflicts:
qa/tasks/cbt.py: install python36-* instead of python3-*
packages. as in EL7, python packages is still versioned using minor
version, and they don't "Provide" python3-*.

6 years agomon/PGMap.h: disable network stats in dump_osd_stats
Neha [Mon, 23 Dec 2019 18:12:59 +0000 (18:12 +0000)]
mon/PGMap.h: disable network stats in dump_osd_stats

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit ffb8a2a904426c8a3d6fc2fd70266418a98623c5)

 Conflicts:
src/mon/PGMap.h - trivial resolution

6 years agoosd_stat_t::dump: Add option for ceph-mgr pythonn callers to skip ping network
David Zafman [Fri, 20 Dec 2019 23:53:49 +0000 (15:53 -0800)]
osd_stat_t::dump: Add option for ceph-mgr pythonn callers to skip ping network

Due to the overhead of this on large clusters, we removed the network
information was wasn't getting used anyway.

Fixes: https://tracker.ceph.com/issues/43364
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 1e2fe722c41d4cc34094afb157b3eb06b4a50972)

 Conflicts:
src/mon/PGMap.cc - trivial resolution
src/mon/PGMap.h - trivial resolution
src/osd/osd_types.h  - trivial resolution

6 years agoMerge pull request #32466 from neha-ojha/wip-43364-2-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 23:24:37 +0000 (15:24 -0800)]
Merge pull request #32466 from neha-ojha/wip-43364-2-nautilus

nautilus: mon/PGMap.h: disable network stats in dump_osd_stats

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #32064 from smithfarm/wip-42997-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 23:18:18 +0000 (15:18 -0800)]
Merge pull request #32064 from smithfarm/wip-42997-nautilus

nautilus: osd/PeeringState: do not exclude up from acting_recovery_backfill

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #32062 from smithfarm/wip-42853-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 23:17:53 +0000 (15:17 -0800)]
Merge pull request #32062 from smithfarm/wip-42853-nautilus

nautilus: mon/OSDMonitor: fix format error ceph osd stat --format json

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #31740 from smithfarm/wip-42885-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 23:17:27 +0000 (15:17 -0800)]
Merge pull request #31740 from smithfarm/wip-42885-nautilus

nautilus: core: mon/OSDMonitor: Fix pool set target_size_bytes (etc) with unit suffix

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #31736 from SUSE/wip-42846-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 23:15:57 +0000 (15:15 -0800)]
Merge pull request #31736 from SUSE/wip-42846-nautilus

nautilus: msg: async/net_handler.cc: Fix compilation

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #32067 from smithfarm/wip-42899-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 23:15:24 +0000 (15:15 -0800)]
Merge pull request #32067 from smithfarm/wip-42899-nautilus

nautilus: mgr/pg_autoscaler: only generate target_* health warnings if targets set

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #31862 from smithfarm/wip-43012-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 20:26:21 +0000 (12:26 -0800)]
Merge pull request #31862 from smithfarm/wip-43012-nautilus

nautilus: rgw: crypt: permit RGW-AUTO/default with SSE-S3 headers

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #31684 from smithfarm/wip-42841-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 20:25:54 +0000 (12:25 -0800)]
Merge pull request #31684 from smithfarm/wip-42841-nautilus

nautilus: rgw: fix an endless loop error when to show usage

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #31298 from smithfarm/wip-42555-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 20:25:23 +0000 (12:25 -0800)]
Merge pull request #31298 from smithfarm/wip-42555-nautilus

nautilus: rgw: prevent bucket reshard scheduling if bucket is resharding

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #31289 from smithfarm/wip-42386-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 20:25:04 +0000 (12:25 -0800)]
Merge pull request #31289 from smithfarm/wip-42386-nautilus

nautilus: rgw: fix compile errors with boost 1.70

6 years agoMerge pull request #31182 from croit/nautilus-rgw-bucket-stats-num-shards
Yuri Weinstein [Mon, 6 Jan 2020 20:24:18 +0000 (12:24 -0800)]
Merge pull request #31182 from croit/nautilus-rgw-bucket-stats-num-shards

nautilus: rgw: add num_shards to radosgw-admin bucket stats

6 years agoMerge pull request #32050 from joke-lee/rgw-sts-crash-token-not-base64-nautilus
Yuri Weinstein [Mon, 6 Jan 2020 20:23:39 +0000 (12:23 -0800)]
Merge pull request #32050 from joke-lee/rgw-sts-crash-token-not-base64-nautilus

nautilus: rgw: fix rgw crash when token is not base64 encode

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #31844 from smithfarm/wip-42994-nautilus
Yuri Weinstein [Fri, 3 Jan 2020 20:22:03 +0000 (12:22 -0800)]
Merge pull request #31844 from smithfarm/wip-42994-nautilus

nautilus: mon: remove the restriction of address type in init_with_hosts

Reviewed-by: Xiaoxi Chen <xiaoxi.chen@intel.com>
6 years agoMerge pull request #31028 from smithfarm/wip-42197-nautilus
Yuri Weinstein [Fri, 3 Jan 2020 20:05:53 +0000 (12:05 -0800)]
Merge pull request #31028 from smithfarm/wip-42197-nautilus

nautilus: osd/PrimaryLogPG: skip obcs that don't exist during backfill scan_range

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #31852 from sseshasa/wip-41810-nautilus
Yuri Weinstein [Fri, 3 Jan 2020 20:04:46 +0000 (12:04 -0800)]
Merge pull request #31852 from sseshasa/wip-41810-nautilus

nautilus: os/bluestore: Add config observer for osd memory specific options.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agomon/PGMap.h: disable network stats in dump_osd_stats 32466/head
Neha [Mon, 23 Dec 2019 18:12:59 +0000 (18:12 +0000)]
mon/PGMap.h: disable network stats in dump_osd_stats

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit ffb8a2a904426c8a3d6fc2fd70266418a98623c5)

 Conflicts:
src/mon/PGMap.h - trivial resolution

6 years agoosd_stat_t::dump: Add option for ceph-mgr pythonn callers to skip ping network
David Zafman [Fri, 20 Dec 2019 23:53:49 +0000 (15:53 -0800)]
osd_stat_t::dump: Add option for ceph-mgr pythonn callers to skip ping network

Due to the overhead of this on large clusters, we removed the network
information was wasn't getting used anyway.

Fixes: https://tracker.ceph.com/issues/43364
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 1e2fe722c41d4cc34094afb157b3eb06b4a50972)

 Conflicts:
src/mon/PGMap.cc - trivial resolution
src/mon/PGMap.h - trivial resolution
src/osd/osd_types.h  - trivial resolution

6 years agoMerge pull request #31295 from smithfarm/wip-42537-nautilus
Jan Fajerski [Thu, 2 Jan 2020 10:27:00 +0000 (11:27 +0100)]
Merge pull request #31295 from smithfarm/wip-42537-nautilus

nautilus: ceph-volume/zfs: add the inventory command

6 years agoMerge pull request #32028 from smithfarm/wip-43140-nautilus
Yuri Weinstein [Mon, 23 Dec 2019 20:26:01 +0000 (12:26 -0800)]
Merge pull request #32028 from smithfarm/wip-43140-nautilus

nautilus: core: mon: keep v1 address type when explicitly set

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #31779 from rhcs-dashboard/wip-42900-nautilus
Laura Paduano [Fri, 20 Dec 2019 10:06:28 +0000 (11:06 +0100)]
Merge pull request #31779 from rhcs-dashboard/wip-42900-nautilus

nautilus: mgr/dashboard: show "Rename" in header & button when renaming RBD

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agonautilus: mgr/dashboard: fix RGW subuser auto-generate key. (#32240)
Lenz Grimmer [Thu, 19 Dec 2019 11:36:08 +0000 (11:36 +0000)]
nautilus: mgr/dashboard: fix RGW subuser auto-generate key. (#32240)

nautilus: mgr/dashboard: fix RGW subuser auto-generate key.

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #32216 from smithfarm/wip-43233-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 21:14:24 +0000 (13:14 -0800)]
Merge pull request #32216 from smithfarm/wip-43233-nautilus

nautilus: tests: radosgw-admin: remove dependency on bunch package

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #31089 from smithfarm/wip-41634-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 21:14:04 +0000 (13:14 -0800)]
Merge pull request #31089 from smithfarm/wip-41634-nautilus

nautilus: rgw: add bucket permission verify when copy obj

6 years agoMerge pull request #30743 from smithfarm/wip-41978-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 21:13:23 +0000 (13:13 -0800)]
Merge pull request #30743 from smithfarm/wip-41978-nautilus

nautilus: rgw: fix list versions starts with version_id=null

6 years agoMerge pull request #30733 from less-is-morr/wip-41636-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 21:12:53 +0000 (13:12 -0800)]
Merge pull request #30733 from less-is-morr/wip-41636-nautilus

nautilus: rgw: gc remove tag after all sub io finish

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #30741 from smithfarm/wip-41714-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 21:12:13 +0000 (13:12 -0800)]
Merge pull request #30741 from smithfarm/wip-41714-nautilus

nautilus: rgw: fix refcount tags to match and update object's idtag

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agoMerge pull request #31301 from smithfarm/wip-42134-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 19:49:10 +0000 (11:49 -0800)]
Merge pull request #31301 from smithfarm/wip-42134-nautilus

nautilus: core: auth/Crypto: fallback to /dev/urandom if getentropy() fails

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #31359 from smithfarm/wip-42203-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 19:45:05 +0000 (11:45 -0800)]
Merge pull request #31359 from smithfarm/wip-42203-nautilus

nautilus: osd: set affinity for *all* threads

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #31735 from SUSE/wip-42739-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 19:38:14 +0000 (11:38 -0800)]
Merge pull request #31735 from SUSE/wip-42739-nautilus

nautilus: mgr/devicehealth: ensure we don't store empty objects

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #31367 from jan--f/wip-42400-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 19:37:29 +0000 (11:37 -0800)]
Merge pull request #31367 from jan--f/wip-42400-nautilus

nautilus: ceph.in: check ceph-conf returncode

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #32283 from neha-ojha/wip-42913-nautilus
Yuri Weinstein [Wed, 18 Dec 2019 19:35:53 +0000 (11:35 -0800)]
Merge pull request #32283 from neha-ojha/wip-42913-nautilus

nautilus: os/bluestore: default bluestore_block_size 1T -> 100G

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agonautilus: mgr/dashboard: A block-manager can not access the po… (#31570)
Lenz Grimmer [Wed, 18 Dec 2019 15:48:28 +0000 (15:48 +0000)]
nautilus: mgr/dashboard: A block-manager can not access the po… (#31570)

nautilus: mgr/dashboard: A block-manager can not access the pool page

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agoMerge pull request #32254 from ideepika/wip-43316-nautilus
Nathan Cutler [Wed, 18 Dec 2019 11:22:19 +0000 (12:22 +0100)]
Merge pull request #32254 from ideepika/wip-43316-nautilus

nautilus: doc: wrong datatype describing crush_rule

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #32035 from cbodley/wip-qa-rgw-swift-nautilus
Yuri Weinstein [Tue, 17 Dec 2019 20:19:16 +0000 (12:19 -0800)]
Merge pull request #32035 from cbodley/wip-qa-rgw-swift-nautilus

qa/rgw: add missing force-branch: ceph-nautilus for swift tasks

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #32229 from alimaredia/wip-s3-tests-branch-name-refactor-nautilus
Yuri Weinstein [Tue, 17 Dec 2019 20:18:05 +0000 (12:18 -0800)]
Merge pull request #32229 from alimaredia/wip-s3-tests-branch-name-refactor-nautilus

nautilus: update s3-test download code for s3-test tasks

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agonautilus: update s3-test download code for s3-test tasks 32229/head
Ali Maredia [Mon, 25 Nov 2019 02:30:03 +0000 (21:30 -0500)]
nautilus: update s3-test download code for s3-test tasks

Fixes: https://tracker.ceph.com/issues/43077
- Ensure the download code for all tasks running
s3-tests is consistent.
- Simplify download code to only use the config
variable 'force-branch' for the branch being
cloned.
- Make ceph-nautilus the force-branch for all
suites using s3-tests.
- Add force-branch to suites running s3readwrite
& s3roundtrip tasks

Signed-off-by: Ali Maredia <amaredia@redhat.com>
6 years agoos/bluestore: default bluestore_block_size 1T -> 100G 32283/head
Sage Weil [Thu, 5 Dec 2019 18:58:12 +0000 (12:58 -0600)]
os/bluestore: default bluestore_block_size 1T -> 100G

This makes vstart *way* faster.  This option is only really relevant
for dev test environments.  We bumped it up back in dbdd1d9b6ec286982b5e86d4c51f831cc16afc12
from 10G just to make ENOSPC less common in dev/test.  Let's see if 100G
is a better balance.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 57890fce7064811780823e298b31e7fced2fa0e3)

 Conflicts:
src/common/options.cc: we did not cherry-pick
        dbdd1d9b6ec286982b5e86d4c51f831cc16afc12 to nautilus, so we'll directly
        go from 10G->100G

6 years agonautilus: mgr/dashboard: Use serial RGW Admin OPS API calls (#31569)
Lenz Grimmer [Mon, 16 Dec 2019 12:57:39 +0000 (12:57 +0000)]
nautilus: mgr/dashboard: Use serial RGW Admin OPS API calls (#31569)

nautilus: mgr/dashboard: Use serial RGW Admin OPS API calls

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agonautilus: mgr/dashboard: Disable event propagation in the help… (#31566)
Lenz Grimmer [Mon, 16 Dec 2019 12:22:42 +0000 (12:22 +0000)]
nautilus: mgr/dashboard: Disable event propagation in the help… (#31566)

nautilus: mgr/dashboard: Disable event propagation in the helper icon

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agonautilus: mgr/dashboard: Remove title from sparkline tooltips (#31737)
Lenz Grimmer [Mon, 16 Dec 2019 10:19:44 +0000 (10:19 +0000)]
nautilus: mgr/dashboard: Remove title from sparkline tooltips (#31737)

nautilus: mgr/dashboard: Remove title from sparkline tooltips

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agodoc/rados/operations: crush_rule is a name 32254/head
Kefu Chai [Sat, 27 Jul 2019 13:35:37 +0000 (21:35 +0800)]
doc/rados/operations: crush_rule is a name

like
```
ceph osd pool set <pool-name> crush_rule <rule-name>
```
where `<rule-name>` is a string instead of a number.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 3ed3de6c964ba998d5b18ceb997d1a6dffe355db)

6 years agoMerge pull request #32248 from neha-ojha/wip-32197-nautilus
Neha Ojha [Fri, 13 Dec 2019 19:11:38 +0000 (11:11 -0800)]
Merge pull request #32248 from neha-ojha/wip-32197-nautilus

nautilus: doc/_templates/page.html: redirect to etherpad

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agodoc/_templates/page.html: redirect to etherpad 32248/head
Neha [Thu, 12 Dec 2019 04:21:04 +0000 (04:21 +0000)]
doc/_templates/page.html: redirect to etherpad

This simplifies things for users who are not able to add cards to
https://github.com/ceph/ceph/projects/4 due to insufficient permissions.

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 066981dedbca161fba85d368d86c8ca15bfe0fac)

6 years agoMerge pull request #31116 from smithfarm/wip-42462-nautilus
Nathan Cutler [Fri, 13 Dec 2019 16:14:54 +0000 (17:14 +0100)]
Merge pull request #31116 from smithfarm/wip-42462-nautilus

nautilus: doc/cephfs: improve add/remove MDS section

Reviewed-by: Jos Collin <jcollin@redhat.com>
6 years agonautilus: mgr/dashboard: Fix e2e chromedriver problem (#32241)
Lenz Grimmer [Fri, 13 Dec 2019 15:45:25 +0000 (15:45 +0000)]
nautilus: mgr/dashboard: Fix e2e chromedriver problem (#32241)

nautilus: mgr/dashboard: Fix e2e chromedriver problem

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: Fix e2e chromedriver problem 32241/head
Tiago Melo [Thu, 12 Dec 2019 18:00:57 +0000 (17:00 -0100)]
mgr/dashboard: Fix e2e chromedriver problem

New version of Chrome/ChromeDriver seems to have a problem with insecure
certificates.

Since we use a vStart cluster with no real certificate,
we always face this problem when running e2e tests.

This will fix the current problem and hopefully any future problems related to
certificates.

Fixes: https://tracker.ceph.com/issues/43254
Signed-off-by: Tiago Melo <tmelo@suse.com>
(cherry picked from commit f0f718f1770bf48028274c100406e0a564710174)

6 years agomgr/dashboard: fix RGW subuser auto-generate key. 32240/head
Alfonso Martínez [Wed, 11 Dec 2019 16:53:01 +0000 (17:53 +0100)]
mgr/dashboard: fix RGW subuser auto-generate key.

Fixes: https://tracker.ceph.com/issues/43263
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 07a08aacea51aae04ba8607688ac4b75a8ee3b3f)

6 years agoMerge pull request #31810 from bk201/wip-42948-nautilus
Lenz Grimmer [Fri, 13 Dec 2019 11:34:03 +0000 (11:34 +0000)]
Merge pull request #31810 from bk201/wip-42948-nautilus

nautilus: mgr/dashboard: fix restored RBD image naming issue

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agonautilus: mgr/dashboard: Update translations nautilus (#31759) BRI-nautilus
Lenz Grimmer [Fri, 13 Dec 2019 09:07:01 +0000 (09:07 +0000)]
nautilus: mgr/dashboard: Update translations nautilus (#31759)

nautilus: mgr/dashboard: Update translations nautilus

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #31300 from smithfarm/wip-42259-nautilus
Neha Ojha [Fri, 13 Dec 2019 04:37:56 +0000 (20:37 -0800)]
Merge pull request #31300 from smithfarm/wip-42259-nautilus

nautilus: doc, qa: remove invalid option mon_pg_warn_max_per_osd

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoqa: radosgw-admin: remove dependency on bunch package 32216/head
Yehuda Sadeh [Sat, 7 Dec 2019 09:12:19 +0000 (01:12 -0800)]
qa: radosgw-admin: remove dependency on bunch package

Fixes: https://tracker.ceph.com/issues/43184
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
(cherry picked from commit 1bf21326aa7f8eaafd7049b44eb73aeb36bcc5d7)

6 years agomds: audit memset & bzero users for FIPS. 32167/head
Radoslaw Zarzynski [Sun, 17 Nov 2019 08:21:40 +0000 (09:21 +0100)]
mds: audit memset & bzero users for FIPS.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 81fd0a4a8720895ca224c2363478bdfaa358f3a6)

6 years agoosd: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Sun, 17 Nov 2019 08:18:34 +0000 (09:18 +0100)]
osd: audit memset & bzero users for FIPS.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 63e0c637963d611518e09ea7bd2dd24b9fe76991)

6 years agoosdc: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Sun, 17 Nov 2019 08:16:43 +0000 (09:16 +0100)]
osdc: audit memset & bzero users for FIPS.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit d2604f45cfae6dd5fdd1efe52f60004ce233ff04)

6 years agolibrbd: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Sun, 17 Nov 2019 08:11:26 +0000 (09:11 +0100)]
librbd: audit memset & bzero users for FIPS.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit f50bfc052b381ff53387c5afb2e47bc5773289c6)

6 years agolibrados: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Fri, 15 Nov 2019 23:47:24 +0000 (00:47 +0100)]
librados: audit memset & bzero users for FIPS.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 00fb1e1c7f1ac523258a334995b72b48c1f4c1ed)

6 years agorgw: add some missed FIPS zeroization calls.
Radoslaw Zarzynski [Fri, 15 Nov 2019 23:42:54 +0000 (00:42 +0100)]
rgw: add some missed FIPS zeroization calls.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 32c84d4d35e599f6a510820b86a535a838ca2941)

6 years agorgw: switch to ceph::crypto::zeroize_for_security().
Radoslaw Zarzynski [Fri, 15 Nov 2019 23:42:29 +0000 (00:42 +0100)]
rgw: switch to ceph::crypto::zeroize_for_security().

CONFLICT: it seems rgw_kms.cc has been dissected from
rgw_crypto.cc in commit 1e5b58ad50eae9b6df7f28baf511f4902cfbae4c.
Because of that the `memset` occurances have been audited
manually during the backport process.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 764010b2c3e779fe9910ff4a8b00ad1a2cafe49d)

6 years agorgw: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Fri, 15 Nov 2019 23:41:13 +0000 (00:41 +0100)]
rgw: audit memset & bzero users for FIPS.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit cdfc5cded9db88c59fc8e9b5dcee0a0fb1f9272a)

6 years agorgw: fix indentation in parse_rgw_ldap_bindpw().
Radoslaw Zarzynski [Fri, 15 Nov 2019 23:02:30 +0000 (00:02 +0100)]
rgw: fix indentation in parse_rgw_ldap_bindpw().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 956f57c711c73c0fe34736b87a1ff341a92fea63)

6 years agomsg/async: switch to ceph::crypto::zeroize_for_security().
Radoslaw Zarzynski [Fri, 15 Nov 2019 22:53:50 +0000 (23:53 +0100)]
msg/async: switch to ceph::crypto::zeroize_for_security().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 050958398767cbd6d3326a3f74df82f5214a1db5)

6 years agomsg/async: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Fri, 15 Nov 2019 22:53:31 +0000 (23:53 +0100)]
msg/async: audit memset & bzero users for FIPS.

CONFLICT src/msg/async/rdma/Infiniband.cc: some parts of
the memset audit made for master were conflicted with
nautilus, and thus have been stripped.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 38084250115fc15df221c94535b0223a8cab0634)

6 years agocommon: switch to ceph::crypto::zeroize_for_security().
Radoslaw Zarzynski [Fri, 15 Nov 2019 22:25:32 +0000 (23:25 +0100)]
common: switch to ceph::crypto::zeroize_for_security().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit a5e19234eda35688782318da16e74de05c8ba9d3)

6 years agocommon: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Fri, 15 Nov 2019 22:24:54 +0000 (23:24 +0100)]
common: audit memset & bzero users for FIPS.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit fc05ac322580e409bd13645282d7e9a64f3d895f)

6 years agoauth: audit memset & bzero users for FIPS.
Radoslaw Zarzynski [Fri, 15 Nov 2019 15:42:12 +0000 (16:42 +0100)]
auth: audit memset & bzero users for FIPS.

This commit add comments after auditing a subset of
`memset` and `bzero` users found basing on the GCC's
`deprecated` attribute:
https://gist.github.com/rzarzynski/db9b4ca6b3d409d2ab8d38f4d6678063.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 947931db7bca4f10fd461ebf727e06587af3c393)

6 years agocommon: introduce ceph::crypto::zeroize_for_security().
Radoslaw Zarzynski [Fri, 15 Nov 2019 15:39:21 +0000 (16:39 +0100)]
common: introduce ceph::crypto::zeroize_for_security().

For the sake of compliance with FIPS memory where security
material (like keys) was stored, should be cleaned when it
isn't used anymore. This is intended to limit the impact of
other security problems allowing to inspect memory.

In many cases such sanitization is performed with `memset`
or `bzero` to zeroize the memory. However, C++ language,
due to the as-if rule [1], provides less guarantees than
necessary to ensure that a call to e.g. `memset` will be
always translated into intended stores. This isn't something
specific to it nor `bzero`. All a compiler needs to know
to perform dead store elimination is the code itself (to
exclude e.g. `volatile` fencing). Presumably it could assume
how the things from standard library look internally – like
with an inlineable function [2].

[1] https://en.cppreference.com/w/cpp/language/as_if
[2] https://godbolt.org/z/XJnAnA

The problem was already discussed in the GCC bug reports
which finally have been marked as "invalid":
  * https://gcc.gnu.org/bugzilla/show_bug.cgi?id=8537,
  * https://gcc.gnu.org/bugzilla/show_bug.cgi?id=71388.

Because of that we want to perform the security clean-ups
with a dedicated procedure that takes responsibility of
prohibiting compilers from optimizing it out. OpenSSL
already provides such utility: `OPESNSSL_cleanse`. This
commit integrates it into Ceph's abstractions over crypto.

The intended clients are some current user of `memset` and
`bzero` found using the GCC's `deprecated` attribute. See:
https://gist.github.com/rzarzynski/db9b4ca6b3d409d2ab8d38f4d6678063.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit c16266cec254f0ca0e0330f4bb84c3b53386e0ba)

6 years agorgw: fix rgw crash when token is not base64 encode 32050/head
yuliyang [Tue, 10 Dec 2019 08:12:57 +0000 (16:12 +0800)]
rgw: fix rgw crash when token is not base64 encode

Fixes: https://tracker.ceph.com/issues/43018
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
(cherry picked from commit b8fca700b52683931052d1567aa259647f977b59)
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
6 years agomgr/dashboard: properly handle a missing rbd-mirror service status 32133/head
Jason Dillaman [Wed, 27 Nov 2019 17:03:21 +0000 (12:03 -0500)]
mgr/dashboard: properly handle a missing rbd-mirror service status

This was resulting in 500 errors in the dashboard due to the missing
status being handled like a dict.

Fixes: https://tracker.ceph.com/issues/43029
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 499d749e3f96ef9af0fa2381a47efc2a745eff45)

6 years agomgr: cull service daemons when the last instance has been removed
Jason Dillaman [Wed, 27 Nov 2019 17:01:39 +0000 (12:01 -0500)]
mgr: cull service daemons when the last instance has been removed

Previously, when the last daemon of a given service was stopped, it
would not have been removed from the MGR internal service daemon
collection. This would result in "ceph service dump" not showing the
service but the dashboard would incorrectly show it.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 7534737030b3b51e00f9ffc519574bcb10f6c950)

Conflicts:
src/mgr/DaemonServer.cc: uses older locks and DaemonKey is pair

6 years agomgr: ensure new daemons are properly indexed by hostname
Jason Dillaman [Wed, 27 Nov 2019 14:32:28 +0000 (09:32 -0500)]
mgr: ensure new daemons are properly indexed by hostname

The hostname key was never populated when storing a daemon within
the daemon state index for the first time. This results in the
"by_server" index being incorrect.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 3e7bc80b35b43d495a56b9cb0e9e15f58381f77b)