Merge pull request #34054 from Gopi-Patta/wip-gopi-rbd

Script for supporting both 7.7 & 8.1

Script for supporting both 7.7 & 8.1

Merge pull request #33568 from julpark-rh/done_data_pool

Done data pool

Merge pull request #33567 from julpark-rh/done_huge_tickets

rbd_huge_tickets added the image-feature layering

Merge pull request #33589 from julpark-rh/done_rbd_map_unmap

rbd_map_unmap, added the image-feature layering

Merge pull request #33564 from julpark-rh/done_image_read

Adding image feature layering

Merge pull request #33683 from TejasC88/wip-s3tests

Force S3-tests to select ceph-nautilus branch for Nautilus runs.

Force S3-tests to select ceph-nautilus branch for Nautilus runs.

Signed-off-by: Tejas Chandramouli <tchandra@tchandra.blr.csb>

Merge pull request #33630 from hkadam134/rh-nautilus

Rh nautilus

Revert "renaming filestore to bluestore"

This reverts commit 3cc18300db97fba4e9c3c3f131a9519e5187de5a.

Revert "mon/MDSMonitor: warn when creating fs with default EC data pool"

This reverts commit eacd25629785e32b6853bbaf9afc95199aa67163.

Merge pull request #33416 from julpark-rh/done_krbd_namespaces

Editting python3 syntax and image-featrue layering

renaming filestore to bluestore

Signed-off-by: hkadam134 <hyelloji@redhat.com>

rbd_map_unmap, added the image-feature layering

removing the image-feature for img0

rbd_huge_tickets added the image-feature layering

krdb_data_pool python3 syntax and adding the image-feautre

Adding image feature layering

Signed-off-by: julpark-rh <yonhyun@gmail.com>

qa: add tests for adding EC data pools

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mon/MDSMonitor: warn when creating fs with default EC data pool

Rationale can be found in [1]. Point is that EC pools incur a
significant performance penalty when dealing with small files and xattr
updates. This is because _every_ inode has a corresponding data pool
object with backtrace information stored in its xattr.

[1] doc/cephfs/createfs.rst

Fixes: https://tracker.ceph.com/issues/42450
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

qa: force creation of fs with EC default data pool

In the future, we should add the EC data pool as a supplementary data
pool but that requires a mount to setup which is awkward in the code
here. When cephfs-shell is more widely available, this will be easier.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Editting python3 syntax and image-featrue layering

Signed-off-by: julpark-rh <yonhyun@gmail.com>

Merge pull request #33319 from preethisn/wip-p

setting up bluestore values

Merge pull request #33251 from Gopi-Patta/wip-gopi-nbd

removing ubuntu related  workload folder

removing the bluestore-xfs.yaml file

Signed-off-by: preethisn <preethisn88@gmail.com>

setting up bluestore values

Signed-off-by: preethisn <preethisn88@gmail.com>

Merge pull request #33192 from harishmunjulur/rbdbugfixes

Using nosetests-3 to fix "nosetests:command not found" error

qa:Using python3 -m nose for "nosetests:command not found" error

On bionic "nosetests3" and on el "nosetests-3/nosetests-3.6" use neither.
Rhel 7.7 does not support python3 using nosetests.

Signed-off-by: harishmunjulur <harishmunjulur@gmail.com>

removing ubuntu related  workload folder

Using python3 -m nose for "nosetests:command not found" error. On bionic "nosetests3" and on el "nosetests-3/nosetests-3.6" use neither.

Signed-off-by: harishmunjulur <harishmunjulur@gmail.com>

Using nosetests-3 to fix "nosetests:command not found" error

Signed-off-by: harishmunjulur <harishmunjulur@gmail.com>

Merge pull request #33102 from hkadam134/fs-ec-fix

deleting distros

deleting distros

Signed-off-by: hkadam134 <hyelloji@redhat.com>

Merge pull request #32509 from ceph/revert-32264-WIP-removedistro

Revert "[qa]: Removing distros othern than rhel 7.x and rhel 8.x"

Revert "[qa]: Removing distros othern than rhel 7.x and rhel 8.x"

Merge pull request #32264 from racpatel/WIP-removedistro

[qa]: Removing distros othern than rhel 7.x and rhel 8.x

Merge pull request #32468 from Manohar-Murthy/wip-manohar

removing unnecessary ubuntu,centos distros

removing unnecessary ubuntu distros

Merge pull request #32330 from racpatel/wip-centosremove

[qa] : removing centos related TestCases

Merge pull request #32329 from racpatel/wip-hardcodeos

[qa] : removing ubuntu specific test cases - rbd-nbd

Merge pull request #32328 from racpatel/wip-ubunturemove

[qa] cephfs-shell is only available as a package on Ubuntu so removing for RHEL

remove centos reference

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #32306 from racpatel/wip-removeubuntu

 removeing ubuntu

remove references to os_type "centos"

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

removing ubuntu specific test cases - rbd-nbd

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

cephfs-shell is only available as a package on Ubuntu, removing
test case as its not applicable to RHEL

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

 removeing ubuntu

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Removing distros othern than rhel 7.x and rhel 8.x

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #32156 from racpatel/WIP-fsfix

qa: fix suite config for cephfs/bugs

qa: fix malformed suite config

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge branch 'rh-nautilus' of https://github.com/ceph/ceph into rh-nautilus

Merge pull request #32147 from TejasC88/wip-ubuntu-remove

Changes to remove references to os_type "ubuntu" and "centos" hardcode

Merge branch 'wip-ubuntu-remove' of https://github.com/TejasC88/ceph into wip-ubuntu-remove

Changes to remove references to os_type "ubuntu" and "centos" hardcodings

Signed-off-by: TejasC88 <tchandra@redhat.com>

Changes to remove references to os_type "ubuntu" and "centos" hardcodings

Merge pull request #31939 from TejasC88/wip-tejas2

symlink to add beast.yaml to rgw singleton suite

symlink to add beast.yaml to rgw singleton suite

Merge pull request #31820 from racpatel/rh-nautilus

removing radom-distro$

removing random-distro
Merge branch 'rh-nautilus' of https://github.com/ceph/ceph into rh-nautilus

removing radom-distro$

Merge pull request #31803 from racpatel/WIP-PythonTOsh

[qa] fixing 'python -c' in tasks/ceph.manager.py so it works for python 2 and python 3

[qa] fixing 'python -c' in tasks so it works for python 2 and python 3 both

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #31634 from rakeshgm/rh-nautilus

distro changes

removed random distro softlink

Signed-off-by: rakeshgm <rakeshgm014@gmail.com>

added rhel_7.7 distro yaml

Signed-off-by: rakeshgm <rakeshgm014@gmail.com>

Merge pull request #31423 from rakeshgm/add-rhbuild-version

Add rhbuild versions file

added rhbuild supported verisions

Signed-off-by: rakeshgm <rakeshgm014@gmail.com>

Merge pull request #31395 from racpatel/WIP-ConfigDownStream

[qa] : added downstream_config dir

added downstream_config dir

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #31391 from racpatel/WIP-rhel8rpm

[qa] : added rhel8 rpm

added rhel8 rpm

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #31390 from racpatel/WIP-rmUnsupported

added/removed supported distros softlinks

added/removed supported distros softlinks

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #31389 from racpatel/WIP-rhel8Latest

rhel 8.0 is latest

rhel 8.0 is latest now

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #31388 from ceph/revert-31386-WIP-rhel8-latest

Revert "rhel 8.0 is latest now"

Revert "rhel 8.0 is latest now"

Merge pull request #31386 from racpatel/WIP-rhel8-latest

rhel 8.0 is latest now

rhel 8.0 is latest now

Signed-off-by: Rachanaben Patel <racpatel@redhat.com>

Merge pull request #31237 from racpatel/WIP-nautilus-rhel8distro

added rhel_8 distro yamls

added rhel_8 distro yamls

14.2.4

ceph-volume tests create a test file for checking unicode output

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests create a shell test for functional unicode

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests verify new logging fallback and encodings in terminal

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume create a logger for the terminal

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume: instantiate the new terminal logger in main()

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume terminal remove unicode stream handler

This caused problems in environments where stderr was redirected, since
stderr sets the encoding to None. Getting it back again allows
everything to work correctly, and keeps all the current unit tests
passing

Signed-off-by: Alfredo Deza <adeza@redhat.com>

14.2.3

Merge pull request #29945 from trociny/wip-41475-nautilus

nautilus: pybind/mgr/rbd_support: ignore missing support for RBD namespaces

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #29975 from theanalyst/nautilus-beast-endpoint-fix

nautilus: rgw: asio: check the remote endpoint before processing requests

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #29977 from yuriw/wip-yuriw-41513-nautilus

qa/tests: adding mgr.x into the restart/upgrade sequence before monitors

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/tests: adding mgr.x into the restart/upgrade sequence before monitors

Fixes: https://tracker.ceph.com/issues/41513
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

rgw: asio: check the remote endpoint before processing requests

`socket.remote_endpoint()` can throw exceptions corresponding to errors in the
`getpeername` syscall, make sure these are handled.

Fixes: CVE-2019-10222, https://tracker.ceph.com/issues/40018
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit caa653196856ecdf50519a9a33195d5c4e3372af)

Conflicts:
src/rgw/rgw_asio_frontend.cc
conflicts due to missing yield ctx in nautilus

pybind/mgr/rbd_support: ignore missing OSD support for RBD namespaces

During upgrades, the OSDs might not yet have been upgraded yet and
therefore might be missing namespace support.

Fixes: https://tracker.ceph.com/issues/41029
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 10c0c806819741012e1c440c38fac17682125d9a)

pybind/rbd: new OperationNotSupported exception

This will help catch errors where the backing OSDs do not support
a given RBD feature.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 97c1a120b7e7d934dd5d2456fd1fb4c1d0e891ec)

Merge pull request #29918 from badone/wip-nautilus-tracker-41518-grafana-server

nautilus: qa/ceph-ansible: Disable dashboard

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #29899 from alfredodeza/nautilus-rm41378

nautilus ceph-volume tests set the noninteractive flag for Debian

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

nautilus: qa/ceph-ansible: Disable dashboard

Recently a dashboard playbook was added which will fail without a
grafana server so disabling the dashboard

Fixes: https://tracker.ceph.com/issues/41521
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 131f5a145adf21d402e39ac2c151664eb8ccec76)

ceph-volume tests set the noninteractive flag for Debian, to avoid prompts in apt

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 89231c9a60a46ba0691f787efbfe5ab35f05c679)