]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agomgr/dashboard: fix issues related with PyJWT versions >=2.0.0 39836/head
Alfonso Martínez [Wed, 3 Mar 2021 14:36:06 +0000 (15:36 +0100)]
mgr/dashboard: fix issues related with PyJWT versions >=2.0.0

Fixes: https://tracker.ceph.com/issues/49574
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 4b96bb51e8f133badd7bc651bcb4dcd755b43d75)

 Conflicts:
src/pybind/mgr/dashboard/services/auth.py
        - Addressed conflicts.

4 years agoMerge pull request #39715 from sebastian-philipp/octopus-backport-39069
Yuri Weinstein [Thu, 4 Mar 2021 16:09:15 +0000 (08:09 -0800)]
Merge pull request #39715 from sebastian-philipp/octopus-backport-39069

octopus: cephadm: fix 'inspect' and 'pull'

Reviewed-by: Nathan Cutler <ncutler@suse.com>
4 years agoMerge pull request #39633 from donggyupark/fix-cephadm-openports
Yuri Weinstein [Thu, 4 Mar 2021 16:07:31 +0000 (08:07 -0800)]
Merge pull request #39633 from donggyupark/fix-cephadm-openports

octopus: cephadm: Delete the unnecessary error line in open_ports

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
4 years agoMerge pull request #39507 from k0ste/wip-49316-octopus
Yuri Weinstein [Thu, 4 Mar 2021 16:06:10 +0000 (08:06 -0800)]
Merge pull request #39507 from k0ste/wip-49316-octopus

octopus: mgr/dashboard: prometheus alerting: add some leeway for package drops and errors

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
4 years agoMerge pull request #39325 from ifed01/wip-ifed-add-rocksdb-annex
Yuri Weinstein [Thu, 4 Mar 2021 16:04:23 +0000 (08:04 -0800)]
Merge pull request #39325 from ifed01/wip-ifed-add-rocksdb-annex

octopus: os/bluestore: introduce bluestore_rocksdb_options_annex config parame…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #39645 from rhcs-dashboard/wip-49388-octopus
Ernesto Puerta [Thu, 4 Mar 2021 12:59:01 +0000 (13:59 +0100)]
Merge pull request #39645 from rhcs-dashboard/wip-49388-octopus

octopus: mgr/dashboard: fix tooltip for Provisioned/Total Provisioned fields

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
4 years agoMerge pull request #39527 from rhcs-dashboard/wip-49328-octopus
Ernesto Puerta [Thu, 4 Mar 2021 12:55:53 +0000 (13:55 +0100)]
Merge pull request #39527 from rhcs-dashboard/wip-49328-octopus

octopus: mgr/dashboard: avoid using document.write()

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
4 years agoMerge pull request #39545 from aaSharma14/wip-48734-octopus
Ernesto Puerta [Thu, 4 Mar 2021 12:55:13 +0000 (13:55 +0100)]
Merge pull request #39545 from aaSharma14/wip-48734-octopus

octopus: mgr/dashboard:minimize console log traces of Ceph backend API tests

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
4 years agoMerge pull request #39819 from yuriw/wip-yuriw-client-upgrade-octopus-pacific-octopus
Yuri Weinstein [Wed, 3 Mar 2021 22:13:28 +0000 (14:13 -0800)]
Merge pull request #39819 from yuriw/wip-yuriw-client-upgrade-octopus-pacific-octopus

qa/tests: fixed branch entry

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoqa/tests: fixed branch entry 39819/head
Yuri Weinstein [Wed, 3 Mar 2021 17:51:01 +0000 (09:51 -0800)]
qa/tests: fixed branch entry

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
4 years agoMerge pull request #39220 from jan--f/wip-49093-octopus
Jan Fajerski [Wed, 3 Mar 2021 09:19:33 +0000 (10:19 +0100)]
Merge pull request #39220 from jan--f/wip-49093-octopus

Merge PR #39220 into octopus

* refs/pull/39220/head:
        ceph-volume: Fix usage of is_lv

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Dimitri Savineau <savineau.dimitri@gmail.com>
4 years agoMerge pull request #39523 from jan--f/wip-49332-octopus
Jan Fajerski [Wed, 3 Mar 2021 09:11:06 +0000 (10:11 +0100)]
Merge pull request #39523 from jan--f/wip-49332-octopus

Merge PR #39523 into octopus

* refs/pull/39523/head:
        ceph-volume: pass --filter-for-batch from drive-group subcommand

Reviewed-by: Rishabh Dave <ridave@redhat.com>
4 years agoMerge pull request #39469 from jan--f/wip-49289-octopus
Jan Fajerski [Wed, 3 Mar 2021 09:10:31 +0000 (10:10 +0100)]
Merge pull request #39469 from jan--f/wip-49289-octopus

Merge PR #39469 into octopus

* refs/pull/39469/head:
        Update batch.py

Reviewed-by: Rishabh Dave <ridave@redhat.com>
4 years agoMerge pull request #39662 from pponnuvel/wip-49441-octopus
Yuri Weinstein [Tue, 2 Mar 2021 20:11:34 +0000 (12:11 -0800)]
Merge pull request #39662 from pponnuvel/wip-49441-octopus

octopus: rgw: radosgw-admin: clarify error when email address already in use

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #39577 from dillaman/wip-49252-octopus
Yuri Weinstein [Tue, 2 Mar 2021 20:10:47 +0000 (12:10 -0800)]
Merge pull request #39577 from dillaman/wip-49252-octopus

octopus: librbd: correct incremental deep-copy object-map inconsistencies

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
4 years agoMerge pull request #39376 from dillaman/wip-48091-octopus
Yuri Weinstein [Tue, 2 Mar 2021 20:10:26 +0000 (12:10 -0800)]
Merge pull request #39376 from dillaman/wip-48091-octopus

octopus: mgr/rbd_support: create mirror snapshots asynchronously

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
4 years agoMerge pull request #39103 from k0ste/wip-49022-octopus
Ernesto Puerta [Tue, 2 Mar 2021 09:51:35 +0000 (10:51 +0100)]
Merge pull request #39103 from k0ste/wip-49022-octopus

octopus: mgr/dashboard: trigger alert if some nodes have a MTU different than the median value

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
4 years agoMerge pull request #39027 from rhcs-dashboard/wip-48960-octopus
Ernesto Puerta [Tue, 2 Mar 2021 09:49:48 +0000 (10:49 +0100)]
Merge pull request #39027 from rhcs-dashboard/wip-48960-octopus

octopus: mgr/dashboard: Fix for incorrect validation in rgw user form

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
4 years agoMerge pull request #39306 from rhcs-dashboard/wip-48829-octopus
Ernesto Puerta [Tue, 2 Mar 2021 09:48:59 +0000 (10:48 +0100)]
Merge pull request #39306 from rhcs-dashboard/wip-48829-octopus

octopus: mgr/dashboard/monitoring: upgrade Grafana version due to CVE-2020-13379

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
4 years agoMerge pull request #39271 from jan--f/wip-49141-octopus
Guillaume Abrioux [Tue, 2 Mar 2021 07:35:31 +0000 (08:35 +0100)]
Merge pull request #39271 from jan--f/wip-49141-octopus

octopus: ceph-volume: add some flexibility to bytes_to_extents

4 years agoMerge pull request #39534 from ideepika/wip-backport-blocklist-ignorelist-qa
Yuri Weinstein [Mon, 1 Mar 2021 18:26:16 +0000 (10:26 -0800)]
Merge pull request #39534 from ideepika/wip-backport-blocklist-ignorelist-qa

octopus: whitelist -> ignorelist for qa/* only

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39235 from k0ste/wip-49107-octopus
Yuri Weinstein [Mon, 1 Mar 2021 18:25:14 +0000 (10:25 -0800)]
Merge pull request #39235 from k0ste/wip-49107-octopus

octopus: mgr/zabbix: format ceph.[{#POOL},percent_used as float

Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agocephadm: fix 'inspect' and 'pull' 39715/head
Sage Weil [Mon, 25 Jan 2021 22:32:45 +0000 (16:32 -0600)]
cephadm: fix 'inspect' and 'pull'

With podman 2.2.1 I would get

ERRO[0000] Error printing inspect output: template: all inspect:1: function "json" not defined

Removing the 'json' portion of the query resolves it.

Fixes: https://tracker.ceph.com/issues/49522
Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit d31bed79411ca493ec48eeed4e9cbb7ad92295c3)

Conflicts:
src/cephadm/cephadm

4 years agocephadm: Delete the unnecessary error line in open_ports 39633/head
donggyu_park [Mon, 22 Feb 2021 07:52:50 +0000 (16:52 +0900)]
cephadm: Delete the unnecessary error line in open_ports

In #39020, d9fbd7e is cherry picked from 70722a2. there is no bug in 70722a2,
but there is a bug in d9fbd7e. It seems that the unnecessary error line was added during cherry picking.
So error only occurs in octopus branch.
This commit directly fixes issue in octopus branch instead of cherry picking
since cherry picking from 70722a2 has already been applied to octopus branch.

This commit deletes the unnecessary error line added in d9fbd7e.
In d9fbd7e, the parameter verbose_on_failure was removed in call.
However, the unnecessary line that uses verbose_on_failure was
added in open_ports and so error occurs.

Fixes: https://tracker.ceph.com/issues/49467
Signed-off-by: Donggyu Park <donggyu_park@tmax.co.kr>
4 years agoMerge pull request #39277 from smithfarm/wip-49131-octopus
Yuri Weinstein [Wed, 24 Feb 2021 22:23:06 +0000 (14:23 -0800)]
Merge pull request #39277 from smithfarm/wip-49131-octopus

octopus: rgw: fix trailing null in object names of multipart reuploads

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #39583 from liewegas/pr-39561-octopus
Josh Durgin [Wed, 24 Feb 2021 20:17:49 +0000 (12:17 -0800)]
Merge pull request #39583 from liewegas/pr-39561-octopus

octopus: qa: use normal build for valgrind

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agorgw/radosgw-admin clarify error when email address already in use 39662/head
Matthew Vernon [Thu, 4 Feb 2021 11:41:14 +0000 (11:41 +0000)]
rgw/radosgw-admin clarify error when email address already in use

The error message if you try and create an S3 user with an email
address that is already associated with another S3 account is very
confusing; this patch makes it much clearer

To reproduce:

radosgw-admin user create --uid=foo --display-name="Foo test" --email=bar@domain.invalid
radosgw-admin user create --uid=test --display-name="AN test" --email=bar@domain.invalid
could not create user: unable to parse parameters, user id mismatch, operation id: foo does not match: test

With this patch:

radosgw-admin user create --uid=test --display-name="AN test" --email=bar@domain.invalid
could not create user: unable to create user test because user id foo already exists with email bar@domain.invalid

Fixes: https://tracker.ceph.com/issues/49137
Fixes: https://tracker.ceph.com/issues/19411
Signed-off-by: Matthew Vernon <mv3@sanger.ac.uk>
(cherry picked from commit 05318d6f71e45a42a46518a0ef17047dfab83990)

4 years agomgr/dashboard: fix tooltip for Provisioned/Total Provisioned fields 39645/head
Avan Thakkar [Tue, 16 Feb 2021 18:24:25 +0000 (23:54 +0530)]
mgr/dashboard: fix tooltip for Provisioned/Total Provisioned fields

Fixes: https://tracker.ceph.com/issues/46619
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 2dd341d63b7dd7d6b8767b93151c0c1f243be6b6)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-details/rbd-details.component.html
      - Adopting the master branch changes.

4 years ago15.2.9 v15.2.9
Jenkins Build Slave User [Tue, 23 Feb 2021 14:10:15 +0000 (14:10 +0000)]
15.2.9

4 years agoqa/valgrind.supp: suppress free[] warnings 39583/head
Sage Weil [Thu, 18 Feb 2021 18:04:16 +0000 (12:04 -0600)]
qa/valgrind.supp: suppress free[] warnings

This is apparently not going to get fixed any time soon.

https://github.com/gperftools/gperftools/issues/792

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 28fe149ea276693b47cc4d600780971f723672e4)

4 years agoqa/suites: do not use notcmalloc flavor
Sage Weil [Fri, 19 Feb 2021 19:20:08 +0000 (13:20 -0600)]
qa/suites: do not use notcmalloc flavor

teuthology now knows how to run valgrind against a tcmalloc binary

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit dc64ccf063f1ddf843fae4d2621ec25187f56135)

# Conflicts:
# qa/suites/rgw/sts/tasks/0-install.yaml
  - test not present in octopus
# qa/suites/rgw/verify/validater/valgrind.yaml

4 years agoMerge pull request #39289 from kamoltat/wip-ksirivad-octopus-turn-off-backports
Yuri Weinstein [Fri, 19 Feb 2021 17:32:51 +0000 (09:32 -0800)]
Merge pull request #39289 from kamoltat/wip-ksirivad-octopus-turn-off-backports

octopus: mgr/progress: introduce turn off/on feature

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #39256 from ifed01/wip-ifed-fsck-spanning-blobs-octopus
Yuri Weinstein [Fri, 19 Feb 2021 17:32:28 +0000 (09:32 -0800)]
Merge pull request #39256 from ifed01/wip-ifed-fsck-spanning-blobs-octopus

octopus: os/bluestore: detect and fix "zombie" spanning blobs using fsck.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39253 from ifed01/wip-ifed-fix-huge-bluefs-reads-oct
Yuri Weinstein [Fri, 19 Feb 2021 17:31:59 +0000 (09:31 -0800)]
Merge pull request #39253 from ifed01/wip-ifed-fix-huge-bluefs-reads-oct

octopus: os/bluestore: fix huge (>4GB) bluefs reads

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
4 years agoMerge pull request #39560 from neha-ojha/wip-revert-39248-octopus
Yuri Weinstein [Fri, 19 Feb 2021 16:41:55 +0000 (08:41 -0800)]
Merge pull request #39560 from neha-ojha/wip-revert-39248-octopus

octopus: Revert "mgr/pg_autoscaler: avoid scale-down until there is pressure"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
4 years agorbd-mirror: don't prune older mirror snapshots when pruning incomplete snapshot 39577/head
Jason Dillaman [Mon, 8 Feb 2021 16:53:28 +0000 (11:53 -0500)]
rbd-mirror: don't prune older mirror snapshots when pruning incomplete snapshot

Since we normally prune in order, we need to ensure that we don't prune older
snapshots when we need to delete an incomplete mirror snapshot since the
older snapshot might be the only remaining mirror snapshot.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 7ba9214ea5b73d0436af6c2896abf4836d741de9)

4 years agoqa/workunits/rbd: show snapshot deltas during stress test failure
Jason Dillaman [Mon, 8 Feb 2021 15:13:35 +0000 (10:13 -0500)]
qa/workunits/rbd: show snapshot deltas during stress test failure

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit f079116e87161b55acaa08c55bf8b8e79cee8670)

4 years agoqa/suites/rbd: add snapshot-based mirroring stress test
Jason Dillaman [Tue, 2 Feb 2021 20:28:48 +0000 (15:28 -0500)]
qa/suites/rbd: add snapshot-based mirroring stress test

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 094bfeaf8efe1c4794a2b301314eddedfa5246f9)

4 years agolibrbd/deep_copy: added new migrating flag to object copy
Jason Dillaman [Tue, 8 Dec 2020 19:16:49 +0000 (14:16 -0500)]
librbd/deep_copy: added new migrating flag to object copy

The migration operation and the copyup state machine will set
this flag when attempting to perform a deep-copy due to a
live-migration.

This flag will prevent a possible race condition between the
start of the object deep-copy when migration was enabled and
the writing portion of the deep-copy when migration might
have completed via external means.

Fixes: https://tracker.ceph.com/issues/45694
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 1baba64e213cb808804796575d3f7969cf37a3c6)

Conflicts:
src/librbd/deep_copy/ObjectCopyRequest.cc: trivial resolution

4 years agolibrbd/deep_copy: added bitwise flag parameter to object copy
Jason Dillaman [Tue, 8 Dec 2020 18:11:20 +0000 (13:11 -0500)]
librbd/deep_copy: added bitwise flag parameter to object copy

This initial version subsumes the original "flatten" boolean flag.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit e79f6b1c157e042f57b577bc510debb21e004ea7)

Conflicts:
src/librbd/deep_copy/ObjectCopyRequest.cc: trivial resolution
src/librbd/io/CopyupRequest.cc: trivial resolution
src/test/librbd/deep_copy/test_mock_ObjectCopyRequest.cc: trivial resolution

4 years agolibrbd/deep-copy: object-copy state machine must update object map
Jason Dillaman [Fri, 5 Feb 2021 15:41:30 +0000 (10:41 -0500)]
librbd/deep-copy: object-copy state machine must update object map

If there was no data to copy, the object-copy state machine was bypassing
the object-map update states and prematurely completing. Since the
object-map is default-initialized to all non-existent objects, this results
in incorrect state for OBJECT_EXISTS_CLEAN objects.

This commit was derived from ca0b9bfc28ef7287ca139ca9640c876223eda87b

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
4 years agolibrbd: deep-copy should update object-map before writing to object
Jason Dillaman [Fri, 25 Sep 2020 14:40:32 +0000 (10:40 -0400)]
librbd: deep-copy should update object-map before writing to object

For the original use-case of RBD mirroring it was (maybe) more
acceptable to write to the object before updating the object map
because an interrupted sync will be retried. However, when using
the deep-copy object copy state machine as part of copyup, it's
more likely that the object-map has the potential to become
out-of-sync with reality if it's updated after the object is
written.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit e782b85bfda8ae6487c637af0059ab94fba332d6)

Conflicts:
src/librbd/deep_copy/ObjectCopyRequest.cc: trivial resolution
src/test/librbd/deep_copy/test_mock_ObjectCopyRequest.cc: trivial resolution

4 years agolibrbd/object_map: diff state machine should track object existence
Jason Dillaman [Thu, 28 Jan 2021 23:30:16 +0000 (18:30 -0500)]
librbd/object_map: diff state machine should track object existence

The deep-copy snapshot-create state machine initializes the object-map
state to non-existent for all objects. There was an assumption that the
deep-copy object-copy state machine would always update the object map
but that was being skipped for clean objects as an optimization. This
change will support a future commit to run the object-copy state machine
for existing objects.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit b81cd2460de748c71210520f8c819895f257f0c7)

Conflicts:
src/librbd/api/DiffIterate.cc: trivial resolution due to renames

4 years agotest/librbd: print difference if deep-copy or migration test fails
Mykola Golub [Wed, 2 Dec 2020 09:41:13 +0000 (09:41 +0000)]
test/librbd: print difference if deep-copy or migration test fails

It may appear to be useful to track the sporadic test failures
observed on jenkins, not reproducible locally.

Previously it was disabled because the output could be too
large. But after the hexdump was improved to skip repeating bytes
the output will hopefully be much smaller.

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit bb77f740df749de1bba0e91b03c4eb23d5586e43)

4 years agoRevert "PendingReleaseNotes: mgr/pg_autoscaler" 39560/head
Neha Ojha [Thu, 18 Feb 2021 19:51:32 +0000 (19:51 +0000)]
Revert "PendingReleaseNotes: mgr/pg_autoscaler"

This reverts commit 1177acb6de32331c67d707032a2ecaeff6bf8365.

Signed-off-by: Neha Ojha <nojha@redhat.com>
4 years agoRevert "mgr/pg_autoscaler: avoid scale-down until there is pressure"
Neha Ojha [Thu, 18 Feb 2021 19:46:00 +0000 (19:46 +0000)]
Revert "mgr/pg_autoscaler: avoid scale-down until there is pressure"

This reverts commit 49dba6edaa807f2c1047c40ce96a76fc5f409b82.

Reason: Needs to bake more given that it may cause pg budget issues
when multiple pools are created at the same time.

More details in https://tracker.ceph.com/issues/49364.

Signed-off-by: Neha Ojha <nojha@redhat.com>
4 years agoqa/suites/rados/thrash: log-whitelist -> log-ignorelist 39534/head
Neha Ojha [Fri, 7 Aug 2020 17:12:28 +0000 (17:12 +0000)]
qa/suites/rados/thrash: log-whitelist -> log-ignorelist

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit c0a358670a8cda2d9e319f0528d6cb9d74b6c605)

4 years agoqa/suites/krbd/thrash: log-whitelist -> log-ignorelist
Neha Ojha [Fri, 7 Aug 2020 16:37:57 +0000 (16:37 +0000)]
qa/suites/krbd/thrash: log-whitelist -> log-ignorelist

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 01fb7e7f7b1f5c6d2c8371560ccf295567c0eb07)

4 years agoqa/suites/multimds: log-whitelist -> log-ignorelist
Neha Ojha [Fri, 7 Aug 2020 16:35:30 +0000 (16:35 +0000)]
qa/suites/multimds: log-whitelist -> log-ignorelist

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit a8c7efab2d51a249e716dad710e2ca3d01482f16)

4 years agoqa: log-whitelist -> log-ignorelist
Sage Weil [Wed, 17 Jun 2020 19:33:57 +0000 (14:33 -0500)]
qa: log-whitelist -> log-ignorelist

Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 2ee9365d0bc220523632753f02c61eb5c2f4fbdd)

4 years agoMerge pull request #39540 from tchaikov/octopus-pr-35352
Kefu Chai [Thu, 18 Feb 2021 15:26:36 +0000 (23:26 +0800)]
Merge pull request #39540 from tchaikov/octopus-pr-35352

octopus: qa/tasks/vstart_runner: do not teardown test_path if "create-cluster-only"

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
4 years agomgr/dashboard:minimize console log traces of Dashboard backend API tests 39545/head
Aashish Sharma [Tue, 14 Jul 2020 04:58:57 +0000 (10:28 +0530)]
mgr/dashboard:minimize console log traces of Dashboard backend API tests

Changed log levels in some files to reduce console log traces

Fixes: https://tracker.ceph.com/issues/45822
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit f5dd0195cd45b6e00e43ef97e209e565e6452777)

4 years agoqa/tasks/vstart_runner: do not teardown test_path if "create-cluster-only" 39540/head
Kefu Chai [Wed, 3 Jun 2020 01:39:26 +0000 (09:39 +0800)]
qa/tasks/vstart_runner: do not teardown test_path if "create-cluster-only"

otherwise we could be removing a "None" directory when tearing down the cluster,
and have following failure:

Exception ignored in: <bound method LocalContext.__del__ of <__main__.LocalContext object at 0x7f99fd4a6cc0>>
Traceback (most recent call last):
  File "../qa/tasks/vstart_runner.py", line 1189, in __del__
    shutil.rmtree(self.teuthology_config['test_path'])
  File "/tmp/tmp.mmM2ugspuR/venv/lib/python3.6/shutil.py", line 477, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/tmp/tmp.mmM2ugspuR/venv/lib/python3.6/shutil.py", line 475, in rmtree
    orig_st = os.lstat(path)
TypeError: lstat: path should be string, bytes or os.PathLike, not NoneType

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 954e9a6fa67cce8e3eb8105ee858340b60b84b15)

4 years agoMerge pull request #39532 from liewegas/pr-39496-octopus
Yuri Weinstein [Wed, 17 Feb 2021 19:49:41 +0000 (11:49 -0800)]
Merge pull request #39532 from liewegas/pr-39496-octopus

octopus: mgr/cephadm: fix host refresh

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
4 years agomgr/cephadm: fix host refresh 39532/head
Sage Weil [Tue, 16 Feb 2021 17:07:08 +0000 (11:07 -0600)]
mgr/cephadm: fix host refresh

Fixes: 01f60cf4e0a751c314120c02956d4ff941eb71b4
Signed-off-by: Sage Weil <sage@newdream.net>
(cherry picked from commit 9df5a6d73ed21b394c01afe6c9800b6e50737c90)

4 years agomgr/dashboard: avoid using document.write() 39527/head
Avan Thakkar [Tue, 9 Feb 2021 08:01:59 +0000 (13:31 +0530)]
mgr/dashboard: avoid using document.write()

Fixes: https://tracker.ceph.com/issues/49220
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 36efe519b90b7508fb830f2c250e8b6956eaaf05)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/app.module.ts
     - Adopting the master branch changes.

4 years agoceph-volume: pass --filter-for-batch from drive-group subcommand 39523/head
Jan Fajerski [Wed, 16 Dec 2020 13:13:25 +0000 (14:13 +0100)]
ceph-volume: pass --filter-for-batch from drive-group subcommand

Otherwise the drive-group spec potentially tries to pull in the root
device (if it fits).

Fixes: https://tracker.ceph.com/issues/48631
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit a6a03d0f5535a053239ae9e49c53ac9208bb0738)

4 years agoos/bluestore: introduce bluestore_rocksdb_options_annex config parameter. 39325/head
Igor Fedotov [Mon, 21 Dec 2020 21:01:52 +0000 (00:01 +0300)]
os/bluestore: introduce bluestore_rocksdb_options_annex config parameter.

This simplifies modifying a subset of rocksdb settings since it
eliminates the need to re-provide bluestore's rocksdb settings.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 711505e8f9effbf4f0ada3bfe8d25dbc7e86861e)

 Conflicts:
  (trivial) PendingReleaseNotes
  (trivial) src/common/options.cc
  (trivial) src/os/bluestore/BlueStore.cc

4 years agomgr/dashboard: prometheus alerting: add some leeway for package drops and errors... 39507/head
Patrick Seidensal [Wed, 11 Nov 2020 17:55:30 +0000 (18:55 +0100)]
mgr/dashboard: prometheus alerting: add some leeway for package drops and errors (1%)

Fixes: https://tracker.ceph.com/issues/48201
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
(cherry picked from commit 9ac248b0c309b95d33bb0b1b64dc2e397bf8508e)

4 years agoMerge pull request #39393 from kamoltat/wip-ksirivad-octopus-release-notes
Yuri Weinstein [Tue, 16 Feb 2021 15:49:19 +0000 (07:49 -0800)]
Merge pull request #39393 from kamoltat/wip-ksirivad-octopus-release-notes

octopus: PendingReleaseNotes: mgr/pg_autoscaler

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
4 years agoMerge pull request #39230 from ifed01/wip-ifed-fix-pin-octopus
Yuri Weinstein [Mon, 15 Feb 2021 16:47:43 +0000 (08:47 -0800)]
Merge pull request #39230 from ifed01/wip-ifed-fix-pin-octopus

octopus: os/bluestore: fixing onode pinning and more

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
4 years agoMerge pull request #39004 from Vicente-Cheng/wip-48568-octopus
Yuri Weinstein [Mon, 15 Feb 2021 16:16:22 +0000 (08:16 -0800)]
Merge pull request #39004 from Vicente-Cheng/wip-48568-octopus

octopus: qa/tasks/cephfs/nfs: Check if host ip is in cluster info output

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
4 years agoUpdate batch.py 39469/head
jshen28 [Mon, 14 Dec 2020 06:54:46 +0000 (14:54 +0800)]
Update batch.py

Correct a typo

Signed-off-by: shenjiatong <yshxxsjt715@gmail.com>
(cherry picked from commit aa5f48780e469b3ed90f251a01cfa3e2a4f7beb0)

4 years agoPendingReleaseNotes: mgr/pg_autoscaler 39393/head
Kamoltat [Wed, 10 Feb 2021 09:19:52 +0000 (09:19 +0000)]
PendingReleaseNotes: mgr/pg_autoscaler

Added details describing the changes that
occured in after merging #39248 into octopus
upstream.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
4 years agomgr/rbd_support: create mirror snapshots asynchronously 39376/head
Mykola Golub [Wed, 21 Oct 2020 17:07:16 +0000 (18:07 +0100)]
mgr/rbd_support: create mirror snapshots asynchronously

To scale up with number of images.

Fixes: https://tracker.ceph.com/issues/47827
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 08151a191fd41427a751d966d523cacead5fe8fe)

Conflicts:
src/pybind/mgr/rbd_support/mirror_snapshot_schedule.py: fixed close_image bug

4 years agomgr/rbd_support: attempt to unregister watcher on mgr exit
Mykola Golub [Wed, 11 Mar 2020 15:03:12 +0000 (15:03 +0000)]
mgr/rbd_support: attempt to unregister watcher on mgr exit

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 0bcaa261510f5bf2c69f2fe411ea3e2efe37ba60)

4 years agomgr/rbd_support: make mirror_snapshot_schedule rescan only updated pools
Mykola Golub [Sat, 7 Mar 2020 10:15:44 +0000 (10:15 +0000)]
mgr/rbd_support: make mirror_snapshot_schedule rescan only updated pools

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 69259c8d3722830c13da1e33f61fb6a72151b803)

4 years agopybind/rbd: add async mirror image get mode and info methods
Mykola Golub [Mon, 26 Oct 2020 11:09:28 +0000 (11:09 +0000)]
pybind/rbd: add async mirror image get mode and info methods

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 13ce488d7aaf60f85429c2e4c036362d61e5f763)

4 years agolibrbd: add missing declaration of rbd_aio_mirror_image_get_mode
Mykola Golub [Mon, 26 Oct 2020 11:06:09 +0000 (11:06 +0000)]
librbd: add missing declaration of rbd_aio_mirror_image_get_mode

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit fd5e642cd74c02e8ef00b7018baaa3093167a01f)

4 years agopybind/rbd: add image async open and close methods
Mykola Golub [Fri, 23 Oct 2020 10:38:21 +0000 (11:38 +0100)]
pybind/rbd: add image async open and close methods

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit b27db87c0391231b39ecd4b5aacf8ac24193c1cf)

4 years agopybind/rbd: async API for creating mirror snapshots
Mykola Golub [Wed, 21 Oct 2020 12:38:31 +0000 (13:38 +0100)]
pybind/rbd: async API for creating mirror snapshots

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit d1571ed2743f97280a2f3a2a70fff59e0cafc0b9)

Conflicts:
src/pybind/rbd/rbd.pyx: trival resolution re: quiesce flags

4 years agolibrbd: async API for creating mirror snapshots
Mykola Golub [Mon, 12 Oct 2020 09:25:46 +0000 (10:25 +0100)]
librbd: async API for creating mirror snapshots

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit d8468ec7e49d93860c3b8b06ff36bde539d10a94)

Conflicts:
src/librbd/api/Mirror.h/cc: no quiesce flags
src/test/rbd_mirror/test_ImageReplayer.cc: no quiesce flags

4 years agoMerge pull request #39000 from Vicente-Cheng/wip-48521-octopus
Yuri Weinstein [Wed, 10 Feb 2021 00:05:46 +0000 (16:05 -0800)]
Merge pull request #39000 from Vicente-Cheng/wip-48521-octopus

octopus: cephfs: client: add ceph.{cluster_fsid/client_id} vxattrs suppport

Reviewed-by: Ramana Raja <rraja@redhat.com>
4 years agoMerge pull request #38949 from Vicente-Cheng/wip-48644-octopus
Yuri Weinstein [Wed, 10 Feb 2021 00:05:18 +0000 (16:05 -0800)]
Merge pull request #38949 from Vicente-Cheng/wip-48644-octopus

octopus: cephfs: client: ensure we take Fs caps when fetching directory link count from cached inode

Reviewed-by: Ramana Raja <rraja@redhat.com>
4 years agoMerge pull request #38947 from Vicente-Cheng/wip-48642-octopus
Yuri Weinstein [Wed, 10 Feb 2021 00:04:48 +0000 (16:04 -0800)]
Merge pull request #38947 from Vicente-Cheng/wip-48642-octopus

octopus: cephfs: client: set CEPH_STAT_RSTAT mask for dir in readdir_r_cb

Reviewed-by: Ramana Raja <rraja@redhat.com>
4 years agoMerge pull request #38612 from ShyamsundarR/wip-47158-octopus
Yuri Weinstein [Wed, 10 Feb 2021 00:04:17 +0000 (16:04 -0800)]
Merge pull request #38612 from ShyamsundarR/wip-47158-octopus

octopus: mgr/volumes: Add a per subvolume trash

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
4 years agoMerge pull request #38466 from Vicente-Cheng/wip-48458-octopus
Yuri Weinstein [Wed, 10 Feb 2021 00:01:59 +0000 (16:01 -0800)]
Merge pull request #38466 from Vicente-Cheng/wip-48458-octopus

octopus: cephfs: client: do not use g_conf().get_val<>() in libcephfs

Reviewed-by: Ramana Raja <rraja@redhat.com>
4 years agopybind/rados: don't try to close watch in dealoc if rados not connected
Mykola Golub [Thu, 12 Mar 2020 09:42:05 +0000 (09:42 +0000)]
pybind/rados: don't try to close watch in dealoc if rados not connected

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit eeee5578877b2c96aa46d5ee427ea5c369a42501)

4 years agopybind/rados: add watch object bindings
Mykola Golub [Tue, 3 Mar 2020 13:24:06 +0000 (13:24 +0000)]
pybind/rados: add watch object bindings

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit dfef23d6d3fdf162f48f909b90c10577f03116bc)

4 years agopybind/rados: add Ioctx dup method
Mykola Golub [Wed, 11 Mar 2020 11:28:26 +0000 (11:28 +0000)]
pybind/rados: add Ioctx dup method

Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit 0ec9cfcf13a1346a628962d315ed19a37e398eba)

4 years agopybind/rados: correct the declarations of C APIs
Kefu Chai [Mon, 12 Oct 2020 07:38:48 +0000 (15:38 +0800)]
pybind/rados: correct the declarations of C APIs

so they are consistent with the ones declared in include/rados/librados.h

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 31db9ce5dc21c769d78e615c2335bd2dbd94f321)

Conflicts:
src/pybind/rados/rados.pyx: trivial resolution

4 years agoMerge pull request #39161 from smithfarm/wip-48496-octopus
Yuri Weinstein [Mon, 8 Feb 2021 19:28:16 +0000 (11:28 -0800)]
Merge pull request #39161 from smithfarm/wip-48496-octopus

octopus: mon: paxos: Delete logger in destructor

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
4 years agoMerge pull request #39120 from rhcs-dashboard/wip-48739-octopus
Yuri Weinstein [Mon, 8 Feb 2021 19:27:45 +0000 (11:27 -0800)]
Merge pull request #39120 from rhcs-dashboard/wip-48739-octopus

octopus: mgr/dashboard: Use secure cookies to store JWT Token

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
4 years agoMerge pull request #39248 from kamoltat/wip-ksirivad-octopus-backports
Yuri Weinstein [Mon, 8 Feb 2021 19:04:08 +0000 (11:04 -0800)]
Merge pull request #39248 from kamoltat/wip-ksirivad-octopus-backports

octopus: mgr/pg_autoscaler: avoid scale-down until there is pressure

Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39122 from smithfarm/wip-48692-octopus
Yuri Weinstein [Mon, 8 Feb 2021 16:18:46 +0000 (08:18 -0800)]
Merge pull request #39122 from smithfarm/wip-48692-octopus

octopus: librbd: clear implicitly enabled feature bits when creating images

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
4 years agoMerge pull request #38474 from ifed01/wip-ifed-fix-avl-octopus
Yuri Weinstein [Mon, 8 Feb 2021 16:17:17 +0000 (08:17 -0800)]
Merge pull request #38474 from ifed01/wip-ifed-fix-avl-octopus

octopus: os/bluestore: fix inappropriate ENOSPC from avl/hybrid allocator

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
4 years agoMerge pull request #38040 from kshtsk/wip-octopuse-cephadm-bootstrap-remote
Yuri Weinstein [Mon, 8 Feb 2021 16:16:28 +0000 (08:16 -0800)]
Merge pull request #38040 from kshtsk/wip-octopuse-cephadm-bootstrap-remote

octopus: tests: qa/task/cephadm: run cephadm only on bootstrap_remote

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
4 years agoMerge pull request #38184 from smithfarm/wip-48101-octopus
Yuri Weinstein [Mon, 8 Feb 2021 16:11:29 +0000 (08:11 -0800)]
Merge pull request #38184 from smithfarm/wip-48101-octopus

octopus: rgw/rgw-admin: fixes BucketInfo for missing buckets

Reviewed-by: Casey Bodley <cbodley@redhat.com>
4 years agoMerge pull request #39169 from sebastian-philipp/octopus-backport-38978
Sebastian Wagner [Mon, 8 Feb 2021 14:37:19 +0000 (15:37 +0100)]
Merge pull request #39169 from sebastian-philipp/octopus-backport-38978

octopus: mgr/cephadm: raise HEALTH_WARN when cephadm daemon in 'error' state

Reviewed-by: Sage Weil <sage@redhat.com>
4 years agoMerge pull request #39321 from idryomov/wip-krbd-stable-writes-attr-octopus
Ilya Dryomov [Fri, 5 Feb 2021 21:06:02 +0000 (22:06 +0100)]
Merge pull request #39321 from idryomov/wip-krbd-stable-writes-attr-octopus

octopus: qa: krbd_stable_pages_required.sh: move to stable_writes attribute

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38422 from smithfarm/wip-48285-octopus
Yuri Weinstein [Fri, 5 Feb 2021 16:44:44 +0000 (08:44 -0800)]
Merge pull request #38422 from smithfarm/wip-48285-octopus

octopus: qa: ignore evicted client warnings

Reviewed-by: Neha Ojha <nojha@redhat.com>
4 years agoMerge pull request #39297 from sebastian-philipp/octopus-backport-39106
Sebastian Wagner [Fri, 5 Feb 2021 14:43:07 +0000 (15:43 +0100)]
Merge pull request #39297 from sebastian-philipp/octopus-backport-39106

octopus: cephadm: use `apt-get` for package install/update

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
4 years agoMerge pull request #39300 from sebastian-philipp/octopus-backport-38998-38927
Sebastian Wagner [Fri, 5 Feb 2021 14:42:51 +0000 (15:42 +0100)]
Merge pull request #39300 from sebastian-philipp/octopus-backport-38998-38927

octopus: mgr/cephadm: try again calling ceph-volume without --filter-for-batch

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
4 years agoqa: krbd_stable_pages_required.sh: move to stable_writes attribute 39321/head
Ilya Dryomov [Thu, 3 Dec 2020 10:24:32 +0000 (11:24 +0100)]
qa: krbd_stable_pages_required.sh: move to stable_writes attribute

bdi/stable_pages_required attribute was deprecated in 5.10 and now
always returns 0.  The replacement is queue/stable_writes.  (It is
also writeable, so we can simplify these test cases somewhat in the
future.)

Fixes: https://tracker.ceph.com/issues/48232
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5adfc15b873bc16d698e7398d3ef2c2a46e8a9df)

4 years agoMerge pull request #39203 from idryomov/wip-krbd-msgr2-octopus
Ilya Dryomov [Fri, 5 Feb 2021 12:51:19 +0000 (13:51 +0100)]
Merge pull request #39203 from idryomov/wip-krbd-msgr2-octopus

octopus: krbd: add support for msgr2 (kernel 5.11)

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
4 years agoMerge pull request #38893 from smithfarm/wip-48519-octopus
Yuri Weinstein [Thu, 4 Feb 2021 18:22:38 +0000 (10:22 -0800)]
Merge pull request #38893 from smithfarm/wip-48519-octopus

octopus: pybind/cephfs: fix missing terminating NULL char in readlink()'s C string

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
4 years agoMerge pull request #38424 from smithfarm/wip-48375-octopus
Yuri Weinstein [Thu, 4 Feb 2021 18:22:05 +0000 (10:22 -0800)]
Merge pull request #38424 from smithfarm/wip-48375-octopus

octopus: cephfs: client: check rdonly file handle on truncate

Reviewed-by: Ramana Raja <rraja@redhat.com>
4 years agoMerge pull request #38352 from smithfarm/wip-48370-octopus
Yuri Weinstein [Thu, 4 Feb 2021 18:21:35 +0000 (10:21 -0800)]
Merge pull request #38352 from smithfarm/wip-48370-octopus

octopus: cephfs: mds: dir->mark_new() should together with dir->mark_dirty()

Reviewed-by: Ramana Raja <rraja@redhat.com>
4 years agoMerge pull request #38349 from smithfarm/wip-48129-octopus
Yuri Weinstein [Thu, 4 Feb 2021 18:21:03 +0000 (10:21 -0800)]
Merge pull request #38349 from smithfarm/wip-48129-octopus

octopus: cephfs: release client dentry_lease before send caps release to mds

Reviewed-by: Ramana Raja <rraja@redhat.com>
4 years agomgr/dashboard/monitoring: upgrade Grafana version due to CVE-2020-13379 39306/head
Alfonso Martínez [Thu, 7 Jan 2021 15:53:26 +0000 (16:53 +0100)]
mgr/dashboard/monitoring: upgrade Grafana version due to CVE-2020-13379

Fixes: https://tracker.ceph.com/issues/48685
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 9441fda4dc9f0257c3b686de811a01f047ef9f53)

 Conflicts:
monitoring/grafana/build/Makefile
          - Remove file as it does not exist on octopus.
src/pybind/mgr/cephadm/module.py
          - Resolve conflicts.