]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Soumya Koduri [Tue, 8 Feb 2022 10:02:16 +0000 (15:32 +0530)]
rgw/dbstore: Add dbstore-tests to `make check`
Include and run dbstore-tests as part of `make check` target
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Soumya Koduri [Tue, 8 Feb 2022 17:14:45 +0000 (22:44 +0530)]
Merge pull request #44813 from soumyakoduri/wip-skoduri-dbstore-obj-id
rgw/dbstore: Use Object ID to handle I/O concurrency
Casey Bodley [Tue, 8 Feb 2022 15:27:01 +0000 (10:27 -0500)]
Merge pull request #44678 from kipdoudou/master
rgw: CopyObject works with x-amz-copy-source-if-* headers
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Soumya Koduri [Thu, 3 Feb 2022 18:55:22 +0000 (00:25 +0530)]
rgw/dbstore: Handle read vs delete races
Now that tail objects are associated with objectID, they are not deleted
as part of this DeleteObj operation. Such tail objects (with no head object
in *.object.table are cleaned up later by GC thread.
To avoid races between writes/reads & GC delete, mtime is maintained for each
tail object. This mtime is updated when tail object is written and also when
its corresponding head object is deleted (like here in this case).
Also done some cleanup.
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Laura Flores [Tue, 8 Feb 2022 13:53:02 +0000 (07:53 -0600)]
Merge pull request #44930 from rishabh-d-dave/py-req-fix
Venky Shankar [Tue, 8 Feb 2022 13:06:56 +0000 (18:36 +0530)]
Merge pull request #44667 from dvanders/dvanders_oft
mds: mds_oft_prefetch_dirfrags default to false
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Ronen Friedman [Tue, 8 Feb 2022 12:59:10 +0000 (14:59 +0200)]
Merge pull request #44922 from ronen-fr/wip-rf-fix-bescrub-test
osd/scrub: fix unintended changes to scrub (cluster)logs
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Daniel Gryniewicz [Tue, 8 Feb 2022 12:29:25 +0000 (07:29 -0500)]
Merge pull request #44927 from dang/wip-dang-cloud-tier
RGW - Move early return
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Ronen Friedman [Sun, 30 Jan 2022 15:23:39 +0000 (15:23 +0000)]
osd/scrub: fix unintended changes to scrub (cluster)logs
OSD logs and cluster logs are monitored by some scrub tests:
some specific strings are required to either appear or not appear in
the logs. The Scrubber backend PR has unintentionally modified some
of these logs, and here we restore the exact logs text.
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
Rishabh Dave [Mon, 7 Feb 2022 18:44:42 +0000 (00:14 +0530)]
monitoring: mention PyYAML only once in requirements
Following error occurs while running "sudo install-deps.sh" -
ERROR: Double requirement given: PyYAML==6.0 (from -r requirements-lint.txt (line 5)) (already in pyyaml (from -r requirements-alerts.txt (line 1)), name='PyYAML')
PyYAML is mentioned twice as a requirement. It is mentioned once in both
the following files -
monitoring/ceph-mixin/requirements-lint.txt
monitoring/ceph-mixin/requirements-alerts.txt
These requirements were added in commits
44d3e4c264506154373ffaeb13d6c924c580e6b5 and
4750ac0d7766a8a089adf073415af0ac0d3f81d9 .
Fixes: https://tracker.ceph.com/issues/54185
Signed-off-by: Rishabh Dave <ridave@redhat.com>
Samuel Just [Tue, 8 Feb 2022 05:37:19 +0000 (21:37 -0800)]
Merge pull request #44921 from cyx1231st/wip-seastore-cleanup-lba
crimson/os/seastore/lba_manager: consolidate logs
Reviewed-by: Samuel Just <sjust@redhat.com>
Soumya Koduri [Tue, 8 Feb 2022 04:00:41 +0000 (09:30 +0530)]
Merge pull request #44916 from joke-lee/dbstore-test-init-env
rgw: fix dbstore test init env wrong
Yingxin Cheng [Mon, 7 Feb 2022 10:46:40 +0000 (18:46 +0800)]
crimson/os/seastore/lba_manager: introduce subsys seastore_lba_details
We will share the lba tree implementation, so classify the related logs
and rename to seastore_lba_details for now.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Mon, 7 Feb 2022 10:50:47 +0000 (18:50 +0800)]
crimson/os/seastore/lba_manager: consolidate logs
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yuri Weinstein [Mon, 7 Feb 2022 22:49:05 +0000 (14:49 -0800)]
Merge pull request #44713 from aclamk/fix-aclamk-vselector-53906
[BlueStore] Fix problem with volume selector
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Samuel Just [Mon, 7 Feb 2022 21:09:12 +0000 (13:09 -0800)]
Merge pull request #44261 from Matan-B/wip-matanb-c-msgr-network
test/crimson: Inject socket level random delays/failures msgr unit test
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Ali Maredia [Mon, 7 Feb 2022 21:02:40 +0000 (16:02 -0500)]
Merge pull request #44856 from cbodley/wip-54103
qa/rgw: install s3cmd with extra_system_packages
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Ilya Dryomov [Mon, 7 Feb 2022 20:41:06 +0000 (21:41 +0100)]
Merge pull request #44886 from holzman/bugfix-54128
krbd: return error when no initial monitor address found
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Burt Holzman [Wed, 2 Feb 2022 15:18:52 +0000 (09:18 -0600)]
krbd: return error when no initial monitor address found
Since we filter monitor addresses based on ms_mode, check that at
least one address was found.
Otherwise, we mismatch arguments when calling sysfs/add_single_major
which emits a misleading error message to dmesg:
libceph: resolve 'name=user1' (ret=-3): failed
libceph: parse_ips bad ip 'name=user1,key=client.user1'
Fixes: https://tracker.ceph.com/issues/54128
Signed-off-by: Burt Holzman <burt@fnal.gov>
Daniel Gryniewicz [Mon, 7 Feb 2022 15:08:02 +0000 (10:08 -0500)]
RGW - Move early return
When transitioning an object to cloud, there was an early return,
skipping the removal of the cloud target. Fix this to be in the right
place.
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
Ernesto Puerta [Mon, 7 Feb 2022 13:07:43 +0000 (14:07 +0100)]
Merge pull request #44825 from rhcs-dashboard/rgw-dashboard-test-hanging
mgr/dashboard: fix for cephadm e2e failing because of rgw commands getting stuck
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Ernesto Puerta [Mon, 7 Feb 2022 13:02:20 +0000 (14:02 +0100)]
Merge pull request #44920 from rhcs-dashboard/cephadm-bootstrap-fix
cephadm: change shared_folder directory for prometheus and grafana
Reviewed-by: MrFreezeex <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Yingxin Cheng [Mon, 7 Feb 2022 02:32:52 +0000 (10:32 +0800)]
crimson/os/seastore/lba_manager: convert to seastore logging
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Nizamudeen A [Mon, 7 Feb 2022 10:53:29 +0000 (16:23 +0530)]
cephadm: change shared_folder directory for prometheus and grafana
After https://github.com/ceph/ceph/pull/44059 the monitoring/prometheus
and monitoring/grafana/dashboards directories are changed to
monitoring/ceph-mixins. That broke the shared_folders in the cephadm
bootstrap script.
Changed all the instances of monitoring/prometheus and
monitoring/grafana/dashboards to monitoring/ceph-mixins
Also, renaming all the instances of prometheus_alerts.yaml to
prometheus_alerts.yml.
Fixes: https://tracker.ceph.com/issues/54176
Signed-off-by: Nizamudeen A <nia@redhat.com>
Yingxin Cheng [Mon, 7 Feb 2022 10:34:40 +0000 (18:34 +0800)]
crimson/os/seastore/lba_manager: move lba_tree_inner_stats into LBAManager
Cleanup, change stats from LBATree static member to BtreeLBAManager
class member.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
yuliyang_yewu [Mon, 7 Feb 2022 06:23:19 +0000 (14:23 +0800)]
rgw: fix dbstore test init env wrong
fix https://tracker.ceph.com/issues/54174
Signed-off-by: yuliyang_yewu <yuliyang_yewu@cmss.chinamobile.com>
Venky Shankar [Mon, 7 Feb 2022 04:33:31 +0000 (10:03 +0530)]
Merge pull request #44503 from lxbsz/typo1
mds: fix a typo of inode version related comment
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Soumya Koduri [Wed, 26 Jan 2022 19:42:44 +0000 (01:12 +0530)]
rgw/dbstore: Create GC Thread to delete stale objects
Create a gc thread to cleanup the stale tail objects data
XXX: handle read + delete usecase, simple approach could be
to use locks or sqlite transactions in GC
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Soumya Koduri [Thu, 13 Jan 2022 20:44:19 +0000 (02:14 +0530)]
rgw/dbstore: Use Object ID to handle racing writes
Create unique ID for each object upload which will be
atomically updated in the head object at the end. This will
prevent data corruption during concurrent writes.
Incase of Multipart Uploads, upload_id is used as ObjectID.
XXX: The stale or obsolete tail data needs to be deleted
Also addressed invalid usage of CephContext in dbstore tests.
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Ilya Dryomov [Sun, 6 Feb 2022 19:37:31 +0000 (20:37 +0100)]
Merge pull request #44842 from idryomov/wip-krbd-rxbounce-option
rbd: recognize rxbounce map option
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Ilya Dryomov [Sun, 6 Feb 2022 19:32:09 +0000 (20:32 +0100)]
Merge pull request #43910 from sunnyku/wip-rbd-snap-sched
mgr/rbd_support: fix schedule remove
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Matan Breizman [Mon, 29 Nov 2021 14:21:40 +0000 (14:21 +0000)]
test/crimson: inject Socket layer delays/failures msgr utest
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
Casey Bodley [Sat, 5 Feb 2022 13:54:57 +0000 (08:54 -0500)]
Merge pull request #44893 from cfsnyder/wip-54130-oplog-segfault
rgw: fix segfault in OpsLogRados::log when realm is reloaded
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Venky Shankar [Sat, 5 Feb 2022 12:34:29 +0000 (18:04 +0530)]
Merge pull request #44851 from batrick/i54081
mds: add inline flag to MDS bootstrap compat in MDSMap
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Samuel Just [Sat, 5 Feb 2022 05:26:11 +0000 (21:26 -0800)]
Merge pull request #44887 from josephsawaya/vstart-dev
src/vstart.sh: Add --no-restart to vstart & add mkfs logs to osd.stdout
Reviewed-by: Samuel Just <sjust@redhat.com>
wanghao72 [Thu, 20 Jan 2022 07:57:29 +0000 (15:57 +0800)]
rgw: CopyObject works with x-amz-copy-source-if-* headers
CopyObject api support condition headers, eg x-amz-copy-source-if-match, while radosgw miss out the 'source' keyword
Fixes: https://tracker.ceph.com/issues/53945
Signed-off-by: Wang Hao <wanghao72@baidu.com>
Joseph Sawaya [Thu, 3 Feb 2022 16:46:44 +0000 (11:46 -0500)]
src/vstart.sh: Add --no-restart to vstart & add mkfs logs to osd.stdout
The output of mkfs wasn't also being included in the OSD's log before this which
can make it more difficult to debug issues with mkfs.
ceph-run restarting every 5 seconds can make it difficult to read the osd's stdout.
Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
Neha Ojha [Fri, 4 Feb 2022 19:56:08 +0000 (11:56 -0800)]
Merge pull request #44868 from neha-ojha/wip-move-to-stream
qa/distros: remove centos8
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Casey Bodley [Fri, 4 Feb 2022 19:55:07 +0000 (14:55 -0500)]
Merge pull request #44866 from yuvalif/wip-yuval-fix-datalog-list
rgw/admin: fix radosgw-admin datalog list max-entries issue
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Casey Bodley [Fri, 4 Feb 2022 19:54:36 +0000 (14:54 -0500)]
Merge pull request #44386 from ivancich/wip-reshard-tentative-goal
rgw: in bucket reshard list, clarify new num shards is tentative
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Casey Bodley [Fri, 4 Feb 2022 19:50:45 +0000 (14:50 -0500)]
Merge pull request #42330 from SWJTU-ZhangLei/wip-rgw-postobj
rgw: RGWPostObj::execute() may lost data.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 4 Feb 2022 19:50:27 +0000 (14:50 -0500)]
Merge pull request #44743 from linuxbox2/wip-rgwlc-lcgetv
rgwlc: fix compat-decoding of cls_rgw_lc_get_entry_ret
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 4 Feb 2022 19:50:10 +0000 (14:50 -0500)]
Merge pull request #44137 from ivancich/wip-fix-reshard-cancel
rgw: "reshard cancel" errors with "invalid argument"
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 4 Feb 2022 19:49:47 +0000 (14:49 -0500)]
Merge pull request #44892 from trociny/wip-54119
rgw: check bucket shard init status in RGWRadosBILogTrimCR
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Ilya Dryomov [Mon, 31 Jan 2022 13:08:26 +0000 (14:08 +0100)]
qa/suites/krbd: add legacy+rxbounce and crc+rxbounce coverage
For basic, rbd and rbd-nomount subsuites, replace legacy and crc
facets with "legacy or legacy+rxbounce" and "crc or crc+rxbounce"
facets (chosen at random).
For fsx, singleton and thrash subsuites, add legacy+rxbounce and
crc+rxbounce facets and drop prefer-crc facet. The expected behaviour
of the latter depends on cluster configuration and should be tested
separately.
The total number of jobs remains the same.
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
Ilya Dryomov [Thu, 27 Jan 2022 16:15:01 +0000 (17:15 +0100)]
qa: krbd rxbounce test
Lives in its own directory since ms_mode doesn't need to be permuted
here.
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
Ilya Dryomov [Wed, 26 Jan 2022 18:36:26 +0000 (19:36 +0100)]
rbd: recognize rxbounce map option
Fixes: https://tracker.ceph.com/issues/54063
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
Neha Ojha [Fri, 4 Feb 2022 17:31:16 +0000 (09:31 -0800)]
Merge pull request #44563 from benhanokh/NCB_new_alloc_map
BlueStore:NCB:Bug-Fix for recovery code with shared blobs
Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
Ernesto Puerta [Fri, 4 Feb 2022 16:42:08 +0000 (17:42 +0100)]
Merge pull request #44796 from pcuzner/remove-old-mib
monitoring: remove old MIB
Reviewed-by: Alfonso MartÃnez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Ernesto Puerta [Fri, 4 Feb 2022 16:35:54 +0000 (17:35 +0100)]
Merge pull request #44857 from rhcs-dashboard/test-doc-dash-cephadm
doc: update kcli test env documentation
Reviewed-by: Alfonso MartÃnez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Ernesto Puerta [Fri, 4 Feb 2022 16:28:44 +0000 (17:28 +0100)]
Merge pull request #44059 from MrFreezeex/mixins
mgr/dashboard: monitoring: refactor into ceph-mixin
Reviewed-by: Alfonso MartÃnez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Daniel Gryniewicz [Fri, 4 Feb 2022 16:24:58 +0000 (11:24 -0500)]
Merge pull request #44862 from andriytk/fix-put-memleak2
rgw_sal_motr: fix possible memleak on put
Sunny Kumar [Wed, 19 Jan 2022 13:15:52 +0000 (13:15 +0000)]
qa/workunits/rbd: improve schedule add/remove cli test
This patch adds few tests to cover schedule add/remove with invalid
inputs.
Signed-off-by: Sunny Kumar <sunkumar@redhat.com>
Sunny Kumar [Fri, 12 Nov 2021 16:27:55 +0000 (16:27 +0000)]
mgr/rbd_support: fix schedule remove
Issue:
If we provide a random string in the schedule remove
command the entire schedule at specified level gets
removed.
Fixes: https://tracker.ceph.com/issues/53250
Signed-off-by: Sunny Kumar <sunkumar@redhat.com>
Casey Bodley [Fri, 4 Feb 2022 16:04:13 +0000 (11:04 -0500)]
Merge pull request #44348 from soumyakoduri/wip-skoduri-lc-teuthology
rgw/qa: Add test suite for lifecycle cases
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Nizamudeen A [Fri, 28 Jan 2022 13:53:31 +0000 (19:23 +0530)]
mgr/dashboard: fix for cephadm e2e failing because of rgw commands getting stuck
Delaying the rgw service creation in the tests until the cluster is
healthy
also changing the node_ip_offset to 110 because in the jenkins I saw
Fixes: https://tracker.ceph.com/issues/54030
Signed-off-by: Nizamudeen A <nia@redhat.com>
Gabriel BenHanokh [Wed, 12 Jan 2022 12:48:27 +0000 (14:48 +0200)]
os/BlueStore: NCB fixes recovery code with shared blobs
Replaces the BitmapAllocator used by NCB Recovery code with a dedicated SimpleBitmap.
The SimpleBitmap allows for bits to be set multiple times without any adverse effect.
This is needed beacuse shared-blobs will report the same allocation multiple times.
Fixes: https://tracker.ceph.com/issues/53678
Signed-off-by: Gabriel Benhanokh <gbenhano@redhat.com>
Neha Ojha [Thu, 3 Feb 2022 23:36:22 +0000 (15:36 -0800)]
Merge pull request #44003 from zdover23/wip-doc-2021-11-17-start-documenting-ceph-python-pip-update
doc/start: update python-pip to python3-pip
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Neha Ojha [Thu, 3 Feb 2022 23:28:16 +0000 (15:28 -0800)]
Merge pull request #44560 from jdurgin/wip-edit-on-github
doc/conf.py: use links to the 'edit' page for edit on github
Reviewed-by: Neha Ojha <nojha@redhat.com>
Samuel Just [Thu, 3 Feb 2022 23:00:47 +0000 (15:00 -0800)]
Merge pull request #44888 from josephsawaya/zns-dev
crimson/os/seastore: change segment_off_t to seastore_off_t in ZNSSegmentManager
Reviewed-by: Samuel Just <sjust@redhat.com>
Patrick Donnelly [Thu, 3 Feb 2022 21:40:07 +0000 (16:40 -0500)]
Merge PR #44691 into master
* refs/pull/44691/head:
doc: document PI .qa symlinks
qa: fix or add missing .qa links
qa: move .qa terminator
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Cory Snyder [Thu, 3 Feb 2022 19:48:05 +0000 (14:48 -0500)]
rgw: fix segfault in OpsLogRados::log when realm is reloaded
We weren't previously handling the deallocation of the store when
a realm was reloaded. Now passing a const reference to the pointer.
Fixes: https://tracker.ceph.com/issues/54130
Signed-off-by: Cory Snyder <csnyder@iland.com>
Andriy Tkachuk [Wed, 2 Feb 2022 11:25:59 +0000 (11:25 +0000)]
rgw_sal_motr: fix possible memleak on put
Currently, the MotrAtomicWriter::cleanup() is called from
MotrAtomicWriter::commit(), which may not be called at all
by rgw in case of md5 checksum failure.
Solution: call cleanup() from process() when data is zero.
rgw calls Writer::process(data, off) with zero data at the
end of the loop to allow writes to flush the data. From:
src/rgw/rgw_op.cc:RGWPutObj::execute():
op_ret = filter->process(std::move(data), ofs);
...
ofs += len;
} while (len > 0);
// flush any data in filters
op_ret = filter->process({}, ofs);
Signed-off-by: Andriy Tkachuk <andriy.tkachuk@seagate.com>
Reviewed-by: Sining Wu <sining.wu@seagate.com>
Andriy Tkachuk [Thu, 3 Feb 2022 20:23:26 +0000 (20:23 +0000)]
rgw_sal_motr: fix cosmetic issues
- rename acc_bl to acc_data
- drop DEBUG prefix from logs
Signed-off-by: Andriy Tkachuk <andriy.tkachuk@seagate.com>
Neha Ojha [Thu, 3 Feb 2022 17:39:13 +0000 (09:39 -0800)]
Merge pull request #44878 from aclamk/fix-git-id-aclamk
github: fix id and mail
Reviewed-by: Neha Ojha <nojha@redhat.com>
Joseph Sawaya [Thu, 3 Feb 2022 16:49:25 +0000 (11:49 -0500)]
crimson/os/seastore: change segment_off_t to seastore_off_t
Signed-off-by: Joseph Sawaya <josephsawaya938@gmail.com>
Patrick Donnelly [Mon, 31 Jan 2022 22:58:55 +0000 (17:58 -0500)]
mds: add inline feature to MDS bootstrap incompat
File systems that had inline data enabled at some point would have this
bit in the CompatSet "incompat" set. This would conflict during upgrade
with the default v16.2.4 CompatSet assigned to existing (16.2.4-) MDS.
Subsequently, this would cause an assertion in FSMap::sanity during
pending map creation.
This bit will get added anyway during the upgrade process so might as
well add it to the MDS CompatSet during bootstrap.
Fixes: https://tracker.ceph.com/issues/54081
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 31 Jan 2022 22:56:51 +0000 (17:56 -0500)]
mds: throw some feature definitions in static memory
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Mon, 31 Jan 2022 19:11:08 +0000 (14:11 -0500)]
qa: test inline compat set on older MDSMap
Reproduced here:
/ceph/teuthology-archive/pdonnell-2022-01-31_19:13:02-fs:upgrade-master-distro-default-smithi/
6651572 /teuthology.log
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Wed, 2 Feb 2022 13:51:13 +0000 (08:51 -0500)]
doc: document PI .qa symlinks
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Thu, 20 Jan 2022 16:28:19 +0000 (11:28 -0500)]
qa: fix or add missing .qa links
Using this command:
find qa/suites/ -type d -execdir ln -sfT ../.qa/ {}/.qa \;
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Patrick Donnelly [Thu, 20 Jan 2022 16:27:29 +0000 (11:27 -0500)]
qa: move .qa terminator
So links can be elsewhere in the qa suite (not used yet) and to simplify
a find command in a follow-up commit.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Adam Kupczyk [Thu, 3 Feb 2022 14:43:41 +0000 (15:43 +0100)]
github: fix id and mail
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Arthur Outhenin-Chalandre [Mon, 24 Jan 2022 09:01:04 +0000 (10:01 +0100)]
monitoring: build jsonnet/jb only for testing
Build jsonnet and jb in the testso that we can build ceph without
internet access and still be able to run the test needed for monitoring
using jsonnet tools.
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Arthur Outhenin-Chalandre [Wed, 5 Jan 2022 11:06:14 +0000 (12:06 +0100)]
spec: debian: monitoring: build jsonnet from source to use 0.18.0
As this new version is recently released it's still not in every distro
we use. We now build jsonnet from source so that we can use this new
version of jsonnet. This commit could be reverted later on when the new
version would be available everywhere.
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Arthur Outhenin-Chalandre [Tue, 23 Nov 2021 08:30:38 +0000 (09:30 +0100)]
mgr/dashboard: monitoring: refactor into ceph-mixin
Mixin is a way to bundle dashboards, prometheus rules and alerts into
jsonnet package. Shifting to mixin will allow easier integration with
monitoring automation that some users may use.
This commit moves `/monitoring/grafana/dashboards` and
`/monitoring/prometheus` to `/monitoring/ceph-mixin`. Prometheus alerts
was also converted to Jsonnet using an automated way (from yaml to json
to jsonnet). This commit minimises any change made to the generated files
and should not change neithers the dashboards nor the Prometheus alerts.
In the future some configuration will also be added to jsonnet to add
more functionalities to the dashboards or alerts (i.e.: multi cluster).
Fixes: https://tracker.ceph.com/issues/53374
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Arthur Outhenin-Chalandre [Mon, 29 Nov 2021 08:38:57 +0000 (09:38 +0100)]
spec: debian: add golang as build dependency
Add golang as a build dependency to build golang project in the test
for monitoring/ceph-mixin.
Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Mykola Golub [Wed, 2 Feb 2022 18:25:33 +0000 (18:25 +0000)]
rgw: check bucket shard init status in RGWRadosBILogTrimCR
to avoid using not properly initialized bs.bucket_obj.
Fixes: https://tracker.ceph.com/issues/54119
Signed-off-by: Mykola Golub <mgolub@suse.com>
Pere Diaz Bou [Thu, 3 Feb 2022 06:49:46 +0000 (07:49 +0100)]
Merge pull request #44812 from rhcs-dashboard/box-remove-error
cephadm/box: fix remove image tar error
Yingxin [Thu, 3 Feb 2022 03:56:38 +0000 (11:56 +0800)]
Merge pull request #44832 from cyx1231st/wip-crimson-msgr-test-timeout
test/crimson/test_messenger: increase timeout
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Neha Ojha [Wed, 2 Feb 2022 23:26:54 +0000 (23:26 +0000)]
qa/suites/rados/thrash-old-clients: remove centos_8.3_container_tools_3.0
Signed-off-by: Neha Ojha <nojha@redhat.com>
Neha Ojha [Wed, 2 Feb 2022 20:01:30 +0000 (20:01 +0000)]
qa/distros/container-hosts: remove centos_8.2 and centos_8.3
Related to https://tracker.ceph.com/issues/54087
Signed-off-by: Neha Ojha <nojha@redhat.com>
Neha Ojha [Wed, 2 Feb 2022 19:16:16 +0000 (19:16 +0000)]
qa/distros/podman: remove centos_8.2 and centos_8.3
Related to https://tracker.ceph.com/issues/54087
Signed-off-by: Neha Ojha <nojha@redhat.com>
Adam Kupczyk [Wed, 2 Feb 2022 19:28:14 +0000 (20:28 +0100)]
os/bluestore/bluefs: Make volume selector operations atomic
Make all RocksDBBlueFSVolumeSelector files/extents/size tracking atomic.
It used to be synchronized by BlueFS global lock.
Now, in Fine Grain Locking era, it is necessary to prevent corruption.
Fixes: https://tracker.ceph.com/issues/53906
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Adam Kupczyk [Thu, 20 Jan 2022 12:44:35 +0000 (13:44 +0100)]
os/bluestore/bluefs: Code for volume selector check
Adds ability to verify that volume selector properly tracks disk usage.
Creates options:
- bluefs_check_volume_selector_on_umount
- bluefs_check_volume_selector_often
that can be used to validate that vselector does not diverge from
values it should have.
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Soumya Koduri [Fri, 17 Dec 2021 11:32:37 +0000 (17:02 +0530)]
rgw/qa: Add test suite for lifecycle cases
Execute lifecycle s3-tests in the teuthology test-suite by configuring
required storage classes and 'rgw lc debug interval' option.
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Ernesto Puerta [Wed, 2 Feb 2022 17:39:57 +0000 (18:39 +0100)]
Merge pull request #43707 from BenoitKnecht/ceph-mgr-service-id
mgr: Fix ceph_daemon label in ceph_rgw_* metrics
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Yingxin Cheng [Sat, 29 Jan 2022 02:39:13 +0000 (10:39 +0800)]
test/crimson/test_messenger: increase timeout
120 seconds are still too short for make check, change to 300.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yuval Lifshitz [Wed, 2 Feb 2022 14:53:21 +0000 (16:53 +0200)]
rgw/admin: fix radosgw-admin datalog list max-entries issue
Fixes: https://tracker.ceph.com/issues/54116
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
Ernesto Puerta [Wed, 2 Feb 2022 13:06:57 +0000 (14:06 +0100)]
Merge pull request #44609 from rhcs-dashboard/daemon_action
mgr/dashboard: perform daemon actions
Reviewed-by: Alfonso MartÃnez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Nizamudeen A [Tue, 1 Feb 2022 15:42:14 +0000 (21:12 +0530)]
doc: update dashboard kcli test env documentation
Fixes: https://tracker.ceph.com/issues/54105
Signed-off-by: Nizamudeen A <nia@redhat.com>
Casey Bodley [Mon, 31 Jan 2022 23:08:02 +0000 (18:08 -0500)]
qa/rgw: install s3cmd with extra_system_packages
this was preventing installation on ubuntu because of
https://tracker.ceph.com/issues/25026
Fixes: https://tracker.ceph.com/issues/54103
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Tue, 1 Feb 2022 15:18:13 +0000 (10:18 -0500)]
Merge pull request #44850 from cbodley/wip-qa-rgw-centos8-eol
qa/rgw: rgw/verify no longer pins centos 8.0
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Adam King [Tue, 1 Feb 2022 13:25:11 +0000 (08:25 -0500)]
Merge pull request #44810 from rkachach/fix_doc_issue_54018
doc/cephadm: fixing cluster purging section
Reviewed-by: Adam King <adking@redhat.com>
Ilya Dryomov [Tue, 1 Feb 2022 11:08:02 +0000 (12:08 +0100)]
Merge pull request #44834 from idryomov/wip-rbd-image-id-spec
mgr/rbd_support: fix mon command API regressions
Reviewed-by: Mykola Golub <mgolub@suse.com>
Pere Diaz Bou [Thu, 27 Jan 2022 17:29:16 +0000 (18:29 +0100)]
cephadm/box: fix remove image tar error and cleanups
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Neha Ojha [Tue, 1 Feb 2022 03:08:13 +0000 (19:08 -0800)]
Merge pull request #44820 from NitzanMordhai/nitzan-add-email-contact
Nitzan add email contact
Reviewed-by: Neha Ojha <nojha@redhat.com>
Matt Benjamin [Fri, 28 Jan 2022 19:47:34 +0000 (14:47 -0500)]
rgwlc: add cls_rgw_lc_get_entry_ret to rgw_types.h (dencoder)
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Casey Bodley [Mon, 31 Jan 2022 22:49:35 +0000 (17:49 -0500)]
Merge pull request #44408 from linuxbox2/wip-rgwlc-warn-attr
rgwlc: warn on missing RGW_ATTR_LC
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Casey Bodley [Mon, 31 Jan 2022 22:23:25 +0000 (17:23 -0500)]
qa/rgw: rgw/verify no longer pins centos 8.0
the symlink rgw/verify/centos_latest.yaml already selects centos
Signed-off-by: Casey Bodley <cbodley@redhat.com>