]> git.apps.os.sepia.ceph.com Git - s3-tests.git/log
s3-tests.git
18 months agoiam: add account tests for Group apis
Casey Bodley [Sun, 11 Feb 2024 16:50:43 +0000 (11:50 -0500)]
iam: add account tests for Group apis

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: add account test for OpenIDConnectProvider apis
Casey Bodley [Tue, 6 Feb 2024 22:57:14 +0000 (17:57 -0500)]
iam: add account test for OpenIDConnectProvider apis

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: test cross-account permissions
Casey Bodley [Tue, 30 Jan 2024 23:17:17 +0000 (18:17 -0500)]
iam: test cross-account permissions

test the [iam alt root] user's access to buckets owned by [iam root]
using various policy principals and acl grantees

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoconfig: add [iam alt root] for an alt account's root user
Casey Bodley [Tue, 30 Jan 2024 23:16:40 +0000 (18:16 -0500)]
config: add [iam alt root] for an alt account's root user

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: test managed role policy
Casey Bodley [Sun, 4 Feb 2024 23:07:09 +0000 (18:07 -0500)]
iam: test managed role policy

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: add account test for RolePolicy apis
Casey Bodley [Fri, 26 Jan 2024 20:51:55 +0000 (15:51 -0500)]
iam: add account test for RolePolicy apis

adds test cases for the following iam actions:
* PutRolePolicy
* GetRolePolicy
* DeleteRolePolicy
* ListRolePolicies

verified to pass against aws when an account root user's credentials are
provided in the [iam] section of s3tests.conf

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: add account tests for Role apis
Casey Bodley [Fri, 26 Jan 2024 20:23:40 +0000 (15:23 -0500)]
iam: add account tests for Role apis

adds test cases for the following iam actions:
* CreateRole
* GetRole
* ListRoles
* DeleteRole
* UpdateRole

verified to pass against aws when an account root user's credentials are
provided in the [iam] section of s3tests.conf

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: test managed user policy
Casey Bodley [Sun, 4 Feb 2024 23:06:39 +0000 (18:06 -0500)]
iam: test managed user policy

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: add account tests for UserPolicy apis
Casey Bodley [Fri, 12 Jan 2024 03:49:54 +0000 (22:49 -0500)]
iam: add account tests for UserPolicy apis

adds test cases for the following iam actions:
* PutUserPolicy
* GetUserPolicy
* DeleteUserPolicy
* ListUserPolicies

verified to pass against aws when an account root user's credentials are
provided in the [iam] section of s3tests.conf

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: test bucket policy principal for iam user with path
Casey Bodley [Tue, 2 Jan 2024 00:11:24 +0000 (19:11 -0500)]
iam: test bucket policy principal for iam user with path

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: add tests for AccessKey apis
Casey Bodley [Wed, 20 Dec 2023 19:17:35 +0000 (14:17 -0500)]
iam: add tests for AccessKey apis

adds test cases for the following iam actions:
* CreateAccessKey
* UpdateAccessKey
* DeleteAccessKey
* ListAccessKeys

verified to pass against aws when an account root user's credentials are
provided in the [iam] section of s3tests.conf

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: add tests for User apis
Casey Bodley [Tue, 19 Dec 2023 15:26:19 +0000 (10:26 -0500)]
iam: add tests for User apis

adds test cases for the following iam actions:
* CreateUser
* GetUser
* UpdateUser
* DeleteUser
* ListUsers

verified to pass against aws when an account root user's credentials are
provided in the [iam] section of s3tests.conf

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoconfig: add [iam root] for an account root user
Casey Bodley [Sun, 4 Feb 2024 23:25:31 +0000 (18:25 -0500)]
config: add [iam root] for an account root user

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoconfig: parse iam config during setup()
Casey Bodley [Tue, 2 Jan 2024 00:08:10 +0000 (19:08 -0500)]
config: parse iam config during setup()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoiam: rename test_of_iam mark to iam_tenant
Casey Bodley [Fri, 12 Jan 2024 03:45:03 +0000 (22:45 -0500)]
iam: rename test_of_iam mark to iam_tenant

differentiate the test cases that expect a tenant-wide IAM api from new
ones that expect an account-wide api

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoconfig: add fixtures for iam name/path prefixes
Casey Bodley [Fri, 12 Jan 2024 03:42:24 +0000 (22:42 -0500)]
config: add fixtures for iam name/path prefixes

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agofixtures: split setup() and configure()
Casey Bodley [Fri, 12 Jan 2024 03:38:17 +0000 (22:38 -0500)]
fixtures: split setup() and configure()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoMerge pull request #555 from cbodley/wip-64822
Casey Bodley [Sun, 10 Mar 2024 14:43:36 +0000 (14:43 +0000)]
Merge pull request #555 from cbodley/wip-64822

test_headers: use fixture to hook request headers

18 months agotest_headers: use fixture to hook request headers 555/head
Casey Bodley [Sun, 10 Mar 2024 14:39:26 +0000 (10:39 -0400)]
test_headers: use fixture to hook request headers

Signed-off-by: Casey Bodley <cbodley@redhat.com>
18 months agoMerge pull request #547 from cbodley/wip-63724
Casey Bodley [Fri, 8 Mar 2024 19:14:19 +0000 (19:14 +0000)]
Merge pull request #547 from cbodley/wip-63724

s3: object lock tests for deletion of multipart objects

18 months agoMerge pull request #551 from clwluvw/bucket-public-block
Casey Bodley [Thu, 7 Mar 2024 15:55:37 +0000 (15:55 +0000)]
Merge pull request #551 from clwluvw/bucket-public-block

BucketPublicAccessBlock: compatibility issues

19 months agoMerge pull request #552 from alimaredia/lc-utcnow-fix
Ali Maredia [Wed, 21 Feb 2024 17:29:17 +0000 (12:29 -0500)]
Merge pull request #552 from alimaredia/lc-utcnow-fix

replace datetime.now with datetime.utcnow()

19 months agoreplace datetime.now with datetime.utcnow() 552/head
Ali Maredia [Tue, 20 Feb 2024 17:17:32 +0000 (12:17 -0500)]
replace datetime.now with datetime.utcnow()

when the local timezone is not UTC and if it is a day behind,
lifecycle_header tests fails with 2 days not equal to 1
so replacing datetime.now() with datetime.utcnow()

Signed-off-by: Ali Maredia <amaredia@redhat.com>
19 months agos3: object lock tests for deletion of multipart objects 547/head
Casey Bodley [Fri, 9 Feb 2024 19:22:37 +0000 (14:22 -0500)]
s3: object lock tests for deletion of multipart objects

Signed-off-by: Casey Bodley <cbodley@redhat.com>
19 months agoPublicAccessBlock: test access deny via bucket policy 551/head
Seena Fallah [Mon, 19 Feb 2024 21:43:43 +0000 (22:43 +0100)]
PublicAccessBlock: test access deny via bucket policy

Make sure 403 is returned when access is denied via s3:GetBucketPublicAccessBlock action on GetBucketPublicAccessBlock

Refs: https://github.com/ceph/ceph/pull/55652
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
19 months agoPublicAccessBlock: test 404 on no block configuration
Seena Fallah [Mon, 19 Feb 2024 21:40:12 +0000 (22:40 +0100)]
PublicAccessBlock: test 404 on no block configuration

Make sure NoSuchPublicAccessBlockConfiguration is returned when no public block is configured on bucket:

Refs: https://github.com/ceph/ceph/pull/55652
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
19 months agoMerge pull request #546 from jzhu116-bloomberg/wip-64340
Casey Bodley [Mon, 12 Feb 2024 20:31:18 +0000 (20:31 +0000)]
Merge pull request #546 from jzhu116-bloomberg/wip-64340

add test case for object copy in versioning suspended bucket

19 months agoMerge pull request #544 from tobias-urdin/improve-presigned
Casey Bodley [Mon, 12 Feb 2024 19:51:43 +0000 (19:51 +0000)]
Merge pull request #544 from tobias-urdin/improve-presigned

Add more testing for presigned URLs

19 months agoAdd more testing for presigned URLs 544/head
Tobias Urdin [Sun, 4 Feb 2024 14:28:28 +0000 (14:28 +0000)]
Add more testing for presigned URLs

This improves the testing for presigned URLs for
both get_object and put_object when using
generate_presigned_url().

It covers the case where you pass for example
a x-amz-acl (ACL in params for generated_presigned_url)
header that should be signed.

Tests the regression in [1].

[1] https://tracker.ceph.com/issues/64308

Signed-off-by: Tobias Urdin <tobias.urdin@binero.se>
19 months agotag test_versioning_obj_suspended_copy with fails_on_dbstore 546/head
Jane Zhu [Mon, 12 Feb 2024 17:44:49 +0000 (12:44 -0500)]
tag test_versioning_obj_suspended_copy with fails_on_dbstore

Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
19 months agoadd test case for object copy in versioning suspended bucket
Jane Zhu [Fri, 9 Feb 2024 04:01:12 +0000 (23:01 -0500)]
add test case for object copy in versioning suspended bucket

Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
20 months agoMerge pull request #533 from cbodley/wip-45736
Ali Maredia [Thu, 11 Jan 2024 18:59:03 +0000 (13:59 -0500)]
Merge pull request #533 from cbodley/wip-45736

304 Not Modified tests still expect etag header

21 months agoMerge pull request #532 from cbodley/wip-63537
Ali Maredia [Tue, 28 Nov 2023 20:53:16 +0000 (15:53 -0500)]
Merge pull request #532 from cbodley/wip-63537

object lock: test very large RetainUntilDate

21 months agoMerge pull request #491 from cbodley/wip-get-part
Ali Maredia [Tue, 28 Nov 2023 15:48:47 +0000 (10:48 -0500)]
Merge pull request #491 from cbodley/wip-get-part

test Head/GetObject on completed multipart parts

22 months agotest Head/GetObject on completed multipart parts 491/head
Casey Bodley [Fri, 17 Feb 2023 15:03:59 +0000 (10:03 -0500)]
test Head/GetObject on completed multipart parts

Signed-off-by: Casey Bodley <cbodley@redhat.com>
22 months ago304 Not Modified tests still expect etag header 533/head
Casey Bodley [Tue, 21 Nov 2023 03:47:28 +0000 (22:47 -0500)]
304 Not Modified tests still expect etag header

test case for https://tracker.ceph.com/issues/45736

Signed-off-by: Casey Bodley <cbodley@redhat.com>
22 months agoobject lock: test very large RetainUntilDate 532/head
Casey Bodley [Wed, 15 Nov 2023 21:31:52 +0000 (16:31 -0500)]
object lock: test very large RetainUntilDate

https://tracker.ceph.com/issues/63537 reported that large dates (with
year after 2107) got truncated when written. test with a later date, and
check that get_object_retention() gives back the date we put

Signed-off-by: Casey Bodley <cbodley@redhat.com>
23 months agoMerge pull request #527 from cbodley/wip-63004
Casey Bodley [Mon, 9 Oct 2023 18:56:53 +0000 (19:56 +0100)]
Merge pull request #527 from cbodley/wip-63004

add test_post_object_wrong_bucket() for CVE-2023-43040

23 months agoadd test_post_object_wrong_bucket() 527/head
Casey Bodley [Wed, 27 Sep 2023 18:31:43 +0000 (14:31 -0400)]
add test_post_object_wrong_bucket()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #524 from cbodley/wip-62013
Ali Maredia [Fri, 22 Sep 2023 14:53:42 +0000 (10:53 -0400)]
Merge pull request #524 from cbodley/wip-62013

lc: test transition of plain null version

2 years agoMerge pull request #525 from cbodley/wip-62919
Ali Maredia [Fri, 22 Sep 2023 14:52:28 +0000 (10:52 -0400)]
Merge pull request #525 from cbodley/wip-62919

boto2: fix byte vs. string comparison in verify_object

2 years agoboto2: copy configured_storage_classes() fix from boto3 525/head
Casey Bodley [Thu, 21 Sep 2023 21:42:58 +0000 (17:42 -0400)]
boto2: copy configured_storage_classes() fix from boto3

some boto2 storage class tests are failing because the list returned by
configured_storage_classes() included an empty string

the boto3 version had an extra line that removes empty values; copy that
for boto2

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoboto2: fix byte vs. string comparison in verify_object
Casey Bodley [Thu, 21 Sep 2023 14:00:37 +0000 (10:00 -0400)]
boto2: fix byte vs. string comparison in verify_object

the storage class tests were failing on comparisons between the input
data and output data:

AssertionError: assert 'oFbdZvtRj' == b'oFbdZvtRj'

convert the byte representation back to string for comparison

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #523 from tobias-urdin/http-options-presigned
Casey Bodley [Mon, 21 Aug 2023 19:52:49 +0000 (15:52 -0400)]
Merge pull request #523 from tobias-urdin/http-options-presigned

Add test to verify HTTP OPTIONS on presigned URL

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agoAdd test to verify HTTP OPTIONS on presigned URL 523/head
Tobias Urdin [Wed, 2 Aug 2023 09:28:20 +0000 (09:28 +0000)]
Add test to verify HTTP OPTIONS on presigned URL

Related: https://tracker.ceph.com/issues/62033

Signed-off-by: Tobias Urdin <tobias.urdin@binero.com>
2 years agolc: test transition of plain null version 524/head
Casey Bodley [Fri, 4 Aug 2023 13:54:50 +0000 (09:54 -0400)]
lc: test transition of plain null version

for validating the fix of https://tracker.ceph.com/issues/62013

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #522 from nadavMiz/boto3-tests-readme-clerify
Casey Bodley [Thu, 6 Jul 2023 15:26:28 +0000 (11:26 -0400)]
Merge pull request #522 from nadavMiz/boto3-tests-readme-clerify

Remove filtering from boto3 test example for simplicity

2 years agoremove filtering from boto3 test example for simplicity 522/head
nadav mizrahi [Thu, 29 Jun 2023 13:55:21 +0000 (16:55 +0300)]
remove filtering from boto3 test example for simplicity

2 years agoMerge pull request #517 from cbodley/wip-rm-rgw-stat-bucket-headers
Soumya Koduri [Mon, 3 Jul 2023 04:53:23 +0000 (10:23 +0530)]
Merge pull request #517 from cbodley/wip-rm-rgw-stat-bucket-headers

remove reliance on x-rgw-object-count and x-rgw-bytes-used headers

2 years agoMerge pull request #521 from soumyakoduri/wip-skoduri-setattr
Soumya Koduri [Fri, 30 Jun 2023 12:09:27 +0000 (17:39 +0530)]
Merge pull request #521 from soumyakoduri/wip-skoduri-setattr

Add testcase to verify obj mtime post setattrs

2 years agoAdd testcase to verify obj mtime post setattrs 521/head
Soumya Koduri [Wed, 28 Jun 2023 07:42:54 +0000 (13:12 +0530)]
Add testcase to verify obj mtime post setattrs

Object mtime should not change for any attr changes unless
its a copy operation. Verify the same using PutObjectACL op.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2 years agoremove reliance on x-rgw-object-count and x-rgw-bytes-used headers 517/head
Casey Bodley [Wed, 21 Jun 2023 17:20:53 +0000 (13:20 -0400)]
remove reliance on x-rgw-object-count and x-rgw-bytes-used headers

stop using head_bucket() to fetch these response headers, and use
list_objects_v2() instead to count objects and sizes

Fixes: #315
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #513 from galsalomon66/using_get_bucket_name
Ali Maredia [Wed, 21 Jun 2023 19:32:59 +0000 (15:32 -0400)]
Merge pull request #513 from galsalomon66/using_get_bucket_name

Using get bucket name

2 years agoMerge pull request #266 from theanalyst/wip-38700-range
Casey Bodley [Wed, 14 Jun 2023 20:11:52 +0000 (16:11 -0400)]
Merge pull request #266 from theanalyst/wip-38700-range

add multipart ranges to encryption tests

2 years agoMerge pull request #514 from cbodley/wip-tox-readme
Ali Maredia [Mon, 12 Jun 2023 18:08:01 +0000 (14:08 -0400)]
Merge pull request #514 from cbodley/wip-tox-readme

readme: change fails_on_aws back to fails_on_rgw

2 years agoreadme: change fails_on_aws back to fails_on_rgw 514/head
Casey Bodley [Mon, 12 Jun 2023 17:33:44 +0000 (13:33 -0400)]
readme: change fails_on_aws back to fails_on_rgw

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge branch 'master' into using_get_bucket_name 513/head
Gal Salomon [Thu, 8 Jun 2023 07:19:37 +0000 (10:19 +0300)]
Merge branch 'master' into using_get_bucket_name

2 years agoinstead of hard-coded bucket-name using get_bucket_name.merging PR #488 alphaprinz
galsalomon66 [Thu, 8 Jun 2023 07:07:54 +0000 (10:07 +0300)]
instead of hard-coded bucket-name using get_bucket_name.merging PR #488 alphaprinz

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2 years agoboto3/test_s3: add ranges around part boundary for encryption tests 266/head
Abhishek Lekshmanan [Tue, 26 Mar 2019 10:24:06 +0000 (11:24 +0100)]
boto3/test_s3: add ranges around part boundary for encryption tests

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2 years agoboto3/test_s3: range encoding helper function takes a size argument
Abhishek Lekshmanan [Tue, 26 Mar 2019 10:22:00 +0000 (11:22 +0100)]
boto3/test_s3: range encoding helper function takes a size argument

This is to avoid a get_object call for every range check as the object size will
not change during this duration and we'd most likely already know the object
sizes beforehand

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2 years agosse: add sse-c test with unaligned multipart parts
Casey Bodley [Fri, 22 Mar 2019 15:41:44 +0000 (11:41 -0400)]
sse: add sse-c test with unaligned multipart parts

Fixes: http://tracker.ceph.com/issues/38700
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #463 from cfsnyder/wip-56646
Casey Bodley [Wed, 17 May 2023 18:33:11 +0000 (14:33 -0400)]
Merge pull request #463 from cfsnyder/wip-56646

Add test_versioning_concurrent_multi_object_delete

2 years agoAdd test_versioning_concurrent_multi_object_delete 463/head
Cory Snyder [Thu, 21 Jul 2022 18:33:51 +0000 (18:33 +0000)]
Add test_versioning_concurrent_multi_object_delete

Tests that concurrent multi-object delete requests which specify
the same versioned object instances return successful object
responses within response body.

relates to: https://tracker.ceph.com/issues/56646

Signed-off-by: Cory Snyder <csnyder@iland.com>
2 years agoMerge pull request #506 from galsalomon66/json_s3tests
Casey Bodley [Mon, 15 May 2023 14:36:15 +0000 (10:36 -0400)]
Merge pull request #506 from galsalomon66/json_s3tests

Json s3tests

2 years agoMerge pull request #505 from cbodley/wip-59218
Ali Maredia [Tue, 11 Apr 2023 02:41:11 +0000 (22:41 -0400)]
Merge pull request #505 from cbodley/wip-59218

test_sse_s3_default_multipart_upload verifies encryption header

2 years agoprogress nessage is sent back upon processing the object, the change make sure it... 506/head
galsalomon66 [Mon, 10 Apr 2023 09:26:59 +0000 (12:26 +0300)]
progress nessage is sent back upon processing the object, the change make sure it stay with the max result

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2 years agomodifying of the run_s3select routine; to handle the different statuses (progress...
galsalomon66 [Sun, 9 Apr 2023 12:02:24 +0000 (15:02 +0300)]
modifying of the run_s3select routine; to handle the different statuses (progress,stats,end)

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2 years agoMerge pull request #501 from mkogan1/wip-chunked-trans-enc
Casey Bodley [Fri, 7 Apr 2023 13:19:38 +0000 (09:19 -0400)]
Merge pull request #501 from mkogan1/wip-chunked-trans-enc

Test object PUT with chunked transfer encoding

2 years agoupon removing the payload tag, the response index should be changed also
galsalomon66 [Tue, 4 Apr 2023 22:30:00 +0000 (01:30 +0300)]
upon removing the payload tag, the response index should be changed also

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2 years agoMerge pull request #503 from cbodley/wip-multi-delete
Ali Maredia [Fri, 31 Mar 2023 18:26:25 +0000 (14:26 -0400)]
Merge pull request #503 from cbodley/wip-multi-delete

boto3: multi-object-delete tests use client.delete_objects()

2 years agotest_sse_s3_default_multipart_upload verifies encryption header 505/head
Casey Bodley [Thu, 30 Mar 2023 18:27:27 +0000 (14:27 -0400)]
test_sse_s3_default_multipart_upload verifies encryption header

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #502 from cbodley/wip-58960
Casey Bodley [Tue, 21 Mar 2023 21:09:04 +0000 (17:09 -0400)]
Merge pull request #502 from cbodley/wip-58960

s3website: collections.Container removed from python3.10

2 years agoMerge pull request #495 from cbodley/wip-get-object-torrent
Ali Maredia [Tue, 14 Mar 2023 16:40:35 +0000 (12:40 -0400)]
Merge pull request #495 from cbodley/wip-get-object-torrent

add test_get_object_torrent

2 years agoboto3: multi-object-delete tests use client.delete_objects() 503/head
Casey Bodley [Mon, 13 Mar 2023 17:00:25 +0000 (13:00 -0400)]
boto3: multi-object-delete tests use client.delete_objects()

when the tests were converted from boto2, they were rewritten as loops
over client.delete_object(). switch back to multi-delete

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agos3website: collections.Container removed from python3.10 502/head
Casey Bodley [Sun, 12 Mar 2023 19:33:34 +0000 (15:33 -0400)]
s3website: collections.Container removed from python3.10

Fixes: https://tracker.ceph.com/issues/58960
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoadd test_get_object_torrent 495/head
Casey Bodley [Sun, 19 Feb 2023 17:32:47 +0000 (12:32 -0500)]
add test_get_object_torrent

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #500 from soumyakoduri/wip-skoduri-lifecycle
Casey Bodley [Wed, 8 Mar 2023 13:48:51 +0000 (08:48 -0500)]
Merge pull request #500 from soumyakoduri/wip-skoduri-lifecycle

lifecycle: Fix test_lifecycle_expiration_header_* testcases

2 years agotest object PUT with chunked transfer enconding 501/head
Mark Kogan [Tue, 7 Mar 2023 14:08:51 +0000 (14:08 +0000)]
test object PUT with chunked transfer enconding

Before the RGW fix PR was responding with 411 instead of 200

RGW fix PR: https://github.com/ceph/ceph/pull/50235

Signed-off-by: Mark Kogan <mkogan@redhat.com>
2 years agolifecycle: Fix test_lifecycle_expiration_header_* testcases 500/head
Soumya Koduri [Tue, 7 Mar 2023 09:47:47 +0000 (15:17 +0530)]
lifecycle: Fix test_lifecycle_expiration_header_* testcases

Few checks were incorrectly mapped when switched to 'assert'. This
commit fixes the same.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2 years agoMerge pull request #499 from soumyakoduri/wip-bz58916
Casey Bodley [Mon, 6 Mar 2023 17:59:35 +0000 (12:59 -0500)]
Merge pull request #499 from soumyakoduri/wip-bz58916

dbstore: add back missing 'fails_on_dbstore' tag

2 years agoMerge pull request #490 from cbodley/wip-489
Casey Bodley [Mon, 6 Mar 2023 14:19:56 +0000 (09:19 -0500)]
Merge pull request #490 from cbodley/wip-489

boto3: list_versions() omits empty KeyMarker/VersionIdMarker

2 years agodbstore: add back missing 'fails_on_dbstore' tag 499/head
Soumya Koduri [Mon, 6 Mar 2023 14:18:01 +0000 (19:48 +0530)]
dbstore: add back missing 'fails_on_dbstore' tag

Mark testcase "test_lifecycle_expiration_header_and_tags_head" as
fails_on_dbstore

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2 years agoMerge pull request #498 from m-ildefons/wip/tox-ini-fixes
Casey Bodley [Sun, 5 Mar 2023 15:06:56 +0000 (10:06 -0500)]
Merge pull request #498 from m-ildefons/wip/tox-ini-fixes

QoL: Fix tox.ini syntax and other minor things

2 years agoQoL: Fix tox.ini syntax and other minor things 498/head
Moritz Röhrich [Tue, 28 Feb 2023 11:19:54 +0000 (12:19 +0100)]
QoL: Fix tox.ini syntax and other minor things

- Fix tox.ini syntax

Modern tox versions require the expected environment variables to be
listed one by one on separate lines in tox.ini

- Add `venv` to list of ignored names for git

This is a common name for a local Python virtual environment. Less
typing than `virtualenv`

- Add `tox` to requirements.txt

Installing `tox` via `pip` has the advantage of including it in the
virtual environment, thus avoiding trouble on operating systems shipping
by default with python3.6 or older. It's also nice that `pip install -r
requirements.txt` is now sufficient to set up the testing environment,
after initializing the virtual environment with a moder-enough python
version.

Signed-off-by: Moritz Röhrich <moritz.rohrich@suse.com>
2 years agoMerge pull request #496 from cbodley/wip-58762
Soumya Koduri [Mon, 27 Feb 2023 05:40:40 +0000 (11:10 +0530)]
Merge pull request #496 from cbodley/wip-58762

iam: add back missing fails_on_dbstore tags

2 years agoiam: add back missing fails_on_dbstore tags 496/head
Casey Bodley [Fri, 24 Feb 2023 16:43:52 +0000 (11:43 -0500)]
iam: add back missing fails_on_dbstore tags

Fixes: https://tracker.ceph.com/issues/58762
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #484 from yuvalif/fix-sts-error-handling
Casey Bodley [Mon, 20 Feb 2023 16:48:41 +0000 (11:48 -0500)]
Merge pull request #484 from yuvalif/fix-sts-error-handling

better error handling in the STS tests

2 years agoMerge pull request #487 from robbat2/rgw_post_content_length
Casey Bodley [Mon, 20 Feb 2023 14:28:53 +0000 (09:28 -0500)]
Merge pull request #487 from robbat2/rgw_post_content_length

test_post_object_upload_size_below_minimum_rgw_max_chunk_size: new testcase for size validation bug

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agotest_post_object_upload_size_rgw_chunk_size_bug: new testcase 487/head
Robin H. Johnson [Wed, 1 Feb 2023 00:39:39 +0000 (16:39 -0800)]
test_post_object_upload_size_rgw_chunk_size_bug: new testcase

`ERR_TOO_SMALL` is wrongly returned if all of the following are true,
- the get_data returns multiple items (chunks)
- the length of the last item is smaller than the POST Policy's min
  value for content-length-range.

The check should be `(ofs < min_len)` instead of `(len < min_len)`

This is further confirmed by the next line of `s->obj_size = ofs`

Move the `int len` scope inside loop to try and prevent the bug in
future.

The bug was refactored in 2016, but was introduced in Oct 2012, when
this functionality was first added to RGW in commit 7bb3504d3f0974e9863f536e9af0ce8889d6888f.

Reference: https://github.com/ceph/ceph/blob/933a42f9af349b3b222270e7f19f1fe151d89e8e/src/rgw/rgw_op.cc#L4474-L4513
Reference: https://github.com/ceph/ceph/commit/7bb3504d3f0974e9863f536e9af0ce8889d6888f
Signed-off-by: Robin H. Johnson <rjohnson@digitalocean.com>
2 years agoboto3: list_versions() omits empty KeyMarker/VersionIdMarker 490/head
Casey Bodley [Fri, 17 Feb 2023 02:15:19 +0000 (21:15 -0500)]
boto3: list_versions() omits empty KeyMarker/VersionIdMarker

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agobetter error handling in the STS tests 484/head
Yuval Lifshitz [Wed, 25 Jan 2023 09:12:20 +0000 (11:12 +0200)]
better error handling in the STS tests

also, give more accurate instruction on how to run the tests

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2 years agos3select: json output serialization
Albin Antony [Mon, 3 Oct 2022 12:48:02 +0000 (18:18 +0530)]
s3select: json output serialization

Signed-off-by: Albin Antony <aantony@redhat.com>
2 years agoUse get_new_bucket_name() in select tests. 488/head
Amit Prinz Setter [Sun, 29 Jan 2023 07:25:58 +0000 (09:25 +0200)]
Use get_new_bucket_name() in select tests.

Signed-off-by: Amit Prinz Setter <aprinzse@redhat.com>
2 years agoMerge pull request #486 from cbodley/wip-58365
Casey Bodley [Fri, 27 Jan 2023 14:20:40 +0000 (09:20 -0500)]
Merge pull request #486 from cbodley/wip-58365

test_s3: remove test_user_policy()

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2 years agotest_s3: remove test_user_policy() 486/head
Casey Bodley [Thu, 26 Jan 2023 16:23:03 +0000 (11:23 -0500)]
test_s3: remove test_user_policy()

this has been failing consistently in local testing. test_sts.py has
lots of user policy test coverage, so this test case in test_s3.py is
superfluous

Fixes: https://tracker.ceph.com/issues/58365
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #482 from cbodley/wip-tox-pytest
Ali Maredia [Wed, 25 Jan 2023 22:46:57 +0000 (17:46 -0500)]
Merge pull request #482 from cbodley/wip-tox-pytest

replace deprecated nose with pytest

2 years agotest_headers: add custom marks for auth_common/aws2/aws4 482/head
Casey Bodley [Wed, 25 Jan 2023 22:04:04 +0000 (17:04 -0500)]
test_headers: add custom marks for auth_common/aws2/aws4

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoremove boostrap
Casey Bodley [Sun, 22 Jan 2023 16:50:40 +0000 (11:50 -0500)]
remove boostrap

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agocleanup duplicate lines
Casey Bodley [Sun, 22 Jan 2023 00:48:29 +0000 (19:48 -0500)]
cleanup duplicate lines

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoremove nose dependency from requirements.txt
Casey Bodley [Sat, 21 Jan 2023 19:25:30 +0000 (14:25 -0500)]
remove nose dependency from requirements.txt

Signed-off-by: Casey Bodley <cbodley@redhat.com>