]>
git-server-git.apps.pok.os.sepia.ceph.com Git - s3-tests.git/log
Shriya Deshmukh [Wed, 27 Jul 2022 14:43:11 +0000 (08:43 -0600)]
rgw/s3_boto3: Added http status code verification for DeleteBucketTagging
case.
Updated test_set_bucket_tagging test for verifying the http status code
for DeleteBucketTagging case.
Related CEPH PR: https://github.com/ceph/ceph/pull/47262
Signed-off-by: Shriya Deshmukh <shriya.deshmukh@seagate.com>
(cherry picked from commit
c8fc8cd7c8a38c0d47b6b4fd8ee2f70f57382bdd )
Soumya Koduri [Wed, 20 Jul 2022 16:26:28 +0000 (21:56 +0530)]
Fix User Policy test failures on dbstore
Tag User policy tests failing on dbstore as 'fails_on_dbstore'
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit
5d63ebf83dbdee52d9795943964086c522f736cb )
Ravindra Choudhari [Mon, 27 Jun 2022 06:24:27 +0000 (11:54 +0530)]
Added put/get/list/delete User Policy Tests
c4d30d7 Ravindra Choudhari Mon, 27 Jun 2022 removing region name
4a13f58 Ravindra Choudhari Thu, 16 Jun 2022 Updating readme file (#15)
18bc152 Ravindra Choudhari Tue, 14 Jun 2022 Adding attr test_of_iam to all user policy tests (#13)
03f520a Ravindra Choudhari Tue, 14 Jun 2022 resolving review comments (#12)
7cf2823 Ravindra Choudhari Mon, 13 Jun 2022 added IAM policy test section in README.rst (#11)
563f3ea Ravindra Choudhari Fri, 10 Jun 2022 adding failing three tests back with attr @fails_on_rgw (#10)
696dd2e Ravindra Choudhari Mon, 6 Jun 2022 changes as per review comments
3d63dfd Ravindra Choudhari Mon, 6 Jun 2022 Fixed review comments (#8)
9492f69 Ravindra Choudhari Fri, 3 Jun 2022 Fixed review comments (#7)
74095dc Ketan Arlulkar Wed, 1 Jun 2022 Fixed review comments (#6)
942fb4f Ketan Arlulkar Wed, 1 Jun 2022 Added Tests for conflicting policies and IAM actions (#4)
ad5b5ae Ravindra Choudhari Tue, 31 May 2022 IAM policies s3 actions (#5)
6515ec6 Ketan Arlulkar Fri, 27 May 2022 Corrected eq import
40a2841 Ravindra Choudhari Tue, 17 May 2022 resolving conflicts
f53a5c1 Ravindra Choudhari Tue, 17 May 2022 added cleanup
747d563 Ketan Arlulkar Tue, 17 May 2022 Added cleanup/Delete Policy
d1cc1d8 Ketan Arlulkar Mon, 16 May 2022 Fixed review comments
1ec43a2 Ravindra Choudhari Mon, 16 May 2022 delete user policy tests
a01722e Ravindra Choudhari Mon, 16 May 2022 get user policy tests
ff9d676 Ketan Arlulkar Fri, 13 May 2022 Removed TEST IDs
d261400 Ketan Arlulkar Tue, 10 May 2022 Put User Policy & List User Policy Tests
Signed-off-by: Ravindra Choudhari <ravindra.choudhari@seagate.com>
(cherry picked from commit
bf889041c9176997112cda7ece4dbf8c4ce442cd )
Casey Bodley [Thu, 2 Jun 2022 16:25:24 +0000 (12:25 -0400)]
remove tests that fail on boto3's parameter validation
Fixes: https://tracker.ceph.com/issues/55193
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Wed, 18 May 2022 13:40:14 +0000 (09:40 -0400)]
fix GetBucketTagging error code
related to https://tracker.ceph.com/issues/55460
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Soumya Koduri [Tue, 10 May 2022 19:21:42 +0000 (00:51 +0530)]
Tag sse* tests with 'fails_on_dbstore' attr
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit
33afb4eb88c5c91caaee6bc178f44c45c052c0e8 )
Soumya Koduri [Wed, 13 Apr 2022 09:58:00 +0000 (15:28 +0530)]
Adjust wait time for cloud-transition test failures
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
(cherry picked from commit
25d05a194b09fd35acba5546ac4ebfca64759b1b )
Casey Bodley [Mon, 9 May 2022 21:19:44 +0000 (17:19 -0400)]
s3tests.conf.SAMPLE: comment out [s3 cloud] section
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
9f1f9c927336700a2438645479f29408cc232af2 )
Priya Sehgal [Fri, 30 Jul 2021 11:54:16 +0000 (17:24 +0530)]
sse s3 jumbo patch - all in one fixes for sse-s3 logic
original tests by Priya Sehgal <priya.sehgal@flipkart.com>:
rgw/s3_boto3: Tests added for SSE-S3 (GET, PUT, HEAD, MPU).
Additions by Casey Bodley <cbodley@redhat.com>:
add 'sse-s3' tag to test cases
sse: add _put_bucket_encryption() helper function
sse: document test cases with default bucket encryption
sse: expects encryption response header on put/get
sse: add 8MB default-encrypted upload
sse: test uploads that request x-amz-server-side-encryption=AES256
Lastly all my changes (Marcus Watts <mwatts@redhat.com>):
remove obsolete test - do it only in boto3 now.
Combine or rename duplicated function names.
Giving more than one test the same name is a Bad Thing(tm).
sse: expand test_bucket_policy_put_obj_enc, and _put_bucket_encryption
test_bucket_policy_put_obj_enc was testing too many things at once.
new tests:
* customer encryption and sse-s3: should fail
* customer encryption and sse-kms: should fail
* deny if not sse-s3: no-enc fails, sse-s3 succeeds.
* deny if not sse-s3: kms fails
deny if not sse-ksm: no-enc fails, sse-kms succeeds.
deny if not sse-ksm: s3 fails
_put_bucket_encryption was only testing sse-s3.
* test both these variations: sse-s3 and sse-kms
Note:
* these tests will fail on pre-sse-s3 ceph.
python3: comment out all boto3.set_stream_logger() calls
They made too much output.
Signed-off-by: Marcus Watts <mwatts@redhat.com>
(cherry picked from commit
dd7cac25f54d5642f46d1a4a68603384c4fb3048 )
Soumya Koduri [Wed, 13 Apr 2022 09:58:00 +0000 (15:28 +0530)]
Tag testcases failing on dbstore with 'fails_on_dbstore' attr
To be able to successfully run s3tests on dbstore backend in teuthology,
mark all the s3-tests currently failing on it with 'fails_on_dbstore' attr
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Soumya Koduri [Mon, 21 Mar 2022 19:21:30 +0000 (00:51 +0530)]
lifecycle: Adjust lc wait time
Adjust wait time to fix spurious failures reported -
https://github.com/ceph/ceph/pull/40703#issuecomment-
1060811704
http://qa-proxy.ceph.com/teuthology/mbenjamin-2022-02-23_15:42:19-rgw-wip-rgwlc-noreset-distro-basic-smithi/
6703349 /teuthology.log
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Pragadeeswaran Sathyanarayanan [Tue, 28 Dec 2021 15:26:23 +0000 (20:56 +0530)]
Improving check_grants reliability
Signed-off-by: Pragadeeswaran Sathyanarayanan <psathyan@redhat.com>
(cherry picked from commit
5f96a32045aa50da674df000f462def06308e10b )
Soumya Koduri [Mon, 7 Feb 2022 17:54:34 +0000 (23:24 +0530)]
lifecycle/deletemarker_expiration: Increase timer window
Increase wait time in test_lifecycle_deletemarker_expiration(..)
to avoid any spurious failure.
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Soumya Koduri [Fri, 17 Dec 2021 11:25:49 +0000 (16:55 +0530)]
Enable lifecycle tests
Add an option to configure lc debug interval and adjust lifecycle
tests sleep as per the value set.
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Soumya Koduri [Mon, 6 Dec 2021 05:23:18 +0000 (10:53 +0530)]
Add testcases for rgw cloudtransition feature
Feature PR: https://github.com/ceph/ceph/pull/35100
Also ported lc testcases from boto2 to boto3
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Kalpesh Pandya [Thu, 6 Jan 2022 07:29:49 +0000 (12:59 +0530)]
test_sts: Changing code for proper cleanup
This solves: https://tracker.ceph.com/issues/53090
The solution is: We need to delete the role_policy and
user_policy attached user which was causing the failure.
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
gal salomon [Wed, 12 Jan 2022 17:01:06 +0000 (19:01 +0200)]
revert the arrow installation(causing failure on some distro"s, such as fedora)
Signed-off-by: gal salomon <gal.salomon@gmail.com>
gal salomon [Tue, 28 Dec 2021 15:08:17 +0000 (17:08 +0200)]
fix output-serialization tests(upon comparing query results need to remove redundant columns)
skip output-serial test. the results from both queries are not equal, thus it raise an assert. the problem seems to be the formatting before the comparision
remove test_output_serial_expressions until fixing the test
experiment pyarrow for parquet testing, adding arrow/parquet to bootstrap, installing pyarrow,pandas for reading/writing parquet
Signed-off-by: gal salomon <gal.salomon@gmail.com>
gal salomon [Mon, 27 Dec 2021 19:46:59 +0000 (21:46 +0200)]
merging master tests into parquet branch
Signed-off-by: gal salomon <gal.salomon@gmail.com>
gal salomon [Tue, 21 Dec 2021 08:02:42 +0000 (10:02 +0200)]
fix for assert of error messages
Signed-off-by: gal salomon <gal.salomon@gmail.com>
gal salomon [Tue, 7 Dec 2021 15:02:21 +0000 (17:02 +0200)]
remove redundant comma. s3select-engine produced redundant result column before its last fix, s3tests should align with that
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Or Friedmann [Wed, 30 Sep 2020 13:25:22 +0000 (16:25 +0300)]
Test expiration header for lc rules with tags
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
胡玮文 [Thu, 24 Sep 2020 16:28:06 +0000 (00:28 +0800)]
Test list_objects_v2 KeyCount with Delimiter
Test for: https://github.com/ceph/ceph/pull/37396
Signed-off-by: 胡玮文 <huww98@outlook.com>
galsalomon66 [Thu, 25 Nov 2021 09:57:52 +0000 (11:57 +0200)]
adding datatime queries from #395
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit
23be1160f5a39a6f16ead172b09a5c0504b7012d )
galsalomon66 [Fri, 12 Nov 2021 09:39:45 +0000 (11:39 +0200)]
rollback to use like without escape syntax (explore valgrind issue)
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit
eef8d0fa6759e80df6c58a1afb874315b91334ff )
galsalomon66 [Thu, 11 Nov 2021 14:15:49 +0000 (16:15 +0200)]
modify the queries syntax to like-escape; the queries semantics is the same; results are the same; it is a part of exploring valgrind issue around like-operator
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit
f51101d7527dc2ccec0b0d4b978da81041ea09f8 )
galsalomon66 [Thu, 21 Oct 2021 00:32:57 +0000 (03:32 +0300)]
add output-serialization tests; add syntax-error tests; run_s3select_output should merge into run_s3select
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit
749e29185b5de8c01d4412626ae3c45a48f5c064 )
gal salomon [Sun, 17 Oct 2021 11:03:39 +0000 (14:03 +0300)]
remove comments from the like-expressions
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit
7c07bad9306f0920d7d17049647437c6fb1409a8 )
galsalomon66 [Tue, 27 Jul 2021 05:26:28 +0000 (08:26 +0300)]
search for the cause of the valgrind issue; remove the like expression that may cause it
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit
723853fd189fe741b78cac5b4e780158b860d0e8 )
Albin Antony [Wed, 30 Jun 2021 15:36:07 +0000 (21:06 +0530)]
s3select: test progress stats
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit
a3447c50dfae2fa0ac025397de8a83cc4df3fd97 )
Albin Antony [Tue, 18 May 2021 02:09:22 +0000 (07:39 +0530)]
s3select: align s3select tests with ceph
Update s3-tests to handle the error-response (return 400, and error-description)
Signed-off-by: Albin Antony <aantony@redhat.com>
Casey Bodley [Fri, 29 Oct 2021 17:06:30 +0000 (13:06 -0400)]
check Owner/Initiator fields of ListMultipartUploads response
new test case test_list_multipart_upload_owner() uses two different
users to initiate multipart uploads, then tests that
list_multipart_uploads() shows the correct user ids and display names
for each upload
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
490d0a4c4f91faf2a5213c95c4b92f7c3c94c878 )
iraj465 [Thu, 15 Jul 2021 21:59:36 +0000 (03:29 +0530)]
chore:Removes unused scaffolds
(cherry picked from commit
d2a7ed88f169fd4ea9864b7fc640ddfe5518a19c )
iraj465 [Thu, 15 Jul 2021 21:45:53 +0000 (03:15 +0530)]
rgw/boto3_s3:Adds delete_objects key limit for list-objects-v2
(cherry picked from commit
459e3c870a8b9bed7a47f354390b1343acb32708 )
iraj465 [Thu, 15 Jul 2021 21:37:21 +0000 (03:07 +0530)]
chore:Bump the list-objects to paginator
(cherry picked from commit
20aa9aa071e704020c7fbf1b95f447cb7f33a763 )
iraj465 [Tue, 13 Jul 2021 17:50:35 +0000 (23:20 +0530)]
rgw/s3_boto3:Adds new delete_objects tests for checking key delete limit
(cherry picked from commit
64bdc3beec46bb5e786146629430fa54d417cd36 )
Pritha Srivastava [Fri, 23 Jul 2021 06:38:07 +0000 (12:08 +0530)]
rgw/sts: test to use role tag as iam:ResourceTag in
role's trust policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit
71266fede99e585875128106c5d319ddbd08d1b4 )
Pritha Srivastava [Fri, 16 Jul 2021 07:47:54 +0000 (13:17 +0530)]
rgw/sts: test for s3:ResourceTag in role's permission policy
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit
5dcc3dd689486ac759092a2bd3307c469bf0c7e1 )
Pritha Srivastava [Thu, 15 Jul 2021 10:10:04 +0000 (15:40 +0530)]
rgw/sts: adding test for aws:TagKeys that can be used in the
condition element of the role's trust policy and the role's
permission policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit
bf43a4a10a2eea15ae0c0c06fe9f16c1893d4115 )
Pritha Srivastava [Thu, 15 Jul 2021 08:45:54 +0000 (14:15 +0530)]
rgw/sts: adding test for aws:PrincipalTag in role permission
policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit
86fecf83b90b247a26e0f69203b7c3844b090af2 )
Pritha Srivastava [Thu, 15 Jul 2021 08:03:08 +0000 (13:33 +0530)]
rgw/sts: adding test to check for aws:RequestTag
in the condition element of a role's trust policy.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit
64068d7bf922ee349c9e47b103b17e5ded0a5450 )
Pritha Srivastava [Wed, 14 Jul 2021 10:10:39 +0000 (15:40 +0530)]
rgw/sts: adding tests for testing assumerolewithwebidentity
using 'sub' and 'azp' fields in the web token.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit
d466b7bd09b94159526164430dde2f3d9bbce1ca )
Liu Lan [Mon, 6 Sep 2021 11:25:09 +0000 (19:25 +0800)]
docs: fix wrong example in README.rst
Run: S3TEST_CONF=your.conf ./virtualenv/bin/nosetests s3tests.functional.test_s3:test_bucket_list_empty
But get an error: "ERROR: Failure: ValueError (No such test test_bucket_list_empty)".
Because test_bucket_list_empty is a test case in s3tests_boto3 directory.
Signed-off-by: Liu Lan <liulan_yewu@cmss.chinamobile.com>
(cherry picked from commit
9ac8aef12bfeb0778a7b410bcf51e26c81565aec )
Mark Kogan [Mon, 23 Aug 2021 15:06:58 +0000 (18:06 +0300)]
Merge pull request #390 from mkogan1/multipart-extra-complete
test extra complete_multipart_upload()
Casey Bodley [Tue, 3 Aug 2021 21:04:15 +0000 (17:04 -0400)]
object-lock: test changes between retention modes
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
8662815ebe2d8b105307edccf56b11ebb7b6824f )
Casey Bodley [Wed, 4 Aug 2021 19:00:04 +0000 (15:00 -0400)]
nuke_prefixed_buckets waits up to 60 seconds for object locks to expire
objects locked in GOVERNANCE mode can be removed with
BypassGovernanceRetention, but some tests may leave an object locked in
COMPLIANCE mode, which blocks deletion until the retention period
expires
nuke_prefixed_buckets now checks the retention policy of objects that it
fails to delete with AccessDenied, and will wait up to 60 seconds for
locks to expire before retrying the deletes. if the wait exceeds 60
seconds, it instead throws an error without deleting the bucket
instead of doing this in nuke_prefixed_buckets, we could potentially
have each object-lock test case handle this manually, but that would
add a separate delay to each test case
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
9c4f15a47e1ee899a7dc453a4971a164e10521d8 )
Casey Bodley [Wed, 4 Aug 2021 17:56:39 +0000 (13:56 -0400)]
nuke_prefixed_buckets deletes objects in batches
speed up the cleanup by using delete_objects() with batches of 128
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
bb995c2aeb8fbbf7c5a9547827b0afa9e1ad15ac )
Rahul Dev Parashar [Mon, 26 Jul 2021 10:45:02 +0000 (16:15 +0530)]
rgw/s3_boto3: Add tests for bucket encryption APIs
Tests are added for GetBucketEncryption, PutBucketEncryption,
and DeleteBucketEncryption APIs.
Related PR: https://github.com/ceph/ceph/pull/42222
Signed-off-by: Rahul Dev Parashar <rahul.dev@flipkart.com>
(cherry picked from commit
44643af0b0e51e6550e508d6854bd576d254141d )
Kalpesh Pandya [Tue, 6 Jul 2021 06:51:33 +0000 (12:21 +0530)]
rgw/sts: Addition of new STS tests for testing
session policies alongwith role's permission policy
and bucket policy.
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit
245a93326ed9d0c091744d28ffb697ac5ba74544 )
iraj465 [Tue, 13 Jul 2021 17:44:51 +0000 (23:14 +0530)]
rgw/s3_boto3:Adds lifecycle transition test for invalid iso8601 date
(cherry picked from commit
ba9525f425f7da4c93d12499fffbb0faaab0ef7c )
Pei [Tue, 5 May 2020 08:07:27 +0000 (01:07 -0700)]
Fix: Bucket resource leak when cleanup
In the function of nuke_prefixed_buckets, if some err is thrown when deleting buckets, the left buckets remain uncleaned.
It is kind of resoruce leak on some charged platform. We have to clear them manually.
I know the original code is meant to give the user some hint by rasing error. But the resource leak of left buckets is a little annoying.
This PR would skip the problem point and continue the teardown process. The last client error would be saved and re-raised after the loop completes.
Signed-off-by: Pei <huangp0600@126.com>
Signed-off-by: Pei <phuang1@dev-new-3-3854897.slc07.dev.ebayc3.com>
(cherry picked from commit
713012c178b074539cd80e10a26c115194c8571f )
Ali Maredia [Tue, 10 Aug 2021 18:41:05 +0000 (14:41 -0400)]
disable ssl verify by default
Signed-off-by: Ali Maredia <amaredia@redhat.com>
(cherry picked from commit
b252638369f56ab171bc88d54d71025ce8b8d6c7 )
Pragadeeswaran Sathyanarayanan [Fri, 30 Jul 2021 04:14:29 +0000 (09:44 +0530)]
Add support for disabling SSL certificate verification
Signed-off-by: Pragadeeswaran Sathyanarayanan <psathyan@redhat.com>
(cherry picked from commit
ea3caaa76bf80094596753cc8abab776f9c50253 )
Mark Houghton [Mon, 19 Oct 2020 16:58:56 +0000 (17:58 +0100)]
Add tests for issue 47586.
(cherry picked from commit
7fe0304e9c373b993465dc5ac4058821c3b03577 )
Danny Abukalam [Wed, 14 Jul 2021 22:03:35 +0000 (18:03 -0400)]
Add test to check retain date is in iso 8601 format
Signed-off-by: Danny Abukalam <danny@softiron.com>
(cherry picked from commit
e229d1aaf6eef5133643454a9643276fe34bd4f7 )
Casey Bodley [Wed, 7 Apr 2021 15:33:46 +0000 (11:33 -0400)]
sts: test role policy around nonexistent objects
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
7276bee050a971b11ccf6f298436bc893620b190 )
Casey Bodley [Thu, 11 Mar 2021 21:36:24 +0000 (16:36 -0500)]
test that listed buckets have creation time
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
66ced9af1d1f27cb06754607f8df072e7618d57d )
Or Friedmann [Thu, 13 May 2021 16:11:00 +0000 (19:11 +0300)]
test multipart upload with bucket policy
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
(cherry picked from commit
cfdf914c4bccdb75be2c993921ca86ee18caad24 )
gal salomon [Wed, 5 May 2021 08:35:32 +0000 (11:35 +0300)]
modifying tests to be align with change of s3select compare sign( == -> = )
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit
1572fbc87b0e0fb1bc1530e368d51659e799e9e1 )
Albin Antony [Wed, 31 Mar 2021 11:00:30 +0000 (16:30 +0530)]
tests
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit
c6a4ab9d125c074b5aa3ac79180fc93e4cfae6a0 )
Albin Antony [Mon, 29 Mar 2021 13:26:38 +0000 (18:56 +0530)]
tests
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit
e7102e8cb0b499daceb1d2915591e6c2dd3151a0 )
Albin Antony [Mon, 22 Mar 2021 10:54:26 +0000 (16:24 +0530)]
tests
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit
60dd3444b3a68c64d845540e1bffe17ab029e718 )
Albin Antony [Wed, 20 Jan 2021 07:46:05 +0000 (13:16 +0530)]
s3select: align s3-tests with new changes in s3select
Fix when then, date functions and NULL, add escape, trim tests
Signed-off-by: Albin Antony <aantony@redhat.com>
(cherry picked from commit
4a86ebbe8b666dbbcf9c5b6b7935129dfd242b28 )
Mark Kogan [Sun, 25 Apr 2021 11:21:26 +0000 (14:21 +0300)]
test extra complete_multipart_upload()
after the 1st successfull one should also return 200 OK
related tracker issue: https://tracker.ceph.com/issues/50141
related pr: https://github.com/ceph/ceph/pull/40594
Signed-off-by: Mark Kogan <mkogan@redhat.com>
galsalomon66 [Wed, 13 Jan 2021 07:24:31 +0000 (09:24 +0200)]
change test_s3select.py permission; add s3select attribute
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit
ea7d5fb563351b176d787b744cafd4ae58aa7b71 )
galsalomon66 [Tue, 15 Dec 2020 09:51:19 +0000 (11:51 +0200)]
reduce object size for test_like_expression, it may cause timeouts in teuthology runs
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
galsalomon66 [Sat, 5 Dec 2020 16:58:45 +0000 (18:58 +0200)]
rename charlength and character_length function names
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
Or Friedmann [Thu, 3 Dec 2020 16:28:40 +0000 (18:28 +0200)]
Add test for head bucket usage headers
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
(cherry picked from commit
ef8f65d917877601f0d18f08dd8ae81f03d0ee1c )
Or Friedmann [Thu, 3 Dec 2020 15:53:50 +0000 (17:53 +0200)]
Add test for GetUsage api
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
(cherry picked from commit
f4f7812efd5b42a3b255148ab67424a4a00ba2fb )
Albin Antony [Tue, 13 Oct 2020 10:06:29 +0000 (15:36 +0530)]
s3select tests for coalesce and case
Signed-off-by: Albin Antony <aantony@redhat.com>
gal salomon [Fri, 3 Jul 2020 11:49:13 +0000 (14:49 +0300)]
per each new uploaded file(for test), it got unique name(random), and uploaded file is verified for its content
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Albin Antony [Thu, 24 Sep 2020 10:39:20 +0000 (16:09 +0530)]
s3select predicate tests
Signed-off-by: Albin Antony <aantony@redhat.com>
root [Thu, 24 Sep 2020 10:04:09 +0000 (15:34 +0530)]
Webidentity Test addition to test_sts.py
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
Few main changes/additions:
1. Webidentity test addition to test_sts.py.
2. A function named check_webidentity() added to __init__.py in order to check for section presence.
3. Few lines shifted from setup() to get_iam_client() to make them execute only when sts-tests run.
4. Documentation update (for sts section)
5. Changes in s3tests.conf.SAMPLE regarding sts sections
Matt Benjamin [Thu, 8 Oct 2020 13:30:50 +0000 (09:30 -0400)]
Add test for HeadBucket on a non-existent bucket
n.b., RGW does not send a response document for this operation,
which seems consistent with
https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Ilsoo Byun [Sun, 8 Nov 2020 13:22:32 +0000 (22:22 +0900)]
Check if invalid payload is added after serving errordoc
Signed-off-by: Ilsoo Byun <ilsoobyun@linecorp.com>
(cherry picked from commit
c08de72d55202381628737a11bb1a4079257d016 )
Casey Bodley [Thu, 10 Sep 2020 18:39:10 +0000 (14:39 -0400)]
test bucket recreation with different acls
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
f6218fa1deaa83e802e246cbb3c0936a2cfb833c )
root [Mon, 5 Oct 2020 19:05:58 +0000 (00:35 +0530)]
STS issue fix (https://tracker.ceph.com/issues/47588)
This is the fix for the issue reported (https://tracker.ceph.com/issues/47588). The issue was with the argument which was passed to the function. After removing that argument (as it's already an optional argument) the issue is fixed.
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
(cherry picked from commit
daf9062a225831a420e471ee0459abc799c45439 )
Matt Benjamin [Wed, 16 Sep 2020 17:19:41 +0000 (13:19 -0400)]
add noncurrent version expiration rule w/tag filter
Create 10 object versions (9 noncurrent). Install a noncurrent
version expiration at 4 days. Verify that 10 versions exist at
T+20, and only 1 (current) at T+60.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Tue, 15 Sep 2020 13:57:00 +0000 (09:57 -0400)]
add lifecycle expiration test mixing 2-tag filter w/versioning
By design this test duplicates test_lifecycle_expiration_tags2,
but enables object versioning on the bucket.
The tests install a rule which requires -2- tags to be matched,
and creates 2 objects, one matching only 1 of the required tags,
the other matching both. Only the 2nd object should expire.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 14 Sep 2020 23:06:32 +0000 (19:06 -0400)]
add tests for lifecycle expiration w/1 and 2 object tags
Note that the 1-tag case contains a filter prefix--which exposes
an apparent bug parsing Filter when it contains a Prefix element
and a single Tag element (without And).
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 14 Sep 2020 18:23:48 +0000 (14:23 -0400)]
fix lifecycle expiration days: 0
In fact test_lifecycle_expiration_days0 is should fail, as 0-day
expiration is permitted for transition rules but not expiration
rules.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 11 Sep 2020 17:52:29 +0000 (13:52 -0400)]
s/test_set_tagging/test_set_bucket_tagging/;
The test exercises bucket tagging, has nothing to do with object
tagging (clarity).
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 11 Sep 2020 17:23:41 +0000 (13:23 -0400)]
fix test_lifecycle_expiration_header_{put,head}
Primarily fixes the expiration header() verifier function
check_lifecycle_expiration_header, but also cleans up
prefix handling in setup_lifecycle_expiration().
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 11 Sep 2020 14:17:39 +0000 (10:17 -0400)]
fix and remark on test_lifecycle_expiration_days0
1. fix a python3-related KeyError exception
2. note here: AWS documentation includes examples of "Days 0"
in use, but boto3 will not accept them--this is why the days0
test currently sets Days 1
3. delay increased to 30s, to avoid occasional failures due to
jitter
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
root [Thu, 30 Jul 2020 11:35:59 +0000 (17:05 +0530)]
STS Tests Files and modification in __init__.py
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
gal salomon [Mon, 6 Jul 2020 21:10:50 +0000 (00:10 +0300)]
add filter for s3select tests
Signed-off-by: gal salomon <gal.salomon@gmail.com>
(cherry picked from commit
fce9a52ef4311c6a89d05452776affe63dfbafe6 )
gal salomon [Sun, 31 May 2020 13:07:58 +0000 (16:07 +0300)]
fix comments;remove non-used imports;enable test for projection;using get_client()
(cherry picked from commit
72e251ed69af4cd69de311d39c7f492292528c70 )
gal salomon [Tue, 26 May 2020 22:20:31 +0000 (01:20 +0300)]
adding radom-generated tests, one for where clause , the second for prjection. random arithmetical expression is generated and used for building s3-select query; result is compared to python-engine
(cherry picked from commit
fb39ac4829816e19a502e7c4d7c4f9f9ab941945 )
gal salomon [Tue, 26 May 2020 08:36:38 +0000 (11:36 +0300)]
python linter; replace assert with assert_equal; add complex query test(sum,count,where); add test-schema ;
(cherry picked from commit
e006dd47537ba56dfcdad2fcf27f15d21ed209d6 )
gal salomon [Sat, 23 May 2020 12:10:14 +0000 (15:10 +0300)]
using config parameters
(cherry picked from commit
1a9d3677f7f77597bc8208232ee0bb4f7ef7322c )
gal salomon [Fri, 8 May 2020 13:51:24 +0000 (16:51 +0300)]
add tests to validate csv-header-info functionalities is correct
(cherry picked from commit
5dc8bc75ab3365d652945c63bd3bceaddb46f825 )
gal salomon [Tue, 28 Apr 2020 16:10:24 +0000 (19:10 +0300)]
adding test cases for processing CSV objects with different CSV definitions; validate null,escape-rules and quotes are processed correctly
(cherry picked from commit
94b19862284f13d351ea4e5164300a3841fbf091 )
gal salomon [Wed, 15 Apr 2020 14:20:52 +0000 (17:20 +0300)]
adding utcnow test
(cherry picked from commit
4c7c279f7017a3510543de5c4b2dff4f15255e65 )
gal salomon [Thu, 9 Apr 2020 13:43:11 +0000 (16:43 +0300)]
adding tests for date-time functionalities
(cherry picked from commit
5925f0fb3f5918fed5c30ff53475c72bf5e13a5a )
gal salomon [Sat, 4 Apr 2020 13:31:54 +0000 (16:31 +0300)]
add complex expression tests; for nested function calls; and different where-clause which create the same group of values
(cherry picked from commit
c1bce6ac705d79a3530c30c2f4d5450570abcd3c )
gal salomon [Tue, 31 Mar 2020 11:35:51 +0000 (14:35 +0300)]
adding test for detection of cyclic reference to alias
(cherry picked from commit
d543619e7162aaedbff58b8f30f4d08da14c5493 )
gal salomon [Sun, 29 Mar 2020 14:23:05 +0000 (17:23 +0300)]
adding aggregation tests
(cherry picked from commit
f42872fd53478d5510dff236ee96a5f0559f0096 )
gal salomon [Thu, 26 Mar 2020 15:49:55 +0000 (17:49 +0200)]
adding alias test case
(cherry picked from commit
74daf86fe5e08f9a4dfb945f3e4b538504803dbb )
gal salomon [Mon, 23 Mar 2020 11:36:32 +0000 (13:36 +0200)]
commit first tests for s3select and initial framework
(cherry picked from commit
dac38694ef8897dc5721c0125e3a538aa530b9ae )
Matt Benjamin [Tue, 19 May 2020 12:41:39 +0000 (08:41 -0400)]
fix/restore test_lifecycle_expiration checks
Commit
bf956df71e56bcdae7d41b9789d8e8d775f76007 adding
listobvjectsv2 tests inadvertently changed the v1
test_lifecycle_expiration test, which it had copied to
create a v2 version. Revert this.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>