Albin Antony [Tue, 18 May 2021 02:09:22 +0000 (07:39 +0530)]
s3select: align s3select tests with ceph
Update s3-tests to handle the error-response (return 400, and error-description)
Signed-off-by: Albin Antony <aantony@redhat.com>
Ali Maredia [Fri, 21 May 2021 18:51:26 +0000 (14:51 -0400)]
Merge pull request #391 from ceph/tethology_s3select_apr19
modifying tests to be align with change of s3select compare sign( == …
gal salomon [Wed, 5 May 2021 08:35:32 +0000 (11:35 +0300)]
modifying tests to be align with change of s3select compare sign( == -> = )
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Gal Salomon [Fri, 9 Apr 2021 07:26:24 +0000 (10:26 +0300)]
Merge pull request #382 from albin-antony/master
s3select: align s3-tests with new changes in s3select
Albin Antony [Wed, 31 Mar 2021 11:00:30 +0000 (16:30 +0530)]
tests
Signed-off-by: Albin Antony <aantony@redhat.com>
Albin Antony [Mon, 29 Mar 2021 13:26:38 +0000 (18:56 +0530)]
tests
Signed-off-by: Albin Antony <aantony@redhat.com>
Albin Antony [Mon, 22 Mar 2021 10:54:26 +0000 (16:24 +0530)]
tests
Signed-off-by: Albin Antony <aantony@redhat.com>
Albin Antony [Wed, 20 Jan 2021 07:46:05 +0000 (13:16 +0530)]
s3select: align s3-tests with new changes in s3select
Fix when then, date functions and NULL, add escape, trim tests
Signed-off-by: Albin Antony <aantony@redhat.com>
Ali Maredia [Thu, 14 Jan 2021 05:02:58 +0000 (00:02 -0500)]
Merge pull request #381 from ceph/fix_test_file_permission_add_attrib
change test_s3select.py permission; add s3select attribute
galsalomon66 [Wed, 13 Jan 2021 07:24:31 +0000 (09:24 +0200)]
change test_s3select.py permission; add s3select attribute
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
Gal Salomon [Wed, 16 Dec 2020 11:43:21 +0000 (13:43 +0200)]
Merge pull request #373 from ceph/fix_function_names
rename charlength and character_length function names
galsalomon66 [Tue, 15 Dec 2020 09:51:19 +0000 (11:51 +0200)]
reduce object size for test_like_expression, it may cause timeouts in teuthology runs
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
galsalomon66 [Sat, 5 Dec 2020 16:58:45 +0000 (18:58 +0200)]
rename charlength and character_length function names
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
Ali Maredia [Thu, 3 Dec 2020 20:59:40 +0000 (15:59 -0500)]
Merge pull request #371 from ofriedma/wip-ofriedma-test-usage-api
Add test for GetUsage api
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Or Friedmann [Thu, 3 Dec 2020 16:28:40 +0000 (18:28 +0200)]
Add test for head bucket usage headers
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
Or Friedmann [Thu, 3 Dec 2020 15:53:50 +0000 (17:53 +0200)]
Add test for GetUsage api
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
Ali Maredia [Wed, 25 Nov 2020 04:57:51 +0000 (23:57 -0500)]
Merge pull request #363 from linuxbox2/master-headbucket-dne
Add test for HeadBucket on a non-existent bucket
Casey Bodley [Thu, 19 Nov 2020 15:24:01 +0000 (10:24 -0500)]
Merge pull request #367 from IlsooByun/check_invalid_payload
Check if invalid payload is added after serving errordoc
Gal Salomon [Thu, 12 Nov 2020 09:53:12 +0000 (11:53 +0200)]
Merge pull request #364 from albin-antony/when-than
s3select tests for coalesce and case
Albin Antony [Tue, 13 Oct 2020 10:06:29 +0000 (15:36 +0530)]
s3select tests for coalesce and case
Signed-off-by: Albin Antony <aantony@redhat.com>
Ilsoo Byun [Sun, 8 Nov 2020 13:22:32 +0000 (22:22 +0900)]
Check if invalid payload is added after serving errordoc
Signed-off-by: Ilsoo Byun <ilsoobyun@linecorp.com>
Ali Maredia [Mon, 2 Nov 2020 18:36:26 +0000 (13:36 -0500)]
Merge pull request #360 from TRYTOBE8TME/wip-sts-webidentity
Webidentity Test addition to test_sts.py
Gal Salomon [Sun, 1 Nov 2020 13:18:33 +0000 (15:18 +0200)]
Merge pull request #358 from albin-antony/predicates
s3select predicate tests
root [Thu, 24 Sep 2020 10:04:09 +0000 (15:34 +0530)]
Webidentity Test addition to test_sts.py
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
Few main changes/additions:
1. Webidentity test addition to test_sts.py.
2. A function named check_webidentity() added to __init__.py in order to check for section presence.
3. Few lines shifted from setup() to get_iam_client() to make them execute only when sts-tests run.
4. Documentation update (for sts section)
5. Changes in s3tests.conf.SAMPLE regarding sts sections
Matt Benjamin [Thu, 22 Oct 2020 12:21:02 +0000 (08:21 -0400)]
Merge pull request #361 from ofriedma/wip-lc-expr-hdr-tags
Test expiration header for lc rules with tags
Or Friedmann [Wed, 30 Sep 2020 13:25:22 +0000 (16:25 +0300)]
Test expiration header for lc rules with tags
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
Albin Antony [Thu, 24 Sep 2020 10:39:20 +0000 (16:09 +0530)]
s3select predicate tests
Signed-off-by: Albin Antony <aantony@redhat.com>
Casey Bodley [Thu, 8 Oct 2020 14:37:09 +0000 (10:37 -0400)]
Merge pull request #356 from cbodley/wip-test-bucket-recreate-acl
test bucket recreation with different acls
Matt Benjamin [Thu, 8 Oct 2020 13:30:50 +0000 (09:30 -0400)]
Add test for HeadBucket on a non-existent bucket
n.b., RGW does not send a response document for this operation,
which seems consistent with
https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Casey Bodley [Mon, 5 Oct 2020 21:19:09 +0000 (17:19 -0400)]
Merge pull request #362 from TRYTOBE8TME/wip-sts-issue-fix
STS issue fix (https://tracker.ceph.com/issues/47588)
root [Mon, 5 Oct 2020 19:05:58 +0000 (00:35 +0530)]
STS issue fix (https://tracker.ceph.com/issues/47588)
This is the fix for the issue reported (https://tracker.ceph.com/issues/47588). The issue was with the argument which was passed to the function. After removing that argument (as it's already an optional argument) the issue is fixed.
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
Matt Benjamin [Fri, 2 Oct 2020 16:41:19 +0000 (12:41 -0400)]
Merge pull request #359 from huww98/master
Test list_objects_v2 KeyCount with Delimiter
Matt Benjamin [Thu, 1 Oct 2020 15:26:31 +0000 (11:26 -0400)]
Merge pull request #357 from linuxbox2/wip-fixes-911
Wip fixes 911
胡玮文 [Thu, 24 Sep 2020 16:28:06 +0000 (00:28 +0800)]
Test list_objects_v2 KeyCount with Delimiter
Test for: https://github.com/ceph/ceph/pull/37396
Signed-off-by: 胡玮文 <huww98@outlook.com>
Matt Benjamin [Wed, 16 Sep 2020 17:19:41 +0000 (13:19 -0400)]
add noncurrent version expiration rule w/tag filter
Create 10 object versions (9 noncurrent). Install a noncurrent
version expiration at 4 days. Verify that 10 versions exist at
T+20, and only 1 (current) at T+60.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Tue, 15 Sep 2020 13:57:00 +0000 (09:57 -0400)]
add lifecycle expiration test mixing 2-tag filter w/versioning
By design this test duplicates test_lifecycle_expiration_tags2,
but enables object versioning on the bucket.
The tests install a rule which requires -2- tags to be matched,
and creates 2 objects, one matching only 1 of the required tags,
the other matching both. Only the 2nd object should expire.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 14 Sep 2020 23:06:32 +0000 (19:06 -0400)]
add tests for lifecycle expiration w/1 and 2 object tags
Note that the 1-tag case contains a filter prefix--which exposes
an apparent bug parsing Filter when it contains a Prefix element
and a single Tag element (without And).
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Mon, 14 Sep 2020 18:23:48 +0000 (14:23 -0400)]
fix lifecycle expiration days: 0
In fact test_lifecycle_expiration_days0 is should fail, as 0-day
expiration is permitted for transition rules but not expiration
rules.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 11 Sep 2020 17:52:29 +0000 (13:52 -0400)]
s/test_set_tagging/test_set_bucket_tagging/;
The test exercises bucket tagging, has nothing to do with object
tagging (clarity).
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 11 Sep 2020 17:23:41 +0000 (13:23 -0400)]
fix test_lifecycle_expiration_header_{put,head}
Primarily fixes the expiration header() verifier function
check_lifecycle_expiration_header, but also cleans up
prefix handling in setup_lifecycle_expiration().
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Matt Benjamin [Fri, 11 Sep 2020 14:17:39 +0000 (10:17 -0400)]
fix and remark on test_lifecycle_expiration_days0
1. fix a python3-related KeyError exception
2. note here: AWS documentation includes examples of "Days 0"
in use, but boto3 will not accept them--this is why the days0
test currently sets Days 1
3. delay increased to 30s, to avoid occasional failures due to
jitter
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Casey Bodley [Thu, 10 Sep 2020 18:39:10 +0000 (14:39 -0400)]
test bucket recreation with different acls
Signed-off-by: Casey Bodley <cbodley@redhat.com>
TRYTOBE8TME [Mon, 17 Aug 2020 09:41:32 +0000 (15:11 +0530)]
Merge pull request #355 from TRYTOBE8TME/wip-sts-tests
STS Tests File and required modification in other files for the same
Gal Salomon [Wed, 12 Aug 2020 10:32:29 +0000 (13:32 +0300)]
Merge pull request #352 from ceph/validate_test_setup
per each new uploaded file(for test), it got unique name(random), and…
gal salomon [Fri, 3 Jul 2020 11:49:13 +0000 (14:49 +0300)]
per each new uploaded file(for test), it got unique name(random), and uploaded file is verified for its content
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Signed-off-by: gal salomon <gal.salomon@gmail.com>
root [Thu, 30 Jul 2020 11:35:59 +0000 (17:05 +0530)]
STS Tests Files and modification in __init__.py
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
Casey Bodley [Tue, 7 Jul 2020 11:37:49 +0000 (07:37 -0400)]
Merge pull request #353 from ceph/add_test_filter
add filter for s3select tests
gal salomon [Mon, 6 Jul 2020 21:10:50 +0000 (00:10 +0300)]
add filter for s3select tests
Signed-off-by: gal salomon <gal.salomon@gmail.com>
Matt Benjamin [Thu, 25 Jun 2020 16:27:32 +0000 (12:27 -0400)]
Merge pull request #342 from ceph/s3select_first_tests_framework
commit first tests for s3select and initial framework
gal salomon [Sun, 31 May 2020 13:07:58 +0000 (16:07 +0300)]
fix comments;remove non-used imports;enable test for projection;using get_client()
gal salomon [Tue, 26 May 2020 22:20:31 +0000 (01:20 +0300)]
adding radom-generated tests, one for where clause , the second for prjection. random arithmetical expression is generated and used for building s3-select query; result is compared to python-engine
Casey Bodley [Tue, 26 May 2020 15:06:40 +0000 (11:06 -0400)]
Merge pull request #347 from linuxbox2/wip-fix-lc-expire-timers
fix/restore test_lifecycle_expiration checks
Casey Bodley [Tue, 26 May 2020 13:01:29 +0000 (09:01 -0400)]
Merge pull request #350 from tchaikov/wip-45691
bootstrap,requirements.txt: bump up setuptools and requests
Kefu Chai [Mon, 25 May 2020 04:48:19 +0000 (12:48 +0800)]
bootstrap,requirements.txt: bump up setuptools and requests
Fixes: https://tracker.ceph.com/issues/45691
Signed-off-by: Kefu Chai <kchai@redhat.com>
gal salomon [Tue, 26 May 2020 08:36:38 +0000 (11:36 +0300)]
python linter; replace assert with assert_equal; add complex query test(sum,count,where); add test-schema ;
gal salomon [Sat, 23 May 2020 12:10:14 +0000 (15:10 +0300)]
using config parameters
Casey Bodley [Thu, 21 May 2020 15:08:46 +0000 (11:08 -0400)]
Merge pull request #348 from cbodley/wip-bootstrap-virtualenv-deprecated
bootstrap: remove deprecated virtualenv options
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Casey Bodley [Thu, 21 May 2020 14:48:34 +0000 (10:48 -0400)]
bootstrap: remove deprecated virtualenv options
this fails on Ubuntu 20.04:
> virtualenv: error: unrecognized arguments: --no-site-packages --distribute
according to `virtualenv -h`:
> --no-site-packages DEPRECATED. Retained only for backward compatibility.
> Not having access to global site-packages is now the
> default behavior.
> --distribute DEPRECATED. Retained only for backward compatibility.
> This option has no effect.
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Matt Benjamin [Tue, 19 May 2020 12:41:39 +0000 (08:41 -0400)]
fix/restore test_lifecycle_expiration checks
Commit
bf956df71e56bcdae7d41b9789d8e8d775f76007 adding
listobvjectsv2 tests inadvertently changed the v1
test_lifecycle_expiration test, which it had copied to
create a v2 version. Revert this.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Ali Maredia [Fri, 15 May 2020 19:19:42 +0000 (15:19 -0400)]
Merge pull request #345 from huangp0600/hp-dev
Fix: Bucket resource leak when cleanup
Pei [Tue, 5 May 2020 08:07:27 +0000 (01:07 -0700)]
Fix: Bucket resource leak when cleanup
In the function of nuke_prefixed_buckets, if some err is thrown when deleting buckets, the left buckets remain uncleaned.
It is kind of resoruce leak on some charged platform. We have to clear them manually.
I know the original code is meant to give the user some hint by rasing error. But the resource leak of left buckets is a little annoying.
This PR would skip the problem point and continue the teardown process. The last client error would be saved and re-raised after the loop completes.
Signed-off-by: Pei <huangp0600@126.com>
Signed-off-by: Pei <phuang1@dev-new-3-3854897.slc07.dev.ebayc3.com>
gal salomon [Fri, 8 May 2020 13:51:24 +0000 (16:51 +0300)]
add tests to validate csv-header-info functionalities is correct
gal salomon [Tue, 28 Apr 2020 16:10:24 +0000 (19:10 +0300)]
adding test cases for processing CSV objects with different CSV definitions; validate null,escape-rules and quotes are processed correctly
gal salomon [Wed, 15 Apr 2020 14:20:52 +0000 (17:20 +0300)]
adding utcnow test
gal salomon [Thu, 9 Apr 2020 13:43:11 +0000 (16:43 +0300)]
adding tests for date-time functionalities
gal salomon [Sat, 4 Apr 2020 13:31:54 +0000 (16:31 +0300)]
add complex expression tests; for nested function calls; and different where-clause which create the same group of values
gal salomon [Tue, 31 Mar 2020 11:35:51 +0000 (14:35 +0300)]
adding test for detection of cyclic reference to alias
gal salomon [Sun, 29 Mar 2020 14:23:05 +0000 (17:23 +0300)]
adding aggregation tests
gal salomon [Thu, 26 Mar 2020 15:49:55 +0000 (17:49 +0200)]
adding alias test case
gal salomon [Mon, 23 Mar 2020 11:36:32 +0000 (13:36 +0200)]
commit first tests for s3select and initial framework
Casey Bodley [Fri, 20 Mar 2020 21:01:34 +0000 (17:01 -0400)]
Merge pull request #302 from theanalyst/public-buckets
Public buckets
Abhishek Lekshmanan [Wed, 22 Jan 2020 16:06:09 +0000 (17:06 +0100)]
fix ignore public acls with py3 compatible code
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Tue, 8 Oct 2019 13:22:42 +0000 (15:22 +0200)]
add tests for ignore public acls
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Tue, 8 Oct 2019 13:22:19 +0000 (15:22 +0200)]
add test for block public policy
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Tue, 8 Oct 2019 13:21:20 +0000 (15:21 +0200)]
use empty bodies for canned acl tests with BlockPublicAccess
This should be a temporary workaround until #42208 is fixed
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Tue, 8 Oct 2019 08:47:23 +0000 (10:47 +0200)]
remove redundant get_client calls
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Wed, 22 Jan 2020 16:03:10 +0000 (17:03 +0100)]
add ability to get svc client for s3config set of apis
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Tue, 8 Oct 2019 08:46:38 +0000 (10:46 +0200)]
add tests for public access configuration
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Fri, 30 Aug 2019 09:34:51 +0000 (11:34 +0200)]
add a few test cases for public bucket policies
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Wed, 22 Jan 2020 16:01:30 +0000 (17:01 +0100)]
boto3: add bucket policy status checks for public ACLs
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Ali Maredia [Fri, 17 Jan 2020 15:02:25 +0000 (10:02 -0500)]
Merge pull request #340 from theanalyst/bootstrap-suse
bootstrap: add support for *suse distributions
Abhishek Lekshmanan [Wed, 15 Jan 2020 19:34:17 +0000 (20:34 +0100)]
bootstrap: add support for *suse distributions
Also reformatted the bootstrap script to parse /etc/os-release instead, so that
more distro/pkg manager support could be added at a later point in time and
fixed the error message
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Casey Bodley [Wed, 15 Jan 2020 13:48:54 +0000 (08:48 -0500)]
Merge pull request #337 from ceph/wip-python-3-port
Wip python 3 port
Ali Maredia [Wed, 18 Dec 2019 20:37:20 +0000 (15:37 -0500)]
remove all non-functional tests and infra
Signed-off-by: Ali Maredia <amaredia@redhat.com>
Adam C. Emerson [Fri, 22 Mar 2019 17:58:30 +0000 (13:58 -0400)]
Port functional tests from python 2 to python 3
Add fails_on_rgw to tests not passing. Some
tests from the master branch do not pass on the
rgw yet. Others waiting on rgw tracker issues to
be resolved.
Signed-off-by: Ali Maredia <amaredia@redhat.com>
Abhishek L [Fri, 20 Dec 2019 17:30:21 +0000 (18:30 +0100)]
Merge pull request #314 from theanalyst/iam/user-policy-basic
iam: add a very basic user policy smoke test
Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Pritha Srivastava <prsivas@redhat.com>
Reviewed-By: Yuval Lifshitz <yuvalif@yahoo.com>
Abhishek L [Fri, 20 Dec 2019 17:28:23 +0000 (18:28 +0100)]
Merge pull request #311 from theanalyst/encoding-type
list-objects: add basic tests for encoding
Reviewed-By: Casey Bodley <cbodley@redhat.com>
Abhishek Lekshmanan [Fri, 6 Dec 2019 16:00:13 +0000 (17:00 +0100)]
iam: explicitly set a region for the iam client
Avoids region not defined errors
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Thu, 24 Oct 2019 15:18:38 +0000 (17:18 +0200)]
iam: add a very basic user policy smoke test
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Ali Maredia [Wed, 11 Dec 2019 15:29:21 +0000 (10:29 -0500)]
Merge pull request #331 from yehudasa/wip-which
bootstrap: different packages for 'which'
Ali Maredia [Tue, 10 Dec 2019 18:04:08 +0000 (13:04 -0500)]
Merge pull request #321 from romayalon/tags-order-fix
test_put_obj_with_tags
Yehuda Sadeh [Mon, 9 Dec 2019 12:20:55 +0000 (14:20 +0200)]
bootstrap: different packages for 'which'
Either debianutils or which.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Ali Maredia [Sun, 8 Dec 2019 19:04:39 +0000 (14:04 -0500)]
Merge pull request #330 from yehudasa/wip-bash
bootstrap: switch to bash
Yehuda Sadeh [Sat, 7 Dec 2019 09:23:03 +0000 (11:23 +0200)]
bootstrap: switch to bash
Use of declare that is bash specific was introduced in:
d44c923405e22ea8b6cc1ab4316be3cc07f29b5
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Casey Bodley [Mon, 25 Nov 2019 16:49:25 +0000 (11:49 -0500)]
Merge pull request #326 from ceph/wip-bootstrap-fix
Minor fix to Centos 8 bootstrap changes
Ali Maredia [Mon, 25 Nov 2019 05:22:44 +0000 (00:22 -0500)]
Merge pull request #156 from gaul/read-unreadable-object
Test reading an unreadable object
Ali Maredia [Mon, 25 Nov 2019 05:09:54 +0000 (00:09 -0500)]
Merge pull request #278 from gaul/x-rgw
Ignore missing x-rgw-* headers
Ali Maredia [Sun, 24 Nov 2019 23:04:42 +0000 (18:04 -0500)]
Minor fix to Centos 8 bootstrap changes
Signed-off-by: Ali Maredia <amaredia@redhat.com>
Andrew Gaul [Wed, 22 May 2019 07:21:43 +0000 (16:21 +0900)]
Ignore missing x-rgw-* headers
Continue to require them in test_bucket_head_extended. Only Ceph
supports these headers.
Signed-off-by: Andrew Gaul <andrew@gaul.org>
Andrew Gaul [Tue, 14 Mar 2017 22:56:13 +0000 (15:56 -0700)]
Test reading an unreadable object
Signed-off-by: Andrew Gaul <andrew@gaul.org>
projects / s3-tests.git / log