Ali Maredia [Sun, 24 Nov 2019 23:04:42 +0000 (18:04 -0500)]
Minor fix to Centos 8 bootstrap changes
Signed-off-by: Ali Maredia <amaredia@redhat.com>
Ali Maredia [Thu, 21 Nov 2019 18:10:56 +0000 (13:10 -0500)]
Merge pull request #319 from liranmauda/liran-fix-bootstrap-for-version-8
Fixing bootstap for RHEL/Centos 8
Casey Bodley [Wed, 13 Nov 2019 16:54:33 +0000 (11:54 -0500)]
Merge pull request #296 from gaul/can-test-website-501
Do not run website tests when server emits 501
Reviewed-by: Casey Bodley <cbodley@redhat.com>
liranmauda [Sun, 3 Nov 2019 13:04:15 +0000 (15:04 +0200)]
Fixing bootstap for RHEL/Centos 8
Fixing bootstap for RHEL/Centos 8
- When VERSION_ID is less than 8, installing the python packages, otherwise installing the python2 packages.
- When we are using the python2-virtualenv, we will run virtualenv-2.
- Making sure we have which installed
Ali Maredia [Tue, 29 Oct 2019 03:56:38 +0000 (23:56 -0400)]
Merge pull request #307 from peter-ginchev/fix_listobjects_v2_tests
Fix validate_bucket_listv2
Ali Maredia [Mon, 7 Oct 2019 13:42:14 +0000 (09:42 -0400)]
Merge pull request #309 from hairesis/master
Push #306 to master branch.
Andrea Baglioni [Mon, 23 Sep 2019 20:02:23 +0000 (21:02 +0100)]
sse-kms test keys parametrization
Signed-off-by: Andrea Baglioni <andrea.baglioni@workday.com>
Andrea Baglioni [Tue, 24 Sep 2019 15:49:13 +0000 (16:49 +0100)]
sse-kms: adding missing kms test to parametrization
Peter Ginchev [Mon, 30 Sep 2019 11:38:45 +0000 (14:38 +0300)]
Fix validate_bucket_listv2
NextContinuationToken is not cleartext, and we shouldn't assume that.
Also, the test should use it for ContinuationToken
Ali Maredia [Tue, 24 Sep 2019 18:42:46 +0000 (14:42 -0400)]
Merge pull request #305 from cbodley/wip-validate-bucket-name
Fix create_bucket tests as per new bucket naming conventions
Soumya Koduri [Thu, 20 Jun 2019 18:14:13 +0000 (23:44 +0530)]
Fix create_bucket tests as per new bucket naming conventions
As per amazon s3 spec -
https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-s3-bucket-naming-requirements.html
The s3 bucket names should not contain upper case letters or underscore.
Name cannot end with dash or have consecutive periods, or dashes adjacent to periods
Name length shouldn't exceed 63 characters.
These rules are being enforced via
- https://github.com/ceph/ceph/pull/26787
This patch is to update the respective testcases as well.
Note: check_invalid_bucket_name() seems to have been broken. It should
try to create bucket using invalid name. Have addressed it in this
patch. Because of this few testcases (which were incorrectly passing
earlier) are failing in validate_bucket_name. Have marked them
'fails_on_rgw' as done for test_bucket_create_naming_bad_punctuation
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Casey Bodley [Wed, 11 Sep 2019 14:30:44 +0000 (10:30 -0400)]
Merge pull request #304 from cbodley/wip-fails-with-subdomain
boto2: tag more tests with fails_with_subdomain
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Casey Bodley [Tue, 10 Sep 2019 19:14:49 +0000 (15:14 -0400)]
boto2: tag more tests with fails_with_subdomain
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 30 Aug 2019 12:58:30 +0000 (08:58 -0400)]
Merge pull request #286 from zhangsw/lifecycle-expiration-versioning
Add a case for lifecycle expiration on versining enabled bucket.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Ali Maredia [Thu, 22 Aug 2019 18:13:09 +0000 (14:13 -0400)]
Merge pull request #297 from albin-antony/mutuallyexclusive
startafter and continuation token shouldn't be returned if they are not specified in the request
J. Eric Ivancich [Tue, 13 Aug 2019 21:09:52 +0000 (17:09 -0400)]
Merge pull request #295 from tianshan/test_pr_29215
add test case for list with delimiter not skip special keys
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
albIN7 [Tue, 6 Aug 2019 15:48:43 +0000 (21:18 +0530)]
startafter or continuation token shouldn't be returned if they are not specified in the request
Signed-off-by: Albin Antony <aantony@redhat.com>
Andrew Gaul [Mon, 29 Jul 2019 21:16:38 +0000 (14:16 -0700)]
Do not run website tests when server emits 501
Signed-off-by: Andrew Gaul <andrew@gaul.org>
Tianshan Qu [Fri, 26 Jul 2019 03:15:28 +0000 (11:15 +0800)]
add test case for list with delimiter not skip special keys
Signed-off-by: Tianshan Qu <tianshan@xsky.com>
Ali Maredia [Tue, 23 Jul 2019 18:27:26 +0000 (14:27 -0400)]
Merge pull request #96 from gaul/if-match
Test copy if-match and if-none-match
Ali Maredia [Tue, 23 Jul 2019 17:51:59 +0000 (13:51 -0400)]
Merge pull request #291 from zhangsw/listobjectv2
Add a test case for continuation token in list objects v2
zhang Shaowen [Thu, 18 Jul 2019 07:06:06 +0000 (15:06 +0800)]
Update the continuation token test case so that it won't fail on aws
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Ali Maredia [Tue, 16 Jul 2019 20:24:20 +0000 (16:24 -0400)]
Merge pull request #284 from timuralp/improvement/improve-range-tests
Add a test for an improperly formatted range.
zhang Shaowen [Tue, 16 Jul 2019 11:03:25 +0000 (19:03 +0800)]
Add a test case for list objects v2 with both continuation token and start after parameter
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Ali Maredia [Mon, 15 Jul 2019 18:26:56 +0000 (14:26 -0400)]
Merge pull request #288 from gaul/missing-tags
Add missing tags
zhang Shaowen [Fri, 12 Jul 2019 01:36:15 +0000 (09:36 +0800)]
Add a test case for continuation token in list objects v2
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
zhang Shaowen [Thu, 11 Jul 2019 08:36:16 +0000 (16:36 +0800)]
update the case for lifecycle expiration on versioning enabled bucket
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Ali Maredia [Wed, 10 Jul 2019 15:42:32 +0000 (11:42 -0400)]
Merge pull request #290 from cbodley/wip-location2
fix syntax error in test_bucket_get_location
Casey Bodley [Wed, 10 Jul 2019 15:22:32 +0000 (11:22 -0400)]
fix syntax error in test_bucket_get_location
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Ali Maredia [Tue, 9 Jul 2019 18:25:52 +0000 (14:25 -0400)]
Merge pull request #271 from cbodley/wip-bucket-location
skip bucket location tests if no api_name is configured
Andrew Gaul [Thu, 18 Feb 2016 06:28:09 +0000 (22:28 -0800)]
Test copy if-match and if-none-match
References #72.
Signed-off-by: Andrew Gaul <andrew@gaul.org>
Andrew Gaul [Tue, 2 Jul 2019 21:59:18 +0000 (14:59 -0700)]
Add missing tags
Ali Maredia [Tue, 2 Jul 2019 21:36:27 +0000 (17:36 -0400)]
Merge pull request #276 from gaul/deps/fedora
Explicitly reference Fedora Python 2 dependency
Ali Maredia [Tue, 2 Jul 2019 21:32:40 +0000 (17:32 -0400)]
Merge pull request #287 from yuvalif/force_python2_in_virtualenv
make sure that virtualenv is python2 regardless of host
Yuval Lifshitz [Tue, 2 Jul 2019 12:30:31 +0000 (15:30 +0300)]
make sure that virtualenv is python2 regardless of host
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
Ali Maredia [Fri, 28 Jun 2019 20:56:49 +0000 (16:56 -0400)]
Merge pull request #267 from albIN7/v2tests
Listobjectsv2 testcases
zhang Shaowen [Fri, 28 Jun 2019 08:15:56 +0000 (16:15 +0800)]
Add a case for lifecycle expiration on versining enabled bucket.
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Timur Alperovich [Mon, 24 Jun 2019 22:32:52 +0000 (15:32 -0700)]
Add a test for an improperly formatted range.
Adds tests for range headers that are not properly formatted (i.e. are
not of the form bytes=0-1024).
Casey Bodley [Thu, 20 Jun 2019 17:21:53 +0000 (13:21 -0400)]
Merge pull request #279 from zhangsw/object-lock
add test cases for object lock.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
albIN7 [Fri, 8 Mar 2019 10:11:16 +0000 (15:41 +0530)]
Added testcases for listobjectsv2
Signed-off-by: Albin Antony <aantony@redhat.com>
Ali Maredia [Wed, 5 Jun 2019 03:17:25 +0000 (23:17 -0400)]
Merge pull request #249 from cbodley/wip-copy-version-urlencode
test versioned copy with urlencoded keys
Casey Bodley [Mon, 3 Jun 2019 17:24:05 +0000 (13:24 -0400)]
Merge pull request #277 from liuchang0812/bucket-tagging
rgw: bucket tagging test
Casey Bodley [Thu, 30 May 2019 14:21:51 +0000 (10:21 -0400)]
test versioned copy with urlencoded keys
Signed-off-by: Casey Bodley <cbodley@redhat.com>
zhang Shaowen [Tue, 28 May 2019 12:10:59 +0000 (20:10 +0800)]
add test cases for object lock.
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Ali Maredia [Tue, 21 May 2019 23:35:50 +0000 (19:35 -0400)]
Merge pull request #245 from gaul/attrs
Add missing attributes for versioning
chang liu [Tue, 21 May 2019 03:53:59 +0000 (11:53 +0800)]
rgw: bucket tagging test
Signed-off-by: chang liu <liuchang0812@gmail.com>
Andrew Gaul [Fri, 16 Nov 2018 00:28:32 +0000 (16:28 -0800)]
Add missing attributes for versioning
Also add cors attributes.
Signed-off-by: Andrew Gaul <andrew@gaul.org>
Andrew Gaul [Sun, 19 May 2019 15:34:52 +0000 (00:34 +0900)]
Explicitly reference Fedora Python 2 dependency
Previously the aliases would install but subsequent runs would not
find the exact package name. This caused yum to unnecessarily re-run.
Signed-off-by: Andrew Gaul <andrew@gaul.org>
Ali Maredia [Tue, 23 Apr 2019 18:56:00 +0000 (14:56 -0400)]
Merge pull request #272 from cbodley/wip-delete-retry
nuke_prefixed_buckets() ignores 404 from bucket delete
Casey Bodley [Mon, 22 Apr 2019 19:34:23 +0000 (15:34 -0400)]
nuke_prefixed_buckets() ignores 404 from bucket delete
if a bucket delete request times out, the retry will likely get a 404
NoSuchBucket response. ignore that error and treat this as a success
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Mon, 22 Apr 2019 14:23:49 +0000 (10:23 -0400)]
Merge pull request #261 from linuxbox2/wip-lifecycle-prefix
boto{2,3}: rm functional.test_s3.test_lifecycle_rules_conflict
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Matt Benjamin [Mon, 18 Mar 2019 06:21:09 +0000 (02:21 -0400)]
boto{2,3}: rm functional.test_s3.test_lifecycle_rules_conflict
The assumption that there may be only one rule per prefix has
been removed. The rules specifically tested here--without tag
filters--do overlap but are not in conflict.
I am proposing to remove altogether rather than writing new
deconfliction logic.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Casey Bodley [Fri, 5 Apr 2019 21:08:59 +0000 (17:08 -0400)]
skip bucket location test if no api_name is configured
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 5 Apr 2019 20:48:24 +0000 (16:48 -0400)]
set 'api_name = default' in sample config
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 5 Apr 2019 20:56:05 +0000 (16:56 -0400)]
Merge pull request #269 from ceph/wip-boto2-remove
Wip boto2 remove
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Ali Maredia [Mon, 1 Apr 2019 04:44:42 +0000 (00:44 -0400)]
remove boto2 tests already passing in boto3
Signed-off-by: Ali Maredia <amaredia@redhat.com>
Ali Maredia [Sun, 31 Mar 2019 21:31:05 +0000 (17:31 -0400)]
boto3: tag boto3 tests that are failing on ssl as 'fails_on_rgw'
Signed-off-by: Ali Maredia <amaredia@redhat.com>
Casey Bodley [Mon, 25 Mar 2019 14:09:54 +0000 (10:09 -0400)]
Merge pull request #262 from tianshan/test_for_38811
add case test for read not exist null version
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Tianshan Qu [Thu, 14 Mar 2019 10:35:17 +0000 (18:35 +0800)]
add case test for read not exist null version
http://tracker.ceph.com/issues/38811
Signed-off-by: Tianshan Qu <tianshan@xsky.com>
Ali Maredia [Thu, 7 Mar 2019 17:12:00 +0000 (12:12 -0500)]
Merge pull request #260 from cbodley/wip-boto3-ssl
Wip boto3 ssl
Casey Bodley [Wed, 27 Feb 2019 16:41:28 +0000 (11:41 -0500)]
boto3: verify certificates for ssl connections
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Tue, 26 Feb 2019 21:25:28 +0000 (16:25 -0500)]
boto3: _get_post_url() uses config endpoint
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Tue, 26 Feb 2019 20:57:19 +0000 (15:57 -0500)]
boto3: use https:// for secure endpoints
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Wed, 27 Feb 2019 16:40:07 +0000 (11:40 -0500)]
boto3: use getboolean() for is_secure
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Tue, 26 Feb 2019 18:28:13 +0000 (13:28 -0500)]
Merge pull request #247 from zhangsw/append-object
Add test case for appending object.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
zhang Shaowen [Tue, 26 Feb 2019 02:10:29 +0000 (10:10 +0800)]
add https support in apppend object test cases
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Yehuda Sadeh [Mon, 18 Feb 2019 16:18:10 +0000 (08:18 -0800)]
Merge pull request #256 from linuxbox2/wip-expiration-header
boto3_s3tests: add tests for lifecycle expiration header
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Matt Benjamin [Thu, 14 Feb 2019 00:17:20 +0000 (19:17 -0500)]
boto3_s3tests: add tests for lifecycle expiration header
The response to a successful PUT or HEAD (or GET) of/on
an object matching any enabled lifecycle expiration rule should
include an x-amz-expiration header for the object. The
x-amz-expiration header consists of an expiry-date, rule-id tuple
indicating the earliest matching rule and the corresponding
expiration date for the object.
Also, while at it, add test for lifecycle expiration rule with
'Days' : 0, which should both apply and...work.
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Ali Maredia [Tue, 22 Jan 2019 17:01:50 +0000 (12:01 -0500)]
Merge pull request #250 from yehudasa/wip-rgw-lifecycle-trans
lifecycle transitions, and storage class related tests
Casey Bodley [Thu, 17 Jan 2019 19:00:37 +0000 (14:00 -0500)]
Merge pull request #210 from ceph/wip-boto-3
boto3: Foundation laid for boto3 tests
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Ali Maredia [Thu, 7 Dec 2017 20:41:01 +0000 (15:41 -0500)]
boto3: Foundation laid for boto3 tests
Added sample config file for boto3 and vstart.sh
Modified setup.py, requirements.txt, and README
Added an rgw_interactive.py to use interactively
with vstart.sh and python -i
Ported 400+ tests over to boto3 from functional/test_s3.py
Signed-off-by: Ali Maredia <amaredia@redhat.com>
Yehuda Sadeh [Sun, 6 Jan 2019 22:31:10 +0000 (14:31 -0800)]
s3tests: test copy objects (storage class)
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh [Sun, 6 Jan 2019 22:16:23 +0000 (14:16 -0800)]
s3tests: more object class related tests
modify object's storage_class, multipart
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh [Sat, 5 Jan 2019 18:23:55 +0000 (10:23 -0800)]
s3tests: test create object with storage class
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh [Fri, 4 Jan 2019 01:32:34 +0000 (17:32 -0800)]
s3tests: lifecycle transitions: configurable storage classes
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Yehuda Sadeh [Thu, 3 Jan 2019 23:54:03 +0000 (15:54 -0800)]
s3tests: tests for lifecycle transitions
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
zhang Shaowen [Tue, 20 Nov 2018 13:05:57 +0000 (21:05 +0800)]
Add test case for appending object.
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
Kefu Chai [Wed, 30 May 2018 16:29:23 +0000 (00:29 +0800)]
Merge pull request #228 from tchaikov/wip-cffi
bootstrap: add libffi-dev for gevent
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Kefu Chai [Wed, 30 May 2018 08:36:52 +0000 (16:36 +0800)]
bootstrap: add libffi-dev for gevent
because gevent 1.3.2 requires cffi>=1.11.5, and cffi requires
libffi-dev to build.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Casey Bodley [Mon, 23 Apr 2018 13:01:53 +0000 (09:01 -0400)]
Merge pull request #192 from joke-lee/cors_option_header_check
rgw: test cors option request with Access-Control-Request-Headers
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Thu, 12 Apr 2018 15:18:14 +0000 (11:18 -0400)]
Merge pull request #220 from joke-lee/max-keys-test
enable test for https://github.com/ceph/ceph/pull/21285
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Ali Maredia [Mon, 9 Apr 2018 18:20:30 +0000 (02:20 +0800)]
Merge pull request #182 from gaul/versioning
Add missing versioning tag
yuliyang [Mon, 9 Apr 2018 16:19:31 +0000 (12:19 -0400)]
enable test for https://github.com/ceph/ceph/pull/21285
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
Ali Maredia [Thu, 5 Apr 2018 16:47:10 +0000 (00:47 +0800)]
Merge pull request #217 from cbodley/wip-unpin-requests
unpin the requests library version
Casey Bodley [Fri, 16 Feb 2018 16:28:31 +0000 (11:28 -0500)]
requirements: unpin 'requests' from old v0.14
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 16 Feb 2018 16:21:25 +0000 (11:21 -0500)]
cors: allow None to match missing headers
this is apparently needed to run against newer versions of the requests
library
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Fri, 16 Feb 2018 16:34:00 +0000 (11:34 -0500)]
Merge pull request #209 from fangyuxiangGL/compression
compression: add case to download range from big object
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Ali Maredia [Tue, 13 Feb 2018 19:03:15 +0000 (14:03 -0500)]
Merge pull request #205 from malc0lm/multipartcopy-no-range
Add test for muiltpart copy without 'x-amz-copy-source-range' header
fang yuxiang [Wed, 7 Feb 2018 08:16:39 +0000 (16:16 +0800)]
compression: add case to download range from big object
Signed-off-by: fang yuxiang <fang.yuxiang@eisoo.com>
Casey Bodley [Thu, 25 Jan 2018 16:06:06 +0000 (11:06 -0500)]
Merge pull request #191 from theanalyst/policy-conditionals
test bucket policy with conditionals
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Malcolm Lee [Wed, 24 Jan 2018 05:55:53 +0000 (13:55 +0800)]
Add test for muiltpart copy without 'x-amz-copy-source-range' header
Abhishek Lekshmanan [Mon, 6 Nov 2017 15:47:05 +0000 (16:47 +0100)]
policy: refactor make_json_policy to use the new Policy classes
since make_json_policy is redundantly doing most of the same work,
refactor to use the new policy classes instead
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Fri, 20 Oct 2017 14:23:55 +0000 (16:23 +0200)]
policy: test existingobject tag on get acl
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Fri, 20 Oct 2017 14:20:52 +0000 (16:20 +0200)]
policy: test put object with reqeust object tag
Abhishek Lekshmanan [Fri, 20 Oct 2017 13:41:32 +0000 (15:41 +0200)]
policy: test policy with sse-c encryption
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Fri, 20 Oct 2017 11:51:48 +0000 (13:51 +0200)]
typo fix for pub_obj_acl
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Fri, 20 Oct 2017 11:42:30 +0000 (13:42 +0200)]
policy: add S3 tests for grants conditionals
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Thu, 19 Oct 2017 14:25:42 +0000 (16:25 +0200)]
move ListBucket to new policy class
Abhishek Lekshmanan [Thu, 19 Oct 2017 14:24:30 +0000 (16:24 +0200)]
policy: add a new policy class to make creation of complex policies
Since policies can have allow/deny rules etc
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
Abhishek Lekshmanan [Tue, 17 Oct 2017 17:03:28 +0000 (19:03 +0200)]
policy: test put object with canned acl
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>