boto2: tag more tests with fails_with_subdomain

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #286 from zhangsw/lifecycle-expiration-versioning

Add a case for lifecycle expiration on versining enabled bucket.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #297 from albin-antony/mutuallyexclusive

startafter and continuation token shouldn't  be returned if they are not specified in the request

Merge pull request #295 from tianshan/test_pr_29215

add test case for list with delimiter not skip special keys

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>

startafter or continuation token shouldn't  be returned if they are not specified in the request

Signed-off-by: Albin Antony <aantony@redhat.com>

add test case for list with delimiter not skip special keys

Signed-off-by: Tianshan Qu <tianshan@xsky.com>

Merge pull request #96 from gaul/if-match

Test copy if-match and if-none-match

Merge pull request #291 from zhangsw/listobjectv2

Add a test case for continuation token in list objects v2

Update the continuation token test case so that it won't fail on aws

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

Merge pull request #284 from timuralp/improvement/improve-range-tests

Add a test for an improperly formatted range.

Add a test case for list objects v2 with both continuation token and start after parameter

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

Merge pull request #288 from gaul/missing-tags

Add missing tags

Add a test case for continuation token in list objects v2

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

update the case for lifecycle expiration on versioning enabled bucket

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

Merge pull request #290 from cbodley/wip-location2

fix syntax error in test_bucket_get_location

fix syntax error in test_bucket_get_location

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #271 from cbodley/wip-bucket-location

skip bucket location tests if no api_name is configured

Test copy if-match and if-none-match

References #72.

Signed-off-by: Andrew Gaul <andrew@gaul.org>

Add missing tags

Merge pull request #276 from gaul/deps/fedora

Explicitly reference Fedora Python 2 dependency

Merge pull request #287 from yuvalif/force_python2_in_virtualenv

make sure that virtualenv is python2 regardless of host

make sure that virtualenv is python2 regardless of host

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>

Merge pull request #267 from albIN7/v2tests

Listobjectsv2 testcases

Add a case for lifecycle expiration on versining enabled bucket.

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

Add a test for an improperly formatted range.

Adds tests for range headers that are not properly formatted (i.e. are
not of the form bytes=0-1024).

Merge pull request #279 from zhangsw/object-lock

add test cases for object lock.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Added testcases for listobjectsv2

Signed-off-by: Albin Antony <aantony@redhat.com>

Merge pull request #249 from cbodley/wip-copy-version-urlencode

test versioned copy with urlencoded keys

Merge pull request #277 from liuchang0812/bucket-tagging

rgw: bucket tagging test

test versioned copy with urlencoded keys

Signed-off-by: Casey Bodley <cbodley@redhat.com>

add test cases for object lock.

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

Merge pull request #245 from gaul/attrs

Add missing attributes for versioning

rgw: bucket tagging test

Signed-off-by: chang liu <liuchang0812@gmail.com>

Add missing attributes for versioning

Also add cors attributes.

Signed-off-by: Andrew Gaul <andrew@gaul.org>

Explicitly reference Fedora Python 2 dependency

Previously the aliases would install but subsequent runs would not
find the exact package name.  This caused yum to unnecessarily re-run.

Signed-off-by: Andrew Gaul <andrew@gaul.org>

Merge pull request #272 from cbodley/wip-delete-retry

nuke_prefixed_buckets() ignores 404 from bucket delete

nuke_prefixed_buckets() ignores 404 from bucket delete

if a bucket delete request times out, the retry will likely get a 404
NoSuchBucket response. ignore that error and treat this as a success

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #261 from linuxbox2/wip-lifecycle-prefix

boto{2,3}: rm functional.test_s3.test_lifecycle_rules_conflict

Reviewed-by: Casey Bodley <cbodley@redhat.com>

boto{2,3}: rm functional.test_s3.test_lifecycle_rules_conflict

The assumption that there may be only one rule per prefix has
been removed.  The rules specifically tested here--without tag
filters--do overlap but are not in conflict.

I am proposing to remove altogether rather than writing new
deconfliction logic.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

skip bucket location test if no api_name is configured

Signed-off-by: Casey Bodley <cbodley@redhat.com>

set 'api_name = default' in sample config

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #269 from ceph/wip-boto2-remove

Wip boto2 remove

Reviewed-by: Casey Bodley <cbodley@redhat.com>

remove boto2 tests already passing in boto3

Signed-off-by: Ali Maredia <amaredia@redhat.com>

boto3: tag boto3 tests that are failing on ssl as 'fails_on_rgw'

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #262 from tianshan/test_for_38811

add case test for read not exist null version

Reviewed-by: Casey Bodley <cbodley@redhat.com>

add case test for read not exist null version

http://tracker.ceph.com/issues/38811

Signed-off-by: Tianshan Qu <tianshan@xsky.com>

Merge pull request #260 from cbodley/wip-boto3-ssl

Wip boto3 ssl

boto3: verify certificates for ssl connections

Signed-off-by: Casey Bodley <cbodley@redhat.com>

boto3: _get_post_url() uses config endpoint

Signed-off-by: Casey Bodley <cbodley@redhat.com>

boto3: use https:// for secure endpoints

Signed-off-by: Casey Bodley <cbodley@redhat.com>

boto3: use getboolean() for is_secure

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #247 from zhangsw/append-object

Add test case for appending object.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

add https support in apppend object test cases

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

Merge pull request #256 from linuxbox2/wip-expiration-header

boto3_s3tests: add tests for lifecycle expiration header

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

boto3_s3tests: add tests for lifecycle expiration header

The response to a successful PUT or HEAD (or GET) of/on
an object matching any enabled lifecycle expiration rule should
include an x-amz-expiration header for the object.  The
x-amz-expiration header consists of an expiry-date, rule-id tuple
indicating the earliest matching rule and the corresponding
expiration date for the object.

Also, while at it, add test for lifecycle expiration rule with
'Days' : 0, which should both apply and...work.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #250 from yehudasa/wip-rgw-lifecycle-trans

lifecycle transitions, and storage class related tests

Merge pull request #210 from ceph/wip-boto-3

boto3: Foundation laid for boto3 tests

Reviewed-by: Casey Bodley <cbodley@redhat.com>

boto3: Foundation laid for boto3 tests

Added sample config file for boto3 and vstart.sh

Modified setup.py, requirements.txt, and README

Added an rgw_interactive.py to use interactively
with vstart.sh and python -i

Ported 400+ tests over to boto3 from functional/test_s3.py

Signed-off-by: Ali Maredia <amaredia@redhat.com>

s3tests: test copy objects (storage class)

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

s3tests: more object class related tests

modify object's storage_class, multipart

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

s3tests: test create object with storage class

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

s3tests: lifecycle transitions: configurable storage classes

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

s3tests: tests for lifecycle transitions

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Add test case for appending object.

Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>

Merge pull request #228 from tchaikov/wip-cffi

bootstrap: add libffi-dev for gevent

Reviewed-by: Casey Bodley <cbodley@redhat.com>

bootstrap: add libffi-dev for gevent

because gevent 1.3.2 requires cffi>=1.11.5, and cffi requires
libffi-dev to build.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #192 from joke-lee/cors_option_header_check

rgw: test cors option request with Access-Control-Request-Headers

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #220 from joke-lee/max-keys-test

enable test for https://github.com/ceph/ceph/pull/21285

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #182 from gaul/versioning

Add missing versioning tag

enable test for https://github.com/ceph/ceph/pull/21285

Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>

Merge pull request #217 from cbodley/wip-unpin-requests

unpin the requests library version

requirements: unpin 'requests' from old v0.14

Signed-off-by: Casey Bodley <cbodley@redhat.com>

cors: allow None to match missing headers

this is apparently needed to run against newer versions of the requests
library

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #209 from fangyuxiangGL/compression

compression: add case to download range from big object

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #205 from malc0lm/multipartcopy-no-range

Add test for muiltpart copy without 'x-amz-copy-source-range' header

compression: add case to download range from big object

Signed-off-by: fang yuxiang <fang.yuxiang@eisoo.com>

Merge pull request #191 from theanalyst/policy-conditionals

test bucket policy with conditionals

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Add test for muiltpart copy without 'x-amz-copy-source-range' header

policy: refactor make_json_policy to use the new Policy classes

since make_json_policy is redundantly doing most of the same work,
refactor to use the new policy classes instead

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test existingobject tag on get acl

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test put object with reqeust object tag

policy: test policy with sse-c encryption

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

typo fix for pub_obj_acl

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: add S3 tests for grants conditionals

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

move ListBucket to new policy class

policy: add a new policy class to make creation of complex policies

Since policies can have allow/deny rules etc

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test put object with canned acl

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test metadta copy key

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test put obj using copy conditionals

Test s3:x-amz-copy-source conditional on put obj with x-amz-copy-source

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test for acl grants conditionals on put bucket acls

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: add tests for put bucket acl with canned acl conditionals

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

s3: policy tests for ListBucket with prefix, delimiter & max-keys

Allow conditionals on ListBucket similar to s3 docs which allow for
these clauses

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test put object tagging with conditionals

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

policy: test get object tagging with conditionals

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

add policy tests for get object with conditionals

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

add bucket-policy attr to all the policy tests

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

test_s3: modify make_json_policy to support conditionals

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

bucket policy: improve the helper functions used for tagging upwards

- Improve `make_json_policy` to support conditionals in policy
- Move the helper functions for creating policies up so that bucket
  policy tests can use these
- add bucket-policy attribute to the tagging tests using policy

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #204 from linuxbox2/wip-post-ctype

Add test case for POST with no Content-Type header

Add test case for POST with no Content-Type header

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>