]> git-server-git.apps.pok.os.sepia.ceph.com Git - radosgw-agent.git/log
radosgw-agent.git
11 years agoMerge pull request #13 from ceph/wip-full-sync
Alfredo Deza [Mon, 8 Dec 2014 13:34:22 +0000 (08:34 -0500)]
Merge pull request #13 from ceph/wip-full-sync

Bug fixes for full sync and a few other data sync cases

11 years agoclient: return object names instead of boto resultsets 13/head
Josh Durgin [Sat, 6 Dec 2014 01:35:02 +0000 (17:35 -0800)]
client: return object names instead of boto resultsets

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
11 years agoAdd tests for boto_call decorator
Josh Durgin [Tue, 25 Nov 2014 23:25:34 +0000 (15:25 -0800)]
Add tests for boto_call decorator

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
11 years agoMore tests for wait_for_object()
Josh Durgin [Tue, 25 Nov 2014 01:21:43 +0000 (17:21 -0800)]
More tests for wait_for_object()

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
11 years agoImmediately fail when op state is not found
Josh Durgin [Tue, 25 Nov 2014 00:26:27 +0000 (16:26 -0800)]
Immediately fail when op state is not found

There's a very narrow window in which our connection sending the copy
request could fail before radosgw records the op state, and we query
the op state in that time. Retrying later at that point is fine, and
avoids a long timeout if there is a bug causing us to reach this point
without the op state ever being recorded. This race hasn't been
observed in practice.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
11 years agoTreat HTTP 500 as any other HTTP error for a copy request
Josh Durgin [Mon, 24 Nov 2014 23:59:20 +0000 (15:59 -0800)]
Treat HTTP 500 as any other HTTP error for a copy request

We still want to retry later, since 500 could be the gateway timing
out, or it being upgraded to fix a bug, etc.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
11 years agoclient: escape copy source header
Yehuda Sadeh [Mon, 10 Nov 2014 21:29:07 +0000 (13:29 -0800)]
client: escape copy source header

Need to esacpe the x-amz-copy-source header.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
11 years agoworker: process full sync for buckets with no log
Josh Durgin [Mon, 10 Nov 2014 23:39:22 +0000 (15:39 -0800)]
worker: process full sync for buckets with no log

This way we catch objects that were uploaded before zones or data logs
were set up. If there are actually no objects in the bucket, the
bucket listing will tell us that.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
11 years agoclient: don't hide boto return values
Josh Durgin [Mon, 10 Nov 2014 22:14:11 +0000 (14:14 -0800)]
client: don't hide boto return values

The decorator for translating boto exceptions needs to return
explicitly, or it will lose the return value of the original function,
and cause full sync to fail for objects that aren't in the bucket
index log.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
11 years agoadd a test that ensures that wait_for_object is not called if object is not found wip-10102 11/head
Alfredo Deza [Wed, 19 Nov 2014 20:23:59 +0000 (15:23 -0500)]
add a test that ensures that wait_for_object is not called if object is not found

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agoby default object is not found, changing only when sync_object_intra_region() works
Alfredo Deza [Wed, 19 Nov 2014 20:23:04 +0000 (15:23 -0500)]
by default object is not found, changing only when sync_object_intra_region() works

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agoraise SyncFailed on transient errors
Alfredo Deza [Wed, 19 Nov 2014 20:09:50 +0000 (15:09 -0500)]
raise SyncFailed on transient errors

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agoallow a stringified version of the http status code
Alfredo Deza [Wed, 19 Nov 2014 20:09:09 +0000 (15:09 -0500)]
allow a stringified version of the http status code

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agotests for sync_object in worker.py
Alfredo Deza [Wed, 19 Nov 2014 20:08:42 +0000 (15:08 -0500)]
tests for sync_object in worker.py

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agoconfigure logging for testing
Alfredo Deza [Wed, 19 Nov 2014 20:08:24 +0000 (15:08 -0500)]
configure logging for testing

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agolog the exception as error
Alfredo Deza [Wed, 19 Nov 2014 14:03:16 +0000 (09:03 -0500)]
log the exception as error

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agoMerge pull request #10 from ceph/wip-coverage
Josh Durgin [Mon, 17 Nov 2014 21:13:59 +0000 (22:13 +0100)]
Merge pull request #10 from ceph/wip-coverage

add parametrization for endpoint tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
11 years agoadd parametrization for endpoint tests 10/head
Alfredo Deza [Mon, 17 Nov 2014 17:20:54 +0000 (12:20 -0500)]
add parametrization for endpoint tests

Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
11 years agoclient: fix unicode handling
Josh Durgin [Fri, 25 Apr 2014 23:52:16 +0000 (16:52 -0700)]
client: fix unicode handling

Use unicode format strings, and don't url-encode the object copy path
before passing it to requests, which will url-encode it for us.

Partially-fixes: #8202
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agologrotate: don't rotate empty logs
Josh Durgin [Thu, 27 Mar 2014 18:54:50 +0000 (11:54 -0700)]
logrotate: don't rotate empty logs

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agodebian: fix init script installation
Josh Durgin [Sat, 22 Mar 2014 03:44:11 +0000 (20:44 -0700)]
debian: fix init script installation

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agopackaging: fix up spec file for non-python files
Josh Durgin [Sat, 22 Mar 2014 12:10:28 +0000 (05:10 -0700)]
packaging: fix up spec file for non-python files

Correct the installation of the binary, logrotate conf, and init script.
Stop using INSTALLED_FILES. Instead explicitly list files and glob the
python package, as recommended by Fedora's python packaging guide.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agocli: add a default log file
Josh Durgin [Wed, 19 Mar 2014 11:31:29 +0000 (04:31 -0700)]
cli: add a default log file

Now that the packages include /var/log/ceph/radosgw-agent, default to
storing logs there, named after the configuration file or
radosgw-agent.log if no config file was used.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agodebian: depend on python 2.6 or higher
Josh Durgin [Wed, 19 Mar 2014 11:30:02 +0000 (04:30 -0700)]
debian: depend on python 2.6 or higher

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agopackaging: add logrotate config
Josh Durgin [Wed, 19 Mar 2014 10:32:07 +0000 (03:32 -0700)]
packaging: add logrotate config

There's no need to signal running agents since they use
a WatchedFileHandler that detects rotation itself.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agopackaging: add init scripts
Josh Durgin [Wed, 19 Mar 2014 10:11:50 +0000 (03:11 -0700)]
packaging: add init scripts

create log, run, and etc dirs as well

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
11 years agopackaging: add dependency on python-requests
Josh Durgin [Wed, 19 Mar 2014 09:27:32 +0000 (02:27 -0700)]
packaging: add dependency on python-requests

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>