Previously, a sync worker receiving
a ConnectionError exception would
be effectively dead but the sync worker
would still be waiting for more results.
This patch adds a check that if
all the worker processes have failed
due to connection errors,
then the syncer should exit.
Joe Buck [Fri, 30 Aug 2013 16:26:46 +0000 (09:26 -0700)]
Improve exception handling
Catch exceptions and continue syncing items
in that shard but do NOT update the worker
bounds. This will result in redundant work
but prevents an error from stopping
the syncing of objects 'after' that object
in the same shard.
Signed-off-by: Joe Buck <jbbuck@gmail.com> Reviewd-by: Josh Durgin <josh.durgin@inktank.com>
Add a quick and dirty http serving mode for testing
POST to --test-server-host:--test-server-port/metadata/[partial|full]
to do a partial or full metadata sync. The server will respond
when the sync is complete.