]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
16 years agos3: fastcgi s3 gateway
Yehuda Sadeh [Fri, 12 Jun 2009 19:48:09 +0000 (12:48 -0700)]
s3: fastcgi s3 gateway

16 years agoobjecter: unify read and write paths
Sage Weil [Fri, 12 Jun 2009 18:17:19 +0000 (11:17 -0700)]
objecter: unify read and write paths

No longer any reason to segregate read and write paths.

16 years agoosd: you may, but need not, specify READ|WRITE flag in MOSDOp.
Sage Weil [Fri, 12 Jun 2009 05:55:07 +0000 (22:55 -0700)]
osd: you may, but need not, specify READ|WRITE flag in MOSDOp.

The OSD will implicitly set the bits based on your OSDOps or class method
calls.  The client may still find it useful to specify these expicitly
for it's own informational purposes.

Make sure the MOSDOpReply has bits set based on the _actual_ op performed.

Note that as things stand, this will confuse the Objecter, who relies on
these bits to choose read or modify reply paths and doesn't know a priori
what mode a method is.

16 years agouClient: Fixed a copying error and a double lock.
Greg Farnum [Thu, 11 Jun 2009 23:23:26 +0000 (16:23 -0700)]
uClient: Fixed a copying error and a double lock.

16 years agoSwitched Client to use objecter's statfs methods.
Greg Farnum [Thu, 11 Jun 2009 22:50:21 +0000 (15:50 -0700)]
Switched Client to use objecter's statfs methods.

16 years agoRebase and better naming.
Greg Farnum [Thu, 11 Jun 2009 22:08:53 +0000 (15:08 -0700)]
Rebase and better naming.

16 years agoAdded support for MStatfs to librados and Objecter.
Greg Farnum [Thu, 11 Jun 2009 21:51:12 +0000 (14:51 -0700)]
Added support for MStatfs to librados and Objecter.

16 years agomds: turn off mds ref sets
Sage Weil [Thu, 11 Jun 2009 21:33:19 +0000 (14:33 -0700)]
mds: turn off mds ref sets

16 years agomds: kill unused CInode.last_open_journaled
Sage Weil [Thu, 11 Jun 2009 21:33:08 +0000 (14:33 -0700)]
mds: kill unused CInode.last_open_journaled

16 years agokclient: include full path names (in parens) in debugfs mdsc
Sage Weil [Thu, 11 Jun 2009 21:07:28 +0000 (14:07 -0700)]
kclient: include full path names (in parens) in debugfs mdsc

16 years agokclient: fix cap reconnect path generation
Sage Weil [Thu, 11 Jun 2009 21:03:22 +0000 (14:03 -0700)]
kclient: fix cap reconnect path generation

This was preventing all caps from reconnecting on mds restart.

16 years agouclient: mark down failed mds
Sage Weil [Thu, 11 Jun 2009 20:17:06 +0000 (13:17 -0700)]
uclient: mark down failed mds

16 years agocosd: one mds for now
Sage Weil [Thu, 11 Jun 2009 20:16:32 +0000 (13:16 -0700)]
cosd: one mds for now

16 years agomds: use boost::pool for CInode, CDentry, CDir, Capability
Sage Weil [Thu, 11 Jun 2009 19:50:25 +0000 (12:50 -0700)]
mds: use boost::pool for CInode, CDentry, CDir, Capability

16 years agoosd: fail gracefully if OSDOp.data is empty
Sage Weil [Thu, 11 Jun 2009 19:49:48 +0000 (12:49 -0700)]
osd: fail gracefully if OSDOp.data is empty

This happens for MOSDOpReply, currently.

16 years agomon: use pool_stat_t for pool summation in PGMap
Sage Weil [Thu, 11 Jun 2009 17:45:37 +0000 (10:45 -0700)]
mon: use pool_stat_t for pool summation in PGMap

pg_stat_t has a lot of pg-specific fields we don't need for the
pool and total summations.

16 years agomds: cut back on hash_map usage
Sage Weil [Thu, 11 Jun 2009 17:18:48 +0000 (10:18 -0700)]
mds: cut back on hash_map usage

These use lots of memory, and aren't necessary for smallish maps.

16 years agomds: fix inotable encoding
Sage Weil [Thu, 11 Jun 2009 17:32:31 +0000 (10:32 -0700)]
mds: fix inotable encoding

ALWAYS use proper interval_set encoders (not the .m), or else the
.size() methods won't behave after decoding.

16 years agolibrados: add const to aio_write bl arg
Sage Weil [Mon, 8 Jun 2009 21:36:07 +0000 (14:36 -0700)]
librados: add const to aio_write bl arg

16 years agolibrados: make get pool stats work
Sage Weil [Thu, 11 Jun 2009 16:49:46 +0000 (09:49 -0700)]
librados: make get pool stats work

16 years agomon: process MGetPoolStats
Sage Weil [Thu, 11 Jun 2009 16:49:39 +0000 (09:49 -0700)]
mon: process MGetPoolStats

16 years agoosd: fix encoding/decoding of [sub]op response
Yehuda Sadeh [Wed, 10 Jun 2009 21:26:11 +0000 (14:26 -0700)]
osd: fix encoding/decoding of [sub]op response

16 years agokclient: fix typo
Sage Weil [Thu, 11 Jun 2009 04:28:26 +0000 (21:28 -0700)]
kclient: fix typo

16 years agobuffer: append individual chars
Sage Weil [Thu, 11 Jun 2009 04:21:23 +0000 (21:21 -0700)]
buffer: append individual chars

16 years agoosd: fix MOSDOp printout
Sage Weil [Thu, 11 Jun 2009 01:36:16 +0000 (18:36 -0700)]
osd: fix MOSDOp printout

16 years agorados: add new headers
Sage Weil [Thu, 11 Jun 2009 00:52:39 +0000 (17:52 -0700)]
rados: add new headers

16 years agolibrados: client side for getting pg stats
Sage Weil [Wed, 10 Jun 2009 23:50:14 +0000 (16:50 -0700)]
librados: client side for getting pg stats

No server side yet!

16 years agokclient: make /debug/ceph/client#/mdsc filenames work, cleanup
Sage Weil [Wed, 10 Jun 2009 22:59:35 +0000 (15:59 -0700)]
kclient: make /debug/ceph/client#/mdsc filenames work, cleanup

Just print #ino/path for dentries, since that's what goes over the
wire.

16 years agoradostool: lssnap
Sage Weil [Wed, 10 Jun 2009 21:30:17 +0000 (14:30 -0700)]
radostool: lssnap

16 years agoAdded a current bandwidth meter to radostool bench.
Greg Farnum [Wed, 10 Jun 2009 23:04:12 +0000 (16:04 -0700)]
Added a current bandwidth meter to radostool bench.

Prints out once/second or at every write, whichever is slowest.

16 years agoosd: destroy messengers on shutdown
Sage Weil [Wed, 10 Jun 2009 21:04:52 +0000 (14:04 -0700)]
osd: destroy messengers on shutdown

16 years agomonclient: avoid hang during startup
Sage Weil [Wed, 10 Jun 2009 21:04:35 +0000 (14:04 -0700)]
monclient: avoid hang during startup

16 years agoosd: fix huge memory leak (MOSDOp)
Sage Weil [Wed, 10 Jun 2009 20:37:28 +0000 (13:37 -0700)]
osd: fix huge memory leak (MOSDOp)

16 years agoradostool: select snaps, rm objects
Sage Weil [Wed, 10 Jun 2009 19:48:41 +0000 (12:48 -0700)]
radostool: select snaps, rm objects

16 years agorados: get rid of wrcall
Yehuda Sadeh [Wed, 10 Jun 2009 19:53:35 +0000 (12:53 -0700)]
rados: get rid of wrcall

16 years agorados: rename rdcall to call
Yehuda Sadeh [Wed, 10 Jun 2009 19:16:47 +0000 (12:16 -0700)]
rados: rename rdcall to call

16 years agoclass: add cls_setxattr
Yehuda Sadeh [Wed, 10 Jun 2009 18:18:17 +0000 (11:18 -0700)]
class: add cls_setxattr

16 years agoclass: set method flags on registration
Yehuda Sadeh [Wed, 10 Jun 2009 17:50:25 +0000 (10:50 -0700)]
class: set method flags on registration

16 years agoosd: don't call may_read/may_write prematurely (revert previous)
Yehuda Sadeh [Wed, 10 Jun 2009 17:26:42 +0000 (10:26 -0700)]
osd: don't call may_read/may_write prematurely (revert previous)

16 years agoosd: update rwm flags for incoming ops
Yehuda Sadeh [Wed, 10 Jun 2009 17:04:11 +0000 (10:04 -0700)]
osd: update rwm flags for incoming ops

16 years agoradostool: clean up bench args, usage
Sage Weil [Wed, 10 Jun 2009 03:51:07 +0000 (20:51 -0700)]
radostool: clean up bench args, usage

16 years agoosd: include size in object_info_t
Sage Weil [Wed, 10 Jun 2009 03:33:15 +0000 (20:33 -0700)]
osd: include size in object_info_t

The main advantage here, aside from slightly decluttering the
code, is to avoid a stat() in get_object_context.  We just
getxattr and that will implicitly tell us if the object
exists.  (If the file exists but the OI_ATTR xattr doesn't,
the object is busted anyway.)

16 years agoosd: include ondisk magic in encoding for key ondisk state structs
Sage Weil [Wed, 10 Jun 2009 03:29:34 +0000 (20:29 -0700)]
osd: include ondisk magic in encoding for key ondisk state structs

This will eventually allow us to incrementally migrate to
updated ondisk structures by making the decoding conditional
(dependent on the encoded version).  At least in some cases.

16 years agorados: remove testradoscio[pp] targets
Sage Weil [Wed, 10 Jun 2009 03:17:13 +0000 (20:17 -0700)]
rados: remove testradoscio[pp] targets

16 years agorados: add helper to header
Sage Weil [Wed, 10 Jun 2009 01:53:16 +0000 (18:53 -0700)]
rados: add helper to header

16 years agobuffer: remove unused field
Sage Weil [Wed, 10 Jun 2009 01:53:00 +0000 (18:53 -0700)]
buffer: remove unused field

16 years agoosd: fix up OSDOp printing
Sage Weil [Wed, 10 Jun 2009 01:52:43 +0000 (18:52 -0700)]
osd: fix up OSDOp printing

16 years agoradostool now includes benchmarking functionality from testradosciopp.cc
Greg Farnum [Wed, 10 Jun 2009 00:01:37 +0000 (17:01 -0700)]
radostool now includes benchmarking functionality from testradosciopp.cc

16 years agoosd: rev osd protocol
Sage Weil [Tue, 9 Jun 2009 23:48:41 +0000 (16:48 -0700)]
osd: rev osd protocol

16 years agokclient: include tid in osdc debugfs dump
Sage Weil [Tue, 9 Jun 2009 23:20:37 +0000 (16:20 -0700)]
kclient: include tid in osdc debugfs dump

16 years agoosd: hold op data on the specific op
Yehuda Sadeh [Tue, 9 Jun 2009 23:33:30 +0000 (16:33 -0700)]
osd: hold op data on the specific op

16 years agomsgr: calculate data crc after encode_payload, in worker thread
Sage Weil [Tue, 9 Jun 2009 23:02:15 +0000 (16:02 -0700)]
msgr: calculate data crc after encode_payload, in worker thread

Faster (bc crc calc is in msgr worker thread).  Also allows
encode_payload() to manipulate data.

16 years agoRemoved time_t -> int conversion warnings.
Greg Farnum [Tue, 9 Jun 2009 22:59:54 +0000 (15:59 -0700)]
Removed time_t -> int conversion warnings.

16 years agomds: fix dir frag split replay
Sage Weil [Tue, 9 Jun 2009 22:22:55 +0000 (15:22 -0700)]
mds: fix dir frag split replay

is_complete() may not be set, but split is still allowed.

16 years agoosd: don't clobber pg_stats.reported when repairing stats
Sage Weil [Tue, 9 Jun 2009 22:22:18 +0000 (15:22 -0700)]
osd: don't clobber pg_stats.reported when repairing stats

16 years agomds: do not fragment dirs if mds_bal_fragment_interval <= 0
Sage Weil [Tue, 9 Jun 2009 22:07:24 +0000 (15:07 -0700)]
mds: do not fragment dirs if mds_bal_fragment_interval <= 0

16 years agoradostool: cleanup
Sage Weil [Tue, 9 Jun 2009 21:58:53 +0000 (14:58 -0700)]
radostool: cleanup

16 years agoHurray, this file works properly as a standalone.
greg [Tue, 9 Jun 2009 21:49:21 +0000 (14:49 -0700)]
Hurray, this file works properly as a standalone.

It takes concurrent writes to maintain, minimum runtime, size of the writes, and whether or not to check for consistency. Reports total runtime, writes made, bandwidth, average & max latency, and time waiting for Rados.

16 years agoAdded initial testradosciopp.cc.
greg [Tue, 9 Jun 2009 00:06:42 +0000 (17:06 -0700)]
Added initial testradosciopp.cc.

16 years agoA properly working testradoscio.c. For the moment it just takes a number of writes...
greg [Mon, 8 Jun 2009 18:35:57 +0000 (11:35 -0700)]
A properly working testradoscio.c. For the moment it just takes a number of writes to make and does that number in a loop.

16 years agoosd: simplify op read/write flag setup
Sage Weil [Tue, 9 Jun 2009 21:49:43 +0000 (14:49 -0700)]
osd: simplify op read/write flag setup

16 years agoosd: kick pg on active set change
Sage Weil [Tue, 9 Jun 2009 21:36:43 +0000 (14:36 -0700)]
osd: kick pg on active set change

16 years agocommon: kill obsolete common/ThreadPool.h
Sage Weil [Tue, 9 Jun 2009 21:22:18 +0000 (14:22 -0700)]
common: kill obsolete common/ThreadPool.h

16 years agoosd: fix osd shutdown vs scrub work queue deadlock
Sage Weil [Tue, 9 Jun 2009 21:18:29 +0000 (14:18 -0700)]
osd: fix osd shutdown vs scrub work queue deadlock

Pause new disk_tp items, kick all (possibly) blocked pgs, and _then_
stop the disk_tp.  And make scrub() bail out if the osd is stopping.

16 years agomon: fix 'scrub' -> 'repair' in command reply msg
Sage Weil [Tue, 9 Jun 2009 20:26:20 +0000 (13:26 -0700)]
mon: fix 'scrub' -> 'repair' in command reply msg

16 years agoosd: counnt errors fixed during repair, and indicate scrub vs repair
Sage Weil [Tue, 9 Jun 2009 20:24:52 +0000 (13:24 -0700)]
osd: counnt errors fixed during repair, and indicate scrub vs repair

16 years agoosd: fix pg stats on repair
Sage Weil [Tue, 9 Jun 2009 20:03:52 +0000 (13:03 -0700)]
osd: fix pg stats on repair

16 years agoosd: replica should not check missing map on push
Sage Weil [Tue, 9 Jun 2009 19:08:05 +0000 (12:08 -0700)]
osd: replica should not check missing map on push

That is, we should let the primary push us objects even if we don't
think they're missing.  This is necessary for pg repair to work.

The old check is useless, since we already restart peering when the
pg changes, and ignore pre-change sub_op messages.

16 years agoosd: improved logging for scrub
Sage Weil [Tue, 9 Jun 2009 19:03:02 +0000 (12:03 -0700)]
osd: improved logging for scrub

16 years agoosd: fix repair_object attr name
Sage Weil [Tue, 9 Jun 2009 18:20:46 +0000 (11:20 -0700)]
osd: fix repair_object attr name

Didn't get switched from 'oi' to '_' way back when.

16 years agoosd: fix pg parsing
Sage Weil [Tue, 9 Jun 2009 18:18:01 +0000 (11:18 -0700)]
osd: fix pg parsing

16 years agoosd: read/write op flags revision (for class methods)
Yehuda Sadeh [Tue, 9 Jun 2009 20:24:31 +0000 (13:24 -0700)]
osd: read/write op flags revision (for class methods)

16 years agoclass: class acl stuff preliminary stuff
Yehuda Sadeh [Tue, 9 Jun 2009 20:24:03 +0000 (13:24 -0700)]
class: class acl stuff preliminary stuff

16 years agomon: don't dup entires in log.err
Sage Weil [Tue, 9 Jun 2009 18:08:11 +0000 (11:08 -0700)]
mon: don't dup entires in log.err

16 years agoosd: fix backlog ordering part deux
Sage Weil [Tue, 9 Jun 2009 17:57:59 +0000 (10:57 -0700)]
osd: fix backlog ordering part deux

Remove the old entry from the map!

16 years agoosd: repair out of order logs in read_log
Sage Weil [Tue, 9 Jun 2009 17:36:03 +0000 (10:36 -0700)]
osd: repair out of order logs in read_log

Works around bug fixed in f1ff93.

16 years agoosd: fix order of prior_version backlog entries
Sage Weil [Tue, 9 Jun 2009 00:36:43 +0000 (17:36 -0700)]
osd: fix order of prior_version backlog entries

They need to end up in the log in the proper order. So make 2 passes,
one to generate the entries, and a second to prepend them to the log.

16 years agoosd: cleanup
Sage Weil [Mon, 8 Jun 2009 22:52:14 +0000 (15:52 -0700)]
osd: cleanup

16 years agomon: handle failures during CLIENTREPLAY state
Sage Weil [Mon, 8 Jun 2009 22:51:46 +0000 (15:51 -0700)]
mon: handle failures during CLIENTREPLAY state

16 years agoradostool: 'ls' fixes
Sage Weil [Mon, 8 Jun 2009 21:11:22 +0000 (14:11 -0700)]
radostool: 'ls' fixes

16 years agolibrados: fix locking on sync methods
Sage Weil [Mon, 8 Jun 2009 21:05:12 +0000 (14:05 -0700)]
librados: fix locking on sync methods

16 years agoobjclass: fix compilation
Sage Weil [Mon, 8 Jun 2009 20:53:07 +0000 (13:53 -0700)]
objclass: fix compilation

16 years agoclass: makefile, include fixes
Yehuda Sadeh [Mon, 8 Jun 2009 20:48:28 +0000 (13:48 -0700)]
class: makefile, include fixes

16 years agoconf: avoid parsing daemon related config options when not needed
Yehuda Sadeh [Mon, 8 Jun 2009 20:22:03 +0000 (13:22 -0700)]
conf: avoid parsing daemon related config options when not needed

16 years agoosd: copy soid out of iterator
Sage Weil [Mon, 8 Jun 2009 19:57:39 +0000 (12:57 -0700)]
osd: copy soid out of iterator

A ref into the iterator is inherently risky.

16 years agokclient: filemap_write_and_wait_range not exported < 2.6.30
Sage Weil [Mon, 8 Jun 2009 19:08:49 +0000 (12:08 -0700)]
kclient: filemap_write_and_wait_range not exported < 2.6.30

Include a warning that snap flushing may not work.

16 years agocosd: put mds on ceph4
Sage Weil [Mon, 8 Jun 2009 19:08:09 +0000 (12:08 -0700)]
cosd: put mds on ceph4

16 years agoosd: fix use-after-free on osd
Sage Weil [Mon, 8 Jun 2009 19:07:25 +0000 (12:07 -0700)]
osd: fix use-after-free on osd

push_to_replica is called on a sobject_t ref from the missing map,
and then removes the item from said missing map.  Reorder to avoid
the soid mangling.

16 years agoosd: write pg info _after_ updating log
Sage Weil [Mon, 8 Jun 2009 16:54:30 +0000 (09:54 -0700)]
osd: write pg info _after_ updating log

Otherwise the log bounds don't match the PG::Info!

16 years agomds: restore session state on load; only save opened sessions
Sage Weil [Mon, 8 Jun 2009 05:20:42 +0000 (22:20 -0700)]
mds: restore session state on load; only save opened sessions

16 years agoosd: remove bad assertions from IndexedLog::print()
Sage Weil [Sun, 7 Jun 2009 22:21:54 +0000 (15:21 -0700)]
osd: remove bad assertions from IndexedLog::print()

16 years agolibrados: add/fix locking
Sage Weil [Mon, 8 Jun 2009 18:03:01 +0000 (11:03 -0700)]
librados: add/fix locking

16 years agolibrados: rename AioCompletion::put -> release
Sage Weil [Mon, 8 Jun 2009 16:43:53 +0000 (09:43 -0700)]
librados: rename AioCompletion::put -> release

16 years agofilestore: escape / and leading . in object names
Sage Weil [Mon, 8 Jun 2009 18:01:01 +0000 (11:01 -0700)]
filestore: escape / and leading . in object names

Conflicts:

src/testrados.c

16 years agomds: allow online changes in mds_log_max_segments, events
Sage Weil [Sun, 7 Jun 2009 22:18:23 +0000 (15:18 -0700)]
mds: allow online changes in mds_log_max_segments, events

16 years agomds: move 'buf' column to right
Sage Weil [Sun, 7 Jun 2009 22:17:48 +0000 (15:17 -0700)]
mds: move 'buf' column to right

16 years agoosd: only update peer_info if !noop
Sage Weil [Sun, 7 Jun 2009 22:17:25 +0000 (15:17 -0700)]
osd: only update peer_info if !noop

16 years agomds: log memory stats to mds%d.mem
Sage Weil [Sun, 7 Jun 2009 21:28:49 +0000 (14:28 -0700)]
mds: log memory stats to mds%d.mem

16 years agolibrados: basic snap api?
Sage Weil [Sat, 6 Jun 2009 22:55:56 +0000 (15:55 -0700)]
librados: basic snap api?

Not actually implemented.

16 years agoradostool: add 'get' and 'put'
Sage Weil [Sat, 6 Jun 2009 21:44:07 +0000 (14:44 -0700)]
radostool: add 'get' and 'put'