]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
16 years agopsim: count result set sizes
Sage Weil [Wed, 13 May 2009 21:56:28 +0000 (14:56 -0700)]
psim: count result set sizes

16 years agocrush: fall back to exhaustive bucket search for any bucket type
Sage Weil [Wed, 13 May 2009 21:55:07 +0000 (14:55 -0700)]
crush: fall back to exhaustive bucket search for any bucket type

If we don't get a bucket-specific choice in 5 tries, do an
exhaustive search (based on a random permutation).  Only then give
up on the bucket and retry descent.

Note that the search-based fallback does not honor weighting at
all.

16 years agocrush: ditch prime number theorem; generate random permutation on the fly
Sage Weil [Wed, 13 May 2009 21:07:45 +0000 (14:07 -0700)]
crush: ditch prime number theorem; generate random permutation on the fly

16 years agocrush: improve uniform selection a bit
Sage Weil [Wed, 13 May 2009 19:02:45 +0000 (12:02 -0700)]
crush: improve uniform selection a bit

Shift to a new prime (and thus permutation) every few r.

16 years agomds todo
Sage Weil [Mon, 11 May 2009 21:33:17 +0000 (14:33 -0700)]
mds todo

16 years agokclient: fail connection when s_addr==0 and port/nonce don't match
Sage Weil [Mon, 11 May 2009 21:00:52 +0000 (14:00 -0700)]
kclient: fail connection when s_addr==0 and port/nonce don't match

Even if s_addr is 0, the port and nonce should match.  We were
previously going ahead with the connection when we shouldn't have
been.

16 years agomds: maintain capid across mds restart and client reconnect
Sage Weil [Mon, 11 May 2009 20:54:03 +0000 (13:54 -0700)]
mds: maintain capid across mds restart and client reconnect

16 years agomon: don't replace standby mds
Sage Weil [Mon, 11 May 2009 20:21:26 +0000 (13:21 -0700)]
mon: don't replace standby mds

16 years agomds: handle MMonMap
Sage Weil [Mon, 11 May 2009 20:05:38 +0000 (13:05 -0700)]
mds: handle MMonMap

16 years agojournaler: fix replay
Sage Weil [Mon, 11 May 2009 18:51:21 +0000 (11:51 -0700)]
journaler: fix replay

Broken by commit 497ade3b90.

Use objecter to write header (not just to read it).

Also reset the prefetch values each time the layout is set.

16 years agomds: fix loner drops
Sage Weil [Mon, 11 May 2009 18:34:37 +0000 (11:34 -0700)]
mds: fix loner drops

This was broken way back by commit 0c3becdf.

Only drop loner in eval().

16 years agorev protocols
Sage Weil [Mon, 11 May 2009 18:15:44 +0000 (11:15 -0700)]
rev protocols

Just for good measure, since I missed a few changes earlier.

16 years agodebian: new rules file. don't strip.
Sage Weil [Mon, 11 May 2009 18:01:50 +0000 (11:01 -0700)]
debian: new rules file.  don't strip.

16 years agoosd: fix accounting .snap thing
Sage Weil [Mon, 11 May 2009 17:44:20 +0000 (10:44 -0700)]
osd: fix accounting .snap thing

16 years agoconf: improved sample
Sage Weil [Sat, 9 May 2009 18:25:27 +0000 (11:25 -0700)]
conf: improved sample

16 years agomon: check for osd exists before up/down
Sage Weil [Fri, 8 May 2009 20:37:06 +0000 (13:37 -0700)]
mon: check for osd exists before up/down

16 years agoosd: maintain up_epoch AND boot_epoch; revise OSDSuperblock accordingly
Sage Weil [Fri, 8 May 2009 21:04:03 +0000 (14:04 -0700)]
osd: maintain up_epoch AND boot_epoch; revise OSDSuperblock accordingly

In order to make the superblock clean interval meaningful after we
are marked down and then up again (over the life of a single
cosd process insance), we track both boot_epoch and up_epoch,
and keep [boot_epoch,clean_thru] in the superblock.

This avoids seeing crashed pgs when and osd is wrongly marked down
and the osd marks itself up again.

16 years agoosd: adjust heartbeat peer lock
Sage Weil [Fri, 8 May 2009 19:55:37 +0000 (12:55 -0700)]
osd: adjust heartbeat peer lock

Need it to protect heartbeat_from_stamp.

16 years agoosd: reset heartbeat peer set on osd down
Sage Weil [Fri, 8 May 2009 19:55:16 +0000 (12:55 -0700)]
osd: reset heartbeat peer set on osd down

This clears out the timers.

16 years agoosd: adjust snap collection memberships during pg split
Sage Weil [Fri, 8 May 2009 04:42:19 +0000 (21:42 -0700)]
osd: adjust snap collection memberships during pg split

16 years agoosd: adjust pg_stats during pg split
Sage Weil [Fri, 8 May 2009 04:38:26 +0000 (21:38 -0700)]
osd: adjust pg_stats during pg split

16 years agoosd: generate correct child pg when doing pg split
Sage Weil [Fri, 8 May 2009 04:32:53 +0000 (21:32 -0700)]
osd: generate correct child pg when doing pg split

16 years agoceph: don't choke on unexpected MMonMap
Sage Weil [Fri, 8 May 2009 04:13:39 +0000 (21:13 -0700)]
ceph: don't choke on unexpected MMonMap

16 years agokclient: recalculate pgid each time request is sent
Sage Weil [Thu, 7 May 2009 21:39:47 +0000 (14:39 -0700)]
kclient: recalculate pgid each time request is sent

The pg calculation depends on osdmap parameters that are transient.  In
contrast, the rest of calc_layout is concerned with file striping, which
is fixed (at least over the lifetime of the request).

16 years agomds: include CAP_PIN in caps_liked()
Sage Weil [Thu, 7 May 2009 21:14:29 +0000 (14:14 -0700)]
mds: include CAP_PIN in caps_liked()

Among other things, this prevents confusion in the uclient.

16 years agoosd: fix bug in recovery ops accounting
Sage Weil [Thu, 7 May 2009 20:56:14 +0000 (13:56 -0700)]
osd: fix bug in recovery ops accounting

Adjust osd global counter too!

16 years agokclient: a few sparse fixes
Yehuda Sadeh [Thu, 7 May 2009 17:47:32 +0000 (10:47 -0700)]
kclient: a few sparse fixes

16 years agomds: only issue sensible caps on directories
Sage Weil [Wed, 29 Apr 2009 23:50:02 +0000 (16:50 -0700)]
mds: only issue sensible caps on directories

16 years agomds: make eval take a mask; kill try_*_eval
Sage Weil [Wed, 29 Apr 2009 23:27:24 +0000 (16:27 -0700)]
mds: make eval take a mask; kill try_*_eval

This will eventually help us deal with all locks as a group.

Also, simplify the eval_subtree_root bits.

16 years agostart v0.8
Sage Weil [Fri, 1 May 2009 14:27:32 +0000 (07:27 -0700)]
start v0.8

16 years agomsgr: kill static instance 'rank' of SimpleMessenger v0.7.3
Sage Weil [Fri, 1 May 2009 14:11:46 +0000 (07:11 -0700)]
msgr: kill static instance 'rank' of SimpleMessenger

16 years agomsgr: clean up refs to static 'rank'
Sage Weil [Fri, 1 May 2009 13:55:54 +0000 (06:55 -0700)]
msgr: clean up refs to static 'rank'

16 years agouclient: clean up mount wrt osdmap, mdsmap
Sage Weil [Thu, 30 Apr 2009 22:24:43 +0000 (15:24 -0700)]
uclient: clean up mount wrt osdmap, mdsmap

16 years agojournaler: store layout in journal header
Sage Weil [Thu, 30 Apr 2009 18:14:31 +0000 (11:14 -0700)]
journaler: store layout in journal header

This means we won't fall over if the 'default' layout changes.  Specify
the layout during journal creation, as you'd expect.

16 years agomds: clean up layouts
Sage Weil [Thu, 30 Apr 2009 17:42:26 +0000 (10:42 -0700)]
mds: clean up layouts

16 years agoosd: more pg_pool, pg changes
Sage Weil [Thu, 30 Apr 2009 16:44:39 +0000 (09:44 -0700)]
osd: more pg_pool, pg changes

Remove 'type' from pg_t.  It's implied based on the pool.

Clean out file_layout.  The pool implies a type and namespace.

16 years agokclient: fix page_mkwrite for 2.6.30
Sage Weil [Thu, 30 Apr 2009 14:12:07 +0000 (07:12 -0700)]
kclient: fix page_mkwrite for 2.6.30

This will change again soon when Nick's other fix gets merged.  Also, we
probably need to stop doing write_begin/end due to some differences in
behavior (e.g., no extending file size? see btrfs as a reference).

16 years agoosd: typo
Sage Weil [Wed, 29 Apr 2009 22:37:39 +0000 (15:37 -0700)]
osd: typo

16 years agoconfig: fix pg pools in default file layouts
Sage Weil [Wed, 29 Apr 2009 19:50:07 +0000 (12:50 -0700)]
config: fix pg pools in default file layouts

16 years agoosd: fix up recovery op accounting
Sage Weil [Wed, 29 Apr 2009 22:33:31 +0000 (15:33 -0700)]
osd: fix up recovery op accounting

Fix varous rop accounting bugs.  Add assertions.  Log recovery
ops.

16 years agotodo
Sage Weil [Wed, 29 Apr 2009 19:06:42 +0000 (12:06 -0700)]
todo

16 years agokclient: retry 2x on ESTALE; fix up mds reply error paths
Sage Weil [Wed, 29 Apr 2009 18:47:13 +0000 (11:47 -0700)]
kclient: retry 2x on ESTALE; fix up mds reply error paths

Also fix error paths, which weren't handling the snap_rwsem
properly.

16 years agokclient: fix symbol names without 'ceph_' prefix
Sage Weil [Wed, 29 Apr 2009 18:44:03 +0000 (11:44 -0700)]
kclient: fix symbol names without 'ceph_' prefix

16 years agokclient: add missing parameter
Yehuda Sadeh [Wed, 29 Apr 2009 19:00:08 +0000 (12:00 -0700)]
kclient: add missing parameter

16 years agoconf: added missing allocations
Yehuda Sadeh [Wed, 29 Apr 2009 18:41:44 +0000 (11:41 -0700)]
conf: added missing allocations

16 years agomon: track per-pg_pool usage
Sage Weil [Wed, 29 Apr 2009 18:38:11 +0000 (11:38 -0700)]
mon: track per-pg_pool usage

16 years agoconfig: make uninit var warning go away
Sage Weil [Wed, 29 Apr 2009 18:13:13 +0000 (11:13 -0700)]
config: make uninit var warning go away

16 years agoosd: push pg_num etc into pg_pool
Sage Weil [Wed, 29 Apr 2009 18:13:01 +0000 (11:13 -0700)]
osd: push pg_num etc into pg_pool

16 years agoosd: clean up assemble_backlog
Sage Weil [Tue, 28 Apr 2009 23:44:12 +0000 (16:44 -0700)]
osd: clean up assemble_backlog

16 years agokclient: don't allow to pass max file size
Yehuda Sadeh [Tue, 28 Apr 2009 23:45:10 +0000 (16:45 -0700)]
kclient: don't allow to pass max file size

16 years agotodo
Sage Weil [Tue, 28 Apr 2009 23:30:34 +0000 (16:30 -0700)]
todo

16 years agoosd: make osd mark itself back up if it is marked down
Sage Weil [Tue, 28 Apr 2009 23:30:12 +0000 (16:30 -0700)]
osd: make osd mark itself back up if it is marked down

We may still want a way to tell an osd to exit.

16 years agomon: optionally dump specific osdmap epoch
Sage Weil [Tue, 28 Apr 2009 23:29:15 +0000 (16:29 -0700)]
mon: optionally dump specific osdmap epoch

16 years agouclient: update dir inode, cap from reply
Sage Weil [Tue, 28 Apr 2009 21:08:57 +0000 (14:08 -0700)]
uclient: update dir inode, cap from reply

16 years agovstart: --nodaemon to run via crun and -f (so that gprof works)
Sage Weil [Tue, 28 Apr 2009 20:42:49 +0000 (13:42 -0700)]
vstart: --nodaemon to run via crun and -f (so that gprof works)

16 years agouclient: take inode ref when dirtying inode
Sage Weil [Tue, 28 Apr 2009 20:22:29 +0000 (13:22 -0700)]
uclient: take inode ref when dirtying inode

16 years agoinitscript: default btrfs mount options notreelog,flushoncommit
Sage Weil [Tue, 28 Apr 2009 19:12:05 +0000 (12:12 -0700)]
initscript: default btrfs mount options notreelog,flushoncommit

16 years agocosd: use \ in dev list in .conf
Sage Weil [Mon, 27 Apr 2009 20:54:23 +0000 (13:54 -0700)]
cosd: use \ in dev list in .conf

16 years agoosd: fix merge_log split point
Sage Weil [Mon, 27 Apr 2009 20:54:10 +0000 (13:54 -0700)]
osd: fix merge_log split point

Look at full eversion, not just .version (part 2).

16 years agomon: order log entries as they're committed
Sage Weil [Tue, 28 Apr 2009 20:10:50 +0000 (13:10 -0700)]
mon: order log entries as they're committed

This doesn't fully order them (across commits), but it helps.

16 years agomon: adjust log levels
Sage Weil [Tue, 28 Apr 2009 05:37:09 +0000 (22:37 -0700)]
mon: adjust log levels

16 years agotodo
Sage Weil [Tue, 28 Apr 2009 05:34:52 +0000 (22:34 -0700)]
todo

16 years agoassert: turn off tls in assert macro
Sage Weil [Tue, 28 Apr 2009 19:54:02 +0000 (12:54 -0700)]
assert: turn off tls in assert macro

About 3% cpu time

16 years agokclient: mark caps sync in check_caps writeback path too
Sage Weil [Tue, 28 Apr 2009 05:16:35 +0000 (22:16 -0700)]
kclient: mark caps sync in check_caps writeback path too

We are already doing so in try_flush_caps().

16 years agokclient: added missing include
Sage Weil [Tue, 28 Apr 2009 05:01:52 +0000 (22:01 -0700)]
kclient: added missing include

16 years agotodo
Sage Weil [Mon, 27 Apr 2009 23:32:43 +0000 (16:32 -0700)]
todo

16 years agoosd: make pg pools resizeable
Sage Weil [Mon, 27 Apr 2009 23:31:50 +0000 (16:31 -0700)]
osd: make pg pools resizeable

Move the pg size from the pgid to the pg_pool descriptor, so that
entire pools of pgs can be resized.

16 years agotodo
Sage Weil [Mon, 27 Apr 2009 20:35:21 +0000 (13:35 -0700)]
todo

16 years agoconfig: -v or --version to print version info
Sage Weil [Mon, 27 Apr 2009 20:32:50 +0000 (13:32 -0700)]
config: -v or --version to print version info

16 years agomon: make down->out osd occur despite mon restarts
Sage Weil [Mon, 27 Apr 2009 19:13:54 +0000 (12:13 -0700)]
mon: make down->out osd occur despite mon restarts

Also add a bit more sanity checking to make sure we don't do the
wrong thing.

16 years agocosd: no valgrind for now
Sage Weil [Mon, 27 Apr 2009 18:53:35 +0000 (11:53 -0700)]
cosd: no valgrind for now

16 years agocommon: add some colors on startup (errors, warnings)
Yehuda Sadeh [Tue, 28 Apr 2009 18:02:55 +0000 (11:02 -0700)]
common: add some colors on startup (errors, warnings)

16 years agoconf: fix allocation
Yehuda Sadeh [Tue, 28 Apr 2009 17:14:05 +0000 (10:14 -0700)]
conf: fix allocation

16 years agoauth: some leaks fixes
Yehuda Sadeh [Mon, 27 Apr 2009 23:26:27 +0000 (16:26 -0700)]
auth: some leaks fixes

16 years agoconf: some more leak fixes
Yehuda Sadeh [Mon, 27 Apr 2009 23:17:53 +0000 (16:17 -0700)]
conf: some more leak fixes

16 years agoconf: some more leak fixes
Yehuda Sadeh [Mon, 27 Apr 2009 21:10:48 +0000 (14:10 -0700)]
conf: some more leak fixes

16 years agocmon: redo remove backslash from end of line
Yehuda Sadeh [Mon, 27 Apr 2009 20:36:17 +0000 (13:36 -0700)]
cmon: redo remove backslash from end of line

16 years agoconf: remove backslash from the end of line
Yehuda Sadeh [Mon, 27 Apr 2009 20:35:26 +0000 (13:35 -0700)]
conf: remove backslash from the end of line

16 years agoconf: add backslash line continuation
Yehuda Sadeh [Mon, 27 Apr 2009 20:31:39 +0000 (13:31 -0700)]
conf: add backslash line continuation

16 years agotodo
Sage Weil [Mon, 27 Apr 2009 18:57:02 +0000 (11:57 -0700)]
todo

16 years agomds: use interval_set for ino allocation
Sage Weil [Mon, 27 Apr 2009 18:52:40 +0000 (11:52 -0700)]
mds: use interval_set for ino allocation

This avoids long ino lists.  Changes ondisk format, unfortunately.

16 years agomon: only log osd boot once
Sage Weil [Mon, 27 Apr 2009 17:50:37 +0000 (10:50 -0700)]
mon: only log osd boot once

16 years agoosd: fix merge_log when split point is divergent
Sage Weil [Mon, 27 Apr 2009 17:22:24 +0000 (10:22 -0700)]
osd: fix merge_log when split point is divergent

Need to compare full eversion (including epoch).

16 years agokclient: avoid spinlock recursion
Yehuda Sadeh [Mon, 27 Apr 2009 18:19:40 +0000 (11:19 -0700)]
kclient: avoid spinlock recursion

16 years agoconf: remove some memory leaks, still have some more
Yehuda Sadeh [Fri, 24 Apr 2009 19:43:30 +0000 (12:43 -0700)]
conf: remove some memory leaks, still have some more

16 years agoupdated sample ceph.conf
Sage Weil [Thu, 23 Apr 2009 23:52:05 +0000 (16:52 -0700)]
updated sample ceph.conf

16 years agoinitscript: cleanup debug
Sage Weil [Thu, 23 Apr 2009 23:48:53 +0000 (16:48 -0700)]
initscript: cleanup debug

16 years agoosd: fix pg missing updates
Sage Weil [Thu, 23 Apr 2009 23:41:34 +0000 (16:41 -0700)]
osd: fix pg missing updates

We may be missing a divergent copy of the same object.

16 years agoosd: do not advance past split point if it is not shared
Sage Weil [Thu, 23 Apr 2009 23:41:09 +0000 (16:41 -0700)]
osd: do not advance past split point if it is not shared

16 years agoinitscript: run valgrind with specified options
Sage Weil [Thu, 23 Apr 2009 22:55:03 +0000 (15:55 -0700)]
initscript: run valgrind with specified options

16 years agoosd: reformat osd map dump
Sage Weil [Thu, 23 Apr 2009 22:53:50 +0000 (15:53 -0700)]
osd: reformat osd map dump

16 years agoosd: set mtime in backlog log entries
Sage Weil [Thu, 23 Apr 2009 22:52:09 +0000 (15:52 -0700)]
osd: set mtime in backlog log entries

16 years agoinitscript: modprobe btrfs and btrfsctl -a before mount
Sage Weil [Thu, 23 Apr 2009 22:12:26 +0000 (15:12 -0700)]
initscript: modprobe btrfs and btrfsctl -a before mount

16 years agomon: fix osd mark out code
Sage Weil [Thu, 23 Apr 2009 22:12:06 +0000 (15:12 -0700)]
mon: fix osd mark out code

16 years agokclient: fix dcache_lock ordering
Sage Weil [Thu, 23 Apr 2009 16:49:13 +0000 (09:49 -0700)]
kclient: fix dcache_lock ordering

16 years agomon: allow clusters of size 2
Sage Weil [Thu, 23 Apr 2009 19:07:56 +0000 (12:07 -0700)]
mon: allow clusters of size 2

16 years agomon: clean up log msg formats a bit
Sage Weil [Thu, 23 Apr 2009 17:41:05 +0000 (10:41 -0700)]
mon: clean up log msg formats a bit

16 years agomon: don't log 'osd alive' updates
Sage Weil [Thu, 23 Apr 2009 17:33:51 +0000 (10:33 -0700)]
mon: don't log 'osd alive' updates

These probably don't need to go in the main log.

16 years agoosd: only trim pg log if pg is complete
Sage Weil [Thu, 23 Apr 2009 17:22:49 +0000 (10:22 -0700)]
osd: only trim pg log if pg is complete

Good policy.  And log.trim() so asserts.

16 years agoosd: set osd down -> out interval to 5 minutes
Sage Weil [Thu, 23 Apr 2009 17:20:11 +0000 (10:20 -0700)]
osd: set osd down -> out interval to 5 minutes

This is the delay from when an osd is marked down before we decide it
won't recover soon as we migrate/replicate data elsewhere.