]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
16 years agokclient: nofail mode for osd writes
Sage Weil [Wed, 29 Jul 2009 20:28:23 +0000 (13:28 -0700)]
kclient: nofail mode for osd writes

If nofail is specified, allocate request from mempool, and do not
return error on message send failure.  Instead, mark the request,
and periodically retry.

This isn't perfect: we can still starve indefinitely trying to
send the write, but it'll do until we have a better way to reserve
resources for writeback messages.

16 years agokclient: use mempool for osd req in writeback paths
Sage Weil [Tue, 28 Jul 2009 20:01:49 +0000 (13:01 -0700)]
kclient: use mempool for osd req in writeback paths

Only in writeback path.  For reads and sync writes, avoid the
mempool.

16 years agoHadoop: Removed unnecessary reload of hadoopcephfs.
Greg Farnum [Wed, 29 Jul 2009 01:26:59 +0000 (18:26 -0700)]
Hadoop: Removed unnecessary reload of hadoopcephfs.

16 years agoHadoop: More debugging statements, converted to use a method we can flag off.
Greg Farnum [Wed, 29 Jul 2009 01:24:16 +0000 (18:24 -0700)]
Hadoop: More debugging statements, converted to use a method we can flag off.

16 years agolibceph: add a check in ceph_deinitialize to prevent badness on multiple calls.
Greg Farnum [Wed, 29 Jul 2009 01:22:00 +0000 (18:22 -0700)]
libceph: add a check in ceph_deinitialize to prevent badness on multiple calls.

16 years agouclient: getcwd fixes
Greg Farnum [Tue, 28 Jul 2009 18:45:15 +0000 (11:45 -0700)]
uclient: getcwd fixes

16 years agokclient: bug on back kmap
Sage Weil [Wed, 29 Jul 2009 00:02:22 +0000 (17:02 -0700)]
kclient: bug on back kmap

16 years agoosd: fail gracefully when problems reading /proc/loadavg
Sage Weil [Tue, 28 Jul 2009 21:44:48 +0000 (14:44 -0700)]
osd: fail gracefully when problems reading /proc/loadavg

16 years agoauth: compat with old struct
Sage Weil [Tue, 28 Jul 2009 18:31:43 +0000 (11:31 -0700)]
auth: compat with old struct

16 years agoinitscript: skip if auto start = no/false/0 and nothing or type specified
Sage Weil [Tue, 28 Jul 2009 18:18:17 +0000 (11:18 -0700)]
initscript: skip if auto start = no/false/0 and nothing or type specified

16 years agokclient: avoid overflow in mds reconnect msg size calc
Sage Weil [Tue, 28 Jul 2009 18:12:48 +0000 (11:12 -0700)]
kclient: avoid overflow in mds reconnect msg size calc

16 years agomon: allow osd down->out interval to be 0 (i.e., manual)
Sage Weil [Mon, 27 Jul 2009 23:14:09 +0000 (16:14 -0700)]
mon: allow osd down->out interval to be 0 (i.e., manual)

16 years agoosd: remove bad osdmap access
Sage Weil [Mon, 27 Jul 2009 23:13:34 +0000 (16:13 -0700)]
osd: remove bad osdmap access

osd may not exist

16 years agoauth: add ClientTicket
Sage Weil [Tue, 28 Jul 2009 18:05:14 +0000 (11:05 -0700)]
auth: add ClientTicket

16 years agouclient: use lookup parent in getcwd()
Sage Weil [Tue, 28 Jul 2009 17:37:59 +0000 (10:37 -0700)]
uclient: use lookup parent in getcwd()

16 years agomds: add lookup parent op
Sage Weil [Tue, 28 Jul 2009 17:37:51 +0000 (10:37 -0700)]
mds: add lookup parent op

16 years agoHadoop: Many silly debug statements.
Greg Farnum [Tue, 28 Jul 2009 16:27:53 +0000 (09:27 -0700)]
Hadoop: Many silly debug statements.

16 years agoHadoop: Minor fixes to the still-unworking Hadoop code.
Greg Farnum [Tue, 28 Jul 2009 00:20:21 +0000 (17:20 -0700)]
Hadoop: Minor fixes to the still-unworking Hadoop code.

16 years agoHadoop: hadoopcephfs is now self-contained instead of requiring other libs.
Greg Farnum [Tue, 28 Jul 2009 00:19:39 +0000 (17:19 -0700)]
Hadoop: hadoopcephfs is now self-contained instead of requiring other libs.

16 years agouclient/libceph: add a getcwd function
Greg Farnum [Tue, 28 Jul 2009 00:17:47 +0000 (17:17 -0700)]
uclient/libceph: add a getcwd function

16 years agokclient: replace osdc request_tree with rbtree
Sage Weil [Mon, 27 Jul 2009 22:05:56 +0000 (15:05 -0700)]
kclient: replace osdc request_tree with rbtree

This avoids a possible memory allocation in writeout path.

16 years agoauth: remove ceph_client_ticket struct
Sage Weil [Mon, 27 Jul 2009 21:12:33 +0000 (14:12 -0700)]
auth: remove ceph_client_ticket struct

Ticket is generally opaque to client anyway.

16 years agoosd: generate primary backlog independent of master log
Sage Weil [Mon, 27 Jul 2009 18:09:39 +0000 (11:09 -0700)]
osd: generate primary backlog independent of master log

We may have the master log (i.e. know the correct pg state), but
still need a backlog to recover some peers.

16 years agokclient: set mapping error on writepage error
Sage Weil [Mon, 27 Jul 2009 18:57:07 +0000 (11:57 -0700)]
kclient: set mapping error on writepage error

16 years agokclient: debugfs mounts on /sys/kernel/debug
Sage Weil [Mon, 27 Jul 2009 17:11:36 +0000 (10:11 -0700)]
kclient: debugfs mounts on /sys/kernel/debug

16 years agoMakefile: skip hadoop client if jni.h not present
Sage Weil [Thu, 23 Jul 2009 23:17:41 +0000 (16:17 -0700)]
Makefile: skip hadoop client if jni.h not present

16 years agokclient: use a mempool for page vector in writepages
Sage Weil [Thu, 23 Jul 2009 19:50:34 +0000 (12:50 -0700)]
kclient: use a mempool for page vector in writepages

16 years agokclient: put writepages pagevec on the stack
Sage Weil [Thu, 23 Jul 2009 19:30:59 +0000 (12:30 -0700)]
kclient: put writepages pagevec on the stack

16 years agodebian: upload packages as sage
Sage Weil [Thu, 23 Jul 2009 18:45:16 +0000 (11:45 -0700)]
debian: upload packages as sage

16 years agokclient: fix bad kmalloc
Sage Weil [Thu, 23 Jul 2009 17:39:32 +0000 (10:39 -0700)]
kclient: fix bad kmalloc

16 years agokclient: rewrite layout ioctls
Sage Weil [Thu, 23 Jul 2009 17:39:17 +0000 (10:39 -0700)]
kclient: rewrite layout ioctls

16 years agomds: only set striping component of file layout, for now.
Sage Weil [Thu, 23 Jul 2009 18:49:44 +0000 (11:49 -0700)]
mds: only set striping component of file layout, for now.

16 years agofix compat
Sage Weil [Thu, 23 Jul 2009 17:39:06 +0000 (10:39 -0700)]
fix compat

16 years agokclient: define compat_ioctl too
Sage Weil [Wed, 22 Jul 2009 23:41:03 +0000 (16:41 -0700)]
kclient: define compat_ioctl too

16 years agoosd: actually adjust rd/wr accounting values
Sage Weil [Wed, 22 Jul 2009 23:22:45 +0000 (16:22 -0700)]
osd: actually adjust rd/wr accounting values

16 years agoosd: add rd/wr ops/bytes stats to pgs, pools
Sage Weil [Wed, 22 Jul 2009 23:15:38 +0000 (16:15 -0700)]
osd: add rd/wr ops/bytes stats to pgs, pools

16 years agoHadoop: Compiles now. Stupid macros.
Greg Farnum [Thu, 23 Jul 2009 18:07:48 +0000 (11:07 -0700)]
Hadoop: Compiles now. Stupid macros.

16 years agoHadoop: Converted CephFSInterface.cc to use libceph.
Greg Farnum [Wed, 22 Jul 2009 23:10:51 +0000 (16:10 -0700)]
Hadoop: Converted CephFSInterface.cc to use libceph.

16 years agolibceph: Added get_stripe_unit method; used by Hadoop.
Greg Farnum [Wed, 22 Jul 2009 22:54:50 +0000 (15:54 -0700)]
libceph: Added get_stripe_unit method; used by Hadoop.

16 years agoHadoop:Remove the clientPointer convention from the C headers.
Greg Farnum [Wed, 22 Jul 2009 22:03:35 +0000 (15:03 -0700)]
Hadoop:Remove the clientPointer convention from the C headers.

16 years agoHadoop: Remove the silly clientPointer convention from the Java.
Greg Farnum [Wed, 22 Jul 2009 21:56:47 +0000 (14:56 -0700)]
Hadoop: Remove the silly clientPointer convention from the Java.

Since we're using libceph now it's unneeded and a waste of space.

16 years agoHadoop: Created new and modified old CephFSInterface.cc methods
Greg Farnum [Wed, 22 Jul 2009 21:08:02 +0000 (14:08 -0700)]
Hadoop: Created new and modified old CephFSInterface.cc methods

16 years agoHadoop: Newly-generated JNI files into CephFSInterface.h
Greg Farnum [Wed, 22 Jul 2009 20:16:01 +0000 (13:16 -0700)]
Hadoop: Newly-generated JNI files into CephFSInterface.h

16 years agoHadoop: Adding JNI header files to repository.
Greg Farnum [Wed, 22 Jul 2009 19:06:44 +0000 (12:06 -0700)]
Hadoop: Adding JNI header files to repository.

Will combine next.

16 years agov0.11 v0.11
Sage Weil [Wed, 22 Jul 2009 19:40:52 +0000 (12:40 -0700)]
v0.11

16 years agokclient: simple dout macro by default
Sage Weil [Wed, 22 Jul 2009 18:42:44 +0000 (11:42 -0700)]
kclient: simple dout macro by default

16 years agotodo
Sage Weil [Wed, 22 Jul 2009 18:26:41 +0000 (11:26 -0700)]
todo

16 years agokclient: msgr cleanup
Sage Weil [Wed, 22 Jul 2009 18:25:51 +0000 (11:25 -0700)]
kclient: msgr cleanup

16 years agokclient: caps.c cleanup
Sage Weil [Wed, 22 Jul 2009 18:24:56 +0000 (11:24 -0700)]
kclient: caps.c cleanup

16 years agoHadoop: CephInputStream seekNewSource done. That was easy.
Greg Farnum [Wed, 22 Jul 2009 18:36:50 +0000 (11:36 -0700)]
Hadoop: CephInputStream seekNewSource done. That was easy.

16 years agoHadoop: CephOutputStream retabbed, and it's an OutputStream now.
Greg Farnum [Wed, 22 Jul 2009 18:25:04 +0000 (11:25 -0700)]
Hadoop: CephOutputStream retabbed, and it's an OutputStream now.

16 years agoHadoop: CephInputStream retabbing and add seekToNewSource stub.
Greg Farnum [Wed, 22 Jul 2009 18:24:36 +0000 (11:24 -0700)]
Hadoop: CephInputStream retabbing and add seekToNewSource stub.

16 years agoHadoop: Renamed listPathsRaw as listPaths
Greg Farnum [Wed, 22 Jul 2009 17:30:17 +0000 (10:30 -0700)]
Hadoop: Renamed listPathsRaw as listPaths

to indicate that listPaths now strips out . and ..

Fixed bad reference to deleteRaw.

16 years agoHadoop: Continued cleanup work.
Greg Farnum [Wed, 22 Jul 2009 00:20:08 +0000 (17:20 -0700)]
Hadoop: Continued cleanup work.

16 years agoHadoop:Stubs for new append method
Greg Farnum [Tue, 21 Jul 2009 21:54:44 +0000 (14:54 -0700)]
Hadoop:Stubs for new append method

16 years agoHadoop: Minor changes to most of the methods.
greg [Tue, 21 Jul 2009 21:44:24 +0000 (14:44 -0700)]
Hadoop: Minor changes to most of the methods.

16 years agoHadoop: Retab CephFileSystem.
greg [Tue, 21 Jul 2009 20:37:25 +0000 (13:37 -0700)]
Hadoop: Retab CephFileSystem.

Also begin changes in create and delete.

16 years agoAdded Hadoop fs components.
greg [Tue, 21 Jul 2009 20:27:25 +0000 (13:27 -0700)]
Added Hadoop fs components.

16 years agokclient: fix up export.c
Sage Weil [Wed, 22 Jul 2009 18:15:50 +0000 (11:15 -0700)]
kclient: fix up export.c

16 years agokclient: mon_client, kobject cleanups
Sage Weil [Wed, 22 Jul 2009 17:02:47 +0000 (10:02 -0700)]
kclient: mon_client, kobject cleanups

16 years agocrush: more cleanup
Sage Weil [Wed, 22 Jul 2009 16:56:13 +0000 (09:56 -0700)]
crush: more cleanup

16 years agocrush: comments
Sage Weil [Wed, 22 Jul 2009 16:47:17 +0000 (09:47 -0700)]
crush: comments

16 years agokclient: osd_client cleanup
Sage Weil [Wed, 22 Jul 2009 00:46:07 +0000 (17:46 -0700)]
kclient: osd_client cleanup

16 years agomount.ceph: update /etc/mtab
Sage Weil [Tue, 21 Jul 2009 23:42:19 +0000 (16:42 -0700)]
mount.ceph: update /etc/mtab

16 years agokclient: mds_client cleanup
Sage Weil [Tue, 21 Jul 2009 23:16:25 +0000 (16:16 -0700)]
kclient: mds_client cleanup

16 years agokclient: fix dcache readdir -> sync readdir transition
Sage Weil [Tue, 21 Jul 2009 23:02:53 +0000 (16:02 -0700)]
kclient: fix dcache readdir -> sync readdir transition

We need to keep maintain the same state variables (namely,
fi->next_offset and fi->dentry) in a consistent fashion.  Use a
helper to keep track of the last name we _did_ see.

16 years agokclient: addr.c comment cleanup
Sage Weil [Tue, 21 Jul 2009 22:23:27 +0000 (15:23 -0700)]
kclient: addr.c comment cleanup

16 years agokclient: file.c cleanup
Sage Weil [Tue, 21 Jul 2009 21:43:20 +0000 (14:43 -0700)]
kclient: file.c cleanup

16 years agokclient: separate kmem_cache for ceph_file_info
Sage Weil [Tue, 21 Jul 2009 21:09:19 +0000 (14:09 -0700)]
kclient: separate kmem_cache for ceph_file_info

16 years agokclient: fix inc osdmap decoding
Sage Weil [Tue, 21 Jul 2009 21:04:49 +0000 (14:04 -0700)]
kclient: fix inc osdmap decoding

16 years agokclient: more dir.c cleanup
Sage Weil [Tue, 21 Jul 2009 17:15:59 +0000 (10:15 -0700)]
kclient: more dir.c cleanup

16 years agokclient: some dir.c cleanup
Sage Weil [Tue, 21 Jul 2009 16:53:33 +0000 (09:53 -0700)]
kclient: some dir.c cleanup

16 years agokclient: small inode cleanups
Sage Weil [Mon, 20 Jul 2009 23:17:53 +0000 (16:17 -0700)]
kclient: small inode cleanups

16 years agokclient: remove unneeded mdsmap request
Sage Weil [Mon, 20 Jul 2009 23:16:04 +0000 (16:16 -0700)]
kclient: remove unneeded mdsmap request

16 years agokclient: fix mdsmap decoding
Sage Weil [Mon, 20 Jul 2009 23:13:59 +0000 (16:13 -0700)]
kclient: fix mdsmap decoding

16 years agokclient: fix osdmap decoding
Sage Weil [Mon, 20 Jul 2009 23:03:45 +0000 (16:03 -0700)]
kclient: fix osdmap decoding

16 years agokclient: fix monmap decoding
Sage Weil [Mon, 20 Jul 2009 23:01:55 +0000 (16:01 -0700)]
kclient: fix monmap decoding

16 years agoCephBroker: Removed unneeded ++
Greg Farnum [Fri, 17 Jul 2009 22:23:22 +0000 (15:23 -0700)]
CephBroker: Removed unneeded ++

16 years agoosd: include version in ondisk osd metadata types
Sage Weil [Mon, 20 Jul 2009 20:46:22 +0000 (13:46 -0700)]
osd: include version in ondisk osd metadata types

rev ondisk format

16 years agomds: include version in ondisk metadata types
Sage Weil [Mon, 20 Jul 2009 20:45:02 +0000 (13:45 -0700)]
mds: include version in ondisk metadata types

rev ondisk format

16 years agomon: include version in monmap encoding
Sage Weil [Mon, 20 Jul 2009 20:39:55 +0000 (13:39 -0700)]
mon: include version in monmap encoding

16 years agoosd: include version in osdmap encoding
Sage Weil [Mon, 20 Jul 2009 20:38:18 +0000 (13:38 -0700)]
osd: include version in osdmap encoding

16 years agomds: include version in mdsmap encoding
Sage Weil [Mon, 20 Jul 2009 20:38:04 +0000 (13:38 -0700)]
mds: include version in mdsmap encoding

16 years agokclient: some super.c cleanup
Sage Weil [Mon, 20 Jul 2009 19:09:05 +0000 (12:09 -0700)]
kclient: some super.c cleanup

16 years agokclient: simplify wait for maps on mount
Sage Weil [Mon, 20 Jul 2009 19:04:19 +0000 (12:04 -0700)]
kclient: simplify wait for maps on mount

16 years agokclient: clean up parse_ips, mount option parsing
Sage Weil [Mon, 20 Jul 2009 18:56:55 +0000 (11:56 -0700)]
kclient: clean up parse_ips, mount option parsing

16 years agokclient: use kmem_cache for ceph_dentry_info
Sage Weil [Mon, 20 Jul 2009 18:37:27 +0000 (11:37 -0700)]
kclient: use kmem_cache for ceph_dentry_info

We have tons (one per dentry), so use a separate cache.

16 years agokclient: don't croak on null dev_name
Sage Weil [Mon, 20 Jul 2009 18:36:23 +0000 (11:36 -0700)]
kclient: don't croak on null dev_name

As currently caused by bad mount.ceph (mount -t ceph foo:bar mnt).

16 years agokclient: drop pr_fmt
Sage Weil [Mon, 20 Jul 2009 18:17:25 +0000 (11:17 -0700)]
kclient: drop pr_fmt

It doesn't build on older kernels, and all we want is varargs
checking anyway.

16 years agokclient: EBADF if there are no caps on an inode
Sage Weil [Mon, 20 Jul 2009 18:04:20 +0000 (11:04 -0700)]
kclient: EBADF if there are no caps on an inode

This will unwedge processes waiting on RD or WR when the mds
caps go away for some reason (like a partial or failed
reconnect).

16 years agomds: ignore stray reconnects
Sage Weil [Mon, 20 Jul 2009 17:58:53 +0000 (10:58 -0700)]
mds: ignore stray reconnects

Although maybe we should force open a session for these stray
clients?

16 years agomds: semi-tolerate/warn on bad client_ranges
Sage Weil [Mon, 20 Jul 2009 17:52:57 +0000 (10:52 -0700)]
mds: semi-tolerate/warn on bad client_ranges

16 years agomds: clean open file lists when we go active
Sage Weil [Mon, 20 Jul 2009 17:52:41 +0000 (10:52 -0700)]
mds: clean open file lists when we go active

Not after reconnect, because some caps have a delayed reconnect.
Add a start_active() stub to do this.

16 years agomds: adjust client_ranges on setattr size
Sage Weil [Mon, 20 Jul 2009 17:51:38 +0000 (10:51 -0700)]
mds: adjust client_ranges on setattr size

16 years agomds: always share min of projected, actual max_size
Sage Weil [Fri, 17 Jul 2009 22:18:53 +0000 (15:18 -0700)]
mds: always share min of projected, actual max_size

16 years agodebian: build git snapshot packages for unstable
Sage Weil [Mon, 20 Jul 2009 17:18:51 +0000 (10:18 -0700)]
debian: build git snapshot packages for unstable

16 years agodebian: build libcrush, librados, libceph packages
Sage Weil [Mon, 20 Jul 2009 17:05:05 +0000 (10:05 -0700)]
debian: build libcrush, librados, libceph packages

16 years agokclient: use kcalloc for decoded count * size allocations
Sage Weil [Sat, 18 Jul 2009 04:38:37 +0000 (21:38 -0700)]
kclient: use kcalloc for decoded count * size allocations

This includes a sanity check to ensure count * size doesn't wrap to a
small value.

16 years agoconfigure.ac: cleanup
Sage Weil [Thu, 16 Jul 2009 00:36:50 +0000 (17:36 -0700)]
configure.ac: cleanup

16 years agokclient: dout is a no-op without DEBUG or CONFIG_DYNAMIC_DEBUG
Sage Weil [Fri, 17 Jul 2009 21:39:50 +0000 (14:39 -0700)]
kclient: dout is a no-op without DEBUG or CONFIG_DYNAMIC_DEBUG