]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
15 years agomsgr: include my addr AND socket addr during connect handshake
Sage Weil [Wed, 2 Sep 2009 21:51:55 +0000 (14:51 -0700)]
msgr: include my addr AND socket addr during connect handshake

This allows connecting side to detect their ip address.

15 years agokclient: whoami is __s64
Sage Weil [Wed, 2 Sep 2009 19:54:08 +0000 (12:54 -0700)]
kclient: whoami is __s64

15 years agouclient: use client_t for client id
Sage Weil [Wed, 2 Sep 2009 19:53:59 +0000 (12:53 -0700)]
uclient: use client_t for client id

15 years agomds: use client_t throughout
Sage Weil [Wed, 2 Sep 2009 19:53:47 +0000 (12:53 -0700)]
mds: use client_t throughout

15 years agomsgr: 64bit entity name num
Sage Weil [Wed, 2 Sep 2009 18:32:21 +0000 (11:32 -0700)]
msgr: 64bit entity name num

15 years agokclient: fix osd request kicking
Sage Weil [Wed, 2 Sep 2009 18:23:04 +0000 (11:23 -0700)]
kclient: fix osd request kicking

15 years agokclient: kill msgr->parent, dead msg pool code, prepare_pages arg
Sage Weil [Tue, 1 Sep 2009 23:16:53 +0000 (16:16 -0700)]
kclient: kill msgr->parent, dead msg pool code, prepare_pages arg

15 years agokclient: osd restart fixes
Sage Weil [Tue, 1 Sep 2009 23:07:55 +0000 (16:07 -0700)]
kclient: osd restart fixes

15 years agokclient: set prepare_pages for osd client (der)
Sage Weil [Tue, 1 Sep 2009 23:02:54 +0000 (16:02 -0700)]
kclient: set prepare_pages for osd client (der)

15 years agokclient: fix request kicking crash
Sage Weil [Tue, 1 Sep 2009 22:59:35 +0000 (15:59 -0700)]
kclient: fix request kicking crash

15 years agokclient: cleanup old FIXME comments
Sage Weil [Tue, 1 Sep 2009 22:51:29 +0000 (15:51 -0700)]
kclient: cleanup old FIXME comments

15 years agokclient: improve osd error handling
Sage Weil [Tue, 1 Sep 2009 22:51:20 +0000 (15:51 -0700)]
kclient: improve osd error handling

We still r_resend even when we could fail, but it's just simpler
to do it that way.

15 years agokclient: reuse osd struct when possible
Sage Weil [Tue, 1 Sep 2009 22:48:32 +0000 (15:48 -0700)]
kclient: reuse osd struct when possible

15 years agokclient: make mon hunt explicit; note in kern.log
Sage Weil [Tue, 1 Sep 2009 21:29:45 +0000 (14:29 -0700)]
kclient: make mon hunt explicit; note in kern.log

15 years agomon: actually send updates to subscribers :)
Sage Weil [Tue, 1 Sep 2009 21:07:06 +0000 (14:07 -0700)]
mon: actually send updates to subscribers :)

15 years agokclient: avoid get_random_int(), it's new
Sage Weil [Tue, 1 Sep 2009 21:02:39 +0000 (14:02 -0700)]
kclient: avoid get_random_int(), it's new

Just use get_random_bytes instead.

15 years agokclient: pick new mon on _fault_, not peer reset
Sage Weil [Tue, 1 Sep 2009 20:08:28 +0000 (13:08 -0700)]
kclient: pick new mon on _fault_, not peer reset

The latter only occurs if we succeed in reconnecting and find that
the peer dropped the session (connect_seq didn't match).  That
won't happen if the mon is just down.

15 years agokclient: fix osdmap requests, subscription timeouts
Sage Weil [Tue, 1 Sep 2009 19:34:28 +0000 (12:34 -0700)]
kclient: fix osdmap requests, subscription timeouts

Only request osdmap once, unless we restart our session.  Clean up
expired tests with helper.  Hunt if our monitor fails.

15 years agokclient: no need for r_fwd_session
Sage Weil [Tue, 1 Sep 2009 18:36:39 +0000 (11:36 -0700)]
kclient: no need for r_fwd_session

We always resend requests at the direction of the mds; the mds
won't forward for us.  (Otherwise the reply won't make it back!)
This simplifies forwards and retries.

15 years agokclient: fix bad mds session put
Sage Weil [Tue, 1 Sep 2009 18:35:28 +0000 (11:35 -0700)]
kclient: fix bad mds session put

From e5847ba5a91723cf7b1c8ee60ee8b120cd204791

15 years agokclient: don't leak ref when queuing fault work
Sage Weil [Tue, 1 Sep 2009 18:04:17 +0000 (11:04 -0700)]
kclient: don't leak ref when queuing fault work

15 years agokclient: use subscribe to get mdsmap, osdmap updates
Sage Weil [Tue, 1 Sep 2009 18:04:03 +0000 (11:04 -0700)]
kclient: use subscribe to get mdsmap, osdmap updates

15 years agomsgr: print louder notice on bad banner; rev
Sage Weil [Tue, 1 Sep 2009 18:03:33 +0000 (11:03 -0700)]
msgr: print louder notice on bad banner; rev

15 years agomon: subscribe duration in units of seconds, not ms
Sage Weil [Tue, 1 Sep 2009 18:03:15 +0000 (11:03 -0700)]
mon: subscribe duration in units of seconds, not ms

15 years agoosd: remove ticket from MOSDOp
Sage Weil [Tue, 1 Sep 2009 17:52:27 +0000 (10:52 -0700)]
osd: remove ticket from MOSDOp

15 years agovstart: be quiet
Sage Weil [Mon, 31 Aug 2009 23:33:45 +0000 (16:33 -0700)]
vstart: be quiet

15 years agokclient: subscribe to mdsmap
Sage Weil [Mon, 31 Aug 2009 23:08:48 +0000 (16:08 -0700)]
kclient: subscribe to mdsmap

15 years agomon: clean up subscribe types a bits
Sage Weil [Mon, 31 Aug 2009 22:54:23 +0000 (15:54 -0700)]
mon: clean up subscribe types a bits

15 years agoobjecter: use one-time subscription request for osdmap
Sage Weil [Mon, 31 Aug 2009 22:54:05 +0000 (15:54 -0700)]
objecter: use one-time subscription request for osdmap

15 years agomon: do one-time subscriptions, too
Sage Weil [Mon, 31 Aug 2009 22:27:13 +0000 (15:27 -0700)]
mon: do one-time subscriptions, too

15 years agomonc: resubscribe on monitor connection reset
Sage Weil [Mon, 31 Aug 2009 21:38:22 +0000 (14:38 -0700)]
monc: resubscribe on monitor connection reset

15 years agomonclient: fix subscription renewal
Sage Weil [Mon, 31 Aug 2009 21:17:54 +0000 (14:17 -0700)]
monclient: fix subscription renewal

15 years agoobjecter: request full map on startup
Sage Weil [Mon, 31 Aug 2009 21:13:10 +0000 (14:13 -0700)]
objecter: request full map on startup

15 years agomsgr: deliver resets to all dispatchers; make naming consistent
Sage Weil [Mon, 31 Aug 2009 21:12:58 +0000 (14:12 -0700)]
msgr: deliver resets to all dispatchers; make naming consistent

15 years agomon: clean up send_reply interface
Sage Weil [Mon, 31 Aug 2009 20:05:47 +0000 (13:05 -0700)]
mon: clean up send_reply interface

15 years agouclient: subscribe to mdsmap; strip out some signed_ticket cruft; fix mount
Sage Weil [Mon, 31 Aug 2009 20:00:09 +0000 (13:00 -0700)]
uclient: subscribe to mdsmap; strip out some signed_ticket cruft; fix mount

15 years agomsgr: keepalive
Sage Weil [Mon, 31 Aug 2009 19:59:01 +0000 (12:59 -0700)]
msgr: keepalive

15 years agomon: route replies
Sage Weil [Mon, 31 Aug 2009 19:58:25 +0000 (12:58 -0700)]
mon: route replies

15 years agomon: add subscribe function
Sage Weil [Fri, 28 Aug 2009 23:48:09 +0000 (16:48 -0700)]
mon: add subscribe function

15 years agomsgr: oops
Sage Weil [Fri, 28 Aug 2009 23:01:45 +0000 (16:01 -0700)]
msgr: oops

15 years agomon: simplify mount; remove MClientUnmount
Sage Weil [Fri, 28 Aug 2009 23:01:34 +0000 (16:01 -0700)]
mon: simplify mount; remove MClientUnmount

15 years agokclient: handle mds reconnect.. mostly..
Sage Weil [Fri, 28 Aug 2009 21:41:58 +0000 (14:41 -0700)]
kclient: handle mds reconnect.. mostly..

15 years agokclient: make con_close, con_reopen work
Sage Weil [Fri, 28 Aug 2009 21:27:18 +0000 (14:27 -0700)]
kclient: make con_close, con_reopen work

15 years agomon: treat osd, mds as peers, not clients (i.e. connect to them)
Sage Weil [Fri, 28 Aug 2009 21:24:19 +0000 (14:24 -0700)]
mon: treat osd, mds as peers, not clients (i.e. connect to them)

15 years agomsgr: server shouldn't initiate outgoing connections
Sage Weil [Fri, 28 Aug 2009 21:24:01 +0000 (14:24 -0700)]
msgr: server shouldn't initiate outgoing connections

15 years agomsgr: set default policy correctly
Sage Weil [Fri, 28 Aug 2009 19:54:10 +0000 (12:54 -0700)]
msgr: set default policy correctly

15 years agomds: never forward messages for the client
Sage Weil [Fri, 28 Aug 2009 03:27:45 +0000 (20:27 -0700)]
mds: never forward messages for the client

Otherwise we won't be sure they have a session.. and the reply might not
make it back!

15 years agokclient: avoid session lookup in mdsc
Sage Weil [Thu, 27 Aug 2009 22:52:50 +0000 (15:52 -0700)]
kclient: avoid session lookup in mdsc

15 years agomsgr: remove 'dst' from ceph_msg_header
Sage Weil [Thu, 27 Aug 2009 21:22:34 +0000 (14:22 -0700)]
msgr: remove 'dst' from ceph_msg_header

15 years agomsgr: remove 'dst' from ceph_msg_header
Sage Weil [Thu, 27 Aug 2009 20:50:28 +0000 (13:50 -0700)]
msgr: remove 'dst' from ceph_msg_header

Shouldn't be there anyway.  We do still need to keep erank in there
though.

15 years agokclient: close socket in work queue (and still on last ref.)
Sage Weil [Thu, 27 Aug 2009 20:03:25 +0000 (13:03 -0700)]
kclient: close socket in work queue (and still on last ref.)

15 years agokclient: msgr cleanup
Sage Weil [Thu, 27 Aug 2009 18:36:27 +0000 (11:36 -0700)]
kclient: msgr cleanup

15 years agokclient: fail con->ops->get() if ref count is zero, and avoid requeueing work
Sage Weil [Thu, 27 Aug 2009 16:14:15 +0000 (09:14 -0700)]
kclient: fail con->ops->get() if ref count is zero, and avoid requeueing work

This fixes a bug where a socket status change races with con_destroy:

ref 1 -> 0
con_destroy()
sock state change, requeue
destroy socket
kfree(con)
...do work and crash...

15 years agokclient: handle osd resets, timeouts, etc.
Sage Weil [Thu, 27 Aug 2009 00:57:42 +0000 (17:57 -0700)]
kclient: handle osd resets, timeouts, etc.

15 years agokclient: remove connection tracking from msgr
Sage Weil [Thu, 27 Aug 2009 00:30:54 +0000 (17:30 -0700)]
kclient: remove connection tracking from msgr

15 years agokclient: use a per-connection ops vector
Sage Weil [Thu, 27 Aug 2009 00:18:47 +0000 (17:18 -0700)]
kclient: use a per-connection ops vector

15 years agokclient: use per-connectino peer_reset callback
Sage Weil [Wed, 26 Aug 2009 22:49:42 +0000 (15:49 -0700)]
kclient: use per-connectino peer_reset callback

15 years agokclient: use connection api for osdc (almost, no kick or timeout)
Sage Weil [Wed, 26 Aug 2009 22:39:20 +0000 (15:39 -0700)]
kclient: use connection api for osdc (almost, no kick or timeout)

15 years agomsgr: handle keepalive
Sage Weil [Wed, 26 Aug 2009 22:38:27 +0000 (15:38 -0700)]
msgr: handle keepalive

15 years agokclient: use connection msgr api for mon client
Sage Weil [Wed, 26 Aug 2009 18:51:58 +0000 (11:51 -0700)]
kclient: use connection msgr api for mon client

15 years agokclient: use connection msgr api for mds
Sage Weil [Wed, 26 Aug 2009 18:02:31 +0000 (11:02 -0700)]
kclient: use connection msgr api for mds

15 years agokclient: add explicit connection-based api
Sage Weil [Wed, 26 Aug 2009 18:02:13 +0000 (11:02 -0700)]
kclient: add explicit connection-based api

15 years agomsgr: fix policy setting
Sage Weil [Wed, 26 Aug 2009 17:42:45 +0000 (10:42 -0700)]
msgr: fix policy setting

15 years agokclient: factor out connection creation; add con_send, con_keepalive
Sage Weil [Tue, 25 Aug 2009 23:49:28 +0000 (16:49 -0700)]
kclient: factor out connection creation; add con_send, con_keepalive

Mmm, much cleaner so far!

15 years agokclient: periodically ping mds's
Sage Weil [Tue, 25 Aug 2009 23:23:47 +0000 (16:23 -0700)]
kclient: periodically ping mds's

15 years agokclient: do not accept connections in messager (client only!)
Sage Weil [Tue, 25 Aug 2009 23:23:35 +0000 (16:23 -0700)]
kclient: do not accept connections in messager (client only!)

This rips out a lot of code, yay!

15 years agomsgr: server flag to avoid connecting to peer
Sage Weil [Tue, 25 Aug 2009 23:23:04 +0000 (16:23 -0700)]
msgr: server flag to avoid connecting to peer

If we have a message and no socket and server=true, just queue it
up.  When they connect to us they'll get it.

15 years agomds: handle ping
Sage Weil [Tue, 25 Aug 2009 23:22:14 +0000 (16:22 -0700)]
mds: handle ping

15 years agokclient: fix bad kfree on kmem_cache cap
Sage Weil [Wed, 26 Aug 2009 19:32:55 +0000 (12:32 -0700)]
kclient: fix bad kfree on kmem_cache cap

15 years agomds: update dir parent pointer on rename
Sage Weil [Tue, 25 Aug 2009 21:56:23 +0000 (14:56 -0700)]
mds: update dir parent pointer on rename

Maintain per-segment list and inode flag for this purpose.
Flush out changes on log segment trim.

Also remove from renamed list if we commit first frag (which also
writes a parent pointer each time).

15 years agomds: factor inode parent pointer encoding out of CDir commit
Sage Weil [Tue, 25 Aug 2009 21:07:23 +0000 (14:07 -0700)]
mds: factor inode parent pointer encoding out of CDir commit

We'll use it to adjust the xattr when a file is renamed, too.

15 years agouclient: don't croak on flush_set_callback on nonexistant ino
Sage Weil [Mon, 24 Aug 2009 22:27:29 +0000 (15:27 -0700)]
uclient: don't croak on flush_set_callback on nonexistant ino

Not sure where this is happening exactly.. :/

15 years agomds: propagate scatterlock data w/o changing lock state in scatter_nudge
Sage Weil [Mon, 24 Aug 2009 21:02:01 +0000 (14:02 -0700)]
mds: propagate scatterlock data w/o changing lock state in scatter_nudge

If we can take the wrlock already, there's no need to adjust the
lock state... just call scatter_writebehind.

15 years agomds: avoid propagating nestlock more frequently than mds_dirstat_min_interval
Sage Weil [Mon, 24 Aug 2009 21:01:14 +0000 (14:01 -0700)]
mds: avoid propagating nestlock more frequently than mds_dirstat_min_interval

Instead, add the lock to the update_scatterlock list, as usual.

15 years agomds: kill SimpleLock::wait_shift
Sage Weil [Mon, 24 Aug 2009 19:45:48 +0000 (12:45 -0700)]
mds: kill SimpleLock::wait_shift

It's a function of lock type.

15 years agotodo
Sage Weil [Mon, 24 Aug 2009 18:41:00 +0000 (11:41 -0700)]
todo

15 years agouclient: warn about stat_precise struct changes
Sage Weil [Mon, 24 Aug 2009 18:33:47 +0000 (11:33 -0700)]
uclient: warn about stat_precise struct changes

15 years agolibceph: no need for frag_info_t
Sage Weil [Mon, 24 Aug 2009 18:32:32 +0000 (11:32 -0700)]
libceph: no need for frag_info_t

15 years agomsgr: add ms_die_on_bad_msg option, make assert(0) conditional
Sage Weil [Mon, 24 Aug 2009 18:28:10 +0000 (11:28 -0700)]
msgr: add ms_die_on_bad_msg option, make assert(0) conditional

15 years agoHadoop: Style fixes.
Greg Farnum [Mon, 24 Aug 2009 18:08:24 +0000 (11:08 -0700)]
Hadoop: Style fixes.

15 years agoHadoop: Move the . and .. elimination
Greg Farnum [Mon, 24 Aug 2009 17:53:21 +0000 (10:53 -0700)]
Hadoop: Move the . and .. elimination
from Java to C++ for less copying.

15 years agouclient: _getdents should *always* return the number of bytes written
Greg Farnum [Sun, 23 Aug 2009 04:50:08 +0000 (21:50 -0700)]
uclient: _getdents should *always* return the number of bytes written
at end of dir, not just assume it's zero!

15 years agoHadoop: Use the new ceph_getdnames instead of getdir
Greg Farnum [Fri, 21 Aug 2009 21:29:26 +0000 (14:29 -0700)]
Hadoop: Use the new ceph_getdnames instead of getdir
Hypertable: fix a nasty not-closing-the-dir bug

15 years agolibceph: Change the C++-only functions to be C-compatible.
Greg Farnum [Fri, 21 Aug 2009 16:31:50 +0000 (09:31 -0700)]
libceph: Change the C++-only functions to be C-compatible.
Hypertable: Change to use ceph_getdnames instead of getdir.

Hadoop: Minor updates to use the new C-style functions in libceph.

15 years agoHadoop: Fix a nasty IO bug.
Greg Farnum [Fri, 21 Aug 2009 16:12:55 +0000 (09:12 -0700)]
Hadoop: Fix a nasty IO bug.
CephInputStream.read() needs to return an int between 0 and 255,
but bytes are signed and casting preserves that. Adjust if needed.

15 years agoHadoop: Clean up ceph_delete code as it's redundant.
Greg Farnum [Fri, 21 Aug 2009 01:32:05 +0000 (18:32 -0700)]
Hadoop: Clean up ceph_delete code as it's redundant.

15 years agoHadoop: Fixed time modification in getFileStatus.
Greg Farnum [Thu, 20 Aug 2009 20:39:52 +0000 (13:39 -0700)]
Hadoop: Fixed time modification in getFileStatus.
No wonder I hadn't noticed an issue with statting!

15 years agoHadoop: Add package.html;
Greg Farnum [Wed, 19 Aug 2009 17:54:43 +0000 (10:54 -0700)]
Hadoop: Add package.html;
fix a NULL instead of null error (Java)

15 years agoHadoop: Put guards up to prevent
Greg Farnum [Tue, 18 Aug 2009 23:30:11 +0000 (16:30 -0700)]
Hadoop: Put guards up to prevent
a nasty bug in case of unspecified preferences, and the unlikely case
that initialize is called twice.

15 years agoupload tarball with 'stable' deb
Sage Weil [Mon, 24 Aug 2009 17:56:35 +0000 (10:56 -0700)]
upload tarball with 'stable' deb

15 years agov0.13 v0.13
Sage Weil [Mon, 24 Aug 2009 17:45:14 +0000 (10:45 -0700)]
v0.13

15 years agotodo
Sage Weil [Fri, 21 Aug 2009 23:35:01 +0000 (16:35 -0700)]
todo

15 years agokclient: cleanup msgpool pr_err
Sage Weil [Fri, 21 Aug 2009 21:36:54 +0000 (14:36 -0700)]
kclient: cleanup msgpool pr_err

15 years agokclient: update ctime on 'no-op' ->setattr(.., ATTR_CTIME)
Sage Weil [Fri, 21 Aug 2009 21:28:26 +0000 (14:28 -0700)]
kclient: update ctime on 'no-op' ->setattr(.., ATTR_CTIME)

If kernel wants ctime updated but nothing else, pick a cap to
dirty, or set a no-op setattr req to the mds.

With this patch, we pass the full pjd fstest with mode ext3.

15 years agokclient tests: fix dir names
Sage Weil [Fri, 21 Aug 2009 20:49:46 +0000 (13:49 -0700)]
kclient tests: fix dir names

15 years agouclient: small _getdents cleanup
Sage Weil [Fri, 21 Aug 2009 20:44:13 +0000 (13:44 -0700)]
uclient: small _getdents cleanup

15 years agouclient: let's do getdents() too, while we're at it
Sage Weil [Fri, 21 Aug 2009 20:27:31 +0000 (13:27 -0700)]
uclient: let's do getdents() too, while we're at it

15 years agocrush: put temp arrays on the stack
Sage Weil [Fri, 21 Aug 2009 20:20:42 +0000 (13:20 -0700)]
crush: put temp arrays on the stack

40 ints on the stack.. not too much I hope?

15 years agouclient: remove readdirplus, readdirlite cruft
Sage Weil [Fri, 21 Aug 2009 20:14:50 +0000 (13:14 -0700)]
uclient: remove readdirplus, readdirlite cruft

Ancient!

15 years agouclient: add getdnames()
Sage Weil [Fri, 21 Aug 2009 20:11:44 +0000 (13:11 -0700)]
uclient: add getdnames()