cls_rgw: reorganize rgw_bucket_link_olh()

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: convert RGWRados::get_attr() to new interface

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: switch get_obj_iterate() to new interface

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: remove unused code

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: purge intent log

We don't use the intent log anymore, just remove it.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: adjust to new interfaces

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: s/RGWRados::ObjectCtx/RGWObjectCtx

Can't forward declare nested class.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: clean up system obj interfaces

Create a new structure to use, RGWRados::SystemObject, similar to the
previous changes made for the data objects.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: change RGWRados::get_attr()

This is an interim fix, will need to make it work similarly to the other
calls.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: rework prepare_get_obj(), get_obj()

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: remove more unused code

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: fix missing state initalization

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: switch RGWRados::delete_obj() to new interface

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: remove unused code

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: remove old index update calls

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: get rid of put_obj_meta(), replace with put_system_obj()

Last use of put_obj_meta() was for system object, simplify it for that
specific use case and rename.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: don't use put_system_obj() for data objects

Use the new interface instead.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: pass around object context refrences, remove unused code

We want to make it clear that the object context is required for
non-system objects, pass it by reference (rather than by pointer). Make
the put processors get it as a constructor param and keep it on the
object.
Still haven't updated everything, as some stuff is going to change
anyway.
Remove the plain put processor, as it is not used anymore.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: remove plain object processor

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: start reorganizing RGWRados

Need to reduce the various states of the different operations. The aim
is to separate the system objects operations from the data objects
operations, and compartmentalize the various systems.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: s/RGWRadosCtx/ObjectCtx

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: move RGWRadosCtx into RGWRados

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: set olh if object has been versioned

Bucket could have versioning suspended, but object has been versioned,
so once object has olh pointer in it, we need to continue maintainig it.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: allow olh linking to null instance objects

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw, cls_rgw: don't remove olh objects

A single head object can contain both olh data, and object data. Don't
remove object if it has olh information on it, just reset the other
info.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: initial versioned object removal implementation

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: bucket versioning status is tri-state

disabled, enabled, suspended.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: add support for version-id-marker

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw, cls_rgw: cls_bucket_list returns raw key in map

This is needed so that we dump the objects in the required order (from
newest to oldest versions for each object). While we're at it, revert to
the original encoding of rgw_bucket_dir, which will be better for
backward compatibility.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: update the appropriate prev key entry

We need to update the previous key entry that it's no longer the latest,
need to use the list entry, not the data entry (which only serves as a
pointer to the list entry).

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: fix rgw_obj initialization

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: request state and various op functionality use rgw_obj_key

instead of plain string. This is needed so that we use the object
instance in the processing.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: cleanup, get rid of req_state::object

We don't want this extra memory allocation

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: restful api now dumps versions

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: propagate dirent flags to rgw (from cls), other fixes

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: deletion marker needs to keep instance entry

Otherwise we wouldn't be able to find it when we remove it.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw, cls_rgw: list object versions is optional

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: bucket listing gets extra param for versioning

Can specify whether we want to see versions or not.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: revise the data model

We don't need to keep a listing entry for the olh.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: add get_type() to rgw ops

This is needed so that we can identify ops correctly.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: add 'versioning', and 'versions' to handled subresources

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: object manifest should reflect instance

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: update json encoding for rgw_obj

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: follow olh if needed

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: olh trim op is read/write

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: tie set_olh() to object completion

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: more atomicity fixes, set_olh()

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: guard against racing writes

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: olh atomicity groundwork

still more to do

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw, cls_rgw: trim olh log functionality

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: apply olh log functionality

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: olh init op

Need an op to initialize olh when a new olh is created. It will set its
initial version and tag.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw-admin: add olh readlog command

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: implement rgw_bucket_olh_log_entry::dump()

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: new api to retrieve olh log

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: bucket index link olh interface

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: object instance olh linking

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: bucket index link olh

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: encode / decode obj and list index keys

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: prepare groundwork for olh

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: obj_stat() follows on olh

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: some code cleanup

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: init olh tag

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: gen rand lowercase string (stl string version)

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: adjust return code when generating random strings

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: gen rand lower alphanumberic string

add a function to generate a random lowercase string, don't want other
characters.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: initial olh implementation

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: remove old unused code

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: interface adjustment following a rebase

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: generate random instance id

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

radosgw-admin: some commands use object_version param

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: clean up some locator use

We don't use locators anymore. New objects are always created having the
locator equals to the object name. Don't allow this to happen through
magic, just get rid of code that is setting the locator. Legacy objects
should continue to work as we'll still decode the locator, and set it on
the ioctx where needed.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

test: cls_rgw fixes

adapt to new objclass interfaces

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

radosgw-admin: adapt to new interfaces

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: adapt to new objclass interface

use rgw_obj_key instead of string, and pass it on to the objclass.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_rgw: change data structures to keep single object key structure

instead of keeping the key name and instance separately. Also, translate
key structure into the index key string representation.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: rename cls_rgw_obj::key to cls_rgw_obj::loc

to avoid confusion.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw, cls_rgw: various datastructures use new rgw_obj_key

Instead of using a string for referencing object's index key, use a
rgw_obj_key structure that's also references the object's instance.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: rename rgw_obj::key to rgw_obj::loc

to avoid confusion

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: decouple object name from index representation

We can't have a direct mapping between the object name to the way we
index it in the bucket index. Have rgw_obj provide different
representations appropriately and use the proper ones where needed.
Introduce the instance element which will be used to refer to versioned
objects.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: remove unused code

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw, cls_rgw: add accounted_size for object metadata entry

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: enable s3 get/set versioning ops

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: restful op to set bucket versioning

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: get bucket versioning status op

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: add versioning_enabled field to bucket info

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #3342 from ceph/wip-10311

rgw: only keep track for cleanup of rados objects that were written

Reviewed-by: Ray Lv <xiangyulv@gmail.com>

os/FileJournal: Fix journal write fail, align for direct io

when config journal_zero_on_create true, osd mkfs will fail when zeroing journal.
journal open with O_DIRECT, buf should align with blocksize.

Backport: giant, firefly, dumpling
Signed-off-by: Xie Rui <875016668@qq.com>
Reviewed-by: Sage Weil <sage@redhat.com>

mon: encode stashed monmap with all features

latest_monmap that we stash is only used locally--the encoded bl is never shared. Which means we should just use CEPH_FEATURES_ALL all of the time.

Fixes: #5203
Backport: giant, firefly
Signed-off-by: Xie Rui <875016668@qq.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@redhat.com>

Merge remote-tracking branch 'gh/next'

PendingReleaseNotes: make a note about librados flag changes

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #3360 from mattrichards/bump_rados_version

librados: bump rados version number

Reviewed-by: Sage Weil <sage@redhat.com>

0.91

Merge pull request #2697 from ceph/wip-8900

RBD image watcher and new exclusive lock handling

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #3254 from trociny/feature-10036

osd: osd tree to show primary-affinity value

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #3281 from ceph/wip-10441-b

osd: fix watch ordering bug 10441 option b

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #3290 from ceph/wip-da-SCA-20150102

Coverity and SCA fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3302 from ceph/wip-9956

os/FileStore: verify kernel is new enough before using extsize ioctl

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #3305 from majianpeng/fix5

fix bugs about sync_filesystem

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3364 from ceph/wip-quota-test

qa: set -e explicitly in quota test

Reviewed-by: Greg Farnum <gfarnum@redhat.com>