Avoid confusing Ceph users with "seastar" terms when possible.
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
Signed-off-by: Neha Ojha <nojha@redhat.com>
ceph config set osd crimson_cpu_num 8
Note that ``crimson_cpu_num`` does **not** pin threads to specific CPU cores.
-To explicitly assign CPU cores to Crimson OSDs, use the ``crimson_seastar_cpu_cores`` parameter.
+To explicitly assign CPU cores to Crimson OSDs, use the ``crimson_cpu_set`` parameter.
This enables CPU pinning, which *may* improve performance.
However, using this option requires manually setting the CPU set for each OSD,
and is generally less recommended due to its complexity.
osd shutdown pgref assert: true
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.1:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
osd.2:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.3:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
global:
ms cluster mode: crc
ms service mode: crc
osd shutdown pgref assert: true
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.1:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
osd.2:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.3:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
global:
ms cluster mode: crc
ms service mode: crc
osd shutdown pgref assert: true
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.1:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
osd.2:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.3:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
global:
ms cluster mode: crc
ms service mode: crc
osd shutdown pgref assert: true
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-1
+ crimson cpu set: 0-1
osd.1:
- crimson seastar cpu cores: 2-3
+ crimson cpu set: 2-3
osd.2:
- crimson seastar cpu cores: 4-5
+ crimson cpu set: 4-5
global:
ms cluster mode: crc
ms service mode: crc
osd min pg log entries: 5
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-1
+ crimson cpu set: 0-1
osd.1:
- crimson seastar cpu cores: 2-3
+ crimson cpu set: 2-3
osd.2:
- crimson seastar cpu cores: 4-5
+ crimson cpu set: 4-5
global:
- osd_backfill:
osd min pg log entries: 5
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-1
+ crimson cpu set: 0-1
osd.1:
- crimson seastar cpu cores: 2-3
+ crimson cpu set: 2-3
osd.2:
- crimson seastar cpu cores: 4-5
+ crimson cpu set: 4-5
global:
- workunit:
clients:
osd shutdown pgref assert: true
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.1:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
osd.2:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.3:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
global:
ms cluster mode: crc
ms service mode: crc
osd shutdown pgref assert: true
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.1:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
osd.2:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.3:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
global:
ms cluster mode: crc
ms service mode: crc
osd shutdown pgref assert: true
crimson alien thread cpu cores: 6-7
osd.0:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.1:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
osd.2:
- crimson seastar cpu cores: 0-2
+ crimson cpu set: 0-2
osd.3:
- crimson seastar cpu cores: 3-5
+ crimson cpu set: 3-5
global:
ms cluster mode: crc
ms service mode: crc
default: 6
flags:
- startup
-- name: crimson_seastar_cpu_cores
+- name: crimson_cpu_set
type: str
level: advanced
desc: CPU cores on which seastar reactor threads will run in cpuset(7) format, smp::count is deduced from this option
type: uint
level: advanced
default: 0
- desc: The number of seastar reactors, overridden if crimson_seastar_cpu_cores is set
+ desc: The number of seastar reactors, overridden if crimson_cpu_set is set
flags:
- startup
min: 0
std::end(early_args),
[](auto* arg) { return "--cpuset"sv == arg; });
found == std::end(early_args)) {
- auto cpu_cores = crimson::common::get_conf<std::string>("crimson_seastar_cpu_cores");
+ auto cpu_cores = crimson::common::get_conf<std::string>("crimson_cpu_set");
if (!cpu_cores.empty()) {
- // Set --cpuset based on crimson_seastar_cpu_cores config option
+ // Set --cpuset based on crimson_cpu_set config option
// --smp default is one per CPU
ret.early_args.emplace_back("--cpuset");
ret.early_args.emplace_back(cpu_cores);
auto reactor_num = crimson::common::get_conf<uint64_t>("crimson_cpu_num");
if (!reactor_num) {
// We would like to avoid seastar using all available cores.
- logger().error("get_early_config: crimson_seastar_cpu_cores"
+ logger().error("get_early_config: crimson_cpu_set"
" or crimson_cpu_num must be set");
ceph_abort();
}
}
} else {
logger().error("get_early_config: --cpuset can be "
- "set only using crimson_seastar_cpu_cores");
+ "set only using crimson_cpu_set");
ceph_abort();
}
return 0;
LOG_PREFIX(OSD::start);
INFO("seastar::smp::count {}", seastar::smp::count);
if (auto cpu_cores =
- local_conf().get_val<std::string>("crimson_seastar_cpu_cores");
+ local_conf().get_val<std::string>("crimson_cpu_set");
cpu_cores.empty()) {
- clog->warn() << "for optimal performance please set "
- "crimson_seastar_cpu_cores";
+ clog->warn() << "for optimal performance please set crimson_cpu_set";
}
startup_time = ceph::mono_clock::now();
ceph_assert(seastar::this_shard_id() == PRIMARY_CORE);
local reactor_interval=${cpu_table[${osd}]}
if ! [ "${reactor_interval}" == "" ]; then
- local cmd="$CEPH_BIN/ceph -c $conf_fn config set osd.$osd crimson_seastar_cpu_cores ${reactor_interval}"
+ local cmd="$CEPH_BIN/ceph -c $conf_fn config set osd.$osd crimson_cpu_set ${reactor_interval}"
echo $cmd
$cmd
else