OpenStack + Ceph

OpenStack + Rados Block Device(RBD)

不具合

On Horizon UI in Admin/Hypervisors, Disk Usage shows incorrect value.

Bug #1359989 “Hypervisor summary shows incorrect total storage” : Bugs : Mirantis OpenStack

まだ修正されてない

live migration failed due to no shared storage when using rbd imagebackend

Bug #1250751 “live migration failed due to no shared storage whe...” : Bugs : OpenStack Compute (nova)

→ Junoで修正

librbd Cache チューニング

Note: Kernel modules can use Linux page caching. For librbd-based applications, Ceph supports RBD Caching.

http://ceph.com/docs/master/rbd/rbd/

qemu-kvm は librbd 経由

http://ceph.com/docs/v0.80.5/rbd/rbd-config-ref/

v0.80.5 は rbd cache は Default: false

[client]
rbd cache = true

で有効になる。

v0.80.9 は Default: true

[client]
rbd cache = true
rbd cache size = 536870912

Optimize Ceph cluster (kernel, osd, rbd) — CEPH Filesystem Users
Default: 32 MiB → 536870912 (512 MiB)

The cache is in memory on the client, and each RBD image has its own.
Welcome to Ceph — Ceph Documentation

RBD image ごと

total amount of ram = (number of virtual disks) X (rbd cache size)

Manage wisely your cache setting in Ceph · Igor Moiseev