nova can't create instances using ceph

Can somebody give helps and insight with my problem regarding with creating an instance using ceph (rbd). As per checking on the logs it created on the ceph but after a few seconds automatically deleted. Tried using the command

but still no luck, even recreated the whole ceph cluster. Even tried in the nova.conf enabling it with volume_drivers=rbd=nova.virt.libvirt.volume.LibvirtNetVolumeDriver but still no effect. As it was not mentioned on their manual. As per notice I couldn't create a socket mentioned on the said manual that states:

1 answer

Hi,
I see it's been a while since you asked your question, have you managed it to work? I've been working with Ceph for about a week or two now, and I was facing the same issue. I tried to launch an instance using a Ceph image, and for two or three seconds I saw the newly created disk in the rbd pool, then it disappeared.
But when I tried to boot-from-volume via Cinder using the exact same image it worked! I'm quite new to all of this, so I'm not really sure, but I assume that cinder and nova have different approaches accessing rbd images/volumes. Besides configuring Ceph, Cinder, Nova and Glance, please notice that I'm working with Mitaka and xen compute nodes right now. I also tested it with kvm as hypervisor, it worked right away. I should also mention that I have full rights for my ceph client, I tried it with restrictions similar to yours, it didn't work at all.
I hope my pointers is helping you or anybode else.

Comments

Yes @eblock I used to get same issue with it before but I notice that when you create an instance, by default it will be created in the local machine first (it create a base image) say in your compute node. Which I found out I was run out of space for that partition /var/lib/nova/instances/_base/

Even if you work with Ceph as backend it can result in a local base image on the compute node(s). You have to disable image cache by setting cache_image = none in /etc/nova/nova.conf on your compute nodes, then delete the images in /var/lib/nova/instances/_base to clear the cache.