ceph 热迁移 live_migrate-XML error: CPU feature `pdpe1gb' specified more than once

"/usr/lib/python2.6/site-packages/eventlet/tpool.py",line 183,in doit 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher result = proxy_call(self._autowrap,f,*args,**kwargs) 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/eventlet/tpool.py",line 141,in proxy_call 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher rv = execute(f,line 122,in execute 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher six.reraise(c,e,tb) 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/eventlet/tpool.py",line 80,in tworker 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher rv = meth(*args,**kwargs) 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib64/python2.6/site-packages/libvirt.py",line 2878,in comparecpu 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher if ret == -1: raise libvirtError ('virConnectComparecpu() Failed',%r0conn=self) 2014-11-12 18:14:33.353 31086 TRACE oslo.messaging.rpc.dispatcher libvirtError: XML error: cpu feature `pdpe1gb' specified more than once

2014-11-12 18:14:33.300 31086 ERROR nova.virt.libvirt.driver [req-e68bce7c-4d44-4a73-abc4-541b0914f772 973eab9670774f589c476b1c4164272b 5e4d0a6d39a44b9c906a3173b448aa4a] 176------------source_cpu_info == {"vendor": "Intel","model": "SandyBridge","arch": "x86_64","features": [" pdpe1gb","osxsave","dca","pcid","pdcm","xtpr","tm2","est","smx","vmx","ds_cpl","monitor","dtes64","pbe","tm","ht","ss","acpi","ds","vme"," 2014-11-12 18:14:33.307 31086 ERROR nova.virt.libvirt.driver [req-e68bce7c-4d44-4a73-abc4-541b0914f772 973eab9670774f589c476b1c4164272b 5e4d0a6d39a44b9c906a3173b448aa4a] cpu doesn't have compatibility. XML error: cpu feature `pdpe1gb' specified more than once

明显可以看出 pdpe1gb被加入到列表中两次。去重。

修改方法：

#edit by ttx 2014-11-25
features_list = info['features']
features_list = list(set(features_list))
for f in features_list:
cpu.add_feature(vconfig.LibvirtConfigcpuFeature(f))

报secret_uuid错误则是所有ceph的secret_uuid必须一致，且nova.conf的rbd_secret_uuid = 8b45ead4-3cc9-4700-b85a-107050eeea8c也必须一致才能迁移。

58fb4811] An error occurred while trying to launch a defined domain with xml: <domain type='qemu'> <name>instance-0000005e</name> <uuid>e72e98dc-567d-4c5e-aefe-3d755ad7c40b</uuid> <memory unit='KiB'>4194304</memory> <currentMemory unit='KiB'>4194304</currentMemory> <vcpu placement='static'>2</vcpu> <sysinfo type='smbios'> <system> <entry name='manufacturer'>Red Hat Inc.</entry> <entry name='product'>OpenStack Nova</entry> <entry name='version'>2014.1.1-3.el6</entry> <entry name='serial'>44454c4c-5000-1052-804d-b3c04f443358</entry> <entry name='uuid'>e72e98dc-567d-4c5e-aefe-3d755ad7c40b</entry> </system> </sysinfo> <os> <type arch='x86_64' machine='pc-i440fx-1.6'>hvm</type> <boot dev='hd'/> <smbios mode='sysinfo'/> </os> <features> <acpi/> <apic/> </features> <clock offset='utc'/> <on_poweroff>destroy</on_poweroff> <on_reboot>restart</on_reboot> <on_crash>destroy</on_crash> <devices> <emulator>/usr/bin/qemu-system-x86_64</emulator> <disk type='network' device='disk'> <driver name='qemu' type='raw' cache='none'/> <auth username='admin'> <secret type='ceph' uuid='026a17e8-ea8c-4997-a013-2622a1d9f9c0'/> </auth> <source protocol='rbd' name='nova/e72e98dc-567d-4c5e-aefe-3d755ad7c40b_disk'> <host name='192.168.10.186' port='6789'/> <host name='192.168.10.187' port='6789'/> <host name='192.168.10.188' port='6789'/> <host name='192.168.10.189' port='6789'/> </source> <target dev='hda' bus='ide'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> <controller type='usb' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/> </controller> <controller type='pci' index='0' model='pci-root'/> <controller type='ide' index='0'> <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/> </controller> <interface type='bridge'> <mac address='fa:16:3e:65:9c:5e'/> <source bridge='qbrfd16f3fc-3c'/> <target dev='tapfd16f3fc-3c'/> <model type='virtio'/> <driver name='qemu'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/> </interface> <serial type='file'> <source path='/var/lib/nova/instances/e72e98dc-567d-4c5e-aefe-3d755ad7c40b/console.log'/> <target port='0'/> </serial> <serial type='pty'> <target port='1'/> </serial> <console type='file'> <source path='/var/lib/nova/instances/e72e98dc-567d-4c5e-aefe-3d755ad7c40b/console.log'/> <target type='serial' port='0'/> </console> <input type='tablet' bus='usb'/> <input type='mouse' bus='ps2'/> <graphics type='spice' autoport='yes' listen='0.0.0.0' keymap='en-us'> <listen type='address' address='0.0.0.0'/> </graphics> <video> <model type='qxl' ram='65536' vram='65536' heads='1'/> <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/> </video> <memballoon model='virtio'> <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/> </memballoon> </devices> </domain> 2014-11-12 22:22:37.770 21166 ERROR nova.compute.manager [req-8c6906c1-9a58-4de7-a78b-1b1097fa551f 973eab9670774f589c476b1c4164272b 84e02e81eb934b7a957e63c058fb4811] [instance: e72e98dc-567d-4c5e-aefe-3d755ad7c40b] Failed to deallocate network for instance. 2014-11-12 22:22:37.925 21166 ERROR root [-] Original exception being dropped: ['Traceback (most recent call last):\n',' File "/usr/lib/python2.6/site-packages/nova/compute/manager.py",line 1390,in _reschedule_or_error\n bdms,requested_networks)\n',line 2116,in _shutdown_instance\n self._try_deallocate_network(context,instance,line 2080,in _try_deallocate_network\n self._set_instance_error_state(context,instance[\'uuid\'])\n',' File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py",line 68,in __exit__\n six.reraise(self.type_,self.value,self.tb)\n',line 2075,in _try_deallocate_network\n self._deallocate_network(context,line 1769,in _deallocate_network\n context,requested_networks=requested_networks)\n',' File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py",line 410,in deallocate_for_instance\n data = neutron.list_ports(**search_opts)\n',' File "/usr/lib/python2.6/site-packages/neutronclient/v2_0/client.py",line 111,in with_params\n ret = self.function(instance,**kwargs)\n',line 306,in list_ports\n **_params)\n',line 1250,in list\n for r in self._pagination(collection,path,**params):\n',line 1263,in _pagination\n res = self.get(path,params=params)\n',line 1236,in get\n headers=headers,line 1221,in retry_request\n headers=headers,line 1156,in do_request\n resp,replybody = self.httpclient.do_request(action,method,body=body)\n',' File "/usr/lib/python2.6/site-packages/neutronclient/client.py",line 195,in do_request\n self.authenticate()\n',line 231,in authenticate\n token_url = self.auth_url + "/tokens"\n',"TypeError: unsupported operand type(s) for +: 'nonetype' and 'str'\n"] 2014-11-12 22:22:38.429 21166 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: 'ascii' codec can't decode byte 0xe8 in position 49: ordinal not in range(128) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py",line 133,in _dispatch_and_reply 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py",line 176,in _dispatch 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint,ctxt,args) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py",in _do_dispatch 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint,method)(ctxt,**new_args) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/server.py",line 139,in inner 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher return func(*args,**kwargs) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/exception.py",line 88,in wrapped 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher payload) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py",in __exit__ 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_,self.tb) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/exception.py",line 71,in wrapped 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher return f(self,context,**kw) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/compute/manager.py",line 274,in decorated_function 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher pass 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py",self.tb) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/compute/manager.py",line 260,in decorated_function 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher return function(self,**kwargs) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/compute/manager.py",line 327,in decorated_function 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher function(self,line 303,in decorated_function 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher e,sys.exc_info()) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py",line 290,line 2069,in run_instance 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher do_run_instance() 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py",line 249,in inner 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher return f(*args,line 2068,in do_run_instance 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher legacy_bdm_in_spec) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/compute/manager.py",line 1201,in _run_instance 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher notify("error",fault=e) # notify that build Failed 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py",line 1185,in _run_instance 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher instance,image_Meta,legacy_bdm_in_spec) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/compute/manager.py",line 1349,in _build_instance 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher filter_properties,bdms,line 1395,in _reschedule_or_error 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher self._log_original_error(exc_info,instance_uuid) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.6/site-packages/nova/compute/manager.py",line 1364,in _log_original_error 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher LOG.error(_('Error: %s') % exc_info[1],instance_uuid=instance_uuid, 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher UnicodeDecodeError: 'ascii' codec can't decode byte 0xe8 in position 49: ordinal not in range(128) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher tils.py", 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher UnicodeDecodeError: 'ascii' codec can't decode byte 0xe8 in position 49: ordinal not in range(128) 2014-11-12 22:22:38.429 21166 TRACE oslo.messaging.rpc.dispatcher 2014-11-12 22:22:38.432 21166 ERROR oslo.messaging._drivers.common [-] Returning exception 'ascii' codec can't decode byte 0xe8 in position 49: ordinal not in range(128) to caller 2014-11-12 22:22:38.432 21166 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n',' File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py",in _dispatch_and_reply\n incoming.message))\n',in _dispatch\n return self._do_dispatch(endpoint,args)\n',in _do_dispatch\n result = getattr(endpoint,**new_args)\n',' File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/server.py",in inner\n return func(*args,' File "/usr/lib/python2.6/site-packages/nova/exception.py",in wrapped\n payload)\n',in wrapped\n return f(self,**kw)\n',in decorated_function\n pass\n',in decorated_function\n return function(self,in decorated_function\n function(self,in decorated_function\n e,sys.exc_info())\n',in run_instance\n do_run_instance()\n',' File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py",in inner\n return f(*args,in do_run_instance\n legacy_bdm_in_spec)\n',in _run_instance\n notify("error",fault=e) # notify that build Failed\n',in _run_instance\n instance,legacy_bdm_in_spec)\n',in _build_instance\n filter_properties,in _reschedule_or_error\n self._log_original_error(exc_info,instance_uuid)\n',in _log_original_error\n LOG.error(_(\'Error: %s\') % exc_info[1],\n',"UnicodeDecodeError: 'ascii' codec can't decode byte 0xe8 in position 49: ordinal not in range(128)\n"]

上述错误就是nova。conf的uuid与virsh secret-list不一致，导致。

错误：

2014-11-18 19:39:20.559 11921 WARNING nova.compute.manager [-] Found 4 in the database and 3 on the hypervisor.

2014-11-18 19:39:46.968 11921 ERROR nova.virt.libvirt.driver [-] [instance: cb91421e-5dfa-4d2b-8d8a-c6b0f51b2bf6] Live Migration failure: unsupported configuration: Unable to find security driver for label selinux

解决办法：

vim /usr/local/libvirt/etc/libvirt/qemu.conf

#security_driver = "selinux"

修改为：

security_driver = "none"

将selinux修改为none