Skip to content

Instantly share code, notes, and snippets.

@atyronesmith

atyronesmith/debug-sriov-new

Created January 31, 2017 21:13
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save atyronesmith/1347e98047593999c99920e7de332a54 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save atyronesmith/1347e98047593999c99920e7de332a54 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
debug-sriov-new
2017-01-31 21:09:36.956 87333 DEBUG nova.virt.libvirt.vif [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] vif_type=hw_veb instanc
e=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=True,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2017-01-31T21:09:29Z,default_
ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='test',display_name='test',ec2_ids=EC2Ids,ephemeral_gb
=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(4),host='overcloud-compute-0.localdomain',hostname='test',id=43,image_ref='a005c1fb-b4e2-4383-9ffa-cb8403a2e44f',info_cache=InstanceInfoCache,ins
tance_type_id=4,kernel_id='',key_data='ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDI4db4jP14EmNAp131u+wZcRSRfzREYZDaRyaIrMNtmz9d+wHmi3O1kdmlKJNClXcUXZJsO/pQoa9J7O0gGajJaLKp1fQnjzjhN5Ze/8KsZOZXXAlCu56US
uKznH+wupMQTYdW1UK4p4SX/sjoXR4QFSxpYh58yCiR3lSIQ76Qp265IL1rF6QW2YC1TmotKtQlcj11VCCGTdLNwIZwInleQ5XAKU2LQdYXMQactc9Q6K0U3x2TxnGAHUeSezhDs962cHQhbY/fchrRoM403Ad2O7acGjk6NGniXs879Zj9hYEl5U5yXMZWcC1yG
sWDmdhBJ2CXDFBwXxz5+Z0v+5zh [email protected]
',key_name='undercloud-stack',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='overcloud-compute-0.localdomain',locked=False,locked_by=None,memory_mb=4096,metadata={},migration_co
ntext=<?>,new_flavor=None,node='overcloud-compute-0.localdomain',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0
,project_id='ad27eac14550494aa43d0e6de2a15158',ramdisk_id='',reservation_id='r-wum0m0gh',root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=Fa
lse,system_metadata={clean_attempts='2',image_base_image_ref='a005c1fb-b4e2-4383-9ffa-cb8403a2e44f',image_container_format='bare',image_disk_format='qcow2',image_min_disk='20',image_min_ram='0',ne
twork_allocated='True'},tags=<?>,task_state='spawning',terminated_at=None,updated_at=2017-01-31T21:09:36Z,user_data=None,user_id='aabdd6c9d8854c9da4758b4f87b7dc79',uuid=34a81072-bc7c-4365-bf65-f4a
8fe7a9614,vcpu_model=VirtCPUModel,vcpus=4,vm_mode=None,vm_state='building') vif={"profile": {"pci_slot": "0000:83:17.7", "physical_network": "phy-sriov2", "pci_vendor_info": "8086:1515"}, "ovs_int
erfaceid": null, "preserve_on_delete": true, "network": {"bridge": null, "subnets": [{"ips": [{"meta": {}, "version": 4, "type": "fixed", "floating_ips": [], "address": "172.20.0.7"}], "version":
4, "meta": {"dhcp_server": "172.20.0.2"}, "dns": [], "routes": [], "cidr": "172.20.0.0/16", "gateway": {"meta": {}, "version": 4, "type": "gateway", "address": "172.20.0.1"}}], "meta": {"injected"
: false, "tenant_id": "ad27eac14550494aa43d0e6de2a15158", "physical_network": "phy-sriov2", "mtu": 1496}, "id": "c381be47-5e20-48c3-986f-0bb53884b369", "label": "sriov2"}, "devname": "tap52229515-
c0", "vnic_type": "direct", "qbh_params": null, "meta": {}, "details": {"port_filter": false, "vlan": "4000"}, "address": "fa:16:3e:42:1c:b5", "active": false, "type": "hw_veb", "id": "52229515-c0
32-4e9e-b31f-69c27b4ea085", "qbg_params": null} plug /usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py:807
2017-01-31 21:09:36.957 87333 DEBUG nova.network.os_vif_util [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] Converting VIF {"pro
file": {"pci_slot": "0000:83:17.7", "physical_network": "phy-sriov2", "pci_vendor_info": "8086:1515"}, "ovs_interfaceid": null, "preserve_on_delete": true, "network": {"bridge": null, "subnets": [
{"ips": [{"meta": {}, "version": 4, "type": "fixed", "floating_ips": [], "address": "172.20.0.7"}], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}, "dns": [], "routes": [], "cidr": "172.20.0.
0/16", "gateway": {"meta": {}, "version": 4, "type": "gateway", "address": "172.20.0.1"}}], "meta": {"injected": false, "tenant_id": "ad27eac14550494aa43d0e6de2a15158", "physical_network": "phy-sr
iov2", "mtu": 1496}, "id": "c381be47-5e20-48c3-986f-0bb53884b369", "label": "sriov2"}, "devname": "tap52229515-c0", "vnic_type": "direct", "qbh_params": null, "meta": {}, "details": {"port_filter"
: false, "vlan": "4000"}, "address": "fa:16:3e:42:1c:b5", "active": false, "type": "hw_veb", "id": "52229515-c032-4e9e-b31f-69c27b4ea085", "qbg_params": null} nova_to_osvif_vif /usr/lib/python2.7/
site-packages/nova/network/os_vif_util.py:362
2017-01-31 21:09:36.957 87333 DEBUG nova.network.os_vif_util [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] No conversion for VI
F type hw_veb yet nova_to_osvif_vif /usr/lib/python2.7/site-packages/nova/network/os_vif_util.py:378
2017-01-31 21:09:36.961 87333 DEBUG oslo_messaging._drivers.amqpdriver [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] CALL msg_id: 27ec65c271314beb850bcc104cf12d3e exchange 'nova' topic 'conductor' _send /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:448
2017-01-31 21:09:37.009 87333 DEBUG oslo_messaging._drivers.amqpdriver [-] received reply msg_id: 27ec65c271314beb850bcc104cf12d3e __call__ /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:296
2017-01-31 21:09:37.011 87333 DEBUG oslo_messaging._drivers.amqpdriver [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] CALL msg_id: 474155e1815b4bd58ae873c350781f3e exchange 'nova' topic 'conductor' _send /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:448
2017-01-31 21:09:37.021 87333 DEBUG oslo_messaging._drivers.amqpdriver [-] received reply msg_id: 474155e1815b4bd58ae873c350781f3e __call__ /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:296
2017-01-31 21:09:37.096 87333 ERROR nova.virt.libvirt.guest [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] Error launching a defined domain with XML: <domain type='kvm'>
<name>instance-0000002b</name>
<uuid>34a81072-bc7c-4365-bf65-f4a8fe7a9614</uuid>
<metadata>
<nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0">
<nova:package version="14.0.2-7.el7ost"/>
<nova:name>test</nova:name>
<nova:creationTime>2017-01-31 21:09:36</nova:creationTime>
<nova:flavor name="large.1">
<nova:memory>4096</nova:memory>
<nova:disk>20</nova:disk>
<nova:swap>0</nova:swap>
<nova:ephemeral>0</nova:ephemeral>
<nova:vcpus>4</nova:vcpus>
</nova:flavor>
<nova:owner>
<nova:user uuid="aabdd6c9d8854c9da4758b4f87b7dc79">admin</nova:user>
<nova:project uuid="ad27eac14550494aa43d0e6de2a15158">admin</nova:project>
</nova:owner>
<nova:root type="image" uuid="a005c1fb-b4e2-4383-9ffa-cb8403a2e44f"/>
</nova:instance>
</metadata>
<memory unit='KiB'>4194304</memory>
<currentMemory unit='KiB'>4194304</currentMemory>
<vcpu placement='static' cpuset='4-11,16-47'>4</vcpu>
<cputune>
<shares>4096</shares>
</cputune>
<sysinfo type='smbios'>
<system>
<entry name='manufacturer'>Red Hat</entry>
<entry name='product'>OpenStack Compute</entry>
<entry name='version'>14.0.2-7.el7ost</entry>
<entry name='serial'>e1622fe8-eb7d-44d0-a2d5-7ce6991b2120</entry>
<entry name='uuid'>34a81072-bc7c-4365-bf65-f4a8fe7a9614</entry>
<entry name='family'>Virtual Machine</entry>
</system>
</sysinfo>
<os>
<type arch='x86_64' machine='pc-i440fx-rhel7.3.0'>hvm</type>
<boot dev='hd'/>
<smbios mode='sysinfo'/>
</os>
<features>
<acpi/>
<apic/>
</features>
<cpu mode='host-model'>
<model fallback='allow'/>
<topology sockets='4' cores='1' threads='1'/>
</cpu>
<clock offset='utc'>
<timer name='pit' tickpolicy='delay'/>
<timer name='rtc' tickpolicy='catchup'/>
<timer name='hpet' present='no'/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<devices>
<emulator>/usr/libexec/qemu-kvm</emulator>
<disk type='file' device='disk'>
<driver name='qemu' type='qcow2' cache='none'/>
<source file='/var/lib/nova/instances/34a81072-bc7c-4365-bf65-f4a8fe7a9614/disk'/>
<target dev='vda' bus='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
</disk>
<controller type='usb' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
</controller>
<controller type='pci' index='0' model='pci-root'/>
<interface type='hostdev' managed='yes'>
<mac address='fa:16:3e:42:1c:b5'/>
<source>
<address type='pci' domain='0x0000' bus='0x83' slot='0x17' function='0x7'/>
</source>
<vlan>
<tag id='4000'/>
</vlan>
<address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
</interface>
<serial type='file'>
<source path='/var/lib/nova/instances/34a81072-bc7c-4365-bf65-f4a8fe7a9614/console.log'/>
<target port='0'/>
</serial>
<serial type='pty'>
<target port='1'/>
</serial>
<console type='file'>
<source path='/var/lib/nova/instances/34a81072-bc7c-4365-bf65-f4a8fe7a9614/console.log'/>
<target type='serial' port='0'/>
</console>
<input type='tablet' bus='usb'>
<address type='usb' bus='0' port='1'/>
</input>
<input type='mouse' bus='ps2'/>
<input type='keyboard' bus='ps2'/>
<graphics type='vnc' port='-1' autoport='yes' listen='0.0.0.0' keymap='en-us'>
<listen type='address' address='0.0.0.0'/>
</graphics>
<video>
<model type='cirrus' vram='16384' heads='1' primary='yes'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
</video>
<memballoon model='virtio'>
<stats period='10'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
</memballoon>
</devices>
</domain>
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] Instance failed to spawn
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] Traceback (most recent call last):
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2078, in _build_resources
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] yield resources
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1920, in _build_and_run_instance
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] block_device_info=block_device_info)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2597, in spawn
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] post_xml_callback=gen_confdrive)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4845, in _create_domain_and_network
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] post_xml_callback=post_xml_callback)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4774, in _create_domain
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] guest.launch(pause=pause)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 144, in launch
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] self._encoded_xml, errors='ignore')
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] self.force_reraise()
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] six.reraise(self.type_, self.value, self.tb)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 139, in launch
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] return self._domain.createWithFlags(flags)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] result = proxy_call(self._autowrap, f, *args, **kwargs)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] rv = execute(f, *args, **kwargs)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] six.reraise(c, e, tb)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] rv = meth(*args, **kwargs)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1065, in createWithFlags
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] libvirtError: error dumping ens6f1 (7) interface: Message too long
2017-01-31 21:09:37.097 87333 ERROR nova.compute.manager [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614]
2017-01-31 21:09:37.098 87333 INFO nova.compute.manager [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] Terminating instance
2017-01-31 21:09:37.099 87333 DEBUG oslo_messaging._drivers.amqpdriver [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] CAST unique_id: ba523473e56b40afb2d9d5358d61aef2 NOTIFY exchange 'nova' topic 'notifications.info' _send /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:432
2017-01-31 21:09:37.101 87333 DEBUG nova.compute.manager [req-b7170a19-74fe-4ff2-9a00-8b87741c208b aabdd6c9d8854c9da4758b4f87b7dc79 ad27eac14550494aa43d0e6de2a15158 - - -] [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] Start destroying the instance on the hypervisor. _shutdown_instance /usr/lib/python2.7/site-packages/nova/compute/manager.py:2192
2017-01-31 21:09:37.105 87333 INFO nova.virt.libvirt.driver [-] [instance: 34a81072-bc7c-4365-bf65-f4a8fe7a9614] Instance destroyed successfully.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment