Cloud

全新 Kilo 安裝中的快照失敗

  • October 31, 2016

我有一個全新的 OpenStack Kilo 安裝。

當我嘗試從儀表板或 nova cli 創建快照時,沒有創建快照。

本地快照以成功結束,但 nova get 在嘗試將圖像上傳到 Glance 時出現“HTTP 400: Invalid disk format ‘None’ for image”錯誤。

完整的日誌在最後。

問題是:為什麼會出現這個錯誤?我該如何解決?

更新:經過一些測試,我發現 Nova 使用 Glance API v1 來上傳圖像。nova 做的請求是對的,兩者都container_formatbare_format發送。該請求也符合Glance v1 API 規範。但是,出現了問題,正如我們在 Glance API 的以下 curl 命令中看到的那樣:

curl -i -X PUT -H 'X-Auth-Token: MY_TOKEN_HERE' \
   -H 'x-image-meta-property-image_state: available' \
   -H 'x-image-meta-name: rarytest2-snapshot' -H 'x-image-meta-container_format: bare' \
   -H 'User-Agent: python-glanceclient' -H 'X-User-Id: e45cf65e7ae94cd5aa86341c87308657' \
   -H 'x-image-meta-property-image_location: snapshot' -H 'Accept-Encoding: gzip, deflate' \
   -H 'x-glance-registry-purge-props: false' -H 'x-image-meta-property-ramdisk_id: ' \
   -H 'Connection: keep-alive' -H 'x-image-meta-property-kernel_id: ' \
   -H 'X-Service-Catalog: []' \
   -H 'x-image-meta-property-owner_id: 2dd6aa6ee0554c0ea5afce27dc63ff3a' \
   -H 'Accept: */*' -H 'X-Roles: _member_,admin' -H 'x-image-meta-size: 1549991936' \
   -H 'X-Tenant-Id: 2dd6aa6ee0554c0ea5afce27dc63ff3a' -H 'x-image-meta-is_public: False' \
   -H 'X-Identity-Status: Confirmed' -H 'Content-Type: application/octet-stream' \
   -H 'x-image-meta-disk_format: qcow2' \
   http://MY_IP_HERE:9292/v1/images/3b3cdac1-d76c-48f2-8150-0977d8720684

預期的行為是更新disk_format到 qcow2 和container_format裸。但是,它不會發生。

出於某種奇怪的原因,如果更改 and 的andx-image-meta-disk_format標題x-image-meta-container_format(即,用連字元更改下劃線)它會起作用!x-image-meta-disk-format``x-image-meta-container-format

完整日誌:

2015-05-24 17:50:46.229 2400 INFO nova.compute.manager [req-b6489814-f538-4773-a15d-c1224b5583b7 e45cf65e7ae94cd5aa86341c87308657 2dd6aa6ee0554c0ea5afce27dc63ff3a - - -] [instance: 00652f00-5a32-44ad-8ad6-ac33610236ac] instance snapshotting
[...]
2015-05-24 17:50:58.670 2400 INFO nova.virt.libvirt.driver [req-b6489814-f538-4773-a15d-c1224b5583b7 e45cf65e7ae94cd5aa86341c87308657 2dd6aa6ee0554c0ea5afce27dc63ff3a - - -] [instance: 00652f00-5a32-44ad-8ad6-ac33610236ac] Snapshot extracted, beginning image upload
[...]
2015-05-24 17:51:01.251 2400 ERROR oslo_messaging.rpc.dispatcher [req-b6489814-f538-4773-a15d-c1224b5583b7 e45cf65e7ae94cd5aa86341c87308657 2dd6aa6ee0554c0ea5afce27dc63ff3a - - -] Exception during message handling: <html>
<head>
 <title>400 Bad Request</title>
</head>
<body>
 <h1>400 Bad Request</h1>
 Invalid disk format 'None' for image.<br /><br />

</body>
</html> (HTTP 400)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     executor_callback))
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     executor_callback)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6791, in snapshot_instance
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     return self.manager.snapshot_instance(ctxt, image_id, instance)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     payload)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     return f(self, context, *args, **kw)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 327, in decorated_function
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     LOG.warning(msg, e, instance_uuid=instance_uuid)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 298, in decorated_function
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 355, in decorated_function
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     kwargs['instance'], e, sys.exc_info())
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 343, in decorated_function
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 403, in decorated_function
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     instance=instance)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 85, in __exit__
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 393, in decorated_function
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     *args, **kwargs)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3227, in snapshot_instance
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     task_states.IMAGE_SNAPSHOT)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3257, in _snapshot_instance
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     update_task_state)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1410, in snapshot
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     image_file)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/image/api.py", line 130, in update
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     purge_props=purge_props)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 398, in update
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     _reraise_translated_image_exception(image_id)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 396, in update
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     image_id, **image_meta)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 219, in call
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     return getattr(client.images, method)(*args, **kwargs)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 329, in update
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     resp, body = self.client.put(url, headers=hdrs, data=image_data)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 265, in put
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     return self._request('PUT', url, **kwargs)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 227, in _request
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher     raise exc.from_response(resp, resp.content)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher Invalid: <html>
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher  <head>
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   <title>400 Bad Request</title>
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher  </head>
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher  <body>
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   <h1>400 Bad Request</h1>
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher   Invalid disk format 'None' for image.<br /><br />
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher 
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher  </body>
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher </html> (HTTP 400)
2015-05-24 17:51:01.251 2400 TRACE oslo_messaging.rpc.dispatcher 

由於同時使用 Nginx 和 Glance API v1 會出現此問題。

簡而言之,可以在 Stack Overflow 的這個執行緒中找到解釋。

預設情況下,Nginx 會丟棄帶有下劃線的標題。這樣做是為了:

將標頭映射到 CGI 變數時防止歧義

參考:Nginx - Pitfalls - Missing (disappearing) HTTP headers

但是,帶有下劃線的標題在 Glance v1 API 中指定。

參考:Glance v1 API - 檢索圖像元數據

我還發現帶有下劃線的標題是完全有效的,並且與 RFC 7230 相衝突

解決方案是在 nginx 配置文件中添加以下行:

underscores_in_headers on;

引用自:https://serverfault.com/questions/696945