我正在尝试使用 Python SDK 将一些较大的 blob (>50MB) 上传到我的 Azure 存储容器:
connect_str = os.environ['AZURE_STORAGE_CONNECTION_STRING']
blob_service_client = BlobServiceClient.from_connection_string(connect_str)
def upload_blob(file_path):
if os.path.exists(file_path):
with open(file_path, 'rb') as data:
blob_client = blob_service_client.get_blob_client(container='foo', blob=file_path)
print(f"Uploading file {file_path} to blob storage...")
print(os.path.getsize(file_path))
return blob_client.upload_blob(data, length=os.path.getsize(file_path))
else:
print(f"File {file_path} not found. Please store the file first before uploading")
return False
然而,当我运行这个时,我得到了azure.core.exceptions.ServiceRequestError
:
Traceback (most recent call last):
File "C:/Users/.../storage_controller.py", line 96, in <module>
upload_blob(config.VECTORIZER_PATH)
File "C:/Users/.../storage_controller.py", line 34, in upload_blob
return blob_client.upload_blob(data, length=os.path.getsize(file_path))
File "C:\Users\...\venv\lib\site-packages\azure\core\tracing\decorator.py", line 83, in wrapper_use_tracer
return func(*args, **kwargs)
File "C:\Users\...\venv\lib\site-packages\azure\storage\blob\_blob_client.py", line 496, in upload_blob
return upload_block_blob(**options)
File "C:\Users\...\venv\lib\site-packages\azure\storage\blob\_upload_helpers.py", line 104, in upload_block_blob
**kwargs)
File "C:\Users\...\venv\lib\site-packages\azure\storage\blob\_generated\operations\_block_blob_operations.py", line 207, in upload
pipeline_response = self._client._pipeline.run(request, stream=False, **kwargs)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 211, in run
return first_node.send(pipeline_request) # type: ignore
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 71, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 71, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 71, in send
response = self.next.send(request)
[Previous line repeated 4 more times]
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\policies\_redirect.py", line 157, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 71, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\storage\blob\_shared\policies.py", line 515, in send
raise err
File "C:\Users\...\venv\lib\site-packages\azure\storage\blob\_shared\policies.py", line 489, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 71, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\storage\blob\_shared\policies.py", line 290, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 71, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 71, in send
response = self.next.send(request)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\_base.py", line 103, in send
self._sender.send(request.http_request, **request.context.options),
File "C:\Users\...\venv\lib\site-packages\azure\storage\blob\_shared\base_client.py", line 312, in send
return self._transport.send(request, **kwargs)
File "C:\Users\...\venv\lib\site-packages\azure\core\pipeline\transport\_requests_basic.py", line 284, in send
raise error
azure.core.exceptions.ServiceRequestError: The operation did not complete (write) (_ssl.c:2317)
我尝试了一些事情,找到了一些分块和使用的建议put_blob
处理较大文件的方法,但这些解决方案在当前版本的 SDK 中似乎不可能,它本身应该处理较大的文件。不过,较小的文件(例如一行的 .txt 文件)绝对可以正常工作。这是 Azure SDK 的问题还是我自己的网络/SSL 配置错误?我该如何解决这个问题?
提前致谢!