s3fs-存储桶名称包含非法字符

问题描述

我正在尝试将S3存储桶安装到我的ubuntu实例上。但是我只想在s3存储桶中安装“目录”或键。

存储桶名称:s3:// my-bucket / 我要挂载的s3存储桶的目录或一部分:s3:// my-bucket / test / 挂载点:/ path / to / mount / dir /

我正在使用s3fs这样实现:

 s3fs my-bucket/test/ /path/to/mount/dir 

但是我总是遇到以下错误: s3fs:BUCKET我的存储桶/测试/-存储桶名称包含非法字符。

关于如何使用s3fs挂载s3存储桶的子目录的任何建议吗?

谢谢!

[CRT] s3fs_logger.cpp:LowSetLogLevel(203): change debug level from [CRT]to [INF]
[INF]     s3fs.cpp:set_mountpoint_attribute(3984): PROC(uid=1002,gid=1002) - MountPoint(uid=1002,gid=1002,mode=40777)
[INF] curl.cpp:InitMimeType(432): Loaded mime information from /etc/mime.types
[INF] fdcache_stat.cpp:CheckCacheFileStatTopDir(79): The path to cache top dir is empty,thus not need to check permission.
[INF] s3fs.cpp:s3fs_init(3295): init v1.87(commit:38e1eaa) with OpenSSL
[INF] s3fs.cpp:s3fs_check_service(3411): check services.
[INF]       curl.cpp:CheckBucket(3235): check a bucket.
[WAN] curl.cpp:ResetHandle(1875): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option Could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
[INF]       curl_util.cpp:prepare_url(243): URL is https://s3.amazonaws.com/my-bucket/test/
[INF]       curl_util.cpp:prepare_url(276): URL changed is https://my-bucket.s3.amazonaws.com/test/
[INF]       curl.cpp:insertV4Headers(2572): computing signature [GET] [/test/] [] []
[INF]       curl_util.cpp:url_to_host(320): url is https://s3.amazonaws.com
[ERR] curl.cpp:RequestPerform(2256): HTTP response code 400,returning EIO. Body Text: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'ap-south-1'</Message><Region>ap-south-1</Region><RequestId>5366A05FF406855D</RequestId><HostId>KmvHCBnlvnNZI/g3F2p+NfS0vP1Niq0+OPCZAP9u0pCjTOvpYzXfAB9QMlgQlcei2oi+lihn7F8=</HostId></Error>
[ERR] curl.cpp:CheckBucket(3261): Check bucket Failed,S3 response: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AuthorizationHeaderMalformed</Code><Message>The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'ap-south-1'</Message><Region>ap-south-1</Region><RequestId>5366A05FF406855D</RequestId><HostId>KmvHCBnlvnNZI/g3F2p+NfS0vP1Niq0+OPCZAP9u0pCjTOvpYzXfAB9QMlgQlcei2oi+lihn7F8=</HostId></Error>
[CRT] s3fs.cpp:s3fs_check_service(3444): Failed to connect region 'us-east-1'(default),so retry to connect region 'ap-south-1'.
[INF] curl_handlerpool.cpp:ReturnHandler(110): Pool full: destroy the oldest handler
[INF]       curl.cpp:CheckBucket(3235): check a bucket.
[INF]       curl_util.cpp:prepare_url(243): URL is https://s3-ap-south-1.amazonaws.com/my-bucket/test/
[INF]       curl_util.cpp:prepare_url(276): URL changed is https://my-bucket.s3-ap-south-1.amazonaws.com/test/
[INF]       curl.cpp:insertV4Headers(2572): computing signature [GET] [/test/] [] []
[INF]       curl_util.cpp:url_to_host(320): url is https://s3-ap-south-1.amazonaws.com
[INF]       curl.cpp:RequestPerform(2266): HTTP response code 404 was returned,returning ENOENT
[ERR] curl.cpp:CheckBucket(3261): Check bucket Failed,S3 response: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Key>test/</Key><RequestId>FC8360185E0E5B79</RequestId><HostId>kwY8RPFw8d/6K9VL+cqc0KYDDgGVUVplbcvT+6PDBMvsdO0N53vQhfkfXRYzSQpy0sZ73f+er6o=</HostId></Error>
[CRT] s3fs.cpp:s3fs_check_service(3484): bucket not found(host=https://s3-ap-south-1.amazonaws.com) - result of checking service.
[ERR] s3fs.cpp:s3fs_exit_fuseloop(3285): Exiting FUSE event loop due to errors
[INF] s3fs.cpp:s3fs_destroy(3353): destroy

解决方法

尝试使用冒号将存储桶名称与存储桶路径分开:

s3fs my-bucket:/test /path/to/mount/dir

s3fs还要求目录对象存在才能安装路径。您可以通过AWS CLI创建它:

aws s3api put-object --bucket my-bucket --key test/