huaweicloud / huaweicloud-obs-obsfs Goto Github PK

I am trying to create an SFTP server that uses the mounted Parallel File System directory, but when it comes to reassigning permissions to a user it is completely impossible for me:
This is how I mount the PFS

./obsfs sftp-storage /opt/sftp -o url=obs.la-south-2.myhuaweicloud.com -o passwd_file=/etc/passwd-obsfs -o allow_other -o umask=0755

The PFS is correctly mounted

Filesystem      Size  Used Avail Use% Mounted on
obsfs           256T     0  256T   0% /opt/sftp

But these are the permissions I get

d----w--w-   1 root root    0 Jul 20 12:57 sftp

I've tried to change the permissions, but nothing happened

[root@sftp-server opt]# sudo chmod -R 755 /opt/sftp
[root@sftp-server opt]# ls -la
drwxr-xr-x.  4 root root 4096 Jul 20 12:51 .
dr-xr-xr-x. 20 root root 4096 Jul 20 12:27 ..
d----w--w-   1 root root    0 Jul 20 12:57 sftp

And for the same reason I can't connect to the directory via SFTP

sftp [email protected]
[email protected]'s password:
client_loop: send disconnect: Broken pipe
Connection closed.

If I try to do it with root, there is no problem

sftp [email protected]
[email protected]'s password:
Connected to [email protected].
sftp>

Any idea how to solve this?
Thank you so much :)

It showed that obsfs doesn't support ECS IAM agency authentication. (AWS is IAM_role)
This is a very important case for access obs from ECS instances.

Is it possible to add this feature?

命令：
obsfs xxx /data -o passwd_file=/etc/passwd-obsfs -o url=obs.cn-southwest-2.myhuaweicloud.com -o use_ino -o dbglevel=info -f -o curldbg
报错：

* TCP_NODELAY set
* Connected to xxx.obs.cn-southwest-2.myhuaweicloud.com (100.125.81.3) port 80 (#0)
> GET / HTTP/1.1
Host: xxx.obs.cn-southwest-2.myhuaweicloud.com
User-Agent: s3fs/1.83 (commit hash 6510c14; OpenSSL)
Accept: */*
Authorization: AWS aaaaaaaaaaaaa:bbbbbbbbbbbb=
Date: Sat, 28 Mar 2020 10:50:49 GMT
x-hws-fs-client: true

< HTTP/1.1 405 Method Not Allowed
< Server: OBS
< x-amz-request-id: 0000017120C403C4A01070780FDE7DF2
< x-reserved: amazon, aws and amazon web services are trademarks or registered trademarks of Amazon Technologies, Inc
< x-amz-id-2: 32AAAQAAEAABAAhjkABAAAQAAEAABCSjkla5/RNgPoghjkygyjkycKlzKdGQ
< Content-Type: application/xml
< Date: Sat, 28 Mar 2020 10:50:49 GMT
< Content-Length: 323
<
* Connection #0 to host xxx.obs.cn-southwest-2.myhuaweicloud.com left intact```

已隐藏部分信息

Is there a video tutorial to install OBSFS Centos

Hello,

Thank you for this project, is it possible to have a list/descriptions of the "some unique functions for Huawei cloud OBS services" obfs provide versus s3fs.
We are currently using s3fs and I would like to know if it is interesting for us to move to your solution.

Thank you by advance,

antonin

obsfs 在挂载到本地目录后，长期使用后发现 obsfs 内存不断上涨。
在刚挂载时占用几兆内存，大量写入，几天后发现内存已经涨到近六百兆，按这种情况来算，根本不能作为稳定的功能使用。
使用环境是 Ubuntu 20.04，自己编译的 Github 上最新版本。

OS: CentOS 7
The default fuse module is libfuse.so.2.9.2, so I download and make the libfuse.so.2.9.7.
And I place the libfuse.so.2.9.7 in /home/haiqwa/lib.
I have added the path of the libfuse.so.2.9.7 into the LD_LIBRARY_PATH and LIBRARY_PATH.

when I try to make obsfs, the output of the terminal is partly shown below:

g++ -DHAVE_CONFIG_H -I. -I.. -D_FILE_OFFSET_BITS=64 -I /usr/include/fuse -I /usr/include/libxml2 -g -O2 -Wall -D_FILE_OFFSET_BITS=64 -std=c++11 -MT curl.o -MD -MP -MF .deps/curl.Tpo -c -o curl.o curl.cpp

It seems that it still use the libfuse of version 2.9.2 in the root directory.
By the way, I also add the include directory path of the fuse in the version 2.9.7 to CPLUS_INCLUDE_PATH and C_INCLUDE_PATH.

I want to know how to specify the path of v2.9.7 fuse while installing the obsfs as a non-root user

你好，请问obsfs支持标准s3协议吗？是不是只支持华为自己的s3服务？

1.问题:mount失败

2.描述详情: 执行 "obsfs test /mnt/test -o passwd_file=/home/dukai1/s3Pass -o url=http://10.14.28.10/ -o use_path_request_style -o dbglevel=info -f -o curldbg" mount bucket时，报错信息

Accept: /
Authorization: AWS X0oXfMgA2Cn0plJwxy5W:QHyiy3zIrFviRKF0/Tyqn6QMxsE=
Date: Tue, 20 Aug 2019 08:44:21 GMT
x-hws-fs-client: true

< HTTP/1.1 403 Forbidden
< Content-Length: 405
< Date: Tue, 20 Aug 2019 08:44:21 GMT
< x-amz-request-id: b42a97b4-c326-11e9-8aeb-a4dcbe06256d
< Server: S3 gateway 3.0
<

• Connection #0 to host 10.174.228.130 left intact
  [CRT] hws_s3fs_statis_api.cpp:s3fsStatis(150): Id[38], Step(lib_curl_send), AVG[1118 us], MAX[1118 us], total[1118 us], numSum[1]
  [ERR] curl.cpp:PrintRequestId4ResponseErr(2271): curl perform failed,url=http://10.174.228.130/lvs-test/,response=403,requestid=
  [INF] curl.cpp:RequestPerform(2349): HTTP response code 403 was returned, returning EPERM. requestId:
  [WAN] curl.cpp:RequestPerform(2350): Body Text:

, requestId:
[ERR] curl.cpp:CheckBucket(4028): Check bucket failed, S3 response:

InvalidArgument
Copy Source must mention the source bucket and key: sourcebucket/sourcekey
Authorization header is invalid
b42a97b4-c326-11e9-8aeb-a4dcbe06256d
734a89cb1fb6de381147addb6986f8b0

[CRT] hws_s3fs.cpp:s3fs_check_service(2931): invalid credentials(host=http://10.174.228.130) - result of checking service.
[ERR] hws_s3fs.cpp:s3fs_exit_fuseloop(2467): Exiting FUSE event loop due to errors

[INF] hws_s3fs.cpp:s3fs_destroy(2554): destroy
[WAN] hws_s3fs.cpp:s3fs_destroy(2558): Could not release curl library.
[CRT] hws_fd_cache.cpp:setFdCacheGlobalVariableByCfg(330): gReadPageCleanMs=3000,gReadStatDiffLongMs=50000,gReadStatDiffShortMs=10000
[CRT] hws_fd_cache.cpp:setFdCacheGlobalVariableByCfg(332): gMaxCacheMemSize=1073741824,gIsCheckCRC=1
[CRT] hws_fd_cache.cpp:setFdCacheGlobalVariableByCfg(335): gReadStatSize=32,gReadStatSeqSize=24,StatSizeThreshold=4194304
[CRT] hws_fd_cache.cpp:setFdCacheGlobalVariableByCfg(339): gWritePageNum=12, gReadPageNum=12,
[CRT] hws_fd_cache.cpp:setFdCacheGlobalVariableByCfg(351): FreeCachePercent=20,g_bIntersectWriteMerge=0