johanels/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2025-12-11 22:14:05 +01:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

Version v1.60.0

Browse Source
This commit is contained in:
Nick Craig-Wood
2022-10-21 15:06:08 +01:00
parent afa61e702c
commit 01dbbff62e
34 changed files with 9667 additions and 2000 deletions
Download Patch File Download Diff File Expand all files Collapse all files

218
docs/content/s3.md
View File

@@ -641,7 +641,7 @@ A simple solution is to set the `--s3-upload-cutoff 0` and force all the files t
{{< rem autogenerated options start" - DO NOT EDIT - instead edit fs.RegInfo in backend/s3/s3.go then run make backenddocs" >}}
### Standard options
Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, China Mobile, Cloudflare, ArvanCloud, Digital Ocean, Dreamhost, Huawei OBS, IBM COS, IDrive e2, Lyve Cloud, Minio, Netease, RackCorp, Scaleway, SeaweedFS, StackPath, Storj, Tencent COS and Wasabi).
Here are the Standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, China Mobile, Cloudflare, ArvanCloud, Digital Ocean, Dreamhost, Huawei OBS, IBM COS, IDrive e2, IONOS Cloud, Lyve Cloud, Minio, Netease, RackCorp, Scaleway, SeaweedFS, StackPath, Storj, Tencent COS, Qiniu and Wasabi).
#### --s3-provider
@@ -676,6 +676,8 @@ Properties:
- IBM COS S3
- "IDrive"
- IDrive e2
- "IONOS"
- IONOS Cloud
- "LyveCloud"
- Seagate Lyve Cloud
- "Minio"
@@ -696,6 +698,8 @@ Properties:
- Tencent Cloud Object Storage (COS)
- "Wasabi"
- Wasabi Object Storage
- "Qiniu"
- Qiniu Object Storage (Kodo)
- "Other"
- Any other S3 compatible provider
@@ -966,13 +970,68 @@ Properties:
Region to connect to.
Properties:
- Config: region
- Env Var: RCLONE_S3_REGION
- Provider: Qiniu
- Type: string
- Required: false
- Examples:
- "cn-east-1"
- The default endpoint - a good choice if you are unsure.
- East China Region 1.
- Needs location constraint cn-east-1.
- "cn-east-2"
- East China Region 2.
- Needs location constraint cn-east-2.
- "cn-north-1"
- North China Region 1.
- Needs location constraint cn-north-1.
- "cn-south-1"
- South China Region 1.
- Needs location constraint cn-south-1.
- "us-north-1"
- North America Region.
- Needs location constraint us-north-1.
- "ap-southeast-1"
- Southeast Asia Region 1.
- Needs location constraint ap-southeast-1.
- "ap-northeast-1"
- Northeast Asia Region 1.
- Needs location constraint ap-northeast-1.
#### --s3-region
Region where your bucket will be created and your data stored.
Properties:
- Config: region
- Env Var: RCLONE_S3_REGION
- Provider: IONOS
- Type: string
- Required: false
- Examples:
- "de"
- Frankfurt, Germany
- "eu-central-2"
- Berlin, Germany
- "eu-south-2"
- Logrono, Spain
#### --s3-region
Region to connect to.
Leave blank if you are using an S3 clone and you don't have a region.
Properties:
- Config: region
- Env Var: RCLONE_S3_REGION
- Provider: !AWS,Alibaba,ChinaMobile,Cloudflare,ArvanCloud,RackCorp,Scaleway,Storj,TencentCOS,HuaweiOBS,IDrive
- Provider: !AWS,Alibaba,ChinaMobile,Cloudflare,IONOS,ArvanCloud,Qiniu,RackCorp,Scaleway,Storj,TencentCOS,HuaweiOBS,IDrive
- Type: string
- Required: false
- Examples:
@@ -1230,6 +1289,27 @@ Properties:
#### --s3-endpoint
Endpoint for IONOS S3 Object Storage.
Specify the endpoint from the same region.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: IONOS
- Type: string
- Required: false
- Examples:
- "s3-eu-central-1.ionoscloud.com"
- Frankfurt, Germany
- "s3-eu-central-2.ionoscloud.com"
- Berlin, Germany
- "s3-eu-south-2.ionoscloud.com"
- Logrono, Spain
#### --s3-endpoint
Endpoint for OSS API.
Properties:
@@ -1495,6 +1575,33 @@ Properties:
#### --s3-endpoint
Endpoint for Qiniu Object Storage.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: Qiniu
- Type: string
- Required: false
- Examples:
- "s3-cn-east-1.qiniucs.com"
- East China Endpoint 1
- "s3-cn-east-2.qiniucs.com"
- East China Endpoint 2
- "s3-cn-north-1.qiniucs.com"
- North China Endpoint 1
- "s3-cn-south-1.qiniucs.com"
- South China Endpoint 1
- "s3-us-north-1.qiniucs.com"
- North America Endpoint 1
- "s3-ap-southeast-1.qiniucs.com"
- Southeast Asia Endpoint 1
- "s3-ap-northeast-1.qiniucs.com"
- Northeast Asia Endpoint 1
#### --s3-endpoint
Endpoint for S3 API.
Required when using an S3 clone.
@@ -1503,7 +1610,7 @@ Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: !AWS,IBMCOS,IDrive,TencentCOS,HuaweiOBS,Alibaba,ChinaMobile,ArvanCloud,Scaleway,StackPath,Storj,RackCorp
- Provider: !AWS,IBMCOS,IDrive,IONOS,TencentCOS,HuaweiOBS,Alibaba,ChinaMobile,ArvanCloud,Scaleway,StackPath,Storj,RackCorp,Qiniu
- Type: string
- Required: false
- Examples:
@@ -1830,13 +1937,42 @@ Properties:
Location constraint - must be set to match the Region.
Used when creating buckets only.
Properties:
- Config: location_constraint
- Env Var: RCLONE_S3_LOCATION_CONSTRAINT
- Provider: Qiniu
- Type: string
- Required: false
- Examples:
- "cn-east-1"
- East China Region 1
- "cn-east-2"
- East China Region 2
- "cn-north-1"
- North China Region 1
- "cn-south-1"
- South China Region 1
- "us-north-1"
- North America Region 1
- "ap-southeast-1"
- Southeast Asia Region 1
- "ap-northeast-1"
- Northeast Asia Region 1
#### --s3-location-constraint
Location constraint - must be set to match the Region.
Leave blank if not sure. Used when creating buckets only.
Properties:
- Config: location_constraint
- Env Var: RCLONE_S3_LOCATION_CONSTRAINT
- Provider: !AWS,IBMCOS,IDrive,Alibaba,HuaweiOBS,ChinaMobile,Cloudflare,ArvanCloud,RackCorp,Scaleway,StackPath,Storj,TencentCOS
- Provider: !AWS,Alibaba,HuaweiOBS,ChinaMobile,Cloudflare,IBMCOS,IDrive,IONOS,ArvanCloud,Qiniu,RackCorp,Scaleway,StackPath,Storj,TencentCOS
- Type: string
- Required: false
@@ -2066,9 +2202,30 @@ Properties:
- Archived storage.
- Prices are lower, but it needs to be restored first to be accessed.
#### --s3-storage-class
The storage class to use when storing new objects in Qiniu.
Properties:
- Config: storage_class
- Env Var: RCLONE_S3_STORAGE_CLASS
- Provider: Qiniu
- Type: string
- Required: false
- Examples:
- "STANDARD"
- Standard storage class
- "LINE"
- Infrequent access storage mode
- "GLACIER"
- Archive storage mode
- "DEEP_ARCHIVE"
- Deep archive storage mode
### Advanced options
Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, China Mobile, Cloudflare, ArvanCloud, Digital Ocean, Dreamhost, Huawei OBS, IBM COS, IDrive e2, Lyve Cloud, Minio, Netease, RackCorp, Scaleway, SeaweedFS, StackPath, Storj, Tencent COS and Wasabi).
Here are the Advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, China Mobile, Cloudflare, ArvanCloud, Digital Ocean, Dreamhost, Huawei OBS, IBM COS, IDrive e2, IONOS Cloud, Lyve Cloud, Minio, Netease, RackCorp, Scaleway, SeaweedFS, StackPath, Storj, Tencent COS, Qiniu and Wasabi).
#### --s3-bucket-acl
@@ -2131,7 +2288,9 @@ Properties:
#### --s3-sse-customer-key
If using SSE-C you must provide the secret encryption key used to encrypt/decrypt your data.
To use SSE-C you may provide the secret encryption key used to encrypt/decrypt your data.
Alternatively you can provide --sse-customer-key-base64.
Properties:
@@ -2144,6 +2303,23 @@ Properties:
- ""
- None
#### --s3-sse-customer-key-base64
If using SSE-C you must provide the secret encryption key encoded in base64 format to encrypt/decrypt your data.
Alternatively you can provide --sse-customer-key.
Properties:
- Config: sse_customer_key_base64
- Env Var: RCLONE_S3_SSE_CUSTOMER_KEY_BASE64
- Provider: AWS,Ceph,ChinaMobile,Minio
- Type: string
- Required: false
- Examples:
- ""
- None
#### --s3-sse-customer-key-md5
If using SSE-C you may provide the secret encryption key MD5 checksum (optional).
@@ -2663,6 +2839,36 @@ Properties:
- Type: Time
- Default: off
#### --s3-decompress
If set this will decompress gzip encoded objects.
It is possible to upload objects to S3 with "Content-Encoding: gzip"
set. Normally rclone will download these files as compressed objects.
If this flag is set then rclone will decompress these files with
"Content-Encoding: gzip" as they are received. This means that rclone
can't check the size and hash but the file contents will be decompressed.
Properties:
- Config: decompress
- Env Var: RCLONE_S3_DECOMPRESS
- Type: bool
- Default: false
#### --s3-no-system-metadata
Suppress setting and reading of system metadata
Properties:
- Config: no_system_metadata
- Env Var: RCLONE_S3_NO_SYSTEM_METADATA
- Type: bool
- Default: false
### Metadata
User metadata is stored as x-amz-meta- keys. S3 metadata keys are case insensitive and are always returned in lower case.