johanels/rclone
1
0
Fork 0
mirror of https://github.com/rclone/rclone.git synced 2025-12-11 22:14:05 +01:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

Version v1.58.0

Browse Source
This commit is contained in:
Nick Craig-Wood
2022-03-18 12:29:54 +00:00
parent ff1f173fc2
commit f9354fff2f
77 changed files with 30304 additions and 13591 deletions
Download Patch File Download Diff File Expand all files Collapse all files

442
docs/content/s3.md
View File

@@ -566,16 +566,18 @@ A simple solution is to set the `--s3-upload-cutoff 0` and force all the files t
{{< rem autogenerated options start" - DO NOT EDIT - instead edit fs.RegInfo in backend/s3/s3.go then run make backenddocs" >}}
### Standard options
Here are the standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Minio, SeaweedFS, and Tencent COS).
Here are the standard options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Lyve Cloud, Minio, RackCorp, SeaweedFS, and Tencent COS).
#### --s3-provider
Choose your S3 provider.
Properties:
- Config: provider
- Env Var: RCLONE_S3_PROVIDER
- Type: string
- Default: ""
- Required: false
- Examples:
- "AWS"
- Amazon Web Services (AWS) S3
@@ -589,16 +591,22 @@ Choose your S3 provider.
- Dreamhost DreamObjects
- "IBMCOS"
- IBM COS S3
- "LyveCloud"
- Seagate Lyve Cloud
- "Minio"
- Minio Object Storage
- "Netease"
- Netease Object Storage (NOS)
- "RackCorp"
- RackCorp Object Storage
- "Scaleway"
- Scaleway Object Storage
- "SeaweedFS"
- SeaweedFS S3
- "StackPath"
- StackPath Object Storage
- "Storj"
- Storj (S3 Compatible Gateway)
- "TencentCOS"
- Tencent Cloud Object Storage (COS)
- "Wasabi"
@@ -612,6 +620,8 @@ Get AWS credentials from runtime (environment variables or EC2/ECS meta data if
Only applies if access_key_id and secret_access_key is blank.
Properties:
- Config: env_auth
- Env Var: RCLONE_S3_ENV_AUTH
- Type: bool
@@ -628,10 +638,12 @@ AWS Access Key ID.
Leave blank for anonymous access or runtime credentials.
Properties:
- Config: access_key_id
- Env Var: RCLONE_S3_ACCESS_KEY_ID
- Type: string
- Default: ""
- Required: false
#### --s3-secret-access-key
@@ -639,19 +651,24 @@ AWS Secret Access Key (password).
Leave blank for anonymous access or runtime credentials.
Properties:
- Config: secret_access_key
- Env Var: RCLONE_S3_SECRET_ACCESS_KEY
- Type: string
- Default: ""
- Required: false
#### --s3-region
Region to connect to.
Properties:
- Config: region
- Env Var: RCLONE_S3_REGION
- Provider: AWS
- Type: string
- Default: ""
- Required: false
- Examples:
- "us-east-1"
- The default endpoint - a good choice if you are unsure.
@@ -732,12 +749,67 @@ Region to connect to.
#### --s3-region
Region to connect to.
region - the location where your bucket will be created and your data stored.
Properties:
- Config: region
- Env Var: RCLONE_S3_REGION
- Provider: RackCorp
- Type: string
- Default: ""
- Required: false
- Examples:
- "global"
- Global CDN (All locations) Region
- "au"
- Australia (All states)
- "au-nsw"
- NSW (Australia) Region
- "au-qld"
- QLD (Australia) Region
- "au-vic"
- VIC (Australia) Region
- "au-wa"
- Perth (Australia) Region
- "ph"
- Manila (Philippines) Region
- "th"
- Bangkok (Thailand) Region
- "hk"
- HK (Hong Kong) Region
- "mn"
- Ulaanbaatar (Mongolia) Region
- "kg"
- Bishkek (Kyrgyzstan) Region
- "id"
- Jakarta (Indonesia) Region
- "jp"
- Tokyo (Japan) Region
- "sg"
- SG (Singapore) Region
- "de"
- Frankfurt (Germany) Region
- "us"
- USA (AnyCast) Region
- "us-east-1"
- New York (USA) Region
- "us-west-1"
- Freemont (USA) Region
- "nz"
- Auckland (New Zealand) Region
#### --s3-region
Region to connect to.
Properties:
- Config: region
- Env Var: RCLONE_S3_REGION
- Provider: Scaleway
- Type: string
- Required: false
- Examples:
- "nl-ams"
- Amsterdam, The Netherlands
@@ -750,10 +822,13 @@ Region to connect to.
Leave blank if you are using an S3 clone and you don't have a region.
Properties:
- Config: region
- Env Var: RCLONE_S3_REGION
- Provider: !AWS,Alibaba,RackCorp,Scaleway,Storj,TencentCOS
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- Use this if unsure.
@@ -768,10 +843,13 @@ Endpoint for S3 API.
Leave blank if using AWS to use the default endpoint for the region.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: AWS
- Type: string
- Default: ""
- Required: false
#### --s3-endpoint
@@ -779,10 +857,13 @@ Endpoint for IBM COS S3 API.
Specify if using an IBM COS On Premise.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: IBMCOS
- Type: string
- Default: ""
- Required: false
- Examples:
- "s3.us.cloud-object-storage.appdomain.cloud"
- US Cross Region Endpoint
@@ -913,10 +994,13 @@ Specify if using an IBM COS On Premise.
Endpoint for OSS API.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: Alibaba
- Type: string
- Default: ""
- Required: false
- Examples:
- "oss-accelerate.aliyuncs.com"
- Global Accelerate
@@ -973,10 +1057,13 @@ Endpoint for OSS API.
Endpoint for Scaleway Object Storage.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: Scaleway
- Type: string
- Default: ""
- Required: false
- Examples:
- "s3.nl-ams.scw.cloud"
- Amsterdam Endpoint
@@ -987,10 +1074,13 @@ Endpoint for Scaleway Object Storage.
Endpoint for StackPath Object Storage.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: StackPath
- Type: string
- Default: ""
- Required: false
- Examples:
- "s3.us-east-2.stackpathstorage.com"
- US East Endpoint
@@ -1001,12 +1091,34 @@ Endpoint for StackPath Object Storage.
#### --s3-endpoint
Endpoint for Tencent COS API.
Endpoint of the Shared Gateway.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: Storj
- Type: string
- Default: ""
- Required: false
- Examples:
- "gateway.eu1.storjshare.io"
- EU1 Shared Gateway
- "gateway.us1.storjshare.io"
- US1 Shared Gateway
- "gateway.ap1.storjshare.io"
- Asia-Pacific Shared Gateway
#### --s3-endpoint
Endpoint for Tencent COS API.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: TencentCOS
- Type: string
- Required: false
- Examples:
- "cos.ap-beijing.myqcloud.com"
- Beijing Region
@@ -1049,14 +1161,68 @@ Endpoint for Tencent COS API.
#### --s3-endpoint
Endpoint for RackCorp Object Storage.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: RackCorp
- Type: string
- Required: false
- Examples:
- "s3.rackcorp.com"
- Global (AnyCast) Endpoint
- "au.s3.rackcorp.com"
- Australia (Anycast) Endpoint
- "au-nsw.s3.rackcorp.com"
- Sydney (Australia) Endpoint
- "au-qld.s3.rackcorp.com"
- Brisbane (Australia) Endpoint
- "au-vic.s3.rackcorp.com"
- Melbourne (Australia) Endpoint
- "au-wa.s3.rackcorp.com"
- Perth (Australia) Endpoint
- "ph.s3.rackcorp.com"
- Manila (Philippines) Endpoint
- "th.s3.rackcorp.com"
- Bangkok (Thailand) Endpoint
- "hk.s3.rackcorp.com"
- HK (Hong Kong) Endpoint
- "mn.s3.rackcorp.com"
- Ulaanbaatar (Mongolia) Endpoint
- "kg.s3.rackcorp.com"
- Bishkek (Kyrgyzstan) Endpoint
- "id.s3.rackcorp.com"
- Jakarta (Indonesia) Endpoint
- "jp.s3.rackcorp.com"
- Tokyo (Japan) Endpoint
- "sg.s3.rackcorp.com"
- SG (Singapore) Endpoint
- "de.s3.rackcorp.com"
- Frankfurt (Germany) Endpoint
- "us.s3.rackcorp.com"
- USA (AnyCast) Endpoint
- "us-east-1.s3.rackcorp.com"
- New York (USA) Endpoint
- "us-west-1.s3.rackcorp.com"
- Freemont (USA) Endpoint
- "nz.s3.rackcorp.com"
- Auckland (New Zealand) Endpoint
#### --s3-endpoint
Endpoint for S3 API.
Required when using an S3 clone.
Properties:
- Config: endpoint
- Env Var: RCLONE_S3_ENDPOINT
- Provider: !AWS,IBMCOS,TencentCOS,Alibaba,Scaleway,StackPath,Storj,RackCorp
- Type: string
- Default: ""
- Required: false
- Examples:
- "objects-us-east-1.dream.io"
- Dream Objects endpoint
@@ -1068,6 +1234,12 @@ Required when using an S3 clone.
- Digital Ocean Spaces Singapore 1
- "localhost:8333"
- SeaweedFS S3 localhost
- "s3.us-east-1.lyvecloud.seagate.com"
- Seagate Lyve Cloud US East 1 (Virginia)
- "s3.us-west-1.lyvecloud.seagate.com"
- Seagate Lyve Cloud US West 1 (California)
- "s3.ap-southeast-1.lyvecloud.seagate.com"
- Seagate Lyve Cloud AP Southeast 1 (Singapore)
- "s3.wasabisys.com"
- Wasabi US East endpoint
- "s3.us-west-1.wasabisys.com"
@@ -1085,10 +1257,13 @@ Location constraint - must be set to match the Region.
Used when creating buckets only.
Properties:
- Config: location_constraint
- Env Var: RCLONE_S3_LOCATION_CONSTRAINT
- Provider: AWS
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- Empty for US Region, Northern Virginia, or Pacific Northwest
@@ -1147,10 +1322,13 @@ Location constraint - must match endpoint when using IBM Cloud Public.
For on-prem COS, do not make a selection from this list, hit enter.
Properties:
- Config: location_constraint
- Env Var: RCLONE_S3_LOCATION_CONSTRAINT
- Provider: IBMCOS
- Type: string
- Default: ""
- Required: false
- Examples:
- "us-standard"
- US Cross Region Standard
@@ -1219,14 +1397,69 @@ For on-prem COS, do not make a selection from this list, hit enter.
#### --s3-location-constraint
Location constraint - the location where your bucket will be located and your data stored.
Properties:
- Config: location_constraint
- Env Var: RCLONE_S3_LOCATION_CONSTRAINT
- Provider: RackCorp
- Type: string
- Required: false
- Examples:
- "global"
- Global CDN Region
- "au"
- Australia (All locations)
- "au-nsw"
- NSW (Australia) Region
- "au-qld"
- QLD (Australia) Region
- "au-vic"
- VIC (Australia) Region
- "au-wa"
- Perth (Australia) Region
- "ph"
- Manila (Philippines) Region
- "th"
- Bangkok (Thailand) Region
- "hk"
- HK (Hong Kong) Region
- "mn"
- Ulaanbaatar (Mongolia) Region
- "kg"
- Bishkek (Kyrgyzstan) Region
- "id"
- Jakarta (Indonesia) Region
- "jp"
- Tokyo (Japan) Region
- "sg"
- SG (Singapore) Region
- "de"
- Frankfurt (Germany) Region
- "us"
- USA (AnyCast) Region
- "us-east-1"
- New York (USA) Region
- "us-west-1"
- Freemont (USA) Region
- "nz"
- Auckland (New Zealand) Region
#### --s3-location-constraint
Location constraint - must be set to match the Region.
Leave blank if not sure. Used when creating buckets only.
Properties:
- Config: location_constraint
- Env Var: RCLONE_S3_LOCATION_CONSTRAINT
- Provider: !AWS,IBMCOS,Alibaba,RackCorp,Scaleway,StackPath,Storj,TencentCOS
- Type: string
- Default: ""
- Required: false
#### --s3-acl
@@ -1239,10 +1472,13 @@ For more info visit https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview
Note that this ACL is applied when server-side copying objects as S3
doesn't copy the ACL from the source but rather writes a fresh one.
Properties:
- Config: acl
- Env Var: RCLONE_S3_ACL
- Provider: !Storj
- Type: string
- Default: ""
- Required: false
- Examples:
- "default"
- Owner gets Full_CONTROL.
@@ -1289,10 +1525,13 @@ doesn't copy the ACL from the source but rather writes a fresh one.
The server-side encryption algorithm used when storing this object in S3.
Properties:
- Config: server_side_encryption
- Env Var: RCLONE_S3_SERVER_SIDE_ENCRYPTION
- Provider: AWS,Ceph,Minio
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- None
@@ -1305,10 +1544,13 @@ The server-side encryption algorithm used when storing this object in S3.
If using KMS ID you must provide the ARN of Key.
Properties:
- Config: sse_kms_key_id
- Env Var: RCLONE_S3_SSE_KMS_KEY_ID
- Provider: AWS,Ceph,Minio
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- None
@@ -1319,10 +1561,13 @@ If using KMS ID you must provide the ARN of Key.
The storage class to use when storing new objects in S3.
Properties:
- Config: storage_class
- Env Var: RCLONE_S3_STORAGE_CLASS
- Provider: AWS
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- Default
@@ -1347,10 +1592,13 @@ The storage class to use when storing new objects in S3.
The storage class to use when storing new objects in OSS.
Properties:
- Config: storage_class
- Env Var: RCLONE_S3_STORAGE_CLASS
- Provider: Alibaba
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- Default
@@ -1365,10 +1613,13 @@ The storage class to use when storing new objects in OSS.
The storage class to use when storing new objects in Tencent COS.
Properties:
- Config: storage_class
- Env Var: RCLONE_S3_STORAGE_CLASS
- Provider: TencentCOS
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- Default
@@ -1383,10 +1634,13 @@ The storage class to use when storing new objects in Tencent COS.
The storage class to use when storing new objects in S3.
Properties:
- Config: storage_class
- Env Var: RCLONE_S3_STORAGE_CLASS
- Provider: Scaleway
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- Default.
@@ -1399,7 +1653,7 @@ The storage class to use when storing new objects in S3.
### Advanced options
Here are the advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Minio, SeaweedFS, and Tencent COS).
Here are the advanced options specific to s3 (Amazon S3 Compliant Storage Providers including AWS, Alibaba, Ceph, Digital Ocean, Dreamhost, IBM COS, Lyve Cloud, Minio, RackCorp, SeaweedFS, and Tencent COS).
#### --s3-bucket-acl
@@ -1410,10 +1664,12 @@ For more info visit https://docs.aws.amazon.com/AmazonS3/latest/dev/acl-overview
Note that this ACL is applied when only when creating buckets. If it
isn't set then "acl" is used instead.
Properties:
- Config: bucket_acl
- Env Var: RCLONE_S3_BUCKET_ACL
- Type: string
- Default: ""
- Required: false
- Examples:
- "private"
- Owner gets FULL_CONTROL.
@@ -1433,8 +1689,11 @@ isn't set then "acl" is used instead.
Enables requester pays option when interacting with S3 bucket.
Properties:
- Config: requester_pays
- Env Var: RCLONE_S3_REQUESTER_PAYS
- Provider: AWS
- Type: bool
- Default: false
@@ -1442,10 +1701,13 @@ Enables requester pays option when interacting with S3 bucket.
If using SSE-C, the server-side encryption algorithm used when storing this object in S3.
Properties:
- Config: sse_customer_algorithm
- Env Var: RCLONE_S3_SSE_CUSTOMER_ALGORITHM
- Provider: AWS,Ceph,Minio
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- None
@@ -1456,10 +1718,13 @@ If using SSE-C, the server-side encryption algorithm used when storing this obje
If using SSE-C you must provide the secret encryption key used to encrypt/decrypt your data.
Properties:
- Config: sse_customer_key
- Env Var: RCLONE_S3_SSE_CUSTOMER_KEY
- Provider: AWS,Ceph,Minio
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- None
@@ -1471,10 +1736,13 @@ If using SSE-C you may provide the secret encryption key MD5 checksum (optional)
If you leave it blank, this is calculated automatically from the sse_customer_key provided.
Properties:
- Config: sse_customer_key_md5
- Env Var: RCLONE_S3_SSE_CUSTOMER_KEY_MD5
- Provider: AWS,Ceph,Minio
- Type: string
- Default: ""
- Required: false
- Examples:
- ""
- None
@@ -1486,6 +1754,8 @@ Cutoff for switching to chunked upload.
Any files larger than this will be uploaded in chunks of chunk_size.
The minimum is 0 and the maximum is 5 GiB.
Properties:
- Config: upload_cutoff
- Env Var: RCLONE_S3_UPLOAD_CUTOFF
- Type: SizeSuffix
@@ -1515,6 +1785,8 @@ most 10,000 chunks, this means that by default the maximum size of
a file you can stream upload is 48 GiB. If you wish to stream upload
larger files then you will need to increase chunk_size.
Properties:
- Config: chunk_size
- Env Var: RCLONE_S3_CHUNK_SIZE
- Type: SizeSuffix
@@ -1534,6 +1806,8 @@ Rclone will automatically increase the chunk size when uploading a
large file of a known size to stay below this number of chunks limit.
Properties:
- Config: max_upload_parts
- Env Var: RCLONE_S3_MAX_UPLOAD_PARTS
- Type: int
@@ -1548,6 +1822,8 @@ copied in chunks of this size.
The minimum is 0 and the maximum is 5 GiB.
Properties:
- Config: copy_cutoff
- Env Var: RCLONE_S3_COPY_CUTOFF
- Type: SizeSuffix
@@ -1562,6 +1838,8 @@ uploading it so it can add it to metadata on the object. This is great
for data integrity checking but can cause long delays for large files
to start uploading.
Properties:
- Config: disable_checksum
- Env Var: RCLONE_S3_DISABLE_CHECKSUM
- Type: bool
@@ -1581,10 +1859,12 @@ it will default to the current user's home directory.
Windows: "%USERPROFILE%\.aws\credentials"
Properties:
- Config: shared_credentials_file
- Env Var: RCLONE_S3_SHARED_CREDENTIALS_FILE
- Type: string
- Default: ""
- Required: false
#### --s3-profile
@@ -1597,19 +1877,23 @@ If empty it will default to the environment variable "AWS_PROFILE" or
"default" if that environment variable is also not set.
Properties:
- Config: profile
- Env Var: RCLONE_S3_PROFILE
- Type: string
- Default: ""
- Required: false
#### --s3-session-token
An AWS session token.
Properties:
- Config: session_token
- Env Var: RCLONE_S3_SESSION_TOKEN
- Type: string
- Default: ""
- Required: false
#### --s3-upload-concurrency
@@ -1622,6 +1906,8 @@ If you are uploading small numbers of large files over high-speed links
and these uploads do not fully utilize your bandwidth, then increasing
this may help to speed up the transfers.
Properties:
- Config: upload_concurrency
- Env Var: RCLONE_S3_UPLOAD_CONCURRENCY
- Type: int
@@ -1640,6 +1926,8 @@ Some providers (e.g. AWS, Aliyun OSS, Netease COS, or Tencent COS) require this
false - rclone will do this automatically based on the provider
setting.
Properties:
- Config: force_path_style
- Env Var: RCLONE_S3_FORCE_PATH_STYLE
- Type: bool
@@ -1654,6 +1942,8 @@ If it is set then rclone will use v2 authentication.
Use this only if v4 signatures don't work, e.g. pre Jewel/v10 CEPH.
Properties:
- Config: v2_auth
- Env Var: RCLONE_S3_V2_AUTH
- Type: bool
@@ -1665,8 +1955,11 @@ If true use the AWS S3 accelerated endpoint.
See: [AWS S3 Transfer acceleration](https://docs.aws.amazon.com/AmazonS3/latest/dev/transfer-acceleration-examples.html)
Properties:
- Config: use_accelerate_endpoint
- Env Var: RCLONE_S3_USE_ACCELERATE_ENDPOINT
- Provider: AWS
- Type: bool
- Default: false
@@ -1679,8 +1972,11 @@ It should be set to true for resuming uploads across different sessions.
WARNING: Storing parts of an incomplete multipart upload counts towards space usage on S3 and will add additional costs if not cleaned up.
Properties:
- Config: leave_parts_on_error
- Env Var: RCLONE_S3_LEAVE_PARTS_ON_ERROR
- Provider: AWS
- Type: bool
- Default: false
@@ -1694,11 +1990,53 @@ In AWS S3 this is a global maximum and cannot be changed, see [AWS S3](https://d
In Ceph, this can be increased with the "rgw list buckets max chunk" option.
Properties:
- Config: list_chunk
- Env Var: RCLONE_S3_LIST_CHUNK
- Type: int
- Default: 1000
#### --s3-list-version
Version of ListObjects to use: 1,2 or 0 for auto.
When S3 originally launched it only provided the ListObjects call to
enumerate objects in a bucket.
However in May 2016 the ListObjectsV2 call was introduced. This is
much higher performance and should be used if at all possible.
If set to the default, 0, rclone will guess according to the provider
set which list objects method to call. If it guesses wrong, then it
may be set manually here.
Properties:
- Config: list_version
- Env Var: RCLONE_S3_LIST_VERSION
- Type: int
- Default: 0
#### --s3-list-url-encode
Whether to url encode listings: true/false/unset
Some providers support URL encoding listings and where this is
available this is more reliable when using control characters in file
names. If this is set to unset (the default) then rclone will choose
according to the provider setting what to apply, but you can override
rclone's choice here.
Properties:
- Config: list_url_encode
- Env Var: RCLONE_S3_LIST_URL_ENCODE
- Type: Tristate
- Default: unset
#### --s3-no-check-bucket
If set, don't attempt to check the bucket exists or create it.
@@ -1711,6 +2049,8 @@ creation permissions. Before v1.52.0 this would have passed silently
due to a bug.
Properties:
- Config: no_check_bucket
- Env Var: RCLONE_S3_NO_CHECK_BUCKET
- Type: bool
@@ -1748,6 +2088,8 @@ operation. In practice the chance of an undetected upload failure is
very small even with this flag.
Properties:
- Config: no_head
- Env Var: RCLONE_S3_NO_HEAD
- Type: bool
@@ -1757,6 +2099,8 @@ very small even with this flag.
If set, do not do HEAD before GET when getting objects.
Properties:
- Config: no_head_object
- Env Var: RCLONE_S3_NO_HEAD_OBJECT
- Type: bool
@@ -1764,10 +2108,12 @@ If set, do not do HEAD before GET when getting objects.
#### --s3-encoding
This sets the encoding for the backend.
The encoding for the backend.
See the [encoding section in the overview](/overview/#encoding) for more info.
Properties:
- Config: encoding
- Env Var: RCLONE_S3_ENCODING
- Type: MultiEncoder
@@ -1780,6 +2126,8 @@ How often internal memory buffer pools will be flushed.
Uploads which requires additional buffers (f.e multipart) will use memory pool for allocations.
This option controls how often unused buffers will be removed from the pool.
Properties:
- Config: memory_pool_flush_time
- Env Var: RCLONE_S3_MEMORY_POOL_FLUSH_TIME
- Type: Duration
@@ -1789,6 +2137,8 @@ This option controls how often unused buffers will be removed from the pool.
Whether to use mmap buffers in internal memory pool.
Properties:
- Config: memory_pool_use_mmap
- Env Var: RCLONE_S3_MEMORY_POOL_USE_MMAP
- Type: bool
@@ -1806,6 +2156,8 @@ See: https://github.com/rclone/rclone/issues/4673, https://github.com/rclone/rcl
Properties:
- Config: disable_http2
- Env Var: RCLONE_S3_DISABLE_HTTP2
- Type: bool
@@ -1817,10 +2169,26 @@ Custom endpoint for downloads.
This is usually set to a CloudFront CDN URL as AWS S3 offers
cheaper egress for data downloaded through the CloudFront network.
Properties:
- Config: download_url
- Env Var: RCLONE_S3_DOWNLOAD_URL
- Type: string
- Default: ""
- Required: false
#### --s3-use-multipart-etag
Whether to use ETag in multipart uploads for verification
This should be true, false or left unset to use the default for the provider.
Properties:
- Config: use_multipart_etag
- Env Var: RCLONE_S3_USE_MULTIPART_ETAG
- Type: Tristate
- Default: unset
## Backend commands
@@ -1836,7 +2204,7 @@ See [the "rclone backend" command](/commands/rclone_backend/) for more
info on how to pass options and arguments.
These can be run on a running backend using the rc command
[backend/command](/rc/#backend/command).
[backend/command](/rc/#backend-command).
### restore