albertony
0dd56ff2a3
docs: fix missing punctuation in backend commands short description
2025-11-04 23:00:46 +01:00
albertony
2443cb284e
docs: fix markdownlint issues in backend command generated output
2025-11-04 23:00:46 +01:00
albertony
0f3aa17fb6
build: improve backend docs autogenerated marker line
...
Replace custom rem hugo shortcode template with HTML comment. HTML comments are now
allowed in Hugo without enabling unsafe HTML parsing.
Improve the text in the comment: Remove unnecessary quoting, and avoid impression that
make backenddocs has to be run and results committed, since we have a lint check which
will then report error because we want to prevent manual changes in autogenerated sections.
Disable the markdownlint rule line-length on the autogenerated marker line.
Make the autogenerated marker detection a bit more robust.
See #8942 for more details.
2025-11-04 21:56:01 +01:00
Alex
8f74e7d331
backend/compress: add zstd compression
...
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
Added support for reading and writing zstd-compressed archives in seekable format
using "github.com/klauspost/compress/zstd" and
"github.com/SaveTheRbtz/zstd-seekable-format-go/pkg".
Bumped Go version from 1.24.0 to 1.24.4 due to requirements of
"github.com/SaveTheRbtz/zstd-seekable-format-go/pkg".
2025-11-04 14:50:56 +00:00
Copilot
ee92673e1b
sftp: fix zombie SSH processes with --sftp-ssh - Fixes #8929
...
Before this fix using --sftp-ssh with the sftp backend could leave
zombie processes.
This patch fixes the problem that sshClientExternal.session was never
assigned, so Wait() always returned nil without waiting for the SSH
process to exit. This caused zombie processes because the process was
never reaped.
It also ensures that Wait() is only called once on each process.
I gave this issue to Copilot to fix as an experiment. It went off in
the wrong direction to start with and fixed something which wasn't the
problem but still needed fixing. With a bit of a nudge it fixed the
correct problem too.
Co-authored-by: Nick Craig-Wood <nick@craig-wood.com >
2025-11-04 12:09:47 +00:00
Nick Craig-Wood
55655efabf
testserver: fix tests failing due to stopped servers
...
Before this fix there were various issues with the test server
framework, most noticeably servers stopping when they shouldn't
causing timeouts. This was caused by the reference counting in the Go
code not being engineered to work in multiple processes so it was not
working at all properly.
This fix moves the reference counting logic to the start scripts and
in turn removes that logic from the Go code. This means that the
reference counting is now global and works correctly over multiple
processes.
2025-11-04 11:45:15 +00:00
dougal
700e6e11fd
docs: add new integration tester site link
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
2025-11-03 17:15:53 +00:00
Nick Craig-Wood
edb47076b5
docs: update the method for running integration tests
2025-11-03 16:52:33 +00:00
Nick Craig-Wood
e5fd97b8d2
bisync: fix failing tests
...
In this commit
d240d044c3 check: improved reporting of differences in sizes and contents
We adjusted the sense of operations.CheckIdenticalDownload to return
true if files are identical as is implied by the name, but we forgot
to invert the logic in the bisync DownloadCheckFn which caused lots of
tests to fail.
2025-11-03 16:52:33 +00:00
Nick Craig-Wood
bc57a31859
Add SublimePeace to contributors
2025-11-03 16:52:33 +00:00
dougal
4adb48fbbc
b2: fix "expected a FileSseMode but found: ''"
...
94deb6bd6f b2: Add Server-Side encryption support
From the commit above, without setting SSE, rclone would send invalid
SSE requests with empty strings. This is as omitempty only works with
struct pointers not structs.
2025-11-03 16:42:40 +00:00
SublimePeace
c41d0f7d3a
docs: s3: clarify multipart uploads memory usage
...
Clarified phrasing to avoid confusion. Fixed a typo.
Fixes #8525
2025-11-03 16:35:33 +00:00
Nick Craig-Wood
d34ba258b0
test_all: fix detection of running servers
...
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
Before this change stopping servers was unreliable, expecially the non
docker based ones. This caused timeouts and connection errors in the
tests.
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
05d54a95b8
accounting: add AccountReadN for use in cluster
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
f16b39165b
fs: add NonDefaultRC for discovering options in use
...
This enables us to send rc messages with the config in use.
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
86edb26fd5
fs: move tests into correct files
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
203e1bdbf9
rc: add NewJobFromBytes for reading jobs from non HTTP transactions
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
a522c056fe
rc: add job/batch for sending batches of rc commands to run concurrently
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
31adc7d89f
Add Ted Robertson to contributors
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
c559ab7c58
Add Joseph Brownlee to contributors
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
80610ef774
Add fries1234 to contributors
2025-11-03 14:44:39 +00:00
Nick Craig-Wood
a6c943a1ad
Add Fawzib Rojas to contributors
2025-11-03 14:43:56 +00:00
Nick Craig-Wood
53e0dbb5cb
Add Riaz Arbi to contributors
2025-11-03 14:43:56 +00:00
Nick Craig-Wood
3a0000526b
Add Lukas Krejci to contributors
2025-11-03 14:43:56 +00:00
Nick Craig-Wood
1fa6941e26
Add Adam Dinwoodie to contributors
2025-11-03 14:43:56 +00:00
Nick Craig-Wood
9bb7ad31e6
Add dulanting to contributors
2025-11-03 14:43:56 +00:00
Ted Robertson
da8c6847ad
docs: add AppArmor restrictions to rclone mount
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
2025-11-01 19:28:14 +00:00
albertony
d240d044c3
check: improved reporting of differences in sizes and contents
...
fixes rclone check --download not showing differing files
2025-11-01 19:23:01 +00:00
iTrooz
1056ace80f
mega: implement 2FA login
2025-11-01 19:03:49 +00:00
albertony
a06c1c0cb7
docs: change to light code block style to better match overall theme
2025-11-01 18:55:11 +01:00
albertony
7672c3d586
docs: fix various markdownlint issues
2025-11-01 18:54:19 +01:00
albertony
f361cdf1cb
build: restrict the markdown languages to use for code blocks
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
2025-11-01 15:52:41 +01:00
albertony
26d3c71bab
docs: fix various markdownlint issues
2025-11-01 15:33:38 +01:00
albertony
c76396f03c
docs: fix markdownlint issue md013/line-length
2025-11-01 15:33:38 +01:00
albertony
059ad47336
docs: change syntax hightlighting for command examples from sh to console
2025-11-01 15:33:38 +01:00
Joseph Brownlee
becc068d36
docs: Clarify remote naming convention
...
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
Co-authored-by: dougal <147946567+roucc@users.noreply.github.com >
Co-authored-by: dougal <dougal.craigwood@gmail.com >
2025-10-31 15:42:38 +00:00
fries1234
94deb6bd6f
b2: Add Server-Side encryption support
...
This commit adds SSE-C (Server-Side Encryption - Customer) support to
the B2 native backend. The server uses a customer provided AES-256 key
to encrypt the files when you upload them to the bucket, and then it
discards your key from the servers RAM after you're done uploading.
The option names and descriptions are based off the S3 backend
implementation as the way S3 and B2 does SSE-C is pretty similar.
Fixes #6585
2025-10-31 15:33:31 +00:00
Fawzib Rojas
cc09978b79
Added rclone archive command to create and read archive files
...
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
Co-Authored-By: Nick Craig-Wood <nick@craig-wood.com >
2025-10-30 16:20:48 +00:00
Fawzib Rojas
409dc75328
accounting: add io.Seeker/io.ReaderAt support to accounting.Account
...
This is a pass through implementation which will fail if the
underlying reader does not have the interface.
2025-10-30 16:20:48 +00:00
Nick Craig-Wood
fb30c5f8dd
operations: add ReadAt method to ReOpen
2025-10-30 16:20:48 +00:00
Nick Craig-Wood
203df6cc58
fstest: add ResetRun to allow the remote to be reset in tests
2025-10-30 16:20:48 +00:00
Riaz Arbi
459e10d599
gcs: fix --gcs-storage-class to work with server side copy for objects
2025-10-30 15:20:16 +00:00
Lukas Krejci
1ba4fd1d83
ulozto: implement the about functionality
2025-10-30 15:06:37 +00:00
Adam Dinwoodie
77553b8dd5
local: add --skip-specials to ignore special files
...
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
Give users a way to explicitly acknowledge that pipes, sockets and block
devices are to be ignored without warnings.
This follows the precedent set in commit 6152bab28 (local: add
--skip-links to suppress symlink warnings, 2017-07-21) for ignoring
warnings about symlinks.
2025-10-29 17:00:25 +00:00
Andrew Ruthven
5420dbbe38
swift: Report disk usage in segment containers
...
Large objects are split and stored in a _segments container in Swift.
These should be included when reporting on the space used.
Fixes #8857
2025-10-29 16:55:53 +00:00
dulanting
87b71dd6b9
refactor: use strings.Builder to improve performance
2025-10-29 16:48:34 +00:00
Nick Craig-Wood
a0bcdc2638
Archive backend to read archives on cloud storage.
...
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.24 (push) Has been cancelled
build / linux_386 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
Initial support with Zip and Squashfs archives.
Fixes #8633
See #2815
2025-10-28 11:05:41 +00:00
Nick Craig-Wood
e42fa9f92d
vfs: remove unecessary import in tests to fix import cycles
2025-10-28 11:05:41 +00:00
Nick Craig-Wood
4586104dc7
Add Lakshmi-Surekha to contributors
2025-10-28 11:05:35 +00:00
Nick Craig-Wood
c4c360a285
Add Andrew Gunnerson to contributors
2025-10-28 11:05:35 +00:00