1949 Commits

Author	SHA1	Message	Date
dougal	e5e6a4b5ae	sync: fix error propagation in tests (#9025) ... This commit fixes the sync transform test IO errors by resetting the error flag which stops subsequent tests failing.	2025-12-10 15:43:22 +00:00
Nick Craig-Wood	4851f1796c	log: fix backtrace not going to the --log-file #9014 ... Before the log re-organisation in: 8d353039a6 log: add log rotation to --log-file rclone would write any backtraces to the --log-file which was very convenient for users. This got accidentally disabled due to a typo which meant backtraces started going to stderr even if --log-file was supplied. This fixes the problem.	2025-12-09 16:35:07 +00:00
Nick Craig-Wood	4ff8899b2c	build: fix lint warning after linter upgrade	2025-12-09 16:15:17 +00:00
Jonas Tingeborn	233fef5c4d	configfile: add piped config support - fixes #9012	2025-12-08 18:42:17 +00:00
Tingsong Xu	b9586c3e03	fs/log: fix PID not included in JSON log output ... When using `--log-format pid,json`, the PID was not being added to the JSON log output. This fix adds PID support to JSON logging.	2025-12-08 18:41:58 +00:00
vicerace	9be7f99bf8	refactor: use strings.Cut to simplify code ... Signed-off-by: vicerace <vicerace@sohu.com>	2025-11-27 14:42:11 +00:00
Nick Craig-Wood	1886c552db	Start v1.73.0-DEV development	2025-11-21 18:23:07 +00:00
Nick Craig-Wood	1d02e1219a	rc: fix formatting in job/batch	2025-11-21 17:06:18 +00:00
Nick Craig-Wood	6d4c625bfb	rc: config/unlock: rename parameter to configPassword accept old as well ... We accidentally added a non `camelCase` parameter to the rc (`config_password`)- this fixes it (to `configPassword`) but accepts the old name too as it has been in a release.	2025-11-20 16:46:01 +00:00
Nick Craig-Wood	4eccc40168	rc: correct names of parameters in job/list output ... These were accidentally committed as snake_case whereas we use camelCase elsewhere. This corrects the issue before the first release in v1.72.0	2025-11-20 16:46:01 +00:00
Nikolay Kiryanov	321488441e	rc: add executeId to job statuses - fixes #8972	2025-11-20 13:15:22 +00:00
Oleg Kunitsyn	ecea0cd6f9	http: add basic metadata and provide it via serve ... Co-authored-by: dougal <147946567+roucc@users.noreply.github.com>	2025-11-17 16:52:30 +00:00
n4n5	71138082ea	fix: comment typos	2025-11-13 13:47:40 +00:00
Nick Craig-Wood	9f75af38e3	rc: make sure fatal errors don't crash rclone - fixes #8955 ... Before this change, if any code called fs.Fatal(f) then it would stop rclone as designed. However this is not appropriate when using the RC API - we want the error returned to the user. This change turns the fs.Fatal(f) call into a panic which is caught by the RC API handler and returned to the user as a 500 error.	2025-11-12 12:22:04 +00:00
Nick Craig-Wood	4d19afdbbf	rc: add osVersion, osKernel and osArch to core/version ... This makes it return the same info as `rclone version`	2025-11-12 11:16:48 +00:00
n4n5	8335596207	rc: add jobs stats	2025-11-05 12:36:39 +00:00
Nick Craig-Wood	05d54a95b8	accounting: add AccountReadN for use in cluster	2025-11-03 14:44:39 +00:00
Nick Craig-Wood	f16b39165b	fs: add NonDefaultRC for discovering options in use ... This enables us to send rc messages with the config in use.	2025-11-03 14:44:39 +00:00
Nick Craig-Wood	86edb26fd5	fs: move tests into correct files	2025-11-03 14:44:39 +00:00
Nick Craig-Wood	203e1bdbf9	rc: add NewJobFromBytes for reading jobs from non HTTP transactions	2025-11-03 14:44:39 +00:00
Nick Craig-Wood	a522c056fe	rc: add job/batch for sending batches of rc commands to run concurrently	2025-11-03 14:44:39 +00:00
albertony	d240d044c3	check: improved reporting of differences in sizes and contents ... fixes rclone check --download not showing differing files	2025-11-01 19:23:01 +00:00
albertony	7672c3d586	docs: fix various markdownlint issues	2025-11-01 18:54:19 +01:00
Fawzib Rojas	409dc75328	accounting: add io.Seeker/io.ReaderAt support to accounting.Account ... This is a pass through implementation which will fail if the underlying reader does not have the interface.	2025-10-30 16:20:48 +00:00
Nick Craig-Wood	fb30c5f8dd	operations: add ReadAt method to ReOpen	2025-10-30 16:20:48 +00:00
dulanting	87b71dd6b9	refactor: use strings.Builder to improve performance	2025-10-29 16:48:34 +00:00
Lakshmi-Surekha	ed87f82d21	build: enable support for aix/ppc64 ... * Adds "aix/ppc64" to the cross-compile target list. * Including AIX in the build tag of "metadata_other.go". * Excluding AIX from the main ncdu build tags. * Marking AIX as an unsupported platform for ncdu. * Excluding AIX from the fallback redirect implementation. * Excluding AIX from unix build tags to avoid undefined unix.WNOHANG.	2025-10-27 13:34:58 +00:00
Aneesh Agrawal	70d2fe6568	fs: remove unnecessary Seek call on log file ... We were seeing a (non-fatal) error in our logs: ``` Failed to seek log file to end: seek /proc/1/fd/1: illegal seek ``` Because we open the log file with O_APPEND, we don't need to manually seek to the end. As https://pkg.go.dev/os#File.Seek also confirms that the behavior of `Seek` is not specified if the file has been opened with O_APPEND, remove the `Seek` call.	2025-10-25 19:38:57 +01:00
dougal	f28c83c6de	s3: make it easier to add new S3 providers ... Before this change, you had to modify a fragile data-structure containing all providers. This often led to things being out of order, duplicates and conflicts whilst merging. As well as the changes for one provider being in different places across the file. After this change, new providers are defined in an easy to edit YAML file, one per provider. The config output has been tested before and after for all providers and any changes are cosmetic only.	2025-10-25 19:37:29 +01:00
Oleksandr Redko	c8a834f0e8	build: enable all govet checks (except fieldalignment and shadow) and fix issues.	2025-10-22 18:37:58 +01:00
Nick Craig-Wood	b272c50c4c	march: fix --no-traverse being very slow - fixes #8860 ... Before this change --no-traverse was calling NewObject on directories (where it would always fail) as well as files. This was very noticeable when doing syncs with --max-age which were only transferring a small number of objects. This should have been very quick, but the NewObject calls for each directory slowed the sync down a lot. This changes replaces the check to see if the source entry is an Object that got missed out from this commit: 88e30eecbf march: fix deadlock when using --no-traverse - fixes #8656	2025-10-22 14:14:52 +01:00
vastonus	c4eef3065f	build: remove obsolete build tag	2025-10-21 18:56:06 +01:00
albertony	54e8bb89f7	docs: use the term backend name instead of fs name for authorize command	2025-10-02 18:46:16 +02:00
Nick Craig-Wood	72437a9ca2	config: add more human readable configmap.Simple output ... Before this, String() quoted every part of the config map even if it wasn't necessary. The new Human() method removes the quoting and adds the special case for "true" values.	2025-10-02 17:30:08 +01:00
juejinyuxitu	7e30665102	refactor: use strings.FieldsFuncSeq to reduce memory allocations ... Signed-off-by: juejinyuxitu <juejinyuxitu@outlook.com>	2025-09-26 15:12:53 +01:00
Nick Craig-Wood	d44957a09c	accounting: add SetMaxCompletedTransfers method to fix bisync race #8815 ... Before this change bisync adjusted the global MaxCompletedTransfers variable which caused races. This adds a SetMaxCompletedTransfers method and uses it in bisync. The MaxCompletedTransfers global becomes the default. This can be changed externally if rclone is in use as a library, and the commit history indicates that MaxCompletedTransfers was added for exactly this purpose so we try not to break it here.	2025-09-26 14:54:47 +01:00
Nick Craig-Wood	37524e2dea	accounting: add RemoveDoneTransfers method to fix bisync race #8815 ... Before this change bisync was adjusting MaxCompletedTransfers in order to clear the done transfers from the stats. This wasn't working (because it was only clearing one transfer) and was part of a race adjusting MaxCompletedTransfers. This fixes the problem by introducing a new method RemoveDoneTransfers to clear the done transfers explicitly and calling it in bisync.	2025-09-26 14:54:47 +01:00
Nick Craig-Wood	4fc4898287	march: fix deadlock when using --fast-list on syncs - fixes #8811 ... Before this change, it was possible to have a deadlock when using --fast-list for a sync if both the source and destination supported ListR. This fixes the problem by shortening the locking window.	2025-09-15 12:55:29 +01:00
Nick Craig-Wood	71b9b4ad7a	build: use sequence Split introduced in go1.24	2025-09-15 12:45:57 +01:00
Nick Craig-Wood	4368863fcb	build: use "for i := range n", added in go1.22	2025-09-15 12:45:57 +01:00
Nick Craig-Wood	04d49bf0ea	build: modernize benchmark usage	2025-09-15 12:45:57 +01:00
Nick Craig-Wood	d7aa37d263	build: in tests use t.Context, added in go1.24	2025-09-15 12:45:57 +01:00
Nick Craig-Wood	379dffa61c	build: replace interface{} by the 'any' type added in go1.18	2025-09-15 12:45:57 +01:00
russcoss	d6f5652b65	build: remove x := x made unnecessary by the new semantics of loops in go1.22 ... Signed-off-by: russcoss <russcoss@outlook.com>	2025-09-14 15:58:20 +01:00
Nick Craig-Wood	c5a3e86df8	operations: fix partial name collisions for non --inplace copies ... In this commit: c63f1865f3 operations: copy: generate stable partial suffix We made the partial suffix for non inplace copies stable. This was a hash based off the file fingerprint. However, given a directory of files which have the same fingerprint the partial suffix collides. On some backends (eg the local backend) the fingerprint is just the size and modification time so files with different contents can collide. The effect of collisions was hash failures on copy when using --transfers > 1. These copies invariably retried successfully which probably explains why this bug hasn't been reported. This fixes the problem by adding the file name to the hash. It also makes sure the hash is always represented as 8 hex bytes for consistency.	2025-09-05 16:09:46 +01:00
Motte	89a8ea7a91	lsf: add support for unix and unixnano time formats	2025-08-28 16:28:49 +01:00
albertony	c8912eb6a0	docs: remove broken links from rc to commands	2025-08-28 11:52:18 +02:00
albertony	01674949a1	hashsum: changed output format when listing algorithms	2025-08-27 23:36:28 +02:00
albertony	2e02d49578	docs: fix markdown lint issues in command docs	2025-08-26 12:04:00 +02:00
Nick Craig-Wood	1aaee9edce	Start v1.72.0-DEV development	2025-08-22 17:42:25 +01:00