github.com/rclone/rclone

See commits

• New backends

• Pikpak (wiserain)

• New S3 providers

• petabox.io (Andrei Smirnov)

• Google Cloud Storage (Anthony Pessy)

• New WebDAV providers

• Fastmail (Arnavion)

• Major changes

• Files will be copied to a temporary name ending in .partial when copying to local , ftp , sftp then renamed at the end of the transfer. (Janne Hellsten, Nick Craig-Wood)

• This helps with data integrity as we don't delete the existing file until the new one is complete.

• It can be disabled with the --inplace flag.

• This behaviour will also happen if the backend is wrapped, for example sftp wrapped with crypt .

• The s3 , azureblob and gcs backends now support directory markers so empty directories are supported (Jānis Bebrītis, Nick Craig-Wood)

• The --default-time flag now controls the unknown modification time of files/dirs (Nick Craig-Wood)

• If a file or directory does not have a modification time rclone can read then rclone will display this fixed time instead.

• For the old behaviour use --default-time 0s which will set this time to the time rclone started up.

• New Features

• build

• Modernise linters in use and fixup all affected code (albertony)

• Push docker beta to GHCR (GitHub container registry) (Richard Tweed)

• cat: Add --separator option to cat command (Loren Gordon)

• config

• Do not remove/overwrite other files during config file save (albertony)

• Do not overwrite config file symbolic link (albertony)

• Stop config create making invalid config files (Nick Craig-Wood)

• doc updates (Adam K, Aditya Basu, albertony, asdffdsazqqq, Damo, danielkrajnik, Dimitri Papadopoulos, dlitster, Drew Parsons, jumbi77, kapitainsky, mac-15, Mariusz Suchodolski, Nick Craig-Wood, NickIAm, Rintze Zelle, Stanislav Gromov, Tareq Sharafy, URenko, yuudi, Zach Kipp)

• fs

• Add size to JSON logs when moving or copying an object (Nick Craig-Wood)

• Allow boolean features to be enabled with --disable !Feature (Nick Craig-Wood)

• genautocomplete: Rename to completion with alias to the old name (Nick Craig-Wood)

• librclone: Added example on using librclone with Go (alankrit)

• lsjson: Make --stat more efficient (Nick Craig-Wood)

• operations

• Implement --multi-thread-write-buffer-size for speed improvements on downloads (Paulo Schreiner)

• Reopen downloads on error when using check --download and cat (Nick Craig-Wood)

• rc: config/listremotes includes remotes defined with environment variables (kapitainsky)

• selfupdate: Obey --no-check-certificate flag (Nick Craig-Wood)

• serve restic: Trigger systemd notify (Shyim)

• serve webdav: Implement owncloud checksum and modtime extensions (WeidiDeng)

• sync: --suffix-keep-extension preserve 2 part extensions like .tar.gz (Nick Craig-Wood)

• Bug Fixes

• accounting

• Fix Prometheus metrics to be the same as core/stats (Nick Craig-Wood)

• Bwlimit signal handler should always start (Sam Lai)

• bisync: Fix maxDelete parameter being ignored via the rc (Nick Craig-Wood)

• cmd/ncdu: Fix screen corruption when logging (eNV25)

• filter: Fix deadlock with errors on --files-from (douchen)

• fs

• Fix interaction between --progress and --interactive (Nick Craig-Wood)

• Fix infinite recursive call in pacer ModifyCalculator (fixes issue reported by the staticcheck linter) (albertony)

• lib/atexit: Ensure OnError only calls cancel function once (Nick Craig-Wood)

• lib/rest: Fix problems re-using HTTP connections (Nick Craig-Wood)

• rc

• Fix operations/stat with trailing / (Nick Craig-Wood)

• Fix missing --rc flags (Nick Craig-Wood)

• Fix output of Time values in options/get (Nick Craig-Wood)

• serve dlna: Fix potential data race (Nick Craig-Wood)

• version: Fix reported os/kernel version for windows (albertony)

• Mount

• Add --mount-case-insensitive to force the mount to be case insensitive (Nick Craig-Wood)

• Removed unnecessary byte slice allocation for reads (Anagh Kumar Baranwal)

• Clarify rclone mount error when installed via homebrew (Nick Craig-Wood)

• Added _netdev to the example mount so it gets treated as a remote-fs rather than local-fs (Anagh Kumar Baranwal)

• Mount2

• Updated go-fuse version (Anagh Kumar Baranwal)

• Fixed statfs (Anagh Kumar Baranwal)

• Disable xattrs (Anagh Kumar Baranwal)

• VFS

• Add MkdirAll function to make a directory and all beneath (Nick Craig-Wood)

• Fix reload: failed to add virtual dir entry: file does not exist (Nick Craig-Wood)

• Fix writing to a read only directory creating spurious directory entries (WeidiDeng)

• Fix potential data race (Nick Craig-Wood)

• Fix backends being Shutdown too early when startup takes a long time (Nick Craig-Wood)

• Local

• Fix filtering of symlinks with -l / --links flag (Nick Craig-Wood)

• Fix /path/to/file.rclonelink when -l / --links is in use (Nick Craig-Wood)

• Fix crash with --metadata on Android (Nick Craig-Wood)

• Cache

• Fix backends shutting down when in use when used via the rc (Nick Craig-Wood)

• Crypt

• Add --crypt-suffix option to set a custom suffix for encrypted files (jladbrook)

• Add --crypt-pass-bad-blocks to allow corrupted file output (Nick Craig-Wood)

• Fix reading 0 length files (Nick Craig-Wood)

• Try not to return "unexpected EOF" error (Nick Craig-Wood)

• Reduce allocations (albertony)

• Recommend Dropbox for base32768 encoding (Nick Craig-Wood)

• Azure Blob

• Empty directory markers (Nick Craig-Wood)

• Support azure workload identities (Tareq Sharafy)

• Fix azure blob uploads with multiple bits of metadata (Nick Craig-Wood)

• Fix azurite compatibility by sending nil tier if set to empty string (Roel Arents)

• Combine

• Implement missing methods (Nick Craig-Wood)

• Fix goroutine stack overflow on bad object (Nick Craig-Wood)

• Drive

• Add --drive-env-auth to get IAM credentials from runtime (Peter Brunner)

• Update drive service account guide (Juang, Yi-Lin)

• Fix change notify picking up files outside the root (Nick Craig-Wood)

• Fix trailing slash mis-identification of folder as file (Nick Craig-Wood)

• Fix incorrect remote after Update on object (Nick Craig-Wood)

• Dropbox

• Implement --dropbox-pacer-min-sleep flag (Nick Craig-Wood)

• Fix the dropbox batcher stalling (Misty)

• Fichier

• Add --ficicher-cdn option to use the CDN for download (Nick Craig-Wood)

• FTP

• Lower log message priority when SetModTime is not supported to debug (Tobias Gion)

• Fix "unsupported LIST line" errors on startup (Nick Craig-Wood)

• Fix "501 Not a valid pathname." errors when creating directories (Nick Craig-Wood)

• Google Cloud Storage

• Empty directory markers (Jānis Bebrītis, Nick Craig-Wood)

• Added --gcs-user-project needed for requester pays (Christopher Merry)

• HTTP

• Add client certificate user auth middleware. This can auth serve restic from the username in the client cert. (Peter Fern)

• Jottacloud

• Fix vfs writeback stuck in a failed upload loop with file versioning disabled (albertony)

• Onedrive

• Add --onedrive-av-override flag to download files flagged as virus (Nick Craig-Wood)

• Fix quickxorhash on 32 bit architectures (Nick Craig-Wood)

• Report any list errors during rclone cleanup (albertony)

• Putio

• Fix uploading to the wrong object on Update with overridden remote name (Nick Craig-Wood)

• Fix modification times not being preserved for server side copy and move (Nick Craig-Wood)

• Fix server side copy failures (400 errors) (Nick Craig-Wood)

• S3

• Empty directory markers (Jānis Bebrītis, Nick Craig-Wood)

• Update Scaleway storage classes (Brian Starkey)

• Fix --s3-versions on individual objects (Nick Craig-Wood)

• Fix hang on aborting multipart upload with iDrive e2 (Nick Craig-Wood)

• Fix missing "tier" metadata (Nick Craig-Wood)

• Fix V3sign: add missing subresource delete (cc)

• Fix Arvancloud Domain and region changes and alphabetise the provider (Ehsan Tadayon)

• Fix Qiniu KODO quirks virtualHostStyle is false (zzq)

• SFTP

• Add --sftp-host-key-algorithms to allow specifying SSH host key algorithms (Joel)

• Fix using --sftp-key-use-agent and --sftp-key-file together needing private key file (Arnav Singh)

• Fix move to allow overwriting existing files (Nick Craig-Wood)

• Don't stat directories before listing them (Nick Craig-Wood)

• Don't check remote points to a file if it ends with / (Nick Craig-Wood)

• Sharefile

• Disable streamed transfers as they no longer work (Nick Craig-Wood)

• Smb

• Code cleanup to avoid overwriting ctx before first use (fixes issue reported by the staticcheck linter) (albertony)

• Storj

• Fix "uplink: too many requests" errors when uploading to the same file (Nick Craig-Wood)

• Fix uploading to the wrong object on Update with overridden remote name (Nick Craig-Wood)

• Swift

• Ignore 404 error when deleting an object (Nick Craig-Wood)

• Union

• Implement missing methods (Nick Craig-Wood)

• Allow errors to be unwrapped for inspection (Nick Craig-Wood)

• Uptobox

• Add --uptobox-private flag to make all uploaded files private (Nick Craig-Wood)

• Fix improper regex (Aaron Gokaslan)

• Fix Update returning the wrong object (Nick Craig-Wood)

• Fix rmdir declaring that directories weren't empty (Nick Craig-Wood)

• WebDAV

• nextcloud: Add support for chunked uploads (Paul)

• Set modtime using propset for owncloud and nextcloud (WeidiDeng)

• Make pacer minSleep configurable with --webdav-pacer-min-sleep (ed)

• Fix server side copy/move not overwriting (WeidiDeng)

• Fix modtime on server side copy for owncloud and nextcloud (Nick Craig-Wood)

• Yandex

• Fix 400 Bad Request on transfer failure (Nick Craig-Wood)

• Zoho

• Fix downloads with Range: header returning the wrong data (Nick Craig-Wood)

See commits

• Bug Fixes

• docker volume plugin: Add missing fuse3 dependency (Nick Craig-Wood)

• docs: Fix size documentation (asdffdsazqqq)

• FTP

• Fix 426 errors on downloads with vsftpd (Lesmiscore)

See commits

• Bug Fixes

• docker: Add missing fuse3 dependency (cycneuramus)

• build: Update release docs to be more careful with the tag (Nick Craig-Wood)

• build: Set Github release to draft while uploading binaries (Nick Craig-Wood)