github.com/ncw/rclone/cmd/dedupe

"rsync for cloud storage" - Google Drive, Amazon Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Cloudfiles, Google Cloud Storage, Yandex Files


Keywords
amazon-drive, azure-blob, backblaze-b2, cloud-storage, dropbox, encryption, ftp, fuse-filesystem, go, golang, google-cloud-storage, google-drive, hubic, onedrive, openstack-swift, rclone, s3, sftp, sync, webdav
License
MIT
Install
go get github.com/ncw/rclone/cmd/dedupe

Documentation

Logo

Website | Documentation | Contributing | Changelog | Installation | G+

Build Status Windows Build Status GoDoc

Rclone is a command line program to sync files and directories to and from

  • Google Drive
  • Amazon S3
  • Openstack Swift / Rackspace cloud files / Memset Memstore
  • Dropbox
  • Google Cloud Storage
  • Amazon Cloud Drive
  • Microsoft One Drive
  • Hubic
  • Backblaze B2
  • Yandex Disk
  • The local filesystem

Features

  • MD5/SHA1 hashes checked at all times for file integrity
  • Timestamps preserved on files
  • Partial syncs supported on a whole file basis
  • Copy mode to just copy new/changed files
  • Sync (one way) mode to make a directory identical
  • Check mode to check for file hash equality
  • Can sync to and from network, eg two different cloud accounts

See the home page for installation, usage, documentation, changelog and configuration walkthroughs.

License

This is free software under the terms of MIT the license (check the COPYING file included in this package).