Existing tools

Existing Backup/Archival tools


This is a listing of different types of solutions that you can use as part of an archival strategy.

Private Backup Sync

  1. Syncthing 
    • Syncthing is a continuous file synchronization program. It synchronizes files between two or more computers in real time, safely protected from prying eyes.
  2. Seafile
    • Seafile is an open source, self-hosted file sync and share solution with high performance and reliability
  3. Gluster, 
    • GlusterFS is a scalable network filesystem suitable for data-intensive tasks such as cloud storage and media streaming
  4. Upspin (open-source)
    • a set of protocols enabling secure, federated sharing using a global naming system; and
    • reference implementations of tools and services that demonstrate the capabilities.
  5. Resilio 
    • "Fast and reliable file and folder synchronization solution for individuals" based on the bittorrent P2P protocol. Some NAS devices can run Resilio.
  6. Owncloud 
    • ownCloud is a 100% open source, self-hosted file sync and share app platform. Access & sync your files, contacts, calendars & bookmarks across your devices.
  7. File Stash
    • Manage your files from a browser to/from independent backend systems (S3, Mysql Storj, Backblaze B2, etc)
    • Sharing
    • Media viewing and transcoding

Content addressable sync


Similar to the "Private Backup Sync", but have more features for decentralization and metadata control.

  1. Perkeep 
    • A decentralized sharing system that can chain together updates on social media to files on disk to updates in a web browser (amongst many other impressive things)
  2. IPFS 
    1. A cooperative storage cloud designed for unlimited peers.

Distributed archive file systems

Basic Cloud Sync

Cloud storage is aimed at the mass market that minimises cost per byte, whilst supporting an ecosystem of solutions that operate one it.

1. OneDrive uses a tiered storage pricing model, so very nearly discounting it as a useful solution except that it's initial tier is free.
2. Backblaze limits the number of USB you can attach.

  1. Google Backup and Sync
    • Connects with google drive for diverse document-handling needs
  2. Backblaze B2
    • Among the cheapest solutions, a similar pricing model to Wasabi..
  3. Backblaze 
    • Super simple and cheap personal backup (also supports encryption).
  4. Wasabi 
    • Among the cheapest solutions, a similar pricing model and concept to Backblaze.
  5. Onedrive 
    • A variety of support models linked to Microsoft Office.
  6. Amazon S3 
    • Super high file durability, technically powerful ecosystem.
    • Multiple pricing tiers, with glacier being the most competitive per GB
  7. Carbonite Basic
    • Its a good backup tool; compared to the others, it tries to make sensible decisions about what it does.

Cloud Sync with Zero Knowledge Encryption

Cloud storage with limited ecosystems for features but with in-built control over the encryption key.

  1. pcloud.com 
    • pCloud is a virtual file system that downloads files from the cloud on demand. "Develop your ideas on your PC without taking actual HDD space with pCloud Drive"
  2. sync.com
    • Keep your files safe, secure, and private. The guy from _Cloudwards says that this is his favourite cloud storage solution.
  3. Carbonite
    • "Automatic cloud backup for your files, photos and more"
  4. Idrive 
    • Backup software with a huge numbers of different features.
    • Real Time Backup, retrieval Data, share, Office 365, Security And Privacy.
  5. Tresorit
    • End-to-end encrypted file sync & sharing for IT pros who want to take control
  6. SpiderOak
    • SpiderOak protects your group messaging, file sharing, and file backups with end-to-end encryption to keep you safe from privacy intrusions, ransomware, and data loss.

Cloud + Local Backup

These services unify multiple cloud storage tools and keep a local copy on usb/NAS. They also provide zero knowledge encryption.


  1. Arqbackup
    • `Technical documentation <https://www.arqbackup.com/documentation/>`_ is great.
  2. Goodsync
    • Technically speaking the best archive solution I’ve seen, but is quite complex. One off $30 license fee
  3. Opendedup 
    • Open source solution. Fairly low level system for shipping files between cloud and local disk. Could act as a great basis for an archive system.
  4. Odrive 
    • Has a powerful system for managing a cached virtual drive. USB/NAS can act as sync sources. $8.25 per month for premium.
  5. Sync Thing
  6. Barracuda
  7. Carbonite Business

File Metadata Systems

---------------------
These systems are not backup tools, but they help to manage file metadata which is useful for archival.

  1. tmsu
    1. TMSU is a command-line tool for applying tags and a virtual filesystem so that you can get a tag-based view of your files from within any other program.
  2. Tagsistant
    1. Tagsistant is a tag-based filesystem for Linux that turns directories into tags and search your files for you.

File Management Systems

These systems act like intermediaries for other storage systems
  1. File Stash (as above)
    • Manage your files from a browser to/from independent backend systems (S3, Mysql Storj, Backblaze B2, etc)
    • Sharing
    • Media viewing and transcoding

Enterprise Backup Systems

This is a list of some enterprise backup systems. They tend to be quite expensive and difficult to manage, but will all achieve some sort of incremental backup and point in time recovery for individual files.

  1. Dell EMC Data Domain (an appliance)
  2. IBM Spectrum Archive (tape storage)
  3. HPE StoreOnce (appliance)
  4. Quantum LTO (tape storage)
  5. Veritas NetBackup (complex pricing model)
  6. Veritas Backup Exec (complex pricing model)
  7. Veeam Backup & Replication (reasonably priced backup and recovery that can cope with backup for specific products like Exchange)
  8. Arcserve UDP (its a data protection platform designed for recovery from worst case scenarios)
  9. Rubrik Cloud Data Management (seems the most advanced out of all of them technically, its easier to add new servers and configure policy)
  10. Commvault Simpana (pricing seems high, but has some specific features)

Simple Data Workflow tools

This list is focused on simple workflow tools purely focused on groups of data.
  • Collibra: a data governance and management platform
  • Informatica: a data integration and management platform
  • Ansarada: a data share review platform. It includes some redaction and reporting capabilities beyond just data sharing.


Comments

Post a Comment