Highly efficient backup system for virtual machines and databases

Development of a large-scale backup system for virtual machines. The implementation of this system reduced the cost of storing backup copies by up to 75%!

Objective

The goal was to create an efficient backup system capable of reading data in real-time from the disks of virtual machines across several hundred servers and transferring it to a backup servers.

Researched

Used technologies

Backup Architecture

Backup Details

Outcomes

This project successfully established a robust and scalable backup solution, enhancing data security and recovery capabilities across a large server network. The use of open-source tools like Restic and the ZFS file system, combined with the orchestration power of Kubernetes, resulted in a highly reliable and efficient backup system suitable for virtual machines backed by block storage.

The same approach was later adapted for the efficient backup of databases, demonstrating its versatility and scalability.