[Borgbackup] performance problem
Giuseppe Arvati
giuseppe.arvati at gmail.com
Fri Aug 25 06:02:08 EDT 2017
Hello,
I’m trying to use borg as backup tool for a file server but I’m not able
to finish the backup during the night. The server is an Proliant 8 core
Intel(R) Xeon(R) E5540 @ 2.53GHz with raid 5 scsi controller. Borg
version is 1.0.11
I have mainly 3 directory to back up:
184G /dati/utenti
354G /dati/gruppi
90G /dati/passa
and I would to backup all three directory every day between 23:00 and
4:00 ( but it can be 22:00 – 5:00 ). Now I use rsync to copy new o
modified files on NAS and it take about 30 minutes to complete but I do
not have an history and a deduplication.
The first directory one take about 11 hours to backup 184GB so is not
possible to complete all 3 directory during the night.
I tried first to backup on NAS connected via 1Gb NSF link without
compression and encryption and I create 2 archive:
utenti-2017-07-06 Thu, 2017-07-06 19:00:01
utenti-2017-07-19 Wed, 2017-07-19 15:03:46
the first archive took about 14 hours to finish
the second archive took about 9 hours to finish
too slow!!
So I thought was a link performance problem and I tried again on local
storage but without important improvement.
Command line: /usr/bin/borg create -v --stat ::utenti-{now:%Y-%m-%d}
/dati/utenti
utenti-2017-07-25 Tue, 2017-07-25 13:05:00
utenti-2017-07-26 Wed, 2017-07-26 19:00:00
utenti-2017-08-24 Thu, 2017-08-24 13:00:00
the 1st archive took about 12 hours to finish
the 2nd archive took about 11 hours to finish
the 3rd archive took about 11 hours to finish with with –ignore-inode
too slow again !!
185 GB of data aren’t a big archive and I think borg generally works
faster than I experienced.
Where are my mistakes ? Missing options, error during archive init
phase, server performance, …
What can I test ?
Thank you for any hints
Giuseppe
More information about the Borgbackup
mailing list