[Borgbackup] Slow backup speed

[Sebastian Pölsterl]

Thanks for the suggestions so far. I'm going to experiment a little bit 
and see how things go.

Unfortunately, I can't install software on the client, therefore I need 
to pull the backup. Were you referring to using sshfs instead of a NFS 
mount on the server?

-- 
Sebastian

Am 30.10.2018 um 20:40 schrieb Marc Pope:
> What about running it from the client? NFS overhead is likely the 
> problem. You could run it using a ssh command to the client from the 
> server.
> 
> On Oct 30, 2018, at 1:59 PM, Zack Coffey <clickwir at gmail.com 
> <mailto:clickwir at gmail.com>> wrote:
> 
>> I think you are right, it's not a bandwidth issue. But NFS dealing 
>> with that many small functions may be the bottleneck.
>>
>> I've seen NFS be the bottleneck many times when dealing with large 
>> amounts of small files or small changes. Big file transfers, it 
>> blazes. Tons of tiny ones, grinds to a halt. Some NFS mount tweaks can 
>> help that though.
>>
>> On Tue, Oct 30, 2018 at 2:55 AM Sebastian Pölsterl <sebp at k-d-w.org 
>> <mailto:sebp at k-d-w.org>> wrote:
>>
>>     Hi,
>>
>>     I'm using borg via borgmatic to backup of about 10TB of data. Since
>>     incremental backups take about 13 hours, I was wondering if
>>     there's any
>>     configuration option that can be used to speed things up, or if 13
>>     hours
>>     is an expected duration.
>>
>>     In total, the volume contains about 25 million files, but changes are
>>     rare. Backups are created daily and are carried out over a gigabit
>>     network connection with the client's disk mounted via NFS on the
>>     server
>>     running borg. Backups are created with --files-cache ctime,size
>>     and lz4
>>     compression. Based on monitoring bandwidth usage, I would say that
>>     network bandwidth is not the bottleneck.
>>
>>     Is there any configuration option I have been missing so far that
>>     could
>>     help to speed up daily backups?
>>
>>     Thanks for your help!
>>
>>     -- 
>>     Sebastian
>>     _______________________________________________
>>     Borgbackup mailing list
>>     Borgbackup at python.org <mailto:Borgbackup at python.org>
>>     https://mail.python.org/mailman/listinfo/borgbackup
>>
>> _______________________________________________
>> Borgbackup mailing list
>> Borgbackup at python.org <mailto:Borgbackup at python.org>
>> https://mail.python.org/mailman/listinfo/borgbackup