[Borgbackup] Data integrity error: Invalid segment entry size 0 - too small
Michael Siepmann
MS at TechDesignPsych.com
Thu Mar 7 11:57:16 EST 2019
I've been using borgbackup for a while without problems but now have an issue I'm unsure how to fix despite looking through the documentation. I'd very much appreciate any help anyone can offer. The two symptoms of the problem are that the backup used to take only a few minutes but now takes over an hour, and that the log shows a data integrity error.
Below is an abbreviated copy of the log, noting where I've edited out large numbers of similar lines:
Many thanks in advance,
Michael Siepmann
---
Creating archive at "/mnt/synology/Qubes-personal::{hostname}-{now:%Y-%m-%d_T%H:%M}"
Synchronizing chunks cache...
Archives: 1026, w/ cached Idx: 0, w/ outdated Idx: 0, w/o cached Idx: 1026.
Fetching and building archive index for personal-2017-09-30_T16:00 ...
Merging into master chunks index ...
Fetching and building archive index for personal-2017-10-31_T22:00 ...
<editing out many similar instances...>
Merging into master chunks index ...
Fetching and building archive index for personal-2019-03-01_T07:52 ...
Merging into master chunks index ...
Done.
------------------------------------------------------------------------------
Archive name: personal-2019-03-06_T07:28
Archive fingerprint: 76673c3396fc9ee3f74f927b75e0c7ce0c8d76c7b953469a09c160d2d827fc12
Time (start): Wed, 2019-03-06 07:28:18
Time (end): Wed, 2019-03-06 08:15:13
Duration: 46 minutes 55.46 seconds
Number of files: 169474
Utilization of max. archive size: 0%
------------------------------------------------------------------------------
Original size Compressed size Deduplicated size
This archive: 109.52 GB 91.18 GB 3.15 GB
All archives: 108.63 TB 90.24 TB 335.80 GB
Unique chunks Total chunks
Chunk index: 510924 211576111
------------------------------------------------------------------------------
Keeping archive: personal-2019-03-06_T07:28 Wed, 2019-03-06 07:28:18 [76673c3396fc9ee3f74f927b75e0c7ce0c8d76c7b953469a09c160d2d827fc12]
<editing out several similar instances...>
Keeping archive: personal-2019-02-14_T12:00 Thu, 2019-02-14 12:00:10 [720753a98c0b33243dd8f1407ea54159833af9691ae4324f1f7ad6149205c1aa]
Pruning archive: personal-2019-02-14_T10:00 Thu, 2019-02-14 10:00:13 [08cf1a86db65c55cfeeecaab1c6977f7f2baf37e8c6c9803ca3334bd26b9adfc] (1/981)
<editing out many similar instances - looks like there are 981, but after it gets to 954 there's an error...>
Pruning archive: personal-2018-07-20_T15:00 Fri, 2018-07-20 15:00:16 [7f3e8e3477faf30de92fefec41baf2243045c085b8a957b9d764a63202ad16a8] (954/981)
Data integrity error: Invalid segment entry size 0 - too small [segment 253305, offset 2331522]
Traceback (most recent call last):
File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 4436, in main
exit_code = archiver.run(args)
File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 4368, in run
return set_ec(func(args))
File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 152, in wrapper
return method(self, args, repository=repository, **kwargs)
File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 1590, in do_prune
Archive(repository, key, manifest, archive.name, cache).delete(stats, forced=args.forced)
File "/usr/lib64/python3.7/site-packages/borg/archive.py", line 809, in delete
chunk_decref(chunk_id, stats)
File "/usr/lib64/python3.7/site-packages/borg/archive.py", line 786, in chunk_decref
self.cache.chunk_decref(id, stats, wait=False)
File "/usr/lib64/python3.7/site-packages/borg/cache.py", line 925, in chunk_decref
self.repository.delete(id, wait=wait)
File "/usr/lib64/python3.7/site-packages/borg/repository.py", line 1113, in delete
size = self.io.read(segment, offset, id, read_data=False)
File "/usr/lib64/python3.7/site-packages/borg/repository.py", line 1392, in read
size, tag, key, data = self._read(fd, self.put_header_fmt, header, segment, offset, (TAG_PUT, ), read_data)
File "/usr/lib64/python3.7/site-packages/borg/repository.py", line 1419, in _read
size, segment, offset))
borg.helpers.IntegrityError: Data integrity error: Invalid segment entry size 0 - too small [segment 253305, offset 2331522]
Platform: Linux personal 4.14.74-1.pvops.qubes.x86_64 #1 SMP Mon Oct 8 17:14:24 UTC 2018 x86_64
Linux: Fedora 29 Twenty Nine
Borg: 1.1.8 Python: CPython 3.7.2
PID: 12045 CWD: /home/user/Apps/ScriptsByMMS
sys.argv: ['/usr/bin/borg', 'prune', '-v', '--list', '/mnt/synology/Qubes-personal', '--prefix', '{hostname}-', '--keep-hourly=24', '--keep-daily=7', '--keep-weekly=6', '--keep-monthly=9']
SSH_ORIGINAL_COMMAND: None
More information about the Borgbackup
mailing list