[Borgbackup] Data integrity error: Invalid segment entry size 0 - too small

[Michael Siepmann]

On 3/8/19 1:04 PM, Sascha Ternes wrote:
> Am 08.03.19 um 20:17 schrieb Michael Siepmann:
>> On 3/8/19 9:30 AM, Sascha Ternes wrote:
>>> Am 08.03.19 um 16:37 schrieb Michael Siepmann:
>>>> I tried "borg -v check --repository-only $REPOSITORY" before, without
>>>> the repair option, and it did nothing beyond saying "Starting repository
>>>> check" for many hours. I'm running that again now (without the repair
>>>> option for now). How long might I need to wait to let it complete?
>>> Try borg check with -p / --progress which will give you a percentage
>>> indicator.
>> Thank you. That's very helpful. It's taken 130 min to get to "Checking
>> segments 8.1%" so I can infer it will probably take almost 27 hours in
>> total to finish checking the segments.
> No. This is a file counter. In a repository with much deduplication you
> will have a lot of very small data files ("segments"). These will be
> checked very fast, compared to the big segments of your very first
> archive in this repository. I guess it will take much less than 27 hours.

It took about 20 hours and said this:

===

Starting repository check
Data integrity error: Invalid segment entry size 0 - too small [segment
253305, offset 2331522]                                           
attempting to recover /mnt/synology/Qubes-personal/data/25/253305
Starting repository index
check                                                                                                           

Completed repository check, errors found and repaired.

===

I then tried running my backup script again and this time it ended with
this error:

===

Pruning archive: personal-2018-07-20_T15:00          Fri, 2018-07-20
15:00:16
[7f3e8e3477faf30de92fefec41baf2243045c085b8a957b9d764a63202ad16a8] (955/982)
Object with key
aaffc27b2efdca19941a533c2d62644e9d1bfb9867f030378eca7df6c9e5df1f not
found in repository /mnt/synology/Qubes-personal.
Traceback (most recent call last):
  File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 4436,
in main
    exit_code = archiver.run(args)
  File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 4368,
in run
    return set_ec(func(args))
  File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 152,
in wrapper
    return method(self, args, repository=repository, **kwargs)
  File "/usr/lib64/python3.7/site-packages/borg/archiver.py", line 1590,
in do_prune
    Archive(repository, key, manifest, archive.name,
cache).delete(stats, forced=args.forced)
  File "/usr/lib64/python3.7/site-packages/borg/archive.py", line 809,
in delete
    chunk_decref(chunk_id, stats)
  File "/usr/lib64/python3.7/site-packages/borg/archive.py", line 786,
in chunk_decref
    self.cache.chunk_decref(id, stats, wait=False)
  File "/usr/lib64/python3.7/site-packages/borg/cache.py", line 925, in
chunk_decref
    self.repository.delete(id, wait=wait)
  File "/usr/lib64/python3.7/site-packages/borg/repository.py", line
1110, in delete
    raise self.ObjectNotFound(id, self.path) from None
borg.repository.Repository.ObjectNotFound: Object with key
aaffc27b2efdca19941a533c2d62644e9d1bfb9867f030378eca7df6c9e5df1f not
found in repository /mnt/synology/Qubes-personal.

Platform: Linux personal 4.14.74-1.pvops.qubes.x86_64 #1 SMP Mon Oct 8
17:14:24 UTC 2018 x86_64
Linux: Fedora 29 Twenty Nine
Borg: 1.1.8  Python: CPython 3.7.2
PID: 17824  CWD: /home/user/Apps/ScriptsByMMS
sys.argv: ['/usr/bin/borg', 'prune', '-v', '--list',
'/mnt/synology/Qubes-personal', '--prefix', '{hostname}-',
'--keep-hourly=24', '--keep-daily=7', '--keep-weekly=6', '--keep-monthly=9']
SSH_ORIGINAL_COMMAND: None

===

Any suggestions anyone has on what to do next would be much appreciated.
Thanks!