<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>Yet another test run, same backup on ARM but using zlib
compression and I get an inconsistency.<br>
</p>
<p># borg check -v usr-local3<br>
Starting repository check<br>
Completed repository check, no problems found.<br>
Starting archive consistency check...<br>
Enter passphrase for key /big/h/usr-local3:<br>
Analyzing archive usr-local-2016-06-20 (1/1)<br>
Archive consistency check complete, no problems found.<br>
# borg init usr-local4<br>
Enter new passphrase:<br>
Enter same passphrase again:<br>
Do you want your passphrase to be displayed for verification?
[yN]:<br>
# borg create --show-rc --stats -v -e .cache -C zlib
usr-local4::usr-local-2016-06-20 /big/usr-local<br>
Enter passphrase for key /big/h/usr-local4:<br>
------------------------------------------------------------------------------<br>
Archive name: usr-local-2016-06-20<br>
Archive fingerprint:
ab47bdebc8cbed2a04194139a5d0bd8ce5ec639d578cd65276e51fba043fac41<br>
Time (start): Wed, 2016-06-22 06:23:23<br>
Time (end):�� Wed, 2016-06-22 07:19:26<br>
Duration: 56 minutes 3.31 seconds<br>
Number of files: 354059<br>
------------------------------------------------------------------------------<br>
���������������������� Original size����� Compressed size���
Deduplicated size<br>
This archive:��������������� 5.86 GB������������� 2.10
GB������������� 1.63 GB<br>
All archives:��������������� 5.86 GB������������� 2.10
GB������������� 1.63 GB<br>
<br>
���������������������� Unique chunks�������� Total chunks<br>
Chunk index:����������������� 190159�������������� 359426<br>
------------------------------------------------------------------------------<br>
terminating with success status, rc 0<br>
[root@backup h]# borg check -v usr-local4<br>
Starting repository check<br>
Index object count mismatch. 190160 != 190162<br>
Completed repository check, errors found.<br>
<br>
</p>
<br>
<div class="moz-cite-prefix">On 6/21/2016 9:55 PM, Thorsten von
Eicken wrote:<br>
</div>
<blockquote
cite="mid:0100015576765f1c-b3eaf78a-b910-4404-b6e2-4a4b6215d2d9-000000@email.amazonses.com"
type="cite">Yet another test. BTW, would it be better if I opened
a github ticket with all this info? I'm fine either way as long as
it leads to a fix :-)
<br>
<br>
I did the same backup as previously (rsync'ed the data to the ARM
box and ran a local backup with lzma resulting in insonsistencies)
but this time I chose lz4 compression. Guess what... no
inconsistency. OK, sample size is one, so who knows... It can't be
the lzma code itself since that runs on the x86_64 box when doing
a remote backup, so it must be something else around it? Unless
it's just chance...
<br>
<br>
The log of the test is:
<br>
<br>
# borg init usr-local3
<br>
Enter new passphrase:
<br>
Enter same passphrase again:
<br>
Do you want your passphrase to be displayed for verification?
[yN]: n
<br>
# borg create --show-rc --stats -v -e .cache -C lz4
usr-local3::usr-local-2016-06-20 /big/usr-local
<br>
Enter passphrase for key /big/h/usr-local3:
<br>
------------------------------------------------------------------------------
<br>
Archive name: usr-local-2016-06-20
<br>
Archive fingerprint:
7cef44fb78c14ac908b50d4f407e660f680fe95386431c9900fcb6d05d8c23a5
<br>
Time (start): Tue, 2016-06-21 16:15:25
<br>
Time (end):�� Tue, 2016-06-21 16:56:37
<br>
Duration: 41 minutes 11.83 seconds
<br>
Number of files: 354059
<br>
------------------------------------------------------------------------------
<br>
���������������������� Original size����� Compressed size
Deduplicated size
<br>
This archive:��������������� 5.86 GB������������� 2.81
GB������������� 2.24 GB
<br>
All archives:��������������� 5.86 GB������������� 2.81
GB������������� 2.24 GB
<br>
<br>
���������������������� Unique chunks�������� Total chunks
<br>
Chunk index:����������������� 190022�������������� 359242
<br>
------------------------------------------------------------------------------
<br>
terminating with success status, rc 0
<br>
# borg check -v usr-local3
<br>
Starting repository check
<br>
Completed repository check, no problems found.
<br>
Starting archive consistency check...
<br>
Enter passphrase for key /big/h/usr-local3:
<br>
Analyzing archive usr-local-2016-06-20 (1/1)
<br>
Archive consistency check complete, no problems found.
<br>
<br>
How can I help from here on?
<br>
<br>
<br>
On 6/21/2016 9:15 AM, Thorsten von Eicken wrote:
<br>
<blockquote type="cite">
<br>
More tests, looks like borg 1.0.4 with lzma doesn't work on ARM,
or the Arch build is broken. I narrowed the backup that fails to
about 6GB of /usr/local. I did a remote backup x86_64->ARM
and got the usual inconsistency. I then rsync'ed /usr/local to
the ARM box and did a local backup there and got the same
inconsistency. Something I haven't mentioned before is that I
run two other backups x86_64->ARM nightly and they do not
produce inconsistencies, but they also do not use any
compression (they're all compressed media files).
<br>
<br>
I can continue testing various combinations but maybe one of the
borg maintainers has an rPI or ODROID or other ARM box and can
run some tests as well? As far as I can tell you need a dir
structure of some minimum size (I tried something tiny and it
worked fine) and then perform a borg create with lzma.
<br>
<br>
Here's the log:
<br>
<br>
# borg init usr-local2
<br>
Enter new passphrase:
<br>
Enter same passphrase again:
<br>
Do you want your passphrase to be displayed for verification?
[yN]: n
<br>
# borg create --show-rc --stats -v -e .cache -C lzma
usr-local2::usr-local-2016-06-20 /big/usr-local
<br>
Enter passphrase for key /big/h/usr-local2:
<br>
------------------------------------------------------------------------------
<br>
Archive name: usr-local-2016-06-20
<br>
Archive fingerprint:
c2bc42a6f7837cf44ca3e4182ebe2e01437876b3c24a8551668b19dcd9b14ce8
<br>
Time (start): Tue, 2016-06-21 02:54:38
<br>
Time (end):�� Tue, 2016-06-21 08:17:51
<br>
Duration: 5 hours 23 minutes 13.95 seconds
<br>
Number of files: 354059
<br>
------------------------------------------------------------------------------
<br>
����������������������
Original size����� Compressed size���
Deduplicated size
<br>
This archive:��������������� 5.86
GB������������� 1.80
GB������������� 1.35 GB
<br>
All archives:��������������� 5.86
GB������������� 1.80
GB������������� 1.35 GB
<br>
<br>
����������������������
Unique chunks�������� Total chunks
<br>
Chunk index:�����������������
190030�������������� 359279
<br>
------------------------------------------------------------------------------
<br>
terminating with success status, rc 0
<br>
# borg check -v usr-local2
<br>
Starting repository check
<br>
Index object count mismatch. 190031 != 190041
<br>
Completed repository check, errors found.
<br>
<br>
<br>
On 6/20/2016 5:42 AM, <a class="moz-txt-link-abbreviated" href="mailto:public@enkore.de">public@enkore.de</a> wrote:
<br>
<blockquote type="cite">On 06/20/2016 09:27 AM, Thorsten von
Eicken wrote:
<br>
<blockquote type="cite">I'm wondering what to test next. Some
thoughts:
<br>
- rsync the data to the ARM box and perform a local
create/check there
<br>
- nfs mount the data onto the ARM box and perform a local
create/check
<br>
this way
<br>
<br>
Suggestions?
<br>
Thorsten
<br>
</blockquote>
Try (1) first to see whether it's a networking-related issue
or happens
<br>
even with local files.
<br>
<br>
Cheers, Marian
<br>
<br>
_______________________________________________
<br>
Borgbackup mailing list
<br>
<a class="moz-txt-link-abbreviated" href="mailto:Borgbackup@python.org">Borgbackup@python.org</a>
<br>
<a class="moz-txt-link-freetext" href="https://mail.python.org/mailman/listinfo/borgbackup">https://mail.python.org/mailman/listinfo/borgbackup</a>
<br>
</blockquote>
<br>
<br>
<br>
_______________________________________________
<br>
Borgbackup mailing list
<br>
<a class="moz-txt-link-abbreviated" href="mailto:Borgbackup@python.org">Borgbackup@python.org</a>
<br>
<a class="moz-txt-link-freetext" href="https://mail.python.org/mailman/listinfo/borgbackup">https://mail.python.org/mailman/listinfo/borgbackup</a>
<br>
</blockquote>
<br>
_______________________________________________
<br>
Borgbackup mailing list
<br>
<a class="moz-txt-link-abbreviated" href="mailto:Borgbackup@python.org">Borgbackup@python.org</a>
<br>
<a class="moz-txt-link-freetext" href="https://mail.python.org/mailman/listinfo/borgbackup">https://mail.python.org/mailman/listinfo/borgbackup</a>
<br>
</blockquote>
<br>
</body>
</html>