Devuan bug report logs - #197
debmirror fails on packages.devuan.org

Package: amprolla; Maintainer for amprolla is Devuan Developers <devuan-dev@lists.dyne.org>;

Reported by: yeti <yeti@digitalfoto-model-award.de>

Date: Tue, 27 Mar 2018 19:18:01 UTC

Severity: normal

Tags: moreinfo

Done: Daniel Reurich <daniel@centurion.net.nz>

Subject: bug#197: debmirror fails on packages.devuan.org
Reply-To: yeti <yeti@digitalfoto-model-award.de>, 197@bugs.devuan.org
Resent-From: yeti <yeti@digitalfoto-model-award.de>
Resent-To: devuan-bugs@lists.dyne.org
Resent-CC: Daniel Reurich <daniel@centurion.net.nz>
Resent-Date: Tue, 27 Mar 2018 19:18:01 UTC
Resent-Message-ID: <handler.197.B.152217780322253@bugs.devuan.org>
Resent-Sender: owner@bugs.devuan.org
Message-ID: <1522177298.15051.9.camel@digitalfoto-model-award.de>
From: yeti <yeti@digitalfoto-model-award.de>
To: submit@bugs.devuan.org
Date: Tue, 27 Mar 2018 19:01:38 +0000
Content-Type: text/plain; charset="UTF-8"
Mime-Version: 1.0
Content-Transfer-Encoding: quoted-printable

Package: amprolla

--------8<--------8<--------8<--------8<--------8<--------8<--------8<--------
(yeti@kumari:14)/wrk/mirrors$ cat devuan.sh 
#!/bin/sh
exec sudo -u ruth debmirror \
        -a arm64 \
        $(: -d jessie,jessie-backports,jessie-proposed-updates,jessie-security,jessie-updates :) \
        -d ascii,ascii-backports,ascii-proposed-updates,ascii-security,ascii-updates \
        -s main -s contrib -s non-free \
        --nosource \
        --method http -h packages.devuan.org -r merged \
        --progress --no-check-gpg \
        /wrk/mirrors/devuan
(yeti@kumari:14)/wrk/mirrors$ ./devuan.sh 
Mirroring to /wrk/mirrors/devuan from http://packages.devuan.org/merged/
Arches: arm64
Dists: ascii,ascii-backports,ascii-proposed-updates,ascii-security,ascii-updates
Sections: main,contrib,non-free
Pdiff mode: use
Not checking Release gpg signatures.
Will clean up after mirroring.
Attempting to get lock ...
Updating remote trace files (using rsync) ...
rsync: failed to connect to packages.devuan.org (2001:41d0:8:2c55::a2): No route to host (113)
rsync: failed to connect to packages.devuan.org (46.105.191.77): Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(125) [Receiver=3.1.2]
Warning: failed to use rsync to download extra files.
Getting meta files ...
[  0%] Getting: dists/ascii/Release...   #** GET http://packages.devuan.org/merged/dists/ascii/Release ==> 200 OK (4s)
ok
[  0%] Getting: dists/ascii/InRelease...         #** GET http://packages.devuan.org/merged/dists/ascii/InRelease ==> 200 OK
ok
[  0%] Getting: dists/ascii/Release.gpg...       #** GET http://packages.devuan.org/merged/dists/ascii/Release.gpg ==> 200 OK
ok
[  0%] Getting: dists/ascii-backports/Release...         #** GET http://packages.devuan.org/merged/dists/ascii-backports/Release ==> 200 OK
ok
[  0%] Getting: dists/ascii-backports/InRelease...       #** GET http://packages.devuan.org/merged/dists/ascii-backports/InRelease ==> 200 OK
ok
[  0%] Getting: dists/ascii-backports/Release.gpg...     #** GET http://packages.devuan.org/merged/dists/ascii-backports/Release.gpg ==> 200 OK
ok
Duplicate dist ascii.
WARNING: releasing 1 pending lock...
-------->8-------->8-------->8-------->8-------->8-------->8-------->8--------

"debmirror" wants to get some parts of the repository using "rsync",
even if configured to get the main amount of files via http. To be
mirrorable via "debmirror", the repository server would need to serve
"rsync" too or Devuan needs a patched "debmirror" script. But that's
not the main topic now.

The main error is "Duplicate dist ascii.", which points to the still
broken "Release" files.

http://packages.devuan.org/merged/dists/ascii-backports/Release without
most of the checksums:

--------8<--------8<--------8<--------8<--------8<--------8<--------8<--------
Origin: Devuan
Label: ascii-backports
Suite: ascii-backports
Version: 2.0.0
Codename: ascii
Date: Tue, 27 Mar 2018 02:05:34 UTC
Valid-Until: Tue, 03 Apr 2018 02:05:34 UTC
NotAutomatic: yes
ButAutomaticUpgrades: yes
Architectures: alpha amd64 arm64 armel armhf hppa i386 ia64 mips mipsel powerpc ppc64el s390x sparc
Components: main contrib non-freeMD5Sum:
  b05bd96d98a1ee79b9413504b4b36310    18076 non-free/binary-amd64/Packages.xz
  660aea9b98ce5da8f4e1f75d4c41794d      162 non-free/binary-amd64/Release
  53d2be49e1742c9ccb937ea29ef2092c    20456 non-free/binary-amd64/Packages.gz
  ed2571d1ba5e160d02c83ba15225f9bc   112079 non-free/binary-amd64/Packages
  a39e73f232d88ed23a6821d1ede10d39       32 non-free/binary-alpha/Packages.xz
-------->8-------->8-------->8-------->8-------->8-------->8-------->8--------

"Codename:" points to "ascii" and that probably triggers the "Duplicate
dist ascii." error.

Mirroring "jessie" yields similar problems.
 
Debian's release files use the subdistribution's name in that field.
http://ftp.debian.org/debian/dists/stretch-backports/Release shortened:

--------8<--------8<--------8<--------8<--------8<--------8<--------8<--------
Origin: Debian Backports
Label: Debian Backports
Suite: stretch-backports
Codename: stretch-backports
Date: Tue, 27 Mar 2018 14:40:15 UTC
Valid-Until: Tue, 03 Apr 2018 14:40:15 UTC
NotAutomatic: yes
ButAutomaticUpgrades: yes
Acquire-By-Hash: yes
Architectures: amd64 arm64 armel armhf i386 mips mips64el mipsel ppc64el s390x
Components: main contrib non-free
Description: Backports for the Stretch distribution
MD5Sum:
 7df415dc7f0909020e3bead872f30bda   293818 contrib/Contents-amd64
 56927b51d570fed004dd30c5da7cd72c     7624 contrib/Contents-amd64.diff/Index
 7efd3a0ce7c3bc5d2a1d72d8ae6257af    21958 contrib/Contents-amd64.gz
-------->8-------->8-------->8-------->8-------->8-------->8-------->8--------

And the next glitch is the missing newline before the "MD5Sum:" tag in
Devuan's Release files which is "handled differently" by Debian too. ;-
)

_o/"

Send a report that this bug log contains spam.

Devuan bug report logs - #197 debmirror fails on packages.devuan.org

Devuan bug report logs - #197
debmirror fails on packages.devuan.org