Devuan bug report logs - #406
apt-2.0.0: Runs very, very slow after update to version 2.0

Package: daptup; Reported by: Klaus Ethgen <Klaus@Ethgen.ch>; Keywords: debian; dated Mon, 9 Mar 2020 18:33:01 UTC; Maintainer for daptup is (unknown).

Message received at 406@bugs.devuan.org:


Received: (at 406) by bugs.devuan.org; 3 May 2020 21:10:03 +0000
Return-Path: <Klaus@Ethgen.de>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Sun, 03 May 2020 21:10:02 +0000 (UTC)
Received: from tschil.ethgen.ch (tschil.ethgen.ch [5.9.7.51])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id 94B09F60BC0
	for <406@bugs.devuan.org>; Sun,  3 May 2020 22:58:39 +0200 (CEST)
Received: from [192.168.17.4] (helo=ikki.ket)
	by tschil.ethgen.ch with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.92)
	(envelope-from <klaus@ethgen.ch>)
	id 1jVLh8-0007xC-HA; Sun, 03 May 2020 22:58:38 +0200
Received: from klaus by ikki.ket with local (Exim 4.93)
	(envelope-from <klaus@ethgen.ch>)
	id 1jVLh8-0001uo-4N; Sun, 03 May 2020 22:58:38 +0200
Date: Sun, 3 May 2020 21:58:38 +0100
From: Klaus Ethgen <Klaus@Ethgen.ch>
To: Andreas Messer <andi@bastelmap.de>
Cc: 406@bugs.devuan.org
Subject: Re: bug#406: apt-2.0.0: Runs very, very slow after update to version
 2.0
Message-ID: <20200503205838.GD15118@ikki.ethgen.ch>
References: <20200407174843.GA5826@zeus.ad.home.arpa>
 <20200309181647.GA23948@ikki.ethgen.ch>
 <20200416201205.GC28224@ikki.ethgen.ch>
 <20200503172029.GA19683@zeus.ad.home.arpa>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
	protocol="application/pgp-signature"; boundary="TeJTyD9hb8KJN2Jy"
Content-Disposition: inline
In-Reply-To: <20200503172029.GA19683@zeus.ad.home.arpa>
OpenPGP: id=79D0B06F4E20AF1C;
 url=http://www.ethgen.ch/~klaus/79D0B06F4E20AF1C.txt; preference=signencrypt
X-Spam-Status: No, score=-2.1 required=5.0 tests=HEADER_FROM_DIFFERENT_DOMAINS,
	RCVD_IN_DNSWL_MED,SPF_PASS autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org


--TeJTyD9hb8KJN2Jy
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Another think I seen..

`apt search '.*'` takes hours (as does all apt search or list calls).

But when I do the usual way `apt-cache search '.*'` it gives me the list
instant. (But it runs ages.)

The man page of apt says that this two should be identical and it
definitively was in the old version but now they are complete different.

By the way, even apt-cache needs some time to finish. I let it count the
lines (packages) and I get a count of 80318 lines which takes nearly 11
minutes time. My /var/lib/dpkg/available file only counts 90655
packages.

Gru=DF
   Klaus
--=20
Klaus Ethgen                                       http://www.ethgen.ch/
pub  4096R/4E20AF1C 2011-05-16            Klaus Ethgen <Klaus@Ethgen.ch>
Fingerprint: 85D4 CA42 952C 949B 1753  62B3 79D0 B06F 4E20 AF1C

--TeJTyD9hb8KJN2Jy
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----
Comment: Charset: ISO-8859-1

iQGzBAABCgAdFiEEMWF28vh4/UMJJLQEpnwKsYAZ9qwFAl6vMHoACgkQpnwKsYAZ
9qyXHgv+PP910vHJ4+tCDqejqDKgAbAx+17Hy+5uXpmiGXORF3eIccZz3WoZqti3
GZ/nMrVaZlnkzqN0p3hhKmW0qYCvjwqwive1PiugU3ClL+GV7AOb1I04ifXfVN1I
1b9YkfgZ+yQ3Fj6J6swHfRvalhmQ1dXMc4xlNXO6Uc7RS80hHwkQz7XAtg1M2q1R
WP1HzNUyidClMzYVcpWkkrbuNl9+8oBsGkK61SJ+h7yi/N0XaI5KMYWAJ7vjdoPf
r5E4d2dDZ9m/eGZguDtPMgf+HmWqlE3GoX320N9uFMJHiabiiVOZRTCdHiYF8bNg
kK/YxuF+j30nbrz2o0RhBzfEBbiHBd1uQgPZBg1YOGef3ty8l+/g1h7m+6RB8lV8
1Vx/StRSbYLAS+1rc6mARHql6bnIPuxgZWzyhEg0cBzripiMLyWNF6Yr2SqfWgIu
/jXt2JA126KfeOJtpYLiKkxfL5suMfnTE8hZgnyO3O3M6O/zk28hCyoXR7CDxnZH
6T0u2QcN
=Qx77
-----END PGP SIGNATURE-----

--TeJTyD9hb8KJN2Jy--

Acknowledgement sent to Klaus Ethgen <Klaus@Ethgen.ch>:
Extra info received and forwarded to list. Copy sent to devuan-dev@lists.dyne.org. Full text available.
Information forwarded to devuan-bugs@lists.dyne.org, devuan-dev@lists.dyne.org:
bug#406; Package daptup. Full text available.

Message received at 406@bugs.devuan.org:


Received: (at 406) by bugs.devuan.org; 3 May 2020 20:30:04 +0000
Return-Path: <Klaus@Ethgen.de>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Sun, 03 May 2020 20:30:04 +0000 (UTC)
Received: from tschil.ethgen.ch (tschil.ethgen.ch [5.9.7.51])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id 01918F609D4
	for <406@bugs.devuan.org>; Sun,  3 May 2020 22:18:29 +0200 (CEST)
Received: from [192.168.17.4] (helo=ikki.ket)
	by tschil.ethgen.ch with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.92)
	(envelope-from <klaus@ethgen.ch>)
	id 1jVL4H-0007L1-9C; Sun, 03 May 2020 22:18:29 +0200
Received: from klaus by ikki.ket with local (Exim 4.93)
	(envelope-from <klaus@ethgen.ch>)
	id 1jVL4G-0007QL-Sn; Sun, 03 May 2020 22:18:28 +0200
Date: Sun, 3 May 2020 21:18:28 +0100
From: Klaus Ethgen <Klaus@Ethgen.ch>
To: Andreas Messer <andi@bastelmap.de>
Cc: 406@bugs.devuan.org
Subject: Re: bug#406: apt-2.0.0: Runs very, very slow after update to version
 2.0
Message-ID: <20200503201828.GC15118@ikki.ethgen.ch>
References: <20200407174843.GA5826@zeus.ad.home.arpa>
 <20200309181647.GA23948@ikki.ethgen.ch>
 <20200416201205.GC28224@ikki.ethgen.ch>
 <20200503172029.GA19683@zeus.ad.home.arpa>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
	protocol="application/pgp-signature"; boundary="vmttodhTwj0NAgWp"
Content-Disposition: inline
In-Reply-To: <20200503172029.GA19683@zeus.ad.home.arpa>
OpenPGP: id=79D0B06F4E20AF1C;
 url=http://www.ethgen.ch/~klaus/79D0B06F4E20AF1C.txt; preference=signencrypt
X-Spam-Status: No, score=-2.1 required=5.0 tests=HEADER_FROM_DIFFERENT_DOMAINS,
	RCVD_IN_DNSWL_MED,SPF_PASS autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org


--vmttodhTwj0NAgWp
Content-Type: multipart/mixed; boundary="g7w8+K/95kPelPD2"
Content-Disposition: inline


--g7w8+K/95kPelPD2
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Maybe the daptup.conf would be of some help.

Gru=DF
   Klaus
--=20
Klaus Ethgen                                       http://www.ethgen.ch/
pub  4096R/4E20AF1C 2011-05-16            Klaus Ethgen <Klaus@Ethgen.ch>
Fingerprint: 85D4 CA42 952C 949B 1753  62B3 79D0 B06F 4E20 AF1C

--g7w8+K/95kPelPD2
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: attachment; filename="daptup.conf"

# configuraton file for daptup

# By default Daptup gathers and shows the information on each invocation of
# 'apt-get/aptitude/cupt update'. Use this option to switch this off.
# Possible values: "n" - no, "y" - yes.
DAPTUP_HOOK_ENABLED=y

# Daptup usually show changes just when it has built new lists. But there is
# a possibility to not show changes after updating the lists. Show changes in
# the '--post' call?
# Possible values: "n" - no, "y" - yes.
# If this option is disabled, administrator is supposed to run 'daptup --last'
# at some time after the update manually to see changes.
DAPTUP_SHOW_CHANGES_IN_POST=y

# Daptup has the ability to find installed packages that have version prepared
# by package maintainer a lot of time ago and have more recent install
# candidate ("outdated" packages). Enable this check?
# Possible values: "n" - no, "y" - yes.
DAPTUP_CHECK_FOR_OUTDATED_PACKAGES=y

# This option contains list of packages that will be watched by daptup though
# these packages are not installed on your system. The list is empty by
# default. Each entry must match whole package name. For example, if you want
# to track changes of gnash, pytagsfs and warsow packages, you should write
#
#   DAPTUP_PACKAGES_WATCH_FOR="gnash pytagsfs warsow"
#
# It is also possible to write any regular expressions in each item, except
# start of line ('^') and end of line ('$') characters. For example:
#
#   DAPTUP_PACKAGES_WATCH_FOR="xfce4-.*-plugin"
#
# line will watch for changes in all the xfce4 panel plugins.
DAPTUP_PACKAGES_WATCH_FOR=""

# If we check for "outdated" packages, what minimal age (in days) must package to have
# to be treated as "outdated"?
DAPTUP_MINIMAL_DAY_COUNT_TREATING_OUTDATED=90

# Use colored output?
# Possible values: "n" - no, "y" - yes.
DAPTUP_USE_COLOR=y

# When daptup builds a list of available packages, include short descriptions
# to the output?
# Possible values: "n" - no, "y" - yes.
DAPTUP_NEW_INCLUDE_DESCRIPTION=y

# Option that disables column output (passes "--disable-columns" to aptitude)
# disabled by default because this option can be processed only by newer
# versions of aptitude.
# Possible values: "n" - no, "y" - yes.
# If aptitude is not installed, option changes nothing and non-column output is
# used.
DAPTUP_DISABLE_COLUMNS=n

# Format string which daptup passes to aptitude when calling for changes in
# new packages, see aptitude reference manual for detailed documentation.
# This option doesn't work if aptitude is not installed.
DAPTUP_NEW_DISPLAY_FORMAT="%10p - %80d"

# Maximum width of line that aptitude can use for output of changes in new
# packages.
# This option doesn't work if aptitude is not installed.
DAPTUP_NEW_DISPLAY_WIDTH=120

# Format string which daptup passes to aptitude when calling for changes in
# watched packages, see aptitude reference manual for detailed documentation.
# This option doesn't work if aptitude is not installed.
DAPTUP_WATCH_DISPLAY_FORMAT="%p %V"

# Maximum width of line that aptitude can use for output of changes in watched
# packages.
# This option doesn't work if aptitude is not installed.
DAPTUP_WATCH_DISPLAY_WIDTH=50


--g7w8+K/95kPelPD2--

--vmttodhTwj0NAgWp
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----
Comment: Charset: ISO-8859-1

iQGzBAABCgAdFiEEMWF28vh4/UMJJLQEpnwKsYAZ9qwFAl6vJxQACgkQpnwKsYAZ
9qzFxQwAoHXJrUbavcmQ7/98Ns8a+YwjZxu70JIZ1PzI4UUC3PmkOLIGHVJ7l5Ii
BrdyoZM/L9uDb+Jp1LFtD5bIlU10hsAnC0USwan1CcKVQLb2Lg8RkNZ/nYwHxpnz
w1+YOurntJ14t4qVmVRDvr7X4CcFJPHlJziJ+hWfm4mx6n3nDXo7T+alRz6MjYir
RgJk5xvLQ+tI2IJbmtoojQf3Mriey7VDWQkFruQKIK0c3MvwK6Ci0d/CqWmImQlz
FL0a8LTi7LpKgb0iXBS5cmwFIpYJSVz0PxyGdyHYZs7QoaGBHywUMQLKyR6NBtfQ
8BWb0OFE5y00cW88RlAYIR3x2NQFXWMmvP+l146vktoEC5OhG7i26JA9WoRgACcK
VcrinxzLf0mIXLRr/tB5BXuHL8WeP2BDae/qTadI09NzkWog8q3vWAaJkFH1PtxA
sgyiEXO+Dj1R79x5S4kuvBwEdEvGrM5eIwRSgxyhDdQI2LU8e8g3viZ8l819UG5b
mUzzINyi
=wYtN
-----END PGP SIGNATURE-----

--vmttodhTwj0NAgWp--

Acknowledgement sent to Klaus Ethgen <Klaus@Ethgen.ch>:
Extra info received and forwarded to list. Copy sent to devuan-dev@lists.dyne.org. Full text available.
Information forwarded to devuan-bugs@lists.dyne.org, devuan-dev@lists.dyne.org:
bug#406; Package daptup. Full text available.

Message received at 406@bugs.devuan.org:


Received: (at 406) by bugs.devuan.org; 3 May 2020 19:50:06 +0000
Return-Path: <Klaus@Ethgen.de>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Sun, 03 May 2020 19:50:06 +0000 (UTC)
Received: from tschil.ethgen.ch (tschil.ethgen.ch [5.9.7.51])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id AEB3FF60BB4
	for <406@bugs.devuan.org>; Sun,  3 May 2020 21:37:22 +0200 (CEST)
Received: from [192.168.17.4] (helo=ikki.ket)
	by tschil.ethgen.ch with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.92)
	(envelope-from <klaus@ethgen.ch>)
	id 1jVKQS-0006jD-4G; Sun, 03 May 2020 21:37:20 +0200
Received: from klaus by ikki.ket with local (Exim 4.93)
	(envelope-from <klaus@ethgen.ch>)
	id 1jVKQR-0000wH-O3; Sun, 03 May 2020 21:37:19 +0200
Date: Sun, 3 May 2020 20:37:19 +0100
From: Klaus Ethgen <Klaus@Ethgen.ch>
To: Andreas Messer <andi@bastelmap.de>
Cc: 406@bugs.devuan.org
Subject: Re: bug#406: apt-2.0.0: Runs very, very slow after update to version
 2.0
Message-ID: <20200503193719.GA15118@ikki.ethgen.ch>
References: <20200407174843.GA5826@zeus.ad.home.arpa>
 <20200309181647.GA23948@ikki.ethgen.ch>
 <20200416201205.GC28224@ikki.ethgen.ch>
 <20200503172029.GA19683@zeus.ad.home.arpa>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
	protocol="application/pgp-signature"; boundary="T4sUOijqQbZv57TR"
Content-Disposition: inline
In-Reply-To: <20200503172029.GA19683@zeus.ad.home.arpa>
OpenPGP: id=79D0B06F4E20AF1C;
 url=http://www.ethgen.ch/~klaus/79D0B06F4E20AF1C.txt; preference=signencrypt
X-Spam-Status: No, score=-2.1 required=5.0 tests=HEADER_FROM_DIFFERENT_DOMAINS,
	RCVD_IN_DNSWL_MED,SPF_PASS autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org


--T4sUOijqQbZv57TR
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Hi Andreas,

Am So den  3. Mai 2020 um 18:20 schrieb Andreas Messer:
> I had to remove some of your local repos for testing, so my test result
> is probably not of much use. Running the command took about 6 seconds
> on my machine.

Strange..

> As far as I understand daptup is another tool not part of apt package.=20
> So maybe it is at the moment not apt to blame. We should figure out were=
=20
> the delay occurs. Did you check that you local file repos are available=
=20
> (e.g. mounted properly before running the tool?)

Yes, they are. Sure they are. And the speed change came exactly with the
new apt release.

> Could you please install libdevel-dprof-perl and then run daptup as
> follows within /tmp:
>=20
>     $ sudo perl -d:DProf /usr/bin/daptup --hook --post
>=20
> Then please invoke:
>=20
>     $ dprofpp
>=20
> And mail the output.

No sudo here and I did it in root $HOME:
```
~> dprofpp
Total Elapsed Time =3D 669.6876 Seconds
  User+System Time =3D 1.747609 Seconds
Exclusive Times
%Time ExclSec CumulS #Calls sec/call Csec/c  Name
 44.6   0.780  0.780      1   0.7800 0.7800  Daptup::Backend::AptOrCupt::ge=
t_updates
 35.4   0.620  1.689      1   0.6196 1.6892  main::do_post
 15.4   0.270  0.270  80346   0.0000 0.0000  Term::ANSIColor::color
 1.72   0.030  0.069     11   0.0027 0.0062  main::BEGIN
 0.57   0.010  0.010      3   0.0033 0.0033  main::diff_cmd
 0.57   0.010  0.010      1   0.0100 0.0100  main::find_old_packages
 0.57   0.010  0.010      4   0.0025 0.0025  Daptup::Backend::Aptitude::BEG=
IN
 0.57   0.010  0.010      7   0.0014 0.0014  IO::Handle::BEGIN
 0.57   0.010  0.010      8   0.0012 0.0012  File::Spec::Unix::BEGIN
 0.57   0.010  0.010      7   0.0014 0.0014  Log::Agent::BEGIN
 0.57   0.010  0.029     21   0.0005 0.0014  File::Temp::BEGIN
 0.00   0.000  0.000      1   0.0000 0.0000  Exporter::Heavy::heavy_export_=
ok_tags
 0.00   0.000  0.000      1   0.0000 0.0000  Getopt::Long::GetOptionsFromAr=
ray
 0.00        - -0.000      1         -       -  main::get_watch_regex
 0.00        - -0.000      1         -       -  IO::Handle::__ANON__
```

Gru=DF
   Klaus
--=20
Klaus Ethgen                                       http://www.ethgen.ch/
pub  4096R/4E20AF1C 2011-05-16            Klaus Ethgen <Klaus@Ethgen.ch>
Fingerprint: 85D4 CA42 952C 949B 1753  62B3 79D0 B06F 4E20 AF1C

--T4sUOijqQbZv57TR
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----
Comment: Charset: ISO-8859-1

iQGzBAABCgAdFiEEMWF28vh4/UMJJLQEpnwKsYAZ9qwFAl6vHWoACgkQpnwKsYAZ
9qx52wwAwuNJiE4QzCyHam4hDSBrS2Z8A9szhK6NLeNx2e7k8UzX9dg7LZIvDWRp
phl1+/6nZXDvhnlfczPV/0sSLJE6hzFfoDe+SDaXorY85dw5XPk3B6RZG3ddNfaW
v8HZoyAXFt93epMd0iKU1u3oGmtDXkQEoQ9PajScJduVAgG8mN6mucMV2jrE/kzH
XchhtbA8LO74sHrnSWOO9D2qVMEBAefumyiBFGg5Lz1EJgBJ9nR0VHq9rgsRno9f
pKw/avIbegVWYhfZTQ1dtdBdt+omLR/a1glpyRZJWvJ0o7pt/QHk3cjRn9R5wwMP
DgENCPscUGypwf7JU2PsGTnRlpwxur7MWT9TvuoB+WVIaqMBdTziz33hpmYQctYc
S316UiONxnXYmTLM/0WbFdIKBbAt1AKoxNL9OTa1zk9Q/HSLdLUc//fWhuwXYeuf
706zbFDp7iDL9jc9VLqa3i5iM54CT0C19XBFtry7xDc39UsfxtsKzQ3zTfw4ssRi
CmNtdlOm
=uBGq
-----END PGP SIGNATURE-----

--T4sUOijqQbZv57TR--

Acknowledgement sent to Klaus Ethgen <Klaus@Ethgen.ch>:
Extra info received and forwarded to list. Copy sent to devuan-dev@lists.dyne.org. Full text available.
Information forwarded to devuan-bugs@lists.dyne.org, devuan-dev@lists.dyne.org:
bug#406; Package daptup. Full text available.
No longer marked as found in versions 2.0.0. Request was from Andreas Messer <andi@bastelmap.de> to control@bugs.devuan.org. Full text available.
bug reassigned from package 'apt' to 'daptup'. Request was from Andreas Messer <andi@bastelmap.de> to control@bugs.devuan.org. Full text available.

Message received at 406@bugs.devuan.org:


Received: (at 406) by bugs.devuan.org; 3 May 2020 17:30:03 +0000
Return-Path: <andi@bastelmap.de>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Sun, 03 May 2020 17:30:03 +0000 (UTC)
Received: from dd10814.kasserver.com (dd10814.kasserver.com [85.13.133.115])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id E65CBF60B84
	for <406@bugs.devuan.org>; Sun,  3 May 2020 19:20:32 +0200 (CEST)
Received: from zeus.ad.home.arpa (p5080F461.dip0.t-ipconnect.de [80.128.244.97])
	by dd10814.kasserver.com (Postfix) with ESMTPSA id 42AC51200F05;
	Sun,  3 May 2020 19:20:31 +0200 (CEST)
Date: Sun, 3 May 2020 19:20:30 +0200
From: Andreas Messer <andi@bastelmap.de>
To: Klaus Ethgen <Klaus@Ethgen.ch>
Cc: 406@bugs.devuan.org
Subject: Re: bug#406: apt-2.0.0: Runs very, very slow after update to version
 2.0
Message-ID: <20200503172029.GA19683@zeus.ad.home.arpa>
References: <20200407174843.GA5826@zeus.ad.home.arpa>
 <20200309181647.GA23948@ikki.ethgen.ch>
 <20200416201205.GC28224@ikki.ethgen.ch>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
	protocol="application/pgp-signature"; boundary="liOOAslEiF7prFVr"
Content-Disposition: inline
In-Reply-To: <20200416201205.GC28224@ikki.ethgen.ch>
User-Agent: Mutt/1.10.1 (2018-07-13)
X-Spam-Status: No, score=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW
	autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org


--liOOAslEiF7prFVr
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Hi Klaus,

On Thu, Apr 16, 2020 at 09:12:06PM +0100, Klaus Ethgen wrote:
> > Would you mind providing your sources.list(s) to me, such that
> > I can try to reproduce the problem? Thanks!
>=20
> Sure.
> [ Removed apt sources.list ]
>=20
> install daptub and run `/usr/bin/daptup --hook --post`, that will take
> 10 Minutes.

I had to remove some of your local repos for testing, so my test result
is probably not of much use. Running the command took about 6 seconds
on my machine.

As far as I understand daptup is another tool not part of apt package.=20
So maybe it is at the moment not apt to blame. We should figure out were=20
the delay occurs. Did you check that you local file repos are available=20
(e.g. mounted properly before running the tool?)

Could you please install libdevel-dprof-perl and then run daptup as
follows within /tmp:

    $ sudo perl -d:DProf /usr/bin/daptup --hook --post

Then please invoke:

    $ dprofpp

And mail the output.

Best regards
Andreas

--=20
gnuPG keyid: 8C2BAF51
fingerprint: 28EE 8438 E688 D992 3661 C753 90B3 BAAA 8C2B AF51

--liOOAslEiF7prFVr
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iF0EABEIAB0WIQQo7oQ45ojZkjZhx1OQs7qqjCuvUQUCXq79WAAKCRCQs7qqjCuv
Ua6WAJwOqkTtMNUq4wIOqUBq4dWzXhYJZACgv4Bu/toMRgXBlqJsoVRjFbAws/A=
=XZN+
-----END PGP SIGNATURE-----

--liOOAslEiF7prFVr--

Acknowledgement sent to Andreas Messer <andi@bastelmap.de>:
Extra info received and forwarded to list. Full text available.
Information forwarded to devuan-bugs@lists.dyne.org:
bug#406; Package apt. Full text available.

Message received at 406@bugs.devuan.org:


Received: (at 406) by bugs.devuan.org; 16 Apr 2020 20:20:04 +0000
Return-Path: <Klaus@Ethgen.de>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Thu, 16 Apr 2020 20:20:04 +0000 (UTC)
Received: from tschil.ethgen.ch (tschil.ethgen.ch [5.9.7.51])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id B901BF60D47
	for <406@bugs.devuan.org>; Thu, 16 Apr 2020 22:12:08 +0200 (CEST)
Received: from [192.168.17.4] (helo=ikki.ket)
	by tschil.ethgen.ch with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.92)
	(envelope-from <klaus@ethgen.ch>)
	id 1jPArm-000836-T8; Thu, 16 Apr 2020 22:12:07 +0200
Received: from klaus by ikki.ket with local (Exim 4.93)
	(envelope-from <klaus@ethgen.ch>)
	id 1jPArm-0004pM-GZ; Thu, 16 Apr 2020 22:12:06 +0200
Date: Thu, 16 Apr 2020 21:12:06 +0100
From: Klaus Ethgen <Klaus@Ethgen.ch>
To: Andreas Messer <andi@bastelmap.de>
Cc: 406@bugs.devuan.org
Subject: Re: apt-2.0.0: Runs very, very slow after update to version 2.0
Message-ID: <20200416201205.GC28224@ikki.ethgen.ch>
References: <20200407174843.GA5826@zeus.ad.home.arpa>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
	protocol="application/pgp-signature"; boundary="c3bfwLpm8qysLVxt"
Content-Disposition: inline
In-Reply-To: <20200407174843.GA5826@zeus.ad.home.arpa>
OpenPGP: id=79D0B06F4E20AF1C;
 url=http://www.ethgen.ch/~klaus/79D0B06F4E20AF1C.txt; preference=signencrypt
User-Agent: Mutt/1.10.1 (2018-07-13)
X-Spam-Status: No, score=-2.1 required=5.0 tests=HEADER_FROM_DIFFERENT_DOMAINS,
	RCVD_IN_DNSWL_MED,SPF_PASS autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org


--c3bfwLpm8qysLVxt
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline

Hello Andreas,

Am Di den  7. Apr 2020 um 18:48 schrieb Andreas Messer:
> A devuanized version of the apt package has just been uploaded to
> unstable/ceres. (2.0.1+devuan1) Should be available within the 
> next hours, can you confirm the problem still exists with it?
> 
> Would you mind providing your sources.list(s) to me, such that
> I can try to reproduce the problem? Thanks!

Sure.
```
/etc/apt (git-[etc:masterU])> grep -vh '^#' sources.list sources.list.d/* G -v '^$'
deb file:///home/ftp/pub/debian ceres unofficial
deb-src file:///home/ftp/pub/debian ceres unofficial
deb file:///home/ftp/pub/debian-security ceres unofficial-secured
deb http://auto.mirror.devuan.org/merged ceres main contrib non-free
deb-src http://ftp.ch.debian.org/debian sid main contrib non-free
deb http://ftp.ch.debian.org/debian experimental main contrib non-free
deb-src http://ftp.ch.debian.org/debian experimental main contrib non-free
deb [trusted=yes] file:///home/local_repo sid main
deb http://www.deb-multimedia.org/ sid main non-free
deb [check-valid-until=no] http://snapshot.debian.org/archive/debian/20150521T214404Z sid main
deb [check-valid-until=no] http://snapshot.debian.org/archive/debian/20161010T164513Z sid main
deb https://www.mirbsd.org/~tg/Debs/ sid wtf
```

install daptub and run `/usr/bin/daptup --hook --post`, that will take
10 Minutes.

apt is currently in the following version:
```
~> apt-cache policy apt
apt:
  Installiert:           2.0.1
  Installationskandidat: 2.0.1
  Versionstabelle:
 *** 2.0.1 500
        500 http://auto.mirror.devuan.org/merged ceres/main amd64 Packages
        100 /var/lib/dpkg/status
     1.3.1 400
        400 http://snapshot.debian.org/archive/debian/20161010T164513Z sid/main amd64 Packages
     1.0.9.9 400
        400 http://snapshot.debian.org/archive/debian/20150521T214404Z sid/main amd64 Packages
```

Regards
   Klaus
-- 
Klaus Ethgen                                       http://www.ethgen.ch/
pub  4096R/4E20AF1C 2011-05-16            Klaus Ethgen <Klaus@Ethgen.ch>
Fingerprint: 85D4 CA42 952C 949B 1753  62B3 79D0 B06F 4E20 AF1C

--c3bfwLpm8qysLVxt
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----
Comment: Charset: ISO-8859-1

iQGzBAABCgAdFiEEMWF28vh4/UMJJLQEpnwKsYAZ9qwFAl6YvBUACgkQpnwKsYAZ
9qzUdQv/cK+dxSaPCe27PrjRKjP37JyF15q0KqZr4hf0X0tURDfHBkDtilVh4GJx
5pIyGJZX0L6euawNJagJZ/OsBXQ7qoBkHjMDyhTSnCb9p1roCp+WDgXq5Gdrp1T1
a/x/vJauq7KNBVjQdns8zJ2HRghGo6BNP+84XYt0mvlaOUDb+uKM68+3XgYE6OFu
WAbdw6oK3yrA2Aogc9UygobZOTOf2T3eNock5zGgHjzhWnM4i4K/ScsTfOa7JNz/
SuYOqsmo/vojjomMEkmdE76Rg5ccRgv07w57ipsnCLGTljhd0aQZfthWUm7Z4U9t
732vjmW4O/vVL89bq21FcON+IFGKPaaE8575OjBpM8i9huVKHUYyTppq5SZA/mbx
RfFE1CUZNa7tR8gF1VDin1BGbUD9hsKT9bIUYNK9RzQPcaBkqoMyS4bhsRn2u6sk
ypfIaiaf8Rxiy2ScAEIA9lKezktoI2ATykA900joIi1uSx465qM/hN3ryH5tW5bK
6vXJlIH7
=repF
-----END PGP SIGNATURE-----

--c3bfwLpm8qysLVxt--

Acknowledgement sent to Klaus Ethgen <Klaus@Ethgen.ch>:
Extra info received and forwarded to list. Copy sent to Andreas Messer <andi@bastelmap.de>. Full text available.
Information forwarded to devuan-bugs@lists.dyne.org, Andreas Messer <andi@bastelmap.de>:
bug#406; Package apt. Full text available.

Message received at 406@bugs.devuan.org:


Received: (at 406) by bugs.devuan.org; 7 Apr 2020 18:00:01 +0000
Return-Path: <andi@bastelmap.de>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Tue, 07 Apr 2020 18:00:01 +0000 (UTC)
Received: from dd10814.kasserver.com (dd10814.kasserver.com [85.13.133.115])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id 7803AF608AB
	for <406@bugs.devuan.org>; Tue,  7 Apr 2020 19:48:45 +0200 (CEST)
Received: from zeus.ad.home.arpa (p5B0557A9.dip0.t-ipconnect.de [91.5.87.169])
	by dd10814.kasserver.com (Postfix) with ESMTPSA id 03C241200154;
	Tue,  7 Apr 2020 19:48:44 +0200 (CEST)
Date: Tue, 7 Apr 2020 19:48:43 +0200
From: Andreas Messer <andi@bastelmap.de>
To: 406@bugs.devuan.org
Cc: Klaus Ethgen <Klaus@Ethgen.ch>
Subject: Re: apt-2.0.0: Runs very, very slow after update to version 2.0
Message-ID: <20200407174843.GA5826@zeus.ad.home.arpa>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
	protocol="application/pgp-signature"; boundary="yrj/dFKFPuw6o+aM"
Content-Disposition: inline
User-Agent: Mutt/1.10.1 (2018-07-13)
X-Spam-Status: No, score=-0.7 required=5.0 tests=FAKE_REPLY_C,
	RCVD_IN_DNSWL_LOW autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org


--yrj/dFKFPuw6o+aM
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Hello Klaus,

A devuanized version of the apt package has just been uploaded to
unstable/ceres. (2.0.1+devuan1) Should be available within the=20
next hours, can you confirm the problem still exists with it?

Would you mind providing your sources.list(s) to me, such that
I can try to reproduce the problem? Thanks!

cheers,
Andreas
--=20
gnuPG keyid: 8C2BAF51
fingerprint: 28EE 8438 E688 D992 3661 C753 90B3 BAAA 8C2B AF51

--yrj/dFKFPuw6o+aM
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iF0EABEIAB0WIQQo7oQ45ojZkjZhx1OQs7qqjCuvUQUCXoy8+wAKCRCQs7qqjCuv
UTCuAJ9bBy7Gz2iGjSoP3Gld1Zu4FpaH2gCfUUDUbc+u2ZI6PUuH7v0BnVuk+f0=
=Jxcn
-----END PGP SIGNATURE-----

--yrj/dFKFPuw6o+aM--

Acknowledgement sent to Andreas Messer <andi@bastelmap.de>:
Extra info received and forwarded to list. Full text available.
Information forwarded to devuan-bugs@lists.dyne.org:
bug#406; Package apt. Full text available.
Added tag(s) debian. Request was from Mark Hindley <mark@hindley.org.uk> to 406-submit@bugs.devuan.org. Full text available.

Message received at 406@bugs.devuan.org:


Received: (at 406) by bugs.devuan.org; 10 Mar 2020 10:30:04 +0000
Return-Path: <mark@hindley.org.uk>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Tue, 10 Mar 2020 10:30:04 +0000 (UTC)
Received: from mx.hindley.org.uk (mohindley.plus.com [81.174.245.179])
	(using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id DB5B3F609DB
	for <406@bugs.devuan.org>; Tue, 10 Mar 2020 11:18:54 +0100 (CET)
Received: from apollo.hindleynet ([192.168.1.3] helo=apollo)
	by mx.hindley.org.uk with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
	(Exim 4.84_2)
	(envelope-from <mark@hindley.org.uk>)
	id 1jBbyM-0002Rs-FT; Tue, 10 Mar 2020 10:18:50 +0000
Received: from mark by apollo with local (Exim 4.84_2)
	(envelope-from <mark@hindley.org.uk>)
	id 1jBbyK-00042o-ME; Tue, 10 Mar 2020 10:18:48 +0000
Date: Tue, 10 Mar 2020 10:18:48 +0000
From: Mark Hindley <mark@hindley.org.uk>
To: 406@bugs.devuan.org
Cc: Klaus Ethgen <Klaus@Ethgen.ch>
Subject: Re: apt-2.0.0: Runs very, very slow after update to version 2.0
Message-ID: <20200310101848.GA15485@hindley.org.uk>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20200309181647.GA23948@ikki.ethgen.ch>
X-Debbugs-No-Ack: No Thanks
User-Agent: Mutt/1.5.23 (2014-03-12)
X-Spam-Status: No, score=0.0 required=5.0 tests=FAKE_REPLY_C,SPF_PASS
	autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org

Control: tags -1 debian

On Mon, 9 Mar 2020 19:16:48 +0100 Klaus Ethgen <Klaus@Ethgen.ch> wrote:
> Package: apt
> Version: 2.0.0
> 
> After updating apt to version 2.0.0, there are two times that takes ~10
> minutes:

Klaus,

Thanks for this.

However, since apt is not a forked package (devuan uses Debian's package
directly) you would be much better reporting this issue directly to Debian's
BTS.

Thanks.

Mark

Information forwarded to devuan-bugs@lists.dyne.org, devuan-dev@lists.dyne.org:
bug#406; Package apt. Full text available.

Message received at submit@bugs.devuan.org:


Received: (at submit) by bugs.devuan.org; 9 Mar 2020 18:20:06 +0000
Return-Path: <Klaus@Ethgen.de>
Delivered-To: devuanbugs@dyne.org
Received: from tupac3.dyne.org [195.169.149.119]
	by doc.devuan.org with IMAP (fetchmail-6.4.0.beta4)
	for <debbugs@localhost> (single-drop); Mon, 09 Mar 2020 18:20:06 +0000 (UTC)
Received: from tschil.ethgen.ch (tschil.ethgen.ch [5.9.7.51])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by vm6.ganeti.dyne.org (Postfix) with ESMTPS id A9026F60B88
	for <submit@bugs.devuan.org>; Mon,  9 Mar 2020 19:16:50 +0100 (CET)
Received: from [192.168.17.4] (helo=ikki.ket)
	by tschil.ethgen.ch with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.92)
	(envelope-from <klaus@ethgen.ch>)
	id 1jBMxN-0006Jp-4i
	for submit@bugs.devuan.org; Mon, 09 Mar 2020 19:16:49 +0100
Received: from klaus by ikki.ket with local (Exim 4.93)
	(envelope-from <klaus@ethgen.ch>)
	id 1jBMxM-0006ew-No
	for submit@bugs.devuan.org; Mon, 09 Mar 2020 19:16:48 +0100
Date: Mon, 9 Mar 2020 19:16:48 +0100
From: Klaus Ethgen <Klaus@Ethgen.ch>
To: submit@bugs.devuan.org
Subject: apt-2.0.0: Runs very, very slow after update to version 2.0
Message-ID: <20200309181647.GA23948@ikki.ethgen.ch>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
	protocol="application/pgp-signature"; boundary="8t9RHnE3ZwKMSgU+"
Content-Disposition: inline
OpenPGP: id=79D0B06F4E20AF1C;
 url=http://www.ethgen.ch/~klaus/79D0B06F4E20AF1C.txt; preference=signencrypt
User-Agent: Mutt/1.10.1 (2018-07-13)
X-Spam-Status: No, score=-2.1 required=5.0 tests=HEADER_FROM_DIFFERENT_DOMAINS,
	RCVD_IN_DNSWL_MED,SPF_PASS autolearn=disabled version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tupac3.dyne.org


--8t9RHnE3ZwKMSgU+
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Package: apt
Version: 2.0.0

After updating apt to version 2.0.0, there are two times that takes ~10
minutes:
~> apt-get update; apt-get --auto-remove dist-upgrade && apt-get clean && s=
ync
Erstelle alte Liste von Paketen...
Erstelle alte Liste von verf=FCgbaren Aktualisierungen...
Erstelle alte Liste von beobachteten Paketen...
-> 10 Minutes
=2E..
Es wurden 212 MB in 33 s geholt (6.340 kB/s).
Erstelle neue Liste von Paketen...
-> again 10 minutes.

It seems that there is all a apt-cache running that long. It seems that
daptub is running that.

Wishes
   Klaus

Ps. That system is a old sid system witch was converted to ceres. It is
    my fastest system but with many source lists.
--=20
Klaus Ethgen                                       http://www.ethgen.ch/
pub  4096R/4E20AF1C 2011-05-16            Klaus Ethgen <Klaus@Ethgen.ch>
Fingerprint: 85D4 CA42 952C 949B 1753  62B3 79D0 B06F 4E20 AF1C

--8t9RHnE3ZwKMSgU+
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----
Comment: Charset: ISO-8859-1

iQGzBAABCgAdFiEEMWF28vh4/UMJJLQEpnwKsYAZ9qwFAl5miA4ACgkQpnwKsYAZ
9qx2nwv8CU2dmykbDhCdrqVmHYUiCTYMRutz4m0U5M5v7spHXHY1DmxTkc8MOzzZ
r4WHK5U5Wtjk5Jxpp9shegvH5t6+61/yaUtOlJyi3aIabPW+ZpcZXeQTZ4Qr0dga
sp4ejNoFE0etcLaIYw81rKfv2HrX0C9jgPbZ3ftOSv7/jGU7MlW8oNHTkUWjj0K7
wLaNu3jn57q928/lQxJatQvrlrIAzmEAZLtPYj/IYDS1Yz7h2ifgYYnpN2O8n5le
9Xx/SVcy9VYVxz5YLrxn5hQOYCa7KdIq7iyX34gkBWmyeU50mcgkjHRm4B1IbZzL
GyJi+mmMmNHEuPbcgsaCYuFKX3CacfoKaVTmYG5LcVlNuhSjVasLOwXSwamaaIYi
zsmYvQn+91981Hlzze1d7/rFbTWOjCB3S/SXnZyqcacdLgORVQ2ucJ37PMt+3XCU
cYpGrIyWsR3bjPbtLRySVnO3YB9HukFq+MhWyCvDl5SGzEs+CAynOiYTjdHCSGeK
0n99HdeE
=fBmg
-----END PGP SIGNATURE-----

--8t9RHnE3ZwKMSgU+--

Acknowledgement sent to Klaus Ethgen <Klaus@Ethgen.ch>:
New bug report received and forwarded. Copy sent to devuan-dev@lists.dyne.org. Full text available.
Report forwarded to devuan-bugs@lists.dyne.org, devuan-dev@lists.dyne.org:
bug#406; Package apt. Full text available.

Devuan BTS -- Powered by Debian bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.

Devuan Bugs Owner <owner@bugs.devuan.org>.
Last modified: Sat, 4 Jul 2020 00:39:02 UTC