On Fri, 3 May 2024 at 03:05, Heinrich Schuchardt <heinrich.schuchardt@canonical.com> wrote:
On 02.05.24 16:46, Robie Basak wrote:
> On Thu, May 02, 2024 at 04:05:31PM +0200, Heinrich Schuchardt wrote:
>> Often I see apt-get update downloads exceeding 100 MiB. That is without a
>> single package download.
>
> I think it might be worth quantifying this. Right now, for amd64
> proposed pocket Packages.xz files for the following:
This is what I see:
$ sudo apt-get update
Get:1 http://archive.ubuntu.com/ubuntu oracular InRelease [64,6 kB]
Hit:2 http://dl.google.com/linux/chrome/deb stable InRelease
Hit:3 https://ppa.launchpadcontent.net/xypron/qemu/ubuntu noble
InRelease
Hit:4 https://ppa.launchpadcontent.net/xypron/rsyslog2312/ubuntu noble
InRelease
Get:5 http://security.ubuntu.com/ubuntu oracular-security InRelease
[64,6 kB]
Hit:6
https://private-ppa.launchpadcontent.net/ubuntu-risc-v-team-private/private/ubuntu
mantic InRelease
Get:7 http://archive.ubuntu.com/ubuntu oracular-updates InRelease [64,6
kB]
Get:8 http://archive.ubuntu.com/ubuntu oracular-backports InRelease
[64,7 kB]
Hit:9
https://private-ppa.launchpadcontent.net/ubuntu-risc-v-team-private/private/ubuntu
noble InRelease
Get:10 http://archive.ubuntu.com/ubuntu oracular/multiverse Sources [299 kB]
Hit:11
https://private-ppa.launchpadcontent.net/ubuntu-risc-v-team-private/ventana/ubuntu
noble InRelease
Hit:12
https://private-ppa.launchpadcontent.net/ubuntu-risc-v-team-private/ventana/ubuntu
mantic InRelease
Get:13 http://archive.ubuntu.com/ubuntu oracular/restricted Sources
[18,7 kB]
Get:14 http://archive.ubuntu.com/ubuntu oracular/universe Sources [19,9
MB]
Hit:15
https://private-ppa.launchpadcontent.net/ubuntu-risc-v-team/private/ubuntu
mantic InRelease
Get:16 http://archive.ubuntu.com/ubuntu oracular/main Sources [1.378 kB]
Get:17 http://archive.ubuntu.com/ubuntu oracular/main amd64 Packages
[1.401 kB]
Get:18 http://archive.ubuntu.com/ubuntu oracular/main i386 Packages
[1.041 kB]
Get:19 http://archive.ubuntu.com/ubuntu oracular/main Translation-en
[512 kB]
Get:20 http://archive.ubuntu.com/ubuntu oracular amd64 Contents (deb)
[51,3 MB]
Get:21 http://archive.ubuntu.com/ubuntu oracular i386 Contents (deb)
[40,3 MB]
Get:22 http://archive.ubuntu.com/ubuntu oracular/restricted i386
Packages [14,7 kB]
Get:23 http://archive.ubuntu.com/ubuntu oracular/restricted amd64
Packages [93,9 kB]
Get:24 http://archive.ubuntu.com/ubuntu oracular/restricted
Translation-en [18,7 kB]
Get:25 http://archive.ubuntu.com/ubuntu oracular/universe amd64 Packages
[15,5 MB]
Get:26 http://archive.ubuntu.com/ubuntu oracular/universe i386 Packages
[8.166 kB]
Get:27 http://archive.ubuntu.com/ubuntu oracular/universe Translation-en
[5.980 kB]
Get:28 http://archive.ubuntu.com/ubuntu oracular/multiverse amd64
Packages [269 kB]
Get:29 http://archive.ubuntu.com/ubuntu oracular/multiverse i386
Packages [126 kB]
Get:30 http://archive.ubuntu.com/ubuntu oracular/multiverse
Translation-en [118 kB]
Fetched 147 MB in 10s (14,3 MB/s)
Reading package lists... Done
Yes sure but that's not the common experience for at least three reasons:
1. it's the devel series so the release pocket gets republished all the time
2. you have apt-file installed and are downloading the Contents files. those are always big
3. you have deb-src enabled (this makes much less difference than the previous 2 though)
If we want to make apt update quicker / lighter on resources we should figure out if we can stop publishing some of the hashes (which entirely dominate the size of the compressed package lists). We currently have 4 hashes in the lists (md5, sha1, sha256, sha512) -- I know Dimitri was trying to get us to the point that we could stop publishing MD5 at least but there are a few things out there that hardcode a dependence on it. Maybe oracular is a good time to turn off some hashes and see what breaks.
Cheers,
mwh
