[SOLVED] Is it possible to exclude a mirror?

l3u · 2022-11-18 09:18:36

Hi all,

can I exclude a mirror from being used? I have the problem that apt always queries 2001:4ca0:4300::1:22, which leads to http://debian.bio.lmu.de/debian/pool/main/ being used. This mirror apparently has problems, as I often – not always – get errors about files not being found.

When I set the nameserver to e.g. 8.8.8.8 in /etc/resov.conf, another mirror is used, and installation of packages or updating works.

So: Can I exclude a specific mirror from being used?

Thanks for all help!

Altoid · 2022-11-18 11:19:06

Hello:

l3u wrote:

can I exclude a mirror ...

What Devuan version are you running and what mirrors are you using?

Please post the output of uname -a and cat /etc/apt/sources.list.

Also, have a look at this page.
ie: the "Default configurations" list

Best,

O.

l3u · 2022-11-18 13:19:03

It's Chimaera (the kernel version is not really relevant here, is it?).

Here's the sources.list:

deb http://deb.devuan.org/merged chimaera main contrib non-free
deb http://deb.devuan.org/merged chimaera-updates main contrib non-free
deb http://deb.devuan.org/devuan chimaera-proposed-updates main contrib non-free
deb http://deb.devuan.org/merged chimaera-security main contrib non-free
deb http://deb.devuan.org/merged chimaera-backports main contrib non-free

Last edited by l3u (2022-11-18 13:19:58)

Altoid · 2022-11-18 17:01:44

Hello:

l3u wrote:

... Chimaera ...

Right.

l3u wrote:

... kernel version is not really relevant here, is it? ...

No.
But I like to see what the output says, just habit.

l3u wrote:

deb http://deb.devuan.org/merged chimaera main contrib non-free
deb http://deb.devuan.org/merged chimaera-updates main contrib non-free
deb http://deb.devuan.org/devuan chimaera-proposed-updates main contrib non-free
deb http://deb.devuan.org/merged chimaera-security main contrib non-free
deb http://deb.devuan.org/merged chimaera-backports main contrib non-free

Seems correct.
I would not use devuan chimaera-proposed-updates, because proposed.
Obviously, YMMV.

I think the explanation could be here.

Devuan has a network of package repository mirrors in place. The mirror network is accessible using the FQDN "deb.devuan.org" via http NOT https. Country Codes (CC) are currently unavailable but a specific mirror from the list can be accessed using the corresponding BaseURL.

The list is here.

There is/maybe some issue with FQDN "deb.devuan.org" and how/when it connects to debian.bio.lmu.de.

You could be able to solve the problem by following the suggestion above.
ie: ... a specific mirror from the list can be accessed ...

Best,

A.

Last edited by Altoid (2022-11-18 17:03:34)

l3u · 2022-11-18 17:56:33

Well,

devuan chimaera-proposed-updates

is there because it's the default – I never touched this file.

However, I want quite the opposite of "... a specific mirror from the list can be accessed ..." – I don't want to connect only to one specific mirror, but exclude one specific mirror …

Head_on_a_Stick · 2022-11-18 18:00:22

Block the mirror in /etc/hosts, the round robin thingy will just find another path.

l3u · 2022-11-21 10:29:05

This is a nice idea, I'll try that! Thanks :-)

l3u · 2022-12-07 08:33:55

If I get this correctly, blocking a host through /etc/hosts would look like this:

127.0.0.1    debian.bio.lmu.de

Alas, this doesn't help – instead of e.g.

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
  ninja-build
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 97.8 kB of archives.
After this operation, 317 kB of additional disk space will be used.
Err:1 http://deb.devuan.org/merged chimaera/main armel ninja-build armel 1.10.1-1
  404  Not Found [IP: 2001:4ca0:4300::1:22 80]
E: Failed to fetch http://debian.bio.lmu.de/debian/pool/main/n/ninja-build/ninja-build_1.10.1-1_armel.deb  404  Not Found [IP: 2001:4ca0:4300::1:22 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

I then get

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
  ninja-build
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 97.8 kB of archives.
After this operation, 317 kB of additional disk space will be used.
Err:1 http://deb.devuan.org/merged chimaera/main armel ninja-build armel 1.10.1-1
  404  Not Found [IP: 127.0.0.1 80]
E: Failed to fetch http://debian.bio.lmu.de/debian/pool/main/n/ninja-build/ninja-build_1.10.1-1_armel.deb  404  Not Found [IP: 127.0.0.1 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

So apt doesn't try the next round-robin mirror but just gives up, as on 127.0.0.1, the package isn't there as well :-(

ralph.ronnquist · 2022-12-07 08:56:15

That's not how it works.

The s.c. round-robin is merely that the domain name has multiple resolutions that the authorative nameserver serves in different orders upon subsequent requests; apt just picks whichever it receives first.

Afaik there's no easy way to selectively exclude servers from the list.

You may however use /etc/hosts to override the name lookup with your favourite resolution. If, say, you prefer m10k.jp you would add their IP as resolution for deb.devuan.org:

160.16.137.156  deb.devuan.org

For anything more advanced I think you will need a local nameserver.

l3u · 2022-12-07 11:03:38

Okay, then, it would get complicated ;-) Not that I don't have or use local nameservers, but it would really suck to work around this by installing BIND or whatever on my Raspberry Pi just to really exclude this very mirror.

Maybe, this is actually a syncing problem. Seems like they have all kinds of ARM packages – but not the armel one needed by my Raspberry Pi 1. I think I'll contact the mirror admin. Maybe, they can or want to change this. Quasi as an upstream bugfix.

Marjorie · 2022-12-07 11:28:00

You could just chose one mirror, from those in the roundrobin, that works for you.

The main purpose of the roundrobin is to spread the load, but if you have a specific need then one person fixing their choice of mirror won't be disruptive.
If lots of you were to need a particular mirror as it was the only one that serves ARM packages then that might be more of a problem, but I don't expect there are that many with that need and I gather than most mirrors would work ok.

I've done this in the past (as I wanted a https connection). It used to work so long as I wasn't trying to download when that site was offline for maintenance, maybe for updating the mirror.

l3u · 2022-12-07 13:51:13

Well, that also would be a solution.

Is it the expected behavior that apt doesn't try another mirror but just gives up right away though?! On Gentoo, we simply have a config file with a variable containing the mirrors we want to use (along with a script to check which ones will work best). As there seems to be no easy way to do this using apt & Co, I would have at least expected that it would retry …

Apart from this: Wouldn't be the mirror be exptected to actually serve the packages in question? Or does everybody choose which architectures to provide when mirroring Debian? And if so, shouldn't the mirror announce itself for leaving some architectures behind?

Sorry, I'm quite new to the Debian/Devuan universe, and a couple of things here are a bit strange ;-)

xinomilo · 2022-12-07 14:53:38

1. use a single mirror that works. eg.
deb $mirror_url chimaera main

2. use a mirrors.txt file with mirrors you want to use. exclude the one you don't want. eg.
deb mirror://path/to/mirrors.txt chimaera main

3. contact mirrors@devuan.org to fix broken mirror.

Last edited by xinomilo (2022-12-07 14:54:01)

l3u · 2022-12-07 15:40:44

Hey, thanks!

deb mirror://path/to/mirrors.txt chimaera main

looks very promising!

Is there some automated way to check which mirrors are the fastest for my location? Like Artix'/Arch's rankmirrors or Gentoo's mirrorselect?

How would I change sources.list? I tried to download http://pkgmaster.devuan.org/mirror_list.txt to/etc/apt/ and removed the mirror in question. Then I changed the sources.list from

deb http://deb.devuan.org/merged chimaera main contrib non-free
deb http://deb.devuan.org/merged chimaera-updates main contrib non-free
deb http://deb.devuan.org/devuan chimaera-proposed-updates main contrib non-free
deb http://deb.devuan.org/merged chimaera-security main contrib non-free
deb http://deb.devuan.org/merged chimaera-backports main contrib non-free

to

deb mirror://etc/apt/mirror_list.txt chimaera main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-updates main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-proposed-updates main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-security main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-backports main contrib non-free

but it dosn't work: I get

Err:1 http://etc/apt/mirror_list.txt Mirrorlist
  Could not resolve 'etc'
...

With three slashes after mirror:, it's

Err:1 http://etc/apt/mirror_list.txt Mirrorlist
  Could not resolve 'etc'

Last edited by l3u (2022-12-07 16:33:53)

golinux · 2022-12-07 16:41:47

@l3u - Mirror list is here: https://pkgmaster.devuan.org/mirror_list.txt
Mirrors are monitored by panopticon here: https://sledjhamr.org/apt-panopticon/re … t-web.html

l3u · 2022-12-07 18:00:32

Thanks, I already found https://pkgmaster.devuan.org/mirror_list.txt – but how would I use a changed local version of it?!

https://sledjhamr.org/apt-panopticon/results/Report-web.html even lists devuan.bio.lmu.de as a "faulty mirror"! Will this lead to this one being removed, or will the maintainers be contacted? I wrote some email to the LMU Munich, but I'm not sure if they will reach the correct addressee …

xinomilo · 2022-12-07 18:51:55

deb mirror+file:/etc/apt/mirror_list.txt chimaera main

mirror_list.txt should contain only mirror urls , eg

https://pkgmaster.devuan.org/merged

it's not supposed to be the same as https://pkgmaster.devuan.org/mirror_list.txt. not the same format to use.. completely different things...

and no, i don't know of a similar netselect tool for devuan.

Last edited by xinomilo (2022-12-07 18:53:31)

xinomilo · 2022-12-07 18:54:39

l3u wrote:

https://sledjhamr.org/apt-panopticon/results/Report-web.html even lists devuan.bio.lmu.de as a "faulty mirror"! Will this lead to this one being removed, or will the maintainers be contacted? I wrote some email to the LMU Munich, but I'm not sure if they will reach the correct addressee …

better contact mirrors@devuan.org

Last edited by xinomilo (2022-12-07 18:55:34)

l3u · 2022-12-07 20:51:54

Okay, I now both wrote to mirrors@devuan.org and (hopefully) to the mirror maintainers. Let's see what happens.

GlennW · 2022-12-07 21:03:55

Hi, regarding /etc/hosts

I usually use 0.0.0.0 (any(?)) for the ip, not 127.0.0.1 (local host)

I'm using it to block certain user "manual" sites that seem to only list tags, but no other info except adds and links to like-wise pages.

I hope this helps

ralph.ronnquist · 2022-12-07 23:20:49

@xinomilo: Great. That mirror+file:pathname was new one for me.

Head_on_a_Stick · 2022-12-08 07:02:54

^ +1 :-)

xinomilo · 2022-12-08 08:51:33

was sure i had that posted before : https://dev1galaxy.org/viewtopic.php?pid=24970#p24970

l3u · 2022-12-08 12:41:27

xinomilo wrote:

deb mirror+file:/etc/apt/mirror_list.txt chimaera main
mirror_list.txt should contain only mirror urls , eg
https://pkgmaster.devuan.org/merged
it's not supposed to be the same as https://pkgmaster.devuan.org/mirror_list.txt. not the same format to use.. completely different things...
and no, i don't know of a similar netselect tool for devuan.

Hey, thanks for the info!

I could get it to work with two mirror files, one for "devuan" and one for "merged":

 # cat mirrors_devuan.txt 
https://ftp.fau.de/devuan/devuan/
https://dist-mirror.fem.tu-ilmenau.de/devuan/devuan/

 # cat mirrors_merged.txt 
https://ftp.fau.de/devuan/merged/
https://dist-mirror.fem.tu-ilmenau.de/devuan/merged/

and these chages to sources.list:

 # cat sources.list
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera main contrib non-free
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera-updates main contrib non-free
deb mirror+file:/etc/apt/mirrors_devuan.txt chimaera-proposed-updates main contrib non-free
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera-security main contrib non-free
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera-backports main contrib non-free

Works now. This way, I could leave out the faulty/incomplete lmu mirror.

Thanks a lot!

The officially official Devuan Forum!

#1 2022-11-18 09:18:36

[SOLVED] Is it possible to exclude a mirror?

#2 2022-11-18 11:19:06

Re: [SOLVED] Is it possible to exclude a mirror?

#3 2022-11-18 13:19:03

Re: [SOLVED] Is it possible to exclude a mirror?

#4 2022-11-18 17:01:44

Re: [SOLVED] Is it possible to exclude a mirror?

#5 2022-11-18 17:56:33

Re: [SOLVED] Is it possible to exclude a mirror?

#6 2022-11-18 18:00:22

Re: [SOLVED] Is it possible to exclude a mirror?

#7 2022-11-21 10:29:05

Re: [SOLVED] Is it possible to exclude a mirror?

#8 2022-12-07 08:33:55

Re: [SOLVED] Is it possible to exclude a mirror?

#9 2022-12-07 08:56:15

Re: [SOLVED] Is it possible to exclude a mirror?

#10 2022-12-07 11:03:38

Re: [SOLVED] Is it possible to exclude a mirror?

#11 2022-12-07 11:28:00

Re: [SOLVED] Is it possible to exclude a mirror?

#12 2022-12-07 13:51:13

Re: [SOLVED] Is it possible to exclude a mirror?

#13 2022-12-07 14:53:38

Re: [SOLVED] Is it possible to exclude a mirror?

#14 2022-12-07 15:40:44

Re: [SOLVED] Is it possible to exclude a mirror?

#15 2022-12-07 16:41:47

Re: [SOLVED] Is it possible to exclude a mirror?

#16 2022-12-07 18:00:32

Re: [SOLVED] Is it possible to exclude a mirror?

#17 2022-12-07 18:51:55

Re: [SOLVED] Is it possible to exclude a mirror?

#18 2022-12-07 18:54:39

Re: [SOLVED] Is it possible to exclude a mirror?

#19 2022-12-07 20:51:54

Re: [SOLVED] Is it possible to exclude a mirror?

#20 2022-12-07 21:03:55

Re: [SOLVED] Is it possible to exclude a mirror?

#21 2022-12-07 23:20:49

Re: [SOLVED] Is it possible to exclude a mirror?

#22 2022-12-08 07:02:54

Re: [SOLVED] Is it possible to exclude a mirror?

#23 2022-12-08 08:51:33

Re: [SOLVED] Is it possible to exclude a mirror?

#24 2022-12-08 12:41:27

Re: [SOLVED] Is it possible to exclude a mirror?

Board footer