The officially official Devuan Forum!

You are not logged in.

#1 2022-11-18 09:18:36

l3u
Member
Registered: 2022-07-10
Posts: 63  

[SOLVED] Is it possible to exclude a mirror?

Hi all,

can I exclude a mirror from being used? I have the problem that apt always queries 2001:4ca0:4300::1:22, which leads to http://debian.bio.lmu.de/debian/pool/main/ being used. This mirror apparently has problems, as I often – not always – get errors about files not being found.

When I set the nameserver to e.g. 8.8.8.8 in /etc/resov.conf, another mirror is used, and installation of packages or updating works.

So: Can I exclude a specific mirror from being used?

Thanks for all help!

Offline

#2 2022-11-18 11:19:06

Altoid
Member
Registered: 2017-05-07
Posts: 1,591  

Re: [SOLVED] Is it possible to exclude a mirror?

Hello:

l3u wrote:

can I exclude a mirror ...

What Devuan version are you running and what mirrors are you using?

Please post the output of uname -a and cat /etc/apt/sources.list.

Also, have a look at this page.
ie: the "Default configurations" list

Best,

O.

Offline

#3 2022-11-18 13:19:03

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

It's Chimaera (the kernel version is not really relevant here, is it?).

Here's the sources.list:

deb http://deb.devuan.org/merged chimaera main contrib non-free
deb http://deb.devuan.org/merged chimaera-updates main contrib non-free
deb http://deb.devuan.org/devuan chimaera-proposed-updates main contrib non-free
deb http://deb.devuan.org/merged chimaera-security main contrib non-free
deb http://deb.devuan.org/merged chimaera-backports main contrib non-free

Last edited by l3u (2022-11-18 13:19:58)

Offline

#4 2022-11-18 17:01:44

Altoid
Member
Registered: 2017-05-07
Posts: 1,591  

Re: [SOLVED] Is it possible to exclude a mirror?

Hello:

l3u wrote:

... Chimaera ...

Right.

l3u wrote:

... kernel version is not really relevant here, is it? ...

No.
But I like to see what the output says, just habit.

l3u wrote:
deb http://deb.devuan.org/merged chimaera main contrib non-free
deb http://deb.devuan.org/merged chimaera-updates main contrib non-free
deb http://deb.devuan.org/devuan chimaera-proposed-updates main contrib non-free
deb http://deb.devuan.org/merged chimaera-security main contrib non-free
deb http://deb.devuan.org/merged chimaera-backports main contrib non-free

Seems correct.
I would not use devuan chimaera-proposed-updates, because proposed.
Obviously, YMMV.

I think the explanation could be here.

Devuan has a network of package repository mirrors in place. The mirror network is accessible using the FQDN "deb.devuan.org" via http NOT https. Country Codes (CC) are currently unavailable but a specific mirror from the list can be accessed using the corresponding BaseURL.

The list is here.

There is/maybe some issue with FQDN "deb.devuan.org" and how/when it connects to debian.bio.lmu.de.

You could be able to solve the problem by following the suggestion above.
ie: ... a specific mirror from the list can be accessed ...

Best,

A.

Last edited by Altoid (2022-11-18 17:03:34)

Offline

#5 2022-11-18 17:56:33

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

Well,

devuan chimaera-proposed-updates

is there because it's the default – I never touched this file.

However, I want quite the opposite of "... a specific mirror from the list can be accessed ..." – I don't want to connect only to one specific mirror, but exclude one specific mirror …

Offline

#6 2022-11-18 18:00:22

Head_on_a_Stick
Member
From: London
Registered: 2019-03-24
Posts: 3,125  
Website

Re: [SOLVED] Is it possible to exclude a mirror?

Block the mirror in /etc/hosts, the round robin thingy will just find another path.


Brianna Ghey — Rest In Power

Offline

#7 2022-11-21 10:29:05

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

This is a nice idea, I'll try that! Thanks :-)

Offline

#8 2022-12-07 08:33:55

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

If I get this correctly, blocking a host through /etc/hosts would look like this:

127.0.0.1    debian.bio.lmu.de

Alas, this doesn't help – instead of e.g.

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
  ninja-build
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 97.8 kB of archives.
After this operation, 317 kB of additional disk space will be used.
Err:1 http://deb.devuan.org/merged chimaera/main armel ninja-build armel 1.10.1-1
  404  Not Found [IP: 2001:4ca0:4300::1:22 80]
E: Failed to fetch http://debian.bio.lmu.de/debian/pool/main/n/ninja-build/ninja-build_1.10.1-1_armel.deb  404  Not Found [IP: 2001:4ca0:4300::1:22 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

I then get

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
  ninja-build
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 97.8 kB of archives.
After this operation, 317 kB of additional disk space will be used.
Err:1 http://deb.devuan.org/merged chimaera/main armel ninja-build armel 1.10.1-1
  404  Not Found [IP: 127.0.0.1 80]
E: Failed to fetch http://debian.bio.lmu.de/debian/pool/main/n/ninja-build/ninja-build_1.10.1-1_armel.deb  404  Not Found [IP: 127.0.0.1 80]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

So apt doesn't try the next round-robin mirror but just gives up, as on 127.0.0.1, the package isn't there as well :-(

Offline

#9 2022-12-07 08:56:15

ralph.ronnquist
Administrator
From: Battery Point, Tasmania, AUS
Registered: 2016-11-30
Posts: 1,268  

Re: [SOLVED] Is it possible to exclude a mirror?

That's not how it works.

The s.c. round-robin is merely that the domain name has multiple resolutions that the authorative nameserver serves in different orders upon subsequent requests; apt just picks whichever it receives first.

Afaik there's no easy way to selectively exclude servers from the list.

You may however use /etc/hosts to override the name lookup with your favourite resolution. If, say, you prefer m10k.jp you would add their IP as resolution for deb.devuan.org:

160.16.137.156  deb.devuan.org

For anything more advanced I think you will need a local nameserver.

Offline

#10 2022-12-07 11:03:38

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

Okay, then, it would get complicated ;-) Not that I don't have or use local nameservers, but it would really suck to work around this by installing BIND or whatever on my Raspberry Pi just to really exclude this very mirror.

Maybe, this is actually a syncing problem. Seems like they have all kinds of ARM packages – but not the armel one needed by my Raspberry Pi 1. I think I'll contact the mirror admin. Maybe, they can or want to change this. Quasi as an upstream bugfix.

Offline

#11 2022-12-07 11:28:00

Marjorie
Member
From: Teignmouth, UK
Registered: 2019-06-09
Posts: 221  

Re: [SOLVED] Is it possible to exclude a mirror?

You could just chose one mirror, from those in the roundrobin, that works for you.

The main purpose of the roundrobin is to spread the load, but if you have a specific need then one person fixing their choice of mirror won't be disruptive.
If lots of you were to need a particular mirror as it was the only one that serves ARM packages then that might be more of a problem, but I don't expect there are that many with that need and I gather than most mirrors would work ok.

I've done this in the past (as I wanted a https connection). It used to work so long as I wasn't trying to download when that site was offline for maintenance, maybe for updating the mirror.

Offline

#12 2022-12-07 13:51:13

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

Well, that also would be a solution.

Is it the expected behavior that apt doesn't try another mirror but just gives up right away though?! On Gentoo, we simply have a config file with a variable containing the mirrors we want to use (along with a script to check which ones will work best). As there seems to be no easy way to do this using apt & Co, I would have at least expected that it would retry …

Apart from this: Wouldn't be the mirror be exptected to actually serve the packages in question? Or does everybody choose which architectures to provide when mirroring Debian? And if so, shouldn't the mirror announce itself for leaving some architectures behind?

Sorry, I'm quite new to the Debian/Devuan universe, and a couple of things here are a bit strange ;-)

Offline

#13 2022-12-07 14:53:38

xinomilo
Unknown
Registered: 2017-07-02
Posts: 315  

Re: [SOLVED] Is it possible to exclude a mirror?

1. use a single mirror that works. eg.
deb $mirror_url chimaera main

2. use a mirrors.txt file with mirrors you want to use. exclude the one you don't want. eg.
deb mirror://path/to/mirrors.txt chimaera main

3. contact mirrors@devuan.org to fix broken mirror.

Last edited by xinomilo (2022-12-07 14:54:01)

Offline

#14 2022-12-07 15:40:44

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

Hey, thanks!

deb mirror://path/to/mirrors.txt chimaera main

looks very promising!

Is there some automated way to check which mirrors are the fastest for my location? Like Artix'/Arch's rankmirrors or Gentoo's mirrorselect?

How would I change sources.list? I tried to download http://pkgmaster.devuan.org/mirror_list.txt to/etc/apt/ and removed the mirror in question. Then I changed the sources.list from

deb http://deb.devuan.org/merged chimaera main contrib non-free
deb http://deb.devuan.org/merged chimaera-updates main contrib non-free
deb http://deb.devuan.org/devuan chimaera-proposed-updates main contrib non-free
deb http://deb.devuan.org/merged chimaera-security main contrib non-free
deb http://deb.devuan.org/merged chimaera-backports main contrib non-free

to

deb mirror://etc/apt/mirror_list.txt chimaera main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-updates main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-proposed-updates main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-security main contrib non-free
deb mirror://etc/apt/mirror_list.txt chimaera-backports main contrib non-free

but it dosn't work: I get

Err:1 http://etc/apt/mirror_list.txt Mirrorlist
  Could not resolve 'etc'
...

With three slashes after mirror:, it's

Err:1 http://etc/apt/mirror_list.txt Mirrorlist
  Could not resolve 'etc'

Last edited by l3u (2022-12-07 16:33:53)

Offline

#15 2022-12-07 16:41:47

golinux
Administrator
Registered: 2016-11-25
Posts: 3,340  

Re: [SOLVED] Is it possible to exclude a mirror?

@l3u - Mirror list is here: https://pkgmaster.devuan.org/mirror_list.txt
Mirrors are monitored by panopticon here: https://sledjhamr.org/apt-panopticon/re … t-web.html

Offline

#16 2022-12-07 18:00:32

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

Thanks, I already found https://pkgmaster.devuan.org/mirror_list.txt – but how would I use a changed local version of it?!

https://sledjhamr.org/apt-panopticon/results/Report-web.html even lists devuan.bio.lmu.de as a "faulty mirror"! Will this lead to this one being removed, or will the maintainers be contacted? I wrote some email to the LMU Munich, but I'm not sure if they will reach the correct addressee …

Offline

#17 2022-12-07 18:51:55

xinomilo
Unknown
Registered: 2017-07-02
Posts: 315  

Re: [SOLVED] Is it possible to exclude a mirror?

deb mirror+file:/etc/apt/mirror_list.txt chimaera main

mirror_list.txt should contain only mirror urls , eg

https://pkgmaster.devuan.org/merged

it's not supposed to be the same as https://pkgmaster.devuan.org/mirror_list.txt. not the same format to use.. completely different things...

and no, i don't know of a similar netselect tool for devuan.

Last edited by xinomilo (2022-12-07 18:53:31)

Offline

#18 2022-12-07 18:54:39

xinomilo
Unknown
Registered: 2017-07-02
Posts: 315  

Re: [SOLVED] Is it possible to exclude a mirror?

l3u wrote:

https://sledjhamr.org/apt-panopticon/results/Report-web.html even lists devuan.bio.lmu.de as a "faulty mirror"! Will this lead to this one being removed, or will the maintainers be contacted? I wrote some email to the LMU Munich, but I'm not sure if they will reach the correct addressee …

better contact mirrors@devuan.org

Last edited by xinomilo (2022-12-07 18:55:34)

Offline

#19 2022-12-07 20:51:54

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

Okay, I now both wrote to mirrors@devuan.org and (hopefully) to the mirror maintainers. Let's see what happens.

Offline

#20 2022-12-07 21:03:55

GlennW
Member
From: Brisbane, Australia
Registered: 2019-07-18
Posts: 650  

Re: [SOLVED] Is it possible to exclude a mirror?

Hi, regarding /etc/hosts

I usually use 0.0.0.0 (any(?)) for the ip, not 127.0.0.1 (local host)

I'm using it to block certain  user "manual" sites that seem to only list tags, but no other info except adds and links to like-wise pages.

I hope this helps


pic from 1993, new guitar day.

Offline

#21 2022-12-07 23:20:49

ralph.ronnquist
Administrator
From: Battery Point, Tasmania, AUS
Registered: 2016-11-30
Posts: 1,268  

Re: [SOLVED] Is it possible to exclude a mirror?

@xinomilo: Great. That mirror+file:pathname was new one for me.

Offline

#22 2022-12-08 07:02:54

Head_on_a_Stick
Member
From: London
Registered: 2019-03-24
Posts: 3,125  
Website

Re: [SOLVED] Is it possible to exclude a mirror?

^ +1 :-)


Brianna Ghey — Rest In Power

Offline

#23 2022-12-08 08:51:33

xinomilo
Unknown
Registered: 2017-07-02
Posts: 315  

Re: [SOLVED] Is it possible to exclude a mirror?

was sure i had that posted before : https://dev1galaxy.org/viewtopic.php?pid=24970#p24970 smile

Offline

#24 2022-12-08 12:41:27

l3u
Member
Registered: 2022-07-10
Posts: 63  

Re: [SOLVED] Is it possible to exclude a mirror?

xinomilo wrote:
deb mirror+file:/etc/apt/mirror_list.txt chimaera main

mirror_list.txt should contain only mirror urls , eg

https://pkgmaster.devuan.org/merged

it's not supposed to be the same as https://pkgmaster.devuan.org/mirror_list.txt. not the same format to use.. completely different things...

and no, i don't know of a similar netselect tool for devuan.

Hey, thanks for the info!

I could get it to work with two mirror files, one for "devuan" and one for "merged":

 # cat mirrors_devuan.txt 
https://ftp.fau.de/devuan/devuan/
https://dist-mirror.fem.tu-ilmenau.de/devuan/devuan/
 # cat mirrors_merged.txt 
https://ftp.fau.de/devuan/merged/
https://dist-mirror.fem.tu-ilmenau.de/devuan/merged/

and these chages to sources.list:

 # cat sources.list
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera main contrib non-free
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera-updates main contrib non-free
deb mirror+file:/etc/apt/mirrors_devuan.txt chimaera-proposed-updates main contrib non-free
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera-security main contrib non-free
deb mirror+file:/etc/apt/mirrors_merged.txt chimaera-backports main contrib non-free

Works now. This way, I could leave out the faulty/incomplete lmu mirror.

Thanks a lot!

Offline

Board footer