apt-mirror config for a local Devuan repo

golinux · 2018-03-13 00:36:01

Today, KatolaZ posted instructions for setting up a local mirror here. Copied below for reference:

Dear D1rs,
Since we are talking of creating a local or LAN Devuan mirror, I
thought that posting a working configuration for apt-mirror could be
found useful. Please find at the bottom an example of what you should
have in your /etc/apt/mirrors.list in order to get a full local Devuan
repo for amd64, i386, and sources. You can use deb.devuan.org instead
of pkgmaster.devuan.org, if you like, or any of the package mirrors
listed at:
https://pkgmaster.devuan.org/mirror_list.txt
Notice that the program apt-mirror must be executed by the user
"apt-mirror", who should have rwx access to the base_path specified in
the mirrors.list file. For more information, man apt-mirror
Useful information on setting up a Devuan package mirror can be found
at:
https://pkgmaster.devuan.org/devuan_mir … hrough.txt
If you want to setup a *public* Devuan package mirror instead, please
follow the instructions reported in the walkthrough and get in touch
as specified therein.
HTH
KatolaZ
-+-+-+-
############# config ##################
#
# base_path is the local path where your mirror will be created
set base_path    /srv/apt-mirror
#
# set mirror_path  $base_path/mirror
# set skel_path    $base_path/skel
# set var_path     $base_path/var
# set cleanscript $var_path/clean.sh
# set defaultarch  <running host architecture>
# set postmirror_script $var_path/postmirror.sh
# set run_postmirror 0
set nthreads     20
set _tilde 0
#
############# end config ##############

# mirroring package sources
deb-src http://pkgmaster.devuan.org/merged ascii main contrib non-free

# mirroring binary architectures
deb-amd64 http://pkgmaster.devuan.org/merged ascii main contrib non-free main/debian-installer
deb-i386  http://pkgmaster.devuan.org/merged ascii main contrib non-free main/debian-installer
deb-amd64 http://pkgmaster.devuan.org/devuan ascii main contrib non-free main/debian-installer
deb-i386  http://pkgmaster.devuan.org/devuan ascii main contrib non-free main/debian-installer

# cleanup obsolete stuff
clean http://pkgmaster.devuan.org/merged

Psud0nym · 2018-09-18 15:04:13

It has been a few years gone by for me now, but I recall Aptly being a way to mirror/merge and publish multiple mirrors locally and over the net/LAN.
perhaps a short guide on this would be hepful those interested in using the distribution build kit. It also supports adding local packages to the repository. it seems that this may be a great boon for those that develop custom packages.

Aptly is in the repository already.

Last edited by Psud0nym (2018-09-18 15:05:57)

aitor · 2018-10-11 07:47:34

Psud0nym wrote:

It has been a few years gone by for me now, but I recall Aptly being a way to mirror/merge and publish multiple mirrors locally and over the net/LAN.
perhaps a short guide on this would be hepful those interested in using the distribution build kit. It also supports adding local packages to the repository. it seems that this may be a great boon for those that develop custom packages.
Aptly is in the repository already.

I'm writing a guide about this in spanish.

https://dev1galaxy.org/viewtopic.php?id=2405

Udo017 · 2025-04-30 13:21:03

Hello,

I want setup an local non public mirror for my local network and I found this post. It works very well with one exception. If I put the line

deb-src https://pkgmaster.devuan.org/devuan stable main contrib non-free

in the config file, I get many errors like this:

Processing indexes: [SUse of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 1.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 4.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 5.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 6
.
.
.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 93.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 94.

On other repros from Debian, Ubuntu and Linux Mint it is works fine.

Last edited by Udo017 (2025-04-30 17:25:15)

ralph.ronnquist · 2025-05-04 23:35:56

"the config file"... which ? Could you perhaps show that config file?
which command gives that output?

EDIT: ... and which system version do you have?

EDIT 2: ... as a start point: the error reported is a "local software error" rather than badness in the data. All Source indexes have a "Files" tag, so the question would be why the local software is buggy upon seeing that tag. Therefore it's important to know which system version you have and which version the software that shows this bug has.

Udo017 · 2025-05-05 03:29:33

Thank's for that hint. First the information you ask for, the strange think's comes later.

xxx@yyy ✓ /src/test # apt-cache policy apt-mirror
apt-mirror:
  Installiert:           0.5.4-2
  Installationskandidat: 0.5.4-2
  Versionstabelle:
 *** 0.5.4-2 500
        500 http://deb.devuan.org/merged stable/main amd64 Packages
        100 /var/lib/dpkg/status
xxx@yyy ✓ /src/test # cat /etc/devuan_version 
daedalus
xxx@yyy ✓ /src/test # cat /etc/debian_version
12.7
xxx@yyy ✓ /src/test # uname -a
Linux srv01 6.1.0-23-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.99-1 (2024-07-15) x86_64 GNU/Linux
xxx@yyy ✓ /src/test #

Here my /etc/apt/mirror.list. Only one line is active:

set base_path    /src/test
#
set mirror_path  $base_path/mirror
set skel_path    $base_path/skel
set var_path     $base_path/var
set cleanscript $var_path/clean.sh
#set defaultarch  i386 amd64
# set postmirror_script $var_path/postmirror.sh
set run_postmirror 0
set nthreads     10
#set _tilde 0
#
############# end config ##############

#deb http://ftp.de.debian.org/debian stable main contrib non-free
#deb-src http://ftp.de.debian.org/debian stable main contrib non-free

# mirror additional architectures
#deb-alpha http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-amd64 http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-armel http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-hppa http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-i386 http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-ia64 http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-m68k http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-mips http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-mipsel http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-powerpc http://ftp.us.debian.org/debian unstable main contrib non-free#clean http://ftp.us.debian.org/debian

#deb-i386 http://pkgmaster.devuan.org/devuan stable main contrib non-free
#deb-amd64 http://pkgmaster.devuan.org/devuan stable main contrib non-free
#deb-i386 http://pkgmaster.devuan.org/merged stable main contrib non-free
#deb-amd64 http://pkgmaster.devuan.org/merged stable main contrib non-free
deb-src http://pkgmaster.devuan.org/merged stable main contrib non-free
#deb-src https://deb.devuan.org/merged stable main contrib non-free
#deb-src http://pkgmaster.devuan.org/devuan stable main contrib non-free
#deb-src http://pkgmaster.devuan.org/merged stable main contrib non-free

#clean https://pkgmaster.devuan.org/devuan

#deb-i386 https://archive.ubuntu.com/ubuntu jammy main universe multiverse restricted
#deb-amd64 https://archive.ubuntu.com/ubuntu jammy main universe multiverse restricted
#deb-src https://archive.ubuntu.com/ubuntu jammy main universe multiverse restricted

#clean https://archive.ubuntu.com/ubuntu

#deb-i386 http://linux-mint.froonix.org virginia main upstream import backport
#deb-amd64 http://linux-mint.froonix.org virginia main upstream import backport
#deb-src http://linux-mint.froonix.org virginia main upstream import backport

#clean http://linux-mint.froonix.org

#deb-s390 http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-sparc http://ftp.us.debian.org/debian unstable main contrib non-free
#deb-i386 https://ppa.launchpadcontent.net/kicad/kicad-9.0-releases/ubuntu jammy main
#deb-amd64 https://ppa.launchpadcontent.net/kicad/kicad-9.0-releases/ubuntu jammy main
#deb-src https://ppa.launchpadcontent.net/kicad/kicad-9.0-releases/ubuntu jammy main

#clean https://ppa.launchpadcontent.net/kicad/kicad-9.0-releases/ubuntu

#deb-i386 https://apt.syncthing.net syncthing stable
#deb-amd64 https://apt.syncthing.net syncthing stable
#deb-src https://apt.syncthing.net syncthing stable

#clean https://apt.syncthing.net

The error come while executing

xxx@yyy ✓ /src/test # apt-mirror 
Downloading 15 index files using 10 threads...
Begin time: Mon May  5 04:56:26 2025
[10]... [9]... [8]... [7]... [6]... [5]... [4]... [3]... [2]... [1]... [0]... 
End time: Mon May  5 04:56:29 2025

Processing translation indexes: []

Downloading 0 translation files using 0 threads...
Begin time: Mon May  5 04:56:29 2025
[0]... 
End time: Mon May  5 04:56:29 2025

Processing DEP-11 indexes: []

Downloading 0 dep11 files using 0 threads...
Begin time: Mon May  5 04:56:29 2025
[0]... 
End time: Mon May  5 04:56:29 2025

Processing cnf indexes: []

Downloading 0 cnf files using 0 threads...
Begin time: Mon May  5 04:56:29 2025
[0]... 
End time: Mon May  5 04:56:29 2025

Processing indexes: [SUse of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 9.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 69.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 352.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 520.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 536.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 848.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 974.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 975.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 1785.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 1787.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 1867.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 1868.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 1901.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2066.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2067.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2068.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2069.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2070.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2242.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2366.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2585.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2714.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2760.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2824.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2898.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2919.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2949.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2991.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3024.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3044.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3047.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3048.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3049.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3226.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3382.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3518.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3839.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 4117.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 4531.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 4671.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 5057.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 5177.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 8091.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 8230.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 9811.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 10121.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 10530.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 10532.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 11439.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 16749.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 17115.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 17195.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 17197.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 17364.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 17365.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 17660.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 18837.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 18840.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 18852.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 18905.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 20935.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 21205.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 21378.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 21429.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 21633.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 21742.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 22382.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 22538.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 22609.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 22643.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 22823.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 23569.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 26922.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 26923.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 26924.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 26925.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 26970.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 27154.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 27285.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 27311.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 30609.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 30852.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 31283.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 31660.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 31673.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 31735.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 32113.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 32600.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 32605.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 32698.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 32842.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 33700.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 33791.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 33861.
]

95.0 GiB will be downloaded into archive.
Downloading 106463 archive files using 10 threads...
Begin time: Mon May  5 04:56:32 2025
[10]... ^C
xxx@yyy ✗ /src/test #

Now the strange think!

All Source indexes have a "Files" tag, ...

I can not confirm that !?

xxx@yyy ✗ /src/test #wget https://pkgmaster.devuan.org/devuan/dists/stable/main/source/Sources.gz
--2025-05-05 04:37:40--  https://pkgmaster.devuan.org/devuan/dists/stable/main/source/Sources.gz
Auflösen des Hostnamens pkgmaster.devuan.org (pkgmaster.devuan.org)… 116.202.138.216, 2a01:4f8:fff1:d::74ca:8ad8
Verbindungsaufbau zu pkgmaster.devuan.org (pkgmaster.devuan.org)|116.202.138.216|:443 … verbunden.
HTTP-Anforderung gesendet, auf Antwort wird gewartet … 200 OK
Länge: 32246 (31K) [text/plain]
Wird in »Sources.gz« gespeichert.

Sources.gz                              100%[============================================================================>]  31,49K  --.-KB/s    in 0,001s  

2025-05-05 04:37:41 (40,9 MB/s) - »Sources.gz« gespeichert [32246/32246]

xxx@yyy ✓ /src/test # sha256sum Sources.gz 
c056312c06721b9e7ea4bcadc4135784e87c071351f02339aff25aed4bc2d652  Sources.gz
xxx@yyy ✓ /src/test # zcat Sources.gz | grep Files:
xxx@yyy ✗ /src/test # zcat Sources.gz | grep Section:
Section: net
Section: python
Section: debian-installer
Section: admin
.
.
.
Section: utils
Section: xfce
Section: games
Section: x11
xxx@yyy ✓ /src/test #

There is no "Files:" tag ...

xxx@yyy1 ✓ /src/test # zcat Sources.gz | head -n 50
Package: 389-ds-base
Binary: 389-ds-base-libs, 389-ds-base-dev, 389-ds-base, python3-lib389
Version: 1.4.4.11-2+devuan0.1
Maintainer: Ben Stack <bgstack15@gmail.com>
Build-Depends: libcmocka-dev, debhelper-compat (= 12), dh-python, doxygen, libbz2-dev, libcrack2-dev, libdb-dev, libevent-dev, libicu-dev, libkrb5-dev, libldap2-dev (>= 2.4.28), libltdl-dev, libnspr4-dev, libnss3-dev, libpam0g-dev, libpci-dev, libpcre3-dev, libperl-dev, libsasl2-dev, libsnmp-dev, libssl-dev, libelogind-dev, lsb-base, pkg-config, python3-all-dev, python3-argcomplete, python3-argparse-manpage, python3-dateutil, python3-ldap, python3-packaging, python3-selinux, python3-sepolicy, python3-setuptools, rsync, zlib1g-dev
Architecture: any all
Standards-Version: 4.5.0
Format: 3.0 (quilt)
Vcs-Browser: https://git.devuan.org/devuan-packages/389-ds-base
Vcs-Git: https://git.devuan.org/devuan-packages/389-ds-base.git
Checksums-Sha256:
 9bf9b53b16b5a8a2279711ca6c017a13451180bfca762a800c9271fad0da30bd 2293 389-ds-base_1.4.4.11-2+devuan0.1.dsc
 71302c3f04a2440be85dd87c5828cbd9e52c24947afeb5f869911dc3ea9a8fc5 3706596 389-ds-base_1.4.4.11.orig.tar.xz
 08a7271cdc1f0ce0f0df849d3eb54f63d77d01552dc023600cd33602bc245c63 445704 389-ds-base_1.4.4.11-2+devuan0.1.debian.tar.xz
Origin: Devuan
Homepage: https://directory.fedoraproject.org
Package-List: 
 389-ds-base deb net optional arch=any
 389-ds-base-dev deb libdevel optional arch=any
 389-ds-base-libs deb libs optional arch=any
 python3-lib389 deb net optional arch=all
Directory: pool/main/3/389-ds-base
Priority: extra
Section: net

Package: acdcli
Binary: python3-acdcli
Version: 0.3.2-10
Maintainer: Franco (nextime) Lanza <nextime@devuan.org>
Build-Depends: dh-python, libfuse-dev, python3-setuptools, python3-all, debhelper (>= 9), python3-requests-toolbelt, python3-dateutil, python3-fusepy, python3-colorama, python3-appdirs
Architecture: all
Standards-Version: 3.9.6
Format: 3.0 (quilt)
Checksums-Sha256:
 b145bf8237fde62a64febfcade3eb9abd737828b8d40ff7647eb4c6ec58414c4 1509 acdcli_0.3.2-10.dsc
 64362e4c2c45c3881f2aa0d7c5491a1e6db28fb0cd66bb8338098708ce28e37a 51508 acdcli_0.3.2.orig.tar.gz
 19ab2163f703ff7de2d9130d0fc9c79dd314e5a683897430f3624e32e4ce93b3 1480 acdcli_0.3.2-10.debian.tar.xz
Homepage: https://github.com/yadayada/acd_cli
Package-List: 
 python3-acdcli deb python optional arch=all
Directory: pool/main/a/acdcli
Priority: extra
Section: python

Package: anna
Binary: anna
Version: 1.90devuan1
Maintainer: Ralph Ronnquist <ralph.ronnquist@gmail.com>
Uploaders: Antonio Rendina <arendina13@gmail.com>
Build-Depends: debhelper-compat (= 13), libdebconfclient0-dev, libdebian-installer4-dev
xxx@yyy ✓ /src/test #

But with a file from debian it is ok:

xxx@yyy ✓ /src/test # wget http://ftp.de.debian.org/debian/dists/stable/main/source/Sources.gz
--2025-05-05 05:12:07--  http://ftp.de.debian.org/debian/dists/stable/main/source/Sources.gz
Auflösen des Hostnamens ftp.de.debian.org (ftp.de.debian.org)… 141.76.2.4, 2a13:dd80:deb::deb
Verbindungsaufbau zu ftp.de.debian.org (ftp.de.debian.org)|141.76.2.4|:80 … verbunden.
HTTP-Anforderung gesendet, auf Antwort wird gewartet … 200 OK
Länge: 12746068 (12M) [application/x-gzip]
Wird in »Sources.gz« gespeichert.

Sources.gz                             100%[============================================================================>]  12,16M  6,66MB/s    in 1,8s    

2025-05-05 05:12:09 (6,66 MB/s) - »Sources.gz« gespeichert [12746068/12746068]

xxx@yyy ✗ /src/test # zcat Sources.gz | grep Files:
Files:
Files:
Files:
Files:
Files:
Files:
.
.
.

ralph.ronnquist · 2025-05-05 06:55:19

Well, you should rather check pkgmaster.devuan.org/merged/dists/stable/main/source/Sources.gz
(which is what you use in the config for apt-mirror),
but the question is still why apt-mirror ends up with that uninitialized array slot.

In any case, you should replace "stable" with "daedalus" in your sources.list. The name "stable" will move to something else all of a sudden while "daedalus" will remain being what it is.

It appears to be a bug in apt-mirror; but you say this doesn't happen with an equivalent mirroring of a debian repo? Which one?

Udo017 · 2025-05-05 15:14:35

The test with pkgmaster.devuan.org/merged/dists/stable/main/source/Sources.gz results in this: The are some Files: lines but not in all packages.

xxx@yyy ✓ ~ # wget https://pkgmaster.devuan.org/merged/dists/stable/main/source/Sources.gz
xxx@yyy ✓ ~ # zcat Sources.gz | grep -c Files:
34209
xxx@yyy ✓ ~ # zcat Sources.gz | grep -c Section:
34303
xxx@yyy ✓ ~ #

In 94 packages are no Files: tag. This fits the 94 error messages from my first post.

All other repros in the mirror.list for deb-i386, deb-amd64 and deb-src are working, including those of Ubuntu, Linux Mint, the ppa from kicad and the ppa from syncthing. Only the deb-src entries of devuan cause problems.

chris2be8 · 2025-05-05 16:13:02

Please post output from:
file /usr/bin/apt-mirror

If it's some script, eg perl, then read it and see what line 920 is doing. If you don't know the language then post line 920 and a few lines each side of it.

Udo017 · 2025-05-05 19:53:55

It is a perl script. Line 920 is in the middle foreach ( split( /\n/, $lines{"Files:"} ) )

xxx@yyy ✓ ~ # file /usr/bin/apt-mirror 
/usr/bin/apt-mirror: Perl script text executable
xxx@yyy ✓ ~ # sed -n 910,930p /usr/bin/apt-mirror 
            print FILES_SHA1 $lines{"SHA1:"} . "  " . remove_double_slashes( $path . "/" . $lines{"Filename:"} ) . "\n" if defined $lines{"SHA1:"};
            print FILES_SHA256 $lines{"SHA256:"} . "  " . remove_double_slashes( $path . "/" . $lines{"Filename:"} ) . "\n" if defined $lines{"SHA256:"};
            if ( need_update( $mirror . "/" . $lines{"Filename:"}, $lines{"Size:"} ) )
            {
                print FILES_NEW remove_double_slashes( $uri . "/" . $lines{"Filename:"} ) . "\n";
                add_url_to_download( $uri . "/" . $lines{"Filename:"}, $lines{"Size:"} );
            }
        }
        else
        {    # Sources index
            foreach ( split( /\n/, $lines{"Files:"} ) )
            {
                next if $_ eq '';
                my @file = split;
                die("apt-mirror: invalid Sources format") if @file != 3;
                $skipclean{ remove_double_slashes( $path . "/" . $lines{"Directory:"} . "/" . $file[2] ) } = 1;
                print FILES_ALL remove_double_slashes( $path . "/" . $lines{"Directory:"} . "/" . $file[2] ) . "\n";
                print FILES_MD5 $file[0] . "  " . remove_double_slashes( $path . "/" . $lines{"Directory:"} . "/" . $file[2] ) . "\n";
                if ( need_update( $mirror . "/" . $lines{"Directory:"} . "/" . $file[2], $file[1] ) )
                {
                    print FILES_NEW remove_double_slashes( $uri . "/" . $lines{"Directory:"} . "/" . $file[2] ) . "\n";
xxx@yyy ✓ ~ #

I don't understand perl, but I'm sure he is looking for the Files: entries. As shown, however, they are not present (everywhere).

ralph.ronnquist · 2025-05-06 00:35:57

pkgmaster.devuan.org/devuan experimental is the only repo to mirror.

pkgmaster.devuan.org/devuan main contains the special devuan packages, i.e. forked and extras and those should be accessed via
pkgmaster.devuan.org/merged main rather, or
deb.devuan.org/merged main would really be better.

pkgmaster.devuan.org/devuan contrib is empty, and
pkgmaster.devuan.org/devuan non-free-firmware is empty.

It looks like apt-mirror doesn't like empty repositories. I wouldn't consider it a bug worth fixing, but you may of course lodge a bug report to debian about that if you think differently.

Udo017 · 2025-05-06 15:55:01

Puting only the line deb-src http://pkgmaster.devuan.org/devuan experimental main in the mirror.list results in this:

xxx@yyy ✓ ~ # apt-mirror 
Downloading 7 index files using 7 threads...
Begin time: Tue May  6 17:37:44 2025
[7]... [6]... [5]... [4]... [3]... [2]... [1]... [0]... 
End time: Tue May  6 17:37:44 2025

Processing translation indexes: []

Downloading 0 translation files using 0 threads...
Begin time: Tue May  6 17:37:44 2025
[0]... 
End time: Tue May  6 17:37:44 2025

Processing DEP-11 indexes: []

Downloading 0 dep11 files using 0 threads...
Begin time: Tue May  6 17:37:44 2025
[0]... 
End time: Tue May  6 17:37:44 2025

Processing cnf indexes: []

Downloading 0 cnf files using 0 threads...
Begin time: Tue May  6 17:37:44 2025
[0]... 
End time: Tue May  6 17:37:44 2025

Processing indexes: [SUse of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 1.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 2.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 3.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 4.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 5.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 6.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 7.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 8.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 9.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 10.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 11.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 12.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 920, <STREAM> line 13.
]

0 bytes will be downloaded into archive.
Downloading 0 archive files using 0 threads...
Begin time: Tue May  6 17:37:44 2025
[0]... 
End time: Tue May  6 17:37:44 2025

0 bytes in 0 files and 0 directories can be freed.
Run /src/test/var/clean.sh for this purpose.

xxx@yyy ✓ ~ #

Here is the same problem I pointed out: In the https://pkgmaster.devuan.org/devuan/dis … Sources.gz are 13 packages listed. Non of these have an Files: entry.
I am sure that the Files: entry in the index files is necessary for the functioning of the repository. I think something is wrong here if the entry is not created when creating the index files. I have no idea when and who created the index files and why the Files: entry is not created.

chris2be8 · 2025-05-06 16:29:17

That confirms my suspicion from the error message that it's a perl script. But I don't know enough about package formatting to offer any more help. Sorry.

ralph.ronnquist · 2025-05-06 23:00:10

Did you clean out all the old files before running that test? Because that file is a single index and your output shows processing of 7 index files. If you want to pursue that further you will need to make sure to output the problem filenames as well.

Perhaps you should clean out all the old stuff and set up the sources according to my instruction above. Don't include empty repositories. You may consider it all a bug that apt-mirror cannot deal with empty repositories. I don't.

EDIT: I see that the experimental repo Source index doesn't have a "Files:" tag. If that is the reason apt-mirror takes issue with it, I agree that apt-mirror seems to have a bug (being unable to deal with that repo format). You may need exclude that repo (as well) from your mirroring.

The officially official Devuan Forum!

#1 2018-03-13 00:36:01

apt-mirror config for a local Devuan repo

#2 2018-09-18 15:04:13

Re: apt-mirror config for a local Devuan repo

#3 2018-10-11 07:47:34

Re: apt-mirror config for a local Devuan repo

#4 2025-04-30 13:21:03

Re: apt-mirror config for a local Devuan repo

#5 2025-05-04 23:35:56

Re: apt-mirror config for a local Devuan repo

#6 2025-05-05 03:29:33

Re: apt-mirror config for a local Devuan repo

#7 2025-05-05 06:55:19

Re: apt-mirror config for a local Devuan repo

#8 2025-05-05 15:14:35

Re: apt-mirror config for a local Devuan repo

#9 2025-05-05 16:13:02

Re: apt-mirror config for a local Devuan repo

#10 2025-05-05 19:53:55

Re: apt-mirror config for a local Devuan repo

#11 2025-05-06 00:35:57

Re: apt-mirror config for a local Devuan repo

#12 2025-05-06 15:55:01

Re: apt-mirror config for a local Devuan repo

#13 2025-05-06 16:29:17

Re: apt-mirror config for a local Devuan repo

#14 2025-05-06 23:00:10

Re: apt-mirror config for a local Devuan repo

Board footer