Make a live-CD with live-sdk

fsmithred · 2017-06-29 13:17:06

Ged, if you have a local repository that's complete enough to contain all you need, I assume that it would work. I think you just need to edit the debootstrap command to point to your own repo. Look in zlibs/bootstrap.

There are several possible locations of isohdpfx.bin. Maybe we should be finding it instead of hard-coding the location. Look at zlibs/iso.

Ged · 2017-06-29 13:38:28

Hello and thanks for the reply.

I'll take a look at that debootstrap command but it isn't a local mirror, it's a caching proxy which uses apt-cacher-ng.
Not sure I'd want to set up a full mirror just for this.

(Yeah, it took me a while to find isohdpfx.bin.

Ged · 2017-07-01 19:49:24

Hello again,

modifying the debootstrap command only affected the package sources for stage 1, so in the end I modified the value of 'mirror' in lib/libdevuansdk/config (which means that source.list gets the same value so I'll need to fix that up near the end of the build). I've burned a CD and it boots and lets me log in OK, so more or less everything seems to be working. Now I need to think a bit more about the packages I need to install.

The image doesn't seem to be bootable directly from a USB stick, just wondering if there's an easy way to achieve that?

fsmithred · 2017-07-01 20:39:40

It should be bootable from a usb stick. Image the stick with dd like you would with any other isohybrid. That's what isohdpfx.bin is for. What are you getting when you try to boot the usb?

Ged · 2017-07-01 20:59:58

Hmmmm.... I did image the stick as normal. When I try to boot from it the machine just boots from the hard drive, like the stick wasn't there, but I can mount the USB stick partition after the machine has booted from the HDD. The same machine boots fine from the same image on a CD.

Well as long as I know it's supposed to boot I can investigate why it isn't working. It might be something weird with the machine's firmware or something. I'll let you know what I find. Thanks again for the help.

fsmithred · 2017-07-01 21:39:55

F12, F8, ESC or some other key might get you to a boot device menu where you can choose the usb.

Ged · 2017-07-01 22:10:30

yeah, I did all that. It offers to boot on the stick and then doesn't.

Don't worry, I'll work something out thanks.

Ozi · 2017-07-06 03:38:31

Ged wrote:

Hello and thanks for the reply.
I'll take a look at that debootstrap command but it isn't a local mirror, it's a caching proxy which uses apt-cacher-ng.
Not sure I'd want to set up a full mirror just for this.
(Yeah, it took me a while to find isohdpfx.bin.

Hi All

I use apt-cacher as well. Been using it for live-build for some years.

_MIRROR_BINARY="http://localhost:3142/packages.devuan.org/merged"
_MIRROR_BINARY="http://localhost:3142/ftp.us.debian.org/debian/"

Ged · 2017-07-06 08:27:45

Ozi wrote:

I use apt-cacher as well. Been using it for live-build for some years.
_MIRROR_BINARY="http://localhost:3142/packages.devuan.org/merged"
_MIRROR_BINARY="http://localhost:3142/ftp.us.debian.org/debian/"

Hi Ozi, thanks for the tip, but I think I'm missing something...

laptop3:~/live-sdk$ > grep -r MIRROR_BINARY
laptop3:~/live-sdk$ >

To use my local cache I set

mirror="http://192.168.44.47:3142/auto.mirror.devuan.org/merged"

in live-sdk/lib/libdevuansdk/config

Is there some doc somewhere explaining your use of _MIRROR_BINARY?

pcalvert · 2017-07-07 00:19:41

I briefly played with apt-cacher-ng, but ended up dumping it. I am now using squid-deb-proxy instead.

Phil

Ozi · 2017-07-07 02:25:10

Ged wrote:

Ozi wrote:
I use apt-cacher as well. Been using it for live-build for some years.
_MIRROR_BINARY="http://localhost:3142/packages.devuan.org/merged"
_MIRROR_BINARY="http://localhost:3142/ftp.us.debian.org/debian/"
Hi Ozi, thanks for the tip, but I think I'm missing something...
laptop3:~/live-sdk$ > grep -r MIRROR_BINARY
laptop3:~/live-sdk$ > 
To use my local cache I set
mirror="http://192.168.44.47:3142/auto.mirror.devuan.org/merged"
in live-sdk/lib/libdevuansdk/config
Is there some doc somewhere explaining your use of _MIRROR_BINARY?

_MIRROR_BINARY is from my live-build setups.

And my point was that to wire up apt-cacher for live-sdk the url for apt-cacher would be something like : "http://localhost:3142/packages.devuan.org/merged" which would go in libdevuansdk config.

Ozi · 2017-07-07 02:30:11

pcalvert wrote:

I briefly played with apt-cacher-ng, but ended up dumping it. I am now using squid-deb-proxy instead.
Phil

apt-cacher-ng takes a little work to configure it to work for devuan. It doesn't by default come with config for devuan.

@phil - what do you find better with squid-deb-proxy?

Ged · 2017-07-07 07:29:21

Ozi wrote:

Ged wrote:
Is there some doc somewhere explaining your use of _MIRROR_BINARY?
_MIRROR_BINARY is from my live-build setups.

Ah, my mistake. I took your "live-build" to mean "live-sdk".

... for live-sdk the url for apt-cacher would be something like : "http://localhost:3142/packages.devuan.org/merged" which would go in libdevuansdk config.

Sure, as per my post that's more or less what I'm doing with live-sdk.

============

In your reply to pcalvert you wrote

... apt-cacher-ng takes a little work to configure it to work for devuan. It doesn't by default come with config for devuan.

That makes me nervous that I might have missed something. Do you mind posting a complete Devuan apt config?

pcalvert · 2017-07-07 21:03:22

Ozi wrote:

@phil - what do you find better with squid-deb-proxy?

For me, apt-cacher-ng was flakey, and one of the features simply didn't work. When I was doing some research on the matter I found comments by others who had similar experiences with apt-cacher-ng. That research also led me to squid-deb-proxy, which I decided to try. After I figured out how to configure it, it has been working without problems. I did have a problem with it once, but it was probably my fault -- I installed it on a fresh system and it refused to start up using the old cache. After I deleted the old cache and let it create a new one, everything was fine.

Also, getting live-build to work with squid-deb-proxy was simple.

From my /etc/live/build.conf file:

# The line below is for squid-deb-proxy.
LB_APT_HTTP_PROXY="http://localhost:8000/"
LB_MIRROR_BOOTSTRAP="http://packages.devuan.org/merged"
LB_MIRROR_CHROOT_SECURITY="http://packages.devuan.org/merged"
LB_MIRROR_BINARY="http://packages.devuan.org/merged"
LB_MIRROR_BINARY_SECURITY="http://packages.devuan.org/merged"

Phil

Ozi · 2017-07-11 05:41:01

Hi Phil

That's great!

And that should avoid the problem I had of "http://localhost:3142/packages.devuan.org/merged" ending up in /etc/apt/sources.list!

Thanks

ozi

pcalvert · 2017-07-11 22:03:22

Here are some more config changes I had to make to get squid-deb-proxy to work.

Path: /etc/squid-deb-proxy/mirror-dstdomain.acl

# mirror-dstdomain.conf
# 
# network destinations that are allowed by this cache

# the default mirror names on debian are ftp[0-9]*\.[a-z]+\.debian\.org
# but that would require (slow) regexp matching, so for now we allow
# www.debian.org and friends here too
.debian.org 
cdn.debian.net
http.debian.net
httpredir.debian.org

# default mirrors
#ftp.debian.org 
security.debian.org

# additional destinations can be added to the directory:
#  /etc/squid-deb-proxy/mirror-dstdomain.acl.d

Path: /etc/squid-deb-proxy/mirror-dstdomain.acl.d/20-extra [a new file]

# Devuan mirrors
.devuan.org
us.mirror.devuan.org

# Grml mirrors
.grml.org
deb.grml.org

# U.S. Debian mirrors
debian.gtisc.gatech.edu
ftp-chi.osuosl.org
mirror-0.csail.mit.edu
ftp-nyc.osuosl.org

Adjust the above to fit your situation.

Phil

Radagast · 2017-07-21 09:28:47

I am trying to build a basic i386 iso, no blend, but fail with the following errors:

tee: /path/to/devuan_sdk/live-sdk/tmp/devuan-i386-build/bootstrap/etc/apt/sources.list: No such file or directory
...
chroot: failed to run command '/dpkgdivert': No such file or directory
...
chroot: failed to run command '/postunpack': No such file or directory
...

The application dpkg-divert is installed on my base system which is Uubuntu 16.04. I have not been able to figure out what postunpack is, both ducky and google have not been sufficiently friendly to me on this occasion.

What do I need to do to resolve these errors?

Thanks!

fsmithred · 2017-07-21 17:58:08

postunpack is an error log generated by lib/libdevuansdk/zlibs/bootstrap.

I don't know if anyone has tried live-sdk on anything other than devuan. There are references to devaun in /usr/share/debootstrap/scripts/jessie in the devuan version of debootstrap, but I doubt you'll find them in debian or ubuntu. Maybe it's possible to install devuan debootstrap in ubuntu, and if so, maybe it will work. I don't know.

samhain · 2018-03-18 10:28:27

I have a problem building heads: build_kernel_amd64 gets the kernel successful, but then breaks when trying to compile it. The logfile says quite surprisingly that "make" is missing in chrooted build system. So, how can I add make to the build system?

fsmithred · 2018-03-18 10:43:14

Samhain, you need to install build-essential. Add it to one of the package lists so that it's installed before the kernel compile happens.

samhain · 2018-03-18 19:54:01

I just started all over again, cloned the heads build-system. "build-essential" is in the list "extra_packages=(" in "build-system/config", so I assume it should be present. Anyway, the build process breaks when trying to compile the kernel.

The console says:

 (*) chrooting to execute dpkgdivert...
+ exec
Adding 'local diversion of /usr/sbin/invoke-rc.d to /usr/sbin/invoke-rc.d.chroot'
 (*) chrooting to execute install-linux-heads...
+ exec
 [E] error in: chroot-script dpkgdivert
 [W] called in: chroot-script dpkgdivert
 [W] called in: mounted devpts
 [W] called in: chrooting to execute install-linux-heads...
 [E] error reported, operation aborted.
 [D] dpkgdivert off /home/heads/build-system/live-sdk/tmp/devuan-amd64-build/bootstrap
 [D] chroot-script dpkgdivert
 (*) chrooting to execute dpkgdivert...

log/install-linux-heads.log says:

+ export DEBIAN_FRONTEND=noninteractive
+ cd /usr/src/linux-heads
+ make oldconfig
/install-linux-heads: 4: /install-linux-heads: make: not found
+ exit 1

What can I try next?

Last edited by samhain (2018-03-18 19:56:28)

samhain · 2018-03-18 20:36:55

Ok, kind of success: As you said, "build-essential" is missing in the chroot-environment. I had to install "build-essentiall" and "bc" into [...]/heads/build-system/live-sdk/tmp/devuan-amd64-build/bootstrap, now the kernel is beeing compiled. But where do I need to place these 2 packages, so that the buidscripts will actually add them to the build system?

fsmithred · 2018-03-19 21:55:41

It needs to be in the base_packages or core_packages list to be included in the bootstrap tarball. You can add it to your blend config. Make sure you use "+=" and not just "=". You want to add to the main list, not replace it.

base_packages+=(
    build-essential
    bc
)

* `core_packages`
this array holds the core packages that will be installed in the bootstrap
process.
* `base_packages`
this array holds the base packages that will be installed later in the
bootstrap process.

samhain · 2018-03-20 14:07:15

Thanks, that helped for the kernel. But I still cannot build a valid heads iso, so I question myself when was the last time somebody actually tried to build that beast from git?

fsmithred · 2018-03-20 14:48:48

I don't know. Last time I built a heads iso was a year ago. Last time I built a plain devuan iso with live-sdk was a couple weeks ago.

Are you getting any error messages on-screen or in the logs? Is it creating an iso that doesn't work, or not making an iso at all? Is filesystem.squashfs getting created? (look in live-sdk/tmp/devuan-whatever/binary/live/)

The officially official Devuan Forum!

#26 2017-06-29 13:17:06

Re: Make a live-CD with live-sdk

#27 2017-06-29 13:38:28

Re: Make a live-CD with live-sdk

#28 2017-07-01 19:49:24

Re: Make a live-CD with live-sdk

#29 2017-07-01 20:39:40

Re: Make a live-CD with live-sdk

#30 2017-07-01 20:59:58

Re: Make a live-CD with live-sdk

#31 2017-07-01 21:39:55

Re: Make a live-CD with live-sdk

#32 2017-07-01 22:10:30

Re: Make a live-CD with live-sdk

#33 2017-07-06 03:38:31

Re: Make a live-CD with live-sdk

#34 2017-07-06 08:27:45

Re: Make a live-CD with live-sdk

#35 2017-07-07 00:19:41

Re: Make a live-CD with live-sdk

#36 2017-07-07 02:25:10

Re: Make a live-CD with live-sdk

#37 2017-07-07 02:30:11

Re: Make a live-CD with live-sdk

#38 2017-07-07 07:29:21

Re: Make a live-CD with live-sdk

#39 2017-07-07 21:03:22

Re: Make a live-CD with live-sdk

#40 2017-07-11 05:41:01

Re: Make a live-CD with live-sdk

#41 2017-07-11 22:03:22

Re: Make a live-CD with live-sdk

#42 2017-07-21 09:28:47

Re: Make a live-CD with live-sdk

#43 2017-07-21 17:58:08

Re: Make a live-CD with live-sdk

#44 2018-03-18 10:28:27

Re: Make a live-CD with live-sdk

#45 2018-03-18 10:43:14

Re: Make a live-CD with live-sdk

#46 2018-03-18 19:54:01

Re: Make a live-CD with live-sdk

#47 2018-03-18 20:36:55

Re: Make a live-CD with live-sdk

#48 2018-03-19 21:55:41

Re: Make a live-CD with live-sdk

#49 2018-03-20 14:07:15

Re: Make a live-CD with live-sdk

#50 2018-03-20 14:48:48

Re: Make a live-CD with live-sdk

Board footer