You are not logged in.
Hello ,
i would like to ask you professionals what the best way is to create an
customized
Devuan Beowulf .installer
that can become .iso
that is possibly installable from iso then to harddrive or usb.
the task is that i would like to include quite some packages that i normally use and then facilitate the install on other computers.
this refractainstaller tool is the right one?
is this feasible?
Thank you!
Offline
Yes, you can create your own live-iso with refractasnapshot, and then install from the live media with refractainstaller.
Documentation is here:
https://refracta.org/documents.html
Offline
Hello
i tried this
sudo refractasnapshot
1. Create a snapshot (uefi enabled)
yielded
sent 9,252,418,803 bytes received 3,037,547 bytes 108,250,951.46 bytes/sec
total size is 9,239,018,468 speedup is 1.00
/tmp/extracted /home/work
Archive is cpio archive...
Decompression error
then i tried
2. Re-squash and make iso (no-copy)
which yielded
Squashing the filesystem...
Parallel mksquashfs: Using 12 processors
Creating 4.0 filesystem on iso/live/filesystem.squashfs, block size 131072.
[=========================================================|] 210854/210854 100%
Exportable Squashfs 4.0 filesystem, gzip compressed, data block size 131072
compressed data, compressed metadata, compressed fragments, compressed xattrs
duplicates are removed
Filesystem size 3995482.37 Kbytes (3901.84 Mbytes)
44.22% of uncompressed filesystem size (9034620.15 Kbytes)
Inode table size 1924071 bytes (1878.98 Kbytes)
29.57% of uncompressed inode table size (6507056 bytes)
Directory table size 1788326 bytes (1746.41 Kbytes)
38.81% of uncompressed directory table size (4608394 bytes)
Number of duplicate files found 15518
Number of inodes 187909
Number of files 154378
Number of fragments 12073
Number of symbolic links 17760
Number of device nodes 0
Number of fifo nodes 0
Number of socket nodes 0
Number of directories 15771
Number of ids (unique uids + gids) 26
Number of uids 12
root (0)
lp (7)
speech-dispatcher (105)
rich (1000)
unknown (501)
unknown (502)
unknown (1001)
unknown (197608)
colord (108)
_apt (100)
man (6)
geoclue (110)
Number of gids 20
root (0)
lp (7)
shadow (42)
ssl-cert (105)
rich (1000)
staff (50)
unknown (1001)
unknown (197121)
tty (5)
crontab (102)
mail (8)
ssh (106)
games (60)
messagebus (104)
utmp (43)
lpadmin (108)
man (12)
colord (114)
geoclue (115)
adm (4)
Creating CD/DVD image file...
All finished!
but no .iso is created just a 0byte file
snapshot-20200320_1926.iso.sha256
Last edited by kapqa (2020-03-20 18:45:41)
Offline
I'd like to see /var/log/refractasnapshot.log. Send it to me in email or paste it somewhere and give me the link. Or read it and see if there's something obvious. I wouldn't expect the decompression error on the initrd to cause a 0-byte iso to be created.
Edit: I just realized you ran the non-gui version, which doesn't make much of a log file unless you run it with the debug option. (That happens automatically with the gui version.) Run sudo refractasnapshot -d
Make sure you didn't run out of hard drive space. You might need to exclude some things to make the system copy and the squashfs smaller. (3.9G is pretty big.)
Offline
This might be a useful post:
Offline
This might be a useful post:
That's the default setting now.
Offline
Oh, I didn't know. Nice . . .
Offline
I'd like to see /var/log/refractasnapshot.log. Send it to me in email or paste it somewhere and give me the link. Or read it and see if there's something obvious. I wouldn't expect the decompression error on the initrd to cause a 0-byte iso to be created.
Edit: I just realized you ran the non-gui version, which doesn't make much of a log file unless you run it with the debug option. (That happens automatically with the gui version.) Run sudo refractasnapshot -d
Make sure you didn't run out of hard drive space. You might need to exclude some things to make the system copy and the squashfs smaller. (3.9G is pretty big.)
Thanks,
the /var/log/refractasnapshot.log is ndeed 0bytes.
sudo refractasnapshot -d
also gives
sent 9,741,744,729 bytes received 3,377,899 bytes 341,934,127.30 bytes/sec
total size is 9,727,112,962 speedup is 1.00
/tmp/extracted /home/work
Archive is cpio archive...
Decompression error
Offline
sudo refractasnapshot-gui -d
sent 10,420,671,375 bytes received 3,378,028 bytes 341,772,111.57 bytes/sec
total size is 10,299,317,781 speedup is 0.99
/tmp/extracted /home/work
Archive is cpio archive...
Decompression error
refractasnapshot.log is a very big file. it is still growing as i type.?
Offline
please see how this refractasnapshot.log grows (it still grows)
https://www.asuswebstorage.com/navigate … E50587CAAW
Last edited by kapqa (2020-03-20 21:45:19)
Offline
That site isn't working for me. If I turn off noscript and allow all cookies, I see the name of a video file. I don't see a text file.
Offline
please do "download", tick box, and then select "download"
Last edited by kapqa (2020-03-21 09:38:05)
Offline
Offline
A video of your file manager showing /var/log is not helpful.
Run
nc termbin.com 9999 < /var/log/refractainstaller.log
and then give me the link.
or send the log to me in email. (my screen name at gmail dot com)
Offline
hello ,
please watch the "status bar" that shows the increase in filesize
Offline
I have no idea how you managed to get an 18GB log file. Try this...
head -n 1000 /var/log/refractasnapshot.log > beginning.txt
tail -n 1000 /var/log/refractasnapshot.log > end.txt
That will put the first 1000 lines and last 1000 lines into text files.
Then try opening them with a text editor and see what's there.
Offline
the .log settled down eventually after shutdown and reboot (several)
at
21.3 GiB (22,898,887,727 bytes)
beginning.txt is
485.2 MiB (508,755,677 bytes)
end.txt is
73.2 KiB (75,000 bytes)
and all lines @end.txt are like
/usr/bin/refractasnapshot: line 479: echo: write error: Input/output error
Last edited by kapqa (2020-03-21 14:07:39)
Offline
Check your hard disk health.
As root:
smartctl -a /dev/sda
(you may need to install smartmontools)
Offline
beginning.txt
[ -f /usr/bin/yad ]]
+ DIALOG=yad
+ INFO=image=gtk-dialog-info
+ QUESTION=image=gtk-dialog-question
+ WARNING=image=gtk-dialog-warning
+ ERROR=image=gtk-dialog-error
+ BUTTON0=button
+ BUTTON1=button
+ BUTTON0NUM=:0
+ BUTTON1NUM=:1
+ CENTER=--center
+ [[ -n :0.0 ]]
++ id -u
+ [[ 0 -eq 0 ]]
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ check_grub
+ [[ yes = \y\e\s ]]
+ dpkg -l
+ grep '^ii'
+ grep grub-efi-amd64
+ grep -v bin
+ [[ ! -e /var/lib/dpkg/info/dosfstools.list ]]
+ choose_task
+ [[ yes = \y\e\s ]]
+ uefi_message='uefi enabled'
++ yad '--title=Refracta Snapshot 10.2.10 (20191218)' --center --borders=10 --height 400 --width 426 '--text=This utility wil$[/c]
[c]Choose the first option to create a snapshot.[/c]
[c]This is free software that comes with no warranty or guarantee of any type, including but not limited to express, implied, me$
' --button=OK:0 --button=Help:1 --list --column Num --column 'Choose a task' 01 'Create a snapshot (uefi enabled)' 02 'Re-squ$
+ task='01|Create a snapshot (uefi enabled)|'
+ exit_code=0
+ '[' 0 -ne 0 ']'
+ [[ 01|Create a snapshot (uefi enabled)| =~ 01 ]]
+ please_wait
+ yad --image=gtk-dialog-info '--title=Refracta Snapshot' --center '--text=This may take a moment while the program checks fo$
++ pgrep yad
+ wait_pid=2303
+ check_copies
+ [[ -d /home/snapshot ]]
+ ls '/home/snapshot/*.iso'
ls: cannot access '/home/snapshot/*.iso': No such file or directory
+ snapshot_count=0
++ du -sh /home/snapshot
++ awk '{print $1}'
+ snapshot_size=4.0K
+ [[ -z 4.0K ]]
+ [[ -d /home/work/myfs ]]
++ du -sh /home/work/myfs
++ awk '{ print $1 }'
+ saved_size=9.7G
+ saved_copy='* You have a saved copy of the system using 9.7G of space
located at /home/work/myfs.'
+ [[ no = \y\e\s ]]
+ save_message='* The temporary copy of the filesystem will be created
at /home/work/myfs and removed when this program finishes.'
+ check_directories
++ echo /home/snapshot
++ awk -F / '{ print "/" $2 "/" $3 }'
++ grep /media/
+ snapdir_is_remote=
++ echo /home/work
++ awk -F / '{ print "/" $2 "/" $3 }'
++ grep /media/
+ workdir_is_remote=
+ '[' -n '' ']'
+ '[' -n '' ']'
+ '[' -n '' ']'
+ '[' -n '' ']'
+ [[ -d /home/snapshot ]]
+ [[ no = \n\o ]]
+ [[ -d /home/work ]]
+ rm -rf /home/work
+ mkdir -p /home/work/iso
+ mkdir -p /home/work/myfs
+ check_space
++ df -h -x tmpfs -x devtmpfs -x iso9660 -x udf -x aufs -x squashfs
++ sed 's/Mounted on/Mountpoint/'
++ awk '{ print $2 " \t" $3 " \t" $4 " \t" $5 " \t" $6 " \t\t\t" $1 }'
+ disk_space='Size Used Avail Use% Mountpoint Filesystem
188G 11G 168G 6% / /dev/sda2
511M 5.3M 506M 2% /boot/efi /dev/sda1'
+ check_initrd
+ echo 'Checking initrd.'
+ lsinitramfs /initrd.img
+ grep -q conf.d/cryptroot
+ lsinitramfs /initrd.img
+ grep -q cryptroot/crypttab
+ remove_cryptroot=yes
+ cryptroot_message='The snapshot initrd will be modified to allow booting the unencrypted snapshot.'
+ lsinitramfs /initrd.img
+ egrep -q 'conf.d/resume|conf.d/zz-resume-auto'
+ remove_resume=yes
+ swap_message='The snapshot initrd will be modified to allow booting without the host'\''s swap partition.'
+ '[' '' = yes ']'
+ kill 2303
+ report_space
++ mktemp /tmp/snapshot-report.XXXX
+ tempfile=/tmp/snapshot-report.RXju
+ echo '
You will need plenty of free space. It is recommended that free space (Avail) in the partition that
holds the work directory (probably "/") should be two times the total installed system size (Used).
(Note: You can deduct the space taken up by previous snapshots and any saved copies of the system from the Used amount.)[/c]
[c]Please CLOSE any running applications NOW.
Turn off NUM LOCK for some laptops.[/c]
[c]* You have 0 snapshots taking up 4.0K of disk space.
* You have a saved copy of the system using 9.7G of space
located at /home/work/myfs.
* The temporary copy of the filesystem will be created
at /home/work/myfs and removed when this program finishes.
* The snapshot directory is currently set to /home/snapshot[/c]
[c]You can change these and other settings by editing
/etc/refractasnapshot.conf.[/c]
[c]The snapshot initrd will be modified to allow booting the unencrypted snapshot.
The snapshot initrd will be modified to allow booting without the host'\''s swap partition.
Current disk usage:
(For complete listing, exit and run '\''df -h'\'')[/c]
[c]Size Used Avail Use% Mountpoint Filesystem
188G 11G 168G 6% / /dev/sda2
511M 5.3M 506M 2% /boot/efi /dev/sda1'
+ yad --text-info '--title=Status Report' --center --height 400 --width 700 --button=OK:0 --button=Exit:1
+ exit_code=0
+ '[' 0 -ne 0 ']'
+ rm -f /tmp/snapshot-report.RXju
+ set_distro_name
+ [[ /usr/lib/refractasnapshot/iso = \/\u\s\r\/\l\i\b\/\r\e\f\r\a\c\t\a\s\n\a\p\s\h\o\t\/\i\s\o ]]
+ [[ live.cfg = \l\i\v\e\.\c\f\g ]]
++ lsb_release -i -s
+ DISTRO=Debian
++ grep -q Refracta /etc/issue
++ yad --entry '--title=Linux Distribution' --center '--text=This is the distribution name that will appear in the boot menu
for the live image. If it'\''s blank, the menu entries will just say
"GNU/Linux (kernel-version)" ' --entry-text=Debian --width=500 --button=OK:0
+ DISTRO=Debian
+ [[ -z Debian ]]
+ housekeeping
+ [[ '' = \y\e\s ]]
+ [[ -n '' ]]
++ awk -F: '/1000:1000/ { print $1 }' /etc/passwd
+ username=rich
+ [[ rich != user ]]
+ username_opt=username=rich
+ [[ no = \y\e\s ]]
+ [[ -e /vmlinuz ]]
+ [[ -e /initrd.img ]]
+ [[ -n '' ]]
+ [[ -n '' ]]
+ [[ yes = \y\e\s ]]
+ updatedb
/usr/bin/refractasnapshot-gui: line 795: updatedb: command not found
+ tee /dev/fd/63
++ yad '--title=Running updatedb...' --center --progress --pulsate --auto-close --width 300
+ [[ '' = \y\e\s ]]
+ cd /home/work
+ copy_isolinux
+ [[ -f /usr/lib/ISOLINUX/isolinux.bin ]]
+ isolinuxbin=/usr/lib/ISOLINUX/isolinux.bin
+ [[ -f /usr/lib/syslinux/modules/bios/vesamenu.c32 ]]
+ vesamenu=/usr/lib/syslinux/modules/bios/vesamenu.c32
+ rsync -a /usr/lib/syslinux/modules/bios/chain.c32 /usr/lib/refractasnapshot/iso/isolinux/
+ rsync -a /usr/lib/syslinux/modules/bios/ldlinux.c32 /usr/lib/refractasnapshot/iso/isolinux/
+ rsync -a /usr/lib/syslinux/modules/bios/libcom32.c32 /usr/lib/refractasnapshot/iso/isolinux/
+ rsync -a /usr/lib/syslinux/modules/bios/libutil.c32 /usr/lib/refractasnapshot/iso/isolinux/
+ rsync -a /usr/lib/ISOLINUX/isolinux.bin /usr/lib/refractasnapshot/iso/isolinux/
+ rsync -a /usr/lib/syslinux/modules/bios/vesamenu.c32 /usr/lib/refractasnapshot/iso/isolinux/
+ [[ '' = \y\e\s ]]
+ copy_kernel
+ rsync -a /usr/lib/refractasnapshot/iso/ /home/work/iso/
+ cp /vmlinuz /home/work/iso/live/
+ cp /initrd.img /home/work/iso/live/
+ copy_filesystem
+ [[ no = \y\e\s ]]
+ rsync -av / myfs/ --delete-before --delete-excluded --exclude=/home/work --exclude=/home/snapshot --exclude=/home/work/efi-$
+ tee /dev/fd/63
++ yad '--title=Copying filesystem...' --center --progress --pulsate --auto-close --width 300[/c]
[c](yad:3885): GLib-CRITICAL **: 21:15:24.515: g_source_remove: assertion 'tag > 0' failed
+ [[ -n '' ]]
+ '[' yes = yes ']'
+ clean_initrd
+ extract_initrd
+ mkdir /tmp/extracted
mkdir: cannot create directory ‘/tmp/extracted’: File exists
+ pushd /tmp/extracted
++ file -L /initrd.img
++ egrep -o 'gzip compressed|XZ compressed|cpio archive'
+ COMPRESSION='cpio archive'
+ '[' 'cpio archive' = 'gzip compressed' ']'
+ '[' 'cpio archive' = 'XZ compressed' ']'
+ '[' 'cpio archive' = 'cpio archive' ']'
+ echo 'Archive is cpio archive...'
+ cpio -i
cpio: kernel/x86/microcode/AuthenticAMD.bin not created: newer or same age version exists
62 blocks
+ zcat
Last edited by kapqa (2020-03-21 14:17:35)
Offline
sudo smartctl -a /dev/sdb
smartctl 6.6 2017-11-05 r4594 [x86_64-linux-4.19.0-8-amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Device Model: KINGSTON SM2280S3G2240G
Serial Number: 50026B7282070FB6
LU WWN Device Id: 5 0026b7 282070fb6
Firmware Version: SAFM01.W
User Capacity: 240,057,409,536 bytes [240 GB]
Sector Size: 512 bytes logical/physical
Rotation Rate: Solid State Device
Form Factor: M.2
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ACS-2 (minor revision not indicated)
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Sat Mar 21 15:16:42 2020 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
See vendor-specific Attribute list for marginal Attributes.
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 30) seconds.
Offline data collection
capabilities: (0x79) SMART execute Offline immediate.
No Auto Offline data collection support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 2) minutes.
Conveyance self-test routine
recommended polling time: ( 3) minutes.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000b 100 100 050 Pre-fail Always - 0
2 Throughput_Performance 0x0005 100 100 050 Pre-fail Offline - 0
3 Spin_Up_Time 0x0007 100 100 050 Pre-fail Always - 0
5 Reallocated_Sector_Ct 0x0013 100 100 050 Pre-fail Always - 0
7 Unknown_SSD_Attribute 0x000b 100 100 050 Pre-fail Always - 0
8 Unknown_SSD_Attribute 0x0005 100 100 050 Pre-fail Offline - 0
9 Power_On_Hours 0x0012 100 100 000 Old_age Always - 1531
12 Power_Cycle_Count 0x0012 100 100 000 Old_age Always - 569
168 Unknown_Attribute 0x0012 100 100 000 Old_age Always - 0
170 Unknown_Attribute 0x0003 100 100 010 Pre-fail Always - 260
173 Unknown_Attribute 0x0012 100 100 000 Old_age Always - 1048596
175 Program_Fail_Count_Chip 0x0013 100 100 050 Pre-fail Always - 0
187 Reported_Uncorrect 0x0012 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0012 100 100 000 Old_age Always - 58
194 Temperature_Celsius 0x0023 061 028 030 Pre-fail Always In_the_past 39 (Min/Max 16/72)
196 Reallocated_Event_Count 0x0002 100 100 010 Old_age Always - 0
197 Current_Pending_Sector 0x0032 100 100 000 Old_age Always - 0
199 UDMA_CRC_Error_Count 0x000b 100 100 050 Pre-fail Always - 0
218 Unknown_Attribute 0x000b 100 100 050 Pre-fail Always - 0
231 Temperature_Celsius 0x0013 100 100 000 Pre-fail Always - 100
233 Media_Wearout_Indicator 0x000b 100 100 000 Pre-fail Always - 2081
240 Unknown_SSD_Attribute 0x0013 100 100 000 Pre-fail Always - 0
241 Total_LBAs_Written 0x0012 100 100 000 Old_age Always - 3815
242 Total_LBAs_Read 0x0012 100 100 000 Old_age Always - 3251
244 Unknown_Attribute 0x0002 100 100 000 Old_age Always - 16
245 Unknown_Attribute 0x0002 100 100 000 Old_age Always - 20
246 Unknown_Attribute 0x0012 100 100 000 Old_age Always - 1107968
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
Offline
I don't see any problems with the hard disk.
Run the head command again, but try '-n 2000'
See if you can get a few lines beyond the point where xorriso runs. (about 20 lines past it should be enough) Look for something like this to find it:
xorriso : UPDATE : 0.23% done
xorriso : UPDATE : 3.28% done
xorriso : UPDATE : 11.45% done
xorriso : UPDATE : 19.93% done, estimate finish Wed Dec 25 22:11:41 2019
xorriso : UPDATE : 28.85% done, estimate finish Wed Dec 25 22:11:40 2019
xorriso : UPDATE : 34.11% done, estimate finish Wed Dec 25 22:11:41 2019
xorriso : UPDATE : 36.97% done, estimate finish Wed Dec 25 22:11:42 2019
xorriso : UPDATE : 40.51% done, estimate finish Wed Dec 25 22:11:44 2019
Offline
sorry, i deleted the .refractalog.
Offline
After doing some test runs, I think I know why you got a zero byte iso - if you use any of the build tasks other than "1. Create a snapshot" you have to edit the config file to set save_work=yes. Otherwise, there's nothing to re-squash or re-pack into an iso file.
These two lines from the log suggest that you stopped it in the middle of a previous run, and /tmp/extracted didn't get deleted. I was able to reproduce these errors, but I did not get any input/output errors, and I did get a normal sized iso.
mkdir: cannot create directory ‘/tmp/extracted’: File exists
cpio: kernel/x86/microcode/AuthenticAMD.bin not created: newer or same age version exists
62 blocks
(Note to self: add /tmp/extracted to the cleanup function.)
Offline