build root being the seed root, target root being the --root target, the install root
#genTree help
plush fjord
eager zodiac
setlocale: unsupported locale setting
* IMPORTANT: 16 news items need reading for repository 'gentoo'.
* Use eselect news read to view new items.
Calculating dependencies \
[ Results for search key : glib ]
* dev-haskell/glib [ Masked ]
Latest version available: 0.13.10.0
Latest version installed: [ Not Installed ]
Size of files: 39 KiB
Homepage: https://projects.haskell.org/gtk2hs/
Description: Binding to the GLIB library for Gtk2Hs
License: LGPL-2.1
* dev-libs/glib
Latest version available: 2.80.5-r1
Latest version installed: 2.80.5-r1
Size of files: 6425 KiB
Homepage: https://www.gtk.org/
Description: The GLib library of C routines
License: LGPL-2.1+
[ Applications found : 2 ]
!!! The short ebuild name "glib" is ambiguous. Please specify
!!! one of the above fully-qualified ebuild names instead.
... done!
Dependency resolution took 0.33 s (backtrack: 0/20).
dev-libs/glib is the one it tries to install
I cant pipe anything to a file
have you actually sucessfully done this
or did you run into all the same garbage
this is very frustrating
plush fjord
dev-libs/glib is the one it tries to install
so it's already installed in the build root?
plush fjord
ok so that almost certainly wants sources available
wait
huh
says installed here
plush fjord
ok so i think maybe you need the kernel sources in the BUILD ROOT
eager zodiac
and then error out
plush fjord
well it's making it for the --root
eager zodiac
I didnt do --root
plush fjord
and then wants to rebuild, using sources from build root, presumably
eager zodiac
I just did without --persistant
plush fjord
so i think maybe glib is in the stage3
so that's why it's "installed" according to that
eager zodiac
then why is it being rebuilt
plush fjord
but i think the key here may be to install gentoo-kernel-bin with --persistent
for the ROOT
eager zodiac
okay
eager zodiac
genTree-exec --persistant --root stage3-amd64-systemd-20250126T154834Z emerge sys-kernel/gentoo-kernel-bin
like that
plush fjord
no --root
but the rest should be fine
when i say use --root i mean with emerge directly
80% of gentree is it just running "emerge --root /build_dir packages"
eager zodiac
raceback (most recent call last):
File "/home/dismal/.local/bin/genTree-exec", line 8, in <module>
sys.exit(execute())
~~~~~~~^^
File "/home/dismal/.local/lib/python3.13/site-packages/genTree/main.py", line 89, in execute
genTree = GenTree(**kwargs)
File "/home/dismal/.local/lib/python3.13/site-packages/zenlib/logging/loggify.py", line 12, in init
super().init(*args, **kwargs)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/home/dismal/.local/lib/python3.13/site-packages/genTree/genTree.py", line 44, in init
self.config = GenTreeConfig(config_file=config_file, logger=self.logger, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/dismal/.local/lib/python3.13/site-packages/zenlib/logging/loggify.py", line 12, in init
super().init(*args, **kwargs)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
TypeError: GenTreeConfig.init() got an unexpected keyword argument '_unknown'
plush fjord
yeah --root will make it unhappy
plush fjord
(will make genTree itself unhappy)
ooh wait
maybe quote "emerge x"
it shouldn't need that?
it passes every arg after the seed name to the container
eager zodiac
nope
plush fjord
persistant
persistent
lol
i think i should enable strict arg parsing so it is noisier about the missing arg
eager zodiac
okay it is running
should I try to run genTree again or just try and install glib after this finishes
plush fjord
this may help a bit
either works
maybe glib directly so you can see the error more easily
eager zodiac
should it be persistent
plush fjord
i don't think so
only the kernel should be
since glib is already in the build root
i think once the kernel sources are available in the build root, glib should build fine in both cases
because it sources dependencies from build root, not the ROOT/layer root
eager zodiac
did nothing
it errored out again
what do you want to try now
* ninja -v -j12 -l12 failed
*
* Call stack:
* ebuild.sh, line 136: Called src_compile
* environment, line 4384: Called meson-multilib_src_compile
* environment, line 2874: Called multilib-minimal_src_compile
* environment, line 3068: Called multilib_foreach_abi 'multilib-minimal_abi_src_compile'
* environment, line 3335: Called multibuild_foreach_variant '_multilib_multibuild_wrapper' 'multilib-minimal_abi_src_compile'
* environment, line 3028: Called _multibuild_run '_multilib_multibuild_wrapper' 'multilib-minimal_abi_src_compile'
* environment, line 3026: Called _multilib_multibuild_wrapper 'multilib-minimal_abi_src_compile'
* environment, line 680: Called multilib-minimal_abi_src_compile
* environment, line 3062: Called multilib_src_compile
* environment, line 3555: Called meson_src_compile
* environment, line 2941: Called eninja
* environment, line 1769: Called die
* The specific snippet of code:
* "$@" || die -n "${*} failed"
*
* If you need support, post the output of `emerge --info '=dev-libs/glib-2.80.5-r1::gentoo'`,
I cant pipe all the output to a file
plush fjord
you're doing that with what command?
eager zodiac
so what do you want
eager zodiac
you're doing that with what command?
installing glib
plush fjord
yeah but what method, genTree-exec <seed> emerge glib?
eager zodiac
I did locale-gen without any args
plush fjord
must be done with --persistent ofc
eager zodiac
must be done with --persistent ofc
yeah I did
eager zodiac
I did research on this and all fixes pulled in glib which made them useless
plush fjord
yeah some things are weirdly circular
so sometimes to make the stuff from scratch you need to bootstrap a bit
like build it "minimally" first, then build another dep, then build it fully
eager zodiac
are you getting the same errors as I have
should I use the desktop stage 3 even thought it comes bundled with kde and I dont need that
or would that not change anything
plush fjord
im not at that stage yet
im updating the base rn
using the desktop base is probably most reasonable if doing any gui stuff
eager zodiac
would it be worth scrapping everything to try that
plush fjord
so the seed is just tbe build root, having more stuff in it generally makes building easier
no need to scrap
you can just add another seed
may be nice to compare things that way
plush fjord
no the seed should be set in the layer config
although i could probably make it an arg
plush fjord
no reason it can't be one
eager zodiac
the desktop version depends on dracut
plush fjord
it probably wants an initramfs generator
eager zodiac
required by virtual/dist-kernel-6.6.74::gentoo
=sys-kernel/installkernel-50 dracut
Use --autounmask-write to write changes to config files (honoring
CONFIG_PROTECT). Carefully examine the list of proposed changes,
paying special attention to mask or keyword changes that may expose
experimental or unstable packages.
ERROR | Emerge info:
Portage 3.0.66.1 (python 3.12.8-final-0, default/linux/amd64/23.0/desktop/gnome/systemd, gcc-14, glibc-2.40-r8, 6.12.11-amd64 x86_64)
plush fjord
you can set -initramfs on the kernel package
dracut is redhat propaganda, ugrd would work 😛
eager zodiac
ssys-kernel/installkernel -initramfs
plush fjord
yea
eager zodiac
it worked?
eager zodiac
it threw the same error during update-seed
plush fjord
huh worked for me
eager zodiac
when it tried to pull in glib
plush fjord
i may try with a systemd desktop one
i didn't even do locale-gen i don't think
but packaegs run that automatically at times
eager zodiac
I did select my profile as gnome tho
so it might not be pulling in glib
if you didnt
plush fjord
can you give the full profile string so i can test?
eager zodiac
default/linux/amd64/23.0/desktop/gnome/systemd
genTree-exec --persistent stage3-amd64-systemd-20250126T154834Z eselect profile set default/linux/amd64/23.0/desktop/gnome/systemd
thats how I set it
eager zodiac
plush fjord
from the latest desktops stage3
yeah it seemed to work?
i think ther may be some kinda conflict with your system locale
idk that's my best gguess rn
hmmmmm maybe i need to have it source /etc/profile first?
but the thing is that it doesn't have a real shell in here?
idk this seems to be some kinda issue with your host system, possibly even the kernel?
it's hard to tell, but locales seem like a good place to start looking
maybe just the stuff in /etc/profile.env needs to be set?
you could source your shell on that, then re-run genTree
that may be a reasonable way to test
so like source <seed root>/etc/profile
it may literally just eb the LANG setting
you may want to set it to something both on your system and in the build root
eager zodiac
so like `source <seed root>/etc/profile`
on my host
plush fjord
yup
just in whatever shell you're using
wait maybe don't source the whole file
i think maybe just set the LANG to start
if that doesn't work you cna try sourcing it
more than moderate chance it breaks your shell
eager zodiac
trying again
I dont think I got an error about locale this tme
I added that line to the etc/profile
eager zodiac
the locale
plush fjord
but i think it should have a locale defined by default
maybe you need to eselect locale set?
eager zodiac
but i think it should have a locale defined by default
there wasnt
plush fjord
for me it always kinda works ootb
eager zodiac
it is still going
plush fjord
nice so maybe it was using some default locale not on your host system?
idk
normally that would be handled without config
not sure if bug or "expected" with another host type
eager zodiac
it is building llvm right now
plush fjord
nice seems to be working then?
so mostly pay attention to the files it outputs, i think
it should list the path
they are pretty normal tarballs
eager zodiac
I think I dont wanna jinx it
plush fjord
tbh most issues should happen early, if they are genTree ones, and if they happen later those are likely portage issues, but can be brought about by the environment
but unless you're setting weird options or doing things totally out of order, portage generally works
eager zodiac
I could have allocated more cores but I dont wanna overload my system
plush fjord
portage uses all cores by default
--jobs is how many different builds can run at once
eager zodiac
I am forced to use Ubuntu bc it is the only distro that supports my GPU
eager zodiac
eager zodiac
i think it should be possible to do whatever it does on other distros
Ubuntu is almost as shit as red hat
plush fjord
you tried the gentoo livegui?
eager zodiac
The other thing is I need to be able to use virtual machines and I don't know of VMware likes using Getnoo
plush fjord
i just use libvirtd
eager zodiac
I participate in cyber security competitions and they distribute images for VMware and if you don't use VMware then you aren't eligible to dispute your score if it doesn't work
plush fjord
well i think vmware stuff should run on gentoo like any other distro
but i use vmware images with kvm all the time
eager zodiac
I would rather ditch VMware entirely but I want to be able to dispute my score if it doesn't work
plush fjord
the most important part is the storage
vmware uses vmdk kvm/qemu use qcow2
you can convert back and forth
the rest of the "vm" is a definition of how many cores it uses, etc
i typically redefine that
from there the main consideration is if it's uefi or not
plush fjord
yeah that doesn't mean they made it a uefi bootable image
so it could mbr boot
some people do that for vms, it depends on who made the image
eager zodiac
It just got done building llvm
plush fjord
nice
eager zodiac
nice
A little bit ago I don't remember. I think it was a couple weeks ago. Microsoft released a video claiming that Windows is the most secure and private operating system
plush fjord
lol
plush fjord
yeah that convinced me
eager zodiac
Great make sure to enable recall so we can watch your screen
BTW we pinky promise we don't get any data
failed on glib
plush fjord
noooo
plush fjord
genTree-exec systemd-desktop emerge -1 dev-libs/glib
this works for me
on the fresh systemd/desktop stage3
eager zodiac
is that before you declare the gnome profile
eager zodiac
ill try that I am trying re running it just to make sure it wasnt a fluke
not persistent?
plush fjord
genTree-import-seed stage3-amd64-desktop-systemd-20250202T154819Z.tar.xz systemd-desktop
genTree-exec --persistent systemd-desktop eselect profile set default/linux/amd64/23.0/desktop/gnome/systemd
genTree-update-seed systemd-desktop
not persistent because im testing
but it shouldn't change much
i just don't really want to alter the seed unless i have to
eager zodiac
it failed
plush fjord
can you try that with that stage3?
eager zodiac
it said invalid locale
plush fjord
it worked for me, if that exact process fails for you im blaming the environment
eager zodiac
it worked for me, if that exact process fails for you im blaming the environment
I used the same seed
plush fjord
like something something ubuntu lol
i may test on an ubunutu vm
this is definitely a strange issue
eager zodiac
like something something ubuntu lol
I am running it inside a debian testing vm
on the ubuntu server
eager zodiac
bc ubuntu doesnt have python 3.12 support
setlocale: unsupported locale setting
setlocale: unsupported locale settin
it did say that
eager zodiac
should I try in a gentoo machine
plush fjord
like outside the container
eager zodiac
I have a gentoo machine pre made
plush fjord
yeah if you have a gentoo machine you may as well
i mean that's where i test it 😛
but im intersted to know why it fails on a different host
the container should be mostly isolated
unless you have a locale set in the host env whihc doesn't work in the container?
it doesn't reset that stuff
eager zodiac
It's unzipping right now. I have a pre-made Gentoo umage with gnome pre-installed so I don't have to redownload it every single time
eager zodiac
GDM_LANG=en_US.UTF-8
LANG=en_US.UTF-8
plush fjord
ok so i don't think it's that
plush fjord
ohhhhh
eager zodiac
could that be why
plush fjord
hmmmmmmmmmmmm maybe changing that or unsetting it could help?
maybe try a compat one
eager zodiac
I am just gonna try in my gentoo machine
plush fjord
wait this is what i have set, i'm not sure if it removes the hyphen?
idk
that was in my /etc/locale.gen
but yeah i would be a bit surprised if it failed on a gentoo vm too
eager zodiac
something didnt work
unzipping again
it is importing now
the machine has 80gb of disk space should that suffice
this machine just has gnome and basic utils so I have to install some stuff
eager zodiac
you mostly need python to run genTree here
I have that
eager zodiac
yeah I just installed that
I am gonna sync
set the profile
and install glib
and then do the gentree command
plush fjord
genTree-import-seed stage3-amd64-desktop-systemd-20250202T154819Z.tar.xz systemd...
you should be able to do this
eager zodiac
it is syncing rn
eager zodiac
you should be able to do this
it successfully merged glib
eager zodiac
I used debian testing
the host is ubuntu but I made a debian testing vm
there should be a disclaimer on there that it only works on gentoo hosts until you can do at least basic testing on other platforms
plush fjord
i don't see any reason it's gentoo specific
i need to look into this issue more at some point
eager zodiac
I would personally test on both Debian Testing and Arch as thats what most people use or have a distro based on
is there a way I can remove the kde desktop from the image so it doesnt have both kde and gnome
eager zodiac
it has kde by default
plush fjord
that is just in the seed
eager zodiac
oh okay
plush fjord
i think it does depclean after a "update"
so if you set a new profile, and do genTree-update-seed it should more or less migrate to that
eager zodiac
">>> Emerging (43 of 61) kde-frameworks/extra-cmake-modules-6.10.0::gentoo"
that is why I am concerned
plush fjord
some things may just want kde stuff
you can do things to forcefully remove that stuff but it may be necessary
eager zodiac
how do I do the thing with chrome to add it to package.license
plush fjord
you make a file under ~/.local/share/genTree/config/<name>/package.license/chrome
then set that config overlay name in the config
you set config_overlay = <name>
same dir name used above
eager zodiac
If I do eix-installed -a is that what will be in the tar ball
plush fjord
no
it uses emerge --root to build stuff into the dir that gets packed into a tarball
eager zodiac
Okay
once the base layer with only system and the kernel
then do I make another file with chrome and the other utilities I want
plush fjord
im not sure it even really needs the kernel tbh
you may be able to sqush them all together if you use "glibc" as the base
since this glib issue is solved
eager zodiac
After all is said and done
How do make the tar ball
And how do you make the tarball into the squashfs
plush fjord
you genTree <config.toml>
tarball to squashfs idk
im sure there are more than one ways
eager zodiac
You were saying it's possible
plush fjord
tar and squashfs are just archive formats
squashfs can make from a dir
but it may be able to handle it direct
the "full" ones have every layer used for the build packed together
you can see contents with tar -tf file
you may want to unpack it and then manually add a kernel or something
emerge with --root doesn't install the kernel "fully"
eager zodiac
How complicated is that
eager zodiac
Where are you copying it from
plush fjord
you can use the modules from the livecd
and the kernel from the livecd
if you want
or make your own
also the initramfs
you can remake any of this
but i mean there is nothing that special about this stuff as long as it's consistent, like matching kernel, initramfs(kmods) and kmods in the rootfs, squashfs in this case
you can always test with arch-chroot into the unpacked archive
or whatever, really
eager zodiac
So it shouldn't be too hard
plush fjord
nope, just try to undertand the process, it's not really that complex
just a bit particular
eager zodiac
you make a file under ~/.local/share/genTree/config/<name>/package.license/chrom...
that didnt work
/home/dismal/.local/share/genTree/config/chrome/package.license
overlay= ["chrome"]
got it
got an ad for BS
plush fjord
lol
plush fjord
you set `config_overlay = <name>`
this is the syntax you used whihc worked right?
eager zodiac
this is the syntax you used whihc worked right?
yes
eager zodiac
INFO | [systemd-base] Created archive: /builds/stage3-systemd-systemd-base.tar (2566.26 MB)
INFO | V:V [systemd-base] Packing all layers into: /builds/stage3-systemd-systemd-base-full.tar
INFO | #%- [systemd-base] Packing bases: /builds/stage3-systemd-base.tar, /builds/stage3-systemd-glibc.tar, /builds/stage3-systemd-systemd-base.tar
INFO | ~%> [systemd-base] Refiltering archive: /builds/stage3-systemd-systemd-base-full.tar (2627.71 MB)
INFO | [systemd-base] Created final archive: /builds/stage3-systemd-systemd-base-full.tar (2627.71 MB)
@plush fjord how do I proceed from here
plush fjord
check out that stage3-systemd-systemd-base-full.tar
eager zodiac
check out that stage3-systemd-systemd-base-full.tar
what do I need to do with it
didnt you say I need to do something with the kernel
plush fjord
you can extract that into a dir and work with it
and you need kmods in it
you can take those from an already made install iso
like rip out /lib/modules from its squashfs
eager zodiac
and you need kmods in it
ok
eager zodiac
you can take those from an already made install iso
does it have to be from a gui image
since I have a gui
or does it not matter
6.6.74-gentoo-dist
there are also symlinks
do they need to be preserved
plush fjord
or does it not matter
well you prob want it to have video drivers
right
if the livegui works, you can copy them from there
eager zodiac
I used the live gui one
plush fjord
and i think those symlniks help but are not required
eager zodiac
and i think those symlniks help but are not required
ok
plush fjord
yeah so once you are done making that, you can more or less repack the livegui with your squashfs
you could even install grub yourself, on some bootable device, then copy the config and edit it to work with your squashfs
eager zodiac
you could even install grub yourself, on some bootable device, then copy the con...
I thought the iso already has it
plush fjord
yeah you need to repack the iso if you want to use that
and make sure it has the same label as it had before
plush fjord
i think the grub tool is how the livecd does it
eager zodiac
idk how you set the label
that was the part that was confusing
I read the man page and didnt see a flag for it
plush fjord
if you manually install grub to some ESP, and set a GPT label, that may work
eager zodiac
the squashfs is extremely small
like susiciously small
I used xz compression because thats what they used to make the image
the one the comes with the iso is 3gb
and the one I generated is 800mb
eager zodiac
plush fjord
you can easily mount a squashfs
eager zodiac
this is the stock one
eager zodiac
plush fjord
i think gentree makes all symlinks relative
and within the root
if the one from the livecd has absolute paths it could be reading system stuff
eager zodiac
the livegui image does come with a lot of stuff
plush fjord
that too
eager zodiac
it has all that
search --no-floppy --set=root -l gentoo-amd64-livegui
linux /boot/gentoo nodhcp secureconsole root=live:CDLABEL=gentoo-amd64-livegui rd.live.dir=/ rd.live.squashimg=image.squashfs cdroot
plush fjord
those are dracut args
idk about it for sure
if you wanna make a custom ugrd image for this, that's possible too
eager zodiac
I just need to find out how to correctly make the iso
plush fjord
im not sure how to make an iso in particular
but it's not hard to make a bootable device
eager zodiac
but it's not hard to make a bootable device
is this just like putting any other image on a device
as the gentoo iso uses HFS+
plush fjord
yeah you just put the kenrel/bootloader/squashfs/initramfs on it
and if the bootlaoder is in the default efi path it should just work
so long as the config is reasonable
if you use ugrd it bakes the label and whatnot into the image
eager zodiac
so just copy the everything from the iso to the disk
plush fjord
you may be able to remake some of it, like grub-install to the ESP root, im not 100% sure how to change the config
i think you can kinda pick parts from the livecd one
and just add those to the grub config on the target
so with ugrd, grub mostly just needs to start the kernel and tell it to use an initarmfs
with dracut it needs those "magic" args passed
where labels matter
eager zodiac
how does catalyst make the iso
plush fjord
mix of grub and dracut, im not sure the exact details
eager zodiac
so with ugrd, grub mostly just needs to start the kernel and tell it to use an i...
I cant just use the stuff that is part of the iso already
and just add the squashfs
plush fjord
I cant just use the stuff that is part of the iso already
grub installs with certain uuids set in the efi portion
it's not always possibel to just copy grub as a whole
you probably want to reinstall
but you can probably use the existing kernel from the livecd
eager zodiac
you probably want to reinstall
how can I do that
do I need to use your tool to do that
eager zodiac
grub-install /path/to/mountpoint
what am I mounting
plush fjord
a USB or something you want to boot to
plush fjord
wdym?
eager zodiac
this is the structure of the iso
I have replaced the image.squashfs with mine
is there anything I have to remove to install grub
plush fjord
so if you replaced the squashfs it may just wrok
as long as it has the "right" kmods in it
eager zodiac
as long as it has the "right" kmods in it
I copied the ones from the stock image.squashfs
plush fjord
then it should be fine
eager zodiac
/home/dismal/Downloads/livegui-amd64-20250202T154819Z.iso: ISO 9660 CD-ROM filesystem data (DOS/MBR boot sector) 'gentoo-amd64-livegui' (bootable)
file.iso: ISO 9660 CD-ROM filesystem data 'gentoo-amd64-livegui'
eager zodiac
```file.iso: ISO 9660 CD-ROM filesystem data 'gentoo-amd64-livegui'```
this one is mine
eager zodiac
what are those other partitions
I got it right
at least for the partitions
@plush fjord any ideas
eager zodiac
I hope I didn't do all this for nothing
Do I need to install grub inside the squashfs
eager zodiac
grub gives me issues more often than not lol
Would you be willing to look at the image