Subject This week in KISS (#15) From Dylan Araps <dylan@k1ss.org> Date Tue, 16 Mar 2020 15:07:09 +0100 Hello. It's been a weird week. All stores (excluding Super Markets, Pharmacies, etc) have been closed here. People are keeping their distance and most people have decided to not leave the confines of their homes/yards (me included).The repositories are now ready for GCC 10. Each package has been tested and fixes have been made to any with issues. GCC 10 snapshots are available in the testing repository for those wanting to dive in early. The perl dependency has been removed from libvpx. Perl was required solely for the generation of four header files. The package now simply includes these header files in generated form. Firefox is now the only package with a dependency on perl. This is also only a build dependency meaning that there is no runtime dependency on perl anywhere in the system. Our gzip implementation has been changed to pigz which is a parallel version of gzip. Expect speedups when working with large gzipped sources (depends on your core count of course). PACKAGE MANAGER The compression method used for KISS packages is now configurable via the KISS_COMPRESS environment variable. The current valid values are gz, xz and bz2. This same code is shared by the source extraction function which has the upside of making our tar command usage more portable between tar implementations. The final step for maximal tar portability is the removal of the '--strip-components' flag which limits our compatibility to busybox tar, libarchive tar (bsdtar) and GNU tar. This is tricky to solve, any suggestions welcome. KISS-FORK and KISS-LINK I added two new utilities which aid in the forking and linking of packages between repositories. 'kiss-fork
' will copy the package's repository directory into your current directory. 'kiss-link ' will link a package's repository file to the next repository in KISS_PATH. Example: -> ls LICENSE.md README.md libsass mesa pp sassc st wine -> kiss-fork libdrm forked package to /home/goldie/dylan-repo/libdrm -> cd libdrm -> ls build checksums depends sources version -> kiss-link checksums linked checksums to /home/goldie/projects/kiss-new/extra/./libdrm -> kiss-link depends linked depends to /home/goldie/projects/kiss-new/extra/./libdrm -> kiss-link sources linked sources to /home/goldie/projects/kiss-new/extra/./libdrm -> kiss-link version linked version to /home/goldie/projects/kiss-new/extra/./libdrm -> lsl build checksums -> /home/goldie/projects/kiss-new/extra/./libdrm/checksums depends -> /home/goldie/projects/kiss-new/extra/./libdrm/depends sources -> /home/goldie/projects/kiss-new/extra/./libdrm/sources version -> /home/goldie/projects/kiss-new/extra/./libdrm/version The result is a fork of the libdrm package to the user's repository with every file (except for build) symlinked to the repository containing libdrm. This allows the user to make changes to the build process of libdrm without having to maintain the entire package. The rest of the files are linked to the official libdrm so any version updates trickle down. REMOVING THE NETWORK REQUIREMENT FROM A RUST PACKAGE First some context. The KISS repositories (excluding community) have the requirement that no package require an internet connection during the build process. What this means is that all network connections made by the package manager should only be to the static list of sources defined for the package. This allows the sources list to be signed via GPG and further allows the package manager to verify the checksums of everything downloaded. This finally allows the sources to be cached. In short, no package should download random stuff during builds. The package manager should handle this. Enter cbindgen. Some packages make this a very difficult thing to pull off. Most notably Rust and cbindgen. The latter being the package I will talk about in this post. The cbindgen package requires a total of 35 crates. This results in 35 additional source downloads we need checksums for. I've come across packages requiring 200+ crates in my travels. The process looks like this: 1. Generate a list of each required crate and the required versions of each crate. This must be done for the whole dependency chain. 2. Turn the generated list into a list of download URLs for each crate. (https://static.crates.io/crates/atty/atty-0.2.13.crate) 3. Append the URL list to the sources file. Each crate source should also be copied to 'vendor/' so the second field of each source must include it. 4. Set the 'CARGO_HOME' environment variable's value to '$PWD' to prevent cargo from accessing the user's home directory. We need to contain things to the package manager's domain. 5. Extract each crate (really tarballs in disguise). Cargo expects them to all be unpacked prior to 'cargo build'. 6. Generate a '.cargo-checksum.json' file for each of the extracted crates. The checksum should be of the unextracted crate. 7. Create the '.cargo' directory in '$PWD'. We need to create a cargo configuration file for the build to work. 8. Create a configuration file called 'config' in '.cargo'. This file will instruct cargo to avoid crates.io when looking for crates and to instead look in 'vendor/'. 9. Use the '--frozen' argument with 'cargo build' to prevent cargo from accessing the network to look for new crate versions. Yes. This is the only way to remove the network requirement from a build of anything using cargo. If you'd like to see what the resulting package looks like, the source is available below (comments included!). NOTE: The maintainer of the software _could_ distribute tarballs which include all of the crates via 'cargo vendor' though this isn't a common practice from what I've seen. Source: https://github.com/kiss-community/repo/tree/master/extra/cbindgen REMOVING DBUS FROM IWD (AGAIN) I posted a while ago about my fork of iwd called 'eiwd'. What it is, is a fork of iwd with the dbus requirement removed. I decided to start again this week with the intention of handling things differently the second time around. The new eiwd touches as little existing code as possible and is merely a series of '#ifdef HAVE_DBUS' throughout the codebase. I've also added the '--disable-dbus' configure flag. It is now possible to use the eiwd sources as a drop-in replacement for iwd in distributions wanting to optionally enable dbus based on some kind of conditional (Gentoo USE flags as an example). The daemon is fully functional and I will _eventually_ get around to writing a new client to work without dbus. Source: https://github.com/dylanaraps/eiwd KISS AND BEDROCK LINUX A KISS user has successfully run Bedrock Linux with KISS as a strata. Bedrock's handling of the system boot/shutdown also uncovered two minor issues with KISS' init process which have now been fixed. A big thank you to Bedrock Linux creator Paradigm for helping myself and the mentioned user to solve any issues. A full album of images can be seen here: https://imgur.com/a/vgf6pGU NOTABLE USER REPOSITORIES kiss-games kiss-games is a user repository for KISS which includes a long list of games and emulators. Any user can add the repository to gain access to its list of packages. Source: https://github.com/sdsddsd1/kiss-games mywayland This repository brings Wayland to KISS. It includes Sway, wlroots and other required packages. Same as above, any user is able to enable this repository to start running Wayland. Source: https://github.com/sdsddsd1/mywayland This is what I was hoping for when creating the repository system and the imposed limits to the size of the official repositories. An "ecosystem" of repositories (by users!) which complement and extend the base system. I can't wait to see where this will go. A LITTLE ABOUT MYSELF KISS has attracted a lot of new users recently. As distributions are more or less centred around trust, I thought I'd end this week's post by taking a moment to introduce myself. * I was born February of 1998 in Melbourne, Australia. Both of my parents are of Greek descent. I grew up living with my Mother and grandparents. I am 22 years of age. * I don't own a phone of any kind. The only piece of technology I own is my laptop which runs KISS and which I use to work on my software. When I leave the house, I'm completely disconnected. * I've always had an affinity for computers and have tinkered with them from a young age. Building my own PCs, messing with console homebrew, iPod jailbreaks (what fun they were), etc. * I dropped out of High School at the age of 13 (after the first year) and dedicated all of my time to technology. I was in an "accelerated learning" class for my only year. * I started making websites at 13 from my PC which still ran Windows. This progressed to making websites for local businesses. * I first tried Linux when Valve ran the Tux promotion for Team Fortress 2 (https://wiki.teamfortress.com/wiki/Tux). I kept using Linux from this point on. * My first Linux project came late 2015 when I released the first versions of Neofetch (a system information tool). * Since 2015 I've written a lot of software. wal/Pywal, the Pure bash bible, the pure sh bible, fff, pfetch, sowm, KISS Linux etc. * I started university in 2016 and turned 18 during the first month or so. I did two years of a Bachelor's in computer something something before transferring to a Journalism bachelor and then finally dropping out of that. * I moved to Greece in 2018 with my Grandmother, Mother, Brother and Cousin. I still live here. I didn't speak the language and couldn't read/write it either. My Grandfather passed two months prior to us leaving. * I've been homeless two times in my life. Once as a child and the second time in 2018 prior to the Greece move. Funny enough we went from homelessness in Australia to homelessness in Greece before finally setting in somewhere. * KISS Linux was started from a single room in which myself, my brother, cousin, grandmother and mother lived at that time. The WiFi came from a cafe across the road, 3 floors down. To complicate things further, my grandmother was also dying at this time (after having a stroke) and a stray cat had birthed kittens in this same room. My Grandmother made a recovery though we had another scare in January of this current year (2020). I now have a permanent place to live and one which I won't jokingly call a "Human rights violation". I am still living out of a single suitcase though. * If I were to count the total "house moves" I've made throughout my life, I'd end up with a number around 40. 2018 alone had me move around 10 or so times. It's been a wild ride so far, full of its ups and downs. I've omitted quite a lot as I'll probably write something more in depth elsewhere (at a later stage). Some things should also probably be left unsaid. This wasn't meant as a sob story or anything of that nature. Just a loose and rough timeline of events somewhat related to my Open Source work. I'm very happy and wouldn't have my life any other way. I hope this gave you a clearer picture of who I am and more importantly, why I am. Dylan --- Dylan Araps (55): atk: Don't build tests firefox: Fix error in dash eiwd,openresolv: Move to extra eiwd: bump to 1.5-1 curl: bump to 7.69.1 firefox-bin: Fix update issue eiwd: bump to 1.5-2 eiwd: bump to 1.5-3 glib: bump to 2.64.1 eiwd: bump to 1.5-4 openesolv: Fix sysconfdir @konimex. Closes #168 kiss: bump to 1.7.8 gcc: latest snapshot nodejs: bump to 13.11.0 cbindgen: Remove network requirement kiss: bump to 1.7.9 gcc: bump to 9.3.0 rust: bump to 1.42.0 libdrm: GCC 10 fix flex: Fix depends flex: Make m4 make binutils: Fix depends binutils: Fix depends bison: Fix depends grub: Fix depends cmake: Remove unneeded configure flags glib: Don't build fuzzing stuff libxkbcommon: Fix depends xcb-util-wm: Fix depends xcb-util-cursor: Fix depends xf86-video-ati: GCC 10 fixes xf86-video-amdgpu: GCC 10 fixes xf86-video-intel: Fix LDFLAGS xf86-video-nouveau: GCC 10 fixes gcc: Fix depends perl: bump to 5.30.2 baseinit: bump to 0.7.1 kiss: bump to 1.7.10 kiss: bump to 1.8.0 gzip: swap implementation to pigz sudo: bump to 1.8.31p1 binutils: Fix depends glib: Fix no libelf firefox-bin: Fix naming issue. Closes #172 kiss: bump to 1.8.1 ccache: bump to 3.7.8 pfetch: bump to 0.5.0 ne: drop from community eiwd,openresolv: Move to extra gmp: new package at 6.2.0 mpfr: new package at 4.0.2 pfetch: bump to 0.6.0 icu: bump to 66.1 icu: Fix url. Closes #528 imagemagick: bump to 7.0.10-1 Adam Schaefers (1): libcap: add perl dep, closes #544 (#546) Anirudh Oppiliappan (1): radare2: new package at 4.3.1 (#538) Cem Keylan (2): boost: don't link statically (#525) libsoup: bump to 2.70.0 (#531) Dilyn Corner (1): extra-cmake-modules bumped to 5.68.0 (#519) Eudald Gubert i Roldan (5): btpd: new package at 0.16 (#520) ledger: new package at 3.1.3 (#526) font-awesome: new package at 5.12.1 (#530) sc: new package at 7.16_1.1.2 (#535) sc-im: new package at 0.7.0 (#536) James Davies (1): Fix qemu (#539) Kiëd Llaentenn (1): hexyl: v0.6.0 => v0.7.0 (#532) Kris Heck (1): jbig2dec: bump to 0.18 (#540) M. Herdiansyah (2): cryptsetup: update to 2.3.1 (#534) lvm2: patch the bashism @ioraff (#533) dzove855 (1): dump xtrlock to 2.13 (#545)