aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Adjust documentation on IRC support channelDavid Runge2021-05-291-1/+1
| | | | | README.rst: Update the documentation on IRC support channel, after Arch Linux has moved to Libera Chat.
* Merge remote-tracking branch 'sxw/copytoram'David Runge2021-05-2913-4/+59
|\ | | | | | | | | | | | | | | | | | | * sxw/copytoram: Apply copytoram Boot Option Menu Entries also to releng Fence add_binary for pv Reorder UEFI boot menu entries Update README.bootparams Apply 1 suggestion(s) to 1 file(s) add optional pv tool
| * Apply copytoram Boot Option Menu Entries also to relengSimon Wilper2021-05-146-1/+21
| |
| * Fence add_binary for pvSimon Wilper2021-05-141-1/+6
| |
| * Reorder UEFI boot menu entriesSimon Wilper2021-05-143-1/+1
| |
| * Update README.bootparamsSimon Wilper2021-05-141-1/+3
| | | | | | | | | | Explain the purpose of optionally adding the "pv" program to the package list.
| * Apply 1 suggestion(s) to 1 file(s)Simon Wilper2021-05-141-1/+1
| |
| * add optional pv toolSimon Wilper2021-05-145-1/+29
|/ | | | | use pv to give feedback on copying the airootfs to RAM when copytoram kernel parameter is given
* Add changelog for v54David Runge2021-05-131-0/+29
| | | | | CHANGELOG.rst: Add changelog entry for v54.
* ci: Use environment variables to override build settingsDavid Runge2021-05-131-15/+15
| | | | | | | | | | | | | .gitlab-ci.yml: Use environment variables to override the build settings offered by the build-host.sh script. Lower the RAM usage of the builds to 3072. Lower the COW space used by archiso to 2GiB. Remove dependency on libisoburn in the `before_script` section of the build target (libarchive and util-linux have replaced this requirement). Use size units in accordance with upstream documentation. Use the new name of the build's metrics file. Fixes #134
* ci: Consolidate build-host scriptDavid Runge2021-05-131-53/+173
| | | | | | | | | | | | | | | | | | | .gitlab/ci/build-host.sh: Change all script-local variables to lower-case and make some of them overridable using environment variables (by providing defaults). Break down overly long commands by splitting them into a list of strings. Use local variables where possible. Change `main()` to use rsync instead of cp to copy the project to the build location more generically. Change `main()` to use rsync instead of cp to copy the build artifacts on the VM from the project's build directory to the output. Remove all unnecessary `function` keywords for function declarations. Replace the dependency on libisoburn's `xorriso` with libarchive's `bsdtar` and util-linux's `blkid` in `prepare_boot()`. Add `print_section_start()` and `print_section_end()` to reduce code duplication and error potential when printing lines for gitlab's collapsible sections (https://docs.gitlab.com/ee/ci/jobs/#custom-collapsible-sections). Document the script's behavior and expectations. Document the understood environment variables and add links to documentation on understood units (in case of size units).
* ci: consolidate build scriptDavid Runge2021-05-131-54/+65
| | | | | | | | | | | | | | .gitlab/ci/build-inside-vm.sh: Add `print_section_start()` and `print_section_end()` to remove code duplication when printing gitlab collapsible sections (https://docs.gitlab.com/ee/ci/jobs/#custom-collapsible-sections). Document further script dependencies. Remove the temporary directory base (located in the project directory) instead of only the tempdir. Simplify setting file and directory ownership when running with sudo, by only doing it once, recursively on the output directory. Make the script's output more verbose by using verbose flags for removal, ownership changes and zsyncmake actions and by displaying e.g. created metrics and checksum files. Change `create_metrics()` to output to a `metrics.txt` by default. Change `create_checksums()` to create the checksums relative to the files.
* configs/releng/airootfs/etc/systemd/system/pacman-init.service: don't ↵nl67202021-05-121-1/+1
| | | | | | | | hardcode the keyrings If the keyring is not specified, pacman-key will simply use all keyrings from /usr/share/pacman/keyrings/. Fixes #133.
* configs/releng/packages.x86_64: explicitly add wanted packages instead of ↵nl67202021-05-111-1/+6
| | | | | | relying on pulling them in as dependencies Fixes #119.
* configs/*: add VM guest packages and enable their servicesnl67202021-05-116-0/+8
| | | | | | | * virtualbox-guest-utils-nox package and vboxservice.service for VirtualBox. * qemu-guest-agent package and qemu-guest-agent.service for QEMU & libvirt. Implements #118.
* ci: Expand parallel matrix with build modesDavid Runge2021-05-111-16/+22
| | | | | | | | | .gitlab-ci.yml: Expand the parallel matrix with build modes per profile. Do not run netboot with the baseline profile, as codesigning is not supported yet (#132). Remove tagging secure, as archiso builds will only ever be used for testing the project. Build ISOs using fast-single-thread (they take very long otherwise and hit the job time limit) and use any available runner for anything else.
* ci: build based on buildmodesDavid Runge2021-05-112-44/+184
| | | | | | | | | | | | | | | | | | | | | .gitlab/ci/build-inside-vm.sh: Expand the script to allow building based on mkarchiso's buildmodes. Accept two parameters now: profile and buildmode. Add gitlab collapsable sections by adding specific printfs for it to all functions. Add extglob to be able to more specifically target files. Change `create_checksums()` to also generate the legacy md5 and sha1 checksums. Change `create_checksums()` and `create_zsync_delta()` to accept and process an unspecified amount of files as parameters. Change `create_zsync_delta()` to lower the blocksize when creating a file for the bootstrap image. Change `create_metrics()` to create metrics depending on build mode. Rename `create_temp_pgp_key()` to `create_ephemeral_pgp_key()`. Add `create_ephemeral_codesigning_key()` to create a codesigning key, that is used to sign the netboot artifacts. Change `run_mkarchiso()` to also create an ephemeral codesigning key before running mkarchiso and to run `create_checksums()` and `create_zsync_delta()` with files depending on build mode. .gitlab/ci/build-host.sh: Call `build-inside-vm.sh` using the PROFILE and BUILDMODE environment variables as parameters.
* mkarchiso: Also create package list for netbootDavid Runge2021-05-101-1/+1
| | | | | archiso/mkarchiso: Change `_make_pkglist()` to also generate the package list when using the netboot build mode.
* Update project documentation related to netbootDavid Runge2021-05-101-2/+3
| | | | | | | README.rst: Add openssl as another dependency. Mention the export of netboot artifacts in the project introduction. Mention that archiso may be used on other operating systems as well.
* docs: Add netboot to buildmodes documentationDavid Runge2021-05-101-1/+2
| | | | | docs/README.profile.rst: Add documentation for the netboot buildmode.
* mkarchiso: Add buildmode to export netboot artifactsDavid Runge2021-05-101-33/+115
| | | | | | | | | | | | | | | | | | | | | | archiso/mkarchiso: Implement a buildmode to export artifacts required for netboot with IPXE. When providing the buildmode 'netboot' via profiledef.sh or the `-m` option, all targets necessary to create an ISO medium are built, but the components required for netboot are exported to the output dir. Optionally, it is possible to provide a set of certificates for codsigning using the `-c` option, where the first file is considered as the signer certificate and the second as the key. Add `_export_netboot_artifacts()` to copy build artifacts to the output directory. Add `_sign_netboot_artifacts()` to codesign the netboot artifacts in the work directory. Add `_validate_requirements_buildmode_netboot()` to check for openssl. Add `_build_iso_base()` to implement common function calls between the 'iso' and the 'netboot' buildmodes. Add `_build_buildmode_netboot()` to make use of `_build_iso_base()`, (optionally) `_sign_netboot_artifacts()` and `_export_netboot_artifacts()`. Change `_build_buildmode_iso()` to make use of `_build_iso_base()`. Add `-c` as an option to mkarchiso to read in a list of file names. Unify the output of `_usage()` by using the same definition style for lists of strings provided to options that accept them (e.g. `-c`, `-m`, `-p`). Closes #128
* Extend project overview with info on bootstrap imagesDavid Runge2021-05-091-2/+9
| | | | | | README.rst: Mention bootstrap images in the opening words of the project documentation. Add awk, erofs-utils, findutils, gzip, libarchive, pacman and sed to dependencies.
* docs: Add documentation for buildmodes and bootstrap build modeDavid Runge2021-05-091-4/+22
| | | | | | | | | docs/README.profile.rst: Add documentation for the optional `buildmodes` array in profiledef.sh, the understood build modes `bootstrap` and `iso` and the implicit default build mode 'iso'. Add basic documentation for the bootstrap_packages.arch file. Add missing backticks. Fix indent.
* mkarchiso: Implement buildmodes that allow building bootstrap imagesDavid Runge2021-05-091-121/+272
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | archiso/mkarchiso: Introduce a buildmodes array, that can be used to build towards more than one output artifact type. Add a buildmode for building a bootstrap image (a compressed file containing a very minimal Arch installation). The buildmodes can be set either using a `buildmodes` array in a `profiledef.sh` or by using the `-m` option flag to mkarchiso and providing a space delimited, quoted list. The 'iso' buildmode is always the default if no buildmodes are setup. Implement building a bootstrap image, when using the 'bootstrap' `buildmode`, which uses a profile's 'bootstrap_packages.$arch' file to install packages using pacstrap and compressing it to a bootstrap image. The name of the output file is currently constructed from the `iso_name` value by appending `-bootstrap`. Replace the uses of `airootfs_dir` with the more generic `pacstrap_dir`, as the location denotes where pacstrap is being used. Replace uses of `img_name` with `image_name` and removing it from the global scope, so that it can be overridden per each buildmode. Rename `_cleanup_airootfs_dir()` to `_cleanup_pacstrap_dir()`. Make `_run_once()` more generic by prepending the state files with a string defined by `run_once_mode`. Add `_validate_requirements_buildmode_all()`, `_validate_requirements_buildmode_bootstrap()` and `_validate_requirements_buildmode_iso()` to validate the general requirements of the different buildmodes. Add `_build_bootstrap_image()` to generate the bootstrap image using bsdtar. Rename `_build_iso()` to `_build_iso_image()` to fit the naming of the respective bootstrap function. Extend `_read_profile()` to include the reading of bootstrap image specific packages from a file. Extend `_validate_options()` to include testing of the bootstrap packages and running of validation functions for all buildmodes. Change `_set_overrides()` to override the buildmodes if they are specified via the `-m` option flag. Change `_make_version()` to be used generically in all buildmodes. Change `_make_pkglist()` to be used generically in all buildmodes. Rename `_build_profile()` to `_build_buildmode_iso()` and set local variables that are specific to the buildmode, such as `image_name`, `pacstrap_dir`, `run_once_mode` , `buildmode_packages` and `buildmode_pkg_list`. Add `_build_buildmode_bootstrap()` and set local variables that are specific to the buildmode, such as `image_name`, `pacstrap_dir`, `run_once_mode` , `buildmode_packages` and `buildmode_pkg_list`. Add the `-m` option flag to the list of flags. Closes #127
* baseline: Add bootstrap packages fileDavid Runge2021-05-091-0/+2
| | | | | configs/baseline/bootstrap_packages.x86_64: Add a packages file for bootstrap images using the baseline profile and add arch-install-scripts and base to it.
* baseline: Add buildmodes to profiledef.shDavid Runge2021-05-091-0/+1
| | | | | configs/baseline/profiledef.sh: Add `buildmodes` array with default entry for the 'iso' buildmode.
* releng: Add buildmodes to profiledef.shDavid Runge2021-05-091-0/+1
| | | | | configs/releng/profiledef.sh: Add a `buildmodes` array to releng's profiledef.sh with the up-to-now default buildmode 'iso'.
* releng: Add packages file for bootstrap imageDavid Runge2021-05-091-0/+2
| | | | | configs/releng/bootstrap_packages.x86_64: Add packages file for bootstrap images and add arch-install-scripts and base.
* Increase timeout for initial prompt in build VMDavid Runge2021-05-061-1/+1
| | | | | | | .gitlab/ci/build-host.sh: Increase the allowed timeout for reaching the initial prompt in the build VM from 30 to 60 seconds. Fixes #129
* Use QEMU 6.x optionsDavid Runge2021-05-061-3/+3
| | | | | | | | scripts/run_archiso: Change parameters to qemu's `-drive` option to make use of the explicit `read-only=on`, as the implicit `read-only` is now obsolete. Closes #126
* Use QEMU 6.x optionsDavid Runge2021-05-061-1/+1
| | | | | | .gitlab/ci/build-host.sh: Change parameters to qemu's `-drive` option to make use of the explicit `read-only=on`, as the implicit `read-only` is now obsolete.
* Set more generic output for signaturesDavid Runge2021-05-011-2/+2
| | | | | | | | archiso/mkarchiso: Change the help output to reflect that the `-g` option is generically signing a rootfs (which may be e.g. squashfs or erofs). Change the output of `_mksignature()` to be more generic, as it signs any type of understood rootfs image (which may be e.g. squashfs or erofs).
* Force PGP signature file extensionDavid Runge2021-05-011-2/+3
| | | | | | | | archiso/mkarchiso: Force the file extension in use for the PGP signatures of the rootfs to always be .sig. When gnupg's 'armor' configuration option is used, the output otherwise defaults to using .asc. As the verification hook in mkinitcpio-archiso expects the .sig file extension, verifying the rootfs will fail in that scenario.
* Add ephemeral signing key to CI setupDavid Runge2021-05-011-1/+48
| | | | | | | .gitlab/ci/build-inside-vm.sh: Create an ephemeral signing key for signing the rootfs image (e.g. squashfs or erofs) when building the profiles. Implements #125
* Add changelog for v53David Runge2021-05-011-0/+20
| | | | | CHANGELOG.rst: Add changelog for v53
* Add packages for unlocking LUKS2 volumes with systemdDavid Runge2021-04-301-0/+2
| | | | | | configs/releng/packages.x86_64: Add libfido2 for unlocking LUKS2 volumes with FIDO2 tokens. Add tpm2-tss for unlocking LUKS2 volumes with TPM2.
* Add required packages to interact with smartcardsDavid Runge2021-04-301-0/+2
| | | | | | | configs/releng/packages.x86_64: Add libusb-compat and pcsclite as optional dependencies for gnupg to be able to interact with smartcards out-of-the-box. Closes #122
* Remove docs/README.knownissues. Replaced by issue #83.nl67202021-04-301-12/+0
|
* Remove docs/README.build. Superseded by README.rstnl67202021-04-301-68/+0
|
* Move README.profile.rst to docs/nl67202021-04-302-1/+1
| | | | Keep all documentation except the main README in the docs directory.
* Update README.profile.rstnl67202021-04-301-60/+59
| | | | | * Don't nest code blocks inside quote blocks. * Use monospace for paths, options, values, etc.
* Update README.rstnl67202021-04-301-37/+36
| | | | | | | | * Don't nest code blocks inside quote blocks. * Replace bash with sh, as there's nothing bash-specific in the examples. * There is no syntax highlighting for grub, use sh. * Use sentence case for headings. * Use monospace for paths.
* configs/releng/syslinux/: increase serial baud rate to 115200nl67202021-04-302-1/+2
| | | | | | Additionally enable serial in baseline profile. Related to #75.
* mkarchiso: create reproducible gzip archivesnl67202021-04-301-2/+2
| | | | | | Use the gzip option -n/--no-name to prevent saving the original file name and timestamp. Fixes #104.
* mkarchiso: make sure to remove potentially preexisting files from ↵nl67202021-04-301-0/+1
| | | | | | | | $airootfs_dir before creating them with output redirection mkarchiso creates "${airootfs_dir}/etc/machine-id" by using output redirection. If this file is an existing symlink, then the printf output would be written to the symlink target. It can be a big issue in case the symlink resolves to a path outside ${airootfs_dir}. Fixes #121.
* mkarchiso: append IMAGE_ID and IMAGE_VERSION to /etc/os-releasenl67202021-04-301-0/+16
| | | | | | | | | This provides the ISO version information in the os-release file. * IMAGE_ID is set to the value of $iso_name. * IMAGE_VERSION is set to the value of $iso_version. Implements #116.
* Add package count, El Torito EFI image size and initramfs image sizes to ↵nl67202021-04-302-1/+23
| | | | | | | | GitLab metrics Metrics are now collected in build-inside-vm.sh since the files in question are in the work directory. Implements #101 and #111.
* Ignore SC3060 in initcpio hookDavid Runge2021-04-301-1/+1
| | | | | archiso/initcpio/hooks/archiso_pxe_common: Disable shellcheck's SC3060, as ash is able to do bash-like string replacements.
* Fix shellcheck complains in CI scriptsDavid Runge2021-04-302-8/+11
| | | | | | | | | | .gitlab/ci/build-host.sh: Change the readonly TMPDIR variable to a global tmpdir variable and set it in the `init()` function. .gitlab/ci/build-inside-vm.sh: Change assigning the readonly tmpdir variable directly to assigning it after declaring it. Change `cleanup()` and `create_zsync_delta()` to use bash-style statements and also check whether SUDO_GID is set before using it.
* mkarchiso: also add iso name in grub environment blockChristian Hesse2021-04-072-5/+6
|