From patchwork Tue Feb 9 04:10:04 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Silvano Cirujano Cuesta X-Patchwork-Id: 308 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:c583:0:0:0:0:0 with SMTP id x3csp529168oop; Tue, 9 Feb 2021 06:10:11 -0800 (PST) X-Received: by 2002:aa7:d888:: with SMTP id u8mr22946714edq.239.1612879811041; Tue, 09 Feb 2021 06:10:11 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1612879811; cv=pass; d=google.com; s=arc-20160816; b=LoM0vmNSlb4UPNLmkEPpHvEdD4Ge6teCvGl8JdFtEAhwk7I6BULsyGMBqFzvOSb5TS /qy+GdK3kqwURslyvPmdtse1hRM5+fowJsp8E6NxYPhdM6aEwn/KE4WRnKT2vk36sqli r11HqaWYrhJLansuYjMdqZv3Esr4bhXqo8IE93hiQeW2xM1nPGYcqCQB//liWMxkjle6 51J1jFINQwOtXc+582o9e6QJRcl2CRmV86uE8vSC+62IJBiZdma4A4DfFJY0jzHPymOA Fl+10XGf62OZlgsUmJJ1rXZO0nIIuAa0UX5x0p+tWCNVtXWRq83VUpgXmYda9GVXx5vt Ebhg== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:to:from:sender:dkim-signature; bh=eeXNWGa9etHLTuWtUyZRF2ItkTnw0QYFBqAbKT95M9c=; b=RrzGVZDMVvOAIuOBwxmJBZYemphLb7X6VLccEQ/lOvF/2HbTapMfwZah+RsH1le/Y1 6bWYiJ3ueu2A2VlWBrxy9NsmbeUj1fvfjlTF52icb4pRVFvTzMTuuxEcUz/Zn3V4LxvF c4tnw7iXFkmM/FgXSIAJH/H2ahNJ/kE/AeBkA+yN1mX7zSGRNwzq6AkQM6LZvKRWTY8u jFzIY2/EKEV1PKkYOV4eMu6Yb05SLYbYliazKGc+eEy9M5Ny+MLXt5alC5t5fQXdnKnk nF0O40XO4EswZo02Wf3A12EZLl2yi5NF4CkAOB59c99Ld/YHdzFmdflN5lZyNZ+cv4Gi KCTQ== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=LA3rXXC9; arc=pass (i=2 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of isar-users+bncbcd6jj6cqqfrbqvprkaqmgqeytoipxq@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCD6JJ6CQQFRBQVPRKAQMGQEYTOIPXQ@googlegroups.com; dmarc=fail (p=NONE sp=NONE dis=NONE arc=pass) header.from=siemens.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id l9sor19630082edb.23.2021.02.09.06.10.10 (Google Transport Security); Tue, 09 Feb 2021 06:10:11 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcd6jj6cqqfrbqvprkaqmgqeytoipxq@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=LA3rXXC9; arc=pass (i=2 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of isar-users+bncbcd6jj6cqqfrbqvprkaqmgqeytoipxq@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCD6JJ6CQQFRBQVPRKAQMGQEYTOIPXQ@googlegroups.com; dmarc=fail (p=NONE sp=NONE dis=NONE arc=pass) header.from=siemens.com ARC-Seal: i=2; a=rsa-sha256; t=1612879810; cv=pass; d=google.com; s=arc-20160816; b=0zOI2vWL0r67oe9431seodrFW5SGtXiV1JdNhk+P33d6slnZsfIAh8UqsmvfRV2HMw 7IdHdNGnxAE5ZJGe5fsMhyIH4H4bwdPlDK3eE9wMxIUEaG4MVMW/rpVw0EzgRZFpg9pD +H0PEFiPAceUInHkG+F8q7Jc9s8IPPK/5sJFRZl/l23iYEXkZCAF6U5pMEPahPBkGFxr PEYkxFPEwA52B16BZB8uCHc5wHghG/eemg8hPAaYjja59JLwyW7qi1vOVP9v2ubUd/c3 +NS2S4s3GpFfcn5oemvLEsMU+heJqTaC+Q+XChooepHbXSu6DYdVEIBrSSlrPBdOGbxN 544Q== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:to:from:sender:dkim-signature; bh=eeXNWGa9etHLTuWtUyZRF2ItkTnw0QYFBqAbKT95M9c=; b=vsu6eIyudpgi6gwD+NxGncbwGfUNeltmmH1TIGCqlETI91zBo5TArcoxViMd9ILO45 T0DQhVWwvDqrpXmUF7Iaw4cf0FLE/f9u0xATOIgUVppPdzqtIbon+MvfHSMuw5ZVHh9r ZDrhMYrdPiUoxgAb0KsJpEmVFxQ8IQUlFw7vszu3cHmYkSyaN+CDTLYwXGR3p5SZwvS/ DKjrCN7RXsRautVd4s2x6qYEzkz7Li5sgnuDW8imvLP6IPid7yA48iAO61i45QudRAmd 5dPbHU6gMjK91F/28nWyKqHoHXHXYeCdV1u1lB+XRaFrDHBwrS2S5osK3xZcSEzTLTWj jTKw== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of silvano.cirujano-cuesta@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=silvano.cirujano-cuesta@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:from:to:subject:date:message-id:in-reply-to:references :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=eeXNWGa9etHLTuWtUyZRF2ItkTnw0QYFBqAbKT95M9c=; b=LA3rXXC9j9ZeVY9E8qwbh01xH9Bvbn0EclG11Bg+GEVyXqMR3hocLWRyUEVo0jN+/l FgiE8NxI9wGwBkTiTd9HYeK3wcwHB5zgJGjBgBk3tI6aRw4uCax0X9CMyNd/gqK98pjI +QdYLTgAZBMDT2LTp+R+nzvM1xioS7H/fVmfreWAnsCjBg3ix1YOZThm76zQGyR3e493 qm7jHJNRnFWNJWkMtvKHB1IPNo1Fjy3aR1j+Ix79z2GPsAUt4viH7sN3zX40c3tTir65 vzcpvBOOrWlZ9tzEhJWoEV6QiaR7u3tK4HT33dze1/LuccbUyKR2otnwwUQHu0V+mjze l54A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:from:to:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=eeXNWGa9etHLTuWtUyZRF2ItkTnw0QYFBqAbKT95M9c=; b=AXihe/BoOtfcCrj20Phm8vlV4rL/bXryrzEha3qKH8oX6MCZxA7G7HFl5/Mjf4y2aM VaOGVGvH/R9345RxDWJeNm4dHvAhevgy1CpOtpkZdjz868aBpUKqVDN5+UPnLGVST9WU dDwvse+v3tUVpSBschOrXN3rPmaxB05m3vqPOYA1BYPjTWU0dU3egQCd8AAFUVQHcHSm bwlVuWcNeNfgKLLQ2wo+0UrjYstIsANwoACpi3wXjaIzYtuXkYAIHPFJMhfEwWAfRYrL ppcWHFwP3r6gWkZXNk3xcotz2GtoCiJuhCyGBSWLOv9NJpUFFg5O5hhD3IMf1vlV2LTE HZjQ== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM531ym/eRl1+FYggZB/NnYjAjMBxGK5FXwNpgKEulrZbbs45WuWSJ lmXFKHh3Qek1mTlDr5XW6SA= X-Google-Smtp-Source: ABdhPJymt0d+dm0TZmMAuB2v95c8hB/kdVYO63HS/ptQBujKketANsax6aaIYjQITX5vWi9Uetv3FQ== X-Received: by 2002:a05:6402:1c85:: with SMTP id cy5mr17254079edb.379.1612879810715; Tue, 09 Feb 2021 06:10:10 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a50:a41e:: with SMTP id u30ls2581226edb.1.gmail; Tue, 09 Feb 2021 06:10:09 -0800 (PST) X-Received: by 2002:a05:6402:4316:: with SMTP id m22mr22851885edc.64.1612879809855; Tue, 09 Feb 2021 06:10:09 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1612879809; cv=none; d=google.com; s=arc-20160816; b=ill2zFXqDrWtQu4yyeqH3f3gX6yQhgaeclosPunEsv9SeHoVPuMpMWbdTyfYz4+Sm6 n1aPLrVuYFixEvyXOVE7GvWYcKgF3/QhGT3lbqSZF3jdv50RtU130gAAC6i9pGk85tkB ogdlEi5jYpzI94lThCIcueQaAhT3cgme2x68ZOEIa3JGOKscGKiCycQGcJMAJO4XiMkq qx30mcX0Hcvh262hNPpkZ/I+WkoRMonjOmowun7dkQZbR1de4cTi3GuaTmcbCLhlD9xg aFvC6I+ab4GvQcuKFzCvHQz2xLSyvlFVrAH7Ed8E/pxoIIwAe5NBcLQaHgv0I7gUygPW K3rg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from; bh=q+OdxZpIue/CjRQP0RP3z6URr22OfuSHyuv8OJWMvxM=; b=jrTASs805BtNmSOEJD4W8uxQYskniiNSVhC3hwM2zc+DPA42wI+3xBdJ0k6OTY5O9x IWpyxO3jkBwMBgNsfqXeUrDu9Yzn2pIkQ+8rMB2SJAKLAFTu0k4pXOYuhG1dKBU8makp nUDhBQgNT63nUYK4+77Z6Y9HmM84ZiK9GTOcryyNAF13tBNs2z+QTJsxMhxbe7ilUGwX ymK8S1c2saBZL3nqoDu4UiGXr5X2z1u2FeH8ml4Bul/9WjLaUDYSAAhKxqragmX6nNLB d011Rr/slWPvjxwpoimxatytvCUgXEJFmaV28HZ8NCUc8Wy1BWoPzR1jWZb1pWac/1tb KpTQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of silvano.cirujano-cuesta@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=silvano.cirujano-cuesta@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from thoth.sbs.de (thoth.sbs.de. [192.35.17.2]) by gmr-mx.google.com with ESMTPS id y20si876046edv.3.2021.02.09.06.10.09 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 09 Feb 2021 06:10:09 -0800 (PST) Received-SPF: pass (google.com: domain of silvano.cirujano-cuesta@siemens.com designates 192.35.17.2 as permitted sender) client-ip=192.35.17.2; Received: from mail1.sbs.de (mail1.sbs.de [192.129.41.35]) by thoth.sbs.de (8.15.2/8.15.2) with ESMTPS id 119EA9PN025516 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Tue, 9 Feb 2021 15:10:09 +0100 Received: from md1sf36c.ad001.siemens.net ([167.87.10.176]) by mail1.sbs.de (8.15.2/8.15.2) with ESMTP id 119EA6ti018204 for ; Tue, 9 Feb 2021 15:10:08 +0100 From: Silvano Cirujano Cuesta To: isar-users@googlegroups.com Subject: [PATCH V2 1/2] images: add support for container images Date: Tue, 9 Feb 2021 15:10:04 +0100 Message-Id: <20210209141005.45491-2-silvano.cirujano-cuesta@siemens.com> X-Mailer: git-send-email 2.30.0 In-Reply-To: <20210209141005.45491-1-silvano.cirujano-cuesta@siemens.com> References: <20210209141005.45491-1-silvano.cirujano-cuesta@siemens.com> MIME-Version: 1.0 X-Original-Sender: silvano.cirujano-cuesta@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of silvano.cirujano-cuesta@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=silvano.cirujano-cuesta@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1691227060315266060?= X-GMAIL-MSGID: =?utf-8?q?1691227060315266060?= Add support for creation of container images with the build root filesystems. Extend also task "populate_sdk" to support the creation of a container image containing the SDK. Signed-off-by: Silvano Cirujano Cuesta --- meta/classes/container-img.bbclass | 99 ++++++++++++++++++++++++++++++ 1 file changed, 99 insertions(+) create mode 100644 meta/classes/container-img.bbclass diff --git a/meta/classes/container-img.bbclass b/meta/classes/container-img.bbclass new file mode 100644 index 0000000..85d9fb4 --- /dev/null +++ b/meta/classes/container-img.bbclass @@ -0,0 +1,99 @@ +# This software is a part of ISAR. +# Copyright (C) Siemens AG, 2021 +# +# SPDX-License-Identifier: MIT +# +# This class provides the tasks 'containerize_rootfs' and 'containerize_sdk' +# to create container images containing the target rootfs and the SDK +# respectively. + +CONTAINER_FORMAT ?= "docker-archive" + +containerize_rootfs() { + local cmd="/bin/dash" + local empty_tag="empty" + local full_tag="latest" + local oci_img_dir="${WORKDIR}/oci-image" + local rootfs="$1" + local rootfs_id="$2" + + # prepare OCI container image skeleton + bbdebug 1 "prepare OCI container image skeleton" + rm -rf "${oci_img_dir}" + sudo umoci init --layout "${oci_img_dir}" + sudo umoci new --image "${oci_img_dir}:${empty_tag}" + sudo umoci config --image "${oci_img_dir}:${empty_tag}" \ + --config.cmd="${cmd}" + sudo umoci unpack --image "${oci_img_dir}:${empty_tag}" \ + "${oci_img_dir}_unpacked" + + # add root filesystem as the flesh of the skeleton + sudo cp -a "${rootfs}"/* "${oci_img_dir}_unpacked/rootfs/" + + # pack container image + bbdebug 1 "pack container image" + sudo umoci repack --image "${oci_img_dir}:${full_tag}" \ + "${oci_img_dir}_unpacked" + sudo umoci remove --image "${oci_img_dir}:${empty_tag}" + sudo rm -rf "${oci_img_dir}_unpacked" + + # no root needed anymore + sudo chown --recursive $(id -u):$(id -g) "${oci_img_dir}" + + # convert the OCI container image to the desired format + image_name="isar-${rootfs_id}" + for image_type in ${CONTAINER_FORMAT} ; do + image_archive="${DEPLOY_DIR_IMAGE}/${rootfs_id}-${image_type}.tar" + bbdebug 1 "Creating container image type: ${image_type}" + case "${image_type}" in + "docker-archive" | "oci-archive") + if [ "${image_type}" = "oci-archive" ] ; then + target="${image_type}:${image_archive}:latest" + else + target="${image_type}:${image_archive}:${image_name}:latest" + fi + rm -f "${image_archive}" "${image_archive}.xz" + bbdebug 2 "Converting OCI image to ${image_type}" + skopeo --insecure-policy copy \ + "oci:${oci_img_dir}:${full_tag}" "${target}" + bbdebug 2 "Compressing image" + xz -T0 "${image_archive}" + ;; + "oci") + tar --create --xz --directory "${oci_img_dir}" \ + --file "${image_archive}.xz" . + ;; + "docker-daemon" | "containers-storage") + skopeo --insecure-policy copy \ + "oci:${oci_img_dir}:${full_tag}" \ + "${image_type}:${image_name}:latest" + ;; + *) + die "Unsupported format for containerize_rootfs: ${image_type}" + ;; + esac + done +} + +do_container_image[stamp-extra-info] = "${DISTRO}-${MACHINE}" +do_container_image[vardeps] += "CONTAINER_FORMAT" +do_container_image(){ + rootfs_id="${DISTRO}-${DISTRO_ARCH}" + + bbnote "Generate container image in these formats: ${CONTAINER_FORMAT}" + containerize_rootfs "${IMAGE_ROOTFS}" "${rootfs_id}" +} + +addtask container_image before do_image after do_image_tools + +do_container_sdk[stamp-extra-info] = "${DISTRO}-${MACHINE}" +do_container_sdk[vardeps] += "CONTAINER_FORMAT" +do_container_sdk(){ + rootfs_id="sdk-${DISTRO}-${DISTRO_ARCH}" + + bbnote "Generate containerized SDK in these formats: ${CONTAINER_FORMAT}" + containerize_rootfs "${SDKCHROOT_DIR}" "${rootfs_id}" +} + +addtask container_sdk after do_populate_sdk +