From patchwork Fri Jan 23 08:24:44 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Zhihang Wei X-Patchwork-Id: 4821 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 23 Jan 2026 09:25:13 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-lj1-f189.google.com (mail-lj1-f189.google.com [209.85.208.189]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 60N8PDuX015090 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 23 Jan 2026 09:25:13 +0100 Received: by mail-lj1-f189.google.com with SMTP id 38308e7fff4ca-382f4c1fa42sf10971961fa.0 for ; Fri, 23 Jan 2026 00:25:13 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1769156706; cv=pass; d=google.com; s=arc-20240605; b=i1erxR+o5R0rmoOiFE5GZn67qPxzL0NT7myEvEpaulqEiYddhBHEjVnqkl4Bhw/Rqr Hy4Kjv3Z4d5txOE9SjEP+4Dg6sfy0A6yiPbhZAIWxxtaDWRVCMerXEFtOfc6kRboSo8K hEgqQF8IuDoDIrQxGrwY2XWytrRi5gyCZn8hU/XlsWXHRhIOM/iUktKiuAT8IqZuaC+e hsuHYxFa8gSg3VCrR9o3kq4A5PFmU+tKFm/CDm5G70i7HcO5BdvBkbffxK53Wpz9hGhe l/+8nRhaLidBbdzlhC2R9k3qRtRqJbXw8ZuRA857Jy5BlVKZLyE4mXxX7NI/X0u09LGO EcFA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:sender:dkim-signature; bh=BaWeqm6od9s2sK74lt0am0yvzw68yEt1qaxsaaRqJdM=; fh=1cGMCOM0qRHjt30o8UFAy9WDxEDtjMGRl+aVCtKMA9g=; b=YAiaU3oWe36pf4Jlejtz61ji8H3C2R7e+9uptw0nRRRu4hTGLsViCmv4CGHKghvf2a 3Fbpt6rvJsuHk6l3tUa2cMYIeSDmz4f/aal4Y2G7PMbRZNHCVvUGI7RNLi1Mpt78bshj E5JmppS0zkdv+J6Zpa+xWFZ4MciqOOd+5W/ywjO1xUevumEpIUoqOnifH4XX/CT5uHzn j2f4+Ow19FMmYySkE6G2ly6sPP/byuYxW991sYO2XocG22BJl9N5/xzs6fjcSYcWTsuV h+vaACdk60v0vPIPol8DEXDjDMq4QhQhrziGYxBhNRpS1W2fkmh++N8Hb7yfWoBdu6YO aRgA==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1769156706; x=1769761506; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:references:in-reply-to:message-id :date:subject:cc:to:from:sender:from:to:cc:subject:date:message-id :reply-to; bh=BaWeqm6od9s2sK74lt0am0yvzw68yEt1qaxsaaRqJdM=; b=UvELIehVGEJn3SNUb2r9yE5sm/QFTnkI+b6sxh9Na+3AVKI5rf70R5GMHyL6mSEzwy pvXdfw8ORRp5QghzpL0FAoVDw6qwSC/tkEL5NWd4jlpw4Z+Tz/zKwn1YuDfhZWw/JR34 kkhhGMR2LfSvgLsxz4mE1qd0JjKHI2MA5i2BxzyKAFFMq30XSMwVMUeXnk8oWdfZypaU 3lUr9GJcFoL/DLtpAIQz/xZlYAH0wJ6Ylgcl06s0RL+WLxALSla9rhCznRctmQPuj9qJ Q5Qx3LKdjvb3NwIB8C4kfLnMa3Tl16Lgq3NIRSgmOqgyIaYh31CK7h8DJtq/Qn8kWVJA uGCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1769156706; x=1769761506; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :x-beenthere:x-gm-message-state:sender:from:to:cc:subject:date :message-id:reply-to; bh=BaWeqm6od9s2sK74lt0am0yvzw68yEt1qaxsaaRqJdM=; b=bN98SA/DyGJMHvPL/+lahdQ6BOmBIqltAfWTH7QMhdXEX3qSmqvfdYD47GCF4NFl0f 2pKJCqEimdoKJDLq+BA0hzGfmtSLkJlJR1XcZw6td268fE+l6M8SLDyj2pZ+h/QRisW5 UGAkoPheCAGs+pf4cQ1IBhhtyeMqg/I7esRseWiGOisCLaHCvGR3aMaq3vNguhN7qFJC Ih1AQ9X5oslgnGtqCXuexj34MyksSNhzyMxtsYgOMgezNYF0e+uicwegCNFxt0WHFcjn /Y6wAMncdFsewSNiThZD0al9l4PtEos9ePVxqt96qeNUUeNg/iv5ArY5E7HZ6o9Sniup es9Q== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCX4bVSubZ57w5YZqLV4keHp0lwyfRtVdgexjQzOr8zURfOettYhubVe6+8ogInHDSayLuYMLpU=@isar-build.org X-Gm-Message-State: AOJu0Yw/oPagCIqDP8Dl3bFt8thDzHFgwkyVFqz7vWesAaD2KgnJcohQ TzIPaVY6btkLYZB1J2V1Qxm8yjisxtyduf1aAZy23UrE4n9ss5ogJqvj X-Received: by 2002:a05:651c:2203:b0:383:2663:eb4a with SMTP id 38308e7fff4ca-385da0c234dmr6104941fa.41.1769156706226; Fri, 23 Jan 2026 00:25:06 -0800 (PST) X-BeenThere: isar-users@googlegroups.com; h="AV1CL+EVfffWD3H7Hoon6+siq9ETe8FBteBcVPePmWn6xyaGoA==" Received: by 2002:a05:651c:4410:20b0:382:5b25:632c with SMTP id 38308e7fff4ca-385c235b422ls2064451fa.0.-pod-prod-07-eu; Fri, 23 Jan 2026 00:25:03 -0800 (PST) X-Received: by 2002:a05:651c:2110:b0:338:10c9:5871 with SMTP id 38308e7fff4ca-385da096e21mr6702641fa.34.1769156703504; Fri, 23 Jan 2026 00:25:03 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1769156703; cv=none; d=google.com; s=arc-20240605; b=akUJHe3/T0ewPA5RwVE6+0JPyryuKyoDb67TtdLTDy5BovxPCFxE76Um84VmKL1IOO 9EpXm4rTd7MNwb9+1cUoX6wzPAV4r22sZvJRuvCy8s0w1yQsiD0NN/BIgWrtqFmYyKLy qETB78RIU77lqkjWwJmBs+bSbfs6zdTvaNVP8qZcYLZ2Dz7tSFmOweKXUEdq7nBAODzc LgMM9Wql3RWyTFCbfY2BykzlmpETuQeiTi78ogPCXz3HmomxRw9dw4OTeOHfj3GlWIzf iDeOe9SBuA1JictRx2knOylGqxUdWR6SpPl6STgSoSIfaHlhyhg+yI9SjzxCtZl/2v/G UAbw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from; bh=p20ozXUjO95QtxzVP4HbR9FNwE4sj1dSXHS6Mx9wt+I=; fh=V42d4Y/lNDOgZ/9/qsphFBeZCU4sz3YugfOOjBc+1H8=; b=P5KW5fwnkO6FPr9T/eyVWWHPmg6YGT4oWM4CkuAmaBt6T9Qkv7eINZAQUCn76ikqFB 8oMxrABM/72OoSV4vfcAECMO4DX+Y0lfgXvb58wDhQ8i1AvuUmJ3FpmGiyEjyIPAg7cj L/1iLTokKtJqssf1evX9ML5xjj8H64ym7RNxpPa4O4P3dRN+XFA2uQhARriiuaBv+AH3 DeXm+wx4qttYXtWfle++UKEgcY2dG0cupkZHlAAaklDbTgqn62KpBJVnZ2Nt29Pr1QjJ wG3zh5xPaCJj3DnAB6N2lle9VztmKOhwljY9pZCMAdKlkdy9dWrVAFLeljlFcMNwqSkh adRQ==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 38308e7fff4ca-385da0e9ef2si338021fa.5.2026.01.23.00.25.03 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 23 Jan 2026 00:25:03 -0800 (PST) Received-SPF: pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from debian-zwei.m.ilbers.de ([88.130.203.42]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPA id 60N8P1Xi014977; Fri, 23 Jan 2026 09:25:02 +0100 From: Zhihang Wei To: isar-users@googlegroups.com, felix.moessbauer@siemens.com, amikan@ilbers.de Cc: wzh@ilbers.de, cedric.hombourger@siemens.com Subject: [PATCH v3 03/20] testsuite: make prebuilt container a feature test Date: Fri, 23 Jan 2026 09:24:44 +0100 Message-Id: <20260123082501.240751-4-wzh@ilbers.de> X-Mailer: git-send-email 2.39.5 In-Reply-To: <20260123082501.240751-1-wzh@ilbers.de> References: <20260123082501.240751-1-wzh@ilbers.de> MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: wzh@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= From: "MOESSBAUER, Felix" This reworks how we handle feature tests: Instead of binding a feature to a target via appends in isar-image-ci, we implement the feature by using the test setup function. By that, we have fine grained control over where to test a feature and can avoid testing the same feature over and over again. This leads to a much cleaner architecture and faster test execution. We start implementing this approach with the prebuilt container test. As the images with containers are currently re-used in the VmBootTestFull, these tests might break depending on the test execution order. To fix this, we rebuild the needed images in the VM test itself, which takes less than a minute when running with sstate cache. Signed-off-by: Felix Moessbauer --- .../recipes-core/images/isar-image-ci.bb | 2 -- testsuite/citest.py | 25 +++++++++++++++++++ 2 files changed, 25 insertions(+), 2 deletions(-) diff --git a/meta-test/recipes-core/images/isar-image-ci.bb b/meta-test/recipes-core/images/isar-image-ci.bb index 7f2b404d..58aa5738 100644 --- a/meta-test/recipes-core/images/isar-image-ci.bb +++ b/meta-test/recipes-core/images/isar-image-ci.bb @@ -16,7 +16,6 @@ IMAGE_INSTALL += "sshd-regen-keys" # qemuamd64-bookworm WKS_FILE:qemuamd64:debian-bookworm ?= "multipart-efi.wks" -IMAGE_INSTALL:append:qemuamd64:debian-bookworm = " prebuilt-docker-img prebuilt-podman-img" # qemuamd64-bullseye IMAGE_FSTYPES:append:qemuamd64:debian-bullseye ?= " cpio.zst tar.zst" @@ -52,4 +51,3 @@ IMAGER_INSTALL:append:qemuarm:debian-bookworm ?= " ${SYSTEMD_BOOTLOADER_INSTALL} # qemuarm64-bookworm IMAGE_FSTYPES:append:qemuarm64:debian-bookworm ?= " wic.xz" IMAGER_INSTALL:append:qemuarm64:debian-bookworm ?= " ${GRUB_BOOTLOADER_INSTALL}" -IMAGE_INSTALL:append:qemuarm64:debian-bookworm = " prebuilt-docker-img prebuilt-podman-img" diff --git a/testsuite/citest.py b/testsuite/citest.py index cba3c008..eec90c6e 100755 --- a/testsuite/citest.py +++ b/testsuite/citest.py @@ -265,6 +265,25 @@ class CrossTest(CIBaseTest): self.init() self.perform_build_test(targets, lines=lines) +class PrebuiltTest(CIBaseTest): + """ + Tests associated with prebuilt artifacts (containers, debs). + :avocado: tags=prebuilt,fast + """ + + def test_prebuilt_containers(self): + targets = [ + 'mc:qemuamd64-bookworm:isar-image-ci', + 'mc:qemuarm64-bookworm:isar-image-ci', + ] + + self.init() + self.perform_build_test( + targets, + bitbake_cmd='do_rootfs_install', + image_install="prebuilt-docker-img prebuilt-podman-img") + + class KernelTests(CIBaseTest): """ Tests associated with kernel builds and development. @@ -984,11 +1003,17 @@ class VmBootTestFull(CIBaseTest): def test_amd64_bookworm_prebuilt_containers(self): self.init() + self.perform_build_test( + ['mc:qemuamd64-bookworm:isar-image-ci'], + image_install="prebuilt-docker-img prebuilt-podman-img") self.vm_start('amd64', 'bookworm', image='isar-image-ci', script='test_prebuilt_containers.sh') def test_arm64_bookworm_prebuilt_containers(self): self.init() + self.perform_build_test( + ['mc:qemuarm64-bookworm:isar-image-ci'], + image_install="prebuilt-docker-img prebuilt-podman-img") self.vm_start('arm64', 'bookworm', image='isar-image-ci', script='test_prebuilt_containers.sh')