From patchwork Fri Jan 23 08:24:58 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Zhihang Wei X-Patchwork-Id: 4823 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 23 Jan 2026 09:25:17 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-wr1-f63.google.com (mail-wr1-f63.google.com [209.85.221.63]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 60N8PGhE015239 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 23 Jan 2026 09:25:16 +0100 Received: by mail-wr1-f63.google.com with SMTP id ffacd0b85a97d-430fcf10287sf1722585f8f.0 for ; Fri, 23 Jan 2026 00:25:16 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1769156711; cv=pass; d=google.com; s=arc-20240605; b=KKgMysGUNnSLGqUD60mALNpfEW2IUrUWBSs431H/3WbBnnuueLmbbYpkN3Yguu9Ldz L37cl1i31kk/++m7VMO7Rh2tY//3MbiapXCV6DUDIKV6Y41l9DWLLnfX8SdNluy/HNMv XEH1oLyZEG+tvy10NZvbYRxCdWTYaDPFLD//OvCtZPlp0EbNC2Mr6tXn/hBRGrZC03Ue F+Mp1vI0Xdpo8ZzUxsdmyankjlHDIZUshf/xc3M1G2lc6jB94pXbYm9vZUdlejugGFVL Wn2j4y87+moNZ/vgdzh1BA7cQvc+gpqW/ha21naXOAP9LjGYrJZD6hcrHQo9jsUtlKGJ QopA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:sender:dkim-signature; bh=iCsi7/SYAnu2zuZruRLL4+PBF1xyTQj7x4fRLX6IFBA=; fh=FqAiFOxg3eqrv9IH5WgDswCe1palYMuSV/yMmOKPgSk=; b=JDX3wLAvwKbIB/ECDj+lz5pVKKcnjw64/8GLXljPsi1yqLHL2gPDdWfn6rHbvRY6R7 MoTqzPQ4j2rjByZtGCCWC+CWZ5OWUc4e0cAsQAV+naM7LCDoemzdCrQ3BWgKf4uUc40M CSgIyoOVcjoNjNX8g4e80XDReFIPZ4XH955nLnGQAAIh4o0n1k9q1gmO6ROzjwZdTpB9 DVmaEyLKyFD8MTUuAjS9MVV7OMy0bjhNEo9p2+vmAQfoQv2Lrj5Y6e4YFUSywSP7wfYj Kq5XXuzyQrcSYE52PBHYiZMNGOVyKvBZnV65wXoelW8KrChR8E6BbDqak92eIawFnQR9 0LiQ==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1769156711; x=1769761511; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:references:in-reply-to:message-id :date:subject:cc:to:from:sender:from:to:cc:subject:date:message-id :reply-to; bh=iCsi7/SYAnu2zuZruRLL4+PBF1xyTQj7x4fRLX6IFBA=; b=GkHgp0S3Jyic/lSmOKJPUHWGgn/nEEJgHtZzN1sbLWIOQZ6DGf1NxJoAEcaRsz6Ulw opnUY14/anW4CMzOc0rYSNVANL6Qn0ZsEdmgmai2ng33Xe5qnui4u8f9BZYsIjZiKJGa UGp6HVC+zZZ193sDlRTVWMDkbbuHcTIJ7uxb5FMgVX586RPt24vC4KLFc0mZ6SIxqGyu /CFzB+ociRlzbwNkDBRSc+QGJL+nhjAnuhRs7/EkIzAlo7v2Fs7usA7Wc+elZczBYD6j fqVgNtXVJ7eOSC2LXUBdIhBlFjDoIMyOJqBrOGwUI4ubriWJOfGO4sd7deKBOAt6IV9f F2rA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1769156711; x=1769761511; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :x-beenthere:x-gm-message-state:sender:from:to:cc:subject:date :message-id:reply-to; bh=iCsi7/SYAnu2zuZruRLL4+PBF1xyTQj7x4fRLX6IFBA=; b=w5MRsQBv+bXvkSpkRF/tVaXCEO7mJD6DlTssEJNpFxSkfNsTCGnVOiokgYeJFGfXPZ +T5zBAGybQhyedrCGo2m/RpHneu+YfnmbjkmYkVyId7b5ehXQ43uZKVxytFU23PgCqo7 zEX0Ms+0/D1M6COSEVm13IXO/pZKUYlvzA/RgBFD+ivlhLkyDbd3GDNo6s54lAIfla07 7Mx+9QJGWwrrjIvvRx2/3RepwkoL9LVuoFdmLnAMwLpiZQRspMsRdebml5pFi64pCNMQ jJcOS3V8qBIvkQHD6xIjqEsxmzkylmhKqsFBpurmexXGRlwEv+Tlj5Ir6d3ncbIe3i4U 5n7w== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCX3jTMKnWqS/pxyOaKVDiGigq0Xv/uZGGUWgNd+ByQ+zsnA6hxZoEPLG5cas49m+iHbNvInPIY=@isar-build.org X-Gm-Message-State: AOJu0YzQMQRK0jKz0pMYd1UUr4iZpBrDB2qgTl5/xnPDzmOJjpIggz/P BwlyINXtanHPobtxnUnBGbppiU6o8nPmWnrSm0Eh75yuL6TUJ1yir0y4 X-Received: by 2002:a05:6000:4387:b0:42b:55a1:2158 with SMTP id ffacd0b85a97d-435b1594203mr3640411f8f.17.1769156710455; Fri, 23 Jan 2026 00:25:10 -0800 (PST) X-BeenThere: isar-users@googlegroups.com; h="AV1CL+GK3nXtnytHRAaXxZWIlwZJFMjNreFFoHLIKNRgov9FKQ==" Received: by 2002:a05:6000:26c8:b0:432:a9f1:1b84 with SMTP id ffacd0b85a97d-435a62c9439ls1200555f8f.0.-pod-prod-02-eu; Fri, 23 Jan 2026 00:25:08 -0800 (PST) X-Received: by 2002:a05:6000:268a:b0:435:8aa0:a30c with SMTP id ffacd0b85a97d-435b1606506mr3421224f8f.48.1769156708429; Fri, 23 Jan 2026 00:25:08 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1769156708; cv=none; d=google.com; s=arc-20240605; b=E+mt27MzVlCk3QYAO0MDHy143nZJ52uXDYkEQtZuoZ6981fnVzZV+Ppq9dTa7q16TQ ZP0W+F/sELoTC2M0OiHSxuadJyiWZUY8qYepkLYNwJTUe7C+P3ZdQBK8zdpTJzUf+3sW CJqIKMxDG7WEx7UE2Ig6HkP2mx/4N+OWcgkeGwXQF7kd23PTyDwDQX2zCsniiMBYIQmC AgnLqvrMuX/jNgsdow3W8h4XnLZLpX8UjeFrBNq27ON/WX6dLE4KEXm+zdcY74o01lRg uBwbu2XqLQSOFs0TMxRlE4rKKR1ZDdrmb7mjZR822wg8baiJDd9yXybnJwkewK14E6gs MpZw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from; bh=c3ifRI9MOYg3BeKC6wVzp86oxUhgbM5E3xGxcS97+JU=; fh=V42d4Y/lNDOgZ/9/qsphFBeZCU4sz3YugfOOjBc+1H8=; b=hg2pLah0YY3fD/DicjG4y0JIiojvqj9RnVobHdi1/dQT0TW5+K6lZEEM9ofeCGDLRo IHiB2oLccr+dGk9FRYNYlO0rfYgI51bwgtJPoZKl51Di7DYBR1AgE19j1gsYoesDWz+/ NjkjnFF6JWK//nXkPd61xlsAsJ/J0MEjasz1cbasg86FgDcjzeX23Qi8i4SbqFA22bok Xqk4w/TW3NM0KK9XxkiD5tr8Bq0S8CAVi7YcVNjIdLSigFOyc2vQbGQTS3nI7NtD7Cki uJ5uQueXkSGwX1rUqYSO7fVBmflFd+xlYFmEK0HUgOtJcT2U7p9s8maOaRYNNrGwJkjw VmrQ==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id ffacd0b85a97d-435b1c08009si32255f8f.4.2026.01.23.00.25.08 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 23 Jan 2026 00:25:08 -0800 (PST) Received-SPF: pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from debian-zwei.m.ilbers.de ([88.130.203.42]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPA id 60N8P1Xw014977; Fri, 23 Jan 2026 09:25:07 +0100 From: Zhihang Wei To: isar-users@googlegroups.com, felix.moessbauer@siemens.com, amikan@ilbers.de Cc: wzh@ilbers.de, cedric.hombourger@siemens.com Subject: [PATCH v3 17/20] testsuite: skip VM tests if images are not available Date: Fri, 23 Jan 2026 09:24:58 +0100 Message-Id: <20260123082501.240751-18-wzh@ilbers.de> X-Mailer: git-send-email 2.39.5 In-Reply-To: <20260123082501.240751-1-wzh@ilbers.de> References: <20260123082501.240751-1-wzh@ilbers.de> MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: wzh@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= From: "MOESSBAUER, Felix" We currently fail the test if the image is not available. Instead, we now skip it and report what is missing. By that, we stay semantically correct by not failing tests when pre-conditions are not fulfilled. Signed-off-by: Felix Moessbauer --- testsuite/cibuilder.py | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/testsuite/cibuilder.py b/testsuite/cibuilder.py index 7538ade2..6faa9038 100755 --- a/testsuite/cibuilder.py +++ b/testsuite/cibuilder.py @@ -24,6 +24,7 @@ from utils import CIUtils from avocado import Test from avocado.utils import path from avocado.utils import process +from avocado.core import exceptions sys.path.append(os.path.join(os.path.dirname(__file__), '../bitbake/lib')) @@ -703,6 +704,7 @@ class CIBuilder(Test): keep=False, ): time_to_wait = self.params.get('time_to_wait', default=DEF_VM_TO_SEC) + self.skip_if_vm_image_missing(arch, distro, image) self.log.info("===================================================") self.log.info(f"Running Isar VM boot test for ({distro}-{arch})") @@ -800,3 +802,20 @@ class CIBuilder(Test): self.vm_turn_off(vm) return stdout, stderr + + def skip_if_vm_image_missing(self, arch, distro, image): + ( + image_fstypes, + image_fullname, + deploy_dir_image, + ) = CIUtils.getVars( + 'IMAGE_FSTYPES', + 'IMAGE_FULLNAME', + 'DEPLOY_DIR_IMAGE', + target=f"mc:qemu{arch}-{distro}:{image}", + ) + image_type = image_fstypes.split()[0] + rootfs_image = f"{image_fullname}.{image_type}" + rootfs_image_path = os.path.join(deploy_dir_image, rootfs_image) + if not os.path.exists(rootfs_image_path): + raise exceptions.TestSkipError(f'VM image missing: {rootfs_image}')