From patchwork Tue Nov 17 12:02:59 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Felix Moessbauer X-Patchwork-Id: 5619 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 17 Nov 2026 13:03:22 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-pj1-f60.google.com (mail-pj1-f60.google.com [209.85.216.60]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 6AHC3KWK005616 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 17 Nov 2026 13:03:21 +0100 Received: by mail-pj1-f60.google.com with SMTP id 98e67ed59e1d1-3ae72da2f57sf7330455a91.1 for ; Tue, 17 Nov 2026 04:03:21 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1794916995; cv=pass; d=google.com; s=arc-20260327; b=W6YyYTxfC6Wphac9XwkMxuHGgDnkuWfbWVw75Yx8tl2bLWPEWxXrOfONqZYho+ibox S+RWJHfeK1Ac2ERIA594PMqIxQ/bCXMwd74DXKeiSnCnur7NoJR6eYWy2uc2ru2DszCx KFbs1U10W6OHIGrgilpfxOhz4sC2Hfpumo9UK3opewqsdMei7EN1AF0ofZ8RKURI9yrs 1t/3xnjMiJOH3yqbZgDLvz7K5oR9F8A2UEgTnosbzPvUj8De5Yj0T/rRl/M2EnZmAxGZ csaIH2R1MODR9J+TTgIzoWEvzLWFTHQ8KK+6gEqRZeYGXpOujdBXflj1yP5TEANfa9Jh cn5g== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=RyxDm7e8hUXVzCAY5ze0h4QqFg/CaTttILlh0YaILtw=; fh=YGLu6EI98c0gdXkqnbx4Ed7pwbg6WFO4NMz63rZ9c0o=; b=iyF6iTx0e1Z4PRwqhwC9FcZyOTw5qotHDugsTr7iONG5mUGROlg3NEcQgQg9ro9OGv 8f0u/DFhalFnDci4kc0W8uW4L4v8bIX1TZEs9fb1eadkg8pFqI87bzzYkOwk3cjjj9+C WSdyenJXP7kdylLm1IwhdKPS5v5zicq42peDBZAliXES4Ml6oGZIkDc9nDk71bWux2zU BSi/ZmjcPjKcPMhAHjarO7ZhXi5447268qYcSfc0X2OeckGXrxLi/bMI8SvBacgwT/8F AH7I/N8WWhaxWSzjazaWLj82rMlqVT+HFNap7yaGwivD6gpo9VNX54yd/Bppq4q0sdCI q3BQ==; darn=isar-build.org ARC-Authentication-Results: i=3; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=yBIllXS3; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20260707; t=1794916995; x=1795521795; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :content-type:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to:content-type; bh=RyxDm7e8hUXVzCAY5ze0h4QqFg/CaTttILlh0YaILtw=; b=XgiNSKff8biTMmc/gKWfxfAzyg1LDcB59bm+7YVHhhtY6zLbxhA15Sa8n+/X8Xnl2k x+Sn34uT9rRacA/oUqHHonAcTQSki3Hi/G5kGrKohNUxBfFxth6cWVsxujRQCJVuz41h D5IWdHN+L/BNB6wSeVBeUB8MdIfArMEtJaV+OGx04Qq1dsT4bj5lQMQM1J8DS2PeQX0U FUIl8QxUV3lTDiAnXEsHm8RPWTn6sAxUw4I6xiWVHqR9bvrubBygl9tc+5WDzG9wrE8j rkwB+AcmapQZRC9KwDYnHjn/l94Fp1R+cy39giPdRSkdYjiL1mmDQUKS5M73Qq54mqr/ o55w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1794916995; x=1795521795; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :content-type:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=RyxDm7e8hUXVzCAY5ze0h4QqFg/CaTttILlh0YaILtw=; b=fpzEVrJdPNbT7hi8dxOWyudqrWqokwV7XsUuEHuGqeRI2TWNqxXnKIu3xigGgIJa8f PGWcb13pCZRJNFxVQfQX/fs3dg161Ya+GiF9q1kmSHL/zJmqYjfCN8MoZC12duIs/1JE 6HPC4SoriQeMGS1AeF5dBe6x7Q2v01B379xOKUHeI9eGXB69reCkg0gpJ5ehj2M9T7BS md5DS+uiLewOxhf7CXGcj1tmL1/pRam9ZdyAHNvF4qniOS2ihJTE5QHf4LgeyUA1cVBk T/BRbkeXP/Hpko0a47R6O3E6fwwIicGidX2CZGrQwyX05qKS7B4f0LdLq81w1pWR+FDm FG/w== X-Forwarded-Encrypted: i=3; AL+hErEfXFsrXiiyGxF6SUyDPCoGCPqgVaGnz7QzgJN7iTk356Q//QgDqmWHfke0CU1jLCYypklEdaM=@isar-build.org X-Gm-Message-State: APuU4Z/Yh7BzmzvYUJXVR2o3CijTM8LAOuXCp8Lx/s/nA9idEK4q8Q83 X5cC/iN8cTVwW1A2ZuGVORN2lUQbG0xlX3khoOJQ+s3Ab3KkZyELXogz X-Received: by 2002:a17:90b:2c8d:b0:3ab:e588:c2a8 with SMTP id 98e67ed59e1d1-3b1b0d8a4d0mr13909851a91.64.1794916994765; Tue, 17 Nov 2026 04:03:14 -0800 (PST) X-BeenThere: isar-users@googlegroups.com; h="ATskLddFbCn/BAmAs0NycMkB1Mkq1HJqxD50UNxsc4v3L8U9Mg==" Received: by 2002:a17:90b:1c0c:b0:3ac:7744:9de with SMTP id 98e67ed59e1d1-3b1aec7516bls7069450a91.0.-pod-prod-08-us; Tue, 17 Nov 2026 04:03:13 -0800 (PST) X-Received: by 2002:a17:90a:e187:b0:3ac:9c37:9426 with SMTP id 98e67ed59e1d1-3b1b0ba53d2mr15077586a91.31.1794916992864; Tue, 17 Nov 2026 04:03:12 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1794916992; cv=pass; d=google.com; s=arc-20260327; b=YC8C5je5omErmMSISM073SARfw9djzCk5XEIig3mqQCFEuqZhpMRsUCHZ5OoVrsQPj Ba3LeEo/QF6kYIpFVaYQzNti/bVEqQMJ0/j+s6Nv73+Lga4/3BjXAog+nkKAPKzc7Ba6 MlAlVqW+QuA8HW8LHLSTS2PVyC8cSWbmNCuZ82MXfC6wRUip9cc3YlGF1QXGENaT+itn GaGbLEzgFh2PJIJIazglLhS3rp4HbZmz2oFOoxRWnpO1IzVmL3pN5X9es63hpVq/XPSS zoBHh7LLUBYiYx6GVJwpg485ruJoC5ey7d0VYjqJrn2fBWsrteDm8ne8IAClOi1WByNM 4mgA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:date:subject:cc:to:from:dkim-signature; bh=3CFbCOomDT0LTklkygJWiDA9fqqZyHjJDRvIxq+eKdY=; fh=y4Q4sSo60XIDMfQl4kOzeqW/gQkja1RlhaZM6hZs/O8=; b=LaUz8lz4wspdXdQaggvTqBEUWlXrBMw+YzRapO4S519230SQy0EtRm/moRQ+SBlmU5 8lDVpP2ZTn+HRqQbohliqX1fwFql+eNXAnOF8JBwlPYKDJsZhs+uvzz5iUcBMqII382w 9HG7nXTtP47yPV6h7DdLZOuilcOxqQlJESbjR2psJt2aItXumv//BWMLbkH5pasVREw9 MUJojH39BaYGIeQ3oQuGOkwzyXJADqGsE0B5L3xU5+P7pY21yU80qvye4NJJjphTVlj4 H64Xk9nZZ5zD6MKQdPKw/X1pgiBbdeWWDByE7j5vq2M27Jxo1LGkslooIWDn6io1ZYQb qOUg==; dara=google.com ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=yBIllXS3; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from DB3PR0202CU003.outbound.protection.outlook.com (mail-northeuropeazlp170100001.outbound.protection.outlook.com. [2a01:111:f403:c200::1]) by gmr-mx.google.com with ESMTPS id 98e67ed59e1d1-3b3a42c51acsi65642a91.4.2026.11.17.04.03.12 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 17 Nov 2026 04:03:12 -0800 (PST) Received-SPF: pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) client-ip=2a01:111:f403:c200::1; ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=XjZDbJ7smiU6fcq7aVYxpmzehczzlNrmHPA6hp0GSFVHh29fl6LMsk/nyWMp+3C7wDbX72CMG3NNkjDesFEdtLk5puaB4KGZg6dPA5IYbp4XUbqG0UiXRaZTXa/J4FHDS7w45POOsrrkddH5AEb387+mOKWBKuDtLd2/LxgAnjtFUK1eGHTq7DLlfrQXfhK47Idj6vIZ5qXhBqNAT5jnylgIcJzUHaz582cZW51hjXJpVEKuMeKeT/W8ahFzHaAHHFsn6OzYlvply0DSyhaG7hTrwCWyG5SnpqwwKvSUjo42AdOFMC3fpDyCmzlu+5k73ecqmtavKV7diRvEFCyedA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=3CFbCOomDT0LTklkygJWiDA9fqqZyHjJDRvIxq+eKdY=; b=amtn+zbApzMnw6u3SBzMAGobt/F/I87hbbji4EDm3F9RDPA0H03+QoCGW5BWuSq7zt1FuAIYHKln/svBKT63kx3q6LUwqe4FBtT3wGaeYxLijnBugamRy/Pa+6Fawr6hu2+18dbbjLszLyzV2V4EzrYmpq/tyE9uPHqWgWSFWkOlQBgvQhOT8nRahSUQAAwWR3Avn+s3tMfoNywp0r1fVaIkJ4HYlqhfdh5fY1Mz+PhXdDCTxnPmbCxJL2tXkZVXYnRcXO6/fb8pUz8oh2e1pIZ4+Y/rRFKPDGz0VDbdKMAD9r/0/5UZTZj7J4sqWrvlXwIxd/qPmXMiVUIUH1o3ow== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none Received: from AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:17e::10) by DBAPR10MB4058.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:1c1::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.639.8; Tue, 17 Nov 2026 12:03:10 +0000 Received: from AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM ([fe80::c54c:ccd8:ebbf:477c]) by AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM ([fe80::c54c:ccd8:ebbf:477c%3]) with mapi id 15.21.0639.006; Tue, 17 Nov 2026 12:03:10 +0000 X-Patchwork-Original-From: "'Felix Moessbauer' via isar-users" From: Felix Moessbauer To: isar-users@googlegroups.com Cc: Felix Moessbauer Subject: [PATCH 1/2] testsuite: add support to run testsuite against specific SDE Date: Tue, 17 Nov 2026 13:02:59 +0100 Message-ID: <20261117120300.374231-2-felix.moessbauer@siemens.com> X-Mailer: git-send-email 2.55.0 In-Reply-To: <20261117120300.374231-1-felix.moessbauer@siemens.com> References: <20261117120300.374231-1-felix.moessbauer@siemens.com> X-ClientProxiedBy: FR2P281CA0164.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:99::14) To AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:17e::10) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AM7PR10MB3956:EE_|DBAPR10MB4058:EE_ X-MS-Office365-Filtering-Correlation-Id: f0f2f675-76d2-482c-c99d-08df44a2bf3c X-MS-Exchange-AtpMessageProperties: SA X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|23010399003|366016|18002099003|22082099003|6133799003|261009223027099003|55112099003|11063799006|56012099006|261102123227099003|261028144727099003|10067099003|261026121527099003|261026140227099003|261021123027099003|261021121427099003|261022075727099003|261022115727099003|261022105027099003; X-Microsoft-Antispam-Message-Info: BNI8QbQvbxJX0jOb6gyD8P+xPxhSiGZxl4Gp1XS8UvmAhDYa3lRfKTXYW8he7FmieTpSSnKw4DoGXpnnqQQnmxM7Yt/VvfHpr8eNRhiW0k4AAnwTlo2jtkXXdVJcmeVRAmq3rrkKHZWesOGMVjd26Q3h7K0r1XoI80eMEdO8WsxDLP3dugF6UdNJdxDByEWZRIUH5gIihsSAN25S7xoLX5LgwNOt7UbUm+RSX/niOYVAylvyv6YdmZVJ+XTxb/xhbkdAMkAiiiU0HEvOFvxRVWU4ynQVljkcCby1y/LjoA+WieoKhr6oo8EqWtXJoiSs4lmagpJFv3JtpSNGnogOwlfcjoYVyR557c7ETWVqBjh435zS0y88YGsJPBRqhiscTapcndqIBliJ0QgbAEknVhvnLHaze8oZ6PjWjEP+eI61WnSh7NqVLFyUSrIRm2Ko8jSy8W9DSsOzuF8eL0h9sj5Dw8SZMORqddLSquDZBIxo3msxxm9X8ZwjO8iOAWGeaDf2T/fm7lc9BZshGJYJdiLIYddiabmfEo5kFUJacrnBJcaQku/c/Qw4uCrcE79wtb2q1p3bkSMbhzJewMUQENY2bGUaVLmFey+2EUhwl90tYlQ7+2D0/ETWjt4GnLSGOx33DdrdFpcQiL/01X5f7CT3dEfv49+lg2aHAW2ITaM= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(23010399003)(366016)(18002099003)(22082099003)(6133799003)(261009223027099003)(55112099003)(11063799006)(56012099006)(261102123227099003)(261028144727099003)(10067099003)(261026121527099003)(261026140227099003)(261021123027099003)(261021121427099003)(261022075727099003)(261022115727099003)(261022105027099003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: ZN9q30VjqaUwslXiQteamYvdPBu5v/m7CqrKllAVxq+LuY1lPkNYwE+Hcl4TNbcyfWACUWCUN9gcQ760yV/fMFHGVSFHJUWu2QNG28rhS5cMBRpeYKtPnjzAvROHMuWWEBUuH1Jb++NHNJJTFRhSeiYMjhn11tQk63rxxd6npt3ZyOR8ZVCm+48+Ng87aiXXV3tvB4QFvARsYSPb59If3/Io1/KuGT8hZ/caFNCngWk2zbGyLEgVyM6Yad1D2pV2iE+bL3bd4HE48ZoBzftnpuyFDm2QickSWH85K4S9Nmf1z2RWwnzFwnZVUGvEdcDvSa7EhP7kKA7Wh7nRU3m06J1YpVRsUGT6PgLpKTsHndYmJhUk7LKWMJ0pmSKnAs4lf2OLJELT0fCwMF/WsTVjw9GHNs5kv+DnadS+/3v2AKuSPnTufRzSbZjshaBsCnRAu8XhbRNycZK4BL8zZKmyM06YiNvAEEkU90TPpX6UbRKgKQVP+GxSfexuYmz3Nb7L20Z5nAqhSgnz4eZi6p8rLcr0ONMzu0Pt+GsYFM0OWosfm5bgyLKqwDd+d2MkQA9Yll2fkrNr7FjlndeP2bXarM8JN9DHUZA7HD2TklAfUfBkINM7NXo6+AgKGQFWiJmR9fFwsueZq+660nQ94P7T8QNPnWioVXu31YH3KerCYIWMn7w9ycWn1cF1x6njaXjT3IUVcF5pugaaqtSnAG7Y9PdnEMboOmFmU1fABsKiwPqA/pBWTcjT+PF3RHw/FZr9KFd9VDkrE5LLq9omaEl7XnS5KSo+QECxuKOCtZVYzahgWQGGrcOwQVG6b9EYqLwuhLtN+IC4kll6k88ebO/Op5azXmEc0e9npB9kNwoOfyqWskZnb+7/sJFZvBF5n1tmp7i5eguFWpmCPMUMgYYXqtcU9I1GytlpQLKJyDVszt3wgt/QyErbs8pHxJep+E+QjXeHtqD5/UmLqwtQpBFYCVQYUB8MGCYL0E6uOGAi9/WXpzqMD4AHpvKDkshMKjYXn2sdFaS+2RWcVuSTDj0Odq+fAIGL6KKpl1MSM6yC4FFOBaMTr8ZviTW9p7i4P27WfvL/kYUCj3sLMXhgfpUDDEbuHJ7Unvym+x+S1to7AIRlgwA8A0AD7sxoSywKFZKyrLGUAzYWrEpKZyj9e0UTwgbXuKcd3T2lCGxN+RsFxVYmmZx1n/s9BXSisauz3x9LEog3vQ1Wy6Fc9NCQho13t8kHesCWVwjSPcMJRHUFW15A1/Vb5DW5IAA8yxzqswYWGZKp3fOVn2i27R5CC2NgLcMt3nNwCy8WoDWSVNmYhn7Avj7kexY+etwxgZLLQWuZSXNk36oz3aS+jsxjUEaiRZ4b4RumhEwUgIU8LEa5nnHqM43ORy75NeNqxhKjmla4T1NWRyGPOjZVfRYr7tcYBW8kFm7n7yXpKW3qe1nFOHqyy7aXLnRsNwof/p+wKylf4tTZ+OrSXz5dsQGqy8ZmWQ3ScIffOv13ivSLHT3c/85Wv9iBvCREbDkFSPwfILkhf3XTU7lkNoqf09XDiVByM/A2s833DpEw9HmIcG9dh1CVDJSSyCtvHjDKZfOTwut1fUhfnWdA7wA5zA1hQtrGzoUI1/gCLL3V/zd3iAoJv0I23V8UWU9rOun1ElkumicKy88sVBYRznsSO8mtuRfnP/d7VWDuhj3M6vFV9a6lfT3JW7Pp30SejkaQWcm/bFxGl2SnCK2fIUG2iheuqy42Ixl3eX9J6UzZGuQMstS7cuo= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: f0f2f675-76d2-482c-c99d-08df44a2bf3c X-MS-Exchange-CrossTenant-AuthSource: AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Nov 2026 12:03:09.5160 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 8ZY9O5ZBlb24kgq7KGizZL0rA1TgxLLQP5uwviaeYJOQOP2BlTyZrw/XBDjoXFQ6xDdpNhy8S4AeQBsfC5TaBCbJ/VdjRk2maCjcFb00mbc= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DBAPR10MB4058 X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=yBIllXS3; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= The testsuite currently runs most tests against the upstream mirrors. By that, it is executed against a moving baseline. This further is problematic if an substantially older sstate cache is used during bootstrapping, as then the referenced .debs are no longer available on the mirrors. We now add support to run the testsuite against a specific timestamp. This can be used both for reproducing sporadic issues, as well as for test speedup when running with an sstate cache. As some Ubuntu targets do not have a working and stable snapshot mirror, we skip these in this case. Signed-off-by: Felix Moessbauer --- testsuite/README.md | 2 ++ testsuite/cibuilder.py | 7 +++++++ testsuite/citest.py | 33 ++++++++++++++++++++++++++++----- 3 files changed, 37 insertions(+), 5 deletions(-) diff --git a/testsuite/README.md b/testsuite/README.md index bd9e998a..07bcfaf2 100644 --- a/testsuite/README.md +++ b/testsuite/README.md @@ -36,6 +36,8 @@ To generate a kas configuration for manual debugging, add `-p kasconfig=1`. The configuration is written when the test starts to `{build_dir}/kas-{testname}.yaml`. +To build against a specific Debian snapshot date, add `-p sde=`. + ## Fast build test ``` diff --git a/testsuite/cibuilder.py b/testsuite/cibuilder.py index 0565f158..e810910a 100755 --- a/testsuite/cibuilder.py +++ b/testsuite/cibuilder.py @@ -55,6 +55,8 @@ class CanBeFinished(Exception): class CIBuilder(Test): def setUp(self): super(CIBuilder, self).setUp() + self.sde = int(self.params.get('sde', default=0)) + self.use_apt_snapshot = self.sde != 0 job_log = os.path.join(os.path.dirname(self.logdir), '..', 'job.log') self._file_handler = logging.FileHandler(filename=job_log) self._file_handler.setLevel(logging.ERROR) @@ -156,6 +158,11 @@ class CIBuilder(Test): if not rootless: rootless = bool(int(self.params.get('rootless', default=0))) + if not source_date_epoch and self.sde: + source_date_epoch = self.sde + use_apt_snapshot = True + self.use_apt_snapshot = use_apt_snapshot + # set those to "" to not set dir value but use system default if dl_dir is None: dl_dir = os.getenv('DL_DIR') diff --git a/testsuite/citest.py b/testsuite/citest.py index 5918a5a4..db907e17 100644 --- a/testsuite/citest.py +++ b/testsuite/citest.py @@ -348,10 +348,13 @@ class CrossTest(CIBaseTest): 'mc:qemuarm-bookworm:isar-image-ci', 'mc:qemuamd64-trixie:isar-image-base', 'mc:qemuarm64-trixie:isar-image-base', - 'mc:qemuarm64-focal:isar-image-base', 'mc:nanopi-neo-efi-bookworm:isar-image-base', 'mc:qemuamd64-resolute:isar-image-base', ] + if not self.use_apt_snapshot: + targets += [ + 'mc:qemuarm64-focal:isar-image-base', + ] self.init() self.perform_build_test(targets) @@ -470,6 +473,9 @@ class CrossTest(CIBaseTest): """ :avocado: tags=startvm """ + if self.use_apt_snapshot: + self.cancel('arm64 focal not supported with apt snapshot') + self.init() self.vm_start('arm64', 'focal') @@ -528,10 +534,13 @@ class CrossTest(CIBaseTest): 'mc:stm32mp15x-bullseye:kselftest', 'mc:qemuarm-bookworm:kselftest', 'mc:qemuarm64-bookworm:kselftest', - 'mc:qemuarm64-focal:kselftest', 'mc:nanopi-neo-efi-trixie:kselftest', 'mc:phyboard-mira-trixie:kselftest', ] + if not self.use_apt_snapshot: + targets += [ + 'mc:qemuarm64-focal:kselftest', + ] self.init() self.perform_build_test(targets) @@ -596,8 +605,11 @@ class CrossTest(CIBaseTest): """ targets = [ 'mc:qemuriscv64-trixie:isar-image-ci', - 'mc:qemuriscv64-resolute:isar-image-ci', ] + if not self.use_apt_snapshot: + targets += [ + 'mc:qemuriscv64-resolute:isar-image-ci', + ] self.init() try: @@ -619,6 +631,8 @@ class CrossTest(CIBaseTest): """ :avocado: tags=startvm,riscv64 """ + if self.use_apt_snapshot: + self.cancel('riscv64 resolute not supported with apt snapshot') self.init() try: self.vm_start('riscv64', 'resolute', image='isar-image-ci') @@ -696,6 +710,8 @@ class UbuntuTest(CIBaseTest): return machine in ('qemuamd64', 'qemuarm64') def test_ubuntu_bootstrap_mirror(self): + if self.use_apt_snapshot: + self.cancel('snapshots enabled, but explicit no-snapshot test') self.init() self.perform_build_test(self.bootstrap_targets()) @@ -1105,12 +1121,15 @@ class NoCrossTest(CIBaseTest): 'mc:hikey-bookworm:isar-image-base', 'mc:hikey-trixie:isar-image-base', 'mc:beagleplay-bookworm:isar-image-base', - 'mc:qemuarm64-noble:isar-image-base', 'mc:qemuamd64-noble:isar-image-base', 'mc:qemuamd64-jammy:isar-image-base', - 'mc:qemuarm64-jammy:isar-image-base', 'mc:x86-pc-bookworm:isar-image-base', ] + if not self.use_apt_snapshot: + targets += [ + 'mc:qemuarm64-noble:isar-image-base', + 'mc:qemuarm64-jammy:isar-image-base', + ] self.init() self.perform_build_test(targets, cross=False) @@ -1333,6 +1352,8 @@ class NoCrossTest(CIBaseTest): """ :avocado: tags=startvm """ + if self.use_apt_snapshot: + self.cancel('arm64 noble not supported with apt snapshot') self.init() self.vm_start('arm64', 'noble') @@ -1354,6 +1375,8 @@ class NoCrossTest(CIBaseTest): """ :avocado: tags=startvm """ + if self.use_apt_snapshot: + self.cancel('arm64 jammy not supported with apt snapshot') self.init() self.vm_start('arm64', 'jammy') From patchwork Tue Nov 17 12:03:00 2026 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Felix Moessbauer X-Patchwork-Id: 5620 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 17 Nov 2026 13:03:23 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-pl1-f188.google.com (mail-pl1-f188.google.com [209.85.214.188]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 6AHC3L4U005630 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 17 Nov 2026 13:03:22 +0100 Received: by mail-pl1-f188.google.com with SMTP id d9443c01a7336-2ea71803effsf41798835ad.3 for ; Tue, 17 Nov 2026 04:03:22 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1794916996; cv=pass; d=google.com; s=arc-20260327; b=B/e2Vj+oAq03mMkYD57uVxx2Xr4eMJt1nKIIHsDZeyezVFKona+3Y+P+lbnWn6U9qq GT2mpriJOno32JsKcVpLrj4uMASIFTPWBUTY27Seh3DTVAoiLEKUxtIWFeFOH93hj90H Q+ZxLC4P9W9S6NonV8Kk6n0XDT/KlKoGmRJSMAf4Ej6lpEbVuOA0gwxyMqm8D+tCiovo kgf/sD3NrgOk7RBb68k5PhtzhBu9jensNf+PZzQWO0EidWSk/BDvaU1Z7IxHMZBc7a5l jgezptJmw1WMK4CuD5GhXK6P7tZ6QJ/RJVEEWPoJedxgpV5v4yK3swGPU8blZGwqa895 aTOA== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=KDG/1q2iT8Vld35xsRizoPeyvzsH6U6YkF/VlPVGn7E=; fh=aKJAIDAfSPYW4HsrTLvV/zvQkY0w/6fEyypKkMkweUg=; b=UgAyBvBowccA0wWhHJpiJVFZHY8TkA0fAOOag7Ec6nZaQ4xc2yHb6QRGOqbVep/+ew kTx2ENCY75Pwt/vcb9sKwElGNpytcmJJZTfTuiwHiJMzxz39ORtQtJ3DwmZfH6WxTXCj /6m65PEY4qMY0l+QlDmV1/BLvIPXyV7/TkumR2ezi8fdf4PqSqOJ/jIx6fOyivUO1q+I MR2ANm9lfNqk1fLBEQOIx3NBREIP+UAzasmekvTw3WpGbnV35hXOnOd2SipbUrW9paB3 Grulok1CcYTC21OK96D8sgUqPKOL8TMd+J6hhuLbJIOd47k+P1a3Df9xyG742WU3DHPI 03eg==; darn=isar-build.org ARC-Authentication-Results: i=3; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=XamXxut5; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20260707; t=1794916996; x=1795521796; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :content-type:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to:content-type; bh=KDG/1q2iT8Vld35xsRizoPeyvzsH6U6YkF/VlPVGn7E=; b=UHQkwaD/Y5FrBWkOh8Xfl/iGo7JXCLLwugrpfiyUmncsIQrJLRPYP/kRQwUtMVXh/Y b3ULP4TT83x1lq13PUL5Jxh4IbLJYgu5wUsNGSXnG+l4yiPPTTMa50dTbVBs4+asHQX7 yO+WfgOT16JgrBb2BP7vHauPKrgSEYR62Fc3u6bh1227s9lr7Ak3w8NhbYzZ/SfTWcev 2B/4//+k8+xyL5frvAfFNNyhY8NPgPnaHmMHMpNc073T2xs+59xGxQOhbJVuRJmq3JGC 2kb0yBoiIoUd5SJTn4WFIcS1DQKl50txkGBf+D3XrkVfsPak112rh4ND9F62LOk8qGvb DCDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1794916996; x=1795521796; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :content-type:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=KDG/1q2iT8Vld35xsRizoPeyvzsH6U6YkF/VlPVGn7E=; b=j6E6L62plQdQ7wtEwRgxY3nh++bmWIP5f3qf8fbObD02dmeKxhhhU+RT1uBy9NZkt7 Yp+5JL8BXeLYygEUAwjA5Kcw4b0VnEOHG845N5LYSLaqVo/Su731ubh4FYAjubpC+wqK /zvOCAkK9yfARuEccEHzNhLoSKpoFKrotg7fuIvfCqRrlVMHdljnPht1SPhN4almfpxB cTs+md2Bq+uXns2bVw+mFFfSs/XyIS6Ti2qtyS4Q54Wk+zKmxFVa4op/D7Si2d21G1hA gBTRhM8Jr+McH8+4zJeTEJNcs6Xr96GlKJIt7DvLwGlAKs4y1nPdTy3Kmu7eZ0+pYRl6 94xQ== X-Forwarded-Encrypted: i=3; AL+hErE6sRznVVtsA4B/7hLmlFH6vsMDtcmGTTc2QEUU32yqHyHE+gEExRVgRlLaeEtd68VhaHqJeTI=@isar-build.org X-Gm-Message-State: APuU4Z/bxF5Yzgqni6vvxboE6r81kRfmVSR/B3YhGtPehh6OjAP4S3FU BjAZl6FaWnxhfljPJns8w333dy4zMz5FEaY5vcTasGW+hp0QbTPothxL X-Received: by 2002:a17:90b:6c7:b0:3b0:9183:23ef with SMTP id 98e67ed59e1d1-3b1b07e41b9mr14686277a91.3.1794916995821; Tue, 17 Nov 2026 04:03:15 -0800 (PST) X-BeenThere: isar-users@googlegroups.com; h="ATskLdcx4mZ03+0H/Th+b9zQNtRiwtGGJydO5utr53pq/M22/g==" Received: by 2002:a17:90b:1b01:b0:3ab:413:49b7 with SMTP id 98e67ed59e1d1-3b3ab97b663ls1330028a91.1.-pod-prod-01-us; Tue, 17 Nov 2026 04:03:14 -0800 (PST) X-Received: by 2002:a17:90b:1c81:b0:3b0:a37a:230a with SMTP id 98e67ed59e1d1-3b1b0a1feaemr12508176a91.25.1794916994515; Tue, 17 Nov 2026 04:03:14 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1794916994; cv=pass; d=google.com; s=arc-20260327; b=gZpixgXSRgFyPuLkeWzy/hh7//A6T1G/4X3ly2T6TxQ8Wer89h/o8zVoV1nee53Z/+ OtVtpuNcaxjFFFuNoLfHUV15FjXiI+Gp3YTzbJBHrkaVkPIQs6AWVHGW7sQDk+7gx9+F xxiujIg5wn0qwYrh5ehMXwsqsWpnbFJZsbcQxpN6yl4yQ97rEpEB1E8cBOqekGrEb6zJ LdNJ329JlpzmmpfTts/gl5hozqbwAGZihLEVayfk+wmlH3hg+RxMht/ISWa6fT5u01sY ymsr89nl16aBAi5ioIH6GlWEvjATPeb8LEZeCe0RfMqxUnCMs5w5gc/zw5UurdGFOuYL Ua3Q== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:date:subject:cc:to:from:dkim-signature; bh=QIftXbZ72Z3QvvpH+yDMX8RSz/+T6BlIuPaz6UYDUCM=; fh=y4Q4sSo60XIDMfQl4kOzeqW/gQkja1RlhaZM6hZs/O8=; b=TWuvKA+pT8CnwfNsLrdyvWVhnfmzJJtk1j9EWrZ/rp6HDCd4TBhPXiiJHr0nOrt9W7 EmUmjpqzJwkR/0mtf0U9I8iPkTyjEr37rpJNWGTIBrwA5HGtAIK0FjYFt939xpDfEIXZ ICcGox5sc5h+RJsVL3LfzcHDyB1GHOylfKvGqHMsSG+F593WT4Dfh69X7DOL5AAl7sWm AYGAQvx8hIdrKHMlbD0OsKepFuhumWtMu0X8ulMmhnEkrvMfeBXvG718vkF6upT9sw12 7iTVyOUaNl1fdS6WpYY6j6HMJXOzA3FLRHNgoiYNmwqjfwoQXL8cZ5P7JUZfS76Ot0el B+Iw==; dara=google.com ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=XamXxut5; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from DB3PR0202CU003.outbound.protection.outlook.com (mail-northeuropeazlp170100001.outbound.protection.outlook.com. [2a01:111:f403:c200::1]) by gmr-mx.google.com with ESMTPS id 98e67ed59e1d1-3b3a42c51acsi65642a91.4.2026.11.17.04.03.14 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 17 Nov 2026 04:03:14 -0800 (PST) Received-SPF: pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) client-ip=2a01:111:f403:c200::1; ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=hYMWZxyp9hE29vB3Z+cgzqcuAHO0TMx4SlzYeLgVjhFgRJadZpq8zWeXQQZrXkSjcyvYk0+8FwJ6AJbZKhAWNG/OdYXsF/v6Cwu13J7hg2BBd7giTHLk3XYCNVazZLfJVf+GiOQzN67MZdRZIyEJ1QwKViM+Z4OPx8nokMFoubRlfn5KBc/6UEgWOrMiLUBnKsvWIyaeExwyQVWCqr9cjJ6oy31hX8+/9ZnWnQ3j5Si9vFekNULPhRw3ZAunYWg7Gu2V2Cm1ua9hcuwhL4DplwquK4JqkWG7XLsgUKEsRP/1Y1yp/IgI+cj4RUzO0ZgbRpza5hpXdJd5diBxU5uNkg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=QIftXbZ72Z3QvvpH+yDMX8RSz/+T6BlIuPaz6UYDUCM=; b=YHKtN6HaTneE6EfLJNDISsDSRokTnxEjSWrMFWfd6SercWHurco+44M2hD9zbt+WT7AJdGt/2tJjybjcFWnKUNAiXE8h0gov7314n0bTWZmHgrDValbjWGuhQ13mMJ8sqznbFVCWM4hwR6ualYJOgsz2WQdw96HSSo1PL+p+4SETnnvQGnlGOpZOgMsXaVxg7MjRMSNB1SFKTfDehy1yL4QYMB0rrjgU9LaMqcJKgfB8xX/3z+BM3xP7AD97tJ15Ux482Z3GMpvz1aUxFoYbquWjOEm1yHyDMAyeDBpBpm210VIAONAAm8Hp24HWBf3AugfAYXVEW1Dnig2bSSpi9Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none Received: from AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:17e::10) by DBAPR10MB4058.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:1c1::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.639.8; Tue, 17 Nov 2026 12:03:10 +0000 Received: from AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM ([fe80::c54c:ccd8:ebbf:477c]) by AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM ([fe80::c54c:ccd8:ebbf:477c%3]) with mapi id 15.21.0639.006; Tue, 17 Nov 2026 12:03:10 +0000 X-Patchwork-Original-From: "'Felix Moessbauer' via isar-users" From: Felix Moessbauer To: isar-users@googlegroups.com Cc: Felix Moessbauer Subject: [PATCH 2/2] testsuite: cleanup artifacts if not requested otherwise Date: Tue, 17 Nov 2026 13:03:00 +0100 Message-ID: <20261117120300.374231-3-felix.moessbauer@siemens.com> X-Mailer: git-send-email 2.55.0 In-Reply-To: <20261117120300.374231-1-felix.moessbauer@siemens.com> References: <20261117120300.374231-1-felix.moessbauer@siemens.com> X-ClientProxiedBy: FR2P281CA0164.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:99::14) To AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:17e::10) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AM7PR10MB3956:EE_|DBAPR10MB4058:EE_ X-MS-Office365-Filtering-Correlation-Id: 9df7c918-a9cb-4152-0727-08df44a2bf83 X-MS-Exchange-AtpMessageProperties: SA X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|23010399003|366016|18002099003|22082099003|6133799003|261009223027099003|55112099003|11063799006|56012099006|261102123227099003|261028144727099003|10067099003|261026121527099003|261026140227099003|261021121427099003|261022075727099003|261022105027099003; X-Microsoft-Antispam-Message-Info: 9CJaj0O+amwPswxE8nOKj35IHJSICdBBDMtEf/9sXP+f/d3v4HQIpdnwg8AbJlB3F+G2v9nP0Qvqp3bzBjMo97tAYv/aLVhoqTTvdiWogB2WAQgZaucdYnTFXs5kshtSsUrSFWurYjvf9/b7ZQZGGA2jsGToTuLlfDjugs2k7FRQuZijG4yoBKHS4eZiO69Bpxi1ELmwtcc1WpgLn+aeNyUp3yCYqkAk7xaStgcW05JoDe3uo873e9bKcKm4TVzdBI4wn+Pe3c58MR2/Qa807JJ/ppi8QON8Bqat/n7EMmlscTPTXJGWvhDAj7g/QL5Fc8yyrK3C6aZ0XHYjOj2IJrXbkFqXPcRkjIpSQVXoJgMdS/cxTp5WXNkAgvuYfxB+oT8TBSWOBj6c/1OlCad1kjRPIOQMJXtqdzz0hsYTEP5zZGvqZ/GkJzDQPmK3esY2+At+Oe65OJMiShKLpqfh7OeLwQvDHNTlTH4uJMOjWQV8tagmTCh/uzmTL+i8z4mghavP979MrTwV1CAy5OhfhFDxdFaWvqiEoxTDHtscAGaobUiJjKZoOSmcUYl8io/TXjo7ANKn8NxpNbP0zNZ1vyl9MRfYCeHLuhLG+ux97cp1igBMQdqp6648uQdTgUvGQHJ+f0fBKCh1vNhaImocxtlTrPSdMC9MS31Yf2HBMFA= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(23010399003)(366016)(18002099003)(22082099003)(6133799003)(261009223027099003)(55112099003)(11063799006)(56012099006)(261102123227099003)(261028144727099003)(10067099003)(261026121527099003)(261026140227099003)(261021121427099003)(261022075727099003)(261022105027099003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: 3fAJijHF9eCInVV4yUWIEEoZ1QugMl+CQEn2rmtFN9oqyn+8kssy4R0/mea+tboeEy9C/HGMo7lSf3tRyg/59Lx1NGse8ojKR8KOwGQP8UXgczPGWNUFNpB0PjTcVPIvBTXt20kyZr3A6ZzQhN4U03tbB+DcerGsJB7Fm3ikgOcPP/Le5uRCrMbdRwxEvcEPXzCsEQmbD3awYfGKVEndbgUL9mhg3ra+IfIKAIi21HLnJttMwtjgusS1xHvjp4U0/jSx23k4H81QD62zzjsROMPg7wnaSRvKq0z21yj+b1yHP/qEPx5iHCEoSw9+/dVdXjOygswTOM+a3cmITrefVLJWCgkvvYM/NwVvHa3abVYEMXmR26LpWN9SQE5g5fnTiTh2t3HEAMfXkruwBiaLosY0OaKDtStYB6rzUcQK2Ybya31ImEO4//Su1gnARgksUoTaxyJSfaLWC1wctypPjFf6TAXRN0kWbVmakJ17z5MOe36xr9Z4c83OlPCHq4xSZMHW/UQFjFhS9mJFBi1sWCC4o9Hr7g23fASozMSC02/s1LfydJlu+U3Btgesg953pnOXiJ4beFqTNwLGdfqhIeSNA9TH+8OcqBmQiYJOurQi2zZBQHkolHPTwHQJu4CuJJ3fnyQadxxEos6xpwaIGLXlRmyCW9Fdjgvw0z17jJL2p3GH8o59J8oRjUrgsPDDZK/qHiVaAdO8H4VgqnzuCy3ONzMDutJTeSoSnuRp4c9YJA88kxUaKi66mcAnOOt6glpBRSJO8Ummqs1QKJ6JJMnifIzq0TZTiNyopuvirybV5wOpBSHoZme8Gy+UWo/324DfUGM4X3c24alZcaQlLmMGpoWFM/R7D3L7c6eQykxmn+AsZchc5je/6qZP3lVg7AoCHrbeCUzSHWMLrX51ItSYzcG/JKxpQJcfDXK27oj7+3V+MtVzq8eQ74OLZe39KQWywgUbOjrib76VhNRFZ+4OCBz0KoMXJPmju46Xahkd+eRvFK1hIGFozLnmwbGCQTGNg1+CuJk3YSdJ3aT6uv/PzvX+2FTJjX19sAA4WB2Q/WbBgrKhqyYalPF9g2ewLvZYspejM3qbhqyxd+1Wt6iX4XSnl2zUWcgTaDy9J/xN2ED3Ot/r1pFhUa5YPGS2v4ovppkEYcVBpLMeRqhtHj3aIE0FmrksZ0t/jpjKrWu/om2BGkT2FQ0z+W6uJ0H8x2GX8E4r9t/1zDShb2Pj3rnLsS/6z7sVo3+naKov2ELafxYVdx73zOB5fCoqV57uABxSqiIrge1HJbSw5WCUxoK9E/1TZBnxvb6L71YxBljv9f8lLj3/EXjik1PjfV9KXZ6iyaM6rtjNiX/6saloHT9I/NF/pIKN6i8yIyrIg6h2elTLw1ZCmzxqUheZXnhNXDofUo3fW3Uhtb82tzM6N2H//DQoJoVJI0VWtaNdNFlKj9kFwOdC28H5WFUzuoVjqFymgZB9B5hkwFrQbzZfkjgg07mR6a1/aBPQJv+yjjDOxBQmIyQK9zUQw/gF1CFUx7KzM7xMd4ktTtUnWEgiqG26gDsC7OPPw0mEeI57Y/Lo2OQ+aUqSvBp5rk0ZQzUD1h3wm/hKYnd1OursBK6kQgUD6kue+sEU+10tgJnTLQuw8P8qWZHPULT8hQmJRKWpXP8hoCrnaw8yFQqI7ktExmCK9qS4Vmxkep0Uni4tNTdIS64Cdidnuo2n8Vf1xJQw+eLHdyCGt5Q52zEZWUwQN9NihJdMZFRXUvo16bT0qvI= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9df7c918-a9cb-4152-0727-08df44a2bf83 X-MS-Exchange-CrossTenant-AuthSource: AM7PR10MB3956.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Nov 2026 12:03:09.9940 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: U2Er5wjqhLm94Ikz1G6Uf6A5azf+ekt+tYSCfzS+L/X3FMCZOpT57c+9Gdbmzzrykqy0Y/0jFtspY+K8Apo2ua2cmOPmVo1W7KVQcODrSV8= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DBAPR10MB4058 X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=XamXxut5; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c200::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= In CI runs we often see issues that only appear if executing tests individually instead of all in a row. This happens, because subsequent builds do not start in a fresh environment. To improve this, we now clean the build/tmp* dirs after executing a test class. As avocado test does not natively support this, we add the cleanup as a last test. Due to our test-internal dependencies, we still cannot cleanup after each testcase. If the cleanup is not desired (e.g. for manual analysis), setting -p cleanup=0 skips it. Signed-off-by: Felix Moessbauer --- testsuite/README.md | 2 ++ testsuite/cibase.py | 18 ++++++++++++++++++ 2 files changed, 20 insertions(+) diff --git a/testsuite/README.md b/testsuite/README.md index 07bcfaf2..461e8c53 100644 --- a/testsuite/README.md +++ b/testsuite/README.md @@ -36,6 +36,8 @@ To generate a kas configuration for manual debugging, add `-p kasconfig=1`. The configuration is written when the test starts to `{build_dir}/kas-{testname}.yaml`. +Artifacts are removed after each test class unless you pass `-p cleanup=0`. + To build against a specific Debian snapshot date, add `-p sde=`. ## Fast build test diff --git a/testsuite/cibase.py b/testsuite/cibase.py index 3f44e8ac..f824ae11 100755 --- a/testsuite/cibase.py +++ b/testsuite/cibase.py @@ -14,6 +14,24 @@ from avocado.utils import process class CIBaseTest(CIBuilder): + def test_cleanup_artifacts(self): + """ + Workaround for missing class teardown support: Cleanup + the build/tmp so that the next test class starts in + a clean environment. This test comes last, according + to the python class inheritance order. + """ + if not bool(int(self.params.get('cleanup', default=1))): + return + + self.init() + rootless = bool(int(self.params.get('rootless', default=0))) + clean_cmd = f"{isar_root}/scripts/isar-clean-builddir" + if rootless: + clean_cmd += " --rootless" + for tmp_dir in glob.glob(self.build_dir + '/' + 'tmp*'): + process.run(f"{clean_cmd} {tmp_dir}") + def perform_build_test(self, targets, should_fail=False, **kwargs): self.configure(targets=targets, **kwargs)