From patchwork Fri Dec 19 13:19:06 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Felix Moessbauer X-Patchwork-Id: 331 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 19 Dec 2025 14:19:49 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-pf1-f188.google.com (mail-pf1-f188.google.com [209.85.210.188]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 5BJDJlUL019076 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 19 Dec 2025 14:19:48 +0100 Received: by mail-pf1-f188.google.com with SMTP id d2e1a72fcca58-7c7957d978asf2242353b3a.1 for ; Fri, 19 Dec 2025 05:19:48 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1766150382; cv=pass; d=google.com; s=arc-20240605; b=f059HhJV8Pye/n33zdrjfZRbLgtAszr35ZGKQAh7a5+dO+2USgszb+XoGX5xj8EF30 7S6jVyyKwWjrcRfXKIFoDNT8sA5yoFzPnTzxrP/w13myyE95QDY+CwYXzAlpPhRrcQTY S/Og0Sz9E1qQe5lhl4NIqDuLowbirvSIkOAh0pJP5lOVdeuB/TiE+Mmm3wAxGvRAKeB7 AU/O0VXBoJhOKyg3ic6u3hOO+IFcYj+SordcpJaTI+dhWT2rQI958xasiGO7wXASp1ch mKtpswyvNjUX1g3C+7DCOohTui7owh3EpULx4dk0FapWmaw0c87hLW2cwFHYTGB0O/Ek PZxw== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:mime-version:message-id :date:subject:cc:to:from:dkim-signature; bh=rOpsLWF5Q3VvhlZPnogLv1ARHGJ7VhxUtPXYPX0clMo=; fh=5RxWNtS9FB0KpT1paMfX+PAESBO9QGqgxt/NG7D144I=; b=ZNgStkp0OzO6NvdMBFPrhnrzob0vHIBdjU1SNqLnOKriHqu73RVAr59Opgwri20x9X F3JWQhZL+3ZGePiScMwwpstuIpMbGEtNWt6zVQybJyZuMyvNRIKJEPmInM7hl5zaM2Wj L4kz4/teciYiPdh5NB/7NKjtdl3JgH0qMI7DAXYbxGbGo+itUQ9DML8f9nXBHphPuSW9 MsSCQBRtzITLTMIoYrOfyT18Di16KG8BgzZC2d30mwlNEuYlr1bwYKm9+1gznTzwKCAD 6r93BWEsICvc0DY2ILCiczg1fsPOxedxwx55KdeEi8deNUZTUlf0arFaWo/ZzxJOk0PW GAzw==; darn=isar-build.org ARC-Authentication-Results: i=3; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="C0yB/pmW"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c201::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1766150382; x=1766755182; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=rOpsLWF5Q3VvhlZPnogLv1ARHGJ7VhxUtPXYPX0clMo=; b=nnnUOs921M289zugAFDVXP0XbBx5+tdJViLubDpd5wHVJAMjLnGQBHdub4tQXEmwq0 3owx4z6G59iDt6MswsxW9yqqDINDeFV07W25w0ml4+nX88aD0hBpRDdecnp6THtzXVKl Dq8Q89zF6d5F04cflT0G76XAEKuFv1+Z9JuDCPvWlipaonJ7Ie/Gb46jI8itIK32W4T2 lDRGxUl8KDhtd7t+J3kCRlGjJKNuJMsG4+3KGV+O6aHZRQDS7N1vSatRdFO5BrrkvZJZ s5tUOidZIXBZyn0rYmQ7vjfU04oaUQRkHQ9vBkUD595sTyIlSvdcUEWePzdrsDJLvMGF OnLg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1766150382; x=1766755182; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:x-beenthere:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=rOpsLWF5Q3VvhlZPnogLv1ARHGJ7VhxUtPXYPX0clMo=; b=w3dD87zLdhR0AzidcEOXVsXnro3vgo+wBJt+BtDpghVNpl+QxeKo0l8M3mJDBxoLbz eOD/AeVOAUXnB8eIy3ARXArfYIPWbBdfMWb/5ePI5gP2vu+2QPjcyc0g1PUFAYw6hT/P a/FrgPYLdNm4WyB6XudKpazKoKfBfyuhiFnOXmn3uDxrUHWBzaesryl7dAiouN/8k24X vlgjzj/sExDhwfBtLUrHq4hlU33m1pS38+hv8/E0y/lfHOtthJpzXll7+rx/W+dK9Ulo n06RbSvqK2oGK1kOIdyrJh/iiKFzwEOXBqSqnC6CdRKfL7ZgZeQk3zS7WKd5LuWO4UIG T9WA== X-Forwarded-Encrypted: i=3; AJvYcCWXkLB4T8Glxx8zv3VPRz0OkWbUIxryw8NSBQ+m/6BYZiy8t6CN8N156G9LJREG6wI7hYCTbW4=@isar-build.org X-Gm-Message-State: AOJu0YwvrATBXMYlfmJWUk4i81LcSvppTqrv95S6NTcpBzyzKmyCyKpX BTBqe4/Im90xK1KMQKcEGuxMEa1HWMS/8LTAXSJkT8kyUENQKALdaSD9 X-Google-Smtp-Source: AGHT+IHk9CBa4XMsFf4fXVD8we9ZI7nnEdO98K5tLMBFfqWzZGa6FbYxw83/K533aLS5GwF+vYzsiA== X-Received: by 2002:a05:6a00:3e04:b0:7ff:a989:2d44 with SMTP id d2e1a72fcca58-7ffa9892efdmr2148425b3a.1.1766150381712; Fri, 19 Dec 2025 05:19:41 -0800 (PST) X-BeenThere: isar-users@googlegroups.com; h="AWVwgWbzB8bkXMRqiE/keR0OPCnFFMSgl86N7V+MI+AxLx4KRg==" Received: by 2002:a05:6a00:2341:b0:7ae:be2f:91a9 with SMTP id d2e1a72fcca58-7f648780ff4ls7683834b3a.2.-pod-prod-04-us; Fri, 19 Dec 2025 05:19:40 -0800 (PST) X-Received: by 2002:a05:6a00:2995:b0:7e8:4471:8c9 with SMTP id d2e1a72fcca58-7ff66279645mr2592051b3a.42.1766150379889; Fri, 19 Dec 2025 05:19:39 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1766150379; cv=pass; d=google.com; s=arc-20240605; b=WCWih6eDC7bYJhuQau2hImermuKdzd+krBUPRAfjtOPpaOOsiCDr4hvVHPLxmd+ub+ JuqQyMlgGoL3LZdVrvHKyaAmnWeKooTSyXGIoChHxHfWHsBtKuj5v7btnZKT1UBugWxq qOxcAbMjx6HDuCj8KBB7S0rtO1Yyk+UNDD8hpOlpmo3ELARP6TJ9MJ9zHO7tvWDsw52l UUKfL8bzqPBXPo4elDYtUH703WwRjS8a/D5Eo0z2xBg5py7Go+6y/9El0nmsYTZFLkbf hpbDext/+1jNN3DM9CGDH8cvxvF6RqCjRORSxTckDD20D3s4TbhabWGdXLk6UDOxzoqq H1Jg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=mime-version:content-transfer-encoding:message-id:date:subject:cc :to:from:dkim-signature; bh=DbDy1Ch630xpZfqhNIel5yoEMOCy9taTWt10EcZ2JNE=; fh=pz2B0UkGs/hnSrN/waE3y1PHEuQis8JPLVQmTv7t9fM=; b=BJ3XOVXnNlMm7N8tzslZpOsHSSBiAOlDiBPoKZr4OHp0NowjgD+6p0imY7B3zrUZGh BertAgTauIXhGKCIJaFiT4EhjqDwRtX3OsZe4V85w09kbmmU+DDNR24Ca3/jWjNZN1Ru nkp4peHk1mst9osDx8Hoox50twfQYFu73pm+S/gmFeLcJEm24iORDFd35bCpuAtHLMhT tREmJ4aZfx/E3RVOb72SqxFe+6L1icD1rh+YpMITb0sgD3fk4gFStib9Csi7fdbqsWVc lzYXaCrCKRk5lXBUZI/ModF0KjUoPhotbInqfdp63d5SmC/umQidoFhlq1oJmG4ePftd e9LQ==; dara=google.com ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="C0yB/pmW"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c201::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from AM0PR83CU005.outbound.protection.outlook.com (mail-westeuropeazlp170100001.outbound.protection.outlook.com. [2a01:111:f403:c201::1]) by gmr-mx.google.com with ESMTPS id d2e1a72fcca58-7ff7d2d401csi60395b3a.8.2025.12.19.05.19.39 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 19 Dec 2025 05:19:39 -0800 (PST) Received-SPF: pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c201::1 as permitted sender) client-ip=2a01:111:f403:c201::1; ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=jiwc1N1Xf0b7gm8MgZMC80dSSNc6zG9dsXegprubE7MIltmarch8vA08IcQGyMW++8yoR0toEmLDM5RqZC9hzS6KBsYvELDFcdM1wJ06KYLAJXS30QmZvw8RJ/PXmHe9cQVC50J1YXdcCeH4rAQckCDwZ80qqZ4WpUk9gEKrmnHQZRg0MetKj0kCNcbFyj5lYpRF7F9drset/UcD+ldWg1fpgSd1stw8qzpCW61HjnzNXoTaSYCkhfPooRVF9HbwmBlhODj81riqQOvLlFCZeYsbSTiDgIWlKS5Iyo2bk6fk1QtipXbJkGYvzgjBVsT9YLzewLwb7PGxf6dtQtMSGA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=DbDy1Ch630xpZfqhNIel5yoEMOCy9taTWt10EcZ2JNE=; b=UtofwiYbLSPWK684xguBrcgKdeZPkmwVzbV0k0fhOYDrCHjY9uwOIx3QXhDvF0sUFEBrGoWEMA08t0WuQ2jf7rntIe4H0sxOQLwxHDMbCX4eamHDy6x+O/jfr2p1OQYwNSi9zAn4oAUaDzFZtz9V1tdMBtYdYq5sdH6pYhtcnNwqQNxE1nTXTHuzQV9Yl5psnD1Qhy6+2XW0Dj/KU/OhWU+78LjCXDk9AC0TdO2RoX2YWJotlhtILR7LhRGd31xn7yWn0c300raI+ab9XzBbf1BrAHSwpcEmj9MrDvvM10ynmS5t4cQlezpEPgJ3iLAXfU8a8Q2uLo9mgq6FPQJ3GQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none Received: from DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:47f::13) by DU0PR10MB5430.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:329::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9434.6; Fri, 19 Dec 2025 13:19:35 +0000 Received: from DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM ([fe80::9412:cd7f:3f72:92ab]) by DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM ([fe80::9412:cd7f:3f72:92ab%4]) with mapi id 15.20.9434.009; Fri, 19 Dec 2025 13:19:35 +0000 X-Patchwork-Original-From: "'Felix Moessbauer' via isar-users" From: Felix Moessbauer To: isar-users@googlegroups.com Cc: cedric.hombourger@siemens.com, Felix Moessbauer Subject: [PATCH v2 00/17] Various improvements to the testsuite Date: Fri, 19 Dec 2025 14:19:06 +0100 Message-ID: <20251219131923.1504046-1-felix.moessbauer@siemens.com> X-Mailer: git-send-email 2.51.0 X-ClientProxiedBy: FR2P281CA0050.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:92::13) To DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:47f::13) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DU0PR10MB6828:EE_|DU0PR10MB5430:EE_ X-MS-Office365-Filtering-Correlation-Id: 1f45ee6b-d81c-47de-8836-08de3f01412d X-MS-Exchange-AtpMessageProperties: SA X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|376014|1800799024|10070799003; X-Microsoft-Antispam-Message-Info: 1Lih/yN3+hBv0/SHZS7gR3tGsEEmt1kf/ILSRw+17t6gSGgysz9vsSlddXgPK6Ccwj34c7URTNJRK3IZKfWTMosLrMBakxH7a7xpDolWsr8ZSYxSg+YW0qmFYphjAEb9xP09O7cV2Z/AxYxh5zmEardlsmi0L5OWWNgQvMtShHPYmv8K7YnC3xes/P4EF8CcEKAEaCCdtWyJ06NMsnAX9cJtpqkfuTWgzCZtgJvSpdIu84UNCZKpaMipVZ8Ik64gKNu6nd+Yp1CQdtlVlb+Dlcn9pXnh1eO7H0KxNH06qeASrlI2kmqPc6VQ3cnf+yqkfa9P7z2a/5iupjKEEcHTeQNtSf5gitWr3i0+w7I3YAbMFQ5k/1llJJOgnDa1f9R/hfj1ulcXhzr8cjZz8u0tq0ho4YREWSUnvKE5h3zTWgqzv2lMB5RsIPcFXmbyhA7tCfVTeTKK/43qPMcm/okDZ3zD7iVZrK34gw/gfpfY83k28yJlt6+fwUToS7xri8GZ9JNr5yG0iAe3i2WYREPNwwFEXuxafi7rdYJQSJa+rZIrM/BP4EuqWqXTKLuImC+JOsAQW+kX/N3SvlxvAqunBr0zMPHM5wyt9XHKLyE7EbYx9NIONibiIN05qtGJwaU4C8JwjhVaz4wATd9usepGgoPBFGxqp2KG7RA6ejrkHduRwKPYT82HfFe52SGYopbxX/NJPyv6Y6yv+t+CXcYE+0vMEznGvXrjj4fpPLoGsegYpC8/mm2sZZO29Q/A4VOA5/1EZRnG3VpvP2F8kBK2SLhwneoFtce0bal14D9oug7TIZYXcQs/go3bV+BUOxFkSZotG+7iRMVAwJM0bmOypvpNmCcwLAX0p/2nqxc1ywOjXaMD9OQrcQLAudi/XwSH1PNlIASVFo3j4FrcR/ZmaV8NX/guLMBNelfD44JOFp6LsBYELhtLh+ctIhpwcXk5R3m9GmgvbG1KU2rPbeYWvmqmWQMbHBljRnuRXYJwRBX76qdqO8eWPhNmY904MFrukUUkvK6vBAHGECqanChBjtZjyVlrDJwzLj8l1gyyoleBpBF81Z1UgxquU0q1IzvZa4fJeihzYAhPxy9kBbcikEWelEXuicfdCsP07Gt15a8urSm1TlQrKrJSjx2incbBoz1Fpy9X9RuxKrmvboqtLdGu1Wh0eo9iBIA1HOQxcyCmRBzuCVfEecDh60EtIodOqRNSGAqV1Ri/0Waw9TIytPu6zPpMO1LDTKASBw36rTVh9GHq0Zgf2mrJi9bHbSPZRakmaQ680UrPwrFnIOguF0Lerfx0t1NM84Q8p7GA5yRObxX6U+X/KmP8Q1huaYFhAHHQsdNOLEyTW1Fi5T3/Rdu2hrrq6GZqOOpHZYi4iZGGRcfE45lczzOJ7DCfNBJe+LLySXzh90305KWUpEtLzT8c61YlyQDzsKlEoY9X481VeW1kdU447IybrCI09Vcq X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230040)(366016)(376014)(1800799024)(10070799003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: ixEnPWCCdHY2K1Q6Az/FFqPrsHtJ/SRfFdRXhePhtjpHAv/e8fLchfATvw22+TXXaHdDNiQJBH+JORqg7BPVbswGypvKE7At7Ab9Ep6+C63A/iwML/8dIcy9YZPcE7Ag8FxeUq0ItY3y1c8IShKyrXmK4DPi5DBDIRQrMg5EvvGpGRD3eWOnw0KMlITkvp41WGdjV4EpI/KpD9tVLyxKTtsxKFKPVd+aS60FoaM5BvGasmAULsi2e8aCpiL1fpKh6ejGpytlD5h91DDY3mnorgY/VRA6STC2ZNRJ45pSqzyiFLMWi2BYx5Z4yWYo/0GsVqBf095oyVRhey4mTN5DAOSs9Zmqka0IM93odyQr0KXbqIxhtd6n/Q5Npl9qQcIET/pR46QYhaiYFtX/KAx1KO/rXPb5lGO7s4B6Lcjsu7k3IWi+5WwMrzz7m1jgbPvVOQyaY/NWfNxRVOLcnMUJJwncRCnIxEJ9i0Y8MC/MsULIaBNO8BZEOXGzJtdkTwhOfLrDU6e7QrHoDE+O5QYVryMISBhyToFT2jz0R2E5fVcEW5uyoJ5uZh3YIvN4ZLzo01YLixh1AChVj3NTSAtWJAsizMCi3Hy+OEkohixviCMCAjqnQ8xQJ/0rKlfcfntwBL873qTWS1vdX5Cjy7cw82bsn8YF5ygZYYQoc1jikKAk+jOH2py6t4wzkfpNMvgmdgJnpV8YJsOKT5gpm3VB32wDhyjsky5Sgf86gWjMIbukl1ZeJkK2Vyt/z7ZV1GrxXgh0EwVvKGAiOY8DE4KYDlyrWF8bhxRyXGsONk2epRlBMZvi1Dx57kj8OuSLKM+VmzzQUYtxXHcM9gpLtnSnEeF2FZouHC69RCAv4rAb+8uneaxN96DqJuV2kexAZ/Bz2pMoiJB/OHWfKI9JRsn12IcGisdeivJtOvODrgM8nhytW6rS4t2+QdFePCWETMUXU3DVM28jaPSqQsFDDRRDVOXsI3pnDo/NQnuLBWJRDeeb5k+38TbderQ40grsteyKPfU5/Qa5iAkft2vz1xkMFSLYua1H3soHNJSF8IuMYai0+eOaEb8D3/HprCN3HnUOyFm9F/Q7TcIW/SZ4VxqSE5NSS0ILr8ieUI3vgIoH0oMb2OBZlsJqYBOtnlEma4wWDDnHuiq3j7/7SRyEeJXw0cg8Ex47Q4AGEi5i4zhwY3ZOuYjJOQ7KfkHgyAvwrePHmeJ96ztb5J8VCh/LUrSkFBc8rHU5CWVG/tUiGIqw+lDn3dBUbnAXXNsqZojs055o9kodOectWjKHuQr1wLq/7urnv/E/2NW561TsVn4KKFkci0wM78C8KRhW+j6we29tgxFT9XNPr0+CCSt9SqfUMCBTPTH4G0pxbkkref+6nAc8bs4lrdKRQqes6OMl5K/Yjni+VJwIJYR+pWw8PiRRw9Pp0wiDfm5MlMiRU3ythy8gPEWnmDWpf7GSPle0jOEgTzyqrurbSiMHm5gbcegGz+9UwBAlfZLhd/8siYiuKJkJ2RkmUhUxTg+FzNeRn7wuQ7Bq5bNyNUkrKMnEICFTtFJOhS7hRf8yD0HGQCdEpNoFWFyvHQkujZS7EgvJrqpasCIYUIHeE2ouFumrcg4aF/HtAYIK1Eq1QFK79rlzkqKo/+orAPJsB5UMSRc8IQ924xo7QSgL0VskOwpUQCsMLw== X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1f45ee6b-d81c-47de-8836-08de3f01412d X-MS-Exchange-CrossTenant-AuthSource: DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Dec 2025 13:19:35.5549 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: CaXyW4UmlNMsIoblIL4n0/7f+Ca/8Sc7+o9yVpAq2Vl7a4ynCJLy7kFUJiyYz0HKWhF2jKn4KfGH6vy+vOu50aUWj1vELXw1NLViGuIk5Y8= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR10MB5430 X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="C0yB/pmW"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c201::1 as permitted sender) smtp.mailfrom=felix.moessbauer@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= This series aims at simplifying and speeding up the testsuite execution. This should enable contributors to actually run it and test their patches. As pointed out in [1], the testsuite currently tests various features over and over again, while others are not tested at all. We try to improve this by focusing on "feature" tests, whereby each test case checks a set of features instead of a whole image. We further identified long running tasks (like the kernel builds) and move them to a dedicated test. The execution time reduction varies greatly depending on the hardware, network and sstate usage. When applying these changes on recently added patches, the time was often decreased by more than 50% on "fast". Note, that more refactorings of the testsuite are needed - and planned, but this series should already address the biggest pain points. [1] https://groups.google.com/g/isar-users/c/uZBTIHzLp8Q/m/8k0L1vfMDAAJ Changes since v1: - continued work on testsuite refactoring, this supersedes: - testsuite: fix SignatureTest by avoiding absolute path in bblayers - testsuite: add rootfs target for rootfs only tests - Enable SState cache in GitLab CI - testsuite: fix typo in log message in perform_signature_lint - completed exclusion / refactoring of db2m sbuild chroot - GitLab CI: increased after script timeout to give sstate upload more time - GitLab CI: do not upload sstate artifacts of images (as almost no reuse) - do not add SignatureTest to fast tag (as otherwise VM tests break...) - rebuild container test images in VM test to not depend on test order - rebased onto next As always, the patches are written in a linear way, so only parts of them can already be integrated. That's a wrap for this year, isar developers! See you next year! Best regards, Felix Moessbauer Siemens AG Felix Moessbauer (17): testsuite: move targets with custom kernel to separate test testsuite: enable ccache on kernel tests testsuite: make prebuilt container a feature test testsuite: make compat test standalone test testsuite: handle IMAGE_INSTALL solely in cibuilder.py testsuite: limit cross_debsrc test to subset of packages testsuite: forward SSTATE_MIRRORS into CI env on sstate ci: add support for sstate cache testsuite: make test_cross_deps more specific testsuite: fix typo in log message in perform_signature_lint testsuite: fix SignatureTest by avoiding absolute path in bblayers testsuite: use more recent distros in SignatureTest testsuite: make SignatureTest idempotent testsuite: add rootfs target for rootfs only tests testsuite: refactor sbom tests to avoid overhead testsuite: make sbuild-flavor test standalone testsuite: skip VM tests if images are not available .gitlab-ci.yml | 36 ++++- meta-test/conf/bblayers.conf.sample | 8 +- meta-test/conf/local.conf.sample | 10 -- .../hello-isar/hello-isar.bbappend | 3 + .../recipes-app/libhello/libhello.bbappend | 5 + .../recipes-core/images/isar-image-ci.bb | 2 - .../recipes-core/images/isar-rootfs-ci.bb | 17 +++ testsuite/cibase.py | 34 ++++- testsuite/cibuilder.py | 49 ++++++- testsuite/citest.py | 131 ++++++++++++++++-- 10 files changed, 255 insertions(+), 40 deletions(-) create mode 100644 meta-test/recipes-app/libhello/libhello.bbappend create mode 100644 meta-test/recipes-core/images/isar-rootfs-ci.bb