From patchwork Mon May 12 08:32:35 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anton Mikanovich X-Patchwork-Id: 269 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 12 May 2025 10:32:56 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-lf1-f58.google.com (mail-lf1-f58.google.com [209.85.167.58]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 54C8WtNY018173 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 12 May 2025 10:32:55 +0200 Received: by mail-lf1-f58.google.com with SMTP id 2adb3069b0e04-54fc4dd1c94sf1606580e87.2 for ; Mon, 12 May 2025 01:32:55 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1747038770; cv=pass; d=google.com; s=arc-20240605; b=MXX88EB97WAO3hspv82zS3RTOo/KI7os80aivLUCHs+dDgwnZVbcrkC8Xd7Dzle/Nq bINcS0Iky7Dg67LzA8C0FsRskSPo7XsVGCz2inj+5WXfhFhI7LB8pRHanoR2LN0A4tGE 9JgEllv7NaAyx15t4o3Colv+vixIs3ZhiJRpOseD066nlhInU2/GAvbhdJGw7POBF8vu 3RnOIOvogmb8xWn+i03VB9mX5ygGfyiPfPvdT6SQ9GyoiAmumKlV31nAz5q7GJ0Vo+Le 9r5PEtBV4S6nY6fJRtieQvjldH4WoOSQZO92BNP9xOy5h5AfkeRTU4D07kgAT7TleIx2 5Xzw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:sender:dkim-signature; bh=Pp8H+AWYRcQ8zM6xabdEZqY13OsYMVWdh2W/1pxGhgA=; fh=v+rQUvZM3NWh6FsDmbbIEN2qdoaIBtWbWfukTFWw/7M=; b=akmEFGLs/aWu+HWzhrLJTQ7lRvMhHjlAO7Av+92NWn/QRP5QfzvdSGFUoJgNonV/yg 9/0E55VLd3FnlRT4LxCGDMASADu49o7OvT+jbOx5DCAOhvIk7Tx2JfuPv3LYBm3Qxsdg HFqimm+dyKIbWssbz0Dtx156Y8rmqT7r625YflPvUAu+5bwzjG6zerHVGuIkZENWapmw d7l50v+9+ReXTSeDuZL6wpVzmx4s7Ke/95V7Ftg6gZgZEk3xb9IjVQeAzZcCaHBsxVs8 BgVoQLVBknL+qKAxZLL3knbZhZlcDunBU2bbP6Qa6beyJ6Z1Fg+++0+NEBDoMkG+hLGR L8Sw==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1747038770; x=1747643570; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:message-id:date:subject:cc:to:from :sender:from:to:cc:subject:date:message-id:reply-to; bh=Pp8H+AWYRcQ8zM6xabdEZqY13OsYMVWdh2W/1pxGhgA=; b=hWB3iBLQw/EA1Efj4YfVhle6+DxjvjgdSVNKqtVLAH7LsmMVzY/GylEu4PqOsi810q uZqm5j4ivzmUMAmlX8He8rD+AFctVtGblFjQ3OI+Y6QIwcGqejOusurdCudPjopSLgtx tnp6RBzumKAzwANC2JLkCMrPw/qJZtL2fmf+JbZIh+hFIlXS/WyGkCtgLfFqnz9HRZgK qLT6N0T2xspjjbwuvWV8bwq5dzrjyTppJyGCEYV41K+jB4tRus6m2idMrZY4b49WQfkc OtiY+BWMa1I543bPdM2glzx9roigsy1QyzgIN9ljsf48o4WwXCABPITiMRSr3BL/Is97 qnqQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1747038770; x=1747643570; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:x-beenthere:x-gm-message-state :sender:from:to:cc:subject:date:message-id:reply-to; bh=Pp8H+AWYRcQ8zM6xabdEZqY13OsYMVWdh2W/1pxGhgA=; b=eVhKrV2YTaFe4SqyLhhlJYQz82wWGIr0YYZUPzvuOp4/jFGELw8XfUMZhK2rUMFJQk iTPBlwRkttp+o/UBnDILxu+e+RxvdQAUGm4S53RGW/aWkbLBTjKNuwpZuMR6sEgyerxV jqOkkvsLtwX8aHjf+duA53E+wVCd5JppOuM3nCgfS2eXGayJL6sDMhqxQqo1CtZmy5sl fjpIUIND6ofpGBNBXv9HKxyMbz+e/l+l8CxMreRRKE1DGLqq0JtB4Me/Aqzqp8oyyHVF 9NCZmBOuRwBmuhveXQAR2w6meXx34brPxC7lQwwlSuqdwgr0As94pp4okTPRuRKheAcs lBEQ== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCXvm8NI+b3gY16UA1rdR+XPdSYDmTgvd0IyD+XeXuXRtpDMjN+la5cR4lV0bfRvwe/fvXD4hWc=@isar-build.org X-Gm-Message-State: AOJu0YxCEF9fWncm/Tfw5wcM1tunx1VVPzwx91dJm22iOkB9dPqzFoJS hmEEdclkaQywD8A11hzu86+gTgWZehs0K0+1zATfwgx5A11XX84W X-Google-Smtp-Source: AGHT+IEsZaMFfVS3jMST1CJvd9I6ofCV0vbnQKmvLFKfb9VCWO3Zb30PLUDKd4TExexOOfbH7ZR3Rw== X-Received: by 2002:a05:6512:2913:b0:549:91c6:970d with SMTP id 2adb3069b0e04-54fc67afe81mr3293805e87.5.1747038769532; Mon, 12 May 2025 01:32:49 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=AVT/gBHPRw2HgUJuFGnTqEXYmEvKAFwdg2eg59pQA9S8aBlUQA== Received: by 2002:ac2:41cf:0:b0:54d:6636:3b22 with SMTP id 2adb3069b0e04-54fc0314f2cls668458e87.1.-pod-prod-01-eu; Mon, 12 May 2025 01:32:47 -0700 (PDT) X-Received: by 2002:a05:6512:6612:b0:54f:c66b:8b73 with SMTP id 2adb3069b0e04-54fc67b8e96mr3848382e87.13.1747038766924; Mon, 12 May 2025 01:32:46 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1747038766; cv=none; d=google.com; s=arc-20240605; b=aIb14N0SW7gBRVpQbFvZN3gXp00Nb0IGsf60h3fv8DVKCOLMZiMWq0chxfjy4rQE4X PPOa+FpIsud1bRV+9hU44CjedPpn/BsuWWvmMdSKw97TG9tEuvMmVhnxc+e56itWrAnH fvqmqgy6T4wpnhfeDaXBFR8YBOyIRtdj/GsuYbP4H+YEwQ7z1KHRII42gKOxi6tHQC0B XcTnWax9sjOFExgYTqd4UAelyNFzl/K56XGnENb1AvZkJs90pme9xANKwumH1gwkj9ka 7NSQnCl4excEUPIMQbLN1qSbe5KmhJL9Pp4O3Tu4RAKrX/m1t38ofAFvaPQXOfX2y16O Yxpw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=e9ZJWGEbNAsK06Hox+AslCrl/plbgsFII4m++APwYik=; fh=/h9QQkzJ8EboVkWg45aWwpaUro6WMavIVd2OhN45RtE=; b=HI1TquPDdjejbK4vHyfMA9NpIJX3vTHl3U9gChLB0/glAMNNgzTGajxriO9zWgkCt7 ZC6yjCLs8HA5+TgVqM5SylasyeGEG9nofbJeD3ECx4MvJw6Tgk2Kph8w0ixefHd1bIiR EIcUwAXSE2WGg+1ADG5+xJA1p5aEpxFMdJ2gbHXAJrX4c05pozlXiUTzsXg7k2BuzZ6C SPgNWoywQrCRKaOoLGO8mxUzvaFFcvC+pfy9zLdPq/zsvjfv7YLqIcEXYXoU+gviBymR ywUwb2uVIy7UdCDWQHD0E/OsT5W7qSfoelobZzr9TqUqNaGJ13Bb1rHlnHK2F7htbJAz cp/Q==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 2adb3069b0e04-54fc64e39d4si93590e87.9.2025.05.12.01.32.46 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 12 May 2025 01:32:46 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from user-B660.promwad.corp ([159.148.83.123]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 54C8Wjvo018145 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 12 May 2025 10:32:45 +0200 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: [PATCH 0/3] Add 'make world' test case Date: Mon, 12 May 2025 11:32:35 +0300 Message-Id: <20250512083238.2089774-1-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: amikan@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= To be able to test all the targets currently supported by Isar we need to add separate test case which can build (and run in qemu if possible) everything with single command. There are 2 running options possible: 1. Run all the targets with single bitbake command. This is the fastest way with sharing build dirs between targets. 2. Run every target in separate build dir, one target per testcase. This allows to check every target separately, but requires external yaml with target list and varianter plugin for avocado. Also fix container example-module usage by default for targets, so this machine can be built without excluding example-module manually. Anton Mikanovich (3): CI: Remove container package list hack from testsuite CI: Add make world test case CI: Run startvm in world test case .gitignore | 2 +- meta-isar/conf/local.conf.sample | 4 + meta-test/conf/local.conf.sample | 3 + scripts/ci_build.sh | 8 +- testsuite/cibuilder.py | 4 - testsuite/citest.py | 55 +++++++++++++ testsuite/data/targets.yml | 132 +++++++++++++++++++++++++++++++ testsuite/targets_gen.py | 13 +++ testsuite/utils.py | 35 +++++++- 9 files changed, 249 insertions(+), 7 deletions(-) create mode 100644 testsuite/data/targets.yml create mode 100755 testsuite/targets_gen.py