From patchwork Mon Mar 25 15:55:17 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anton Mikanovich X-Patchwork-Id: 165 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 25 Mar 2024 16:56:00 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-lf1-f62.google.com (mail-lf1-f62.google.com [209.85.167.62]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 42PFtxp7011733 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 25 Mar 2024 16:56:00 +0100 Received: by mail-lf1-f62.google.com with SMTP id 2adb3069b0e04-5158a57abd4sf3871091e87.3 for ; Mon, 25 Mar 2024 08:56:00 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1711382154; cv=pass; d=google.com; s=arc-20160816; b=N5DlteDZ41YCNO6m2hAiqIO83bnxy7npAzt8X4+ZWfLxBtCi1Oo3GeUkZHx40Aomm6 pNv1wCsshlv2ZbuTXfl/W+zgMWO5bAZtYe+T8LKiDu7it4QPUod2wZTA57ZwSD20qSlJ 5dAoG018KQtbg7E09S7ZGsF95eu17zzS9txGyLv4xnyexQvQncNaNca83DUAnmwYu6gJ HrFwoZHxs0JoXfhJfyhgwhrppBkZTy+WSa7noaSi7MU2qeA5wn9qbyCoKShcjiwY/cV4 fZUW3eo1+6qr9JVXhByg7DAJzgVjVAMzPPYFDtQ8ahNix+nzQ2qEE6/zeuyty9mXCBQ+ /fQA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:sender:dkim-signature; bh=wV0RY9ssUhWH7iNtBrHPmcXFnsUYUj8s0U2dqRXWDzs=; fh=eA13TfclaNQLwyxi2dIh8Ri8YF8v/zR6oDKmFzPQGG4=; b=B0O8hQJWmCskqI9DPtypXLfITskIzq/fS+i1V40YD2Epna9ccjNe6sI4cuDD+JNitg yJzwqDmlwFWzQGsujhqPWJhm6ShIBGhq3e8BwAcDl+LJ6rl3CIaQiugZVJXcsDnpc8GL MbZnkCgAXetur/okoEBif9ldpndkUt6piawqZf1aJw3qcZTKAfYW6cyFaV+wZSB9zzMe XKr1jfnTruVFDjstLtgC1ZrYofwgypDu/QxcZyeJ7nVr13wxBUuBV6KCobZM8GE0K+z4 i9GLMcbLP8/1niFhor3ArCZZNdKTC8vPTGqQdq9n1POLyrpSV2l3vw71JiRk7he34ZZ+ OgOA==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1711382154; x=1711986954; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:message-id:date:subject:cc:to:from :sender:from:to:cc:subject:date:message-id:reply-to; bh=wV0RY9ssUhWH7iNtBrHPmcXFnsUYUj8s0U2dqRXWDzs=; b=v5KgQb9qDsb4GUNxQq0FQE9Wj+gMJif2V+J7t+jZoxyziWIafk2TzJGpMdAGJhSBGK VeNGyas70i5I9mshT1w3T7rKDplIMygqz8F3TqlL8oVJIgwIAqW7LvjI1PyUwFeHSlK2 uVq7O766xxq2HXpBkAZbXXJx/tkPOLPrEU8L0Gd4pNHQN1tKzAqaChw/ZXaNKKvjD9Ag 1WRzHxTP0Wmg7mJQsEtItsbBWRRkhS3VQwW4KuPURn9O5FyxdU37PR+BGXpp7UA931he pOuJSLuR6BeSg2FkdWdgWKWMtR7xRa1oAsViFRdWKqrTp6P/8IqcfFPeaL9FUDlEjSHa eIDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1711382154; x=1711986954; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:x-beenthere:x-gm-message-state :sender:from:to:cc:subject:date:message-id:reply-to; bh=wV0RY9ssUhWH7iNtBrHPmcXFnsUYUj8s0U2dqRXWDzs=; b=Jy7HBiI68xaztmXu83iO1cAH6yy/ixbTuxcdWe1NmnHdUGtXNgEVAOW4EeFUU4NBk4 p7+RQD88zGXRSKRafjZENFgSqn6Cfp7ywPxOj5rrhC3DyeM6QoqWyaEAm/XpEpDLsWiv yssbYsCAshbnboB7JhRFiUZ2cd5GUHlgJPLdKhrxlBttuL8rpv33bctROq05N630WUy2 2svXaKJTfC6ImdoQtOxkRLdF3ahKQryWuUapf2XUEpyIEPVqNlFuERP5stcQod4wArOR 55OmBvdQve0QnFKTy/0BAAVpfU+scbRPWh9mI9yt+C2CIPU/uwZsnTXYq2x5rzBErX1a wEog== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCWhd0o7tqCEknmTt2ShpKvPpwC3ITDL1Opk/4JuVS1eUic39Zat9CosYgYN528vxGuFMfGlbRZxdNVLfFryaCv5znwozhA= X-Gm-Message-State: AOJu0Yza+6ssdbahbbYT5wCN8Lq+Av+VyUo0ltegRAD1GJP0U9GZsrO5 zw36SV47Ku8pBHrpVCmomqByzcKv7v6qL5H/Gp1Sk1e76ZNqFtyN X-Google-Smtp-Source: AGHT+IHHJ0e9pnfHuDyMIUUvoWMNSqzkSiBtaBsGUmKnfiXt4hyIppjF5bDgOR5QUiQ8klMBmBMhiA== X-Received: by 2002:a19:2d41:0:b0:513:cdde:18f9 with SMTP id t1-20020a192d41000000b00513cdde18f9mr5059657lft.54.1711382153493; Mon, 25 Mar 2024 08:55:53 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:ac2:520c:0:b0:513:e91f:da6f with SMTP id a12-20020ac2520c000000b00513e91fda6fls230802lfl.1.-pod-prod-07-eu; Mon, 25 Mar 2024 08:55:51 -0700 (PDT) X-Received: by 2002:a19:5e19:0:b0:513:d5ea:1d21 with SMTP id s25-20020a195e19000000b00513d5ea1d21mr5213584lfb.69.1711382151376; Mon, 25 Mar 2024 08:55:51 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1711382151; cv=none; d=google.com; s=arc-20160816; b=RDRoJPy+BC5nDnPxRLFdv9fDGgpSLaETT/oJlOtwN+MpekV9A7oTpY9T/CP75GcTE0 +XpFYTAbSAEe1srCOA80UZUZZ+4PVf1hjeCOKhgLEp9KvtxRsFfwW800ZyFvHeL8FNVo xoYnWNvunu+pGjVmJTYKIbAToCPtxUtceuTOQgz0Cm+LSEjztzqOZPdSVa4LqLNwmMcF 1L20NontEYlOweXFVLOgnjzPWkJpSLW8t6+t+znQeYkrTyBTVFbf6FIDPOOo+dmhNoYL H/kWVfxrXEY7VeIvFhsr+j7pP7+1cTm7JhMS9pAyGWCwI+nghfqbsXjrKNIHVex3uwHL dQAQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=gsd1523YQ0x8mbAH1iX2Wy70ZvZyxZe/U5/sZrXKrq8=; fh=/h9QQkzJ8EboVkWg45aWwpaUro6WMavIVd2OhN45RtE=; b=o7k57yAJciOG6+cxVUETwqhBHhh9MVuUhF+z+qvUenGE6N7Kvd3/5wqFCXj0+Ypt6S 5EiA4rtaDa6IhYi297Y6MsFK7PRMaPDO1WIqcz837/BSUPmXqI0LW93KDX03635EF929 udU6GzmVXRw0uJn3BvYOrD7F9FmG/8QIiIeUrehUcR7up2iTqlakHyzdbw/0bBDd8xBA 8/f0ja5yeUJV4u8UmxUIXa/cIHiEiOPy77PWPTKSavdJm2xaDsAmTY4sDjHnkhKgy0bi FX2u1wrkxMKz13a9RFXKXpdXD2RtVwlmevWuD2lhOwCoO+ItDMr/o9JAgo6e9/sCFoqq YmbQ==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id v14-20020a170906380e00b00a46acd22106si229717ejc.0.2024.03.25.08.55.51 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 25 Mar 2024 08:55:51 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from user-B660.promwad.corp ([159.148.83.123]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 42PFtnL9011703 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 25 Mar 2024 16:55:50 +0100 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: [PATCH 00/23] Additional CI improvements Date: Mon, 25 Mar 2024 17:55:17 +0200 Message-Id: <20240325155540.4162990-1-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: amikan@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= This patchset accumulates testsuite fixes and improvements in the following main ways: - Migration of full testsuite to cross building - Target lists update - Speedup overall CI execution - Improve testsuite naming - Make output log lines shorter - Improve startvm errors handling - Increase startvm test coverage - Add an ability to check all the possible targets - Improve Avocado tags usage - Code cleanup The main change here is a new Standard testsuite to be placed between fast and old full testsuites. Anton Mikanovich (23): CI: Introduce Standard CI for cross building CI: Rename cross to fast CI: Rename nocross to full CI: Remove test keyword from class names CI: Rename base test cases CI: Remove cleanup before nocross build CI: Update default target to bookworm CI: Remove duplicated targets CI: Run startvm for all qemu targets CI: Fix errors reporting during startvm CI: Remove logging hack for job.log CI: Do not lost errors on failed processes CI: Remove container package list hack from testsuite CI: Minimize debsrc_cache checking CI: Minimize kselftest checking CI: Do not include testsuites into each other CI: Mark some single testcases with tags CI: Execute startvm testcases after building CI: Fix missing endline in generated config CI: Remove absolute path to citest.py CI: Create avocado.conf inside build_dir CI: Set also cache dir for Avocado CI: Add make world test case .gitignore | 2 +- meta-isar/conf/local.conf.sample | 4 + meta-test/conf/local.conf.sample | 3 + scripts/ci_build.sh | 24 +- testsuite/cibuilder.py | 86 +++-- testsuite/citest.py | 608 ++++++++++++++++++++++++------- testsuite/data/targets.yml | 118 ++++++ testsuite/utils/targets_gen.py | 27 ++ 8 files changed, 692 insertions(+), 180 deletions(-) create mode 100644 testsuite/data/targets.yml create mode 100755 testsuite/utils/targets_gen.py