From patchwork Fri Mar 3 14:47:15 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anton Mikanovich X-Patchwork-Id: 79 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 03 Mar 2023 15:47:41 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-oo1-f61.google.com (mail-oo1-f61.google.com [209.85.161.61]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 323Ele0p029214 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 3 Mar 2023 15:47:41 +0100 Received: by mail-oo1-f61.google.com with SMTP id i2-20020a4abc02000000b0052529fc100asf986004oop.7; Fri, 03 Mar 2023 06:47:41 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1677854855; cv=pass; d=google.com; s=arc-20160816; b=Zpfrh2DgYuRA4pQc+UhvrVssR4XwMALSPvKDs7lP5Z3iKE+LgZudlzrAclGQnr2DrK S5msmiyhnHTOB8c8QQY0sdGwAUXrZeDsZHRMiDSoVudYi2PJhn6ExgNI17JIW6RDFP4K GEd0eBXqJbYEDR8BuIztJn1DbYNcB2JYwRbj0pmn9Xml9ExhAGf9pP8vwDk+YO/wAnmG jkVpLk5qIE3kx3m89Y/jCa5MeehDuzDvi1cuNCQWlDMov0Ife/09cvbkbYAM5FSeCbrg T71RrmQEfQrwOM4sV9uTOd4b0tNXyw/Vm1YQPAowWE9qM6JE7Cv7Sll6PF/t1zeqtayU rPUA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:sender:dkim-signature; bh=5CPSUHJ+OU5piD5VK+pm91o5BnyA3iZ3vesbXKypywU=; b=AfaAx+lyNyqA9c4YzQq2mYZ7+BwWo4Xy+oSlI/2Ukxr92p68XnQ8Wgu+yfDrnI5nr1 Lz9lqmqdqIp1zVZOkFD/kYtMt/bMvYoL/TM5ZnR+QmPiTOMOccqMIaLHfg0RCZH8nMlO aQWZN3qa7MmRsJIOvVLI5kphF+56WyM3xXgQOvU1+2EFvOAEUCxaZuvTm8JvptXJniTG jkqxNT7zEYw/Wl31QkDX9SYfj6r1PTCMfJA2KmkHeiBu5xRt5uEQQAfYMe43A6Z0bMmG oUsDO4Tx3wVuuvJAwqqSDMzEX2tGAU2+n1alXsGplCpUhCQP7Y5iseFIWuv4MZI/3fT4 qmuA== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20210112; t=1677854855; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:message-id:date:subject:cc:to:from :sender:from:to:cc:subject:date:message-id:reply-to; bh=5CPSUHJ+OU5piD5VK+pm91o5BnyA3iZ3vesbXKypywU=; b=Sat6QMmnWMM5KNpnjtRIJ9NMiLP15nOPvLlJymvOsJKUWCWgvAe3Ty7dIL/LBlDrnT I07O5o7jzKKQQVK2Vk4ktQqw4epHhAW8uiCBE6X8ux7r88qEJyGRIFNBw00E0CTasIsA lRNEjYSVK0h/JCBcJGZa1Vwx3VbmBJ6nOAL67VRsBePuwIL5pr4+Axli+/6VEsjN+BpD guRlcHJTG07ldjEr5/TNrZ3+8nuK88Iy5Buom2RA5RhfeBhtl1RtjVCS2gPmE5j20lVw ddcgRCuD7y/oG2aC42Q8/suNsqe86E0lCR4BMFEAhw9z/zRkeK//aHEWDbvw8sIazDFm 9pzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1677854855; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:x-gm-message-state:sender:from :to:cc:subject:date:message-id:reply-to; bh=5CPSUHJ+OU5piD5VK+pm91o5BnyA3iZ3vesbXKypywU=; b=brzw1Ho0aTGJJUbKP6I7leGxYc8uOJirXoODs20xxhs4I5iyBrSlQunw+JmFtrtCzI qGciTHKGValCkeCGKgUW8wB8fWQoT2lsv0upRGWVR6LagKuJRuSZUhdZPokbn/pQuTE4 zEqgwhE/6QJ+oe46vBpJGXlM2RJG9gsRXD94qbEKBOn4fkCfahCQ88jRk0RiggqM+jSK GxISm+JOWpSalMzHSjPOPXAptGqJAvKWQTnK89p1IgfDjFTWG/POzp+GrGi6MrrK1Dm7 +rEuclkv75zle+TmMXcEkoN3Nfnts/dhN5yR2xT4yZR/yhSlitxKENdYeLKL1JRRYor6 +k8g== Sender: isar-users@googlegroups.com X-Gm-Message-State: AO0yUKXt9a73DHNqOm4mMnD/7tByhwJq5EOmcIDiWpCo85y2AzLFyPPy Jcf6NDmPo3LycWV03LqkyucjHw== X-Google-Smtp-Source: AK7set/I66g94l1owfCx0yhHDiV9RY9jlizYP6nR5wLk4m3ja6+LdsHdcD7pN8wddLVeQH+FDkebJA== X-Received: by 2002:a05:6870:98af:b0:176:2b10:5f9f with SMTP id eg47-20020a05687098af00b001762b105f9fmr650745oab.7.1677854854995; Fri, 03 Mar 2023 06:47:34 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6871:4096:b0:176:30d5:30b9 with SMTP id kz22-20020a056871409600b0017630d530b9ls1385931oab.9.-pod-prod-gmail; Fri, 03 Mar 2023 06:47:34 -0800 (PST) X-Received: by 2002:a05:6870:5249:b0:176:683f:684a with SMTP id o9-20020a056870524900b00176683f684amr1267311oai.42.1677854854478; Fri, 03 Mar 2023 06:47:34 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1677854854; cv=none; d=google.com; s=arc-20160816; b=u7T2B7uO1qJIaxagK54U4yYR19Y5QITt5h7t69k77WPupz6u1WwyFLJlkeRvUUzL1G XSmXRb3nQmW4y/d0AYymKgEEQWhyxWFkdau0jLp0QrHK8kph0HIKIpetnv7GkzhLEkcy WhO0GgO+9EArea+xA2joMmCj+EV1bd8pj8/BO4FPAtbjIOV+25OMXSsDOh4OegRT/Sgp neEg8U/IOz716WSgL07zal/2X9sx5gESSHChEJ5FHbhjEEQOnsuRzXpi6MROtpkUJmtr uKhJkkRXDjGSSotxmLpWaVEAX3UntBYxH0+VJcNs/0wScG2zgvP6Ey0WaHbabQRwWaUL 4LAQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=JggKNRhpB2zcwKXQbhYFG/reuA8VkRkqpkj+UJazYK4=; b=mBKDYf/WdLA/LDEjFJqKr097hAY4a7MmLqgIwcC1P7kU1r2pf38/fSEo3TRKD7zMh6 9zHIu5u0P2CaeHFbTzd/JrGvwNxiUyd+p8b51FAMJcahMjDZbMUl9/QcAVVnkiG1dhCa fY+dDcAiu1tFEb8eHZ9nZpAb5cmAL5+Z/xRfegJVGJGyrXVOnJvtpzI0N8YWFcbpxhtM 9tl+1wVSy68kqE19Na0nytWtwXMWzuySj+VpRBloeV35e7JYWzr4Q0z/D8I2Gy8P5+S7 eWGYvQ3tsfMdAOxxEiSwi+EicbiTYDCYg+DuELlX1ruSaL6jiTtShWBifKLZA0GaFno4 ISnw== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id bb19-20020a056808169300b00383d1b15a2asi106794oib.4.2023.03.03.06.47.33 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 03 Mar 2023 06:47:34 -0800 (PST) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from user-B660.. (IN-213-226-141-166.bitemobile.lv [213.226.141.166] (may be forged)) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 323ElSpn029181 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 3 Mar 2023 15:47:28 +0100 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: =?utf-8?q?=5BPATCH_v2_00/12=5D_Next_avocado_improvements=E2=80=8B?= Date: Fri, 3 Mar 2023 16:47:15 +0200 Message-Id: <20230303144727.481716-1-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: amikan@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= There are several ways of improving Isar testsuite currently: 1) Simplify testsuite configuring. Beside of making CI more comfortable for user it will also move us closer to removing ci_build.sh at all and just execute avocado with some minimal parameters. 2) Reusing of caches. This will be helpful later on after moving to parallel test cases execution. 3) Improve testsuite documentation 4) Moving avocado binary up to date All this improvements can be found in the following patchset. Changes since v1: - Rebased on next - Fix typos in commit messages - Add Jenkinsfile Anton Mikanovich (10): CI: Update Avocado version CI: Add avocado version checking CI: Set default QEMU timeout to 10 minutes CI: Make quiet option to be set by default CI: Remove norun option CI: Enable sstate dir sharing CI: Enable ccache dir sharing CI: Add Jenkins pipeline configuration CI: Update avocado install documentation CI: Add documentation for test case creation Uladzimir Bely (2): scripts: Add option to directly specify avocado tags gitlab-ci.yml: Run dev tests set on push .gitlab-ci.yml | 13 ++++++++--- Jenkinsfile | 34 +++++++++++++++++++++++++++++ scripts/ci_build.sh | 49 ++++++++++++++++++++++++++++-------------- testsuite/README.md | 48 +++++++++++++++++++++++++++++++++++------ testsuite/cibase.py | 8 +++---- testsuite/cibuilder.py | 18 +++++++++++++--- 6 files changed, 137 insertions(+), 33 deletions(-) create mode 100644 Jenkinsfile