From patchwork Mon Mar 25 15:55:22 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Anton Mikanovich X-Patchwork-Id: 3434 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 25 Mar 2024 16:56:05 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-lj1-f186.google.com (mail-lj1-f186.google.com [209.85.208.186]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 42PFu3GC011792 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 25 Mar 2024 16:56:04 +0100 Received: by mail-lj1-f186.google.com with SMTP id 38308e7fff4ca-2d48e62e525sf40350451fa.1 for ; Mon, 25 Mar 2024 08:56:04 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1711382158; cv=pass; d=google.com; s=arc-20160816; b=Zc/71YnD13F/DDF5TCiPl5Ax78FTVPOPnV84BaYRpxW5ksSHbJisXegy5nOpQ0XLqD xc1PPmCWC7JKmuFbVJ2k+cbH57s4jWRcagEh7Ayn9BmM2SUmP0VdaQ9gNM/zc+FOjzIw XRO9pJZd8hm0n7/0mpGsNcQs7wBf0BwLmcteihB+MA1xjWuJZg+6fCTIm+/zMeBAciOr n+IpuHgoFSUMDCEefe7tnsy2dRVIRspdw4j36Q7ATEoR06MHNDSghRm8xGXfJygpLE1B 4aZa+FvDC33s0IrbRNAK9w+7EjJFcJZJ/SgyuUK0TbXZ5a+Leg39S6UFmATyeYEM+R3N 8csw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:sender:dkim-signature; bh=Rju1L1X+v5yf2DcRvj5LU14iDzDXob1+gSMLyFPCB+k=; fh=Q3OLEXC+nKcJAF46g/uJydQsNKS2WJd7RRlik42zMlo=; b=dFeAKvWTX4E8tn9l1Wzi5QQIw+h8vrycnsgY0DYLMk9Cr84igZ08tRfvjvixxE05R/ guLFRS2f85m4YtSwg3RSS1wUuBQukzFeAX6hjiY7MOmwJ+sxBWbt07AiXoHcUEcliFSA 9vKqHPVfzLqrXWOF3xehkBf5guGzPMU+t+07rVGhRrfsCJ/eysjOtN1P6vHTAGPXIN+c Z+i0LLyA1Bklm3SS5dwsaoRK5pgZh4wDRDrGOmJ+mHzaFni6706DhQr2bZvloQDgYTyU iAtJgal2oIMdUdYQu3C3kZBPTDJz36Cehx2mJhXo/vchmLBuuEKcIMM26k1/ySBsqsBk VPjw==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1711382158; x=1711986958; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:references:in-reply-to:message-id :date:subject:cc:to:from:sender:from:to:cc:subject:date:message-id :reply-to; bh=Rju1L1X+v5yf2DcRvj5LU14iDzDXob1+gSMLyFPCB+k=; b=PBQmqCioZ2nAVbmmv9ysP+LbNtMRRlW+QYqO+NjMoR0uYMkf7o1pOlJFDrVJG07asN KhmxNvOhKfVQfgt1RWMgFOFqcuNZFWLKMzh567Pi/1H3NmYXz1BTnfi4VKCrQIilE8O5 Zp27+h2rE1j4K2lPDtSCieWfrikakB2JfT9AMfVGecw5KvrqvGRZHeDCccaUr0SfSd8O 9jXNNXknGQYuBaUF/uV9I2bmKhzcGOKnRn+HLCKBIm9if92fUwU75hGO5Vj2fOJKHtqb CxGYe+XZvhQgTkkr2CXDkkD34b46BjKcQNKYLSwk97d7Z8oAcpyWNVVbWK3Tb5kNruC2 W2tg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1711382158; x=1711986958; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :x-beenthere:x-gm-message-state:sender:from:to:cc:subject:date :message-id:reply-to; bh=Rju1L1X+v5yf2DcRvj5LU14iDzDXob1+gSMLyFPCB+k=; b=dngFdPUd+vWID0xfcYMrCFiBkIi70TZEDCHSnj6ahW2rx2mAumiYDGCPBBVTa+kOk3 AmofmcgKcQInVTmVgz5Sn6Jxn7fKw8n1iOfkRWdPanN8dpBDSNAXBL4pz8wf1nLlebtM HSyWCu8tAIhwOiLTUjpWPrBj9UjZDVvcneJycO0jy1yu/4vct5hweAp3TDt6rXZVJyWc 3mcW4ouzTY++CbwCGm607Ahan1KAuPcKhLEnZn/TXvuw62fkjlogMGR8GKNXSVRCr1L1 rHyLecdNAMXtzstlFIA1UdGrfkDlHguoX1q7SECl50k28Ze8EtEgCRms5OTZkwdIz1j/ ySNQ== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCUxc1BErCrYnuhLn1nt9jZmL+VARsE9shSLvu1i077Ll8h1gmLFm35B6DTAs3uCVnoukvyLJED1S9+MhTKx8Q6DQPIaRQY= X-Gm-Message-State: AOJu0Yy+tuKJPZg0/uroG6Zvw/rlpa82J9yPES1xATaNpUlXkIxN9OFs IdWPbFGakxrUoFQFOGDnoRMRP1RmbigF66dGVUC9LqA5rft0+VWa X-Google-Smtp-Source: AGHT+IFbu3XJIfgquXMyoOncWJZnZbbfiRXFGY2DlEJM4CvIwB6UQmBvL8RNoT2kKfOphFlwkOorWw== X-Received: by 2002:a2e:a716:0:b0:2d6:dba9:cc66 with SMTP id s22-20020a2ea716000000b002d6dba9cc66mr1483567lje.28.1711382158281; Mon, 25 Mar 2024 08:55:58 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:97c7:0:b0:2d3:3a2f:99a0 with SMTP id m7-20020a2e97c7000000b002d33a2f99a0ls272405ljj.0.-pod-prod-09-eu; Mon, 25 Mar 2024 08:55:56 -0700 (PDT) X-Received: by 2002:a2e:7805:0:b0:2d6:ab2f:7862 with SMTP id t5-20020a2e7805000000b002d6ab2f7862mr4360183ljc.2.1711382156399; Mon, 25 Mar 2024 08:55:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1711382156; cv=none; d=google.com; s=arc-20160816; b=imyNDg4wNm1iKesKU2DU5UmmBB1T+gyNOby+TGnZkaTIZ0WV4VfxyB81XiO7uVcsR/ /YPsBXKjDeeMCdh452jMrfpBq84E328J/2n9/YJYRlyjP6SAasi/5jj0x88KtOFr4kVW sNszdMEvzXP+rcEB85Ml/dkMvPzQ72j+vK/YHYwN0KYCIryLFltPdeIV243MURYoie6B 0PRDxabp1Lw/JNW+M/iHmy3c+b59rUv/6aVR4bMWwoDqZG09QNjjwQRW5otNiDNKAAQP ch2XCx5LpgF8lFXpSIi1m882j/VyCXaTxGeEom97SF+oP36mqizvU8HXCwZ83sVcLsGU k8+g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from; bh=uOc5tuHJp0+yu6KRJrw2i7JPDbw0SXOtdXLNAxuj2wg=; fh=/h9QQkzJ8EboVkWg45aWwpaUro6WMavIVd2OhN45RtE=; b=DKwu1kaGseDj97R9fDvx0f33G1t+PtCZBzsPTGP5vuQnJJ/f6umW8wVjBDPcO6bpao 7jfq9hVBxXokZkL6jSGJgQ1CU67395gPJVtl+9KDSFtk9y8oJOf2jAbal/sd3ALe1o+8 LH1RG9oKHNHP9clB6soFcYID/7QhY9yUvxjFwyjdmoc3u5T+txN+Zpt+AFB4UVNFXXTN rmGka5sAa4LFtyOCNAqY0PFs+yi+D9LxIX5ASFjW+GxrwPPmpH5pKUMUAg18G46hKKgB pUb6OJjNTFDlLiHer4L9UyzX5YCbZ3TKIYi6/Hib1X0E8iB4kEsLaHlCetoxUOFrawcb US8w==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id z18-20020a2e8852000000b002d4721d2d8esi303948ljj.2.2024.03.25.08.55.56 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 25 Mar 2024 08:55:56 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from user-B660.promwad.corp ([159.148.83.123]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 42PFtnLE011703 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 25 Mar 2024 16:55:55 +0100 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: [PATCH 05/23] CI: Rename base test cases Date: Mon, 25 Mar 2024 17:55:22 +0200 Message-Id: <20240325155540.4162990-6-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20240325155540.4162990-1-amikan@ilbers.de> References: <20240325155540.4162990-1-amikan@ilbers.de> MIME-Version: 1.0 X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: amikan@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= Single test case can be called by the command like: $ avocado run ../testsuite/citest.py:DevTest.test_dev But this will actually call all test_dev* test cases. So remove names which can be a substring of other ones. After that running test_dev_min* will not cover all test_dev* cases. This will allow user to call any single test case. Signed-off-by: Anton Mikanovich --- testsuite/citest.py | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/testsuite/citest.py b/testsuite/citest.py index ce6e107d..780a2882 100755 --- a/testsuite/citest.py +++ b/testsuite/citest.py @@ -24,7 +24,7 @@ class Dev(CIBaseTest): :avocado: tags=dev,fast,standard,full """ - def test_dev(self): + def test_dev_min(self): targets = [ 'mc:qemuamd64-bullseye:isar-image-ci', 'mc:qemuarm-bullseye:isar-image-base', @@ -122,7 +122,7 @@ class Fast(CIBaseTest): :avocado: tags=fastbase,fast,standard,full """ - def test_fast(self): + def test_fast_min(self): targets = [ 'mc:qemuarm-buster:isar-image-ci', 'mc:qemuarm-bullseye:isar-image-ci', @@ -394,7 +394,7 @@ class Sstate(CIBaseTest): self.perform_sstate_populate(image_target) - def test_sstate(self): + def test_sstate_reuse(self): image_target = 'mc:qemuamd64-bullseye:isar-image-base' package_target = 'mc:qemuamd64-bullseye:hello' @@ -447,7 +447,7 @@ class VmBootFast(CIBaseTest): :avocado: tags=startvm,fast """ - def test_arm_bullseye(self): + def test_arm_bullseye_base(self): self.init() self.vm_start('arm','bullseye', image='isar-image-ci', keep=True) @@ -462,7 +462,7 @@ class VmBootFast(CIBaseTest): script='test_systemd_unit.sh getty.target 10') - def test_arm_buster(self): + def test_arm_buster_base(self): self.init() self.vm_start('arm','buster', image='isar-image-ci', keep=True) @@ -477,7 +477,7 @@ class VmBootFast(CIBaseTest): script='test_kernel_module.sh example_module') - def test_arm_bookworm(self): + def test_arm_bookworm_base(self): self.init() self.vm_start('arm','bookworm', image='isar-image-ci', keep=True) @@ -505,7 +505,7 @@ class VmBootFull(CIBaseTest): self.vm_start('arm','bullseye') - def test_arm_buster(self): + def test_arm_buster_base(self): self.init() self.vm_start('arm','buster', image='isar-image-ci', keep=True) @@ -520,7 +520,7 @@ class VmBootFull(CIBaseTest): script='test_systemd_unit.sh getty.target 10') - def test_arm64_bullseye(self): + def test_arm64_bullseye_base(self): self.init() self.vm_start('arm64','bullseye', image='isar-image-ci', keep=True) @@ -548,7 +548,7 @@ class VmBootFull(CIBaseTest): self.vm_start('amd64', 'buster', True, image='isar-image-ci') - def test_amd64_focal(self): + def test_amd64_focal_base(self): self.init() self.vm_start('amd64','focal', image='isar-image-ci', keep=True) @@ -578,7 +578,7 @@ class VmBootFull(CIBaseTest): self.vm_start('i386','bookworm') - def test_mipsel_bookworm(self): + def test_mipsel_bookworm_base(self): self.init() self.vm_start('mipsel','bookworm', image='isar-image-ci', keep=True)