From patchwork Tue Apr 2 17:28:13 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: kergoth@gmail.com X-Patchwork-Id: 3471 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 02 Apr 2024 19:29:18 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-yw1-f187.google.com (mail-yw1-f187.google.com [209.85.128.187]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 432HTGgD019938 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 2 Apr 2024 19:29:17 +0200 Received: by mail-yw1-f187.google.com with SMTP id 00721157ae682-615272125c6sf14219817b3.3 for ; Tue, 02 Apr 2024 10:29:17 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1712078951; cv=pass; d=google.com; s=arc-20160816; b=YEt7zEb1Na8Xwpw+Qyfz6x0/BPHkIYfZ7yDbd919b7uKbv5nbMFl/Ln99/t57/b2Dq mvVukp845LT68sQxau1YMFCkj/tkjhxI+unGXiQJkbDbZlXLZtBTBwXDAAcwH1CDU+Xc wYecihxk9p+jExl57SQdVX4Ff/15m2HmyD4uyznK94PmtL4WbEf0L8ukw6hBtnpFqawm gED+edTaGzq+dguBfiPS5ih85kT3iyLVU1unFQyQAlCC8YauOrRKp2xaomtsAVy8xRmK U0+rDBBZl0qFrEhFiE3YAibHUkfr2tfcPWdOt26gWmYYWvjxs7WxcNvttGYn8PUav1y0 5S2Q== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:sender:dkim-signature :dkim-signature; bh=SxtlIwg16dYwoN39z9O7mytdir90JmqYA72T+k/2Rqg=; fh=gl2GcookxOmnREy0/d1QLhzYbsZrV4+TE1hOtY7WiXM=; b=rgOlbYgwwrNMLt4F0pWb9zwR6NMCHjqq4VtiGHA3IWLiFTmpno2ehxqBnsPBQWJbmv dvZARxVMgAZEOokEMARDvs/8W7I6yBRjmCwF0x5Ba3vjLnwDXePemBVkk/sbMK9A76ML g8xyewydP3C4dOCVSvB1DKW2g/zTZLJNyzDEnRbRxFachr2UoLGk7mPc5CQUW/vnidBp L2fBTmlaMH8l33HM53j1EghlaWqkfFqfRGoC4nM4PoE85LfSJ5KIH6AjhJ+2c8lV+C3t VpNX+3Z8pM//i8ZJ4Nyl2Rj5QS8PZfg5IgEMHX7m0AmVQVzcjEEilsQdAr0J3zTYxkFV 6spg==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=kr2GMP6r; spf=pass (google.com: domain of kergoth@gmail.com designates 2607:f8b0:4864:20::102f as permitted sender) smtp.mailfrom=kergoth@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1712078951; x=1712683751; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:references:in-reply-to:message-id :date:subject:cc:to:from:sender:from:to:cc:subject:date:message-id :reply-to; bh=SxtlIwg16dYwoN39z9O7mytdir90JmqYA72T+k/2Rqg=; b=BHsmh8h3HYSFTQR2/YXusgUjkEyxTQAe2ueTxyHYVJ3Cd4XKcKzcmZi93wzljuAsKm PO+TgPtB0fjw3P8j4BkM07EXVYR9Ilkns/Ad/4PNG1S43iCGtjuKeFdn834ZeI3JQ8r2 BeSiBIcxKIobKXM/Kr7kLjnkkhmVinHyey/x1lQbesYafgeA2XSkRhmdjUdFzQgnuPWR w7g4ecX/emlXOGLA965ny61I1zNwcbtG75IkeMFuL9gFF66ua3NhiVsnSHPn+YITlP22 X4wZkln5cBDqB5LyiqzVHULtNdOnynZDzZ33lHd6cJI49NGjc/db7P2R+PxlUrHEeRkn pK6Q== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1712078951; x=1712683751; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:references:in-reply-to:message-id :date:subject:cc:to:from:from:to:cc:subject:date:message-id:reply-to; bh=SxtlIwg16dYwoN39z9O7mytdir90JmqYA72T+k/2Rqg=; b=nXFb+pOl3A41Wa2ylDik34q4vAb60B3UN5zo2idOghBA2OhRFpvAEwWF7QrcSyA6dn 7gTzdK7FFuKoZz8RvsycessfBJ2BBlMzlVPnD0jpucmLtZn//kikZBfrtwFdf44qnZ93 VsyGwa3quG8Zegt0KbhaqdYjAoxplokH9E89qLVTYvRZSDtl0N0CxPLTnSWX5Mq7QLZ1 6WkIAEq3+kZtNsxL/kEaP8b71RaxQ2FtvpY3P2YZlJF3meXTR9oLWQs1qqClLHeRDxuI CKqZhJTdv5q+KC+6S8gw2PQyvxNvvuCp+TiSV586hxJnJqAYJEoQZb3k7yNUui/NwODf Rznw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1712078951; x=1712683751; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :x-beenthere:x-gm-message-state:sender:from:to:cc:subject:date :message-id:reply-to; bh=SxtlIwg16dYwoN39z9O7mytdir90JmqYA72T+k/2Rqg=; b=HVP/ybcQIfXCuNGLyMlwsMFpyiY+QBaGZGnmg7iLDZdBYrE7EitdKIEavkBUZbT78A w5zkba8AzHOV8/rUYVbk6dHO/Qa4bP0I77/qEwZt/pj/jFDyFzSl8xgusH8libjIE8sA ZKLDqNyIRhqkvReD6S651ScFU/YoA+QW+zCgJ0MH/UYlV5iTKg8w3vC4amPXeDuBcSlZ /pKO+0NiTpYgRPpMR+DNz2wq/5hrknQbqucgOKFGmxo48Bp8aj0UwNk67ca8J/QV3XHW aoYVGtrnqit+BnVjRL0MZYR169rzv+AJrqfi3Q7tqT38fR6kRrLGeURCTVlL52cwc6Fz 2MXw== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCUF6u+tK6w+V8M69DEDeY0zfJC29IVITKYmkHv1bSXQcadB5ZMfofYRmhPPWOiyy6ij83cHHtNl6CVaYrQOgPZbpfIJ3YA= X-Gm-Message-State: AOJu0YyKd0iaEnHEZicNzpcUSS/NG8rgtmd0zIA9VbyuY/CTpuzfHjuX nPSR0FKgh0ZOQbJHUpBw5JaJS8MlVvO8ye08P2K/K1fkQL7JJpZp X-Google-Smtp-Source: AGHT+IH9rKa2vXudeiP6psBUyORsipAMiaDIVfFH3SqN2FGl5lOJNkbfL62Ri+kpcnHzx+ZNiyJJDA== X-Received: by 2002:a25:ad45:0:b0:dc7:45df:a04c with SMTP id l5-20020a25ad45000000b00dc745dfa04cmr11247771ybe.43.1712078950987; Tue, 02 Apr 2024 10:29:10 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a25:b29e:0:b0:dcc:be89:34e3 with SMTP id k30-20020a25b29e000000b00dccbe8934e3ls506828ybj.1.-pod-prod-05-us; Tue, 02 Apr 2024 10:29:10 -0700 (PDT) X-Received: by 2002:a25:141:0:b0:dd1:ebc:ca2d with SMTP id 62-20020a250141000000b00dd10ebcca2dmr11462420ybb.52.1712078949928; Tue, 02 Apr 2024 10:29:09 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1712078948; cv=none; d=google.com; s=arc-20160816; b=CnP3awS7SLYIF/vdKIKLESVmZk1LtvqE/UCAa2IAk14ORwKEzYu9DvJ4ZXyyQn2/x3 q/RF23FNiU7SCpBN/+q5CC/HvSeyUwv/D3/HuPgPZGBf13udtT9genI0Ytlv3VcJT0NN PodAQw7Y4CjEcOdmwF30fH9hVi+i5saGLQs8+YM9IkYKgzavyHZdCFoji5vjV8XoMb+7 +zPJ9BY8pmbDK7v+WOSNmsWGyVNShFEjy7m6INt2kNVqZFl+gqKjigHc5gjZ0fQN/xwd foK/KaMhbWgwlZaZLFAfSyr51U2jDQKPt5rUZTTSGiMAgDzIcpPhMjAkaSz+ySq7myl1 LdEg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:dkim-signature; bh=Z8poW6yDo5+DmGfYF8v/qfCYZl4n9xDTebx2Drsxr88=; fh=oQsVBfLFKOCDpQI4v78XDUCp+c0vYPEMW+xCOFIgP4c=; b=olXquFXx7EjYTl1ryIhFzlSXR2KVcTUmT9ulpiUSKmEfsxUq7zxPUWXLlIn3KKuuMS a8MXebZAd9s+UvanbESNTkZWrLxs75EvtPl4PNhytW7Lf3Bj5igQDW+JdVG6Qp1ABRue bK5LFL24eGIPUvHeZzi32Xjy6fjgdJ3ADx+RGdTpIJBlDUGA4E82r+DF14bsgOdzGaT3 4au+UAB5iCYJk90i47MHK8nY3iiBWdtLb1UX0g+oA9Jslu5bQsmCxOJpwHrVm+qjDhbS 1k8Vea5KVnFPKBpUfi+tSs2x1A7wJlGLtgl2jw0d0xXO1VW9alvlvGnikChF5ogR/tP+ 46/A==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=kr2GMP6r; spf=pass (google.com: domain of kergoth@gmail.com designates 2607:f8b0:4864:20::102f as permitted sender) smtp.mailfrom=kergoth@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from mail-pj1-x102f.google.com (mail-pj1-x102f.google.com. [2607:f8b0:4864:20::102f]) by gmr-mx.google.com with ESMTPS id x195-20020a25cecc000000b00dcd2dd6bba7si829215ybe.1.2024.04.02.10.29.08 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 02 Apr 2024 10:29:08 -0700 (PDT) Received-SPF: pass (google.com: domain of kergoth@gmail.com designates 2607:f8b0:4864:20::102f as permitted sender) client-ip=2607:f8b0:4864:20::102f; Received: by mail-pj1-x102f.google.com with SMTP id 98e67ed59e1d1-2a27ba3b1f3so321141a91.3 for ; Tue, 02 Apr 2024 10:29:08 -0700 (PDT) X-Received: by 2002:a17:90b:2c85:b0:2a2:2dc9:7437 with SMTP id sw5-20020a17090b2c8500b002a22dc97437mr6679408pjb.43.1712078947373; Tue, 02 Apr 2024 10:29:07 -0700 (PDT) Received: from dc4670097af0.alm.mentorg.com (nat-mam.mentorg.com. [139.181.8.34]) by smtp.googlemail.com with ESMTPSA id bt19-20020a17090af01300b002a2313f62dcsm66705pjb.0.2024.04.02.10.29.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 02 Apr 2024 10:29:07 -0700 (PDT) From: kergoth@gmail.com To: isar-users@googlegroups.com Cc: Christopher Larson , Christopher Larson Subject: [PATCH 9/9] testsuite: add signature cachability checks Date: Tue, 2 Apr 2024 17:28:13 +0000 Message-Id: <20240402172813.418770-10-chris.larson@siemens.com> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20240402172813.418770-1-chris.larson@siemens.com> References: <20240402172813.418770-1-chris.larson@siemens.com> MIME-Version: 1.0 X-Original-Sender: kergoth@gmail.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20230601 header.b=kr2GMP6r; spf=pass (google.com: domain of kergoth@gmail.com designates 2607:f8b0:4864:20::102f as permitted sender) smtp.mailfrom=kergoth@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-1.0 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= From: Christopher Larson The current sstate tests do call `isar-sstate lint`` after populating the shared state cache, but those tests take some time to do so, and do not check for cachability issues for other targets, so add a new test which does so. Signed-off-by: Christopher Larson --- testsuite/citest.py | 22 +++++++++++++++++++++- 1 file changed, 21 insertions(+), 1 deletion(-) diff --git a/testsuite/citest.py b/testsuite/citest.py index 7e24c498..b1c0b760 100755 --- a/testsuite/citest.py +++ b/testsuite/citest.py @@ -290,8 +290,28 @@ def test_container_sdk(self): self.init() self.perform_build_test(targets, bitbake_cmd='do_populate_sdk', container=True) -class SstateTest(CIBaseTest): +class SignatureTest(CIBaseTest): + """ + Test for signature cachability issues which prevent shared state reuse. + SstateTest also checks for these, but this test is faster and will check more cases. + + :avocado: tags=signatures,sstate + """ + def test_signature_lint(self): + verbose = bool(int(self.params.get("verbose", default=0))) + targets = [ + 'mc:qemuamd64-bullseye:isar-image-ci', + 'mc:qemuarm-bullseye:isar-image-base', + 'mc:qemuarm-bullseye:isar-image-base:do_populate_sdk', + 'mc:qemuarm64-bullseye:isar-image-base', + 'mc:qemuamd64-focal:isar-image-base' + ] + + self.init() + self.perform_signature_lint(targets, verbose=verbose) + +class SstateTest(CIBaseTest): """ Test builds with artifacts taken from sstate cache