From patchwork Tue Apr 9 15:55:48 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "MOESSBAUER, Felix" X-Patchwork-Id: 3491 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Tue, 09 Apr 2024 17:56:19 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-pj1-f57.google.com (mail-pj1-f57.google.com [209.85.216.57]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 439FuHxu023094 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 9 Apr 2024 17:56:18 +0200 Received: by mail-pj1-f57.google.com with SMTP id 98e67ed59e1d1-2a2dbaacff8sf4874407a91.2 for ; Tue, 09 Apr 2024 08:56:18 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1712678172; cv=pass; d=google.com; s=arc-20160816; b=rwNtu8pETX3a1ZZ/zcotdWO6LnydAXV0Q6TpPGAlcIcd7/pmjRjS68hsYtSXGUvPLr RXu2NQW5Yiepyy+D34wq8qTWI2IiBlUN/sUmFhXiyruwWdYqRv3EN6OPf/05u1PDsqS8 grvJErfmIFiH7tEkDmvsczc605bxPnuCgiYMmM9LjlYaT7kGyahxShPfYL1UvYh+dokM M7ILOqeAa4EqOWg7Tmxje3zu7cMHX22Juzz+JM7fAsuYPMvFp8nePpZrlz0MeVDDjJ1t ZthHqZQuoaPY53K0DhBTlxgP/AwUNvPUbNR8ORHmTwQ4cPg5k/ZdJJbcgZoeLlD9G9YV vN/Q== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=4wXwQgZWiUUpdxjXIn8+1yCulZ4k1EHR8y2QGj4DLuA=; fh=2nVnaIBgsA2CzMXWV5/aKhS+ch2EVsUbvKh0SajOMiA=; b=XPu0PoDvQ/GnuSIn1MFsalvym9eAQwWg7ogqk+A6RF0YlXSpcVxKwwFxSunZVQFyY+ jDS/ozd8On+TsaPbBFFXq4//qW49u+pIcmT6fOwK2ZBERPJNUaXEUMJDhgUsiip9XAl9 ta5+BPsY8sNeLOMVxGvCDzvHWs/4DV5pwZt+AE4Dr+jxy2avZbn6UHqf8G2Ywj8UX5f8 TlifDV0QZQNwevwaK0Fk6GQIc9eJMmmLYH7omkERzjxT2E94+erwoa2bauSllKf8k9Af t06CddlZGjW1htbMJnjkrgNdSuVYkuYW8biSk3VM0FkACtWKWtjXejWW+Lt2EXRBZeeC zqUg==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Knjflh69; spf=pass (google.com: domain of fm-1321639-202404091556085e5053408d64d9c91c-mm_jwi@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1321639-202404091556085e5053408d64d9c91c-MM_JwI@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1712678172; x=1713282972; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=4wXwQgZWiUUpdxjXIn8+1yCulZ4k1EHR8y2QGj4DLuA=; b=xmo44mZv1NsUlAnuuoERP9PVT62DRvYriihyKzY9tBUJa2FtTPxkZNPQVAJG9L9WBH XRzD683xHpO6Ab4m4Nt7VMVomwVp7OUOIFELQn42qH9YTrLrEbGNFjNaTqM8PKy8opTC olXW2y6F/FoXIsnteTk8tNwsAxEijpIsJJNn7w8IVzLZqovN58vLrAfPG0PGzYk6/dIi P4GfA8BeZmjNdlQVSB+ecnzKmVHKv3cyzZ/k3nISSbUlsONU+gnVWVxJmH/QIOZNYvLu EaH0AxquzRvSzred6+6I1RX3Og8fvVlF/XdHG0Ln/1G+AyFWwcJEJ0eMIIePJthrM1hl HaVQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1712678172; x=1713282972; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=4wXwQgZWiUUpdxjXIn8+1yCulZ4k1EHR8y2QGj4DLuA=; b=Bps45pfpobvN9mnFvSqZ5l1TDcJPB7NEDNgeOYNQOhOECwHpnWJuywB8W2Pq1j3SzD 4p10tHER3uAK5AP7IvuGRR88h4yASvGLWTsZ2IR/GTW0Bo0B65PGB6fsKlaEGIu0LDyi lUGenbXD9Dj86/KXvqbbYR4QMn99kVyof3XH3CrUUEHP8KVjD2nq7W3XOUqPAsPjb56M H+eo4c87PiL/KPUK7Zs3zeeoxWLmWge7+7n/4hFh6yuFpg7tpdnpbBgElREJzByO9DEp HchYZ5fd/wscHs/t+ClMxkMpFZ8icSEp9ZrY5M0pclH2FM8Pk9xPPJS8N3NIK8i6WThD Em2g== X-Forwarded-Encrypted: i=2; AJvYcCUwJ7gtDHl0rzJrFduDZjhQYS5z7CmqIZVYkpUh3kPJ4OahNU432D3rZYopQuqqspFLBI/pRXAJESFDWbsJ6OuVNM/LQiQ= X-Gm-Message-State: AOJu0YzFNCkNwnMsM4PQwSfChWT8+6DqhrTCzHStvi5xdTFak6Gqu0LK uTdONN0NJgKNfYbpJvtoLCtx82XdErKHrP6B9Bzm+iSEArwk/LOD X-Google-Smtp-Source: AGHT+IEmTvSsBCno0n6Pbl8AiNxWDOWsi+hJeqZgxi9Cf9D2wYkEOdTqiXEIcxCKKiqaKVIp4oUeMw== X-Received: by 2002:a17:90b:188b:b0:2a2:afb8:372a with SMTP id mn11-20020a17090b188b00b002a2afb8372amr41104pjb.17.1712678172128; Tue, 09 Apr 2024 08:56:12 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:90a:8c6:b0:2a2:937e:f959 with SMTP id 6-20020a17090a08c600b002a2937ef959ls2928059pjn.2.-pod-prod-09-us; Tue, 09 Apr 2024 08:56:11 -0700 (PDT) X-Received: by 2002:a17:90a:d910:b0:2a4:6a31:600c with SMTP id c16-20020a17090ad91000b002a46a31600cmr42318pjv.14.1712678170639; Tue, 09 Apr 2024 08:56:10 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1712678170; cv=none; d=google.com; s=arc-20160816; b=YgaQvu4Zy7cjjidxuHYC8r5q+FD/Hay0RJS1ZnupRrG+Vs2DY2gl/6JZ0OF7/6XdlD KF1tHbpfXIKiKGSfHwu/bApUoT5NY5IuiiRRqpiswl1qf0Md3BotT2OocH0GRt4Wx+bg MCWxagtEzzuAXiZ+wnqUeF1vcjIzPRMsNxFbPQg5rZvJxvoEl7Yw8hxH2p+RV89okucW uN+Gw6OojFlwLo57gBduvfq+GW+4j/WF8rwzjlH01l0OwQ9zatnO1GqKEa1tkKe0ysyW 6xpmidkk37Uqh6XgwM1kKTG3Hwu53MvfJNronRQdUBgBnlYto261xo7UMRQowhOGZT8x Xf4A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=feedback-id:content-transfer-encoding:mime-version:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=ilQMryfxvzUvG4DkYfuoXCHe2z5Q+t43t3HIp4OQ/kI=; fh=WkhL8kaJc+l2wQon1t06Ej3uvBGj9sVhNcE8PaS/XbI=; b=XklFiJLRX0wi/95UVk1uwTwS17rZ4CueqsUkIFPjl0BDPNo5m2DU4I44Lz/D0jN0fi JbSyLd4x7hjZTm/fgUuSBsSsrQuuK9w3mVQZ1LWDjfY6lEaeCJEZqHIp0aqWFDG/skc6 RTc73WvXU7GSbW/pfITVe+MgFCy8/CRv5sFJC7pDaU55tMRMKNmo5KI6mimcBUByS6kS CZzEJFc6ig0L+voCmbsPlwhc4c7Qlj01YZyGCcErYU4WZKVUaTVqsbzzjhSpgt3DfPee 05n7X3vH3jkKbOKtxz+J6PGVrgsTlNhF+QOkQwriV1xI3Vtpg4kDCl8pimcWiLj6SATT McBA==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Knjflh69; spf=pass (google.com: domain of fm-1321639-202404091556085e5053408d64d9c91c-mm_jwi@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1321639-202404091556085e5053408d64d9c91c-MM_JwI@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-228.siemens.flowmailer.net (mta-64-228.siemens.flowmailer.net. [185.136.64.228]) by gmr-mx.google.com with ESMTPS id mu11-20020a17090b388b00b002a5aaa7bd84si12525pjb.0.2024.04.09.08.56.10 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 09 Apr 2024 08:56:10 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1321639-202404091556085e5053408d64d9c91c-mm_jwi@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) client-ip=185.136.64.228; Received: by mta-64-228.siemens.flowmailer.net with ESMTPSA id 202404091556085e5053408d64d9c91c for ; Tue, 09 Apr 2024 17:56:08 +0200 X-Patchwork-Original-From: "'Felix Moessbauer' via isar-users" From: "MOESSBAUER, Felix" To: isar-users@googlegroups.com Cc: jan.kiszka@siemens.com, quirin.gylstorff@siemens.com, Felix Moessbauer Subject: [PATCH v3 4/5] change the proposed interface to set the SDE Date: Tue, 9 Apr 2024 17:55:48 +0200 Message-Id: <20240409155549.826454-5-felix.moessbauer@siemens.com> In-Reply-To: <20240409155549.826454-1-felix.moessbauer@siemens.com> References: <20240409155549.826454-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1321639:519-21489:flowmailer X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Knjflh69; spf=pass (google.com: domain of fm-1321639-202404091556085e5053408d64d9c91c-mm_jwi@rts-flowmailer.siemens.com designates 185.136.64.228 as permitted sender) smtp.mailfrom=fm-1321639-202404091556085e5053408d64d9c91c-MM_JwI@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-1.2 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= To align the handling of source timestamps with OE, we propose to not set the SOURCE_DATE_EPOCH variable directly, but via `SOURCE_DATE_EPOCH_FALLBACK`. By that, we internally can use heuristics to better estimate the value of the SDE, while still having a global fallback if it cannot be estimated otherwise. Please note, that change is backwards compatible. You can still set the SOURCE_DATE_EPOCH variable directly and get the same behavior as before. This patch also updates the reproducibility test according to the new interface. Signed-off-by: Felix Moessbauer --- RECIPE-API-CHANGELOG.md | 6 ++++++ doc/user_manual.md | 1 + testsuite/cibuilder.py | 2 +- 3 files changed, 8 insertions(+), 1 deletion(-) diff --git a/RECIPE-API-CHANGELOG.md b/RECIPE-API-CHANGELOG.md index e6861523..4afe8b16 100644 --- a/RECIPE-API-CHANGELOG.md +++ b/RECIPE-API-CHANGELOG.md @@ -589,3 +589,9 @@ compilation for a user-provided module when building it for a distro kernel. To build against a distributions snapshot mirror, set `ISAR_USE_APT_SNAPSHOT="1"`. The mirror to use is specified in `DISTRO_APT_SNAPSHOT_PREMIRROR` and usually pre-defined in the distro config. + +### Use OE interface to set timestamp for reproducible builds + +The `SOURCE_DATE_EPOCH` (SDE) should not be set globally, but on a per-recipe basis +and to meaningful values. As a global fallback, set the `SOURCE_DATE_EPOCH_FALLBACK` +bitbake variable to the desired unix timestamp. diff --git a/doc/user_manual.md b/doc/user_manual.md index 70741968..b12c7692 100644 --- a/doc/user_manual.md +++ b/doc/user_manual.md @@ -425,6 +425,7 @@ Some other variables include: - `IMAGE_INSTALL` - The list of custom packages to build and install to target image, please refer to relative chapter for more information. - `BB_NUMBER_THREADS` - The number of `bitbake` jobs that can be run in parallel. Please set this option according to your host CPU cores number. + - `SOURCE_DATE_EPOCH_FALLBACK` - The unix timestamp passed to all tooling to make the results reproducible. This variable is optional. - `HOST_DISTRO` - The distro to use for SDK root filesystem. This variable is optional. - `HOST_ARCH` - The Debian architecture of SDK root filesystem (e.g., `amd64`). By default set to current Debian host architecture. This variable is optional. - `HOST_DISTRO_APT_SOURCES` - List of apt source files for SDK root filesystem. This variable is optional. diff --git a/testsuite/cibuilder.py b/testsuite/cibuilder.py index fa30c2f5..7e69dafe 100755 --- a/testsuite/cibuilder.py +++ b/testsuite/cibuilder.py @@ -159,7 +159,7 @@ class CIBuilder(Test): f.write('USE_CCACHE = "1"\n') f.write('CCACHE_TOP_DIR = "%s"\n' % ccache_dir) if source_date_epoch: - f.write('SOURCE_DATE_EPOCH = "%s"\n' % source_date_epoch) + f.write('SOURCE_DATE_EPOCH_FALLBACK = "%s"\n' % source_date_epoch) if dl_dir: f.write('DL_DIR = "%s"\n' % dl_dir) if sstate_dir: