From patchwork Thu Dec 7 15:41:09 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: venkata.pyla@toshiba-tsip.com X-Patchwork-Id: 137 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 07 Dec 2023 16:41:28 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-pj1-f64.google.com (mail-pj1-f64.google.com [209.85.216.64]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 3B7FfR4T030687 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 7 Dec 2023 16:41:28 +0100 Received: by mail-pj1-f64.google.com with SMTP id 98e67ed59e1d1-286da868833sf933004a91.0 for ; Thu, 07 Dec 2023 07:41:28 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1701963681; cv=pass; d=google.com; s=arc-20160816; b=bIc8Zi5gDKhBW5LAPgzRzF3CrFlDSRR4gTJ3ksnVSqKU3z5aO3JmZXlojxXhcpgvLY Xk7/HeHsxCPBMO6ChPXR2a9IbuqlQZ/qfywyUSwqbwnmgeOOCPMzAuV5n5d8oXMeVxMw 536lN+rplqrlLVMxUWDnnX37RvW2ReTTV63NontAt/QNs5aiIyr6sUPxDioC512uobJr ziWNKOBHZHrhvOwxyIfJc7KS5mfFzq0qSkrYzYMmR/0k0GwnWx8Buuw8596wAJxveWFE R+nzWEDEvne+AjXrTRsw9FxZyKaoZCCpApjFEX+3+HouvUMQ8WzHtpbZFiHSlwwKfGhw 6UYw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:sender:dkim-signature; bh=v8k801+hsPWRTSarFl16naEykJOx33umukQYTjLvL2Q=; fh=0lUGB2344BCNlOMKgxbVcIhrk5SvZVfMXmxQVZJT4o8=; b=EtM4g+RRigYw3kHk8dWFjXQSog53ha0g8roWA6o/yoXKfBz2YuDw5DNZOCc+RiJmTh 3tAjcCwFI/RI1FrH+FYX2zDiV146rVOxlBbYZ2ochMq3rZ9bBc6ENszWJ2l15bfwdZsX H54x8lSRlw2sRCzjhkXhsyWvJm1wKJILRoipwhvpWYZHxIku0MNsxXWc1g4rCvvLELn5 Xbi9KtXqAsmZktoPRUB6uVdBDGjs2cO3xkbqb973yUvoiVGCZne7II5S5DNLIzyhlreN HolDxivQ1z7Oti2zQ0vJKy+ZNJbEbGQh2xhXUlS1SXi27k38IaJJr4drkruO88zOBU4W 694g== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of venkata.pyla@toshiba-tsip.com designates 210.130.202.132 as permitted sender) smtp.mailfrom=venkata.pyla@toshiba-tsip.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1701963681; x=1702568481; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:message-id:date:subject:cc:to:from :sender:from:to:cc:subject:date:message-id:reply-to; bh=v8k801+hsPWRTSarFl16naEykJOx33umukQYTjLvL2Q=; b=SGAZxANFMLRqHQ536CIRsXvGv9gFVxxMMJZ+E5QbvpzfjPsSKFZVv7BQ/dwt8w5Map AYL6bH2pzOJ+2l4/xUhcJreiZf/Gx7K7PUagavgJKqmVwjcB3qJKHR/u9nHYCKLV8m/j sVQGooXU/PP82jcJUbEZyA1WhywKMC5T5N3e+JNZWjKCLnzjx82N6E4gF/yt3/29taFE rVSJEvQOSDGINQ7TdjGogeHtouHx6WCEtUYSc0/VINAMpC708Zx2QEFC8rVAycVwhlO1 brUHnsIUY04Gh4OACNoHGzehnbVrfiPHpwtct4e+U9XK6GgtF/RVBGo4CPrTZDWTm5k0 Q0aw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701963681; x=1702568481; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:x-beenthere:x-gm-message-state :sender:from:to:cc:subject:date:message-id:reply-to; bh=v8k801+hsPWRTSarFl16naEykJOx33umukQYTjLvL2Q=; b=PppnrM7nl4V7E+pyeOnCdY4Tt056tw8zq83+m8ZNesVEodBgT18g7OL7l9A4/hRGRL tv1XGq86mnsUyh6SF5fDUgmDokOhecUrBqV4Jqo81WnyU2TGFwL+ES+OJqsv+Yjijmpa O0Zhtc5OX6VfoGSfQm7Osy2n8NrJTwIdThocXiM6bk1P6dBRA9u1MqQJWu1UyyPzw4Yf Ebf7oPikKIB5gKZKm4hHORUDjWaUSm97Owa/P2zPiy/Mh0xVkamkvgpFtm7QRwCDOX0E g7YBNorKGxG7oTqBhIfdYmyZAyoMSY9HzU/gnOXc/5OAJOp2GhOfTZJO342rCKjuSIHr gPmQ== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOJu0Yykw9id4G827XBp9fvKvs7qkXSl/r3obpIbF6WZ+mqN3Zm8Hi1e PZr9/wA0jgjfy7OUmqMgfY4= X-Google-Smtp-Source: AGHT+IFvqmlcX2t73B21yOlrIx9BFNLqiqnfh662Y1mBrZSWdMrw2A2npBMUmShSOeglPAi+qcY/pw== X-Received: by 2002:a17:90a:1a02:b0:286:6cc1:2cc1 with SMTP id 2-20020a17090a1a0200b002866cc12cc1mr2355314pjk.75.1701963681254; Thu, 07 Dec 2023 07:41:21 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:90b:1b42:b0:286:f180:8d37 with SMTP id nv2-20020a17090b1b4200b00286f1808d37ls615701pjb.1.-pod-prod-05-us; Thu, 07 Dec 2023 07:41:20 -0800 (PST) X-Received: by 2002:a17:90b:1d0b:b0:286:7ec2:df40 with SMTP id on11-20020a17090b1d0b00b002867ec2df40mr2209535pjb.2.1701963680145; Thu, 07 Dec 2023 07:41:20 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1701963680; cv=none; d=google.com; s=arc-20160816; b=RzeWlXhhjelYer+vYH6V/S0LI5lVggBvZc+EWaBaXzBlQ70mJKw11LuSB0tr1NWwxX ITtpr7uTN3G9wmBL05HgdQrGTLummH5UZOLo8DQku1hjQtCvwbvkUMH8cX83fpDSkCkp vuRtMygBw6VltMR7Upm8MIg6ZJsGpko7L3HGbtlxjjSTzk6qxNAOYBh2EzYPdKZIdpDD lZfEjOCVcHtu6CxpIQR9+gCyDomFSVRBuNiWpcAY1aaqCQKOC8u9dfO8OPuJyq/iJFxY RqaHzqF319nB4mH7Hgwgsn55WZUgIPz6pwWO6tauk7NqcvuTa1ciGy+hHK9lPEQtdF49 bVPQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=FXcW8Fdr78nYoicfBG4LJPeHN3F/J1+KByRp4+PhquY=; fh=0lUGB2344BCNlOMKgxbVcIhrk5SvZVfMXmxQVZJT4o8=; b=UcTw10zdS6JkHFLpUE2XMOy3kDFHcp4uLCRg/teGrpK+qtHJCYQx/CClzfQWOMXf+N TufSyymrtwo1Lk/tGxgwnZ3Usy/HJlBYIoatJuTlKvSupkzKzI+oPBJWOSZnqwy+mghi KCaZAN5kIe6uCLtdpMY/Mc3+S5kL1pCjtVAVeag6DLJZXpfDgXbLwaM6Ww/TMoxd5oz8 gNBPda4dqDTD529YQmaKtFnlouqF48+TfvXoQsMxh9At3/+fSNBkcwuT66yd7whA9OpP qN1AARq3rfLtszGn51qCUYWY6srDlWdh4UCFwS9WdTnswjSmIYxRjZpgnvw228eFDlQ1 CGkA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of venkata.pyla@toshiba-tsip.com designates 210.130.202.132 as permitted sender) smtp.mailfrom=venkata.pyla@toshiba-tsip.com Received: from mo-csw.securemx.jp (mo-csw1121.securemx.jp. [210.130.202.132]) by gmr-mx.google.com with ESMTPS id p9-20020a17090b010900b0028694acf28asi85361pjz.0.2023.12.07.07.41.19 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 07 Dec 2023 07:41:19 -0800 (PST) Received-SPF: pass (google.com: domain of venkata.pyla@toshiba-tsip.com designates 210.130.202.132 as permitted sender) client-ip=210.130.202.132; Received: by mo-csw.securemx.jp (mx-mo-csw1121) id 3B7FfHd3298582; Fri, 8 Dec 2023 00:41:17 +0900 X-Iguazu-Qid: 2rWhVu35FtySTtNsTA X-Iguazu-QSIG: v=2; s=0; t=1701963677; q=2rWhVu35FtySTtNsTA; m=4IRGpIFYPTCIaoi5Da/RB9VucywO6iMLhIkhecgP924= Received: from imx2-a.toshiba.co.jp (imx2-a.toshiba.co.jp [106.186.93.35]) by relay.securemx.jp (mx-mr1121) id 3B7FfGgX2748844 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Fri, 8 Dec 2023 00:41:17 +0900 From: venkata.pyla@toshiba-tsip.com To: isar-users@googlegroups.com Cc: venkata pyla , jan.kiszka@siemens.com, kazuhiro3.hayashi@toshiba.co.jp, dinesh.kumar@toshiba-tsip.com, felix.moessbauer@siemens.com Subject: [PATCH 0/5] Make ext4 images reproducible Date: Thu, 7 Dec 2023 21:11:09 +0530 X-TSB-HOP2: ON Message-Id: <20231207154114.20400-1-venkata.pyla@toshiba-tsip.com> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 X-OriginalArrivalTime: 07 Dec 2023 15:41:14.0542 (UTC) FILETIME=[CFA93CE0:01DA2923] X-Original-Sender: venkata.pyla@toshiba-tsip.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of venkata.pyla@toshiba-tsip.com designates 210.130.202.132 as permitted sender) smtp.mailfrom=venkata.pyla@toshiba-tsip.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= From: venkata pyla Hi, The following series of patches will help to fix reproducible build issues in ext4 file systems. Verified with following steps: ``` $ git clone http://github.com/ilbers/isar.git $ cd isar $ . isar-init-build-env ../build configure image parameters $ cd isar $ cat <> conf/local.conf SOURCE_DATE_EPOCH = "$(git log -1 --pretty=%ct)" IMAGE_FSTYPES = "wic" WIC_DEPLOY_PARTITIONS = "1" EOT # First Build $ cd ../build $ sudo rm -rf tmp sstate-cache $ bitbake mc:qemuamd64-bookworm:isar-image-base $ mv tmp/deploy/images/qemuamd64/ ../qemuamd64-1 # Second Build $ sudo rm -rf tmp sstate-cache $ bitbake mc:qemuamd64-bookworm:isar-image-base $ mv tmp/deploy/images/qemuamd64/ ../qemuamd64-2 # compare ext4 images with diffoscope $ diffoscope qemuamd64-1/isar-image-base-debian-bookworm-qemuamd64.wic.p2 \ qemuamd64-2/isar-image-base-debian-bookworm-qemuamd64.wic.p2 ``` venkata pyla (5): linux-module: Use debug-prefix-map to build modules deterministically wic: Set file system uuid to ext4 partitions wic: use E2FSPROGS_FAKE_TIME and hash_seed to generate reproducible ext4 images wic: honor the SOURCE_DATE_EPOCH in case of updated fstab wic: make ext2/3/4 images reproducible .../lib/wic/canned-wks/common-isar.wks.inc | 2 +- .../lib/wic/canned-wks/de0-nano-soc.wks.in | 2 +- .../lib/wic/canned-wks/efi-plus-pcbios.wks | 2 +- .../scripts/lib/wic/canned-wks/hikey.wks | 2 +- .../lib/wic/canned-wks/multipart-efi.wks | 4 +- .../lib/wic/canned-wks/nanopi-neo-efi.wks.in | 2 +- .../lib/wic/canned-wks/nanopi-neo.wks.in | 2 +- .../scripts/lib/wic/canned-wks/rpi-sdimg.wks | 2 +- .../wic/canned-wks/sdimage-efi-sb-debian.wks | 2 +- .../lib/wic/canned-wks/sdimage-efi-sd.wks | 2 +- .../lib/wic/canned-wks/sdimage-efi.wks | 2 +- .../lib/wic/canned-wks/sifive-fu540.wks | 2 +- .../canned-wks/starfive-visionfive2.wks.in | 2 +- .../lib/wic/canned-wks/stm32mp15x.wks.in | 2 +- .../linux-module/files/debian/rules.tmpl | 5 ++- scripts/lib/wic/partition.py | 37 ++++++++++++++++++- scripts/lib/wic/plugins/imager/direct.py | 3 ++ scripts/lib/wic/plugins/source/rootfs.py | 2 +- 18 files changed, 59 insertions(+), 18 deletions(-)