From patchwork Fri Dec 23 08:55:23 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Henning Schild X-Patchwork-Id: 40 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 23 Dec 2022 09:55:51 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-ej1-f62.google.com (mail-ej1-f62.google.com [209.85.218.62]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 2BN8tohp013987 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 23 Dec 2022 09:55:50 +0100 Received: by mail-ej1-f62.google.com with SMTP id ne1-20020a1709077b8100b007c198bb8c0esf3044771ejc.8; Fri, 23 Dec 2022 00:55:50 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1671785745; cv=pass; d=google.com; s=arc-20160816; b=c+Q9bWKax71Hdf5xgSwVIaYXQ27IzYw9ZJdxDHB/XFEqyoe99eWQMPdbmuW2T2aaEg GCnROaUccYdKm1P1rcohaVQ83kZOXL2gUIEaJ/rQMXpu4RcquXP5cpv5PMN7oV2cL7co jN0bnNDBDYXGBMihOewIrjN02AH31rwBk05iiz4vGy0OqVGDyGxXA38rEF30NIZYBCfg ubUzKrlXZPvIDwCzUGeSU2awNh7P9auZfhuUhdTdPa+Nmrvlye/Ssk/IqHhyAJbNQswa aXItW5kYSO0wZlZQhxJKMc/rCpqAyOUykNxWcmGiE50lWfpv7nUHi9K/iQ4g4f1ayEdY GNXA== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:sender:dkim-signature; bh=M5U/BOKJdq61tgkLd4XdMqOntjbHNjCYHR4F3QjoK6M=; b=JEGumiYh9M1rwbmj2/AQ+LUr/40ikFhB5HsrfXUXrH7+zRJb4uIrKBFTkB6fvAgAou AflgTWxkmd/7eqXwF+cvG2Aoka0/p2mlxQjbfMwpfs/bAIwzZY6z0I6dajVltxhMqV0g C6XRFLA5mzThGeTG3nOMYKPB/WwkBDhNgQV6rWlwcOTjUA0OO/iGcmkKNok8NnXRAsDC tQAAyrC5IRzMPijcDQNB3OutV5JdmwcoIgaoVzhc8VyfJZ7+ZDMZoMj1dpXedKSF0rzg 8Dea2Jq9vcN4vLvxqL7bIHkHLepZ4qwrxN/DZc87JCJOULlsT0cMVT4lkb+DKKams8G/ OmVA== ARC-Authentication-Results: i=3; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=uvywnN+v; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.13.88 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20210112; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:message-id:date:subject:cc:to:from :sender:from:to:cc:subject:date:message-id:reply-to; bh=M5U/BOKJdq61tgkLd4XdMqOntjbHNjCYHR4F3QjoK6M=; b=aLml2HFxeGr0OSJJXqARor/0qAGKjVhd1v/E05L6/3LUE0jGoLMpF2Gb+6dSyS7Zj6 1TruO7EBkvlGf7ziRZa0z6KXHakNP70yEwLgCd0DGjWTHIMqND/SD9NXc0zcZmEFlwKs 76uKh2WmTbc3g0/8lykpp5f5nyCkOEPUJPCviO14ahLdFFvsoXdrJ88Gf7hVTVUUFp2t cXjvhNl4ft2eqzd/62s0lY2Z80CNhf7uDGNWUHEuVCkkEG+zKZo/fQFC/q+6x+Ul15Tm uHvPoW2J04c7lugfF/ImnEPwAu/MEgl+vakxxgPE01jEgeX/v/pqMpK++lwHYOZo1NwJ 7zxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:x-gm-message-state:sender:from :to:cc:subject:date:message-id:reply-to; bh=M5U/BOKJdq61tgkLd4XdMqOntjbHNjCYHR4F3QjoK6M=; b=ByTCb2kD+byzrHRrB61QwNGG233Uhs9j6P4fpI5GPTPasmyL0tMJBgxaytMf/vCwUp Jlk2AvfJ8Wp5KhmA4BnTHMPJ56/l50omwEPJmMGAZQDV6rq+JMP/ydY4CROP+yXhFlZF W3b7Twk6kwdFqXhzDhMPXfoXjMfVxt6eKGexP8XDWkJa9qWzhOlArb/os5YslNiudhwH Ayo7yTrsCn55mR0ChZSc+ePHUGglxIn5Ucex+BOfUxVKBLGGY6X9jQlCeomqFNwau5So ZMsD3xPmKrFqeQL0EWi9nNV0fNAi5767R6xjsuZXT2b7Ql/LL3/N8HBHFA9okj6Ezd9Z uNOw== Sender: isar-users@googlegroups.com X-Gm-Message-State: AFqh2kpiqJJJwkFSJI+Q+qpFcKnzQSv4qyRGTHWTaZ2EVUYBZ3RT8EEN KO4YWMk3SjQH2pzwBokHFO4= X-Google-Smtp-Source: AMrXdXsMXlkzvjYyaADrNla96K7Qw9amklnyu8zhbABYP+5t0DFKoKJ+xFv3Mv3w0KNNuigksLScLw== X-Received: by 2002:a17:906:2b54:b0:7c0:e6da:e25a with SMTP id b20-20020a1709062b5400b007c0e6dae25amr928977ejg.22.1671785745396; Fri, 23 Dec 2022 00:55:45 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:906:3d62:b0:7ad:9efd:4692 with SMTP id r2-20020a1709063d6200b007ad9efd4692ls2552450ejf.4.-pod-prod-gmail; Fri, 23 Dec 2022 00:55:44 -0800 (PST) X-Received: by 2002:a17:906:1ccc:b0:7c0:d88b:4323 with SMTP id i12-20020a1709061ccc00b007c0d88b4323mr5983154ejh.61.1671785744369; Fri, 23 Dec 2022 00:55:44 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1671785744; cv=pass; d=google.com; s=arc-20160816; b=Sf8uFV5JFQ3zjzeNQjeyl7O0QRp2c/U6qhHc1RH1FHfuF5V+BrS3O+7fss1bGPznK+ ekYO83nemjD2EFFQyAgYpOitQyai7K4z4KO2++NAeRXiApaYuUyK9SgrCwI0y3zGrQho mmiZXn6F/o23m/sCjTWMkCXx2+9qqvftDt+/qsigiItY09Hm1ifiOdrLzsAw9OtHieoN tSWJkqMH6+8jhUb/UqYHq2H5m57kqcbYwNxIbgbvB18HtQHuUg8vGJzK9vfWciuaykUH aJRR95OyH6CF7teGmpsuLIpms3naRKgZkj0GBeHPj5HGzKfc6xBzR+7CfBSG6k1Owdv0 FMPQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:dkim-signature; bh=lgDZ23tMCRXCYA9hsahaY1pMAfSJlJlvlpD9f5LrB9o=; b=XHtHudcu2gPuu14usSZGLgzF95Aug3DVzMUVUbt5loSctQeEQtxvexKV00dladsPHt GROVBTTdznVdREn8PufVjwbb7ru+gk9wnR8K1ozKsQjsYlAfqZIuYII70VO659cg8zXq uNXS4fPqRLACOn01pqxC4FcqLJU96ftcXHYse3UFd9RbLVCtjZTsR/7Iia2nWoBX+Yj4 YMT6Yq8oOqebw5wrPmt0KnArt/EA5bz7yX9w841lPbqlyyEEobM+vrPeHYbtnAtpotBl x+bj1hHpyClRNUfuGLJ1qL3Z2shmT8ZSy0NCUlU6zzy/ps396aNTpzkeOtLh1DoKfBUm JSpw== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=uvywnN+v; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.13.88 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on2088.outbound.protection.outlook.com. [40.107.13.88]) by gmr-mx.google.com with ESMTPS id h13-20020aa7c60d000000b0046c3ce626bdsi127310edq.2.2022.12.23.00.55.44 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 23 Dec 2022 00:55:44 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 40.107.13.88 as permitted sender) client-ip=40.107.13.88; ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=DYeoR+1Hf41lfiHrGt8CNR0xZQ7/Of+Bh0VLcCi9y3XsBEagPP88eyIQjPWv23PHbIZO9Mv+mgsXbxV/BsDrca4Nhx6t0rpKIl58TDUIw0LF7Atq6HFsnCIN+SPs48vk4ONO4SW/xHIlqkdFGEBzXTTjLXu+75uTvs/RRXx1YyzLFxg3RYeg4C7CSeUbVbUdBjKSx020CApgF1tfS4h4+rHnn+iQQMw779/4gbIM5V/SldRxMPM+H9No33ywV2n8MMmns3zBb1uAgI72/oFQU8UWyGOA5g3XQQxR91KmN15A0NafrHHn1pGyGKmk0Zp23+fib5oWffd3IFbe3Rd0Jw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=lgDZ23tMCRXCYA9hsahaY1pMAfSJlJlvlpD9f5LrB9o=; b=INAQrjqWHXSg3bVZktU7ogkWbFTdpkkOVXwlIo//SHg5mAZUfhtntk+81/Z2xew0YojqsSFBTYDzck9Tw1Y4vjS4i05cjN4yFKRQzemFJlfEfsgp2duvurOdDOeXBSsCSifsfKC9vcBQ9RM68a5FAa2m+m2ysvsCyJQCyibQoEqhBFkSjm/ctuW5wYv2g5h/iUJQfq8tHFzkKql9DWoTN5Ug5n9ytyHz6nqViR1SUnXVl252aN1weqpLP2bIkjWw/a2z2DpQhv3rr6NuPklGdE83vYbKT079VHYATIPbSTq8JQHPFUp9rKrV3lJ6yhxQk88F7P4UVlCHIUgzXoQLuA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 194.138.21.76) smtp.rcpttodomain=googlegroups.com smtp.mailfrom=siemens.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=siemens.com; dkim=none (message not signed); arc=none Received: from DB8PR04CA0004.eurprd04.prod.outlook.com (2603:10a6:10:110::14) by DU0PR10MB6929.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:414::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5924.16; Fri, 23 Dec 2022 08:55:43 +0000 Received: from DB5EUR01FT089.eop-EUR01.prod.protection.outlook.com (2603:10a6:10:110:cafe::58) by DB8PR04CA0004.outlook.office365.com (2603:10a6:10:110::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5944.13 via Frontend Transport; Fri, 23 Dec 2022 08:55:43 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 194.138.21.76) smtp.mailfrom=siemens.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=siemens.com; Received-SPF: Pass (protection.outlook.com: domain of siemens.com designates 194.138.21.76 as permitted sender) receiver=protection.outlook.com; client-ip=194.138.21.76; helo=hybrid.siemens.com; pr=C Received: from hybrid.siemens.com (194.138.21.76) by DB5EUR01FT089.mail.protection.outlook.com (10.152.5.156) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5944.13 via Frontend Transport; Fri, 23 Dec 2022 08:55:42 +0000 Received: from DEMCHDC8WAA.ad011.siemens.net (139.25.226.104) by DEMCHDC8VSA.ad011.siemens.net (194.138.21.76) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.20; Fri, 23 Dec 2022 09:55:41 +0100 Received: from localhost.localdomain (167.87.23.195) by DEMCHDC8WAA.ad011.siemens.net (139.25.226.104) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1118.20; Fri, 23 Dec 2022 09:55:41 +0100 From: Henning Schild To: CC: Henning Schild Subject: [PATCH v7 0/6] expand-on-first-boot btrfs and CI testing Date: Fri, 23 Dec 2022 09:55:23 +0100 Message-ID: <20221223085529.8835-1-henning.schild@siemens.com> X-Mailer: git-send-email 2.38.2 MIME-Version: 1.0 X-Originating-IP: [167.87.23.195] X-ClientProxiedBy: DEMCHDC8WAA.ad011.siemens.net (139.25.226.104) To DEMCHDC8WAA.ad011.siemens.net (139.25.226.104) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DB5EUR01FT089:EE_|DU0PR10MB6929:EE_ X-MS-Office365-Filtering-Correlation-Id: 7765c6d4-1795-455a-9b8f-08dae4c37901 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: g3uBfM35KSXp7H6eFNPu8+qh+MtWkXOS7A0RQgvlahGmLmh8L1wXsVp1WSxVtYA+bzdo5F6k8+7K6Cl4Ewmfa8Kc1aTaqJJ5QxbSLyuMWSkHriSVTe18eb+HVeHur8BN5aDqUh6FdFkqsPILNykoHHtGz9OMIOMIsbGBbAHHUWH+l1SpkDlCU910J75LmPv9NrbDBfSl/j8mxxwNN08bQMA7V0XKZm6uQI6HzDnHXgkxptG+Zfsniriby1GWgFJt/WaAnO4iUrNBF/2rlKBzjrwLTku2qJTLzhzsTl8t5p3KQCduJiYBlI0HSNXaj0Y6EOHv5BNyMfu1aNT45dEh4pGAH9CppySpx4JvVYxVlVGrs7QnRXyw5tX+ojgp2DJitx/EwYte+67EomiAg+1SVa2Kf4XkoHFW9sf8MFrV889FV4E89+UnxyQEeUbtv39Yq20dav80omZ7S7onEgi5bA4UoAVSUKl8ROGlML9k7prauUgNvqVwbloHj8ad0nH4ioFeZABZEVXGpqgzOOViQC2uAl2R/ImujoHvhW+nLVVLqGmnxGT+gZNteKIiLlAghVFNqXKTnnk/wBXqYivup1lsJBgd7xXhwb/+B9k6KA5QDLMdeIXdugqAhyZhfdMfoHLkkZHv90vPj3haEW8rSsEx+b90mLCGaUhbEP0zr+HO+uhDTMtoK4RNQd67oHnTlSS7oJ2pnHLBPdJUkF6ZwhaP627Cl8yqAns40xt6JVo= X-Forefront-Antispam-Report: CIP:194.138.21.76;CTRY:DE;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:hybrid.siemens.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230022)(4636009)(39860400002)(396003)(346002)(376002)(136003)(451199015)(36840700001)(40470700004)(46966006)(956004)(336012)(2616005)(316002)(1076003)(16526019)(6916009)(478600001)(81166007)(356005)(40480700001)(40460700003)(36756003)(86362001)(26005)(47076005)(82310400005)(186003)(83380400001)(82960400001)(6666004)(70206006)(5660300002)(8676002)(82740400003)(41300700001)(107886003)(70586007)(36860700001)(8936002)(4326008)(2906002)(44832011)(36900700001);DIR:OUT;SFP:1101; X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Dec 2022 08:55:42.5469 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 7765c6d4-1795-455a-9b8f-08dae4c37901 X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=38ae3bcd-9579-4fd4-adda-b42e1495d55a;Ip=[194.138.21.76];Helo=[hybrid.siemens.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR01FT089.eop-EUR01.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR10MB6929 X-Original-Sender: henning.schild@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=uvywnN+v; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.13.88 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-0.8 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= changes since v6: - make sure CI only expects resize output when booting wic changes since v5: - drop dead code around mktemp subshell - revert cosmetic mktemp stuff back to v3 - remove "Suggested-by" tag to hopefully improve signal to noise ratio in review process changes since v4: - cosmetic fix in the way we call mktemp - add a patch that makes sure the service is run only once, also on error - bump package version after changes are done changes since v3: - rebased on "expand-on-first-boot: switch back away from systemd-growfs" - implement btrfs resizing and CI testing it - put the padding wks entry into an include changes since v2: - add python namespace prefix for the bitbake get functions - install only in images that use WKS_FILEs that have the "gap" changes since v1: - complete rewrite to not focus only on the tests but rather the feature for all examples This first was only about testing but meanwhile has a focus on enabling the expand feature in all example images anyhow, and later look for traces of that happening in CI test where we can. We install the application in any image and in the wic images add some scratch space at the end. That will enable improved interactive use of all those wic images, so makes sense apart from any testing. Later use the log reading feature of the qemu tests to look for traces of successful resizing for non ubuntu images. In ubuntu the console_loglevel is not verbose enough to find traces. Henning Schild (6): expand-on-first-boot: really only do that once, especially on failure expand-on-first-boot: support resizing a btrfs meta-isar: introduce an example to use btrfs CI: improve cibuilder readability meta-isar: install expand-on-first-boot in most images and add space CI: expect a message about filesystem resize vom expand script meta-isar/conf/machine/qemuamd64.conf | 6 ++++ meta-isar/conf/machine/virtualbox.conf | 1 + meta-isar/conf/machine/vmware.conf | 1 + .../conf/multiconfig/qemuarm-bookworm.conf | 1 + .../lib/wic/canned-wks/expand-padding.wks.inc | 5 +++ .../lib/wic/canned-wks/sdimage-efi-btrfs.wks | 11 +++++++ .../lib/wic/canned-wks/sdimage-efi-sd.wks | 2 ++ .../lib/wic/canned-wks/sdimage-efi.wks | 2 ++ ...oot_1.3.bb => expand-on-first-boot_1.4.bb} | 0 .../files/expand-last-partition.sh | 31 ++++++++++++++++--- .../files/expand-on-first-boot.service | 1 + testsuite/cibuilder.py | 31 ++++++++++++++++--- 12 files changed, 83 insertions(+), 9 deletions(-) create mode 100644 meta-isar/scripts/lib/wic/canned-wks/expand-padding.wks.inc create mode 100644 meta-isar/scripts/lib/wic/canned-wks/sdimage-efi-btrfs.wks rename meta/recipes-support/expand-on-first-boot/{expand-on-first-boot_1.3.bb => expand-on-first-boot_1.4.bb} (100%)