From patchwork Wed Sep 2 10:56:14 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 19 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:eb04:0:0:0:0:0 with SMTP id f4csp654190ooj; Wed, 2 Sep 2020 11:56:58 -0700 (PDT) X-Received: by 2002:a17:90b:390d:: with SMTP id ob13mr3582876pjb.122.1599073018602; Wed, 02 Sep 2020 11:56:58 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1599073018; cv=pass; d=google.com; s=arc-20160816; b=RItjx1ksRpFObuNb9tRbvsTTHYglru7hvNkZ2EOiIgh3/fwhXuGYbGS22fHY+TYTah oZAg6pFG3L3+0uRwBHwecHGAehxUU5u3qwuNDMk354ctki+s82dWzQ27ERvZNofYV15A Cf6Q150wQBQsLWy6J8VPSLcMoNVun+rOAsB3Tenaftj7sfGTZBejf7S06DUZnq+8bG7+ tYEJnABNawN5Pk6EXhckgXr6Pl+UgPgeTCXH/OYePth1S5wfyjCiTj7bdLnMYSdT3i8P XZgiT4+gu/sDMP4DkHrK/3XIdAo5JGxhedFYCJCTd9C/S28XIFbftmRaL2CpRkkrktAn 5E5w== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=KSphwVLSpnFaFfAhYy4a/eFMN+irFOBkocLB954v0Ko=; b=r29CRHs6ToNKsPTwF+VxJMRltUI+jfhpPb9NOb/Mr3ONGpsS7wm0Xwn5CxQVQNIpKx iiwwQ7VPZrBxeKjP+btWb4WqYpcyk3zJazhGe497I2g2yRZbhUoS4U5jT8OYdZ8ErN03 HBOf9ITpVK8DmR9KZQ9101MiUkDjp54DNSERL9pckiG6u25baFh8D7mUcbrh+cBTbMAs p8l3f+627LQjHLoD+A87MgbLJcfw6iHpmnIbLmBijJBddklk2AYinXRghKtPQNvNfJ50 L5ZRnDE2eromCbOfPdpHe1fxUHYhDM6nJ67IS+lGBR8Kd3UI3LjVrLjkHaFGUl5MjllY 5DrQ== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=RySxTnu7; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrb6ovx75akgqewlznrwa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRB6OVX75AKGQEWLZNRWA@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id x19sor238886pjq.37.2020.09.02.11.56.57 (Google Transport Security); Wed, 02 Sep 2020 11:56:58 -0700 (PDT) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrb6ovx75akgqewlznrwa@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=RySxTnu7; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrb6ovx75akgqewlznrwa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRB6OVX75AKGQEWLZNRWA@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1599073017; cv=pass; d=google.com; s=arc-20160816; b=RLxUxgtiq0s1bU9RMsc7yFmmxAvWzX29jn4ehc5UylNCrkGXy9K59+aUEg09AzEGEU hG3pbADvz/1aYHdlxTZ6/sb5xr4XcM8cSSaZ2Iclje+mWNKiLZwV8sqqehaQ0joSvrQL Uc5ZQ71AiYhqL1DRqMdtTPfDtXoZI/SkqUuc0u3FAa/Uq/B4k3vegU4FrpMojMWJTcYU UCeW/YU3m08kFQTc4+5Wt/8wky1V+fL/zwAJENhTtuiZECLZ30c/PtVC5aDh5HedeVzv 8tMM/OpuTuPzNlTPfQ6Nh+LeSuiYqghocrh/Wkn4hIVfdco0dt93mkNfx2QXM3gGrz3x M1Mg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=KSphwVLSpnFaFfAhYy4a/eFMN+irFOBkocLB954v0Ko=; b=y6DORbCHqOvH8xsnU86PXS1Mp49+JU0Wh8NSC6o+1QGcq2ZdTpEpCfNSaFOTOnbS9r HBk/vAGvkFHah663KfNdoGUfE8rSNyWYC8v2mGltvVltE7dQUVZgYKyvOF2HmZeSERK6 Qlij6HRqXnsQL2rOLZC/uK0cZ/o3ENVPsDIS8dTZKf3u98YafhIMFXe33CD8b5ymnW2U eRF8Ops72fL2Uo24lhqlOMaMeK2H71OBoEpr9g5v+ySsaCjOInrP6PX0MUN2fkk6If+I knFMRUPqALnk5cz9aFmXRVqnQGI5fCeC/zIwHowYSgA+YO0WItFHEcJbSd3gexA1baso AZpQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:subject:date:message-id :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=KSphwVLSpnFaFfAhYy4a/eFMN+irFOBkocLB954v0Ko=; b=RySxTnu7uu6Bg6XiGbOjrsgR4/K35FqUj32bXke7dtZ22LMErbIuuZ8Bg02pQMgQnb NM8y8zIehCYJaLxoFLMRni1Fjii6XVCtR5t5E7WVy5mGt6FZXCDhmV+hQpsIWa618mEk oaVhGkxuVqXWL8Nvi7GKsafgqW8TArKbGr0ogSLAohgD5CUqPfBAQ4HqW2Wo7DsJ9w1p CeOCcL1/TBkWHpBPEDvxL6Ozk3rQSY2uDU3jBjCOomSG6YPdrjG0s8HTTusAqpprQ1kP HUdtt4s/wi4iWIbq+JULO4ulvYwNsB8FZXj73kVtAQ+prbM2Phne4TD4sDyovrkNScBW nyYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:subject :date:message-id:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=KSphwVLSpnFaFfAhYy4a/eFMN+irFOBkocLB954v0Ko=; b=rMcGBL6jQxRIgGk6KV/qtY1oiSSzPvsdN0dm3wBjBSmJ03GTDY9lOGHex+9pcTYMQn l6mZ47NiEsjFYa1ApycxwAZPFJIqXgDzl9oVfn0mId9iHF/IL/m6slcqEdpvC9ahVCP1 fukWJB6TUZq7dN0GVSlUufhQ40C+ckqF2wOg7+oirFU/pt4lDlhyV2UmxHDyx+MDTePy j1YJ7Za9STbPTjVBjWftLQ4EwWze+bwLHa/5lbe39blYJ19F84rGvKlTVnfb4IWS7nLl ibE3mfNobE5deOTiscX8VbISCSyJTC38Br6X5eU8K3+RPHLiTi9CrpOgsO8lG2gpNXgo 8rnA== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM531ECsQutjeQc6sq+W68/9hJ+IAW45TKRzAWUuuLv33amBmI5c7C B4rqWuOkS9UNmHlBkNqPBf8= X-Google-Smtp-Source: ABdhPJzMgVSrCTeXP8YfzZIkNepoJWvA9nCejlYi6FdTQBq03V+TJMsrsrxhHLtZGUaQlnvOssIF3w== X-Received: by 2002:a17:902:9a8e:: with SMTP id w14mr3242179plp.6.1599073017503; Wed, 02 Sep 2020 11:56:57 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:902:8d89:: with SMTP id v9ls1633613plo.4.gmail; Wed, 02 Sep 2020 11:56:57 -0700 (PDT) X-Received: by 2002:a17:90a:7f8a:: with SMTP id m10mr3556715pjl.47.1599073016991; Wed, 02 Sep 2020 11:56:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1599073016; cv=none; d=google.com; s=arc-20160816; b=bfRjDhONbEjLfqZokcBlRdXOCS5SQmZVMejnLUHmL2fpxAJ2ipicKtMeh+JfTv97Q8 qL61EhAeSBnHB1qMgPnbz0gPU28xXtjDSFuFL0BJEd3naH72aSkq82qTOIcsSxDdlyl6 ZBH6DuDb8u0TPc7zVBxCP9INgfCwvhNfqOHUGyC7+Igm7ttXd82bSUUPafG7Q6YRAZ3Y cIiUTvxiFn2obHum/7ko+HVptvaxgtal4vXhIvD48q56uwfV72XeVh0vrJJQfgZA0RCU OgPhYhKjh6YBLil1s2rTHApJlh4fSiRx/E7o5YiPiOTnl6yfDpV782QhAYNrA5xRWpgg szTg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:subject:to:from:ironport-sdr :ironport-sdr; bh=QQQpmmLIsoyr1hzpyojs3UEdObpeu810RsCY925hck0=; b=MmpdT3Bqf6AUHvbmo27t1QmRjEZkbeTkl1yEh4WCekraiA2etctKx/5QckyfXDdR4D fwjxjcytuqWoP3kZ3rp3p2SihfmxLRLuDZAidN1C7jW1zE3p6qQY/p19vi/O6kU69uC+ KAEOCLZmNrWK7oSh4x1u9otFe3QsxwEnq2q7nMVDvDWU+p95nEyjAAuUtKbIyh0Tj8dM ec1jom7TJ5yXhGSKmXC74mzhLf1nnn1qZ8NRyNIG98o2aFXlQ8iPQbiT3PtFndQlNP8n hKT0GVqPFE28TX5BoRKe4IOi35OdXYaIoYQ9C7Rrtk+mtDLU+pLSH3v3WRRMan02YaH5 6A2Q== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa1.mentor.iphmx.com (esa1.mentor.iphmx.com. [68.232.129.153]) by gmr-mx.google.com with ESMTPS id a199si43434pfd.1.2020.09.02.11.56.56 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 02 Sep 2020 11:56:56 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) client-ip=68.232.129.153; IronPort-SDR: e6G5ZkDKB6nC6tbHB+t6SoMl3Lg1CFF2KmzzBLaPYcLWsPxfvLj/DFKWpeTGY9EFnpE/HeLLCy inufQVLGhdryWRBNMaMw206PxT1SjY2pYcs5pIPE0pFasr1fle2XnOa6IryZaATezp1iaLbLx0 TVLnkvIfEh+wDc5Ap+e+6VrUZm9UR7V/yUy5Gd7RVWJuQP7JYBB5zw5PnTQiqMziDh0RBlUlBD RsJAi7UwbokcBkLm63wWok53bblXb2rxA6ufaVojX+Hmm5Bckv8dwRTwyPJBZ1jqmB/iIHA7DG Wz0= X-IronPort-AV: E=Sophos;i="5.76,383,1592899200"; d="scan'208";a="54698476" Received: from orw-gwy-02-in.mentorg.com ([192.94.38.167]) by esa1.mentor.iphmx.com with ESMTP; 02 Sep 2020 10:56:56 -0800 IronPort-SDR: HEGVLz1fYqblx5VZMZ2VFs6YfohffM9Lmqz2mR8j4RLdr1o9A+5p2uE/wk8NbwcXuVGJtcqcbK xxoqpI+KHdkKlw76/nw86U6RTqcztOcEgsMtJ6k0om6sa25Uw7tZ1WakDKCq0ezEDKhTWDYvS+ XL6Dnu8hNX7Ovt10m4qqFLUB+URzB5jtEK0IJnNKluAQ4U4UxrR9kcniIDpaKdFatI5mhuE886 zquMduR30jFWKNp4aTdzqGLrqGTRCy6locPrSh5amKIb092+p7WmetlKt0sQF48XOJXPecq4w6 oWk= From: Vijai Kumar K To: , Subject: [PATCH v2 00/10] WIC update Date: Thu, 3 Sep 2020 00:26:14 +0530 Message-ID: <20200902185624.15044-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-07.mgc.mentorg.com (147.34.90.207) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1676749589508844215?= X-GMAIL-MSGID: =?utf-8?q?1676749589508844215?= Changes since RFC(v1): - P9 commit is upstreamed and replaced with the version from OE-core. - P10: Lot of downstream projects tend to use /boot mountpoints for bootloader/EFI partitions. Added RECIPE-API-CHANGELOG entry to warn user about potential issues that might arise when doing so with latest wic. Henning Schild (1): lib/oe/path: try hardlinking instead of guessing when it might fail Paul Barker (1): oe.path: Add copyhardlink() helper function Vijai Kumar K (8): wic: Update to the latest wic from openembedded core wic/plugins: Fix wic plugins to work with the latest wic wic-img: Satisfy the quirks of latest wic wic_fakeroot: Handle standalone pseudo invocations meta-isar/conf: Add provision to debug WIC debian-common: Add tar as a dependency for wic wic: misc: Add /bin to the list of searchpaths meta-isar/canned-wks: Remove /boot mountpoint RECIPE-API-CHANGELOG.md | 17 + meta-isar/conf/local.conf.sample | 3 + .../lib/wic/canned-wks/common-isar.wks.inc | 2 +- .../scripts/lib/wic/canned-wks/hikey.wks | 2 +- .../lib/wic/canned-wks/sdimage-efi.wks | 2 +- meta/classes/wic-img.bbclass | 15 +- meta/conf/distro/debian-common.conf | 3 +- meta/lib/oe/path.py | 27 +- .../wic/plugins/source/bootimg-efi-isar.py | 2 +- .../wic/plugins/source/bootimg-pcbios-isar.py | 9 +- .../lib/wic/plugins/source/rootfs-u-boot.py | 2 +- scripts/lib/scriptpath.py | 32 ++ scripts/lib/wic/__init__.py | 14 +- scripts/lib/wic/canned-wks/common.wks.inc | 2 +- .../directdisk-bootloader-config.cfg | 8 +- .../lib/wic/canned-wks/efi-bootdisk.wks.in | 3 + scripts/lib/wic/canned-wks/mkhybridiso.wks | 2 +- scripts/lib/wic/canned-wks/qemuriscv.wks | 3 + .../lib/wic/canned-wks/qemux86-directdisk.wks | 2 +- .../lib/wic/canned-wks/sdimage-bootpart.wks | 4 +- .../lib/wic/canned-wks/systemd-bootdisk.wks | 4 +- scripts/lib/wic/engine.py | 421 +++++++++++++++- scripts/lib/wic/filemap.py | 170 ++++--- scripts/lib/wic/help.py | 401 ++++++++++++++-- scripts/lib/wic/ksparser.py | 115 +++-- scripts/lib/wic/{utils => }/misc.py | 100 ++-- scripts/lib/wic/partition.py | 234 ++++----- scripts/lib/wic/pluginbase.py | 36 +- scripts/lib/wic/plugins/imager/direct.py | 175 ++++--- .../wic/plugins/source/bootimg-biosplusefi.py | 213 +++++++++ scripts/lib/wic/plugins/source/bootimg-efi.py | 111 +++-- .../wic/plugins/source/bootimg-partition.py | 153 ++++-- .../lib/wic/plugins/source/bootimg-pcbios.py | 91 ++-- scripts/lib/wic/plugins/source/fsimage.py | 56 --- .../wic/plugins/source/isoimage-isohybrid.py | 185 +++---- scripts/lib/wic/plugins/source/rawcopy.py | 44 +- scripts/lib/wic/plugins/source/rootfs.py | 159 ++++-- scripts/lib/wic/utils/__init__.py | 0 scripts/lib/wic/utils/runner.py | 114 ----- scripts/wic | 452 +++++++++++++----- scripts/wic_fakeroot | 5 + 41 files changed, 2357 insertions(+), 1036 deletions(-) create mode 100644 scripts/lib/scriptpath.py create mode 100644 scripts/lib/wic/canned-wks/efi-bootdisk.wks.in create mode 100644 scripts/lib/wic/canned-wks/qemuriscv.wks rename scripts/lib/wic/{utils => }/misc.py (70%) create mode 100644 scripts/lib/wic/plugins/source/bootimg-biosplusefi.py delete mode 100644 scripts/lib/wic/plugins/source/fsimage.py delete mode 100644 scripts/lib/wic/utils/__init__.py delete mode 100644 scripts/lib/wic/utils/runner.py