From patchwork Mon Sep 7 08:17:47 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 34 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:eb04:0:0:0:0:0 with SMTP id f4csp3466150ooj; Mon, 7 Sep 2020 09:18:18 -0700 (PDT) X-Received: by 2002:aca:b988:: with SMTP id j130mr79200oif.0.1599495498230; Mon, 07 Sep 2020 09:18:18 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1599495498; cv=pass; d=google.com; s=arc-20160816; b=oFBp9Q0TYVO4IPtQhfDSKOfTAZQkUT+ylvxnS5DKtzoWCcYF7KnUX9ieT2G4SEc+AE /uobhQ4mETMJYcJ9AKxd/KjYjYY1+AtwxxpN7M7lp2xoE/HkS7gyGXPaB3Nhs1KX4c6x r610jOBxkviAukyNcNN1l70o7H09vs/eskm+ka9Ef8v+5gyMjI7yWhW3JeixVejUEqhg 0azNE0rVMiW2MzS6h7xJfVu+Ioy2waev4yCrhuUf8uiY7TETR3jYH/ZCxUjkRZhrp8Qf vaQB4Cam6kIv0iQSviw6LfcoqY1ckOMbEhb7VklrAZZcB3cNIApRRi/6iMbk13N8N+md eE4Q== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=kIDurPuaWoWXVLi2wCqeXravtwUQvTj+UQ+47qORkW0=; b=m3F8x83KoFssG8ObTmvAwZu2QKVfOWIUsdo6ujwWaBGut0mjZGtTDEX9JuFV58Yo4m RlYvw1VSW2TgPYPQKhvoKHeb/P+nkxPjgDV6eORMyQCNGgpwvsfeETTOneen7YdQ/wta eiRf/3si1X2hDfUk6HcBaXnxco124uPB+LlkcfT9F1x9WYJIAYNKrzbjUo7HptroCW0/ u92MsjGsHqnZHjWPmK0dm4DK1egNEcfOHip3r/b0Owmoq8dJDVibtsaVQM7HJG4Tg8ir 5+qh5P0B77AisVWlNKA1vSQ1yce79mPIYfojuemSdXBzmgMA7mxnRUtmIVYT3YjWJRXQ oCyw== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=B7pvAWEW; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbsn23h5akgqesh3pt5y@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBSN23H5AKGQESH3PT5Y@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id b1sor6051148oon.0.2020.09.07.09.18.17 (Google Transport Security); Mon, 07 Sep 2020 09:18:18 -0700 (PDT) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbsn23h5akgqesh3pt5y@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=B7pvAWEW; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbsn23h5akgqesh3pt5y@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBSN23H5AKGQESH3PT5Y@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1599495497; cv=pass; d=google.com; s=arc-20160816; b=A4v0joV/jSGDBL7uYBUsI1UfCgINUo2Sq9nuH/l4miuyC1wEYhEauSrTesyIx2mlvd XvEiCi4/Qvya8jt9gAiAPyrc44R3UUAeXmcM3ZFkx5ElX3qqk5r8OssSHnET4JouJbyl raf+nqNqeN9F0OwKj/vy8aQ7UJFG0NUHynre94tOdFlIVlP1lEUXRMOHu9xhLNFCHJNu TroFPy7Cq8SPzdVReftktKyA7el8Qz3oKsotx0PCrsSWWOf1O0YCMnr6FB3IBhIowpq1 7fLjo68xbKEUiE8aHXPfbjmjqeDovD/L9gZnA3PHL06vFAlw3kFGfhUd6j5WrzdNssad CpoA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=kIDurPuaWoWXVLi2wCqeXravtwUQvTj+UQ+47qORkW0=; b=JrsRTYo9Ku/m7IVGqRcrhqeYmN8usxAyKJQwMY14NekN2R3mAZQpcIgpKMxipDa2Kf NjdnCGDzrAjfpIap+p2cwzBL05I1quP4fhHiSvwMEQsrIJgVFcioQ/QKBT74a3DrLWDM GHroveVMGQoWoQb7SOkirz+T48wppbkkIxPlGyKf6IArv7ZXJXbfnWvQpmTTZTlIAFdO PVYdEzIINkSHbaKZPXQFIJH4YCAFvq+bfO8ZT138URvyXP+qzqawHmuj2DxZHavi1Ev0 DPU2SzAzeHldr5ntqk3/AxQttdnP8Y9tD3jWw3o8ke8HfYDbByfUZ/JY4+1hD5ggmXAa I9zA== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:subject:date:message-id :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=kIDurPuaWoWXVLi2wCqeXravtwUQvTj+UQ+47qORkW0=; b=B7pvAWEW5oFKloXzQJ6v5suwOXk32Ux74HeIRHuXFknD01YmLdLfaOBeXOW0imLS/h LrG4Zm6iPuED8QX77nFyLo7AXup8+81zxXSk2gQxyt5/HmRHnZOZwmifazur88l8d6LR oShTy7wESevgVfBImxH0M2cj0VSuscBVOFasROGRl6z7MgSToKPjtrA2dVHTbX1TiyRM Q32GYwTM3u1Lqo5IJUEcf/fRPupwuyDBmWsfbfO/XlFGopuo2gGxmpP6DEFTbX4FB3Qu sZwZtYp/BYWCyFnwshBxTJO+4ALyLGy8jkbfnukHmajhG9GzyTlIsFNiUWlGAOGaw8xg j0+A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:subject :date:message-id:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=kIDurPuaWoWXVLi2wCqeXravtwUQvTj+UQ+47qORkW0=; b=pjfJGLnl6w1fzN3WAuaZw3chvVEEmpNJgGd6UPTP8IXH/sME3kPP5fhoBHzncgaYis 2XzXJIXKb4WDVaYBPz//EOgjf2gighrCh/AK2bPxJ+dP8do3fFCiswiXxSYOfpPmaDcY 3z41YqwPq72g2VyLip72iQK+iHupKwBkKJG3yVP12yFJTQNfc6K9PRz2Ae18bEOrJF9c j2fpX0+yDl7sDxaSqnWBIbV9yxiFdVbNV48+PuTROpZRj5BmVyzrN0CVnYo2+xDzC0vz 4BuKEdAmiEynmiIgCmCri3+OSFulyrH5YzGBXjxcCAQhqoqKXcQ66vn+OrgalrFi+eua xyCA== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM533l2zHecd5JQT6SKIanZXV2TxtAXKHE4o8lY+hT+WVy+6S6kOai JhjRVWuR1R+L0PbwHVquwwY= X-Google-Smtp-Source: ABdhPJwQYfXM6aARSzKAxizrTaV8UB4ptjEIP8iPayw47wvGSxP+fMBRNYAeMEwVPtytJ9jYtfiP7A== X-Received: by 2002:a4a:a201:: with SMTP id m1mr15321897ool.26.1599495497422; Mon, 07 Sep 2020 09:18:17 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:aca:b154:: with SMTP id a81ls3715270oif.8.gmail; Mon, 07 Sep 2020 09:18:17 -0700 (PDT) X-Received: by 2002:aca:cc07:: with SMTP id c7mr69607oig.82.1599495496939; Mon, 07 Sep 2020 09:18:16 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1599495496; cv=none; d=google.com; s=arc-20160816; b=YKtlG321q2JTCslC3MzLbMQiI8N+aP9ZrsV2kwbkyFgCItLeFxEQ12yHuo8qA04nNZ GUd9GNIu05lh5lwAY0Gu0ye0jsQW49OpiLwTElSaq4bu3+UYyj8hn/v0+2PoXYD/9O4U 2LwvbRnKrJ3oAnlOeOIg8yysCcFf0C1dkR6+loaHX+TPuXixsxu+9njnGlwi7FE+VXxX fVbUzWF0Ihgrn5dqasOXQdDWG8qjEoBxswWxFhWBhowmReUPBB00PXsULAMpvzE2Nfu+ WxZKUDHzUvDTgv94Q7k2FeFCHho5AwuDGnM2ogPI5u4I2Vc+axVfQQVU+nx30lY32XtS l4lA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:subject:to:from:ironport-sdr :ironport-sdr; bh=rIcOU7V/IrODUvpHG5CU/M7IXzlk9lq6JGgbDzqX+98=; b=YKAe906S0m2axciiDWSzMF0T30O9Hq4d01DhcbUjKJ5rmEUmXGXnA9vKNDsxi86S9k r549Fgm7d7lqdPfkoMvpcHpkseZJssIx0n6HpK9Ux4QgFbtJ1tpzUXPxz+DRpJE5+4IU 8OGM6sja5Y/srww8s2/oPUBthQjARY/M99tZlUTMSRUSPIoGN6zhjS6GtV6a6gzg/ZyJ 6IK5pFJFb/Q/oML8xRjdMitcEFGpLyhIoN/9ljP+qHa67qSWaMo8HW7KN8bTLnXV62aa wWUbXmC2tG/9SlENmcls1zzjYTpUB2RbQ2BgeWtGUsmjiE8l3pFfwTrA3GVk3mTgRBes Skrw== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa2.mentor.iphmx.com (esa2.mentor.iphmx.com. [68.232.141.98]) by gmr-mx.google.com with ESMTPS id d11si862274oti.2.2020.09.07.09.18.16 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Sep 2020 09:18:16 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) client-ip=68.232.141.98; IronPort-SDR: JhkZ6wo/oxqAK74HsRx+UAx36a7TejeeBiZnQTZz3acj6qxvZiqJtGLjdwdfPXXkSSJ4txMqkt 6HWGnv8D+thTnw5H0st9hVjHjcpPZR/GqvF5JlVzvP9pmgAHlbmtWgukcwihsqx7G/thP+ZnRh 1a722wth8ZtlLUYXfYWZCBGEVYPQcyIXrF2Qbr74APqzk1m7hS5sIubNmNDDUeNIlEUPwzu5Vi rY6w7vE64n75E5gE+3QJPRHEH8ZRzUTBIlUjl7P9IG+MRcabRq+/O4U1qS+PtiV3CNQjsOuF/q ZNk= X-IronPort-AV: E=Sophos;i="5.76,402,1592899200"; d="scan'208";a="52670201" Received: from orw-gwy-02-in.mentorg.com ([192.94.38.167]) by esa2.mentor.iphmx.com with ESMTP; 07 Sep 2020 08:18:15 -0800 IronPort-SDR: ch9iPdjw76ZIDtjN6UCf0/VpvtmhLi2GMMKXMwIPX9eEKmXIpUyigwlSS3PgYiI9UEuOnCN7Qi D4keCghHkUaeSnuYCt21IaDO2NwnqKQt5JaopUcRFLIrFMwJweBTMfYNZtbVeSzoTYcnDLEDTy CxXRYtVAVC+d2Hsnd+2zLAb66HAFNJ1WQ6++8P0gY9YJC/7C4sjCjcYZq0FBsnLY/8/yyeL4Yf H0yv2rYkH7JIQr5Feo4daleDEmoO86Hej8w5bSq8DIoFO7VyT/scm3fU4qAp06Qr4LInnOm4gP AUw= From: Vijai Kumar K To: , Subject: [PATCH v3 0/9] WIC update Date: Mon, 7 Sep 2020 21:47:47 +0530 Message-ID: <20200907161756.16372-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 X-ClientProxiedBy: svr-orw-mbx-02.mgc.mentorg.com (147.34.90.202) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1677192591550569465?= X-GMAIL-MSGID: =?utf-8?q?1677192591550569465?= We still need the fsck & export MTOOLS_SKIP_CHECK=1 hack for the stretch build to work. Changes since v2: - Dropped P9 from previous series and updated oe-core to the latest revision which includes that patch. - Some minor commit message & API changelog changes. Changes since RFC(v1): - P9 commit is upstreamed and replaced with the version from OE-core. - P10: Lot of downstream projects tend to use /boot mountpoints for bootloader/EFI partitions. Added RECIPE-API-CHANGELOG entry to warn user about potential issues that might arise when doing so with latest wic. Henning Schild (1): lib/oe/path: try hardlinking instead of guessing when it might fail Paul Barker (1): oe.path: Add copyhardlink() helper function Vijai Kumar K (7): wic: Update to the latest wic from openembedded core wic/plugins: Fix wic plugins to work with the latest wic wic-img: Satisfy the quirks of latest wic wic_fakeroot: Handle standalone pseudo invocations meta-isar/conf: Add provision to debug WIC debian-common: Add tar as a dependency for wic meta-isar/canned-wks: Remove unwanted /boot mountpoint RECIPE-API-CHANGELOG.md | 23 + meta-isar/conf/local.conf.sample | 3 + .../lib/wic/canned-wks/common-isar.wks.inc | 2 +- .../scripts/lib/wic/canned-wks/hikey.wks | 2 +- .../lib/wic/canned-wks/sdimage-efi.wks | 2 +- meta/classes/wic-img.bbclass | 15 +- meta/conf/distro/debian-common.conf | 3 +- meta/lib/oe/path.py | 27 +- .../wic/plugins/source/bootimg-efi-isar.py | 2 +- .../wic/plugins/source/bootimg-pcbios-isar.py | 9 +- .../lib/wic/plugins/source/rootfs-u-boot.py | 2 +- scripts/lib/scriptpath.py | 32 ++ scripts/lib/wic/__init__.py | 14 +- scripts/lib/wic/canned-wks/common.wks.inc | 2 +- .../directdisk-bootloader-config.cfg | 8 +- .../lib/wic/canned-wks/efi-bootdisk.wks.in | 3 + scripts/lib/wic/canned-wks/mkhybridiso.wks | 2 +- scripts/lib/wic/canned-wks/qemuriscv.wks | 3 + .../lib/wic/canned-wks/qemux86-directdisk.wks | 2 +- .../lib/wic/canned-wks/sdimage-bootpart.wks | 4 +- .../lib/wic/canned-wks/systemd-bootdisk.wks | 4 +- scripts/lib/wic/engine.py | 421 +++++++++++++++- scripts/lib/wic/filemap.py | 170 ++++--- scripts/lib/wic/help.py | 401 ++++++++++++++-- scripts/lib/wic/ksparser.py | 121 +++-- scripts/lib/wic/{utils => }/misc.py | 100 ++-- scripts/lib/wic/partition.py | 234 ++++----- scripts/lib/wic/pluginbase.py | 36 +- scripts/lib/wic/plugins/imager/direct.py | 175 ++++--- .../wic/plugins/source/bootimg-biosplusefi.py | 213 +++++++++ scripts/lib/wic/plugins/source/bootimg-efi.py | 171 +++++-- .../wic/plugins/source/bootimg-partition.py | 153 ++++-- .../lib/wic/plugins/source/bootimg-pcbios.py | 91 ++-- scripts/lib/wic/plugins/source/fsimage.py | 56 --- .../wic/plugins/source/isoimage-isohybrid.py | 185 +++---- scripts/lib/wic/plugins/source/rawcopy.py | 44 +- scripts/lib/wic/plugins/source/rootfs.py | 159 ++++-- scripts/lib/wic/utils/__init__.py | 0 scripts/lib/wic/utils/runner.py | 114 ----- scripts/wic | 452 +++++++++++++----- scripts/wic_fakeroot | 5 + 41 files changed, 2430 insertions(+), 1035 deletions(-) create mode 100644 scripts/lib/scriptpath.py create mode 100644 scripts/lib/wic/canned-wks/efi-bootdisk.wks.in create mode 100644 scripts/lib/wic/canned-wks/qemuriscv.wks rename scripts/lib/wic/{utils => }/misc.py (70%) create mode 100644 scripts/lib/wic/plugins/source/bootimg-biosplusefi.py delete mode 100644 scripts/lib/wic/plugins/source/fsimage.py delete mode 100644 scripts/lib/wic/utils/__init__.py delete mode 100644 scripts/lib/wic/utils/runner.py