From patchwork Mon Oct 5 07:52:59 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 106 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:eb04:0:0:0:0:0 with SMTP id f4csp3887049ooj; Mon, 5 Oct 2020 09:53:33 -0700 (PDT) X-Received: by 2002:a62:fccf:0:b029:152:4f37:99dc with SMTP id e198-20020a62fccf0000b02901524f3799dcmr605977pfh.17.1601916813758; Mon, 05 Oct 2020 09:53:33 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1601916813; cv=pass; d=google.com; s=arc-20160816; b=Yuxr+pCPe1oOczrCwqFTcv9UOXiXKlJrl78WDyzSNZbtyBcCFjaauiHPAyDTnbNYCC j1yaU62qOEqHYgdntY1+2AIgraRltlbkhNnLXJKm4/0YInPWGpeXzo3MQyrmiJygOJnR 5ykPThvBL/YcVZ911y0+JMn2n6yuv5doLsNODb1ARMSxYye2glF9LoW4/V3mveCD5Ik/ riaYwa7o5wEvXP8Gn0Z//Yb2dZ5OBzUF1S120Nph11KNrwZOYES+gKyVhz/Ft5FmHcVv o0WvJMvCFlI4hu8tpYDJmO9TZj9GA+lPIO6KvyitBabdSQOMhGOtmzU1qYyCHqnFXi/L PqHA== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=L3bIVLdFu05HnfuoTvfDbi+UIkx3d5VeT89BC3hvdGc=; b=tBmfIpochs7h3HQRjbEvGb6Y5uHo0ZQv4p1BLypg7aBee64iGnNstW8R4L7Lkgao5m pMYSCV7i5ptLCQWX+OyOg5ICgAeprjvKGRJOG9Uw5IsBvvY8+cop+e0I2JNagVh48BB0 2xnNBdvzkoPR/yI9kyHEvSCtw9cv3c7DK2AIb14ZmtiXYmUQ8br6LRhKUwZAHJ9nk4pp Zb7xGIc9RjELc5C8izIx0MOrqkzq7bTa2WCbDjyH95Aw8xwRVYiTaO5X94EMEMlSJFxH f12oFposOEL4SDtOWaUW57gdv/9YhcbcczU3gs8JyHIaB8r0kRjQEf86HBbkG7WUeFN+ NFtg== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=giK+VaPM; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbde75x5qkgqevvrp74y@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBDE75X5QKGQEVVRP74Y@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id 27sor234518pgo.80.2020.10.05.09.53.33 (Google Transport Security); Mon, 05 Oct 2020 09:53:33 -0700 (PDT) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbde75x5qkgqevvrp74y@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=giK+VaPM; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbde75x5qkgqevvrp74y@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBDE75X5QKGQEVVRP74Y@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1601916813; cv=pass; d=google.com; s=arc-20160816; b=owcD+I0e6x7MN0r9uk2WLd8xfgnb5JPvBff/G8jZ9DocNtWDwOUOjiXRt0S9l9UFsk J1AV15qWwr+Qomm4cRdDt/5fpBSJJkOIOoEfp+bjJkiUoV6vz9urxAWDPeqHYmXZwzsw VSuj+5dNWBgaAttJN/Caks69xSW+8Z9uL8dz0dUERu/MQkePWX/nsWlUZAOElf5KnjKD alBTcmApdNWkBKqg+Y228g8vUTXOCZo5fBGDRK4pLBNJsVBzlgRNh7X9qqknM0ApC7wR pLfMWNhv+37oJv1rWKIyhML0g4JVazo2L80ZkI6G/K7IQt4bZoZiHEyRh6HTUKo/5JOC IF2w== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=L3bIVLdFu05HnfuoTvfDbi+UIkx3d5VeT89BC3hvdGc=; b=q7JOt0i3p9yJ5AfrCoG/K79MhDmWm9B9NIh8znhGcSgMNjoP3GErAKgdSjJMCPzwiF bkSC076e9yFcd+SQ6RGRT1V4zVIjXflJ+Bij70mSiTXCiKYJFz2uUJ2IG2kePP0Y18o6 37mU0lvaMtBkQ6zvh+pv1uOmtl2YrKy4yqjpqH4yGI9sPxlgssXouwULyPfzVxtA1yBH 2BJbG7sbFCgURgu4/dsdEv2Uo65kFvUad2oKtKwNkPd5xTQeawKxC3uLC3rejvQ/o8VU 6D+J7R4XwSpF25q0sFCIbKonygNxpFXl31XEGHtR2cMxt7S8YIvvDonMHgVwjP36FBh6 6VjQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=L3bIVLdFu05HnfuoTvfDbi+UIkx3d5VeT89BC3hvdGc=; b=giK+VaPMz5oFzyk1g5QMxOs2mOqmr7hwkB97MbIQwRBHQqvDtLIYroAKCILIs64dRI nRQYHxSsvUL6VtS/fXoS62fWrDmBT4L3zz01r4cZMA3gUJ2thP37j/wlxT5H6ThQt0vs FrnBvWQSWnVlXEZuSDt2+fa4idUZshoLIFZHYRwHplQCaKvyrYrelEsbFqe1DJpCNj5B IyFJhZllupTQ3CHO3i7EERPB9XFNgtd5o3Zh7RglXJz725gMnvmUa0qpRhyIn4kCfHT7 sKXHEi+849MIqvqJlSI8ACZ94+9AxzmScm951uy4GkQ0DAGepsq89i/TnLuRpvEyj4Eo RRNw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=L3bIVLdFu05HnfuoTvfDbi+UIkx3d5VeT89BC3hvdGc=; b=GjLwjfFx4p6F6x46GkYU7ajkdYviN+ME4T/OmVJTm1Zbtw9dNddZIaejfcgqD8axOY bpgRxpFivZG9RpX1pGc+SDYs8yMWysbfr2eXNUAzqSbMj1cAfKlBpm5sfffFTkV1092b TGsvHD8x012z8Lm7LmildLgQExnJojpg8XX+11Gurw6JuOcUN2ZzWqhlH/yJ4tpEf7H9 RitlYtFVklv10ymz2791InVTP8mQEvUqiUtaROF+vC1xHahPAEPoqOUu5X7o9tCg5XKs PGUkm8wb1rAogz5nYICKfYX4Lw92GHPewu/EdbrrH3pb96JOQRaf/Jxm5aOPAVfg1sf/ jTwQ== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM531vgKgrji2Te+7WxFag8uNF29UBzvLOIz41IUlZh7CpDUDjfhkR Lei5qsL8vJ4FBUE3sFRagTs= X-Google-Smtp-Source: ABdhPJz7Xu5MHwVt4jJI0QP9PPJui0wML5l/LDUTl2ribV9An6Jja3dPH1vUuGlC8ulkcrAWoqEKaA== X-Received: by 2002:a63:3448:: with SMTP id b69mr360447pga.269.1601916813043; Mon, 05 Oct 2020 09:53:33 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a63:d4f:: with SMTP id 15ls3453831pgn.3.gmail; Mon, 05 Oct 2020 09:53:32 -0700 (PDT) X-Received: by 2002:a63:c20f:: with SMTP id b15mr415673pgd.8.1601916812264; Mon, 05 Oct 2020 09:53:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601916812; cv=none; d=google.com; s=arc-20160816; b=0NMVWOsKDJSrRFXtoJJWTt1mHeXdNmIjyx80yh9IBHlGRJe9dTc+8UE5G903Z5yn6z CcdJwTzimlRXUThSnFQ2TAV35cdkFpfYgqLYMmtIsDIC1NdeYtUFJ5Sm3ooN6sbJMyYP Ch9oob3Zt2uty9cstHdo/bHM4Mc8omlzxCFKZ7ja/M9WMkBN5Na3j9iTG7UVAVICuE/o CaztGEIF3Yi2BPyKgzIj7bMpGBwynb3WVkt/bELcMaj0LjkyLYvKPVMXXiffEuauM1Bc HCfkaZivhslwJZa5QIQOamfI9Y0OX60kUyKBxevrNXygBDuuT40B5KSAAjFXEw8CdF5K euyg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:subject:cc:to:from:ironport-sdr :ironport-sdr; bh=vJH08HiDKgt88rBWQMezVp576tRzw4Vr2IqPjNyRXos=; b=ODuCDnZwzxQ2R6L7DluISSftIEarLw/xBvu0yEZrEI7gegw+V/59hdIoVK81+5GlUT g6M2NvUJ/oXZsTSczeXb5uo//jpupd0TuxvCX5tLL/B+j+MrbsJawGS/2Ykm2BaynYrF d9bqKILc/XqHFWQZY0UypLhKWXzayB1EWZGZc216JGW2/R7ETC5bdSAEmeu1/i5XWuKP Vh9dCwehINXtDwaUEAcz0WF8XVOCRp6ZBAMNXgFi1mIGqRqU9KBms7rEVGoo+Wyhg7xS Lp2jXtRyi2U1PerLy95UETNKhW911kmwgFcWQR3YzSWeIhnWpP3KkjDdmOWPCSgn8Ia7 ZA4A== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa2.mentor.iphmx.com (esa2.mentor.iphmx.com. [68.232.141.98]) by gmr-mx.google.com with ESMTPS id mj1si11184pjb.3.2020.10.05.09.53.32 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 05 Oct 2020 09:53:32 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) client-ip=68.232.141.98; IronPort-SDR: gzZgn1f+JPaCBbfYFuAk0W37FSv+XnXjYIwZOSaJP9uXycahwRqv5MHEe7IpFChHYDH+KabVzQ PtZKk8Q15o9EF6jONySePDsn5rzh6H5rWyeWCTn6rIswRx1w6XZ59onD9cRXmoTLdZF8UAJnaJ O2dUhBOXI2i63lb0CCVYUulshiUOfacnxYbHUjysk0hrHiG2GGpALhZtojb5qyvX3r7MvWeenX XaVSXF4CLWIXwpUzvSFTQkIthKj6EavacKpcokIsH7Zc/iE5VR6pkYY/AbCghgDNezosOaSI05 yuI= X-IronPort-AV: E=Sophos;i="5.77,340,1596528000"; d="scan'208";a="53645364" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa2.mentor.iphmx.com with ESMTP; 05 Oct 2020 08:53:31 -0800 IronPort-SDR: 4DPtsF1xEvI6tGAq3I3VfMTBo6IJ79Evg1gLwxFSX6AuZj8S+c3lqWBMq1g2CAbIchX8mWKb3v 4Lxe8dIJTGNLtQm7tZEz9WoLtfihFGFJfWk6qqGE6ez3oxHfYeVzzGC6PWbciFuYybqVP6hGJG 4STdBHTbBiMLNhNeb4mb9aNx+afEP6u9ZmznlGrnmOC82+HMi99gBiR4ThccUr3938dkGu+JFT mOaRL3qz+IgagWxKEz/mhwYlj0ERURK5jOGPEHP5+owlUONgGaDGpPrY8N3U839bMmWQPjZLZD 92g= From: Vijai Kumar K To: , CC: Vijai Kumar K Subject: [PATCH v5 0/8] WIC update Date: Mon, 5 Oct 2020 22:22:59 +0530 Message-ID: <20201005165307.14668-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-05.mgc.mentorg.com (147.34.90.205) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1679731524702706874?= X-GMAIL-MSGID: =?utf-8?q?1679731524702706874?= Changes since v4: - Rebase against latest next Changes since v3: - Rebase against the latest next. Drop P4 & P5 from previous series. - P7 fixes the kernel update in legacy bios boot image - Minor documentation changes. Changes since v2: - Dropped P9 from previous series and updated oe-core to the latest revision which includes that patch. - Some minor commit message & API changelog changes. Changes since RFC(v1): - P9 commit is upstreamed and replaced with the version from OE-core. - P10: Lot of downstream projects tend to use /boot mountpoints for bootloader/EFI partitions. Added RECIPE-API-CHANGELOG entry to warn user about potential issues that might arise when doing so with latest wic. Vijai Kumar K (8): wic: Update to the latest wic from openembedded core wic/plugins: Fix wic plugins to work with the latest wic wic-img: Satisfy the quirks of latest wic wic_fakeroot: Handle standalone pseudo invocations meta-isar/conf: Add provision to debug WIC debian-common: Add tar as a dependency for wic Fix legacy bios boot partition meta-isar/canned-wks: Remove unwanted /boot mountpoint RECIPE-API-CHANGELOG.md | 26 + meta-isar/conf/local.conf.sample | 3 + .../lib/wic/canned-wks/common-isar.wks.inc | 2 +- .../scripts/lib/wic/canned-wks/hikey.wks | 2 +- .../lib/wic/canned-wks/sdimage-efi.wks | 2 +- meta/classes/wic-img.bbclass | 20 +- meta/conf/distro/debian-common.conf | 3 +- .../wic/plugins/source/bootimg-efi-isar.py | 2 +- .../wic/plugins/source/bootimg-pcbios-isar.py | 40 +- .../lib/wic/plugins/source/rootfs-u-boot.py | 2 +- scripts/lib/scriptpath.py | 32 ++ scripts/lib/wic/__init__.py | 14 +- scripts/lib/wic/canned-wks/common.wks.inc | 2 +- .../directdisk-bootloader-config.cfg | 8 +- .../lib/wic/canned-wks/efi-bootdisk.wks.in | 3 + scripts/lib/wic/canned-wks/mkhybridiso.wks | 2 +- scripts/lib/wic/canned-wks/qemuriscv.wks | 3 + .../lib/wic/canned-wks/qemux86-directdisk.wks | 2 +- .../lib/wic/canned-wks/sdimage-bootpart.wks | 4 +- .../lib/wic/canned-wks/systemd-bootdisk.wks | 4 +- scripts/lib/wic/engine.py | 421 +++++++++++++++- scripts/lib/wic/filemap.py | 170 ++++--- scripts/lib/wic/help.py | 401 ++++++++++++++-- scripts/lib/wic/ksparser.py | 121 +++-- scripts/lib/wic/{utils => }/misc.py | 100 ++-- scripts/lib/wic/partition.py | 234 ++++----- scripts/lib/wic/pluginbase.py | 36 +- scripts/lib/wic/plugins/imager/direct.py | 175 ++++--- .../wic/plugins/source/bootimg-biosplusefi.py | 213 +++++++++ scripts/lib/wic/plugins/source/bootimg-efi.py | 171 +++++-- .../wic/plugins/source/bootimg-partition.py | 153 ++++-- .../lib/wic/plugins/source/bootimg-pcbios.py | 91 ++-- scripts/lib/wic/plugins/source/fsimage.py | 56 --- .../wic/plugins/source/isoimage-isohybrid.py | 185 +++---- scripts/lib/wic/plugins/source/rawcopy.py | 44 +- scripts/lib/wic/plugins/source/rootfs.py | 159 ++++-- scripts/lib/wic/utils/__init__.py | 0 scripts/lib/wic/utils/runner.py | 114 ----- scripts/wic | 452 +++++++++++++----- scripts/wic_fakeroot | 5 + 40 files changed, 2434 insertions(+), 1043 deletions(-) create mode 100644 scripts/lib/scriptpath.py create mode 100644 scripts/lib/wic/canned-wks/efi-bootdisk.wks.in create mode 100644 scripts/lib/wic/canned-wks/qemuriscv.wks rename scripts/lib/wic/{utils => }/misc.py (70%) create mode 100644 scripts/lib/wic/plugins/source/bootimg-biosplusefi.py delete mode 100644 scripts/lib/wic/plugins/source/fsimage.py delete mode 100644 scripts/lib/wic/utils/__init__.py delete mode 100644 scripts/lib/wic/utils/runner.py