From patchwork Wed Oct 14 04:27:21 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 142 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:e04f:0:0:0:0:0 with SMTP id v15csp550094oos; Wed, 14 Oct 2020 06:27:56 -0700 (PDT) X-Received: by 2002:a17:902:9349:b029:d4:df10:353c with SMTP id g9-20020a1709029349b02900d4df10353cmr4318282plp.20.1602682076465; Wed, 14 Oct 2020 06:27:56 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1602682076; cv=pass; d=google.com; s=arc-20160816; b=o0LeG0xo2w2d930qDK6PziAPpJgwP4q0tXwYOZny89wJY0vi8w4n07eZFquW++qMV3 9oyxPeJCU+3pB5poptMVo11FjHaqmbOf3VzzIbfl68T3MeCKMluI3SCvsBB7ph4vc8Zj k4wPdIbmXzLzjgtuSfLZnM+AJ+beEBZ6DXIqMghWzozx9vZdnuwR9Eya+JV8KqvTG6JB qS43DcMBT7OgUSkbSRakzerIww+jiZa9gyf7e5iTWLSg3ecGKQCFi1Me/NFG2JxRRjzm tDNSboO0Q6rG+5gB3WlVweZCq/XVMbb46LMK8EwcvOtfv3cd4easAe3x5nl+LugB6zw3 Qc5A== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=VlJhXy4yKW2VZ1k+JnniDV+XbxIIdXL7pl6PhMfaYbg=; b=wiuUkAySNTMpFmxv7ry/0y/TdM1uh/O6V63FChUCYyKKZcjIyaEid72Tl4FgcaBbz7 mIDMdKweA0yEsHCq8x2Qw37TNIzf6WVG3gcyQlONX/o6t9cksezSjBtuTyVYqKiUsQGc sAqirALyjQoIzBMMeh9qWXr1XfZCTLsLngJ1L3arihSV2Gp3mMH0LmDgKv1TwZsosKlF O0oS4tebiJNESMWMHe3LOr1WP7ELzbSbkqH1xN1LmSIgymSSlOZ2tlX4aaAXZLkpRTEr cJw18zQFqf7dRLM6hpHclCWgBQ7NYsXE+ovm0aoxGt5G2hNCUycUE7psHHZy3U+Qmdvl tsCg== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=qQe0b93F; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbw7ztp6akgqecsrap2a@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBW7ZTP6AKGQECSRAP2A@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id it13sor1434265pjb.19.2020.10.14.06.27.56 (Google Transport Security); Wed, 14 Oct 2020 06:27:56 -0700 (PDT) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbw7ztp6akgqecsrap2a@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=qQe0b93F; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbw7ztp6akgqecsrap2a@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBW7ZTP6AKGQECSRAP2A@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1602682076; cv=pass; d=google.com; s=arc-20160816; b=GW2wLaQd1oibl4XmM5PoOmB9wJmbCTyiKAG/nP08ROfNX4t+JBK3PmeCGYudzV6q/J ZCWw5fVFLfe3LsuZX3FPoiwpgk2eztp6iYqYVrd4vARXiC/avAAsO25i+ayl/nrd4yd9 f1/NNAJeYISylZWIIBuIuH1BdRFQtlMJqfVtN5MH8r/lF+mUZkjcCWS8+fKaHtYsZgPB PtZE0hKEbgMrrtyJ2A2SBQjvDsSFUjeNv4Mfq/KeDEFmg7Im1lm1QpiuOgxp59xYQjyM L6zYf8RVrIWsRevTB4DSSXDvtVcoZvq3rS+KSrIn7uKgh3Qn/TPWBCf8W6aQt9dWiv7H Oyfg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=VlJhXy4yKW2VZ1k+JnniDV+XbxIIdXL7pl6PhMfaYbg=; b=G0dmFZB5/vf7CWK0Ruq1PQKea4yYc0yugoqMkJg5UukjbXHlwnPX8dWvpI17QRw1YN vhENu1PbrDQo4sZCMnQFJsKUltJs2aJX6jYLijbrxey4OimGDAV3D1ggOc29ly1AK/0u f94PkjShvzNTSni6Kbkz3m1BmaHyNNgy890uH3nWUY1/CjQ2z+eUksraVnEoOyXvrtKZ vueOTAIX2RCZelcEvqdd7QrDAJCHz8zQkTyEqjKmBdaHVHwtiYzScTfbN/72h8ezOmbu 3IS4Cp9G2hPO9bQ0/nV+x7aJuBj9Ayg4kJfcxfyi1D/bJ58pigR2YvgutdezVirvcY5B 4ruw== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=VlJhXy4yKW2VZ1k+JnniDV+XbxIIdXL7pl6PhMfaYbg=; b=qQe0b93FtJw4FO0YDR00/vMTVAYb5IwVp2hjBhHwvHkjlZ4LYiQE88hEnCbTYYxrly B1NeE9xbKw4Rfy528xmBhNqLybRcjxG7HPeVo97qvDqcKJ5TtTp8uYkulVgDkZK2gLtY nGvCK8fXLdfTkQ3IhmW59xXd/DCcLOs1QmfnWRHuyMMthhpu5aaaE3YvYQhxzWAajchK nrLfGKWWp7vIOz1gUGaSO7VaWVEQvlx81+UQyzQDNZpPDXxszXi/RNaoFWLyb+Zt53ew MtW4e+/eriPOE9Ze7GiOln+MU4RkgCsNABGMsWGDrHSWcOrhL8pxIKTmWFsPXVQ+xx01 TF2w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=VlJhXy4yKW2VZ1k+JnniDV+XbxIIdXL7pl6PhMfaYbg=; b=W9Mo7XEt1AMeZ+6J4oXyS3xEJnR8IV3DPxtjrr0vAx9piiBrtmXhnuWZETsoTp9qCE AemdpxBUGhPMFBo0eh4llDMd1DKfCrz16124cQ3+9W9hltQ487hPpFjo160cxUGa8jlY rrKUd6DCyu+0M21rL9MBRms6V6+a+mrn9XTDPG26QxPgFtDxVynWC3lIsIbaFJgI3H1V bHWn4DAwYNhbr/K2rpXIYy3GL4+JSDSgdRoQFyokPJgtCE6M4wPtk6nGBLXG6I0g4gYI imHoQLzv3e9htwO2qst0gCZKvz3nqKtb+WJYqJK3ukbIQDvZNP2Fimka5GDGomgxObnH R82g== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM531JCjTXYrW7O5uGnHyt5X0isyoCMmkMGD/Y4ABo1kKfulJA6mCT KVhzfQZUv3lCZLA0Vt4xBCE= X-Google-Smtp-Source: ABdhPJw8RvkyPrVwihfb8PbMKGtp/9cK7CNpnRMkZe+M9yjXgWj8fC3+rR7XtD3CrRBp5AokINN9Fw== X-Received: by 2002:a17:90a:7c03:: with SMTP id v3mr3480618pjf.233.1602682075820; Wed, 14 Oct 2020 06:27:55 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:90a:bc0c:: with SMTP id w12ls1375737pjr.2.gmail; Wed, 14 Oct 2020 06:27:55 -0700 (PDT) X-Received: by 2002:a17:90a:d596:: with SMTP id v22mr3726442pju.146.1602682075127; Wed, 14 Oct 2020 06:27:55 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1602682075; cv=none; d=google.com; s=arc-20160816; b=mvzHbvLWrQPk1uw4fyTwuhRTTcqppEoSqcyMJFA4iFbwusqZ333xGXld+h1Pr5RJqX gNuzYi5etOYXKLMBSm4F5aL9WDBsAYyJNqW145OJ4KjRQVcBjTVjenmJ8S2r3FImaufK bo6MLNGzALB+10I52FAbURc6d6vug/IoEb1mQ8Uv0QeMEO585xNsDil+KwPUl1euIiID OhjGMZ7kCP0b0zHira4gy/7VpO4c4nPnati9ZTx9augju8LDxc96WMFp4N+ar1/FC9q2 GFMmN3TYJdzqGISKPd3Fz8ywKyGI7kZ4iRL8x5SDBYaXKGN9O28vtILvXFD7nwx44rdG bT0w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:subject:cc:to:from:ironport-sdr :ironport-sdr; bh=A3uXPmVrDWuZxYb5tcXJkpXg/yUneznlDVVoKZwavCE=; b=zUeftgmB1pBlkwe11JtMEqPSaXH9GGDks64lOEf7VrfvbJE2WVcmCsIKSogb7JhxUR 7jwxxaTcTQiDjr3eq7Z8AIovbHnhzWcvTKamfZHoU1v0FZV1y4Km0iDum0SEshHhdimF wD8ndxHJMEnsZLZ+uUYRS5r2lAVGgC5Gk80Qzq9Me2ZdYWDBrPUVws0nH6UsV3jABL2q 2Mx5aHmHw/K27C27Wyk1p6eAzzqAwx2xaEioLJLaA8mDm8+Bp7P+fle5GOLMLjnzOTOq zZQAmv2KayKvZEXp6HdZzAw9eg9tLVD9mdHOrrviTA3pWNha29LAtGtsD0YbLrufu0kD b/jQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa1.mentor.iphmx.com (esa1.mentor.iphmx.com. [68.232.129.153]) by gmr-mx.google.com with ESMTPS id q2si205685pfc.0.2020.10.14.06.27.54 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 14 Oct 2020 06:27:55 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) client-ip=68.232.129.153; IronPort-SDR: 5dlG1YxGZVU52TjtjKvzIip9YuxRFXYnjnKpEp8913GH1Y/d+PEGBqFkIpk0uztmbYh7mSPqza 8JDFvoitxbLXvuIC5TFlCsaLb/4wHs3qilCTf9onmIxitKmM5T0PYfUwWzDxAw3Iwr/TZuNbWv 3peejOoEzHCh6GzGXWpw/bvS8+HKq7NRGfAyVLMQJNdytNZIj+qYzn78xzwhegSsGrD+9i2Nds KNGTBpeFQWt6PTT800icUOfbsqxo0OnRJFFaceAsEHYiWmIfhFjsv0uNjHLFlXomfcVC0w9QI2 pcQ= X-IronPort-AV: E=Sophos;i="5.77,374,1596528000"; d="scan'208";a="56199986" Received: from orw-gwy-02-in.mentorg.com ([192.94.38.167]) by esa1.mentor.iphmx.com with ESMTP; 14 Oct 2020 05:27:54 -0800 IronPort-SDR: vnVoicIANmZchTt4dAFXLzntNoHwMbXjeHXTEOrLqPvoZF9Ofe5nuWQ1qxtKgycy84fsNiBJEA XPyQs634s3jlBqLfjM8H7zt0i2PRkrWVaGMb0BTQmRoIUWeYfcQPMGMASRuHQoCe8lNRLCIUIn 5LimD7pYONjO+e9HuDsvtjSm2KSOdA2k9RQnUdZKE4INKUdDvDN3oWBn5Qw0aCgae8DmWMc3kG +k5L9kbBm+pLL7Uttl/KKEvMUtxJ2CwdnOacHOoGw2JvwcsnfIjiq5mVbWZUEFv1QSXOImscPI c0M= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v6 0/8] WIC update Date: Wed, 14 Oct 2020 18:57:21 +0530 Message-ID: <20201014132729.18571-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-09.mgc.mentorg.com (147.34.90.209) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1680533960881415115?= X-GMAIL-MSGID: =?utf-8?q?1680533960881415115?= Changes since v5: - There was an issue in rebase of v4 in P3. Fixed the conflict properly now. Changes since v4: - Rebase against latest next Changes since v3: - Rebase against the latest next. Drop P4 & P5 from previous series. - P7 fixes the kernel update in legacy bios boot image - Minor documentation changes. Changes since v2: - Dropped P9 from previous series and updated oe-core to the latest revision which includes that patch. - Some minor commit message & API changelog changes. Changes since RFC(v1): - P9 commit is upstreamed and replaced with the version from OE-core. - P10: Lot of downstream projects tend to use /boot mountpoints for bootloader/EFI partitions. Added RECIPE-API-CHANGELOG entry to warn user about potential issues that might arise when doing so with latest wic. Vijai Kumar K (8): wic: Update to the latest wic from openembedded core wic/plugins: Fix wic plugins to work with the latest wic wic-img: Satisfy the quirks of latest wic wic_fakeroot: Handle standalone pseudo invocations meta-isar/conf: Add provision to debug WIC debian-common: Add tar as a dependency for wic Fix legacy bios boot partition meta-isar/canned-wks: Remove unwanted /boot mountpoint RECIPE-API-CHANGELOG.md | 26 + meta-isar/conf/local.conf.sample | 3 + .../lib/wic/canned-wks/common-isar.wks.inc | 2 +- .../scripts/lib/wic/canned-wks/hikey.wks | 2 +- .../lib/wic/canned-wks/sdimage-efi.wks | 2 +- meta/classes/wic-img.bbclass | 18 +- meta/conf/distro/debian-common.conf | 3 +- .../wic/plugins/source/bootimg-efi-isar.py | 2 +- .../wic/plugins/source/bootimg-pcbios-isar.py | 40 +- .../lib/wic/plugins/source/rootfs-u-boot.py | 2 +- scripts/lib/scriptpath.py | 32 ++ scripts/lib/wic/__init__.py | 14 +- scripts/lib/wic/canned-wks/common.wks.inc | 2 +- .../directdisk-bootloader-config.cfg | 8 +- .../lib/wic/canned-wks/efi-bootdisk.wks.in | 3 + scripts/lib/wic/canned-wks/mkhybridiso.wks | 2 +- scripts/lib/wic/canned-wks/qemuriscv.wks | 3 + .../lib/wic/canned-wks/qemux86-directdisk.wks | 2 +- .../lib/wic/canned-wks/sdimage-bootpart.wks | 4 +- .../lib/wic/canned-wks/systemd-bootdisk.wks | 4 +- scripts/lib/wic/engine.py | 421 +++++++++++++++- scripts/lib/wic/filemap.py | 170 ++++--- scripts/lib/wic/help.py | 401 ++++++++++++++-- scripts/lib/wic/ksparser.py | 121 +++-- scripts/lib/wic/{utils => }/misc.py | 100 ++-- scripts/lib/wic/partition.py | 234 ++++----- scripts/lib/wic/pluginbase.py | 36 +- scripts/lib/wic/plugins/imager/direct.py | 175 ++++--- .../wic/plugins/source/bootimg-biosplusefi.py | 213 +++++++++ scripts/lib/wic/plugins/source/bootimg-efi.py | 171 +++++-- .../wic/plugins/source/bootimg-partition.py | 153 ++++-- .../lib/wic/plugins/source/bootimg-pcbios.py | 91 ++-- scripts/lib/wic/plugins/source/fsimage.py | 56 --- .../wic/plugins/source/isoimage-isohybrid.py | 185 +++---- scripts/lib/wic/plugins/source/rawcopy.py | 44 +- scripts/lib/wic/plugins/source/rootfs.py | 159 ++++-- scripts/lib/wic/utils/__init__.py | 0 scripts/lib/wic/utils/runner.py | 114 ----- scripts/wic | 452 +++++++++++++----- scripts/wic_fakeroot | 5 + 40 files changed, 2433 insertions(+), 1042 deletions(-) create mode 100644 scripts/lib/scriptpath.py create mode 100644 scripts/lib/wic/canned-wks/efi-bootdisk.wks.in create mode 100644 scripts/lib/wic/canned-wks/qemuriscv.wks rename scripts/lib/wic/{utils => }/misc.py (70%) create mode 100644 scripts/lib/wic/plugins/source/bootimg-biosplusefi.py delete mode 100644 scripts/lib/wic/plugins/source/fsimage.py delete mode 100644 scripts/lib/wic/utils/__init__.py delete mode 100644 scripts/lib/wic/utils/runner.py