From patchwork Wed Sep 16 06:50:13 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 49 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:eb04:0:0:0:0:0 with SMTP id f4csp517574ooj; Wed, 16 Sep 2020 07:50:45 -0700 (PDT) X-Received: by 2002:a17:902:ee54:b029:d1:f2ae:e2 with SMTP id 20-20020a170902ee54b02900d1f2ae00e2mr2076078plo.3.1600267845341; Wed, 16 Sep 2020 07:50:45 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1600267845; cv=pass; d=google.com; s=arc-20160816; b=ur+yWaKTrKErsmiKxndqo7pPdLx8/w1wxv38KfYVb8vCQo2Ku6eKNEic01ghreKLT6 h73yx+6+UPoMhWt+jChYwMnRp/eGJ0OdATcy33z0sLN/r4H3zH224C67os2HGZu41CUQ +SL7keUnlF2z07wuobto+Ha7rvWV1pszk+Uk0lMfULMKIPBz5Z+Poat8at6Sh4hO/Q4l Iv3Y21e3rc5nNX3U6DUSYoL+OQ9F4+uGq9xJv3zFuxPQAg7YiQ+xYer6N5e5RW5ACRFa t6MMwRquIDnL1IjDW2RHYLGtvZ2CuXQft9EYyFEq/1ROqlXnGPa9FhZhKUwYGyNyOEe5 e8dQ== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=WWyQZ/Jxnor9FBABulp+se3czbe3/AQgDvu10KhBlSc=; b=b7pQtq2JXrJZo23aiZ175yOelCZQ7L13A62VkuVI9Qgf0M4NKEr9KUSMK0mICPzoXq S9cxLxbMfzaep/zZBtjI6KPPiVkirsBUQ2tIjrekxgu4BZphc/d4DrMzg1EfU7xXyS3T 875ixPSEdWqMDX2KSiYn62WXoevvSjVjp46vP0TpZrzrET2GR3RvSzAx+pzmt+831Igr +4p9h/iUoKp5qVwAUgX+L3hNxRcUeDzQ8XLlTujv8EgCkmIIsl1NOFFZnJrfJKAAkebh 2rcPGhmWY1F1hV1LmDrxNBSLss82ATsvhUw/VAj4jptRkw9WNj+o7/Euv85figiaVvrO 78GA== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=sn1aromq; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbrgmrd5qkgqeyfzznsa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBRGMRD5QKGQEYFZZNSA@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id i7sor1728101pjm.35.2020.09.16.07.50.44 (Google Transport Security); Wed, 16 Sep 2020 07:50:45 -0700 (PDT) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbrgmrd5qkgqeyfzznsa@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=sn1aromq; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbrgmrd5qkgqeyfzznsa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBRGMRD5QKGQEYFZZNSA@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1600267844; cv=pass; d=google.com; s=arc-20160816; b=epeOXoXqSZDhUQzMVAUtGJRazWQg6tAxMLirBlN32h8qwtclH2zswNCzWjexrxdCP1 EpjzVqTPpajRmEewkLu/sewSCWcGrzVKe3o82b8VGSCRvINwNk5PpqxgAPj/eEv5fPYK DZ6ufNYmE7rkXrQH/+Y63XK7KtMEGtQ77ccIZi7n2fHwYvLNnfQZ5oQVZS/5uRYAj78+ zcNYVW78eE97OU41KcuUV7mrKLLfyVR+54M41Dfg36igjM2VloEH+VRTwCD7xxX0+uD5 y5iUAcPv8oZlYAZyJ7G0w6hTRU6Zm/TAdk2MN89zrzL3a1Lj4cgB3EHcAsD6D9Uk/Em1 1XfQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=WWyQZ/Jxnor9FBABulp+se3czbe3/AQgDvu10KhBlSc=; b=GWaJ79AS0nbQuyAyWXcvo0FWKqm7BR4doLw/EFWMspdaU5rtfSoA8xyP74+hE9hWDm dqiYH8asxUnbndw0WCz9409J14OmoLesDEgjrrI0iJv6SU4VF1kaPFhcRQNgGeH8C5Ag Kh+MLVMFtlCs9OOWRy7pAasD2jcZGObe0/v9Rzc7fkdLS4PlwSytwcSqkLpR4MUgHH8b PhI1PXVhldzUk6B7Pusvh1FuJXZaEnwSxikvc8kwkXk+aWMnhe3rWlgcR+FbugMu7JFP 07mclVcs9KxWZWqHHeRwTleEHSdjtqOLKEY/Jrhmk1pwJEDqmqCncFk1ilGMcADfP46i nuog== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:subject:date:message-id :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=WWyQZ/Jxnor9FBABulp+se3czbe3/AQgDvu10KhBlSc=; b=sn1aromqxp1BPSjDOBU6i6cYKXrPYbw0WEu4Temm/gmq6s1YAoAn0AvZfBwaSToJ77 OOoRxG4huZcCGRPahAEwBegOcF8B8x49SelRa0oHlltq3+NYpTyeL7YNbIwsIFchE9Yj jhkiwRjGDRz8vlP8yqZzUirNibU9UTkMl5Bsg3ka1Uc6oQnw73HKSSaq1aMmXKKuJHWU NCNs4xYrcGK8xkcTiEcdswBro5RrEKNvYg5VBDV63Fu1q07rTvqWE1yCsggqzx+BpEC3 xoB4tde1LKBPE+ihT6KkGCoyvEEpaKKQdz7tcdL08E06Pjz6mFQhkxZpOOlhLgFtyQ+3 5DHA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:subject :date:message-id:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=WWyQZ/Jxnor9FBABulp+se3czbe3/AQgDvu10KhBlSc=; b=bZVOeFhqB/4WaGPWnf/dPhMLS0AAYDncdP5Y5wvXWzAKpymRBllF9+eG5AmvgsHeWW XPGSU3mWI6LuV0tkwoA2JuMYfB84HUJ9htomz6WGajYu4hr9rtRsAJArMkM1fNGhpxiJ eKJd48QXCUgk0rSvjymxh9P1IvSNVI+KcO11a5o7Pno/BxZtknV4qyzH07A5/5ibe/nq PPpYNMkqONk4ODhafqlPrHILDVkxaNAuB7xOgx5/+uj/Zap4ogUitOthGy8/lWSUpezy AX4Gu0616UccFw/OnoTZnCAX2JQDcYgawCpm56O5vo9NFGTlXcAg6P5nQ9evXwUCPiSI LQEw== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM533jjUxMoX5SLqDpBo3lsinxSLbPFjM0hr2aLV9TP/X17MW9n5Xs UXxsPw0/qEoUaWKQqqVhtJo= X-Google-Smtp-Source: ABdhPJxuXz4DbFNCNFsMy/ukWBfDSqsM7qF0ECcu2lJOgKxjpwcHtM5uVAyJUqNc78T8+b2RrzL1mA== X-Received: by 2002:a17:90b:1649:: with SMTP id il9mr4242662pjb.94.1600267844758; Wed, 16 Sep 2020 07:50:44 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a62:6883:: with SMTP id d125ls860871pfc.8.gmail; Wed, 16 Sep 2020 07:50:44 -0700 (PDT) X-Received: by 2002:a63:f90d:: with SMTP id h13mr18757700pgi.227.1600267843984; Wed, 16 Sep 2020 07:50:43 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1600267843; cv=none; d=google.com; s=arc-20160816; b=jkUNfa6e1EJiJmNu3YjVnx6AnE6aZU1MEXKZqBvE0x//9Yb7b3e858aiTPuOfyUaGb ycB0Q3u/eV+vbDh6flHw0a9taSuXBbt6DtUuzlo/IwSe2ySxXm++kOzz1GvsZkejF21i zro9lFoEr8w43uFSgUT0UaB96CVRassjQ43GtoOKv6PKKafkt3+r0a+M9FSmfC4RiIHw eRi4MBsQwT/i56sGuPh6jWz/GUoTaqm9f0lpzyuteQDOsRHLSfImEc5IbuGyuMKks6Ka LDCgmn5crc5Z/zF5uJPvIbPcqESXSxr28gbeDsxKX5FmFQGfpRHYHSpC46mJb4kuKX9R Sh6Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:subject:to:from:ironport-sdr :ironport-sdr; bh=ifrVqb26Fa3yP9zWzlVoFTyOF9vQNH5whNiNlFlchm4=; b=qsr9Z5cgbChar6C/DAYSqwbrUzmF0sl2GOt8FZVtfmXg3Khe1k/pC7Xp5Be72jjxeY iNhF4YYOdK214aTbpeFyi5mXK9vAOoojPOEM9OC3mg+hn4Xlu3xjm13lNT+APRUADYob +bhsMu84NVI2erRSNcY71U3byWGEuxB1wnOSwgKVoFW2p0/sCG9HUXWGEkVNgrV3Epfx ZE4ycV5ZFkurrb7MFkSGrS+fQ1LkAY8bBWnOvr0ID2sdT4NBXYSJtTUlP57YJsuMo3lu QVLYp8KMnsgjx1NTS+3PRBVG7F8UMvyd2d7u+SY2mMrT7qqCXzugbG17dcI680sB0OBZ cbhw== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa1.mentor.iphmx.com (esa1.mentor.iphmx.com. [68.232.129.153]) by gmr-mx.google.com with ESMTPS id w15si320460pfu.6.2020.09.16.07.50.43 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 16 Sep 2020 07:50:43 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) client-ip=68.232.129.153; IronPort-SDR: 37qHj+4ehCjQHr7zCmRDuvYvmP6WOXCjHcizF0dEgATcoeZGtGiqps+ArPVBoTJ5JPZUEjqY00 YpoE4H3OG04Lh69neEZeZSIvTi6qCwEceswLat4PHf/D3wLbf90F5anBQUQLcCk77Kd9QvJrwx NCOZgBrUXgm2RCHZ2DsxmbxdH9hccY4m618xNol2OW11EPNSOw1c9+S/60K4VipcQx9N4R32yn y1x3kdc2YUQQwV5dgScsFQ8trYXcKBUuEPiosblH53OgQPX35Eszluk5WG2gaoN//MNc602eRR jX0= X-IronPort-AV: E=Sophos;i="5.76,433,1592899200"; d="scan'208";a="55173141" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa1.mentor.iphmx.com with ESMTP; 16 Sep 2020 06:50:42 -0800 IronPort-SDR: 3iCn3YB7AjclYYHHcOWg5sRWuyWDlK4/taZfy161zVi52j+J2wxUT+d3IM78BUVlKrCa58vSop 2FggjN1JtpCvVJJXivqNlNdxdnzjJQec1qh/uYUsP82Z/4VkLNBxjypbLuBqTI8QdXpvgotNSN 5mLlxOf01XfH7qISY9rQ6tmk+dpGcZPZNQ/63lOQAnNxv1eqh3dtPVIianiyQfltSxQpaJjOTY lMhylUIdVgDYkBICRUPKnFNIzfPsVq45qVwDjQKuTQdoo/4Yru2bfQfziukprJZ/3lgpCB1Fz+ zf8= From: Vijai Kumar K To: , , Subject: [PATCH v4 0/8] WIC update Date: Wed, 16 Sep 2020 20:20:13 +0530 Message-ID: <20200916145021.5856-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-06.mgc.mentorg.com (147.34.90.206) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1678002456115034755?= X-GMAIL-MSGID: =?utf-8?q?1678002456115034755?= Changes since v3: - Rebase against the latest next. Drop P4 & P5 from previous series. - P7 fixes the kernel update in legacy bios boot image - Minor documentation changes. Changes since v2: - Dropped P9 from previous series and updated oe-core to the latest revision which includes that patch. - Some minor commit message & API changelog changes. Changes since RFC(v1): - P9 commit is upstreamed and replaced with the version from OE-core. - P10: Lot of downstream projects tend to use /boot mountpoints for bootloader/EFI partitions. Added RECIPE-API-CHANGELOG entry to warn user about potential issues that might arise when doing so with latest wic. Vijai Kumar K (8): wic: Update to the latest wic from openembedded core wic/plugins: Fix wic plugins to work with the latest wic wic-img: Satisfy the quirks of latest wic wic_fakeroot: Handle standalone pseudo invocations meta-isar/conf: Add provision to debug WIC debian-common: Add tar as a dependency for wic Fix legacy bios boot partition meta-isar/canned-wks: Remove unwanted /boot mountpoint RECIPE-API-CHANGELOG.md | 26 + meta-isar/conf/local.conf.sample | 3 + .../lib/wic/canned-wks/common-isar.wks.inc | 2 +- .../scripts/lib/wic/canned-wks/hikey.wks | 2 +- .../lib/wic/canned-wks/sdimage-efi.wks | 2 +- meta/classes/wic-img.bbclass | 18 +- meta/conf/distro/debian-common.conf | 3 +- .../wic/plugins/source/bootimg-efi-isar.py | 2 +- .../wic/plugins/source/bootimg-pcbios-isar.py | 40 +- .../lib/wic/plugins/source/rootfs-u-boot.py | 2 +- scripts/lib/scriptpath.py | 32 ++ scripts/lib/wic/__init__.py | 14 +- scripts/lib/wic/canned-wks/common.wks.inc | 2 +- .../directdisk-bootloader-config.cfg | 8 +- .../lib/wic/canned-wks/efi-bootdisk.wks.in | 3 + scripts/lib/wic/canned-wks/mkhybridiso.wks | 2 +- scripts/lib/wic/canned-wks/qemuriscv.wks | 3 + .../lib/wic/canned-wks/qemux86-directdisk.wks | 2 +- .../lib/wic/canned-wks/sdimage-bootpart.wks | 4 +- .../lib/wic/canned-wks/systemd-bootdisk.wks | 4 +- scripts/lib/wic/engine.py | 421 +++++++++++++++- scripts/lib/wic/filemap.py | 170 ++++--- scripts/lib/wic/help.py | 401 ++++++++++++++-- scripts/lib/wic/ksparser.py | 121 +++-- scripts/lib/wic/{utils => }/misc.py | 100 ++-- scripts/lib/wic/partition.py | 234 ++++----- scripts/lib/wic/pluginbase.py | 36 +- scripts/lib/wic/plugins/imager/direct.py | 175 ++++--- .../wic/plugins/source/bootimg-biosplusefi.py | 213 +++++++++ scripts/lib/wic/plugins/source/bootimg-efi.py | 171 +++++-- .../wic/plugins/source/bootimg-partition.py | 153 ++++-- .../lib/wic/plugins/source/bootimg-pcbios.py | 91 ++-- scripts/lib/wic/plugins/source/fsimage.py | 56 --- .../wic/plugins/source/isoimage-isohybrid.py | 185 +++---- scripts/lib/wic/plugins/source/rawcopy.py | 44 +- scripts/lib/wic/plugins/source/rootfs.py | 159 ++++-- scripts/lib/wic/utils/__init__.py | 0 scripts/lib/wic/utils/runner.py | 114 ----- scripts/wic | 452 +++++++++++++----- scripts/wic_fakeroot | 5 + 40 files changed, 2433 insertions(+), 1042 deletions(-) create mode 100644 scripts/lib/scriptpath.py create mode 100644 scripts/lib/wic/canned-wks/efi-bootdisk.wks.in create mode 100644 scripts/lib/wic/canned-wks/qemuriscv.wks rename scripts/lib/wic/{utils => }/misc.py (70%) create mode 100644 scripts/lib/wic/plugins/source/bootimg-biosplusefi.py delete mode 100644 scripts/lib/wic/plugins/source/fsimage.py delete mode 100644 scripts/lib/wic/utils/__init__.py delete mode 100644 scripts/lib/wic/utils/runner.py