From patchwork Tue Sep 29 22:02:47 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 93 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:eb04:0:0:0:0:0 with SMTP id f4csp4807304ooj; Tue, 29 Sep 2020 23:03:58 -0700 (PDT) X-Received: by 2002:a17:90a:c28f:: with SMTP id f15mr1071502pjt.143.1601445838411; Tue, 29 Sep 2020 23:03:58 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1601445838; cv=pass; d=google.com; s=arc-20160816; b=fBZm4YsnzQe9iMJp6IxjAe6D+1qW71Lb/+FyOnrn/DudbZMXhwhAFXZGVwCM4xhYWC qRMOq0Nug7KLa9Jmz+TKc4j2yc4xvqPy7pjySMYiPzmpf0iHUlxLWNowqlAuDyncn8GS SgIgamSWJHLePjHQ7M3XnTi7/MK6GDdZpjmzIqEaUNAW/8/z+qdLRIwd5/4h6tgnsnp1 JQpbiGuUVdNBszTF7YQj9geUSyqfN8AzhRsGj/QSi4LpM/IimCHzR5oX3gODGdGB3AkC mM/xDnqudjoGzey9Cv00lWljOAPEFfcYpF45VLw6V0DIM97HnfdyEeXMl5jcdQo4daLE blnw== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=dEHCmhMuydY4t0kEMRcEN1sRMLvCdJF8ZM44KQhz0N8=; b=J/jsD1B3a7A/sMJANz1OtfC0dTMLZgSkv711qz+/Bdvdpfty3AwX5qzmscy68CHinz vC0q47Y9axUUyZDTVCyk5LEkZWU5ntn4oZjlSCtS+2ZmSYsI4FpQAeKjkNgab2cfxnS0 w9Kotrzx9bfPbYqvBO6rPGvIlYcacrCShEvFDMHlzelkJ4dPdTdm6SGSu/O8P5n94OVQ oXCkm+a+uheECLC2sz8cStlGOqvrHh2t8UwRyHS/tuq2vvA/XAfbBNPl0YqTbh2/q53J rpXEP3kQdrNJTFmV+GNbR7yMh+rDt3/p98fL7LextjA7Gknnz3C1Ee5raLALlYjFcJDK iYyg== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=o1lr5JIj; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbtf72d5qkgqekdqs4wy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBTF72D5QKGQEKDQS4WY@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id 93sor279105pjz.28.2020.09.29.23.03.58 (Google Transport Security); Tue, 29 Sep 2020 23:03:58 -0700 (PDT) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbtf72d5qkgqekdqs4wy@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=o1lr5JIj; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbtf72d5qkgqekdqs4wy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBTF72D5QKGQEKDQS4WY@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1601445838; cv=pass; d=google.com; s=arc-20160816; b=muzGRgnG4Qd7nESZIwhQqj5WwRt5Dm0Hq4ui5ap7Jv7Ljf4BtNl9IuAOUYI5S0iHqY /JYsFu4aSQ5CEzgEt5S9/Du9m6/LRJy3b0usteT8DciEbcjeGu1A+y1qyq5YqrLFcvYX F158ImEmeW4fPnoGtTWYxIRzGuzJwOrX3x6pivpMe3VDHMKM4/8ljsBWUMyLSfd0E7kb VemE94gKp+4HmY9O5lzF3eYlIKnfBrqm7PQFWid86iOqsW/3kKlfA78oNWl2MnVqeT1X Qf2Tlu+IGCG3Pek1uie2yW9ZvdY7nc0zq17/i1ONlCaq5hgTSPjSpDb+B46mW/EUtwef HnfQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=dEHCmhMuydY4t0kEMRcEN1sRMLvCdJF8ZM44KQhz0N8=; b=vLoaqMW+HY/1NBLB1YY/Ch1hePIgSufmH3WdYC8Netmr4Tj09OBeIt3SvHjACl4fO5 5UJQaoTZTg8eOgy1KC8Y5H2vtbnN67SWljMnoNgKpMjzwAoaDZgmRvaZiDvyRDr/2fGu NbXyBLWYAuIQ6gCDxPoYiRfZZopguK4x8conBlNBQEq9lq7Ss81/bdWyxLYoBJQ275mb yPOmyTayAYD5NMapaWU5nzI3dut/0/DN3Wd9T+BSODJfWhsBgOVn0f7Wc4Pa574+3VpE o+zrJidV87vr1S16PhTZkOri4XSK2dvKTDLUNcYBJDVdzd/wmpaTyX684rO1ALn496LW flSg== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=dEHCmhMuydY4t0kEMRcEN1sRMLvCdJF8ZM44KQhz0N8=; b=o1lr5JIj+wXahiUtn+2MAhX0bu5kqS9bqnIXoBhT/GEZv0c+nUcXLXoUL4Y7+VSuQT IflxQtUdkP6NGIvrNrlS2PumgkXm0Y7wEhKyAsgu657J1Sem/k5zlDiwMDy3dsfs8Xza bX0DFElSGlg74lclWVGLvrkwBfeLFN+W95YzGlvfeWvy83fHG8qTDGtdQ19raR/7CWea tC5+I9RfLX4V2UGgAlFEF5aQDsYlR9+OtNFQtien03cS5iiFHAAb3A19sZONXc29QxzO W58spe3sqvSuGGA6byEioy8InVt+Ni5X0QGnEkkFT+O8jsX02atfGjvy2/BU9vUW7d07 Jkpw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=dEHCmhMuydY4t0kEMRcEN1sRMLvCdJF8ZM44KQhz0N8=; b=WigwqQLNTw/j80U3Rt1Ivk5MEpyD5S5ysTWWS6Qdkl0+AAQj/u7WSXvhs6CqRz++7g PXhriu+VisBLPEKUP+CyriVJG2hWDKNywDDDQCXebGirP2zCam9p6Aa5CmZyDKinCTQ0 a87SBvLiOI1kdKeXAf24+mMCXf+wuDMCd/+yRtvPx46waOPnxS92UioHB0ptwmi4ZN1k Ad2eFdgPGy89u6Aptu/pRGuL4XLYkQxUT7SNDulOcr53MoPYBUWR9j3DLvlfT3vEjZJ5 3x6hVeBa3NWGJLZxq+EiBu9xxK2qnHZrwDXmGPhfQa/djptcNvzeLJDyPhx8DUv7zfZu RMzQ== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM533Lyw8i8pc5WYBK/lBaGbEdJBCsaWKUOBNj5XsCS80t+ifBr54Z /wLqeXj6EFLmU7+cix0GW2c= X-Google-Smtp-Source: ABdhPJwiFq2X8xbsFHVl1aIkoHtVDusdOdBO9cOT1nRCU4GqvkcG641tq6aoQPLFBl9NGGRyxGnw4w== X-Received: by 2002:a17:90a:e60d:: with SMTP id j13mr1121155pjy.61.1601445836925; Tue, 29 Sep 2020 23:03:56 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:90b:2154:: with SMTP id kt20ls313991pjb.1.gmail; Tue, 29 Sep 2020 23:03:56 -0700 (PDT) X-Received: by 2002:a17:90b:a51:: with SMTP id gw17mr1155483pjb.118.1601445836328; Tue, 29 Sep 2020 23:03:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601445836; cv=none; d=google.com; s=arc-20160816; b=sOdf/HnVkx4kemCJb22XRXLl/mi7ELaIRV/ZzxYLEw7p686jPHtXUcx044COXgnAtm QDTm0YBusgAjJnoacY4JbwSKxoBL3ADO43g5DSxdCiqT5Bonz/vWsdl7tlspOykGOfrj x7SyYKYYf6R+Y+0tinEQfUdO3HcmItgF8xLR8atHAIkQkx9mYx6zG7nmay2r1kRYxH78 yCf1o79vJWo2OBbwMlXIUp5BVrRxp1/eJ1G1hT0cTcPLVGB/HBU4CGk2b+Ak/1QI6I7W qw9ENYtUW7lNlfWwKrXuagIvV0x4JCAD/btfVRhLA3IxsY8+Z+e2xbLwUn7lKRBEEGte GaAg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=H8niWxM5BKPb6fWXtTy1dn2jxNvuJlJ1fTRLh0T9ZqE=; b=wb3hy764DpTj015lDmGR4zEGHQOGm4Yuz8Immab8M9Ne5ob1Tnsx2W46HnLHfunxQ1 EF7cqHpq2ACULgyWjnuqICM4ZHAC7eNLzo/u7c3VzbXiyxq4AbCiUEOAIvnQJ8iqPw4r cv9P+VJn+w4WhaGjiGXZ5C2Jll+t6jDklAR9+dwsmWHTHu3lTp+XfTp6Z1JCt4ucoAIV EFljIo27iiRB5SVPvvP4Gdnvz60pZl0eh1FvdgaRHXyScy2M+SEjIdzMhqad8cJJ2CID sf+5ZJemQAPwYAi4Xm8bdSqniu1HFEAFku2ljP+HGrjwnhZh9OamI+jr1VNWLxfmjqoX vctA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa2.mentor.iphmx.com (esa2.mentor.iphmx.com. [68.232.141.98]) by gmr-mx.google.com with ESMTPS id mm16si51246pjb.2.2020.09.29.23.03.56 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 29 Sep 2020 23:03:56 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) client-ip=68.232.141.98; IronPort-SDR: 2ZuaqvZzUXNAQYpW1aHojMGlaLuKYv91hkL2VtNnV+NT5aigmMVarkpqBuR/NGfKzihKZHF8S5 s/m9UIfFUlXfhB6dtCWgCdM9SqKL9uJ0vEbIW3NYKUh5jn4LyZleBxSCtWF+hD3FYeZShKE7oA hEFa1GgzCRI8MD9Ke9HRv3kv6ScH5HIrlUuBV31vL4gFUj/ohF588PnTPguxqA5wgJe4/hd7LM owYoaVFlhWrv3CHIVGhYgYwmKRRx0JfbWfW0yYc6gdLeK0n5+HqhV1+Uk+I4xpzvdzlAqRHvWb D9A= X-IronPort-AV: E=Sophos;i="5.77,321,1596528000"; d="scan'208";a="53461959" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa2.mentor.iphmx.com with ESMTP; 29 Sep 2020 22:03:56 -0800 IronPort-SDR: XbkNUtt2HJoE+IWt73KG/gx6MBrU+6AnMxOicPp7FA/vfi1Pk+tifFhQOrD0SwRBE1VtCWPEsQ S79Kt/dcTol5BZ2nJuaoXXDfAp5jjr+jkADXBG1vz7aBatJQmIoco3c8ZoVD02O2ROo7OU5Eve rpy7YyLJ8Gnh7h37/8/NrycdV5vVUMnGAoLjEfmnHfujxOlbBwp62iQFhfnIquf4uSvqMdM1Qo +Zp01qMCrYmQRrmBp5q2EJGVkWUhsxqGOaxFS1ZZQhYsiL0BU3nLQ9xBDZ+lnbh2roUhUqX1v0 zs8= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v6 01/13] rootfs: Make rootfs finalize a separate task Date: Wed, 30 Sep 2020 11:32:47 +0530 Message-ID: <20200930060259.12422-2-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200930060259.12422-1-Vijaikumar_Kanagarajan@mentor.com> References: <20200930060259.12422-1-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-05.mgc.mentorg.com (147.34.90.205) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.141.98 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1679237671847862933?= X-GMAIL-MSGID: =?utf-8?q?1679237671847862933?= With the current implementation it is difficult to append a postprocess function which requires a chroot environment. For example, to add a postprocess function which runs apt-get to download all source of packages installed in the target. rootfs_postprocess_finalize is not actually an optional feature but instead a necessary cleanup function for image class. So, move the implementation to image class and make it as a task. Signed-off-by: Vijai Kumar K --- meta/classes/image.bbclass | 41 ++++++++++++++++++++++++++++++++++++- meta/classes/rootfs.bbclass | 39 ----------------------------------- 2 files changed, 40 insertions(+), 40 deletions(-) diff --git a/meta/classes/image.bbclass b/meta/classes/image.bbclass index a296cc0..2391529 100644 --- a/meta/classes/image.bbclass +++ b/meta/classes/image.bbclass @@ -63,7 +63,7 @@ image_do_mounts() { } ROOTFSDIR = "${IMAGE_ROOTFS}" -ROOTFS_FEATURES += "clean-package-cache finalize-rootfs generate-manifest" +ROOTFS_FEATURES += "clean-package-cache generate-manifest" ROOTFS_PACKAGES += "${IMAGE_PREINSTALL} ${IMAGE_INSTALL}" ROOTFS_MANIFEST_DEPLOY_DIR ?= "${DEPLOY_DIR_IMAGE}" @@ -173,5 +173,44 @@ python do_deploy() { } addtask deploy before do_build after do_image +do_rootfs_finalize() { + sudo -s <<'EOSUDO' + test -e "${ROOTFSDIR}/chroot-setup.sh" && \ + "${ROOTFSDIR}/chroot-setup.sh" "cleanup" "${ROOTFSDIR}" + rm -f "${ROOTFSDIR}/chroot-setup.sh" + + test ! -e "${ROOTFSDIR}/usr/share/doc/qemu-user-static" && \ + find "${ROOTFSDIR}/usr/bin" \ + -maxdepth 1 -name 'qemu-*-static' -type f -delete + + mountpoint -q '${ROOTFSDIR}/isar-apt' && \ + umount -l ${ROOTFSDIR}/isar-apt + rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/isar-apt + + mountpoint -q '${ROOTFSDIR}/base-apt' && \ + umount -l ${ROOTFSDIR}/base-apt + rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/base-apt + + mountpoint -q '${ROOTFSDIR}/dev' && \ + umount -l ${ROOTFSDIR}/dev + mountpoint -q '${ROOTFSDIR}/sys' && \ + umount -l ${ROOTFSDIR}/proc + mountpoint -q '${ROOTFSDIR}/sys' && \ + umount -l ${ROOTFSDIR}/sys + + rm -f "${ROOTFSDIR}/etc/apt/apt.conf.d/55isar-fallback.conf" + + rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/isar-apt.list" + rm -f "${ROOTFSDIR}/etc/apt/preferences.d/isar-apt" + rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/base-apt.list" + + mv "${ROOTFSDIR}/etc/apt/sources-list" \ + "${ROOTFSDIR}/etc/apt/sources.list.d/bootstrap.list" + + rm -f "${ROOTFSDIR}/etc/apt/sources-list" +EOSUDO +} +addtask rootfs_finalize before do_rootfs after do_rootfs_postprocess + # Last so that the image type can overwrite tasks if needed inherit ${IMAGE_TYPE} diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index afec1cb..eae14d5 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -201,45 +201,6 @@ rootfs_generate_manifest () { ${ROOTFS_MANIFEST_DEPLOY_DIR}/"${PF}".manifest } -ROOTFS_POSTPROCESS_COMMAND += "${@bb.utils.contains('ROOTFS_FEATURES', 'finalize-rootfs', 'rootfs_postprocess_finalize', '', d)}" -rootfs_postprocess_finalize() { - sudo -s <<'EOSUDO' - test -e "${ROOTFSDIR}/chroot-setup.sh" && \ - "${ROOTFSDIR}/chroot-setup.sh" "cleanup" "${ROOTFSDIR}" - rm -f "${ROOTFSDIR}/chroot-setup.sh" - - test ! -e "${ROOTFSDIR}/usr/share/doc/qemu-user-static" && \ - find "${ROOTFSDIR}/usr/bin" \ - -maxdepth 1 -name 'qemu-*-static' -type f -delete - - mountpoint -q '${ROOTFSDIR}/isar-apt' && \ - umount -l ${ROOTFSDIR}/isar-apt - rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/isar-apt - - mountpoint -q '${ROOTFSDIR}/base-apt' && \ - umount -l ${ROOTFSDIR}/base-apt - rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/base-apt - - mountpoint -q '${ROOTFSDIR}/dev' && \ - umount -l ${ROOTFSDIR}/dev - mountpoint -q '${ROOTFSDIR}/sys' && \ - umount -l ${ROOTFSDIR}/proc - mountpoint -q '${ROOTFSDIR}/sys' && \ - umount -l ${ROOTFSDIR}/sys - - rm -f "${ROOTFSDIR}/etc/apt/apt.conf.d/55isar-fallback.conf" - - rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/isar-apt.list" - rm -f "${ROOTFSDIR}/etc/apt/preferences.d/isar-apt" - rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/base-apt.list" - - mv "${ROOTFSDIR}/etc/apt/sources-list" \ - "${ROOTFSDIR}/etc/apt/sources.list.d/bootstrap.list" - - rm -f "${ROOTFSDIR}/etc/apt/sources-list" -EOSUDO -} - do_rootfs_postprocess[vardeps] = "${ROOTFS_POSTPROCESS_COMMAND}" python do_rootfs_postprocess() { # Take care that its correctly mounted: