From patchwork Thu Nov 26 08:28:05 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 238 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:df02:0:0:0:0:0 with SMTP id i2csp1569170oou; Thu, 26 Nov 2020 10:28:45 -0800 (PST) X-Received: by 2002:a05:600c:2110:: with SMTP id u16mr4834324wml.178.1606415325738; Thu, 26 Nov 2020 10:28:45 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1606415325; cv=pass; d=google.com; s=arc-20160816; b=utp8NMLTuX23uK+Zhln/JZR7ElpAouEErR1/4yGRbTIt6nQX3Rkp6/bFkIToA0xO21 dnPjiG4kdWU/HdCNEdq2f5wN04z8wIUZ+NhNBCJYIK3UhU1nxENQL3koOLlt1OjvR4vX wIdbLu6oBO1vay93Elk/0/SehbNx/VdznSsj5W27G260NUalp9w3u3D7DruaVQD4tR/J oAydNlBPbzMZPqEJ4r5sXgj+snvcKDUO0ArEAm2P8yxqoTahf1H+a384Tc45y4tQpqJa 9jpdVJB4m40Pz9Anysk/l/PkSLjTRBln3bpmgIWFcnJsQi/E6AkpCdUFDoT8ddAArXnz k1iw== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=tYQgP289eUo8t+XYJ+oTUe9qvTJst1mjxrWS9PeDs/s=; b=J9fQoI7XSOORnEhSj2I8G6x6vgTXmc9WvGKH5y0zXJJJY9HNsvGeeU0CwtqlYevPjb 65It7S6Cc+vqurtXOftAzYknovDtufTXoW23WR3pg23Bd5CG7E8lVoFAMK6WOZ4372Zb J4414EQ7D1y4FpNydBHDf+aMVb2It0kI7c6Zvde3j7Lv3Pfl46r6WzJdpS56WYjtvk3m XxJBnhxR8sPe/TUXbERXNGF2/y0fV11zCzuDfqq3oBwdBT1juig6MIbtBs0xHOUBzfUM 40XR8WH0LDdDYy87vh2fcJRP9teQdKyOamC1Xhe7DFGIKdQf1JdB+m7ovOL2LFhb5qGm Ysvg== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b="rC5/ZXV9"; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbxph776qkgqe7spdtpa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBXPH776QKGQE7SPDTPA@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id l17sor3191184wrn.59.2020.11.26.10.28.45 (Google Transport Security); Thu, 26 Nov 2020 10:28:45 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbxph776qkgqe7spdtpa@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b="rC5/ZXV9"; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbxph776qkgqe7spdtpa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBXPH776QKGQE7SPDTPA@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1606415325; cv=pass; d=google.com; s=arc-20160816; b=MWoUYFjwdZHsWr89oqDIj2LtheNS1Yi2oa+rgem54KAkQuSqjrvFtBwGSQjPnaTWT3 6Z/9SlJzTqK8CdyrW1+dkfBJlOYzghWICw8w4uk/hNjr+r8mEn87WtRuYArt39zMjlnq Z1+LJMI5vDE40GIA232Cz94FZ4n9Vrti+2bOywUgPwktu5ffblLnUX6qcpsaFosSRQmp o9w11qo4Jfy/YABjuMZ5gZ+QRi+PZqysao1ZLqY/xT/h29RxF3C4cAdOeoXnIMupb3in CEx/7XOdHW517JmC5m1/b5K/T0W43Eq9vcW/nutPkF15s68Pk6ZC9rKA0XO3zjb8HX+s tcnw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=tYQgP289eUo8t+XYJ+oTUe9qvTJst1mjxrWS9PeDs/s=; b=YfOKEs8Hfo7L0v2TJqI0BpOgmwuKoU7sF8pEvzao9KUQeeb9gl4wNfCkvTvJsz3gNP qXk3sUN8jZ8LpvozRZhvvmTdeZgxDUfLSpkFngDEl223AsCrh4YGFqYIEWEsrhZAUuW4 92Y0v2TcqcHaRNT/VJNgdnQek/iV+XXGYwB91gNDl0h4ZwHDP5cxLfprYo2d0rcnMgSz NQhmvXRog7iq+g+F86rb4PeElcR9oGRet1e5Zoo07DSgX5XvrcIShKzuxmTgnIyI3PiV H4Td/n5Ec5SK7mz1sgk5QCl6S3LCPyUkBdA0J31/l38+WeaPyZ7YL3B9Fe0BFTh/8Gpt c6yA== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=tYQgP289eUo8t+XYJ+oTUe9qvTJst1mjxrWS9PeDs/s=; b=rC5/ZXV9mLHiA6Y4zmj/1j4BLwtQYqNQy+063EYnqar+IFsbsvDzyh9P0m8arjLQEs WGskXXgVPBLfZSr3Ns1Vkew0rvEr7vaQ9j11c1uKSIbCA21pp2JsXME4eK5G5SNF/C+L zvWhCgww6ZQPY55JVdy8d5QGzFbVFSl3XhQeoUAMrh8fAU0qQNt95Uh8HhhZFpSwRbSE XcIngFpXPkD8uCY/S7tGe+w85ti92SF1wtUCXIJZkOx3yjfBx8tthSmHSzPxS45Sa77K bVMPj2I+fOtV+w4SSQ4nEYCBxmg43m7RE6BJK28HWpLejKqYQQhfD9cDmZUA3i2FwMu6 TNeQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=tYQgP289eUo8t+XYJ+oTUe9qvTJst1mjxrWS9PeDs/s=; b=Toiwn6gh9jG4P203KG6SFn3jz23WvtZvs0AEGhMYxy6AHyWNZUGKO7/5nUh2LFvds+ QeuAS6O5x7Z0mg0Q3wmhs5cInwZ1i5LosirxbayTlo1adyEZSFF4QSzVnzdA48qUDhOR VevoYqIQBDsMa2M8kD8RR2XkApl8+WrzdqPa4mt0x1iFFSIpR1Iqs0LVP5/Qjf8rTk5e qKTPlTymKMou+UuqOWFYA49iJjhNgwHnqYeNFZ8EYavz8WSo/oL0lD4VuqPd2P8gaHzN seCS45eMr2mZXcN0vfPLbRTUl2pNxfY+vXfGyDqvI6TZtr8VSV65WJwvxJC2WUa0IhFq uubg== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM5317BhbFxZ1g6iD1EpPgaZ4BTWJGXSbPFLNvJkcdfXDD7SAVbgpG +/x5hS60DH4CReE+yFH/FtE= X-Google-Smtp-Source: ABdhPJxJMrpdHq7e6pvs5xHrPqqGcUlKtjJaOG9ytAtMKsPosmye7Sy1GQ7cU6spDubyCvm7TGzXcg== X-Received: by 2002:adf:e6cf:: with SMTP id y15mr5388652wrm.403.1606415325450; Thu, 26 Nov 2020 10:28:45 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a1c:1fc7:: with SMTP id f190ls1359611wmf.1.gmail; Thu, 26 Nov 2020 10:28:44 -0800 (PST) X-Received: by 2002:a1c:f311:: with SMTP id q17mr4666999wmq.28.1606415324560; Thu, 26 Nov 2020 10:28:44 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606415324; cv=none; d=google.com; s=arc-20160816; b=jokV42sVqet3+X4LiP9Dr+n8CGOnMS7Jz0+Xbl9sub6SjUHleOoHferYX4G6xC2Pfg xePA0OgXVa3L9KDkqS7Pov8vEcHJK6A0wxPW5KP/J3J8zENKasOB52whtHUF3UllXKG5 YWc5BhG9AavUbUlRc8B+hEQQtgigg1viTSWTtEfp0vfRzgOiUkey4q+Te/9VNPV9orNj 25Jfs1W6v+YMAef5lmVuHMJiqhWl+RQKqjSch90qmbge4Os+1ohnJe+70sC+ZS+64ZU3 KTqUzAsqUghXhQupmSbwRI4DPANyXZck7Cd5Xd30CNPGfzDcsH+MmBf+awQr5VuNzaOu uh5A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=+psr9IKvQzg/5QPjOWPy8KP08uOEmtcwfcP1pPeRXoM=; b=gzxvvBd6lReqT1GYyS1x7gA9qwB264R21jZ30019rVWWZnWXNLCWisCA2LI+yL1q2B zug1KU4WRv8+BurkI449X4kyPAJge2Fpz4uWp+ROZDrcX5n+KOCGUBtb6uGjzdPPTA0q yn+LVmJpIw7RRdgw5FuWVH5hpSEz6HXbNK7UDJqIgZtpnOXdjhCPk/4Io0Bq/K4OfCTT +zkbYL9j4IQLdJIBPd6OJE73Pp6+sTK5R2vq5M3nK+yUMjs8Ie3DuU6yecRvvVnfbH4h Xh4phzB6VsLSBdQ0CmiEQ1l804iVQ+y3xcHPr65tRBP4kMrsYEGeFqwtaCw+B0fRT09Q cIZg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa4.mentor.iphmx.com (esa4.mentor.iphmx.com. [68.232.137.252]) by gmr-mx.google.com with ESMTPS id y187si226499wmd.1.2020.11.26.10.28.43 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 26 Nov 2020 10:28:44 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) client-ip=68.232.137.252; IronPort-SDR: zH+AHhU09ieikk8y0rkO3ngVxgzeC1Zp2/bRCMo/0VFWQvs2ICnbviBdWJhopMltAIPG1MmYQ/ 9bEN+bjQJREqyvMkd8oNaObeNPCdfM9WZZppGGuYfMt8KtorM2STHP5RUvMmJtB4oiwkx0PfEB hm9oaQYRKgfLhmqN3L0jpxfoN71qq6BFYVh5GYuzjR7YGF/TqnL9WPVuUc5kvZdsSQFw6zT+zY olCmi5malnJz+PcB1BDU9isWEBYV5/O86mUWviK5i8PLwlPqGAx7k1Y1cuc408uSOFQQ5TQnW6 Nyc= X-IronPort-AV: E=Sophos;i="5.78,372,1599552000"; d="scan'208";a="55644666" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa4.mentor.iphmx.com with ESMTP; 26 Nov 2020 10:28:43 -0800 IronPort-SDR: 1eJrD0b2cSmYgO6e1OueafZ5GnFnp2QciHjT6xOz3PWb7llsAV2q3RgANhdITIxuAxpo142stp ghBgYW60vq3mFm2Bb4M8o1rzVKk3ihW64FOmrGBeH14zBPj4GWgjbKUlAGa7Di8a/yzNpMkt3e FtIWyii9QKTKYQsewRwjcbvvr4XB8vcQJ2WPP6dKgVFGy2oqWq83r5q4jL6Kxk+0Klj1oWgpDM xkoAh0giPEbXgAAPVLlnTS2LHJTI1iLiD6hVj5YmDiR4D7hlpu/25LQjPATnlp7bw2ebd4DqqA Lpo= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v10 01/14] rootfs: Make rootfs finalize a separate task Date: Thu, 26 Nov 2020 23:58:05 +0530 Message-ID: <20201126182818.7261-2-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201126182818.7261-1-Vijaikumar_Kanagarajan@mentor.com> References: <20201126182818.7261-1-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: svr-orw-mbx-04.mgc.mentorg.com (147.34.90.204) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1684448556741887624?= X-GMAIL-MSGID: =?utf-8?q?1684448556741887624?= With the current implementation it is difficult to append a postprocess function which requires a chroot environment. For example, to add a postprocess function which runs apt-get to download all source of packages installed in the target. rootfs_postprocess_finalize is not actually an optional feature but instead a necessary cleanup function for image class. So, move the implementation to image class and make it as a task. Signed-off-by: Vijai Kumar K --- meta/classes/image.bbclass | 41 ++++++++++++++++++++++++++++++++++++- meta/classes/rootfs.bbclass | 40 ------------------------------------ 2 files changed, 40 insertions(+), 41 deletions(-) diff --git a/meta/classes/image.bbclass b/meta/classes/image.bbclass index 8e350a3..cdde195 100644 --- a/meta/classes/image.bbclass +++ b/meta/classes/image.bbclass @@ -63,7 +63,7 @@ image_do_mounts() { } ROOTFSDIR = "${IMAGE_ROOTFS}" -ROOTFS_FEATURES += "clean-package-cache finalize-rootfs generate-manifest export-dpkg-status" +ROOTFS_FEATURES += "clean-package-cache generate-manifest export-dpkg-status" ROOTFS_PACKAGES += "${IMAGE_PREINSTALL} ${IMAGE_INSTALL}" ROOTFS_MANIFEST_DEPLOY_DIR ?= "${DEPLOY_DIR_IMAGE}" ROOTFS_DPKGSTATUS_DEPLOY_DIR ?= "${DEPLOY_DIR_IMAGE}" @@ -174,5 +174,44 @@ python do_deploy() { } addtask deploy before do_build after do_image +do_rootfs_finalize() { + sudo -s <<'EOSUDO' + test -e "${ROOTFSDIR}/chroot-setup.sh" && \ + "${ROOTFSDIR}/chroot-setup.sh" "cleanup" "${ROOTFSDIR}" + rm -f "${ROOTFSDIR}/chroot-setup.sh" + + test ! -e "${ROOTFSDIR}/usr/share/doc/qemu-user-static" && \ + find "${ROOTFSDIR}/usr/bin" \ + -maxdepth 1 -name 'qemu-*-static' -type f -delete + + mountpoint -q '${ROOTFSDIR}/isar-apt' && \ + umount -l ${ROOTFSDIR}/isar-apt + rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/isar-apt + + mountpoint -q '${ROOTFSDIR}/base-apt' && \ + umount -l ${ROOTFSDIR}/base-apt + rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/base-apt + + mountpoint -q '${ROOTFSDIR}/dev' && \ + umount -l ${ROOTFSDIR}/dev + mountpoint -q '${ROOTFSDIR}/sys' && \ + umount -l ${ROOTFSDIR}/proc + mountpoint -q '${ROOTFSDIR}/sys' && \ + umount -l ${ROOTFSDIR}/sys + + rm -f "${ROOTFSDIR}/etc/apt/apt.conf.d/55isar-fallback.conf" + + rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/isar-apt.list" + rm -f "${ROOTFSDIR}/etc/apt/preferences.d/isar-apt" + rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/base-apt.list" + + mv "${ROOTFSDIR}/etc/apt/sources-list" \ + "${ROOTFSDIR}/etc/apt/sources.list.d/bootstrap.list" + + rm -f "${ROOTFSDIR}/etc/apt/sources-list" +EOSUDO +} +addtask rootfs_finalize before do_rootfs after do_rootfs_postprocess + # Last so that the image type can overwrite tasks if needed inherit ${IMAGE_TYPE} diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index 5b63ae7..94176a9 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -12,7 +12,6 @@ ROOTFS_PACKAGES ?= "" # 'clean-package-cache' - delete package cache from rootfs # 'generate-manifest' - generate a package manifest of the rootfs into ${ROOTFS_MANIFEST_DEPLOY_DIR} # 'export-dpkg-status' - exports /var/lib/dpkg/status file to ${ROOTFS_DPKGSTATUS_DEPLOY_DIR} -# 'finalize-rootfs' - delete files needed to chroot into the rootfs ROOTFS_FEATURES ?= "" ROOTFS_APT_ARGS="install --yes -o Debug::pkgProblemResolver=yes" @@ -209,45 +208,6 @@ rootfs_export_dpkg_status() { '${ROOTFS_DPKGSTATUS_DEPLOY_DIR}'/'${PF}'.dpkg_status } -ROOTFS_POSTPROCESS_COMMAND += "${@bb.utils.contains('ROOTFS_FEATURES', 'finalize-rootfs', 'rootfs_postprocess_finalize', '', d)}" -rootfs_postprocess_finalize() { - sudo -s <<'EOSUDO' - test -e "${ROOTFSDIR}/chroot-setup.sh" && \ - "${ROOTFSDIR}/chroot-setup.sh" "cleanup" "${ROOTFSDIR}" - rm -f "${ROOTFSDIR}/chroot-setup.sh" - - test ! -e "${ROOTFSDIR}/usr/share/doc/qemu-user-static" && \ - find "${ROOTFSDIR}/usr/bin" \ - -maxdepth 1 -name 'qemu-*-static' -type f -delete - - mountpoint -q '${ROOTFSDIR}/isar-apt' && \ - umount -l ${ROOTFSDIR}/isar-apt - rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/isar-apt - - mountpoint -q '${ROOTFSDIR}/base-apt' && \ - umount -l ${ROOTFSDIR}/base-apt - rmdir --ignore-fail-on-non-empty ${ROOTFSDIR}/base-apt - - mountpoint -q '${ROOTFSDIR}/dev' && \ - umount -l ${ROOTFSDIR}/dev - mountpoint -q '${ROOTFSDIR}/sys' && \ - umount -l ${ROOTFSDIR}/proc - mountpoint -q '${ROOTFSDIR}/sys' && \ - umount -l ${ROOTFSDIR}/sys - - rm -f "${ROOTFSDIR}/etc/apt/apt.conf.d/55isar-fallback.conf" - - rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/isar-apt.list" - rm -f "${ROOTFSDIR}/etc/apt/preferences.d/isar-apt" - rm -f "${ROOTFSDIR}/etc/apt/sources.list.d/base-apt.list" - - mv "${ROOTFSDIR}/etc/apt/sources-list" \ - "${ROOTFSDIR}/etc/apt/sources.list.d/bootstrap.list" - - rm -f "${ROOTFSDIR}/etc/apt/sources-list" -EOSUDO -} - do_rootfs_postprocess[vardeps] = "${ROOTFS_POSTPROCESS_COMMAND}" python do_rootfs_postprocess() { # Take care that its correctly mounted: