From patchwork Wed Nov 25 03:42:26 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 210 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:df02:0:0:0:0:0 with SMTP id i2csp371463oou; Wed, 25 Nov 2020 05:43:18 -0800 (PST) X-Received: by 2002:a7b:cc85:: with SMTP id p5mr4102853wma.102.1606311798448; Wed, 25 Nov 2020 05:43:18 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1606311798; cv=pass; d=google.com; s=arc-20160816; b=JqhOwjeft6+eYYYcp318SKnRy7H6ELe4mHbp2u2qn9y3uefD+jS7Ya/ZgfYMGQ6B3K ixfSj3XmVR5GaZRaeRTOKEmCSd8cM03QLFLB0F0Fdta+HdTUUWbgmXi3iIdo9oU9AnqY aCGUqLyPLQ2q3Fk2ZyS/ZkhoUS+gVBpFqnrGC60GmwWc7hgH/c7DOHfhfbrQ6n13DfEI pQCS2yddClkzOgxSLScaOYRdh++Le2Pg+ennjxxxtW2xpqG9REGoOY1U0tDW4nQGIUNx NYyOtDgVl/GY6ecqvVf57TaNQZKSzhC8wMcigxlL6Ufyde+SnW8By8dDJGi7eQZfEoYd D/3w== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=lsmSVZBmIQAj6gzWXn+1WX+/NUbQ9Tnk9ktlc8zJJ/k=; b=rtuMJywmXuJm9dnjDaSkVtIa5sNo5/EuBwxY7v89VJeGJnGimsWIGJD3pPLLNDgP/H gcbqYU1Mm50Sgcb4zJERsAlirAboPbBAcgVLOquOps4ZAgo/UM67fMV8EVLDAXY3H9L6 5GlWEaXffnwqzObodrJzw1mJSqXBKPFuD9m0PznQQtzf//om/FHoSDei8DomF1vMotZ5 dZD9uE6vbWxDPfcnWgYlLKIrRgWoCMuBxuiJhYs9JscD/x42I+Z2LXBtCUTFJ/uxPMdQ W4N+o3jqVcVP9f/OI82gP6RNpybKDZ9ZkG4TevtyfxDcqTwwsqhqiMMBdwHsf1ytFDK0 1PPA== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=RQXVxYV4; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrb5n67h6qkgqe3leccfy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRB5N67H6QKGQE3LECCFY@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id f12sor1171885wmb.13.2020.11.25.05.43.18 (Google Transport Security); Wed, 25 Nov 2020 05:43:18 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrb5n67h6qkgqe3leccfy@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=RQXVxYV4; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrb5n67h6qkgqe3leccfy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRB5N67H6QKGQE3LECCFY@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1606311798; cv=pass; d=google.com; s=arc-20160816; b=B37st+o+PIRWuWSGKYtBP/6f6DIGN0HBq1TkFUFzkhDgZVWEgjob5hjsLyoxvQ75xr YTfNDTsiYFrwXW+/BwMoK+dBDQbbdnkPdEziyarnu89I3MbLCajqyyARzych3HH/SuLl 7JMWZijS/EKxsUdzdVTj+ZhUT1+CNxohOvhfnV5spgkzGn+yL4LVc6Bm6J4tlykeHS/Z ShBOVPO6tAzv+DEbarAZt19vhaf5FkQKMIvDA9IISf4tENbGUh0HIJ88dqO0fIXzS+ZC B4sDq5KCBME9bt9Z30FQd42JITsMmBh65LkfbV2c/Vp7sVksm9EcMmdnijU7mYo9KvH1 ayhA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=lsmSVZBmIQAj6gzWXn+1WX+/NUbQ9Tnk9ktlc8zJJ/k=; b=hzwu/OkCbLry4GeDVlYBb+UflLcYhhGPwf173XkpeLz6uRkxL7UHpV2uAxZ8DVfllI TMQ6/QPjOsgbaKs+iI+U5AaMTsLrsVZ48pnMAGpOhrvNIn2v6hXGrIzsAxyiRiEKO0/2 meYd5U3gbb4103GNERODdvfLQ6JMGaBu99JWRpuBAGBYBpNCWKGTdT4NYmfDfN1YhE7t 8fLUU3O1Ev9DMqJJVK7bYbXcHyIid+XpeMqieAPsbyiWDo8IuB+4rQ88RadGRtzJec9s Ka4qD1+MiXg/7JXwHTk6SxlMXjRYHah96ht/nfkk3eao5eaAits0D1OOEUQKlhGTbBNE LWvw== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=lsmSVZBmIQAj6gzWXn+1WX+/NUbQ9Tnk9ktlc8zJJ/k=; b=RQXVxYV448LBdxrVXBu310nIaalZRE+P1+V+3DMAVwUIVfbFc8pqkJmVmEz/LLtA1Z 9Wswg+FRq6iOa1zlQXBiyswXM2GyPV4sjs97fgNnjIZt1QKxYwe8lD8GZDw1WOsQHv2z Rm2HyetQshzD+uWkNbzV42U9KxgZZJSgfZ/khW+jH6bOF/ZvzdpbTdOtMeH+wXPv6zYJ YjdNzutIfsE26qwatzigqyzV55k5pQ3eW8FbJgajcjXEtjkT3+ExHQe3Xkm899j0X6zC KhNFK02h1YOVH6ejIY66ECVfOcySkIP2Y4Q9WyY0Hlw06FJsPF4nK3S3Dq4k69vZPRuP vGpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=lsmSVZBmIQAj6gzWXn+1WX+/NUbQ9Tnk9ktlc8zJJ/k=; b=VWDIrFehAnJIIu+PJwarD6tyo+fuIw0HNxF+Qx9WeFvz5kSIJM/PIlfBnap/3nX6ce XdQQBOOFyD4TUxp/qKss+1kR4UaWYtowT0C9OsKn0w4k0ThwRcj/4B+xv7A0Rgq8WJeu cXLU30EqN1pnLcFfLKPSczPgWqZTe+XCreMDERLUmNblende9Mc7qKr1qi2DLUyi4BUL 3I76pMMphQgGLpkYq2lzHGa3KoPy2BLrwJHEItm83dGUwfW5jI5sDu+heMU103iq312U UhtkVCT19oBKrq3kqDJUHuPlgR1SRCVgGEAx2IEb89WBAAFBnk+EClfYG5Ae0oBbver0 gxCQ== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM531enZpB1jUG658RfyQtORp9a4Y29BnlTYg0ycDZJEb5OwNtzPUq wuKFUlPu/EvUQVROO0734Dk= X-Google-Smtp-Source: ABdhPJw2XWIL6XQWmO5+vtbFY1VJ3uNwdW9fcebf4lPuJhXITdMqJi/jyDru12c/k+I7KSlsYPBRYg== X-Received: by 2002:a7b:c3c7:: with SMTP id t7mr4152546wmj.114.1606311798197; Wed, 25 Nov 2020 05:43:18 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:adf:c689:: with SMTP id j9ls2846323wrg.0.gmail; Wed, 25 Nov 2020 05:43:17 -0800 (PST) X-Received: by 2002:a5d:5505:: with SMTP id b5mr4265690wrv.410.1606311797309; Wed, 25 Nov 2020 05:43:17 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606311797; cv=none; d=google.com; s=arc-20160816; b=tXyOhGQFNWy7UFwbdSqxW9gAGlYXCex4vbDOiVeplvhfKHDGF1iyWMh9agZeWtfR8y aNldHhrvb2L622q9H026XogDBLKmNIthILg3p+5vKP7uHNWztAQXDKthA3JmtRQDTnsk veY/JYXNsA+hNiPguuUhwS3RplbYcKqfPq9LNTOQVSvnR361KkW10qEnPZRyq+EELAEX k3dAtzom8Vzk6m2MzID3QfqYnq7u6Juc2yTsy9Yv9JJhgNfCztp30IaN9BbKPOsKQ8AT MFp0sTsTK55MX9qua7P3ANaLW/W/sIuGBeREtrc2DjMmhVF8GIWXSWY58IVHUGIzYw6V pkYQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=eNGr2sY82htXXv/f2Ypru+JC6ylWvonjFgG9JC2l700=; b=gVn2hLiSwfpziRy0qMjrqU5nlwnZb5JLhWU4BzPvXTKxZC5DN9lUGATsublxKE34j8 TrxdOTH6hRo4FatRvgcqhmDIRhdlbxTR2BDgY7v+p5ofmsU96nEplJ9rWlpIuwv7g0fR FUxq7rt/zmDTzMypvudHzDyv82cXP4YvpKBai2opJ7Mx1EKAKfUWuePn+f86pA1+s38q WZayU76U3s//R5gSRx3iKnkiIcOFPsNR/OvylY4hksserSHqLMR/LUFWvqAiKuQXMnVG RFUSKjmfoMyh/+ODWGsSirNod8zc0eAwyCRlV7XgPUYAr0QQoCCpTD1MIDQOnUVj27m1 MG5g== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa4.mentor.iphmx.com (esa4.mentor.iphmx.com. [68.232.137.252]) by gmr-mx.google.com with ESMTPS id c20si60917wmd.2.2020.11.25.05.43.16 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Nov 2020 05:43:17 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) client-ip=68.232.137.252; IronPort-SDR: gFdUUiXFe6iOZA5dHcbS197JEaiCbrilnozT74ihlrsRnvRy/irv6g/22mA5dIqhUmtVIt7PxR UK8W1JVD2YVm5+cjhjnm+VFlzs9WMYHvrtRZBj6cXC9Q3jHrTtMFlyZ06uLKYvkiV+KccF+03J L9vl5umLQOOXXV67fdpzCxfkFvrot4uh7MHaU0p7wiEtBVscV7LKvABIKnA7KtrlFXwI01if35 TQ1BnMOdPcBuNnPlkavulreq6LNYANH0ZHY9p1HggBItC2SMzfPZFZA4sSPM22F/ef3iDfag6S lko= X-IronPort-AV: E=Sophos;i="5.78,368,1599552000"; d="scan'208";a="55597752" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa4.mentor.iphmx.com with ESMTP; 25 Nov 2020 05:43:16 -0800 IronPort-SDR: T6diPQStVyrKFRQZjwfipCd3Hbrt2IwneyvHqweQQLCr+qWt7GzGtON/rJMFXy1XmxvzwQ0sNz c2LU9+cKDay4Ap8zeFZfvpzYG95gfQTFRUY40/LgR4hm9c3mdXcxgwDZQKMj/CcxhiJnbpVyd3 SOr81tiTkX8Y2BVIdnCA6BAM73eR0RSOYQhUeun0BgNH/2OMWRFhcP4vOayUBjm/hvlyRbARvI XHOU116TXRO85hnNY6V9XsTU+taoL62sLKZV4UXEPfBrUVctQOT84zct9deqK1bUVeRrigGnhy 2rQ= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v8 04/14] deb-dl-dir: Make debsrc_download faster Date: Wed, 25 Nov 2020 19:12:26 +0530 Message-ID: <20201125134236.25878-5-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201125134236.25878-1-Vijaikumar_Kanagarajan@mentor.com> References: <20201125134236.25878-1-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-06.mgc.mentorg.com (147.34.90.206) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1684340000448670069?= X-GMAIL-MSGID: =?utf-8?q?1684340000448670069?= Eventhough apt-get source skips redownloading of files, it is still slow and takes a lot of time. Instead, lookup if the dsc file is already present in the cache and skip based on it. Signed-off-by: Vijai Kumar K --- meta/classes/deb-dl-dir.bbclass | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index 659fe4b..79a9a88 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -20,6 +20,8 @@ EOSUDO find "${rootfs}/var/cache/apt/archives/" -maxdepth 1 -type f -iname '*\.deb' | while read package; do local src="$( dpkg-deb --show --showformat '${source:Package}' "${package}" )" local version="$( dpkg-deb --show --showformat '${source:Version}' "${package}" )" + local dscfile=$(find "${DEBSRCDIR}"/"${rootfs_distro}" -name "${src}_${version}.dsc") + [ -n "$dscfile" ] && continue sudo -E chroot --userspec=$( id -u ):$( id -g ) ${rootfs} \ sh -c ' mkdir -p "/deb-src/${1}/${2}" && cd "/deb-src/${1}/${2}" && apt-get -y --download-only --only-source source "$2"="$3" ' download-src "${rootfs_distro}" "${src}" "${version}"