From patchwork Thu Nov 26 08:28:08 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 241 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:df02:0:0:0:0:0 with SMTP id i2csp1569244oou; Thu, 26 Nov 2020 10:28:55 -0800 (PST) X-Received: by 2002:a05:6000:1cf:: with SMTP id t15mr5281323wrx.321.1606415335299; Thu, 26 Nov 2020 10:28:55 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1606415335; cv=pass; d=google.com; s=arc-20160816; b=rCpcxc+icX4URmIypCZgiqEg/1ZtUTQd8ZlUCwu4pHCoASIh7DUFXUBaNYe73aKjv8 IAGHsOVbkufrznDQwKVa40Tz6+dJowT5SCeZDm8N5lDQCu71Bwd9T5wHXx3cXUTKOTsa Hli6zieBEP2rMNukv5EiCeOgq2By7aPnjn1tVKNXv9b7XYyUmpXGzZd+olgUawpqq6Q3 v7koeP+24HScE6c9Kq6S/zf3f1rea0EvcrnF1SmO6ijwVSoPUqS3FDg9HOU20HlF0yVl +2E0VdrvjEWi525ANv2y1WeGToKW7WofLlrH/raRhnqAy6ToyeHeR61IveT5AMUNdQT/ hHmg== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=Zo2q3zpX/jYG5GD+6BnU5kLqeawi9/zMR3YMbizwcow=; b=UBuyUCPffRk54gJ95gsa36ZPKXzyTqdnHbK8WysIKxw+/PYy6I0Ul+GFMY3Zl4JcI3 AnmtjHbsQu6ZTimMb6ndob7kbfn4TXFq6gfqVcc39HBXSgcc0I2FMIYHemxYTUcjQ0l7 X0e5QDHRpPrd/A0M2cS7FZ6TfkaUWQ/8e5mb/GloUEPvsqqH0qEHZJRzmKy/eAoUruYR 3WCJCT15HXm+RPbhv4ZoPSomFQ96RTATE9LQulWZBB5UoNEVnzttXhZNTNicW2+sAMB2 dUUArwMWGWGvghI/foyY95hH/priatErv9CBWen02AXIeSzzy5YF48UmMDmbyev5dBod Aa+w== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b="etVc/Mnf"; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbzxh776qkgqei6rt5wa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBZXH776QKGQEI6RT5WA@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id z22sor3319158wmi.29.2020.11.26.10.28.55 (Google Transport Security); Thu, 26 Nov 2020 10:28:55 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbzxh776qkgqei6rt5wa@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b="etVc/Mnf"; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbzxh776qkgqei6rt5wa@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBZXH776QKGQEI6RT5WA@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1606415335; cv=pass; d=google.com; s=arc-20160816; b=Xiio1AY+OGXOJwe+msbJbBzHGzC+mFD6HZuSQJKX66AMeRZcBEKUvmb7N1DCzJcXtK reMe42//WUw6o4jQOMn7heay5g+LYNiXjo5qKQSSrngFGsTVi+JqRxkkJJ80GmDcT3cz ug/dk22uDm1jOKngWLmFSzUwnrgTxCZ0Z5Qf0Gdd3200mbrjBEdUy9EqvD4CAfh+wXel 0fvHyUCtydzi6sHAoT9+nhJl9GxaFjg+1fw8zTcvjkub0F+F6XhbzKablNaP7DDeMgpM pexoc/p46mS82B4xVT+mjqd7wa0+Mh72i+lPZeSzKfqXVr3kVcg+dYt0uNS2j2YOzPnm qTDA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=Zo2q3zpX/jYG5GD+6BnU5kLqeawi9/zMR3YMbizwcow=; b=fix4QQpz6tzNpJeq7tUWSfGTQhphFy9QBXdhxVRiDnaWICgPwd71v8mkSY0t9XQJoh JzsxFJWDWBJeV9aje6jlSlJLc3Cp8ai6y8a/zGVd1VEiIirKy9RzRSXREH1YO+j9vVg+ tGWEyJ2p3CGZmb117PVldOWjzk93j5tqASWHYB/PD4wuP9roG1fUqK5eFmC4YZJvHxWX QCMz5HCS3htU1voaJDk0d+ggMH1bbfIBNcCqL/h0unzioh8N1neYs0K/DffvQzybOsil kDvw+yMmeY9WxkFYTmHfbCxMLXAP/DszLVAbIe3ChkCamDd7UhRwVnm8yM0B7E12wCM+ LfFQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=Zo2q3zpX/jYG5GD+6BnU5kLqeawi9/zMR3YMbizwcow=; b=etVc/Mnf+0G6t1okQ4oxFeGMmSQlgIUtZs01IiTkOre8YcJohSBcs5P4TN+ww5gpzv FBZaRlfh4hdtcJN1Nc6EJmhu9TlDV/kepBKRSEw6YwOR32ozT8rCjWsl43r5MexwAFJL 25eOt9xz67HtC9sXq6+CFyZdhTQOtRHrk3T8RmF14QaKa7JO7IN12xI8MCtivDv2yfZ7 2U8G67HZkTgerjfbREF0ieIIJBdunyyuE80qqxBRsSYV1YuYf1GCZnreMMbpqR2pHn3l rXEuoI6xqklx8hYykUUf1i3nAmT2G8XmTSejVP+xf7B9ID0cDgNNWSS1QeYbyIDEnryT rQqw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=Zo2q3zpX/jYG5GD+6BnU5kLqeawi9/zMR3YMbizwcow=; b=pCBzLrs/NsuFsKbUgJjMmQ2RdDBNqKFu3AZ0lgIWVjvw20Ry+BPg3n6BpDX9zi7O9A MOi3Q4WFfl9+qEWY58z2d3aBwd+FO8Cmh/GlNkfXTohOxZ7eeefcK8qAix0gtE/k1BGy 3F3spIPfgD0wDmIs6SiG8fVXzMcbXkgaCnd15f7bV1CJVu6Cgf9EKmGanIHxGjGvGLtc Si3iRSJBDid8EFMmOylgCBfMh/+oaQsiqiMKnkOe4Mq0YrfaQD5CiQqKc45yJ2Mktv+k OEvgMaw4kUTalZn0+tPgeEbynSK8EGH7URxOtDMH/s0+uP6MLxHI279TMVB/+RF4h+PA 9PEw== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM5310VyCFNJIvKV6lUhbnIuAGoQKXliwu7S0rGbikeGmLtvULrc/L 4w3Syh0514hOXppBnzdWNhs= X-Google-Smtp-Source: ABdhPJxj6+2UP4NvxcL7sxbz+Qf4N4ZBZ0jNlavdgxNZLN9zvDH1dSRSmzhCFwvV/BEgkaC9ue2ovw== X-Received: by 2002:a7b:c182:: with SMTP id y2mr4704879wmi.97.1606415335041; Thu, 26 Nov 2020 10:28:55 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:adf:f70d:: with SMTP id r13ls3466089wrp.1.gmail; Thu, 26 Nov 2020 10:28:54 -0800 (PST) X-Received: by 2002:a5d:66c3:: with SMTP id k3mr5477835wrw.123.1606415334154; Thu, 26 Nov 2020 10:28:54 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606415334; cv=none; d=google.com; s=arc-20160816; b=GlWpbr+Ylm8Z+pQaKDwALAfrSf1yHnTgQj3dVRnPNx+kUqu8WpNTMJ9h3nwCGwELEQ +V80j43kSaXeeGVm3ebUqjayR7WjEMpoRc6wj++Hz3tPkptSeaKJjfZf9mD9rL7FCTEm L59hERH69b9zp1VCM6njQ4lQAspJzywg6QHiVntJoYRWygjZ0Yf/2nXkwNj61qOLkAd7 N4Sqn5bjtf+yTMhlUf4z9hFtZ8JCTF8EKbFGO2uvvkhO1Mwx+1e3BGEgFeZ5av2GSnsC I1VipiOo6ESu8yMuMpnthkzrfzKlYHWNBwGt+9e26Chm7AObJrd32uRVeg5AkDkt/Y5G 4rjA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=Vus/iYkiI3L4K+s+bL8jozuCgx9M8/c1fVDoKvrbP6U=; b=KLqCUvX1+QAuxPBeot/XLgcMsO0q5ZqkREciuzeEW4nV9KfdJtrr9NCGygmJJzZpww 9ZRcmGc1Wa6ZgU39EEln8RvXhwQX1umZveUlOFEKpxJNhfzYUqj8Llsyy1VuboL6HMIp dNIapJkA7+/1S2qgXub2KlsxoXk+HE51WyOIYhdwzT2Esiv7wFu9wKSoN+iEXHQYkWW1 MlApbR2uKn4EyWUi1j9eIMl+kYhHIfeUm9uGWAIJhIKeLkAkC8V5xPa5ieOa/f/Yycpj 7gTp5ThanItTOxViOYr6By3d3NEjxxexkAJfn8RR96ZZ5Zokh0WnKTZgwDZ2m3BHCHvm CDjA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa4.mentor.iphmx.com (esa4.mentor.iphmx.com. [68.232.137.252]) by gmr-mx.google.com with ESMTPS id y187si226499wmd.1.2020.11.26.10.28.53 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 26 Nov 2020 10:28:54 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) client-ip=68.232.137.252; IronPort-SDR: buBg84mXU1HOt50zNsD6+VvBj+IwgYLWLkdgLexRsizrMXQDCNC6aBnAgoQWdzLbExmlhnSPJ1 D1PeAGdXlQxqTWGXdNVIk6uJcxC3s94KXy+ltb5Da+uFBgKF3x8pTZsKXn7WDDjiaH0gj9cAWt b5iyRwIn0QyWrS7C4G9oHBZSvrEVvyqbYBZAlOQjIFCS+M/Y0D+9O9rz84VX6be6rtgHC4R4OS NoIb6D4oVo1GHe55W23FLiZnQef+C/Bb76f2PLAV28uU8Ur3Xb2MbjKv8Y3tHTHTOwqSOKftzH N9g= X-IronPort-AV: E=Sophos;i="5.78,372,1599552000"; d="scan'208";a="55644671" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa4.mentor.iphmx.com with ESMTP; 26 Nov 2020 10:28:53 -0800 IronPort-SDR: BXI0GYZ233dfrhHoNwEZhfk0ljUrHc3xqtvfk+LcZxTCYY0e7JAMX12A5UpLXH5RNk6WKeEB/E 4u6OZ1oSSgOVq1C2aUXM5fviN8/OqxO313oCytPG9xk8ZCRiW8D8DOibZ5B0HuBI0JvcGZTEL2 OUe1EhX4wmh2/PcSz1pgEfPNCljNUO8Yuy2Pvyj/6RgDQ90tx9D02660O7kNRcJixXG/cjJ6RM 6Q/qHLXlmdx8fiZHux57/8EqguU53qogt5pQGTaQdrqLVJ4EGTLgcerSkMCbULcBvKMXrjwBzc vUM= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v10 04/14] deb-dl-dir: Make debsrc_download faster Date: Thu, 26 Nov 2020 23:58:08 +0530 Message-ID: <20201126182818.7261-5-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201126182818.7261-1-Vijaikumar_Kanagarajan@mentor.com> References: <20201126182818.7261-1-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: svr-orw-mbx-04.mgc.mentorg.com (147.34.90.204) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1684448566571398762?= X-GMAIL-MSGID: =?utf-8?q?1684448566571398762?= Eventhough apt-get source skips redownloading of files, it is still slow and takes a lot of time. Instead, lookup if the dsc file is already present in the cache and skip based on it. Signed-off-by: Vijai Kumar K --- meta/classes/deb-dl-dir.bbclass | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index bbc6f0a..0e2cef2 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -20,6 +20,8 @@ EOSUDO find "${rootfs}/var/cache/apt/archives/" -maxdepth 1 -type f -iname '*\.deb' | while read package; do local src="$( dpkg-deb --show --showformat '${source:Package}' "${package}" )" local version="$( dpkg-deb --show --showformat '${source:Version}' "${package}" )" + local dscfile=$(find "${DEBSRCDIR}"/"${rootfs_distro}" -name "${src}_${version}.dsc") + [ -n "$dscfile" ] && continue sudo -E chroot --userspec=$( id -u ):$( id -g ) ${rootfs} \ sh -c ' mkdir -p "/deb-src/${1}/${2}" && cd "/deb-src/${1}/${2}" && apt-get -y --download-only --only-source source "$2"="$3" ' download-src "${rootfs_distro}" "${src}" "${version}"