From patchwork Tue Nov 24 22:02:51 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 194 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:df02:0:0:0:0:0 with SMTP id i2csp150512oou; Wed, 25 Nov 2020 00:03:39 -0800 (PST) X-Received: by 2002:a25:c7c6:: with SMTP id w189mr2168173ybe.403.1606291419349; Wed, 25 Nov 2020 00:03:39 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1606291419; cv=pass; d=google.com; s=arc-20160816; b=OVBGeGeqnuEdNj1iCbkrNs/3gJZviIl32ixWKSKe9x/GFzwatUK+yw7SAoP65dPB2k omktapyqe7dmaRcBkaKJkM0EvO94GYpSZDhEJJ3Vcbc0SOmlaPUack6vZJlB4DNPBI6P Dw7Xs0AJGfcZKlzpSs2u5GwWShiSlL9BMlHcG/OlwfEobrO6n5CkQYTxtAmAkMoHsn9s 03n5rdIrYSm/ArrmnYu9hOh2SnpX82FLyOR88UJouhFhswzaza+caSgyQpC/tb4Nyt74 VMV4YMqTEIuekistjLJ1Btmdg562rK4bQhw0xCWFVvkVRX746WeO6IwSRnhF8JlxqsLz qJ0Q== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=Vx1dsTqZfLEqSZVHVrM2RK/1ljwmNbzuNxTb/xfVwFE=; b=NvdF0mwAy9AVH75fYvv+hPnJqUuNZKdrJft7ML66hz1oCgg7VZKSfT9J2UPnQ5Fsl1 13XMLUplYvXA2wEjF655mJZ6BCtqZ3k6y6j68GA1+18Kevi0n4NPrR3F6lPN0BmVhtyg NJ7m5x/6KX0YurXlwtYGq1AkJ6ysnjRRDn4ovD654/l3YF7QoFOt7NM90wv7vbinVPhO VH+W0JUDbMuZsylzqvsufb8mMeVpFoNwP96ggIaToMsWO8C5G29jUfOXKw+x9Au82Wqu ZnnH0K7YWwrJ7yqlskbKX+8ZkX1hruEYB7AhXuBltVgoX64AC1x1yd5r59ph6nSSDibS 2jwQ== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=ZI6zF0ci; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbwu77d6qkgqemkiaf6a@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBWU77D6QKGQEMKIAF6A@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id i140sor370041yba.105.2020.11.25.00.03.39 (Google Transport Security); Wed, 25 Nov 2020 00:03:39 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbwu77d6qkgqemkiaf6a@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=ZI6zF0ci; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbwu77d6qkgqemkiaf6a@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBWU77D6QKGQEMKIAF6A@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1606291419; cv=pass; d=google.com; s=arc-20160816; b=HL75exz4c20eOf+42zd78fDwOMeaaPH1EePn2OAutom/IMKJdqf9OPpxjaiZvPbvUg WxiMHEZ+AkiMvmGx+JWm96D7WAloXsSQdrYfjI8DN4VkOVNZibyo6B2783SFEtc6WhYI DfSEI0xbORACVUXmcZofOrJWWcm/zPWJz8CqFQeuXL9M07AELgJDptJvBxS4rUA1drY2 7HkR6dBDWfC4dpxHwDRZ3HNfGwqsuyRlzLtzfsiZ0p+obnSDOx5E0iaYbWHHEa1jnUx2 toeqgFRC53wVly2x4l0QjDfKitolRKywGoRj0A2a5m21GsGORziI+77ZpKOqGZVAXJRE 3q+A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=Vx1dsTqZfLEqSZVHVrM2RK/1ljwmNbzuNxTb/xfVwFE=; b=0vdeTExf+oZBTz+AIaS+s6e8Hm8SQ0vzV4F6kf6ui+qpVxN9LCSi6nLeBE8nQi5Ozi yiBHB/fEGix6wctIxKIAo/FVNCqlLU6n1nYtJNghMUTMEexjVKK+ftCjwyhMj6KCuqrX ZaRGW0LHO+R3+grjOR/fbvKhZlxkT8S6CFmoIrsMjKzZ8+p/pNl6Cwhojrb8IGoTd1cj A1oxBSXJ9470HxtlOANqqingwGGLj77nQrvHCvlV3D/f+uQmv+yiQL5YQO71YBqpd7af gfwgxbgDPDIVukWFyeHHSfQyKTLUcZ3Q8mNroaJ4hVYsV5YvBzVlZDTZ1nxelQjXEAuF YieQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=Vx1dsTqZfLEqSZVHVrM2RK/1ljwmNbzuNxTb/xfVwFE=; b=ZI6zF0cieffdL3SsIkOgflRxfLopAya2RZ0U8sQ2J1Zn5bKFHZgDbQU/Ky6WHx2Zqc BQBFnM/SIrLCaxo4938jS/cXfKMPxbV1mEU8uBRg6dhUny83YIsJecddyuIf7q4YTQNa KWMBHiL68G4xDAgyI+Ppvmj8OVIwZ02i7f+6D2iNkWj2Frtj3iYkzJEqcXarNak+aNBQ LuqLQchGHMi4txxChcfyGXELSyJ5r4hB6cykHLr0S0G+qYxxOsa4/PnHVu3ActPmzNCH zSMK/4n7Pwe8ibVl4vTfi2a8puIFnZ9NudzuRrpHaUfyZj4zZ0fZmpS12erSMJmYSx7q Cw0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=Vx1dsTqZfLEqSZVHVrM2RK/1ljwmNbzuNxTb/xfVwFE=; b=OsB6HR4Q9qgLnlzVU4eZV1KabJK5m4pfeFJ8SE/HbiZeRj6568NucVSWt0S1AfrSeG EjpC1KVyVFfEMXscO5QeUk4EAf039d4wZm2/hZIFAAFFZl9KCKvq3v6FBehH83D1e0it U3iAMI2sdm/FaoglRFHD/OYLGVN4xVBxOG+/5hCeKX7Q/LffNFId9YOjse+tyFzryXxp ZGEUuhCDBwRerP1ZPH7nWxuCBF5pm1f4mX8DmFhtH5SZmdjMnS9OzfpYKQ1iJJJcOP4h Bb33j1qO528PzeUfMMnGcfFGH432ggj7RdxhCIDUAn+gJYx+w1/69j1agh/Upk65zt64 lGbw== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM5333gNrKAD1ZoranDSXpRmA4WMv2tVbRFL4/erQ6d+ZbIcaQMX3n 4UuVlzwAht6DuUkOlvlA7QY= X-Google-Smtp-Source: ABdhPJziUBHSbQu2axJ+F327GpXnsXkL4+QUmdjgi83fFLY1a8tTmwN8aMvnnlufULuOLMmsND6DyA== X-Received: by 2002:a25:6d0a:: with SMTP id i10mr2398485ybc.445.1606291418979; Wed, 25 Nov 2020 00:03:38 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a25:2d56:: with SMTP id s22ls822180ybe.0.gmail; Wed, 25 Nov 2020 00:03:38 -0800 (PST) X-Received: by 2002:a25:3281:: with SMTP id y123mr3062867yby.467.1606291418652; Wed, 25 Nov 2020 00:03:38 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606291418; cv=none; d=google.com; s=arc-20160816; b=qy/P2qAu57QJhvtCF8fyax16EDMp0nOKr29CDqUojtwm9LMsqCbpnoJzKL2gYbmC3V Ij8uPPiXfyh61qzCG1Lz3QR3ZpkRSWuv+cRgfWyYr56IASAKj64Z8be5wvXqNRP+e75m hpFSYp/zXr5BYannoYRKoL4/WeuHn3sJI8sIr32VUWJ2u2TT/2TNQmOa36htw09mtyTD Gpta+C1Xuc5APrP9PJ+hrnUZat0vy422q0KINS6XPNPO9mcpOLXR9SLQEkHYsjt9Y65R PXAyQj+j2C3nPXHqqyc4S3QkhKxjhx7WUPg2UGLBLOkJba6WQfL4P8nsgmx6QdN0Y6vR iuzw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=eNGr2sY82htXXv/f2Ypru+JC6ylWvonjFgG9JC2l700=; b=rmdqnPOzqu8qG59wizYzO0WAlHKf9RDfdZyJ0my0uhNLauKd/EYE4uRrUtNtJQgB6u zyDG+Gb4pjNE/MSDxBrhGEi/JTPedyHWqYFc2tk5OphDfbIZ81zHNudMAj0uAzwLdIrx JlM1nWLNlUYaVj7w6fci380kR6K7pimvNrkjZycCZE5JP0d3LtzPcXriGeSEMris4H6F VHFJdaT83u8OOHmnYVpUTo3vXhsJNQm6dyx9B1juVbNL9TqfYmiOd5Zu+ZZJEzU9B+1n P4vuJMtZvjQr2pFGTwYbfnEHJz/vRZ59vpbgACPYZMTHQ2Q+CPB+nTVtvNQIXKGkzeG9 Grew== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa1.mentor.iphmx.com (esa1.mentor.iphmx.com. [68.232.129.153]) by gmr-mx.google.com with ESMTPS id 199si77218ybd.5.2020.11.25.00.03.38 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Nov 2020 00:03:38 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) client-ip=68.232.129.153; IronPort-SDR: WSZJ4zuuwRvdhB89fwcgXBmCqSKqOisxZJb1HjTmOBXr7McySwQYZpCGkxskhMrsGmaYIuqS8D cD4c84gS0N7k4h17TFxcAZg93Uqg78kSdi0uPpDzl3E6V161c7BsVDq4ZCLcqX2CuN5S/BxaJC +I+PIXJR4izpPRuuHg2b0leSzmLv+Pl4Vlxf4k+hNs2bF2HcX8sS2GtAzW2m/2t3wPJ0YjeAkV dSQDJkfhviQ8QhaINoXVTpeCLXqRQmtEro1mf4tt9Kn/G83B3JuQ5ZXJe3VsI28QoSGoGfsUbK XUE= X-IronPort-AV: E=Sophos;i="5.78,368,1599552000"; d="scan'208";a="57762480" Received: from orw-gwy-02-in.mentorg.com ([192.94.38.167]) by esa1.mentor.iphmx.com with ESMTP; 25 Nov 2020 00:03:38 -0800 IronPort-SDR: jwhWBw76WZ9fDO8zMQrGYOCCvePSEM6b1Wk1wrkDyqDlnFcCAUwXO5SMiyAhMIN/NQfqU931Ei u44I4M5PPRizaZdoQEjzacKm87h8egA5ZPUKY9hsEbM6HXzc+aqAsVRBOoqEe3121p9zX2NtYL OBVfpc97Tuy5TLjdm+/rYDpjAhvmRNlPOER6NFJEk2WOYLXIg3nl5xuIBB/shzIS+VVomz0Ien FsMDXYLupulUJQ3hs/eKktEmYqxfjXGCJF0TxPoKPraialh254P06bLXhXjV/W1hjaiav9yFnH g/8= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v7 04/14] deb-dl-dir: Make debsrc_download faster Date: Wed, 25 Nov 2020 13:32:51 +0530 Message-ID: <20201125080301.15818-5-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201125080301.15818-1-Vijaikumar_Kanagarajan@mentor.com> References: <20201125080301.15818-1-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: svr-orw-mbx-04.mgc.mentorg.com (147.34.90.204) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1684318631144431511?= X-GMAIL-MSGID: =?utf-8?q?1684318631144431511?= Eventhough apt-get source skips redownloading of files, it is still slow and takes a lot of time. Instead, lookup if the dsc file is already present in the cache and skip based on it. Signed-off-by: Vijai Kumar K --- meta/classes/deb-dl-dir.bbclass | 2 ++ 1 file changed, 2 insertions(+) diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass index 659fe4b..79a9a88 100644 --- a/meta/classes/deb-dl-dir.bbclass +++ b/meta/classes/deb-dl-dir.bbclass @@ -20,6 +20,8 @@ EOSUDO find "${rootfs}/var/cache/apt/archives/" -maxdepth 1 -type f -iname '*\.deb' | while read package; do local src="$( dpkg-deb --show --showformat '${source:Package}' "${package}" )" local version="$( dpkg-deb --show --showformat '${source:Version}' "${package}" )" + local dscfile=$(find "${DEBSRCDIR}"/"${rootfs_distro}" -name "${src}_${version}.dsc") + [ -n "$dscfile" ] && continue sudo -E chroot --userspec=$( id -u ):$( id -g ) ${rootfs} \ sh -c ' mkdir -p "/deb-src/${1}/${2}" && cd "/deb-src/${1}/${2}" && apt-get -y --download-only --only-source source "$2"="$3" ' download-src "${rootfs_distro}" "${src}" "${version}"