From patchwork Thu Nov 26 01:22:27 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 237 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:df02:0:0:0:0:0 with SMTP id i2csp1231642oou; Thu, 26 Nov 2020 03:22:56 -0800 (PST) X-Received: by 2002:a05:6512:5d7:: with SMTP id o23mr1163709lfo.272.1606389775882; Thu, 26 Nov 2020 03:22:55 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1606389775; cv=pass; d=google.com; s=arc-20160816; b=F5ieradKjMJnH1qXJpG7zhYE023HNcj9weKlopHP9Xi4YCVE+m24j0qoQce3kQYsq6 OLvmdiL/O1rO1IUi8tJHrq6/nLUk4i/DlRGtRpMq8I+2xN52gGlRNph5Alpfzub2aNgb FNm9HzElMOvBcBVRekO8qag/UaK0nz7/oVbBRe2K5PcU+pEeCxnppV8PsFkFdpSziZ5Q 13IsuWHAT1o6d+lvn/KY2oaPS1rHAOBwW5xG+p9BXayMhc4xw0lE09kLVYSX2zhxgroS c+cuWGPiy+fP7Wgj5AbmdeMvgfpRL8ckQ/sDdgaY8eopPHIXkIpVhSZdQOKF0AgpFGeG sHcA== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=DI5ONKjDZNC1a1dOGE8u2jHf4gL8RjMZnR6OSdsyhz8=; b=tvuVLdyEOEE/SZ4MKwzgSxEaOY0mzt8HV1lGYVvynwE7My0AjRT80FRU76YOcV1m2x voZacX4wuLpiruy29vL74RvkoLQHFKTCYSmAkEpFFhLy++LFmWGrg7+7b+6ZM0AnzJc0 xd5ihjstVQ6Jei0Wev4oUfh+Cq+VI7tAeMzYreLQAsO8JpC4zWA2K8/PlBeC9xFHAoqH LdG7uyXgHP1WJ+g8OzMygoK0FzBbTCP7dEFVeBkLaoPhMsMUYmIho21Fkzf2V8ySR4OB 7sG4xtgv8+9V2J2PXEacCI55sCAQCCzuQR5cG5yz5jz0clEYWvMZPAxi0R3O9ocJeEOb 3JHg== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=GskvrVOS; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbd5a736qkgqevg5x6sy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBD5A736QKGQEVG5X6SY@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id g10sor484852lfj.108.2020.11.26.03.22.55 (Google Transport Security); Thu, 26 Nov 2020 03:22:55 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbd5a736qkgqevg5x6sy@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=GskvrVOS; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbd5a736qkgqevg5x6sy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBD5A736QKGQEVG5X6SY@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1606389775; cv=pass; d=google.com; s=arc-20160816; b=Okd/2S1d5Je3yfjKxywgjVHiamvDtSIC4qLUDPG/TNlwx5CNCyJXtB9lN5x16+mpEH 3nKFzR5TqHlvLZy3kSXPJjn6TQezw//QvIaVZlEs5mA2l4eewZPEtCE+9KEai1lXUyjv mgrnsR84gp+m02CcEBdkTIYYUaHOdbb5yxTiVPOgNl63Jj+iHDAfLRoPfOjZo7A5duNZ Mg4uGhn6vKAdpvX++p8HCmk99Pta3zmvUP7w0YMDeuBIzqpprS0V4AnsttwLFDnN4/Hr oczDXBV/VDk6Wj85tkFBO2L4MRMPwvKypxuk8plv3chxJCpfSaqJ/NoDzqK54wccDrvZ kzdA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=DI5ONKjDZNC1a1dOGE8u2jHf4gL8RjMZnR6OSdsyhz8=; b=kv7+0Ob+W4pNLKuXbHDZXkWir3KvByD9FfWnB4QsXx9Wpa74rYRKs2x+D6VdaStlbd VRxHBoDw8u3+ym6Nb09xuiLExct8EIrtcw8iVwlsCfKTww4UmBeIRfsj4xHnDY5gqLYm pLyd1MUc/6uTkYQ0drS21/5LSCf6PCnRgytCvsdxWW765B07KrZNxMT1Z/YZ1R5VybQg PoQafly5b72XUxRQyrprtdtfNpwncXERM97TDBBErz0UTO5T7uamaiXLT05TQwsCN4Aw QWuWO5TjyNF/yuZeXTesFlbr6NzoDy6lTq4WuRr4Aew9wVBr7apkVLYHAPzZxHX0rRpA v3ug== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=DI5ONKjDZNC1a1dOGE8u2jHf4gL8RjMZnR6OSdsyhz8=; b=GskvrVOSNoQTbRBFJgZkVWXQNjEgf2ead9fkYKJXKpgF7ceIb1xKk+CQjvl72QzjtS zqlVDI4Bq4mLTODAuNLo7mrzAAuXoU2Q1aujX33uPfnWB7gFoHNl/7DJAawnHibHGzBf hs3eF90vuts7cmrNd59duXeiix13IhZdMy9GqGVeiD8AZwYYn41Bc3hfu5wT3u3pu5Im cRjp1VW4xgtCbJbdRmw5DvfqQySSBWBgzQuDhFlG+/0UmCd9q9WyLhoaWkTz9gqezelm +O/6LZGpeGY3yH4dacDdiZo+xDNXUXA9Br62dTceItxAEIBTlNBrd5H8xxgidQuU+YuI f+oQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=DI5ONKjDZNC1a1dOGE8u2jHf4gL8RjMZnR6OSdsyhz8=; b=TTm/s7mc4D2y+nv7GqxZIDyrS1co6RNTupsV6DdmBcRnHCeTUDvlGLpK/XiifUpz+L 4QzRmKFLw0XQeIv41fA33B910BR9zhARvoSpNphZ5RuD218PwGJE9O2SwngZNp/WF6cl ZD7u5PRUHnXO3PLOp4mXfJmHYy+1/XBwOjX8cAtTBcL1NjNI6Lpzagb86s6dyFx2JtMD 3iNFv4atQo2bp+n/hmJRLk2rb4PmVc4AXnGPHscj/DRwt9mhh82X8th6FN/72yuMDxG3 cI/aNTRDybR/CDoGKrvW60X3SDjtKSLAsUV5ycAN54YL32VMzVfIQfTyVh2aEgGekWXv Iteg== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM531RQvEBk77rt3gzEZQ1dC8m2ntvci7aBeV9xH5anhpn+o81hidE 6q8QmpuCUQu4VeO62mOhqo0= X-Google-Smtp-Source: ABdhPJwrJGNfsDMTvCwAmblCUg6bzZ+uBTZT5Tr61P2aB6B5jAk+aCJj9tQ8WQI2pWu0SSK8e1xpoQ== X-Received: by 2002:a19:154:: with SMTP id 81mr1215577lfb.161.1606389775549; Thu, 26 Nov 2020 03:22:55 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a19:ccc2:: with SMTP id c185ls1028729lfg.3.gmail; Thu, 26 Nov 2020 03:22:54 -0800 (PST) X-Received: by 2002:a19:c815:: with SMTP id y21mr1079872lff.589.1606389774402; Thu, 26 Nov 2020 03:22:54 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606389774; cv=none; d=google.com; s=arc-20160816; b=WBOGGVxUaiwHWprsd6YscKOhdDbff0qQdiwEgIKMfY2gRRENzevGNVypZ3R5gzhFQm +pAoCmHZNLSrXGYmIEge05VxNH5O/ue6+6xxdRenE/dXg+nezHXVYqAXBgDjXJpB3R8B htVPES8Lilsf4nIafpiGQuTpqxPqW+XhQD5jg9Q+uImnUgjeybFgx76zzXlE9eEP53l+ WmDD130zJDpc4QqlAl9zGY5nnLF/ZuG2Wah8y9TvPm4BA463nABwqPhlXtfp2JdYi8oB RcDD3gCR42dWW1qygSr5QI4r33EOjCQs1F390Dh1SMjwb323m+MPieu1rfStWxJ6AtnF d7sQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=lfarbXaVgFViW6PH8jVECCsBxs0yaqU9vngv2YHNKTY=; b=I+zwJsMus3pVxRcOWZt5/heftGdm6fYZjk+prlW6MdMb9XKPpbb+t4Y0yOfGa4KW9h YiyTx0MWdq2zSoC0O8MpqGDtEJrkQI2t+ysj02ZMdSHpFRV9IAxXeHCtBhvjfWTb4NW1 kk313eYJDGGl2aNmCtctyaOaU2lt7Qd3tLPi5Ns52V1aqlBqt/3RpvQKA8r61hd/pwnO 5iXWXtTuMRbDVhTv/ram6CEgPkAUZcRHGNF3IyA/AX5nN7OD0Vpd81pEoP23TRVpow5/ 1SaszwtSbeYgazcY8l1tobnwB+J+JaRT2l0S9cTb5Yj14fbG9GTb1TsjJaMb8G8OmPqn w2Jw== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa3.mentor.iphmx.com (esa3.mentor.iphmx.com. [68.232.137.180]) by gmr-mx.google.com with ESMTPS id h4si160165ljl.6.2020.11.26.03.22.53 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 26 Nov 2020 03:22:54 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) client-ip=68.232.137.180; IronPort-SDR: 7z5tDN3UWDgXlTj3VIQ0YrFIdJroNlPgp+fST2rID1cwkfdmb+VoEzZJ0MJC5IBpR03G8s0S0Y V6dkdrwq3mToDcTgFV6EiVshEnNv5sF6bRx6THCyIUvG9aWztFi8qbIhKTKzL3b4Uek6kmd4R4 VOvi+IUd1+IGe1ktAw7GI4XEIL9Qa4VtJRZ1AwX2149OxaMc4CPCmo/HFbccFAMo7JjoFgmhIG XJRqFsdsLamNaJhWECzSmuxh77f3ofTAAnRobU0xyIqCsPHuNSnRAhh1SxkuZQ7bGjgEcVCc89 wkE= X-IronPort-AV: E=Sophos;i="5.78,371,1599552000"; d="scan'208";a="55500583" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa3.mentor.iphmx.com with ESMTP; 26 Nov 2020 03:22:52 -0800 IronPort-SDR: /XM2ZGJK0tJlnSPVW0JC4iompyvAfmAV1MmNCZE+lRzaB+wcAYZkvWBSi4pz9FxyqqHZ9qbrdc eERyFg0Jw6mLbDjLrO6eA6NDK3D1Tk5Bjix72lKrI4Vc9GQ/OkE0fMAgKXCLaIKlh5L906KMBE GiWqRaX3NayTEMhqisWw9Qz3C/6HVAacPknE+LkrtH/IVlNrgUm9uk/D07DQLzcGmJ8bkN7bFC pHZ3aliFx+LZ+oU63cDDSeyU78SpvsDSj2fM26fwCRD2GyOkvC6hw5G2WdZomn0Rlni1zDOwwd 4lQ= From: Vijai Kumar K To: , CC: Vijai Kumar K Subject: [PATCH v9 14/14] doc/user_manual.md: Document details about deb-src caching Date: Thu, 26 Nov 2020 16:52:27 +0530 Message-ID: <20201126112227.3395-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201126112108.3320-5-Vijaikumar_Kanagarajan@mentor.com> References: <20201126112108.3320-5-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: svr-orw-mbx-08.mgc.mentorg.com (147.34.90.208) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1684421765157205872?= X-GMAIL-MSGID: =?utf-8?q?1684421765157205872?= Add details about deb-src caching. Signed-off-by: Vijai Kumar K --- doc/user_manual.md | 30 ++++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+) diff --git a/doc/user_manual.md b/doc/user_manual.md index dd6fc34..8827b29 100644 --- a/doc/user_manual.md +++ b/doc/user_manual.md @@ -919,3 +919,33 @@ And build the corresponding image target: ``` bitbake mc:qemuarm64-buster:isar-image-base ``` +## Cache all upstream Debian source packages in local apt + +### Motivation + +OSS license compliance: Some licenses require to provide the corresponding sources code, +other require copyright attributions that may be best provided via the source code. In +addition, you may want to archive the code locally in order to ensure reproducibility (and +modifiability) in the future. + +Currently the local-apt generated has only Debian binary packages. Extend the local-apt +to have Debian source packages as well. + +### Solution + + - Trigger download of Debian source packages as part of rootfs postprocess. + +With the current base-apt implementation, we already cache all the binary packages that +we download and install onto the target rootfs and buildchroot. This is then used to +generate a local-apt for offline build. + +Use rootfs postprocessing to parse through the the list fo deb files in ${DEDDIR} and +download the corresponding Debian source file using "apt-get source" command. +This caches the sources of all the Debian packages that are downloaded and installed onto +the target rootfs and buildchroots. + +By default, the Debian source caching is not enabled. +To enable it, add the below line to your local.conf file. +``` +BASE_REPO_FEATURES = "cache-deb-src" +```