From patchwork Thu Nov 26 08:30:54 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 251 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:df02:0:0:0:0:0 with SMTP id i2csp1570975oou; Thu, 26 Nov 2020 10:31:17 -0800 (PST) X-Received: by 2002:a62:5b05:0:b029:197:fafb:50f3 with SMTP id p5-20020a625b050000b0290197fafb50f3mr3672756pfb.76.1606415477821; Thu, 26 Nov 2020 10:31:17 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1606415477; cv=pass; d=google.com; s=arc-20160816; b=zLI910WnhZGK/Z9WwXt8mybYr2KYnDeuhZ9dUjld/DReICWfnGwCEbJwGnOvAicxZA 0aTf/kXIoX4mNO18GxKcwA7UGicgIsqtekjQdTxalGSCj8tRQljysEJ4Ka+wcfgv/DRp X0nrKQ8rCQgu7mQRk+KvP1QQou2aI6ymAGWxr8tykLviBVfr9BtIbiP0VEPfT/ngmu5E v/QrsP7tdl6yXZrUABi6b4GJ4rhgT6BfSf8/7lT41wSnbmAdGnUewXgltBKeUciXvi88 PsXjUKwz1zXJ14fG9L38hQQxsrzrGBSBv7dVa2OF4QIbx4rldopIlOdiVMdf/2hUgYgh BdBA== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=bJcGJm3CsOWBRAbYOZyblUgYtkL4MIHM1UoGbM2hjqk=; b=uCquvBlXhLz7qKKgpKhBFqD3Q/MZr9aJwsqOyanYwoQUFvzM21N70u9qIAnGxbuH4G QOC4wB5ye/g8hmnDPtnfNOvZdj8XJ5suXj74tk7phSEdu2hzbIaDKWOnaroOYWU7pFTC pDh+369QjM7BRVJXYbqLsCX3Q7HD9+GYeoB+Bn3iO5U5ImwjVuwkQjcfyLWhwrmgbIjy FDZfWTLrcLMgTh2y9+pKeBMor1BjHNoHIhIN1b3XHxOZN9mdgKIZ642j8hHpZUSH0RLB B3PexPZ8eGG8WiVTC5EBvXiGIiysbIFnycOGjmnb+t0Pyr3xUXOeNIM+ttQydnSylx4R fYHA== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b="Ey9VYfV/"; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrb5pi776qkgqe5eycuna@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRB5PI776QKGQE5EYCUNA@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id i33sor2035157pgb.19.2020.11.26.10.31.17 (Google Transport Security); Thu, 26 Nov 2020 10:31:17 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrb5pi776qkgqe5eycuna@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b="Ey9VYfV/"; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrb5pi776qkgqe5eycuna@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRB5PI776QKGQE5EYCUNA@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1606415477; cv=pass; d=google.com; s=arc-20160816; b=kVjHzXmDE37kDD9lsj5VARZP6lrmeG0PNiISb8kDDm9qeez592xGCyNJnjBYAjLiIf TKYDBiIHAqgSxe7rqyCP90LPSWJaKHJT/mNHBo4RKcwA8XdHgWgdH4A7mxRp/xynJrsO 4Ahjce6HQqcYUkW1NZQmcsfDasdeGN8rWHRgltjKprU7zHgXvSalrcI5NX+x6Y5VJz9v Qu8sIdqRXuyC+mA1mz0ocv4ruJPy7cssL5zrQ+xpyPwtUA1FMBo+t+x869P3xUDHXBqQ IzPNyiSm6kvj/t4Hl6NOSmPpRL0JYkA6mpQUzpZ2AWSdJObTsHckQdN/amtk4hv0BMMj 7i/A== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=bJcGJm3CsOWBRAbYOZyblUgYtkL4MIHM1UoGbM2hjqk=; b=PW317V/nuM1ideSgYfIB3lz3IpuodbRG1C0RobWHkrrQt8mO67XWx/zKVXrR62iRAF cGdlBHwwUWN59+qf3Yua2SjVZqbNj3vfPwPGLqiJ1VUsn4zhMhp/CJPG/AJ6fMzzOEWu 4SU45ocXtOII3QJZjdIh8dj0beEpiiQdbiybvel7nckcht4qVhbKyvxUdAEQSc9Anf4/ CWC0piTYpxcmR2yxM966Udtj0c1/Y+mprKS2u5yLDQ6uah5LVcxqr0M91XPtGS3myxi2 q1R6T73FtF7I9pYz5T9Xt+7gNZmf86v0NFEqMhfzFq0Na1u0m0prTJoU9f4Serqwl519 tadw== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=bJcGJm3CsOWBRAbYOZyblUgYtkL4MIHM1UoGbM2hjqk=; b=Ey9VYfV/1AgeLcHURfrq6WOkPnM0bJ00l6RMDJFddhuIowqdE903EvICZyDkroE3L2 p+NcHR6nCFQzE6x2CY5aP3nvVfm22whjQXwHcIHaVsw9jNY09426W9HalghU2GaKk5w+ A76QRqGkYSKhYUWx+7fQACIgBw9RUI7pVIxv7EwguZhgR/l71cMItSDDb3D6F9RHB70i GVbTbAf/hvUYOk0gUsXbJKzmeaNs8+HCVdVoBf0i9Bb4FUhXmmLttvfVxMCSDQHqJoOL mYpaSy9497WAh7AyFnoyYaD1SFVhyJ/UOP8gc0LHrktsJPpGyXH6F3bZ7J0LyDJLmvfd 5erg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=bJcGJm3CsOWBRAbYOZyblUgYtkL4MIHM1UoGbM2hjqk=; b=CJOhc03EBRe4vwMXiPyOBVV6Hh4KLvoVsxqmCFbZtzFkjviPYR93YPrLeVYLF7PthI ihZRtwmlg2pReMqGnZFgzipJYBXQ39TnXYkai/3ZaDo8u8V/6LrdAeALE7vFC/zyWpSj A3ZRTCLwHEV4r82BcT3/9ZR6YEJ3dz9/Cw8tKsRb8/MTJuvXO7hbEUhc8CLiNZN81T10 y+fHk0CzbQNdVpqCPSihlHHz6o8SQAKUyYYxAjMt/fa+3DPebTpB0M5l7KlBYy40cANV S6XY/0x9/pzhYktDMkOL4i6rRaeodsuOdQUUPHvB24N4xMROnmFpw5Al+e4sPV0EuZeS d5wg== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM533XtMWgkbACeVhCxXh9WOz/qQ6PRlKv91Cze2I+wlmsWqny+Jdx NEwNctD00KF4qJnOq6BDZuo= X-Google-Smtp-Source: ABdhPJzgGUeH9bwLUZfe2x/9MzzCRKhlqQbuQRQFHp9rcFf8XdYm0rGI1GS9TT2f+QjnP07Aurjz4Q== X-Received: by 2002:a63:7f03:: with SMTP id a3mr1962012pgd.313.1606415477435; Thu, 26 Nov 2020 10:31:17 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a63:f601:: with SMTP id m1ls1002484pgh.4.gmail; Thu, 26 Nov 2020 10:31:16 -0800 (PST) X-Received: by 2002:aa7:9888:0:b029:18b:a9e2:dc7a with SMTP id r8-20020aa798880000b029018ba9e2dc7amr3586894pfl.67.1606415476778; Thu, 26 Nov 2020 10:31:16 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606415476; cv=none; d=google.com; s=arc-20160816; b=uAShWdcJFOJYtxUuhZ6XGK27CR+tvxvMObS3RffPMp/Wv3WHZwiUcrnkEz76wuqLdC yk4YwlQTbQfzRdoXMAK1Q7QO1xnyMzJa9rwsOJrP3Ljmtr3mv6eqH89SKm5DiILenoCo fv/8cJwfAt3emCNfheEO9qTdTd8phg6uT8whz2CEvvI8pdsIXGcK/AQWzSbNsTPJX0O0 4nUSwp+WeoBzlfW/3YFBr9p9CyHTksRSE8e4AjEGex+hI4zYxkDtpbKJD+owIfmkfOKr G0wrrWbdf3XWetEgZqXU5MBAWTS+DeK408goZ4mZW+UI9nmKInE1rEOgpTKNkRynU3dW 7CBw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=n86CWes63CscKi28nbFasxAn1G8SdKgNCwDn56jZAJ8=; b=Y2NfecCpv500Hc511k8SIrUcW9TuXb1FYMi/m9BtVC3dfnRgVc1jDSUHk/7vsDfyOS HNzQ/ALbbxI+c+4PKQi6snNafoXWolE1N1JdWvAWCLJ+PWcxKXYvD7HWF9+XZ70j6Ic+ +IHRvHU9vlmmKD9zNfBalOPo+x3z7UhUh4MCRJgtKssj4kQIYG9DI5FM4NgvdUNJr4QH 8jpjM2b79urAd8NP/S7o5YNJ1QexGuKFNqFjPLzXugw9/zu8G3OreFoHtJWz4pQO+/zn R6PPOQvuW3y7vDHERH6mQms3IEU6dwpEz8E1LMr49Lym8GUqCPBqbSbVmJynModlU2nh pnhg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa1.mentor.iphmx.com (esa1.mentor.iphmx.com. [68.232.129.153]) by gmr-mx.google.com with ESMTPS id o2si477769pjq.0.2020.11.26.10.31.16 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 26 Nov 2020 10:31:16 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) client-ip=68.232.129.153; IronPort-SDR: 4zWRAI0EH9DawSACPSsllKRmvsMyDXTUTdUwKykd+j9mi+scGuJi7/QpAecYNhTnht3ltpa0BO 06KL6hkmWbX9U+xL6pz5XS27kMCwhXdqhl0LRwj4NPOU1zsulls/WxhHDrbJrKg6PFiEomW3j3 v5mIo+9+54SyNDbWvxWBmGaDCknpp3JqXuKk92sZGO2Lwq7LO6a0gUOZnyZoi7lwuVNZJSk11U a4PArjzWavU4L1raEfARMMI17LmdAETOICnA+kE9DP6r5JK5pm3hPgP/5VhmJLRHo1RctfY3Js DPM= X-IronPort-AV: E=Sophos;i="5.78,372,1599552000"; d="scan'208";a="57815823" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa1.mentor.iphmx.com with ESMTP; 26 Nov 2020 10:31:16 -0800 IronPort-SDR: kHpAMUSlLrt+Z6Zmz2DR9vCpiVz751VbfFIpXR64xNo011FVrtqFJaDnNzJ7O7wuqbH8by5k4x Y65Zq9Dp1EFhyVvM1Aak1pGdVyZZqestrl4cbjt1i3yscmoIb2DkfgollSX/10vIk8T6r9K62o rymag7QfPktbrXGH5VmR/l9pr+QpL12iBrrldYH0VxBmqyjnpRi7yBcq/FtOgobCkrmhJZnbNF +HcwaQ4hqzhS4iyYZwHKsSb7GqhS4dJefCM9XwVDWfh67uzBQE+th01kC+RTt3PhYmjmLEhPqO v9o= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v10 14/14] doc/user_manual.md: Document details about deb-src caching Date: Fri, 27 Nov 2020 00:00:54 +0530 Message-ID: <20201126183054.7593-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201126182953.7518-5-Vijaikumar_Kanagarajan@mentor.com> References: <20201126182953.7518-5-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-06.mgc.mentorg.com (147.34.90.206) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.129.153 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1684448716210591468?= X-GMAIL-MSGID: =?utf-8?q?1684448716210591468?= Add details about deb-src caching. Signed-off-by: Vijai Kumar K --- doc/user_manual.md | 30 ++++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+) diff --git a/doc/user_manual.md b/doc/user_manual.md index dd6fc34..a4f3d1d 100644 --- a/doc/user_manual.md +++ b/doc/user_manual.md @@ -919,3 +919,33 @@ And build the corresponding image target: ``` bitbake mc:qemuarm64-buster:isar-image-base ``` +## Cache all upstream Debian source packages in local apt + +### Motivation + +OSS license compliance: Some licenses require to provide the corresponding sources code, +other require copyright attributions that may be best provided via the source code. In +addition, you may want to archive the code locally in order to ensure reproducibility (and +modifiability) in the future. + +Currently the local-apt generated has only Debian binary packages. Extend the local-apt +to have Debian source packages as well. + +### Solution + + - Trigger download of Debian source packages as part of rootfs postprocess. + +With the current base-apt implementation, we already cache all the binary packages that +we download and install onto the target rootfs and buildchroot. This is then used to +generate a local-apt for offline build. + +Use rootfs postprocessing to parse through the the list of deb files in ${DEBDIR} and +download the corresponding Debian source file using "apt-get source" command. +This caches the sources of all the Debian packages that are downloaded and installed onto +the target rootfs and buildchroots. + +By default, the Debian source caching is not enabled. +To enable it, add the below line to your local.conf file. +``` +BASE_REPO_FEATURES = "cache-deb-src" +```