From patchwork Tue Sep 29 22:18:29 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 104 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:eb04:0:0:0:0:0 with SMTP id f4csp4816877ooj; Tue, 29 Sep 2020 23:23:04 -0700 (PDT) X-Received: by 2002:a19:905:: with SMTP id 5mr278839lfj.497.1601446743370; Tue, 29 Sep 2020 23:19:03 -0700 (PDT) X-Received: by 2002:a19:905:: with SMTP id 5mr278796lfj.497.1601446742057; Tue, 29 Sep 2020 23:19:02 -0700 (PDT) ARC-Seal: i=3; a=rsa-sha256; t=1601446742; cv=pass; d=google.com; s=arc-20160816; b=hPSNhnEj70ejes6CWiOZgo5QC7vzcPNr5vD7bGKkPJ48ZQWDhKeA2GLFKQfC7zTfTF iB1nd4BAEXzlEO1cJzFaBt3MFn5J4jBaCrdghkCiZ8amCJigsdX7rP3Olb5j+4pW5dHe RZHpA5Y8jTNWPhA7TR5QtbeYbV8Mu8HLyOW2wP3rL1NwDkD7mCINfoJsK+uLy2/G0j+4 mw3jiLRRz2b80KdOrNg31eYJEPU2hfHFvKc6UsVSCMRVP3cb0W6covFzMczi52GP8Nuw Jpk10SDimy/fALmf8v5UZAHQVPGS4oGOPs2l9Xa7ZId0iHga+1bfL+nee87nhtcQJCb8 WxPQ== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=/W2pN6jp+XjlGaj4RqH88NZdJt6z1Xz+zgMBgU67CfE=; b=lrmOnQRg6LokG3aZxMHZpcygPhKql/EJtFp20mm/vVvuTLdDcq7zgM2F/2AABJwjVK 1g4UEcU5/JjLvdUKSqJmUGztwMJ1OUtCvmpQ0FY3dL6vTtmdqLRe8NgubUfz0mVGbah7 gdiEUesnhPWTLM5y5UaXDebWriQwk+rUKRuT6JsyrSyZBqOPCLMt+FIx2dLuNUXapWT2 qxmYYe5X1OQpq+0rGDT+IRuR/42Fu3lQOF20cRPqkJ6/9fQAwgE1P8qZ91WRlHx09uN1 rIohzFMt6geD8Q9w9ozSJnWHR2YlprUQg3qBwPsVXx6zVtTxIwgY5uU2zKZhmFcExWWD 7GLQ== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=Tw7Ru5hC; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbvog2d5qkgqertz2g4i@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBVOG2D5QKGQERTZ2G4I@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id p14sor140795lfa.13.2020.09.29.23.19.01 (Google Transport Security); Tue, 29 Sep 2020 23:19:02 -0700 (PDT) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbvog2d5qkgqertz2g4i@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=Tw7Ru5hC; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbvog2d5qkgqertz2g4i@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBVOG2D5QKGQERTZ2G4I@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1601446741; cv=pass; d=google.com; s=arc-20160816; b=SIdCv6caxfg60abr7pqizxMzYNb8ayJdDLZ5arWpg/mEOjx1pItXQFmucKOIKvpJre bXyCYfd/ChUhA5iG0BVluOtNVdRKmUVY/HPrkSRgNXaHms4b6bAC+6Uhmwudg4kTyoM7 S0fy5hfL1CgD6Ac3OyrJb/862f5Q5kPWNKAYCUhaGRLeIepXxQFLor/LUO9YacN3wsbt wZjEf38tvCDl2jQXlkbGe2sB3dZf2L8iPc/Vy+9KeNrsKmTiorTqvl0DEHV21EDYAnW8 nzzr0gPa592JYGesdUCL5F/BmFNt+biWW8pqMW3fcEuM8/cdeNP3o0+yShaCx5fPGVzc goPw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=/W2pN6jp+XjlGaj4RqH88NZdJt6z1Xz+zgMBgU67CfE=; b=J8SEnZt8bNeV3NLSIv+MOIf0Kiq2kBvBBh9z7K5h0ba5TgQu3/CUdNBXxNXDC1nF3t nAyzZVAKC3GKEK3t/SVIejGDFs/d15077E0nt2vxGFSum1Fn+qfIRl149wb77ExH1hVX WBzn1yQcpzXO17y/WLe+7ut5oMWoLcsGemxIGnv+yqp3byGa480IqrtzKsmLV2OQsPlx Mncga271qVNkNPhbYHDo1GMGcqUTCJQqetWU0x5CGY93aSXSn13DXYGDAAQ5SXNugJsm gIQ0X4kNLAHmD3pSFwwQzI9NfsY7fx4xm7JpkG+1/rYRwxA1gFouXYo/DbXO1z7eCObp blvw== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=/W2pN6jp+XjlGaj4RqH88NZdJt6z1Xz+zgMBgU67CfE=; b=Tw7Ru5hClYjVPUidow1cgZh0Klitu+UMS97SvYTxFBGfoJwwA5QQlUhf3J4+o1gNxp XrHQ3V3PAtb5ZWY6sroVbVufbccWPU2Aijz9Uu4unFUqRTG0X1O55WSbSPgL8UybHhnm K5bUEdNjixANddwDE7V0sXRzTXttQTZetPafFNCf0gZTi7/mfJcws6HQVB7IK5eFjQ7k jcRjIsnZI14Jb3Xq5/MQo5yOXlMuVZZFJgt1lyzVJHi9FaNFWcEC3dFAzTP9q/rGzfWY GC7VQh1mxSFc3lbmAwPWKdiCi5knfnPdOCAxTvhHhI4J3lqGAstFRRX/ZQlI3F1GfkLf w00g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=/W2pN6jp+XjlGaj4RqH88NZdJt6z1Xz+zgMBgU67CfE=; b=Jw+tTQ2ixd5oGZoyDAoyzr51GWqtCKODG6ssnz8hnE625x9kf2mtAFUMrpzxnCHBNi 5fyGPOcpihLPVrYhe8kuwHPKxx0+WcxXlS7FQifZ2PZaeLFrTpwGeiKQLms/fvh3IUQ/ xyk9RBsKS7q5s4A6EHnOlqT9dSgYM7hOuojB5MeGRDtxFYUEAdwhQvwvPMK0EVK3ZClv tPhNiUsRi8jbD5kcwaEDUjeaICj9CKTex6idtZxzAOg/v6QNoWnOCHPio9ir4JkuEqZx xsen7Izp5A9pSdsmxONi/ID6R36D5ZGmh6KFF2/5dJgV9taSB4xv7tFEasgOr/iBspJ1 yapA== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM530QExAFrEJnPNPXT0fRnI22TtjAbaUyx//sN6yk7c6S9txaoSGP AubyxJLr3WHCFLbirHyZQeg= X-Google-Smtp-Source: ABdhPJwHfH4sJfk46e3clZ6149E19uFknXTsmyxb4VXLo1Q9sJKmVh7DyLOqSHikdoSzXGnn0zICWw== X-Received: by 2002:ac2:52ab:: with SMTP id r11mr360743lfm.118.1601446741644; Tue, 29 Sep 2020 23:19:01 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a19:c7c8:: with SMTP id x191ls493671lff.0.gmail; Tue, 29 Sep 2020 23:19:00 -0700 (PDT) X-Received: by 2002:ac2:5de3:: with SMTP id z3mr345492lfq.327.1601446740369; Tue, 29 Sep 2020 23:19:00 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1601446740; cv=none; d=google.com; s=arc-20160816; b=qsrCc2VTQYyrp/Q9M4byixt56foE8X96GXM2rd2exsJimmUAcJOapc5FG0ay2SyFiN mQ1T2TJSy3SkeXV0uLxnTCy1QbbZrNXD1gz1JnuU+wnzsu4h4XWcPAO5xiHemAlkei7n DiPt+l8mcE/7VTIk21yIUMObbuRiYRM5+U8QLwkjMlSfI6J1MUWbIZXr2A0sJdgz18rd YNSHAEZz8esh9ZB0xa2pZH1TA7IUEq5sZekncYAcKSkKmMlNZk8PGVSp63KIjbPpX+Z2 uMz0nu0/vWolBtZAywphbJ3wPBqn6VMH0YQ2iI1OC7bhTXpvvdt8M9/2qNa5lS1q1WVQ 1GPw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=WplXIXQFwUYXdKlr0gKnhR+7rW2TCZ95LWfeYAz8gHc=; b=S1/gHi/1dkbwdSievaAwQQX4OGJ4Y6OX85RQvhTbtMUI94O7R4M+/pA9l9/Xeyinbs hWM2jmuaQCVk783s46RRpVgz0bIiutA/U/KBhcfze+r3wWRJFmtGSFRlCNBB5qA7GCSe AKGNCAPaPc6LsOGtXVMlOynjihkjecsnPYGboFYsIPIMrqqsVyQ6WKAVOd6bs4e09Mph 2HfjWGO0jgwrt2s5PsUH/WdiZ5eQMJD+5DAkUQcyNNtTa35fXlMh7Bbxrh3Zzs4B/ha5 M3b1Jz2JzrYOSOUsW7rDOu8CweXS1vZIDJaOPk+lkSzpm2sLSRPhnSqvWGion+0wUylA 6TVg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa3.mentor.iphmx.com (esa3.mentor.iphmx.com. [68.232.137.180]) by gmr-mx.google.com with ESMTPS id r13si14487ljm.3.2020.09.29.23.18.59 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 29 Sep 2020 23:19:00 -0700 (PDT) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) client-ip=68.232.137.180; IronPort-SDR: 5BJWP0A34vNcX+NE/3UI4XO5IOaGuqM6FNuRHLMcI8pM8+jNy5DvO/a7upL4us0QqJ/dtLGi9A jkuqji3IvdTPxUxD97TPaWD5zpKurMbk2WueKiKTw2jBBehWX/bmWuh9IA0JIpIqQbaSJy/gmX 2jEZDPMbUboi/r+0Fs2aiQQTP5wNmrLWHhj2oubBs6RYWAndoyaTfFWPnX3wnB2vhh3i4ikqnJ 2OJnzf4aK5rMT2XGC7Zon9hWNkhNeqoBXWXX2d4KlG/7iXMq3zyobQZnZHA7CYBlowY1SerYAd vWc= X-IronPort-AV: E=Sophos;i="5.77,321,1596528000"; d="scan'208";a="53398670" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa3.mentor.iphmx.com with ESMTP; 29 Sep 2020 22:18:58 -0800 IronPort-SDR: O0afbweHa42n6ThD1yMxsDtBVraeWKRVC8ghA4w1qYn8VIkTogYF5LgnmljhvgeeXB+WLhEQ/O E67w2sQ/H0RbjTM8f5bjocJzZxjSCNuiVZrQ5xEjp/cYtexZc61zF9Hjjz4Z7gOLsa0nHSVqX2 QkjbMNUvKy9B44tpem+qF+licoMgCVLV2ff2sqqxdkm84iEkWcxXL7vtoSsXhYVFjVfFOUU/+s SrwDQHH0MFUtBQBaRV45M5+xMFtQFBlhThajWAZFxjJ3Kcqhcxr48o5pcR4zSl3iVy6Whf4PiR Exg= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v6 09/13] base-apt: Introduce BASE_REPO_FEATURES Date: Wed, 30 Sep 2020 11:48:29 +0530 Message-ID: <20200930061833.13347-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20200930060707.12785-5-Vijaikumar_Kanagarajan@mentor.com> References: <20200930060707.12785-5-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-05.mgc.mentorg.com (147.34.90.205) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.180 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1679238619125688963?= X-GMAIL-MSGID: =?utf-8?q?1679238619125688963?= Eventhough we are collecting the debsrcs as part of postprocess, it could not be considered a ROOTFS_FEATURE, instead a base-apt one. Introduce BASE_REPO_FEATURES, to provide user with control to enable or disable cache-deb-src. Disabled by default, since it is not required for normal offline build to work. Signed-off-by: Vijai Kumar K --- meta-isar/conf/local.conf.sample | 4 ++++ meta/classes/image.bbclass | 4 +++- meta/classes/repository.bbclass | 9 +++++---- meta/classes/rootfs.bbclass | 1 - meta/recipes-devtools/base-apt/base-apt.bb | 1 + 5 files changed, 13 insertions(+), 6 deletions(-) diff --git a/meta-isar/conf/local.conf.sample b/meta-isar/conf/local.conf.sample index 07a7781..ec0a384 100644 --- a/meta-isar/conf/local.conf.sample +++ b/meta-isar/conf/local.conf.sample @@ -181,6 +181,10 @@ ISAR_CROSS_COMPILE ?= "0" # NOTE: this works for amd64 and arm64 targets so far #ISAR_ENABLE_COMPAT_ARCH ?= "1" +# Uncomment this to enable caching of all source packages. +# Without this feature, only sources of packages downloaded with apt:// are downloaded. +#BASE_REPO_FEATURES ?= "cache-deb-src" + # # Uncomment this to enable use of cached base repository #ISAR_USE_CACHED_BASE_REPO ?= "1" diff --git a/meta/classes/image.bbclass b/meta/classes/image.bbclass index 6ca5759..5c2c88c 100644 --- a/meta/classes/image.bbclass +++ b/meta/classes/image.bbclass @@ -63,10 +63,12 @@ image_do_mounts() { } ROOTFSDIR = "${IMAGE_ROOTFS}" -ROOTFS_FEATURES += "clean-package-cache generate-manifest cach-deb-src" +ROOTFS_FEATURES += "clean-package-cache generate-manifest" ROOTFS_PACKAGES += "${IMAGE_PREINSTALL} ${IMAGE_INSTALL}" ROOTFS_MANIFEST_DEPLOY_DIR ?= "${DEPLOY_DIR_IMAGE}" +ROOTFS_POSTPROCESS_COMMAND_prepend = "${@bb.utils.contains('BASE_REPO_FEATURES', 'cache-deb-src', 'cache_deb_src', '', d)} " + inherit rootfs inherit image-sdk-extension inherit image-tools-extension diff --git a/meta/classes/repository.bbclass b/meta/classes/repository.bbclass index 7b6e47b..1f475dc 100644 --- a/meta/classes/repository.bbclass +++ b/meta/classes/repository.bbclass @@ -100,9 +100,10 @@ repo_contains_package() { repo_sanity_test() { local dir="$1" local dbdir="$2" - local output="$( reprepro -s -b "${dir}" --dbdir "${dbdir}" sourcemissing )" - if [ -n "${output}" ]; then - bbwarn "One or more sources are missing in base-apt" - bbwarn "${output}" + if [ "${@bb.utils.contains('BASE_REPO_FEATURES', 'cache-deb-src', 'yes', 'no', d)}" = "yes" ];then + local output="$( reprepro -s -b "${dir}" --dbdir "${dbdir}" sourcemissing )" + if [ -n "${output}" ]; then + bbfatal "One or more sources are missing in repo. ${output}" + fi fi } diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index cfabeae..0aa5502 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -185,7 +185,6 @@ python do_rootfs_install() { } addtask rootfs_install before do_rootfs_postprocess after do_unpack -ROOTFS_POSTPROCESS_COMMAND += "${@bb.utils.contains('ROOTFS_FEATURES', 'cache-deb-src', 'cache_deb_src', '', d)}" cache_deb_src() { rootfs_install_resolvconf deb_dl_dir_import ${ROOTFSDIR} ${ROOTFS_DISTRO} diff --git a/meta/recipes-devtools/base-apt/base-apt.bb b/meta/recipes-devtools/base-apt/base-apt.bb index 8940ae8..506a28f 100644 --- a/meta/recipes-devtools/base-apt/base-apt.bb +++ b/meta/recipes-devtools/base-apt/base-apt.bb @@ -10,6 +10,7 @@ SRC_URI = "file://distributions.in" BASE_REPO_KEY ?= "" KEYFILES ?= "" +BASE_REPO_FEATURES ?= "" populate_base_apt() { find "${DEBDIR}"/"${DISTRO}" -name '*\.deb' | while read package; do