From patchwork Wed Nov 25 03:44:09 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 215 Return-Path: Delivered-To: ilbers.mnt@gmail.com Received: by 2002:a4a:df02:0:0:0:0:0 with SMTP id i2csp372454oou; Wed, 25 Nov 2020 05:44:51 -0800 (PST) X-Received: by 2002:a17:906:17d1:: with SMTP id u17mr3162196eje.6.1606311891799; Wed, 25 Nov 2020 05:44:51 -0800 (PST) ARC-Seal: i=3; a=rsa-sha256; t=1606311891; cv=pass; d=google.com; s=arc-20160816; b=kyYwBabdSoKLl8v1ZZWGGwv0RiU/RGUN4wIUVFFVfT7Ok9Odjie9CoqiMg4w1b6R89 qGtv0hI87WQTYZEVgY/imNZkoJqP3cI8w0NSgz44bbHYg7hd7kvOq/Se0NLPk+7yozbD GzMPTvNrEwempt1p43Hf8NfV96fBNFmZlJoN8mpATG7Dzpg21KxkM1uKfz5bqP0rfX5J oH3Xa+Bhx0RgEXVDRllmFky3zOrPYFks9R+haSubzKychp+pPlOOF2DGn9ab5S1A4f58 Ctfjv8z7UDjIgCNl8zm4/906MCB3cQWEZk+PTqvhVZZMHYi+3C2iwmcYjOH/2eB5y6HS 4i7Q== ARC-Message-Signature: i=3; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=5cELYBDm0/Zn3S7y5k7pp88YHSl/f/RVvzFDjUvwsJ8=; b=RkDB3OkyJ1f/mPDqnULLmu2M4MiQ5sUoDMFu/YHANwQClRzKEZTvqzGlABkeFGTi/B rCeZAmUS4Pg87Ymj8bZWO/aJ9CQbcHHu6Oq0U/XtZA9Ogk4oY1fuHChrhXL/7xN/9W2E cNdfUWYgJl9CB9qOxTvBpQVrpg8+hfQFhIIVkbeiupmxWLcrl+aoSxTXabNcSqbnn/DW SyJQLL/ABmzYK26wITxX+lyKSou9co995EIPka2fzLcDAvJTbf37fYIqlmugOOV/V7LR LyzurDf7HOhcDPjGHDn4SMD+eypI73V1YCwmPwu8ZP4N3rGIqmqOcVx1p8slwkJrcmRI e2TA== ARC-Authentication-Results: i=3; mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=elIIBdS3; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbu577h6qkgqehzicqsy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBU577H6QKGQEHZICQSY@googlegroups.com Received: from mail-sor-f55.google.com (mail-sor-f55.google.com. [209.85.220.55]) by mx.google.com with SMTPS id t11sor1452478eji.25.2020.11.25.05.44.51 (Google Transport Security); Wed, 25 Nov 2020 05:44:51 -0800 (PST) Received-SPF: pass (google.com: domain of isar-users+bncbcwp7lf37ukrbu577h6qkgqehzicqsy@googlegroups.com designates 209.85.220.55 as permitted sender) client-ip=209.85.220.55; Authentication-Results: mx.google.com; dkim=pass header.i=@googlegroups.com header.s=20161025 header.b=elIIBdS3; arc=pass (i=2 spf=pass spfdomain=mentor.com); spf=pass (google.com: domain of isar-users+bncbcwp7lf37ukrbu577h6qkgqehzicqsy@googlegroups.com designates 209.85.220.55 as permitted sender) smtp.mailfrom=isar-users+bncBCWP7LF37UKRBU577H6QKGQEHZICQSY@googlegroups.com ARC-Seal: i=2; a=rsa-sha256; t=1606311891; cv=pass; d=google.com; s=arc-20160816; b=MO84yHev966aVptllKB3v2hJNhigfcRZ+TsSsuRue9sZyAfsYnweSHOYQ6O/WBxp89 xkGlhlIGmmyizATJZh5juq4o48oPI55ZZofoz8d4B76KllTifzfh6XNbgifR8lskJ+cz XcnH6JygE44fZNZzNClmCy8uaQAj9yXdLQ8Oqg4MlH5GUknUrtKJwWvzkD6ZrX6YfPJI TReFA1ebjCggS7yh5sS/Ry7FnxPkohLbU60T1tWJBSM3r6GlrP33INO0XBbtvXBDyQ15 hhx7OrDaMIqtsqMJFeUeL5mQUoo3SLg7UqPI1SbzilKFEzjdVzq3kHUwgdx9iReIPZnl 1GcQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:ironport-sdr:ironport-sdr:sender :dkim-signature; bh=5cELYBDm0/Zn3S7y5k7pp88YHSl/f/RVvzFDjUvwsJ8=; b=pYlXy8UobtoO4dY5k9sJ5xtep0/Zgk6RGQM9gHwuinKNlRGz3MO/K6Ypif3cy8Jiw4 HRN/zjILtC7QiT7MD/+anwULSr12kV5olX+cY+MAVcXquuvUlntMQF56OOyANXfOtkYP dwORR6uh1ybQ4LVUw10DTk3rMlug34UyqMedQjp7D4C9Gv047JEGqG7Pf8hGrHII2d72 H9LLYe7kG89uYlPDVthCKCJv1BF4jJjOf05MdNeFXZ2pTKp6Zn0Hq9iDnhlfRgntwq3F n1qKKw4ozihQk/NQa6EwxrlWz1wshVW1LI7VstmkkpFHtmQXmaQCGjRxtQ1IzTcXXInA 25Vg== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :in-reply-to:references:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=5cELYBDm0/Zn3S7y5k7pp88YHSl/f/RVvzFDjUvwsJ8=; b=elIIBdS3BiiZB7p9nI5NqylF96TLaQWnEGmj02zWqvwoILgfrvCiSrMyNoWsuyry9G g7L69KFi3NF4p+zeaIP4omuylg8GhcwAMDJIkpdTM2qqGuZuERBfsSc+khEXuzD2BVvt PV+8DnKVsE5rD6bp9nELsGyH8MPnfxAITGC5n5AtCLD11Ckj5t90IMpT+Yx8aRRxLDkf WNYpgFbjd6oTNVDUoO7YMYFf72wsAwpMuf9/Wmiiu8EqtU0GhimzJxcHFo/xNkE143Y2 FFB0cM5HL30uxpsDf9p/yX5nsRgCWrXMTPGg9yu7xP8jhLAaVigGo0orOt+/XdUxW6Os 3OCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:in-reply-to:references:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:x-spam-checked-in-group:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=5cELYBDm0/Zn3S7y5k7pp88YHSl/f/RVvzFDjUvwsJ8=; b=Hp6yX5mrUhzW2UnToPKcfpKqRNKvbunV07uB6ycyyGrdtrKFJoBEH1xT/36nPOnSwe 3GuEWPn71IBBDiLcFx0N933Tea6wWgKoeHqYX3LNzM2tqhyYZkfuXCuSDlaaSRAwrToK c8L5ZyWcYY2t+4JMa85vCsPw9B76grDRR48uRSJq59RZ8XtCQ9x4+DRFeU/6aa+N2OR1 oR4gPsSrh+uHnaPdRmSkHeW1X6pavLtViHRuFCeReW+wK6jkU9io7TjSo5btNVD23j8U PuSeo7CN23PNQEvV6E1F33RHVIzxZG3XnBIeGfqoGX6aLrVlPiZCnUe5txYTRz7o4fub JbNQ== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM531YFLr8lYub7vCHT/6l6oiJDAN/OUKqvFZa/N0SY0V/3KjAxzNC 5WL4BvpOQ8S2FuULqZrLNng= X-Google-Smtp-Source: ABdhPJxcnnNhP3S3CWthbMrHQ7BN0/8gxB4gOVNJVnrnKphND2OC4XisfeBC5EWCvV2GYw/9b2uNaQ== X-Received: by 2002:a17:906:a186:: with SMTP id s6mr3220412ejy.193.1606311891398; Wed, 25 Nov 2020 05:44:51 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:aa7:d151:: with SMTP id r17ls458697edo.1.gmail; Wed, 25 Nov 2020 05:44:50 -0800 (PST) X-Received: by 2002:a05:6402:19b4:: with SMTP id o20mr3538650edz.103.1606311890600; Wed, 25 Nov 2020 05:44:50 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1606311890; cv=none; d=google.com; s=arc-20160816; b=ienTgazD/K9p8IFLmTTMgKBM2X6a8o/Er4bIS5Ea614Dp6BCn6StCcdysghbzmiRJl puzh10rkxkfaJYppSNVXRUhkk+BrlsmITiPFCxNQ4IF6gplNqnV9jBJNwDIkslqFjOZF n6i170OQRZ76oiATofkQXJSs+DjQKHXtIhU86O+4NgKqcJ27F6Q+5TzIdyfX9lMsVVxv eJEY4kGJwQVq5tgrHxVIejwZe17FLGu4606RroEnRs87PxkRhtAMPhWPn0/ffMCI3VHj EyM6pk0j8k1+LKJNnduscKWQrwPUWzJwA3SuvCWDwfllPvdaAhENz8GItzML2ayH4EzX RzXA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:references:in-reply-to:message-id:date:subject:cc:to :from:ironport-sdr:ironport-sdr; bh=WplXIXQFwUYXdKlr0gKnhR+7rW2TCZ95LWfeYAz8gHc=; b=eD5nNJdjiXtfTBDCd6FrgK16Ls8aWkQrvlXUBABmzhYy7hcW6mWXhzv0fV4nV5q0as J8019n/kNb7sPFF8RTuCj7Aofmr0c4m4Rxb20A5dOP0Yg9zzgqfl2nmeJ8dRHVewThhJ KN+u/dxrCHTzyXLO7nPFpOyJCwYFrPZyHxAFjYJOVYElqjdh4EX/mX0uVEclR6AaAvmk RPWLvrSXgt7M+gYO5szGHfX3FUjllIkUN8Z6yUAbwpYyRoGqaYxAjFrNNXFsd0b6UI2E 5KRUrGkaSB335WElvDXpD+ckql8ZhaNo3vKZs/o8M5hh6eCJb91T90JnelvAAdgkBDFU tDkQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa4.mentor.iphmx.com (esa4.mentor.iphmx.com. [68.232.137.252]) by gmr-mx.google.com with ESMTPS id v7si130589edj.5.2020.11.25.05.44.50 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 25 Nov 2020 05:44:50 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) client-ip=68.232.137.252; IronPort-SDR: w/70mdxXftQOsQXs4HBQY5p49SaGs10XrWEEd0D8jJYAqeashzQ7NKOR53/vOrn3KIXajHPl/w aeF6fpPTwEPz4AOE1bNFtFQw7pwvHC7fzEo5lJIuWbzf9tm0ZidqCHcNxiOWaaXgwWZPN/KLhH ewStThb3Ky1Lujvb1NWDL3MQMXEEPJ/1Fi8q4oOaH/ZmdeJlVnWygW2tdVYzzfIAXgKZgF6P6Q EZUfxZ38LDJwjBXm/6Kae15uvEAw4Iz637SmmxeEBq7Yd0E9LxVlYkVLsE89w+nO/A1lOcaoFk 8jo= X-IronPort-AV: E=Sophos;i="5.78,368,1599552000"; d="scan'208";a="55597783" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa4.mentor.iphmx.com with ESMTP; 25 Nov 2020 05:44:49 -0800 IronPort-SDR: dTE+3DbF89EIwtTwwGIGrQ7HC0JwsXDV8dEhhmEdoQ9e61J/TWn8o8pc3u8HVk67gdncp9N2to 4JpcFRLwTzSmAVTXJoeZ0bonF7gp68g95sPMrOaSixl60BLCzXHc+6CNbfuuRKm8JCp8Po+yF1 n+RVe8nASo+3PJdqqXPHPjiNUBMiszBt5PtXLV0cyibebkd7WidM/ErSM8UapLl1w45/azsLlf 21uK+P/hnGa8SvuL89r+N8LgXk3ToLYa679oDHteCCTDn3pzK45+UwrT0Uum6VJubF3GXTKvGj IKo= From: Vijai Kumar K To: CC: Vijai Kumar K Subject: [PATCH v8 09/14] base-apt: Introduce BASE_REPO_FEATURES Date: Wed, 25 Nov 2020 19:14:09 +0530 Message-ID: <20201125134414.26061-5-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20201125134414.26061-1-Vijaikumar_Kanagarajan@mentor.com> References: <20201125134236.25878-5-Vijaikumar_Kanagarajan@mentor.com> <20201125134414.26061-1-Vijaikumar_Kanagarajan@mentor.com> MIME-Version: 1.0 X-ClientProxiedBy: SVR-ORW-MBX-05.mgc.mentorg.com (147.34.90.205) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX X-GMAIL-THRID: =?utf-8?q?1684340098247180390?= X-GMAIL-MSGID: =?utf-8?q?1684340098247180390?= Eventhough we are collecting the debsrcs as part of postprocess, it could not be considered a ROOTFS_FEATURE, instead a base-apt one. Introduce BASE_REPO_FEATURES, to provide user with control to enable or disable cache-deb-src. Disabled by default, since it is not required for normal offline build to work. Signed-off-by: Vijai Kumar K --- meta-isar/conf/local.conf.sample | 4 ++++ meta/classes/image.bbclass | 4 +++- meta/classes/repository.bbclass | 9 +++++---- meta/classes/rootfs.bbclass | 1 - meta/recipes-devtools/base-apt/base-apt.bb | 1 + 5 files changed, 13 insertions(+), 6 deletions(-) diff --git a/meta-isar/conf/local.conf.sample b/meta-isar/conf/local.conf.sample index 07a7781..ec0a384 100644 --- a/meta-isar/conf/local.conf.sample +++ b/meta-isar/conf/local.conf.sample @@ -181,6 +181,10 @@ ISAR_CROSS_COMPILE ?= "0" # NOTE: this works for amd64 and arm64 targets so far #ISAR_ENABLE_COMPAT_ARCH ?= "1" +# Uncomment this to enable caching of all source packages. +# Without this feature, only sources of packages downloaded with apt:// are downloaded. +#BASE_REPO_FEATURES ?= "cache-deb-src" + # # Uncomment this to enable use of cached base repository #ISAR_USE_CACHED_BASE_REPO ?= "1" diff --git a/meta/classes/image.bbclass b/meta/classes/image.bbclass index 6ca5759..5c2c88c 100644 --- a/meta/classes/image.bbclass +++ b/meta/classes/image.bbclass @@ -63,10 +63,12 @@ image_do_mounts() { } ROOTFSDIR = "${IMAGE_ROOTFS}" -ROOTFS_FEATURES += "clean-package-cache generate-manifest cach-deb-src" +ROOTFS_FEATURES += "clean-package-cache generate-manifest" ROOTFS_PACKAGES += "${IMAGE_PREINSTALL} ${IMAGE_INSTALL}" ROOTFS_MANIFEST_DEPLOY_DIR ?= "${DEPLOY_DIR_IMAGE}" +ROOTFS_POSTPROCESS_COMMAND_prepend = "${@bb.utils.contains('BASE_REPO_FEATURES', 'cache-deb-src', 'cache_deb_src', '', d)} " + inherit rootfs inherit image-sdk-extension inherit image-tools-extension diff --git a/meta/classes/repository.bbclass b/meta/classes/repository.bbclass index 7b6e47b..1f475dc 100644 --- a/meta/classes/repository.bbclass +++ b/meta/classes/repository.bbclass @@ -100,9 +100,10 @@ repo_contains_package() { repo_sanity_test() { local dir="$1" local dbdir="$2" - local output="$( reprepro -s -b "${dir}" --dbdir "${dbdir}" sourcemissing )" - if [ -n "${output}" ]; then - bbwarn "One or more sources are missing in base-apt" - bbwarn "${output}" + if [ "${@bb.utils.contains('BASE_REPO_FEATURES', 'cache-deb-src', 'yes', 'no', d)}" = "yes" ];then + local output="$( reprepro -s -b "${dir}" --dbdir "${dbdir}" sourcemissing )" + if [ -n "${output}" ]; then + bbfatal "One or more sources are missing in repo. ${output}" + fi fi } diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index cfabeae..0aa5502 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -185,7 +185,6 @@ python do_rootfs_install() { } addtask rootfs_install before do_rootfs_postprocess after do_unpack -ROOTFS_POSTPROCESS_COMMAND += "${@bb.utils.contains('ROOTFS_FEATURES', 'cache-deb-src', 'cache_deb_src', '', d)}" cache_deb_src() { rootfs_install_resolvconf deb_dl_dir_import ${ROOTFSDIR} ${ROOTFS_DISTRO} diff --git a/meta/recipes-devtools/base-apt/base-apt.bb b/meta/recipes-devtools/base-apt/base-apt.bb index 8940ae8..506a28f 100644 --- a/meta/recipes-devtools/base-apt/base-apt.bb +++ b/meta/recipes-devtools/base-apt/base-apt.bb @@ -10,6 +10,7 @@ SRC_URI = "file://distributions.in" BASE_REPO_KEY ?= "" KEYFILES ?= "" +BASE_REPO_FEATURES ?= "" populate_base_apt() { find "${DEBDIR}"/"${DISTRO}" -name '*\.deb' | while read package; do