From patchwork Mon Nov 29 04:52:39 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vijai Kumar K X-Patchwork-Id: 1107 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3) with LMTPA; Mon, 29 Nov 2021 15:53:20 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-wr1-f57.google.com (mail-wr1-f57.google.com [209.85.221.57]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8) with ESMTPS id 1ATErJoP003273 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 29 Nov 2021 15:53:19 +0100 Received: by mail-wr1-f57.google.com with SMTP id c4-20020adfed84000000b00185ca4eba36sf2916538wro.21 for ; Mon, 29 Nov 2021 06:53:19 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1638197594; cv=pass; d=google.com; s=arc-20160816; b=y12zCaN8HgpEv9h6vYt1dvaU9E+8wcA26Uz7XwAFw40667KyQn0oqKvyx2UFjqxJhR IZayeuy1IQ2pkv1qWe6rl6wJsOwbuGz7fuO4uaUN2Bl6VwkHrjH8PRTbJk8y58UYDT3H 9TH7JAkigEXnvSk71dcL8RQ3ESRvjJU+uAqT8+/TjTTqOQETvBPDDFqU2brvHQjrPz3k YXQP2jJ7RD3ibIM/AqGPThzEhg6VlGZlyOHRon2IIo/yD1vFbmNbGRgTcwwLwTNLpaLY xorcsr3elwcoAuqXlqG38/RiFF9ZZX4H51V5e/oMvYUJB0PJY6+VYsLJs1eeusTVNdeT 8AyQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:ironport-sdr:ironport-sdr:sender:dkim-signature; bh=mwbgdPxIfg+iUrwOT7r4yxVg4yaTW8iEnZ4g6NwcmOA=; b=M0L2x+2JVoFQg7rTVp+qXToNOim03noSy/75sU32DTYAYHrVeD5xt0+Kr9itFphHCt Zp/vXVzy4/Wc8WFy3hCM37a3cmCHzEJ6wvcvvJfO6FyzufWJQg++mic5n4smM2hRsDLF 7lOfqXZXontcKERxTWkDO3J3fny07WZ5HDGS0VD2772KELcvCwcWSPv6EtbUq5h2AAVg XYlbhGmDxxcvthOba/eMgwgfxzr+GeLdHKZ3XWndpx5m1s8MTiJJ3no9RtlD28+dOkSJ BuCzuXGelJhciII+3iVt04BLoNcEPbOAaP/+UK6SLraGO0Gu/m8EM3HtF0xD7rXOgJuz bP2Q== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20210112; h=sender:ironport-sdr:ironport-sdr:from:to:cc:subject:date:message-id :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=mwbgdPxIfg+iUrwOT7r4yxVg4yaTW8iEnZ4g6NwcmOA=; b=bodMskVEHV+4yL8xfpVptAD5kBxg9HBuujipEkvapX3n/VnN5EnHg5M0HKcKWceues /EL/Iu/hVQoqRcOaK7JfJTh2hZD2fukkBilyx+US1S/qyv/eegkCmTN8vVd677O9buk8 jsi8oCKKCs6cwvo2Gc+uLZ36zk0ACr3xCzcbYo7Lpqnl0JAkdEkH4FM/nspW3Pyj0p3j HRQ70K6rSR8GNoFKPv0qBG33+RRWBrvzVWyYvDqclTA2XbxynPRRTwc1FMHtvn+4wqZZ OR70oI9yVVih4jSrSTZIbsbWfNLlH93Q207yxnxOOx9puSqvtZCFmALK8PqNBqjv8OXr T7eQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=sender:x-gm-message-state:ironport-sdr:ironport-sdr:from:to:cc :subject:date:message-id:mime-version:x-original-sender :x-original-authentication-results:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=mwbgdPxIfg+iUrwOT7r4yxVg4yaTW8iEnZ4g6NwcmOA=; b=ehV2qYOY7yMMPqwls7D2LcvmhYtVSi0Xk6xkdRmpJJPmKUakAssBNlCpuu+z4sThrw DbKJ1AvW+mvJhMpjl0Cs1apn3y9wUW2VoNixKq9jkz6/wMTJ7xQxgqs36JYg9tcH+/Fw wCeO6/jEq/JJfl5LqLR/LkWRLEmMM8i8jO3LNOGZeDOC65yy+cpQTAFEyawpjY8or4Eq sH1RAqTTusVHl9kTdF1q8zQW8EZfE4/Egda9rJG/TXAk/ro6+eCoxoh9SaJ+Q4J9/wSU DD450J7vxRiepLQouEnX6yoV7QEFzDubtDAv7viGO0O6do87VvnUB1OZez+Y0XZaz165 Ed6g== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM533ZPgXCJngiEFuD0qziPSR8ClDhKCGFXtFB2rGOa644NAb7Hv3o dVk3MArx5nGKjsdRcHcuBtU= X-Google-Smtp-Source: ABdhPJxXsoFspWrAa08rmihbRM3bJMCOg1EFLx6tPC2TdS6GHNk8cSg8D1rH7XwPyqvAPDkUUJPPzw== X-Received: by 2002:a05:600c:510d:: with SMTP id o13mr37091851wms.104.1638197594157; Mon, 29 Nov 2021 06:53:14 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a1c:1c7:: with SMTP id 190ls9472153wmb.3.canary-gmail; Mon, 29 Nov 2021 06:53:13 -0800 (PST) X-Received: by 2002:a7b:c92e:: with SMTP id h14mr37039442wml.135.1638197593163; Mon, 29 Nov 2021 06:53:13 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1638197593; cv=none; d=google.com; s=arc-20160816; b=cpkWZdPTOWbn89u+IUVNEUkvwQog62/ZAuHLK0/wKBgDPZM6HxruztxO6w3kvxvs2E LNIwaTumJmtnI5Gn3KwnHMO836/0Zr7mNTbxsom2JOcXHjGZKn5a15l43bd92RytXhg1 GwINBup8ypzAPezfBasHPgOhgvN/GVnCPhY+j9gTmCRInvuq5lbaerKLw3CcN6h0jeea 5g8+9/klmqmtnkLhUxSfxelPdH/ZAI4XsLbqasOw+wqFLl+sSkn0GqtW+EVrHxXV00YK xfMsZvDGpPdA6QoXf5KCH/O2+TJ2i876K9t9dlW9KXe0u/18z5SZwHbKbqm0tdaE0L4q elug== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:ironport-sdr:ironport-sdr; bh=x4eLFmziu9XzvuxfPNLuafXb2GTKyzmAwOin9M5QtXw=; b=vIzm1v91URVZC7b93arE40cN14fsvHCbg4BRaIVvNKE5yKF46EIeUbu/CTx3iNGXR4 RgjCYwPvuzdNgndhBMQlvyVTCkvvX9odNoLKWj3TNzaxL3JaeBioyT/Af2KxYmATIMYW 7TYrU6nQ2Lz0RrlgpapIJZr5ewcbw9DOatk7bI7Pj2ZiWdS1vNjvlBpRBXpDvIEFzxbP z4E56ZrG5WRHMUQ++xyiNM7Xo4k9jLTQWhnQ4dNJQGz8u9dRAe0pKQ24A5wQayrZltwW ZJFNIfUvPCRIfQqQIa9XG6MbzLZAaOBCQ4+ZI9GH1XcgtOQQ2F8zefCL4jyVBhiKB99c hKyA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Received: from esa4.mentor.iphmx.com (esa4.mentor.iphmx.com. [68.232.137.252]) by gmr-mx.google.com with ESMTPS id 125si1841390wmc.1.2021.11.29.06.53.12 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 29 Nov 2021 06:53:13 -0800 (PST) Received-SPF: pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) client-ip=68.232.137.252; IronPort-SDR: XvhY/WmvQNW7pYgkvulhVT93Ya1T0JfP3+i/Fhji8EMpM/Af+ACTZ7re2mGvSl8rnDDxekSsPE tVm4De2mgfT2Kuu3ygHCnMbBp8Y+AJcJVB95e7MQXhck6waH+//pOGBhvubpdoY7J3ClYQMUq7 8V7tAWN/qUKoa2Nc8wBD8dd2VY84dAO2N5IglDSpZE/6DHHjqDfNQd29zyMymyvijuDEooDxnM YKUyieaFD+nG18tqrd87sWub/T2fAdw1388ziGxbsV6pkolgJ64HKbo+hOmWqy4/W+g291M7vN f3pcRpXpraqqRhcJ+e+iluqB X-IronPort-AV: E=Sophos;i="5.87,273,1631606400"; d="scan'208";a="69034259" Received: from orw-gwy-01-in.mentorg.com ([192.94.38.165]) by esa4.mentor.iphmx.com with ESMTP; 29 Nov 2021 06:53:10 -0800 IronPort-SDR: OOgsFH34JZf5OG5+MTuaazj0dg6pOYxDcnFu14ajBVO88fOmuErif4vgQy5Q0ijFao36eBoOnF 4j0omlH5OQaKgzgw8oUcQtEr1VJoyP/9I+TiuO8n5MUu0ytu8UHmxhKtMaqu2fWPFONQgvZOru zEmmd9fktYXvC+xTwuVNyCDqCn19AcRdE4r8XoS1q6c0Iq0uq1sxnnYaOnTsmdHj6W1fkGSgcY VDhYZnfVhiqB0wLnGOJqZaU0PnS2qKWSwXbJToSbYX596ck/kPfTwTWz5Ae2bjHhNxYdfsNfuc jCA= From: Vijai Kumar K To: , , CC: Vijai Kumar K Subject: [RFC PATCH 0/2] Buildchroot non-determinism Date: Mon, 29 Nov 2021 20:22:39 +0530 Message-ID: <20211129145241.2932943-1-Vijaikumar_Kanagarajan@mentor.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-ClientProxiedBy: svr-orw-mbx-14.mgc.mentorg.com (147.34.90.214) To svr-orw-mbx-01.mgc.mentorg.com (147.34.90.201) X-Original-Sender: vijaikumar_kanagarajan@mentor.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of vijaikumar_kanagarajan@mentor.com designates 68.232.137.252 as permitted sender) smtp.mailfrom=Vijaikumar_Kanagarajan@mentor.com Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_MED, DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: INBOX Hello All, Sometimes buildchroot-host completes long before isar-bootstrap-target and proceeds with building packages and populates it in isar-apt. By the time buildchroot-target is triggered, some packages are available via isar-apt and as per the default preference[1], is installed instead of the one from other mirrors. This is not always the case, sometimes there is no such race and the packages from DISTRO_APT_SOURCES mirrors are installed. This makes buildchroot non-deterministic and affects caching. One solution is to provide a mechanism to set preferences for buildchroot. This way, the user would have flexibility to control the mirrors from which certain packages are installed. This RFC introduces 2 new variables 1. BUILDCHROOT_HOST_APT_PREFERENCES 2. BUILDCHROOT_TARGET_APT_PREFERENCES to set the preferences for buildchroot-host/target respectively. Ofcourse, there might be more ways to solve this problem. Happy to discuss them here. Thanks, Vijai Kumar K [1]: https://github.com/ilbers/isar/blob/919fc995fc8ecb675f8bf639ee8628f90728b1ea/meta/classes/rootfs.bbclass#L90 Vijai Kumar K (2): meta: Move aggregate_files to base class buildchroot: Add provision to specify apt preferences meta/classes/base.bbclass | 10 +++++++ .../isar-bootstrap/isar-bootstrap.inc | 10 ------- .../buildchroot/buildchroot.inc | 30 +++++++++++++++++++ 3 files changed, 40 insertions(+), 10 deletions(-)