From patchwork Sun Jun 12 23:07:56 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Uladzimir Bely X-Patchwork-Id: 1872 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 13 Jun 2022 09:08:09 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-yb1-f184.google.com (mail-yb1-f184.google.com [209.85.219.184]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 25D788RH027785 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 13 Jun 2022 09:08:08 +0200 Received: by mail-yb1-f184.google.com with SMTP id a68-20020a25ca47000000b006605f788ff1sf4289599ybg.16 for ; Mon, 13 Jun 2022 00:08:08 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1655104082; cv=pass; d=google.com; s=arc-20160816; b=WxRAnSxPVKpZYLU31n94dtz5+DaDZri12B+5WrU6MNPZ8h5jNu5LOAY5yXg3DUbPcN 9xSgEbhF1zYDNjTpZTisYf9wOB4gbOMpwcoLb4zE3QwEt+tGYrxCv4wXz7bJSBGIaES7 BAAqMQZmPiEdguFO8pzZ5bue9RksW8m19gUjG3ZLzqpKezcGcKT2peFtKAmWl2Eh0HWH oFBZfM/DwFJXsVv1Q1YScsEYpvwJ5XBb3dcPVsmTnOF0TvN4xvY9VPkLZUCFAIWrL169 QrhxcHGmNMkYGudFRcCvGgKV7JXC5ULL6e7PybondqiipIZRml7Mm/caC7j1+tT2yA6a i+mw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:to:from:sender:dkim-signature; bh=X7BK9obYS0W5AYesAdvZBDH+dWxdTVhGILFC3l3FdBI=; b=aGt3ew2YMPo3ykJjm78gbaahs3M3SS4kQL0NYss/9ySJ18IaF0zk2gpOQVd2psjFRE 3/68NDrByuAwzk1z8/5BOedfbSPoRbP5uMwfax06Fb+SjKzvuqHwrv5A/VKwg9NtdwxZ /Oq6GPzgBrV1GhJ8bwnCkbw+Uj9tUBxdGtSXI9RbHjBNCP0IpOePiT2iLiHRu8qkQtxh Zg3ficX86TVJzbsNFaujtyIHaKtpBzE23KgiTwzwTHb7Pt2AOZ49uWNTr2msG4IjfLqC hc7gsIlIpti7CUMa3fN5D+Cw1TukaqFn0nN55RibpWV7PF7q27vHQiIGU/QTHgO/IcXA jEdg== ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20210112; h=sender:from:to:subject:date:message-id:mime-version :x-original-sender:x-original-authentication-results:precedence :mailing-list:list-id:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=X7BK9obYS0W5AYesAdvZBDH+dWxdTVhGILFC3l3FdBI=; b=aFKKuVDjuWhFCEB6ei6jmJsmKZ5PQCP8D4BJmofdiW9jcuQsjMGLPDdhXvVWGrYavF xYIZVYYS7l79ISZGOfCEzoLeWK6N6TwFOJt8TnB+cFKiIFG9h6+osQ2srriFerp0xNMJ piMone5f6TKVl6X2cnF8SwJz+C9+LBIYl2JTiNdbVMvY5bIRl1JiBz+cuePIa1LTB6Qc iPG5TB2wDJRA7efT3uu79vgr9DSyQs57nkrTJ5tXrgrbnWtj6KpgcBimUWAzX3Ot0rBV LSinX0vUNu/Vwb6VJttsdYwOfV/mrsXDmhyTV8xR7PFDaiUB8bOswwBWPZcR3DKfOqUs 1G5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=sender:x-gm-message-state:from:to:subject:date:message-id :mime-version:x-original-sender:x-original-authentication-results :precedence:mailing-list:list-id:x-spam-checked-in-group:list-post :list-help:list-archive:list-subscribe:list-unsubscribe; bh=X7BK9obYS0W5AYesAdvZBDH+dWxdTVhGILFC3l3FdBI=; b=ycWs12WHjNZhThVshaZscdE3ko5TR0Yv6bNAXCVo6C4HiQhI+uc5qKjFR8DOm6z8I1 bMPbOsV4IPH/ljp60ZmGxr/UBiQ25wlh2Dvp1WHGDLgNp04nQZ3tVUb4mB/4aQd7eD6L p8GcjobrO2Buh5EAz8Zbr8mzCe3XbmCoOQvjeCzeTyuMG7racR0Xv56JJjeWJyjTvsdj D49T8yDTPPZEEPyhnorlRtLmrbEzP/3prcWD4RzO0yuwgE3QcK7MjohnOqnKk60M+1Tn hX/0MDKdjDoeXAtxxAs1dwwgSmth00vu0ChBLgbWo2Y3whFIcCCESMWS8G32XtrXPNVA hVxw== Sender: isar-users@googlegroups.com X-Gm-Message-State: AOAM5303SZlamilE769/TZhDS9S39IkywAuMBoChTWU31uLByiSSf1qO g2fOl9qTecJJgupN+OA5fJ4= X-Google-Smtp-Source: ABdhPJzN7XjZL2YSWioy84lV8z7XGkPI3D/pQUfPSDKAyw8cKNbKb+YmWsopKEED+AbafzlG9NKivQ== X-Received: by 2002:a25:ce83:0:b0:664:6360:41ae with SMTP id x125-20020a25ce83000000b00664636041aemr15567714ybe.336.1655104082470; Mon, 13 Jun 2022 00:08:02 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a25:73d6:0:b0:65d:5fb3:5381 with SMTP id o205-20020a2573d6000000b0065d5fb35381ls3263428ybc.7.gmail; Mon, 13 Jun 2022 00:08:01 -0700 (PDT) X-Received: by 2002:a25:af48:0:b0:663:60f0:2794 with SMTP id c8-20020a25af48000000b0066360f02794mr42620938ybj.408.1655104081904; Mon, 13 Jun 2022 00:08:01 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1655104081; cv=none; d=google.com; s=arc-20160816; b=FHNXpT89QF/VbUBWE9Xx1Pf4do1MwsX8sQNBmc0bpmclqy88fNbmuiJ7iHgRxGsffZ T0JJ7tlmgWfywkXtVv5m5Ho9OHeRBERQOcoveW7jCTNtpKCbYxf/8zgfb6LQYKmDE8nL FntGklRrQAOAxz8YVMxfQbfQDy8dIYNACZCvpaLSc/L3bKnVE68M+zPTJVTNtsORWly0 GENtD4/UBMDZItLtOH2LyOjXLxDlfnN6iO3zRWyNE7kbqtsVF834pwaqz/FqXllZpr8u Lusbp/RLMhFsbSJq22GG/akWrsuUBH6Uqu4lz4pdmKWZIeaPpXhrGHv/33psfOLoe0yw AFpA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from; bh=gRu9r9LLvzDI0S0swusRZ7ND2pfDiGJDuJqNFbVKEqM=; b=RBNueiQdV9JK4Sjm6Kj3RD1UvnoSemGewJOIlwBx/s3apFWriq77KXsMGULVpe2dse r/gnJojA6fJIZnwAPB+BDaE2FE4eUX4RmJ4Qd/EJ8diidyKRcU1SSYgB7E5G2FzsdpTC WuMZ0qd6CsSu5njtMeoT6Eqy0gXIY1wHfjAOvzp7al8maTKD82dMeSaArQ8+yHOuVia9 PUs4X++tcr0nUIUGbB1TOu+sKCaUqSLaVXhoX8plzD0pbNepjXFK0GZXuZrOMXGwUfiz qzEwk1O83OZKs2NUEWysCAh4G7xlWenbbam28ekHjDU9d1+4MZpXsHvXPHytHR3LJbU4 Nnjw== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id bg25-20020a05690c031900b0031332987bdasi246882ywb.3.2022.06.13.00.08.01 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Mon, 13 Jun 2022 00:08:01 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from baighyz.m.ilbers.de (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 25D77xZ7027766 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 13 Jun 2022 09:07:59 +0200 From: Uladzimir Bely To: isar-users@googlegroups.com Subject: [RFC v2 0/3] PoC for isar-apt repo reusing Date: Mon, 13 Jun 2022 09:07:56 +0200 Message-Id: <20220613070759.16949-1-ubely@ilbers.de> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_MED, DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: ubely@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-getmail-retrieved-from-mailbox: INBOX Currently, isar-apt repo is always rebuilt at second build when temporary files except the repo directory were deleted. This patchset implements proof-of-concept of reusing isar-apt repo previously built. The idea is to check that package already exists in the repo and early exit tasks related to fetching/building. Such approach doesn't remove any tasks from the queue, but changes their behvaior (early exit) in case of existing package found. Using this feature doesn't depend on sstate-cache and requires only local repo from some of previous builds to exist. Changes since v1: - avocado test, not based on build time measure - fixed isar-apt check in compat-arch mode Uladzimir Bely (3): meta: Reuse existing local isar-apt repo in new builds doc: Add section for isar-apt reuse functionality ci: Added test for isar-apt reuse functionality doc/user_manual.md | 23 ++++++++++ meta-isar/conf/local.conf.sample | 4 ++ meta/classes/dpkg-base.bbclass | 1 + meta/classes/isar-apt-cache.bbclass | 69 +++++++++++++++++++++++++++++ testsuite/cibase.py | 42 ++++++++++++++++++ testsuite/cibuilder.py | 7 ++- testsuite/citest.py | 12 +++++ 7 files changed, 157 insertions(+), 1 deletion(-) create mode 100644 meta/classes/isar-apt-cache.bbclass