Message ID | 20250310115149.1977443-1-srinuvasan.a@siemens.com |
---|---|
Headers | show
Return-Path: <isar-users+bncBCSPNL5H7MGRBRVEXO7AMGQEMGHOBHQ@googlegroups.com> Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 10 Mar 2025 12:51:41 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-il1-f185.google.com (mail-il1-f185.google.com [209.85.166.185]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 52ABpeva009898 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for <iupwgm@isar-build.org>; Mon, 10 Mar 2025 12:51:41 +0100 Received: by mail-il1-f185.google.com with SMTP id e9e14a558f8ab-3d054d79dacsf88426145ab.2 for <iupwgm@isar-build.org>; Mon, 10 Mar 2025 04:51:41 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1741607495; cv=pass; d=google.com; s=arc-20240605; b=EKzBVtWY5Uvirq+0RrDPEt85Y1DQjyCPsSeY7LJttThmiS2RDNCXIiP4LDbEFyXoTa gJXr/mk7seLLbt9/bAoi6vEjmJcilp2w2ojJWE73QSKSMPJRs+nHIXRqltrzPQEYtYLO 3/4lli7tKbmey75ONqI2JGxpBBJ94t5z4W5s/uBOr1ICfs++t0NK2LhlCPC1dBj1nX/2 PUkbrwD2KO53dJ5+/30Qh+j1ZAsUxttAJajBj0MSd+RrtaKAv4H+LXLGPvQK3W0UAFaT +/KqXnwdDQlHHx5Znql1Shzpyt6nqJ0TfivWfnEdqVjygwSjavac3ZE0uh4vgCDncQjB dXZA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=B/r5ivivMjuMOS9e2pGGkFZNG2MRe5vuOC6BkRSFPzw=; fh=voG2iCiABRX6RstUvNVrPUSFA7XGBX9+HU4a5iqDFIk=; b=F0lzKL5As+JrXwXYbUQg0OZnEgy4j8r/mP+YmechicMwmh2xzjYNlfDG5Wqe2NbA2v kmw2o+tw26oQYsQTlpygilf4I0SYCxhPp8bjOaxMwPV/GMbQZa3lbxEqdFfPFaLWffBi xY/Q65pz0Uf5B61eNTRAs7REifRQqX8I5nPt7ZY2PQkvzSiRzvI6zrlIGBX4WNzxBfna 9WBEaCIDBWM/iYx+kM7rfEcI86ihWP2Zc7dtCq1ih4eyG9AwwdMNzNNrhNBaO9Ol2m6a UFaNneltjpQcw+Sm2qOjkVXHEROEobp4DkPskwB3TBwnDpPRt/82+Vk/R8RUfIFzZsuA mySQ==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Ds+i+4Nn; spf=pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1324425-202503101151289e97932d3717106a7f-DYH3sa@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1741607495; x=1742212295; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:from:to:cc:subject :date:message-id:reply-to; bh=B/r5ivivMjuMOS9e2pGGkFZNG2MRe5vuOC6BkRSFPzw=; b=uL+/Y+vsoQ05lLQK4zL9LgHYHwDT1lVpwTKQNsqJezCngOLcHS4NZ0SlsCD38Rh6t8 SQobrhhr/4hE+CWJ62moxuMFfzLlEnoAPnMq19gT7mvtvDZ4PKD2tERM9BC7dLQS9xIh Q8CQY7YWsA2JkWqGdf9rhhmIMFJ6/53h56W2ZKRaVbHeIezcTeC9LeA+li+y4jzFCYsI VNUJbY0ZODT2/fmzo3pBxxFjjd9AuLO76BdIN8UC016zF4eq4aQXTefFs8PtuGzdWI/L Uq85LNl6TN85OnyI81p1wA/R+Yi40veEgOkEQyAF6QKRVzBVfxyloJRedpVBFjOnTzNb j72Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741607495; x=1742212295; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:x-beenthere :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=B/r5ivivMjuMOS9e2pGGkFZNG2MRe5vuOC6BkRSFPzw=; b=Wwbjnb3eoPJi0tVPw7twqpqHr66Q3IZIHXDJPoZZWwwCwIkpEyvXcUZKji7oXWRhL2 PzVUb8Uh0FrCCDA1OiPdzrFhVlwGh/Dt0Y6fziP2yGEaTv+4V4vrO+YSAGhk78wOpFPa iGbTl122tduykQo63dCAybsyEDm6zdwKCb89yirnf6fZ9Zn6Qdi+LgZ/K5svAXGI4+UP iZSnJPtUh7AN6/2EJBLU/x6PC8dai0hpPpEivWfCjYRS+VxsFJKd4N+tT2G0Rfq9KFgx MfdbLjG2ORQ6MXzC61zyy0M0W1TjkJE3//cCThX6UXVnf+oB7WRMnE3RwTdxSsIF4tVB T0/w== X-Forwarded-Encrypted: i=2; AJvYcCVUM7VOQgeYA4BzAxm8OqMMIeFj58Uv1Mgo6Wv54/FmTmacIckvcVQRi8NqkHNz+DhjD+D+fyw=@isar-build.org X-Gm-Message-State: AOJu0YyfHIm+XIiubNlBhPBjuJQmRtZhvcPPriwLTFHQ/teO1NWRuVuy 84qVApYmyume+ng48LG8uHxJvaZF3N+1gse5PgkHFp+bmN/d0FWn X-Google-Smtp-Source: AGHT+IEUYbIYx70/c3Snugt70ejeMCelRbbYgRPIhcOBHMwd9yhsiDOdf+2vy957/QAIqVVRno2KBg== X-Received: by 2002:a05:6e02:144f:b0:3d2:aa73:7b65 with SMTP id e9e14a558f8ab-3d44193d19emr152001845ab.6.1741607494997; Mon, 10 Mar 2025 04:51:34 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=Adn5yVH1QwVRIuBikB615mOYPST9fnACvGug4pamIwLM78xcDA== Received: by 2002:a05:6e02:3003:b0:3d4:58a3:f62 with SMTP id e9e14a558f8ab-3d458a310f4ls16351685ab.0.-pod-prod-01-us; Mon, 10 Mar 2025 04:51:34 -0700 (PDT) X-Received: by 2002:a05:6602:4816:b0:85b:59d4:b00 with SMTP id ca18e2360f4ac-85b59d41073mr265228039f.0.1741607494043; Mon, 10 Mar 2025 04:51:34 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1741607494; cv=none; d=google.com; s=arc-20240605; b=TB9qRpSzGerUPreW7tKbmF8XTTMk1UOyhKZGTybg9fHKRcvYBd01iskFfXUFNu9ax6 Sn7YcCBDQ3RlENHfN7ngHg1BaI1KZnt7U022+/wzGQYiOQiGzX+2jyisIW8lerI6SHNn 1xwj0JZV4pmnUz+nDIOx/hf8M+DUUbgPWZT5N5hHSB+481JFsvJGkqAD8nvO12i0WR/i 9x1W4604XIA3jMnDOJK+QiSN9USpPodqpEbet0fegvQpu3v1nMKPndCpOfb9XZ2xfjoV 7JKFuaaB1xRhw9MytCkYEt1XEyWfglNIg13UdQDKcjp75E7mLe069ci5PqbhoQTKPL8n zmYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=bW4JSlH2OlXsbnFsKoGa0T2ULhgndL2zstJFim7d4ys=; fh=vSDejBuUD8kp+mUPb3rALatMrpk6EntwGWFTmK/3QX8=; b=OxiEJhKbOmXELBBmbzRD4aicew/t4OfBffeK8mdgVoStR0sh4SCBeqNWzuJVOXloyY 0TwVqZDYjOmNjrps2ZpDiCUGzOK4a9VTJHDvzEeAKZ17TtN7ryHQj9KPOcd8tCi6nNhu QP2mmsikF45mI9UE8rITgLnb9jvYllIBnYyXAW9E1N/A/vgjNBiN6wYk1ljT5/4SYsKm 3AFnk+j3pGhhn+cUrAx90E9ud4NUoYBFsEgg7j1tLmPaDuJJCjBBkI9R3K4lCV777j9n wR2wldjVfCms8O+ySilQ4NeZyINZamqtod9cRM/NfzaP17hHlxR3KNrIjP2TmL8FL5t5 Hg7g==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Ds+i+4Nn; spf=pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1324425-202503101151289e97932d3717106a7f-DYH3sa@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-227.siemens.flowmailer.net (mta-64-227.siemens.flowmailer.net. [185.136.64.227]) by gmr-mx.google.com with ESMTPS id ca18e2360f4ac-85b3dbe397bsi14421439f.1.2025.03.10.04.51.33 for <isar-users@googlegroups.com> (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 10 Mar 2025 04:51:33 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) client-ip=185.136.64.227; Received: by mta-64-227.siemens.flowmailer.net with ESMTPSA id 202503101151289e97932d3717106a7f for <isar-users@googlegroups.com>; Mon, 10 Mar 2025 12:51:28 +0100 From: "srinuvasan.a via isar-users" <isar-users@googlegroups.com> To: isar-users@googlegroups.com Cc: jan.kiszka@siemens.com, cedric.hombourger@siemens.com, ubely@ilbers.de, benedikt.niedermayr@siemens.com, Adithya.Balakumar@toshiba-tsip.com, srinuvasan <srinuvasan.a@siemens.com> Subject: [PATCH 0/1] Fix deb-src caching issue Date: Mon, 10 Mar 2025 17:21:48 +0530 Message-Id: <20250310115149.1977443-1-srinuvasan.a@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1324425:519-21489:flowmailer X-Original-Sender: srinuvasan.a@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=Ds+i+4Nn; spf=pass (google.com: domain of fm-1324425-202503101151289e97932d3717106a7f-dyh3sa@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-1324425-202503101151289e97932d3717106a7f-DYH3sa@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: srinuvasan.a@siemens.com Reply-To: srinuvasan.a@siemens.com Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: <isar-users.googlegroups.com> X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: <https://groups.google.com/group/isar-users/post>, <mailto:isar-users@googlegroups.com> List-Help: <https://groups.google.com/support/>, <mailto:isar-users+help@googlegroups.com> List-Archive: <https://groups.google.com/group/isar-users List-Subscribe: <https://groups.google.com/group/isar-users/subscribe>, <mailto:isar-users+subscribe@googlegroups.com> List-Unsubscribe: <mailto:googlegroups-manage+914930254986+unsubscribe@googlegroups.com>, <https://groups.google.com/group/isar-users/subscribe> X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= |
Series |
Fix deb-src caching issue
|
expand
|
From: srinuvasan <srinuvasan.a@siemens.com> Dear isar-user, When we enabled the deb-src caching during base-apt creation, we noticed a few deb-src packages missing in the pool. Missing deb-src packages categorized in the below stages: 1. bootstrap related deb-src packages 2. imager related deb-src packages 3. image rootfs related deb-src packages This regression we found after mmdebstrap migration, this issue addressed in the below patch series, for more details, please refer to [1]. but here we use the /var/log/dpkg.log file to ensure the parsing of deb (from /var/cache/apt/archive) is installed or not. By default, mmdebstrap deletes the /va/log/dpkg.log file and we enabled that option in [1], but our images are becoming longer reproducible. Meanwhile, Cedric proposed one change to remove excessive calls to dpkg-deb in debsrc_download, refer [2]. Here he completely rid of the checking status in /var/log/dpkg.log file and introduced the ftp-aptarchive to scan all the deb packages and download the src against them, i feel it is more robust and works for all the stages. With his patch i validated the deb-src caching, now we can able to download the src packages for bootstrap and image related packages only missing part here is imager related packages, this one is addressed with a refactor of my patch 2/3 in [1]. Validated for amd64 and armf, it seems deb-src caching working fine and able to see all the deb-src packages. I hope the combination of Cedric changes [2] and mine is the better solution for this deb-src caching issue. [1]: https://groups.google.com/g/isar-users/c/8QstIaudyts [2]: https://groups.google.com/g/isar-users/c/OwrSBmCPe0Y Note: [PATCH 1/1] image: move deb-src-caching functionality after image creation heavily depend on [2]. srinuvasan (1): image: move deb-src-caching functionality after image creation meta/classes/image.bbclass | 8 +++++++- meta/classes/rootfs.bbclass | 3 ++- 2 files changed, 9 insertions(+), 2 deletions(-)