From patchwork Fri Jan 24 09:12:18 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Benedikt Niedermayr X-Patchwork-Id: 240 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 24 Jan 2025 10:12:36 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-wm1-f63.google.com (mail-wm1-f63.google.com [209.85.128.63]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 50O9CZJR012423 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 24 Jan 2025 10:12:35 +0100 Received: by mail-wm1-f63.google.com with SMTP id 5b1f17b1804b1-436328fcfeesf14755865e9.1 for ; Fri, 24 Jan 2025 01:12:35 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1737709950; cv=pass; d=google.com; s=arc-20240605; b=aRbIawdXrTVNPykd281wrJcUO0T228I6sdFTwJ6Hl4QfoozZ9XPDDyn2nMqr9A7LtG AHafp2Scu/YvpW4ZyUj7eT4KKtJh8LltjkmQDEbqUiBDabrAmbISq9QaDzJiDeTCFIPP zzUv6Oj1SQJvF3yrz+dUl+tzM8IfJQ4rDcnshPeX/NMSp0SKhKLW4H4p81FuyE85EL69 YOs+rSmiazJyZ9Igehy8U7q9YrFUkG021tFFpzjSk/dMMedb+HTiINDK7j2tdtu5WMNS jBVYN1M08OdQy8PFk7IVTacKlj7UeexYuvxDjUKnyXvf8lNqVlQFDkUMYQtqwXeKx01t NJXA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :message-id:date:subject:to:from:dkim-signature; bh=8ngVnPn64omX9cfdEWgvGzazTc8A7zIVGXgPKwkU7Rs=; fh=rMy04lU3z2W08ndd/CAFQeSMKZH3Vx5vSSu5Jg0wOfo=; b=aHncXLY8FWeg14HMXaGIiIVOVKSuCtyypp9opSRV7eB0rGcvIvcobyyOgG/n37Uapp OiPWJg7K7VIzuzlnwwFnuAhwnHsAAll55/D+wBEuTAChyfw10Q+DjgSIGXTNekKZPlet mWUpwqlDYHrLoAIpOdq0QmOH5NT7I8WjX8VKU8mCiABINzDmAjbO3cVTFAQcSbWrN5qS zTBoCYHJUoptqdsHvhkk4w+KcJw7j6IuqyapGLBsiidMaHSxmx2Oz04UAjqnRQ6EYDvu Dj4EoRTf32PtQucJ4rpzUlyeLUdbNm38KGaIkyhU3npW0vzDo40brQAm6Mt3vjE5VaQ3 qhNQ==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=Vr8WK6Oo; spf=pass (google.com: domain of fm-1323861-202501240912264da4d39ca57c54404b-rz9vnx@rts-flowmailer.siemens.com designates 185.136.64.225 as permitted sender) smtp.mailfrom=fm-1323861-202501240912264da4d39ca57c54404b-RZ9vNx@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1737709950; x=1738314750; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:to:from:from:to:cc:subject :date:message-id:reply-to; bh=8ngVnPn64omX9cfdEWgvGzazTc8A7zIVGXgPKwkU7Rs=; b=W1ffMkH8lQ4g855XkHFfznffiP+YlLX79VtIcUUe1ZvjONaQLzKajeNNMdT5ZI2F62 izIDMzXFqUXU4wBj2lW4phUEApsJOmormKCbhuKGK6mV7scTn5ls2nt1dPooZTbl4PLT WEccBpQpRuHTikoQ8oORL2oL+oj+k9SpAv8h1EGJuvnxleZMzBIO9EnywrrfUzTcSk/Q JkBdSnBqgvVsOVNryBz14w7uOp8rIAKhNMpcLpFJktc5OYZ9k0G0DDFxJeuL3D0kQFCI MHjaaKui5bnt5Ri9vEI57VgmP/Y3hSTpMHWeK6ZbR9HNhCVXW3knD3icjjVuzuX/wJz4 CGjg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1737709950; x=1738314750; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:to:from:x-beenthere :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=8ngVnPn64omX9cfdEWgvGzazTc8A7zIVGXgPKwkU7Rs=; b=NGtnKyWR8fJtXej/cCrj7wF8OOfU/m5m8dPUSIE+NarBL4gaxJi4noVIT7MvwIpvvN GY5Yz5EUWsHIOLLGA+ncK4Hs66EOlgCdPpt16frlVKIMKRTMzCsIn9Ss/tkOWeCL2pey C5+zfXAhHZJOKO1JiajbiieWVw+TUGDEK3sd7jCDfpzCOqmN4hXZ2BgykvIKYwBEtjvv XOovjJR+RUTjDMWdS2F65YQHEnuY/H6ESm76+az2kdQfhsQ8MBKSYScubo/NxRxKX3HE GRAWmqSbwgNkxAH5k5kJlW8uorzvxBliwLOExM+OVnMRoTBHaagm8+o2FpdkvYxum56Y DUxg== X-Forwarded-Encrypted: i=2; AJvYcCVTOUgwKmZ2+NnfmLUqfyDWJxvDmHagxSFp16Pa8noNZh5VYQgkpSaRIZWrRqWuNQ5cZw1s/yg=@isar-build.org X-Gm-Message-State: AOJu0YyhxOBorkJv6MVFScW5g5WSy5J0mNScec12wnGN+U2XHaCUBsQT aZUHu949JgWrrk9CIethTH8rkaLtfYjKbnDbY6xyeKIpXXxKpxf1 X-Google-Smtp-Source: AGHT+IEGV34ULE9iLwCPfyFxeRHSQ8Fi5L2lsmPsxY07OGEpiStgWbPCC7uEREJtSRE1Ow6pbnPGiQ== X-Received: by 2002:a05:600c:c84:b0:434:a684:9b1 with SMTP id 5b1f17b1804b1-438913c0207mr271967985e9.4.1737709949177; Fri, 24 Jan 2025 01:12:29 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:4b97:b0:436:5d0c:e9c6 with SMTP id 5b1f17b1804b1-438b861afd3ls4413635e9.0.-pod-prod-02-eu; Fri, 24 Jan 2025 01:12:27 -0800 (PST) X-Received: by 2002:a05:600c:1f14:b0:434:f623:a004 with SMTP id 5b1f17b1804b1-438913e391fmr316148115e9.16.1737709946931; Fri, 24 Jan 2025 01:12:26 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1737709946; cv=none; d=google.com; s=arc-20240605; b=EnPOELe8tgSp4FV0X5kDcWUNMEP89an6E3Qcqg5dYpsT052k9R7uyFeDLasEiCDKoN PfxadRDSnM4UzhI6ek23v8rpa7+vNNN6kKmVjCUxT2f+4O4BhMpkZpVZBD/0S4rlp46G 3gkdXK2JnzR/k38jzAkEcn3oo+0NhX2B3yhcfdgxQrXFrWciR/Itpt4CWdvyg7dhczjP xLLYdEiHRVX4AalBSgfOD12l4X3uu7AWiACGdh26fyw/dAqrRHGcnCRtNQdlkejrvGaq uuanZPvRlsGi014tbZZcjf4b40FkwKSSbPjfWn3X3Vvx5KeSHJJBEWdVpx38W85P9xOx lR+g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:to:from:dkim-signature; bh=KpGqOx2gMLA6Dn5s4Pfr0Um4ypPUZPwZTKeDg8HGvi8=; fh=7tclEdh7YbwSQowgJ6LNq720O7H5HTEaqj22NJWRE2E=; b=YQyjArScTsvFY6V5FcE/uc81yuQDFwOPZRYtJv24/dsk4GfRKmVMb5su+oLfja//qo qgvI71byZikToKLc5W8JhYBT00apjWm2eNe1soDAxbrBMhFZnm9KiXvrgc1yLgYVkyyR upKyNOzdnbIwRX+L/KsiZIDuWzN2KTWgNN25CLV1rObitl510BYUNBdUKVum1bMQsoaV CJLCicgFeUHptfKyM/o9jBS0BUDhp+JHk/s2PQ3XTUTYVtfK+vMA5/TzS3TdilHYBlGq 6aTDE0BVh80osmM2Sjc/M/Lk16Ht8CsULfQWqJ/s4BVYGEpCP27ulYe8Wgd6NU6ExyR2 Xruw==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=Vr8WK6Oo; spf=pass (google.com: domain of fm-1323861-202501240912264da4d39ca57c54404b-rz9vnx@rts-flowmailer.siemens.com designates 185.136.64.225 as permitted sender) smtp.mailfrom=fm-1323861-202501240912264da4d39ca57c54404b-RZ9vNx@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-64-225.siemens.flowmailer.net (mta-64-225.siemens.flowmailer.net. [185.136.64.225]) by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-438bd4b988dsi322255e9.1.2025.01.24.01.12.26 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 24 Jan 2025 01:12:26 -0800 (PST) Received-SPF: pass (google.com: domain of fm-1323861-202501240912264da4d39ca57c54404b-rz9vnx@rts-flowmailer.siemens.com designates 185.136.64.225 as permitted sender) client-ip=185.136.64.225; Received: by mta-64-225.siemens.flowmailer.net with ESMTPSA id 202501240912264da4d39ca57c54404b for ; Fri, 24 Jan 2025 10:12:26 +0100 X-Patchwork-Original-From: "'Benedikt Niedermayr' via isar-users" From: Benedikt Niedermayr To: isar-users@googlegroups.com Subject: [PATCH v2 0/1] deb-dl-dir: fix package source download Date: Fri, 24 Jan 2025 10:12:18 +0100 Message-Id: <20250124091219.3489707-1-benedikt.niedermayr@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1323861:519-21489:flowmailer X-Original-Sender: benedikt.niedermayr@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=Vr8WK6Oo; spf=pass (google.com: domain of fm-1323861-202501240912264da4d39ca57c54404b-rz9vnx@rts-flowmailer.siemens.com designates 185.136.64.225 as permitted sender) smtp.mailfrom=fm-1323861-202501240912264da4d39ca57c54404b-RZ9vNx@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Benedikt Niedermayr Reply-To: Benedikt Niedermayr Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= I recently wanted to download all source packages for a specific image and encountered that some of the source packages were missing (e.g. adduser). I tracked the issue down to the deb-dl-dir.bbclass and found that the "is_not_part_of_current_build" function skipped the source package download because the "adduser" package was not listed in the "/var/log/dpkg.log" file. I assume that this package has been installed during early debootstrap and therefore the package is not listed in the dpkg.log file. **As discussed in V1, the issue has been introduced with mmdebstrap, which either doesn't create or deletes the dpkg.log file.** I'm not sure if I got the comment in the function right: "Since we are parsing all the debs in DEBDIR, we can to some extend try to eliminate some debs that are not part of the current multiconfig build using the below method" AFAIK we could also achieve this by running dpkg-query commands on the target filesystem and also catch the packages that have been installed during bootstrap. I'm not sure if this patch will interfere in any way with multiconfig builds, as mentioned in the comment above, but I think it's worth a try. Changes since v1: - Adapt the commit message: Make it clear that the problem has been introduced with mmdebstrap Benedikt Niedermayr (1): deb-dl-dir: fix package source download meta/classes/deb-dl-dir.bbclass | 39 ++++++++++----------------------- 1 file changed, 11 insertions(+), 28 deletions(-) --- 2.34.1