From patchwork Mon Jul 22 10:39:17 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "MOESSBAUER, Felix" X-Patchwork-Id: 3713 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 22 Jul 2024 12:39:33 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-lf1-f63.google.com (mail-lf1-f63.google.com [209.85.167.63]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 46MAdXIo020082 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 22 Jul 2024 12:39:33 +0200 Received: by mail-lf1-f63.google.com with SMTP id 2adb3069b0e04-52efcb739adsf1468808e87.2 for ; Mon, 22 Jul 2024 03:39:33 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1721644767; cv=pass; d=google.com; s=arc-20160816; b=Pi5eaOH8F24/z1zrsIkI8Q0gO/3kseV8AsEIDlOH+cujKGh5Y9kh1np0SLOkuZBO6S zNKwZerailMr+iD0ZjYwMq93ZZrXRTjYTWKrV28MDNa17nCo9iu8rpdjMXqXP5sLW6OP mbnfhGjrZocJB10Od4TMlvTIkYLCZgUbCHADlL0GCnDYFK1Xq1mT5UE6DQi5qlQfDtLo wumoqX/XoYZItkUxfAfxv31SMf9Dn4tK8agiITbU2IR3bJGSrfUU3/WCGaKB8tVQykyy vSzj6cr7wAaOnIWloaE1+MEAP9mhKu2dSh32qDEOIR5E0GADIOcOWavLylvyKNOrRXuH +m+g== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id :content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:dkim-signature; bh=/DAuGzu1VrmV9rSML76KTLdDfguZNR4l1f661LKehFI=; fh=+3DgpLTxHHa/Qq+VxCoX9ZVmg00CO+HJGQ+N9nXCs/w=; b=sJR01ZPBKyK+FU7nYnOYPBnaJWIQphLHC9pHTt/cRLId2+93CqvNjQdaCoirJ39u10 g+/NcIuGsFZcUgs8jAr5soHSM26BWddbKhwWh+wmce/nfYRDvUyUau0DGfb7Y9Susym/ zkqpTBOFiuUpbGKW98bREl7dsb3A01cej9XVJR9yUJnqh2pOZ0GO86QSA6c82PCazDcP JTFrhk28hHJSZm9peXKIPrLfOurvESjwOEAahV3glXEsskQhdzEpTZswq0iqiTOGfcWr e30Q9RcU5xpw79u7gpDU5uklust/xMBcUSD7eze7UAxWKgbU+oKxE+t/TfKlx4rPFlf+ sHjw==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=SuuHMWWy; spf=pass (google.com: domain of fm-1321639-2024072210392325fdf3484f3519e476-5jdwif@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-1321639-2024072210392325fdf3484f3519e476-5JDwif@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1721644767; x=1722249567; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=/DAuGzu1VrmV9rSML76KTLdDfguZNR4l1f661LKehFI=; b=m31Tqt2ybxPIeuQKbC89N1N6cSEVXT62bpM5HLau+saEaiJqNC6GfEh/gd4ywvbMAD YRo9k16vnFHU75pwRWrieegXSia+UK3o1+lnvmAEk3B4Hr/jtPFOSY4MY8bn3BoSCGX5 /m++SOjFK+Cka1ldIuxBJF1cd6b7KSIW0LDda3ZJUgOg+upm+e1L49x6XjLYfKscI41v o8369Rl4YMz1EXFs53xB8DqN0h9uywcW9X3CBNxOyU3279U5kWpR7xcbvYcKky/lisa7 +s6DNhrVlLdC+mzroxJ451dl+4jj5CrhEFsqOW/DId4nHUdUk+OXo+tdJuKkYtyxSKmU Z3KQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721644767; x=1722249567; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-beenthere:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=/DAuGzu1VrmV9rSML76KTLdDfguZNR4l1f661LKehFI=; b=Eu3+Ce8d+Cacu7L4ZMZj9I1VsqYhbftIUg6IjhB6vOsWcgthE/G7BMyHQt+b97OrL4 w1PJiNfj0725DJE8vBnBnhTnEZUgoBNUBW9LRVKZYKN2g2Cw6gR6h8TORw3yITHePK7Y viocz3lx1nNTWot0jC0s9fgR0qcobfqKaZWfVS7CX45rmrUZWTL2FWP7LMp6XkFg4wai YdDv037DTgWBQnx/hXLPa8qALZxOp4IcinzN6GJ+28F1Y6A6mwG4RMxWFswbpMbHNK1q qfnZm/iauqFxtDCiu5jItXGlSuLBnGi+0P0GBCaRw0A6YeXFw7FGZy6fPPdWqsvhNT6p WJ4w== X-Forwarded-Encrypted: i=2; AJvYcCU9bCCkyWYt/GtBIjAaU1HnrRoMJUcfM25JXsNxWW/B8B+rw0vhcv9ODiO+tfghFOvh/XVXu06giBcx2dcXvkx1T58HCYs= X-Gm-Message-State: AOJu0YxXzX6BuXclhc9+UGPYePGg2xzQBG88r+LXUoK1uMnjnWMUOsyU OAPBSS7C++K9JLskOCjp5tCH9WC92TzD57YfnYyVwBWteEQkh3tN X-Google-Smtp-Source: AGHT+IF74jAFcD+1FhYdx9PTDaPRRhVAlewPn5oq56sHYtP0t4gjLmxqTp8vZdTDsxNZgqXeXFMvRw== X-Received: by 2002:a05:6512:a83:b0:52e:9ba5:9853 with SMTP id 2adb3069b0e04-52efb7bff8amr4734059e87.24.1721644766824; Mon, 22 Jul 2024 03:39:26 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:2316:b0:52f:286:27f9 with SMTP id 2adb3069b0e04-52f02862defls371466e87.1.-pod-prod-07-eu; Mon, 22 Jul 2024 03:39:24 -0700 (PDT) X-Received: by 2002:a05:6512:ac8:b0:52c:e10b:cb36 with SMTP id 2adb3069b0e04-52efb816426mr3252680e87.33.1721644764477; Mon, 22 Jul 2024 03:39:24 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1721644764; cv=none; d=google.com; s=arc-20160816; b=aPlKSaFFJJDrofco8kp3OWMM19mimvB2AAGKH0GMOICOpjXSaRueyrSokSKV4d7qUH jiIMmWPj4BvKVgJftCoP2wO02xsSRKP01vS7PKScpdFmAT2Cfp7PEQpFKuWVCSEi2eba VLqyZ1hH6Cgp6d2OFoBbYaVzNB+NsUIEGVv+cxhhrkYnJqS+x9v18F7gEqR7wDZYTYrm +3Pl2CnsUjxrbet5b0GHcrGandzJRMiYFMEBbmgL8MTQs43gb0VmDisBHEsLx+x6Tbb7 GNI2H8CfRCp9tYcAa58FvKqkjktpmNUV7foRhbww/waTrjkxe5xetQBdFDiGS6h3i1vO mw2A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=iwzeFneVc/WuPpOS9ddrNbBsasyvcMSFE1PkspkMurU=; fh=y4Q4sSo60XIDMfQl4kOzeqW/gQkja1RlhaZM6hZs/O8=; b=ZFELP243B2Jq60qkx0fKUMXy83/cA6dS9RoJLZgCaqb+8nuYuJq5wwcR6PledMySE1 R3OljgDGOoh89b+QmEcA6L0KwHr8Tx6aKG9q3lLVdvUBHqIeCtyre0vgdC4h8USn7Un/ FPTWNGO2GbAh3Cwa2O3RX6jzVrAsMeYV3Z9IDiSK4kkNmR6wp+HUYkXCTpcxlgUVbKua fvFgLI9s2FbfXIpDlmWlFiq4Kv7Uy/X06wm3PiVnIq71j3KTQcgwKR58lc2BzetoJkf4 ic85f/p3lh6paYFLI2Q60/9n8gF40DzzSAlOLxqvYZY5jHfIo0cVicD1bJsXffqs+D8O Be3w==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=SuuHMWWy; spf=pass (google.com: domain of fm-1321639-2024072210392325fdf3484f3519e476-5jdwif@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-1321639-2024072210392325fdf3484f3519e476-5JDwif@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-65-225.siemens.flowmailer.net (mta-65-225.siemens.flowmailer.net. [185.136.65.225]) by gmr-mx.google.com with ESMTPS id 2adb3069b0e04-52fc148f7a4si15998e87.6.2024.07.22.03.39.24 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 22 Jul 2024 03:39:24 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1321639-2024072210392325fdf3484f3519e476-5jdwif@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) client-ip=185.136.65.225; Received: by mta-65-225.siemens.flowmailer.net with ESMTPSA id 2024072210392325fdf3484f3519e476 for ; Mon, 22 Jul 2024 12:39:23 +0200 X-Patchwork-Original-From: "'Felix Moessbauer' via isar-users" From: "MOESSBAUER, Felix" To: isar-users@googlegroups.com Cc: Felix Moessbauer Subject: [PATCH 1/1] add var to configure apt rate limits Date: Mon, 22 Jul 2024 12:39:17 +0200 Message-Id: <20240722103917.628994-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1321639:519-21489:flowmailer X-Original-Sender: felix.moessbauer@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=SuuHMWWy; spf=pass (google.com: domain of fm-1321639-2024072210392325fdf3484f3519e476-5jdwif@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-1321639-2024072210392325fdf3484f3519e476-5JDwif@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Felix Moessbauer Reply-To: Felix Moessbauer Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= This patch introduces the variable ISAR_APT_DL_LIMIT which is used to control the rate limit of apt. Signed-off-by: Felix Moessbauer --- RECIPE-API-CHANGELOG.md | 5 +++++ doc/user_manual.md | 1 + meta/classes/rootfs.bbclass | 4 ++++ 3 files changed, 10 insertions(+) diff --git a/RECIPE-API-CHANGELOG.md b/RECIPE-API-CHANGELOG.md index 12ea93ec..65cd98b3 100644 --- a/RECIPE-API-CHANGELOG.md +++ b/RECIPE-API-CHANGELOG.md @@ -629,3 +629,8 @@ into kernel kbuild package. Only the "host" specific package is built automatically at cross builds. * Support emulated module build with cross-compiled kernel for linux-module + +### Rate-Limit apt fetching + +When downloading from debian snapshot mirrors, rate limits might apply. +To limit the amount of parallel fetching to n kB / s, you can set `ISAR_APT_DL_LIMIT="`. diff --git a/doc/user_manual.md b/doc/user_manual.md index 776ae52c..22d39073 100644 --- a/doc/user_manual.md +++ b/doc/user_manual.md @@ -433,6 +433,7 @@ Some other variables include: - `HOST_DISTRO_BOOTSTRAP_KEYS` - Analogously to DISTRO_BOOTSTRAP_KEYS: List of gpg key URIs used to verify apt bootstrap repo for the host. - `DISTRO_APT_PREMIRRORS` - The preferred mirror (append it to the default URI in the format `ftp.debian.org my.preferred.mirror`. This variable is optional. PREMIRRORS will be used only for the build. The final images will have the sources list as mentioned in DISTRO_APT_SOURCES. - `ISAR_USE_APT_SNAPSHOT` - Use a frozen apt snapshot instead of the live mirror. Optional. + `ISAR_APT_DL_LIMIT` - Rate limit the apt fetching to n kB / s. Optional. - `DISTRO_APT_SNAPSHOT_PREMIRROR` - Similar to `DISTRO_APT_PREMIRRORS` but for a snapshot, pre-defined for supported distros. - `ISAR_APT_SNAPSHOT_TIMESTAMP` - Timestamp of the apt snapshot. Automatically derived from `SOURCE_DATE_EPOCH` if not overwritten. - `THIRD_PARTY_APT_KEYS` - List of gpg key URIs used to verify apt repos for apt installation after bootstrapping. diff --git a/meta/classes/rootfs.bbclass b/meta/classes/rootfs.bbclass index 2e091e0c..fdb25eaa 100644 --- a/meta/classes/rootfs.bbclass +++ b/meta/classes/rootfs.bbclass @@ -111,6 +111,10 @@ rootfs_configure_apt() { mkdir -p '${ROOTFSDIR}/etc/apt/apt.conf.d' { echo 'Acquire::Retries "3";' + if [ -n "${ISAR_APT_DL_LIMIT}" ]; then + echo 'Acquire::http::Dl-Limit "${ISAR_APT_DL_LIMIT}";' + echo 'Acquire::https::Dl-Limit "${ISAR_APT_DL_LIMIT}";' + fi echo 'APT::Install-Recommends "0";' echo 'APT::Install-Suggests "0";' } > '${ROOTFSDIR}/etc/apt/apt.conf.d/50isar'