mbox series

[v10,00/14] Debsrc Caching

Message ID 20201126182818.7261-1-Vijaikumar_Kanagarajan@mentor.com
Headers show
Series Debsrc Caching | expand

Message

Vijai Kumar K Nov. 26, 2020, 8:28 a.m. UTC 
Changes in v10:
- Rebased against the latest next
- Fixed some typos
CI job running here: http://ci.isar-build.org:8080/job/isar_vkk_devel/91/
Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc10

Changes in v9:
- Address review comments from Baurzhan

Changes in v8:
- Fix documentation as per Jan comments.

Changes in v7:
- Document details in user manual.

Changes in v6:
- Rebase against latest next
- Address review comments from Henning
Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc6.3

Changes in v5:
The major changes in this series are as below,
- (P2) Handle cases where HOST_DISTRO!=DISTRO. This avoids mixing
of debs from different distro which inturn helps the src caching logic.
- (P5) Avoid downloading package from other builds.
- (P8) Add a reprepro based sanity test to check if the repo contains
the sources for all the debs.
- (P9) Introduce a new variable BASE_REPO_FEATURES which provides means
to enable or disable various base-apt features. (cache-deb-src for now)
- Some fixes in (P12 & P13)
Also, addressed some review comments from Henning.
Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc5

Changes in v4:
- Use <source package>=<version> format instead of just using <packagename>
to download the right version of source package.

Changes in v3:
- Take care of non-existent downloads/deb-src directory.

Changes in v2:
- Introduced additional patch to cache deb src
- Rebased on top of henning/staging4 tree

Vijai Kumar K (14):
  rootfs: Make rootfs finalize a separate task
  deb-dl-dir: Cache host distro debs separately
  meta: cache deb srcs as part of postprocessing
  deb-dl-dir: Make debsrc_download faster
  deb-dl-dir: Download files only belonging to the current image
  deb-dl-dir: Factor out the mounting part
  deb-dl-dir: Fix skipping of removed files
  repository: Add a sanity test to check missing sources
  base-apt: Introduce BASE_REPO_FEATURES
  repository: Fix failures due to missing section
  scripts/ci_build.sh: Enable deb-src caching
  rootfs: Fix possible overwrite of existing resolv.conf
  rootfs: Handle failures when postprocess is rerun
  doc/user_manual.md: Document details about deb-src caching

 doc/user_manual.md                            | 30 +++++++++
 meta-isar/conf/local.conf.sample              |  4 ++
 meta/classes/deb-dl-dir.bbclass               | 61 +++++++++++++++++-
 meta/classes/dpkg-gbp.bbclass                 |  8 ++-
 meta/classes/dpkg.bbclass                     |  8 ++-
 meta/classes/image-tools-extension.bbclass    |  4 +-
 meta/classes/image.bbclass                    | 43 ++++++++++++-
 meta/classes/repository.bbclass               | 13 +++-
 meta/classes/rootfs.bbclass                   | 63 +++++++------------
 .../isar-bootstrap/isar-bootstrap.inc         | 12 +++-
 meta/recipes-devtools/base-apt/base-apt.bb    |  3 +
 scripts/ci_build.sh                           |  1 +
 12 files changed, 196 insertions(+), 54 deletions(-)

Comments

Anton Mikanovich Nov. 27, 2020, 3:46 a.m. UTC | #1 
26.11.2020 21:28, Vijai Kumar K wrote:
> Changes in v10:
> - Rebased against the latest next
> - Fixed some typos
> CI job running here: http://ci.isar-build.org:8080/job/isar_vkk_devel/91/
> Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc10
>
> Changes in v9:
> - Address review comments from Baurzhan
>
> Changes in v8:
> - Fix documentation as per Jan comments.
>
> Changes in v7:
> - Document details in user manual.
>
> Changes in v6:
> - Rebase against latest next
> - Address review comments from Henning
> Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc6.3
>
> Changes in v5:
> The major changes in this series are as below,
> - (P2) Handle cases where HOST_DISTRO!=DISTRO. This avoids mixing
> of debs from different distro which inturn helps the src caching logic.
> - (P5) Avoid downloading package from other builds.
> - (P8) Add a reprepro based sanity test to check if the repo contains
> the sources for all the debs.
> - (P9) Introduce a new variable BASE_REPO_FEATURES which provides means
> to enable or disable various base-apt features. (cache-deb-src for now)
> - Some fixes in (P12 & P13)
> Also, addressed some review comments from Henning.
> Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc5
>
> Changes in v4:
> - Use <source package>=<version> format instead of just using <packagename>
> to download the right version of source package.
>
> Changes in v3:
> - Take care of non-existent downloads/deb-src directory.
>
> Changes in v2:
> - Introduced additional patch to cache deb src
> - Rebased on top of henning/staging4 tree

Applied to next, thanks.