[0/2] Enable SState cache in GitLab CI

Message ID	20251218073853.41121-1-felix.moessbauer@siemens.com
Headers	show Return-Path: <isar-users+bncBCYIZ4M3XAKRBHG7R3FAMGQER752GAY@googlegroups.com> Received-SPF: pass (google.com: domain of felix.moessbauer@siemens.com designates 2a01:111:f403:c202::7 as permitted sender) client-ip=2a01:111:f403:c202::7; From: "'Felix Moessbauer' via isar-users" <isar-users@googlegroups.com> To: isar-users@googlegroups.com Cc: Felix Moessbauer <felix.moessbauer@siemens.com> Subject: [PATCH 0/2] Enable SState cache in GitLab CI Date: Thu, 18 Dec 2025 08:38:51 +0100 Message-ID: <20251218073853.41121-1-felix.moessbauer@siemens.com> Content-Type: text/plain; charset="UTF-8" MIME-Version: 1.0 Reply-To: Felix Moessbauer <felix.moessbauer@siemens.com> Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com
Series	Enable SState cache in GitLab CI \| expand [0/2] Enable SState cache in GitLab CI [1/2] testsuite: forward SSTATE_MIRRORS into CI env on sstate [2/2] ci: add support for sstate cache

Message ID

20251218073853.41121-1-felix.moessbauer@siemens.com

Headers

Received-SPF: pass (google.com: domain of felix.moessbauer@siemens.com
 designates 2a01:111:f403:c202::7 as permitted sender)
 client-ip=2a01:111:f403:c202::7;
From: "'Felix Moessbauer' via isar-users" <isar-users@googlegroups.com>
To: isar-users@googlegroups.com
Cc: Felix Moessbauer <felix.moessbauer@siemens.com>
Subject: [PATCH 0/2] Enable SState cache in GitLab CI
Date: Thu, 18 Dec 2025 08:38:51 +0100
Message-ID: <20251218073853.41121-1-felix.moessbauer@siemens.com>
Content-Type: text/plain; charset="UTF-8"
MIME-Version: 1.0
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: 
 smmQ12b5ODbBn6whf0gdzch5ucPjdOmIPHi76pdM5Z8I2Jh/ssMB/4FEx/a/00Oom+oDo+unRV3XuLUjoImO0aw7Pvzga7KHpPz7LK7w+ptkhXx6NiPA8XkH/JTYk2yi/FmsaC52eUxpQ7rTbQirJobGhG0PVv9aSWfm6NbuncKt9hYjVkfejtaoIXtw4WyxthYo5/0tn/jWuFUY/W/MHb+u4H1tcoQ+MidRqkmN/6ZEvEo1AZGZdOjFZnvlr/pcJE1GszMeGngVhEKq65vtv84DBbaZpLZqkZx5wo3sHaVuRrdOb4zGVU3hHn3nrmMbdftvGHsNXlGdWFwPGzn7hSRsVFIyb8CReiG5E3LvEFWtGAMWTf0i9WEgbO1OgHFcSZMR8AhRiVjtsTFbWF+q46h3RqkLcvzOZwsT57Hpxnn5JiFID0oHHfM34+C9M08RSDre2pEMnPBtyDLe0nCW4nk0RHU+4NiYRBWohBSXD6dxavvgwlmR2nLZxn2GoIZMjWXyIu46T9D4z7C8EtA6tPmVn+z8bV6mVQ+IW7Yi3ZXzZ5y4RJzjq1CHqqMSlt1Dl7JwdjMKf26qBLb/p82HWoBm8Aqr3tgxccwKKeqaKsw82t7JPCoaglfGBjjo0RhZCXRUVJmE2aEDrXSNYt9gnHCo24Yfx1zXkGkeFpwfHRnmLOU8R1U1tC6zBwiJwT3TMJRBiacCMG5ORH3pHY7SlvqRRWKXIV1Su8IeNzWzdy+AlQe1vkEkh3fIPbyysK2VDAji7o/k2aWbTQLiCGfJ0EMrQ2zrSnlJdzmlvV3SYKd3d9ggRh9pbfM5DOmpXuJrpXEAPZER3PDk07FtwutUMV1ENKLelHjSmSqyXBfu5mDsgfBvhLsIVHjZNoxOrf17bhJq8SFoqjIeu0ku7wokoyd1lNEorvgC4DjORnqcvt6zRwpDKwwdSRsRXfmPZc0UWC4Acu/crhipp9zNDlmtR7jgEDhH7cxawUEXxR2L6XJJ/Xpv2b/9MI9TEGgZZkuQz7t74DWQhyIpxcOCKWIkvlhLC/ICvWrq3Gykmd9WSpW4r8x8Tl2p3bTE2byOjxFgZozaa+VmTkmTaYbowjurX3/vaboZp8xMF5irMRIos4ozB+9RZcVlUlEVMupEVK+D20/xHIaofo2D6FmITOP++q0n+vRcsZyw0MiMFNFpyZ7VP/IX70UoqDcSn8LDTNG9KDHG0SfacT02/muv2GxePaKhZ6CAcgrA+op/KEv50YIRVot40/ZS2cMaMaXV2Od9J2DYWPK7iHrHE+gc1APE939AYX5uP9GbWA0ImMGE5rLq3a7Q/B56CBAFo4zkEeNrThj7O7hNZzseTElQecFaNfL9bd53ecfWwKImGKSUZdUUuECM8wL/1lcrV5Mrchm0AkL1YKVXAV+qw6JI371LmiiNrukdJthiLQZgwjHTJVYYmyieJ4/elvZ2JO2rHeoshxdBOynnjFwurFp82gxrxZYMAetLXt9/s4+X4KJ1lC5cUcb8AeP90dDvnWDbEyL1FTlNgN2o9Ja7/H/BKdMYe7Du1KIrOPsVtRKgS3UEDv49F57q5/9C/NHoN/1wMgZZh1oC3204d9Bh5dzoTQ6GGLwLIBD+eVfWCCaGNtiVdDtFq5dChDd3f2WfbV0a00UaxVEExqqBnDKvZVeFZK/+pA==
X-OriginatorOrg: siemens.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 
 5747c02d-d1d5-4eef-7c49-08de3e08845e
X-MS-Exchange-CrossTenant-AuthSource: DU0PR10MB6828.EURPRD10.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 18 Dec 2025 07:39:03.6089
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: 
 1HJbufB9tEYWQwk7vbwUXK7XSrqvV8SnuTY6i+JKuW6dytE+vADp7NXGHkAK3IS6g2VVD81NfmhYo1zahAKF4fouY3Qf6pPkvbxUCDlMn9g=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAWPR10MB6856
X-Original-Sender: felix.moessbauer@siemens.com
X-Original-Authentication-Results: gmr-mx.google.com;       dkim=pass
 header.i=@siemens.com header.s=selector2 header.b=mcpHoDcg;       arc=pass
 (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass
 fromdomain=siemens.com);       spf=pass (google.com: domain of
 felix.moessbauer@siemens.com designates 2a01:111:f403:c202::7 as permitted
 sender) smtp.mailfrom=felix.moessbauer@siemens.com;       dmarc=pass
 (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com
X-Original-From: Felix Moessbauer <felix.moessbauer@siemens.com>
Reply-To: Felix Moessbauer <felix.moessbauer@siemens.com>
Precedence: list
Mailing-list: list isar-users@googlegroups.com;
 contact isar-users+owners@googlegroups.com
List-ID: <isar-users.googlegroups.com>
X-Spam-Checked-In-Group: isar-users@googlegroups.com
X-Google-Group-Id: 914930254986
List-Post: <https://groups.google.com/group/isar-users/post>,
 <mailto:isar-users@googlegroups.com>
List-Help: <https://groups.google.com/support/>,
 <mailto:isar-users+help@googlegroups.com>
List-Archive: <https://groups.google.com/group/isar-users
List-Subscribe: <https://groups.google.com/group/isar-users/subscribe>,
 <mailto:isar-users+subscribe@googlegroups.com>
List-Unsubscribe: 
 <mailto:googlegroups-manage+914930254986+unsubscribe@googlegroups.com>,
 <https://groups.google.com/group/isar-users/subscribe>
X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED,
	DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI,
	RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED,
	RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable
	autolearn_force=no version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de
X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?=

Series

Enable SState cache in GitLab CI | expand

Message

MOESSBAUER, Felix Dec. 18, 2025, 7:38 a.m. UTC

By running the GitLab CI jobs with SState cache enabled, huge speedups
can be achieved. Example:

Rebuild with 100% cache hits:

+ avocado run /build/testsuite/citest.py -t dev --max-parallel-tasks=1 --disable-sysinfo -p sstate=1
JOB ID     : 3070455808c8c6c4fa78adac9e4c4508fe001069
JOB LOG    : /build/build/job-results/job-2025-12-17T16.59-3070455/job.log
 (1/6) /build/testsuite/citest.py:DevTest.test_dev: STARTED
 (1/6) /build/testsuite/citest.py:DevTest.test_dev:  PASS (449.91 s)
 (2/6) /build/testsuite/citest.py:DevTest.test_dev_apps: STARTED
 (2/6) /build/testsuite/citest.py:DevTest.test_dev_apps:  PASS (307.69 s)
 (3/6) /build/testsuite/citest.py:DevTest.test_dev_rebuild: STARTED
 (3/6) /build/testsuite/citest.py:DevTest.test_dev_rebuild:  PASS (249.28 s)
 (4/6) /build/testsuite/citest.py:DevTest.test_dev_run_amd64_bookworm: STARTED
 (4/6) /build/testsuite/citest.py:DevTest.test_dev_run_amd64_bookworm:  PASS (96.88 s)
 (5/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm64_bookworm: STARTED
 (5/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm64_bookworm:  PASS (61.12 s)
 (6/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm_bookworm: STARTED
 (6/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm_bookworm:  PASS (64.81 s)
RESULTS    : PASS 6 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB TIME   : 1233.72 s

Rebuild without cache:

+ avocado run /build/testsuite/citest.py -t dev --max-parallel-tasks=1 --disable-sysinfo -p sstate=1
JOB ID     : 38c1d4fa508ab774c7774ad404a3575343c59979
JOB LOG    : /build/build/job-results/job-2025-12-17T13.29-38c1d4f/job.log
 (1/6) /build/testsuite/citest.py:DevTest.test_dev: STARTED
 (1/6) /build/testsuite/citest.py:DevTest.test_dev:  PASS (1559.37 s)
 (2/6) /build/testsuite/citest.py:DevTest.test_dev_apps: STARTED
 (2/6) /build/testsuite/citest.py:DevTest.test_dev_apps:  PASS (1429.77 s)
 (3/6) /build/testsuite/citest.py:DevTest.test_dev_rebuild: STARTED
 (3/6) /build/testsuite/citest.py:DevTest.test_dev_rebuild:  PASS (383.64 s)
 (4/6) /build/testsuite/citest.py:DevTest.test_dev_run_amd64_bookworm: STARTED
 (4/6) /build/testsuite/citest.py:DevTest.test_dev_run_amd64_bookworm:  PASS (99.56 s)
 (5/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm64_bookworm: STARTED
 (5/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm64_bookworm:  PASS (62.24 s)
 (6/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm_bookworm: STARTED
 (6/6) /build/testsuite/citest.py:DevTest.test_dev_run_arm_bookworm:  PASS (65.56 s)
RESULTS    : PASS 6 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB TIME   : 3604.21 s

Note: the measurements are on top of the "Various improvements to the testsuite" series,
but the patches also work independently.

Best regards,
Felix Moessbauer

Felix Moessbauer (2):
  testsuite: forward SSTATE_MIRRORS into CI env on sstate
  ci: add support for sstate cache

 .gitlab-ci.yml         | 34 ++++++++++++++++++++++++++++------
 testsuite/cibuilder.py |  2 ++
 2 files changed, 30 insertions(+), 6 deletions(-)