[2026-11-14T08:37:17.232Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 725
[2026-11-14T08:37:17.232Z] originally caused by:
[2026-11-14T08:37:17.232Z]  Started by upstream project "anvil/anvil-build-cron" build number 225
[2026-11-14T08:37:17.232Z]  originally caused by:
[2026-11-14T08:37:17.232Z]   Started by timer
[2026-11-14T08:37:18.260Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-11-14T08:37:18.272Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-11-14T08:37:18.510Z] Examining kronosnet/ci-tools
[2026-11-14T08:37:18.510Z] Attempting to resolve main as a branch
[2026-11-14T08:37:18.734Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-11-14T08:37:18.734Z] Selected Git installation does not exist. Using Default
[2026-11-14T08:37:18.734Z] The recommended git tool is: NONE
[2026-11-14T08:37:18.734Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-11-14T08:37:18.738Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-11-14T08:37:18.738Z] Wiping out workspace first.
[2026-11-14T08:37:18.770Z] Cloning the remote Git repository
[2026-11-14T08:37:18.770Z] Using shallow clone with depth 1
[2026-11-14T08:37:18.770Z] Avoid fetching tags
[2026-11-14T08:37:18.770Z] Honoring refspec on initial clone
[2026-11-14T08:37:18.770Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-11-14T08:37:18.770Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@5 # timeout=10
[2026-11-14T08:37:18.780Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-11-14T08:37:18.780Z]  > git --version # timeout=10
[2026-11-14T08:37:18.786Z]  > git --version # 'git version 2.52.0'
[2026-11-14T08:37:18.786Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-11-14T08:37:18.795Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-14T08:37:18.993Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-11-14T08:37:19.000Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-14T08:37:19.008Z] Avoid second fetch
[2026-11-14T08:37:19.008Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-11-14T08:37:19.008Z]  > git config core.sparsecheckout # timeout=10
[2026-11-14T08:37:19.015Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-11-14T08:37:19.054Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-11-14T08:37:19.062Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-11-14T08:37:19.317Z] Examining kronosnet/ci-tools
[2026-11-14T08:37:19.317Z] Attempting to resolve main as a branch
[2026-11-14T08:37:19.476Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-11-14T08:37:19.477Z] Selected Git installation does not exist. Using Default
[2026-11-14T08:37:19.477Z] The recommended git tool is: NONE
[2026-11-14T08:37:19.477Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-11-14T08:37:19.480Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-11-14T08:37:19.480Z] Wiping out workspace first.
[2026-11-14T08:37:19.504Z] Cloning the remote Git repository
[2026-11-14T08:37:19.504Z] Using shallow clone with depth 1
[2026-11-14T08:37:19.504Z] Avoid fetching tags
[2026-11-14T08:37:19.504Z] Honoring refspec on initial clone
[2026-11-14T08:37:19.505Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-11-14T08:37:19.505Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@4 # timeout=10
[2026-11-14T08:37:19.522Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-11-14T08:37:19.522Z]  > git --version # timeout=10
[2026-11-14T08:37:19.531Z]  > git --version # 'git version 2.52.0'
[2026-11-14T08:37:19.531Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-11-14T08:37:19.540Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-14T08:37:19.729Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-11-14T08:37:19.745Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-14T08:37:19.757Z] Avoid second fetch
[2026-11-14T08:37:19.757Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-11-14T08:37:19.757Z]  > git config core.sparsecheckout # timeout=10
[2026-11-14T08:37:19.775Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-11-14T08:37:19.833Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-11-14T08:37:19.874Z] [Pipeline] Start of Pipeline
[2026-11-14T08:37:19.970Z] [Pipeline] node
[2026-11-14T08:37:19.972Z] Running on anvil-ci-bm-phy06 in /srv/workspace/anvil/anvil-build-kmods
[2026-11-14T08:37:19.973Z] [Pipeline] {
[2026-11-14T08:37:19.981Z] [Pipeline] stage
[2026-11-14T08:37:19.981Z] [Pipeline] { (Prep build env)
[2026-11-14T08:37:19.992Z] [Pipeline] cleanWs
[2026-11-14T08:37:20.042Z] [WS-CLEANUP] Deleting project workspace...
[2026-11-14T08:37:20.042Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-11-14T08:37:20.067Z] [WS-CLEANUP] done
[2026-11-14T08:37:20.085Z] [Pipeline] lock
[2026-11-14T08:37:20.085Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-11-14T08:37:20.086Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-11-14T08:37:20.086Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT], resources: [MAINTENANCE LOCKOUT]
[2026-11-14T08:37:20.086Z] [Pipeline] {
[2026-11-14T08:37:20.088Z] [Pipeline] }
[2026-11-14T08:37:20.088Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT], resources: [MAINTENANCE LOCKOUT]
[2026-11-14T08:37:20.090Z] [Pipeline] // lock
[2026-11-14T08:37:20.093Z] [Pipeline] sh
[2026-11-14T08:37:20.571Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-11-14T08:37:20.571Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-14T08:37:20.918Z] Genering ssh keys and ssh config
[2026-11-14T08:37:21.661Z] Cleaning up simengine configuration
[2026-11-14T08:37:25.569Z] Destroying VMs (if any)
[2026-11-14T08:37:25.644Z] [Pipeline] }
[2026-11-14T08:37:25.646Z] [Pipeline] // stage
[2026-11-14T08:37:25.649Z] [Pipeline] stage
[2026-11-14T08:37:25.650Z] [Pipeline] { (Build kmod)
[2026-11-14T08:37:25.660Z] [Pipeline] sh
[2026-11-14T08:37:26.135Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 ci ci
[2026-11-14T08:37:26.135Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-14T08:37:26.482Z] Genering ssh keys and ssh config
[2026-11-14T08:37:27.227Z] Destroying VMs (if any)
[2026-11-14T08:37:27.227Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-14T08:37:27.971Z] Genering ssh keys and ssh config
[2026-11-14T08:37:28.317Z] Cache already updated
[2026-11-14T08:37:28.317Z] Building drbd kmod for almalinux-9 repo: ci anvil: ci
[2026-11-14T08:37:28.317Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-11-14T08:37:28.317Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-11-14T08:37:30.664Z] 
[2026-11-14T08:37:30.664Z] Starting install...
[2026-11-14T08:37:30.664Z] 
[2026-11-14T08:37:30.664Z] Creating domain...                                          |         00:00     
[2026-11-14T08:37:30.664Z] Domain creation completed.
[2026-11-14T08:37:30.664Z] Waiting for nodes and cloud-init to complete full init
[2026-11-14T08:37:33.728Z] cloud-init status node an-cache: 
[2026-11-14T08:37:33.728Z] Sat Nov 14 03:37:33 EST 2026 actual: 0 expected: 1
[2026-11-14T08:37:47.091Z] cloud-init status node an-cache: 
[2026-11-14T08:37:47.091Z] Sat Nov 14 03:37:46 EST 2026 actual: 0 expected: 1
[2026-11-14T08:37:58.158Z] cloud-init status node an-cache: 
[2026-11-14T08:37:58.158Z] Sat Nov 14 03:37:57 EST 2026 actual: 0 expected: 1
[2026-11-14T08:38:11.515Z] cloud-init status node an-cache: running
[2026-11-14T08:38:11.515Z] Sat Nov 14 03:38:09 EST 2026 actual: 0 expected: 1
[2026-11-14T08:38:22.555Z] cloud-init status node an-cache: running
[2026-11-14T08:38:22.555Z] Sat Nov 14 03:38:20 EST 2026 actual: 0 expected: 1
[2026-11-14T08:38:33.579Z] cloud-init status node an-cache: running
[2026-11-14T08:38:33.579Z] Sat Nov 14 03:38:31 EST 2026 actual: 0 expected: 1
[2026-11-14T08:38:44.596Z] cloud-init status node an-cache: running
[2026-11-14T08:38:44.596Z] Sat Nov 14 03:38:43 EST 2026 actual: 0 expected: 1
[2026-11-14T08:38:55.693Z] cloud-init status node an-cache: running
[2026-11-14T08:38:55.693Z] Sat Nov 14 03:38:54 EST 2026 actual: 0 expected: 1
[2026-11-14T08:39:09.028Z] cloud-init status node an-cache: running
[2026-11-14T08:39:09.028Z] Sat Nov 14 03:39:06 EST 2026 actual: 0 expected: 1
[2026-11-14T08:39:20.064Z] cloud-init status node an-cache: running
[2026-11-14T08:39:20.064Z] Sat Nov 14 03:39:18 EST 2026 actual: 0 expected: 1
[2026-11-14T08:39:31.108Z] cloud-init status node an-cache: running
[2026-11-14T08:39:31.108Z] Sat Nov 14 03:39:30 EST 2026 actual: 0 expected: 1
[2026-11-14T08:39:42.143Z] cloud-init status node an-cache: running
[2026-11-14T08:39:42.143Z] Sat Nov 14 03:39:42 EST 2026 actual: 0 expected: 1
[2026-11-14T08:39:55.524Z] cloud-init status node an-cache: running
[2026-11-14T08:39:55.524Z] Sat Nov 14 03:39:53 EST 2026 actual: 0 expected: 1
[2026-11-14T08:40:06.700Z] cloud-init status node an-cache: running
[2026-11-14T08:40:06.700Z] Sat Nov 14 03:40:05 EST 2026 actual: 0 expected: 1
[2026-11-14T08:40:17.729Z] cloud-init status node an-cache: running
[2026-11-14T08:40:17.729Z] Sat Nov 14 03:40:16 EST 2026 actual: 0 expected: 1
[2026-11-14T08:40:28.757Z] cloud-init status node an-cache: running
[2026-11-14T08:40:28.757Z] Sat Nov 14 03:40:28 EST 2026 actual: 0 expected: 1
[2026-11-14T08:40:42.112Z] cloud-init status node an-cache: running
[2026-11-14T08:40:42.112Z] Sat Nov 14 03:40:39 EST 2026 actual: 0 expected: 1
[2026-11-14T08:40:53.149Z] cloud-init status node an-cache: done
[2026-11-14T08:40:53.149Z] Sat Nov 14 03:40:52 EST 2026 actual: 1 expected: 1
[2026-11-14T08:40:53.149Z] Waiting for akmods to complete build
[2026-11-14T08:40:53.495Z] build not found, sleeping 10 seconds
[2026-11-14T08:41:04.648Z] build not found, sleeping 10 seconds
[2026-11-14T08:41:15.670Z] build not found, sleeping 10 seconds
[2026-11-14T08:41:26.686Z] build not found, sleeping 10 seconds
[2026-11-14T08:41:35.910Z] build not found, sleeping 10 seconds
[2026-11-14T08:41:46.942Z] build not found, sleeping 10 seconds
[2026-11-14T08:41:57.961Z] build not found, sleeping 10 seconds
[2026-11-14T08:42:08.990Z] build not found, sleeping 10 seconds
[2026-11-14T08:42:20.025Z] build not found, sleeping 10 seconds
[2026-11-14T08:42:29.136Z] build not found, sleeping 10 seconds
[2026-11-14T08:42:40.283Z] build not found, sleeping 10 seconds
[2026-11-14T08:42:51.292Z] build not found, sleeping 10 seconds
[2026-11-14T08:43:02.328Z] build not found, sleeping 10 seconds
[2026-11-14T08:43:13.485Z] build not found, sleeping 10 seconds
[2026-11-14T08:43:22.566Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-11-14T08:43:22.566Z] build found
[2026-11-14T08:43:23.312Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-14T08:43:25.041Z] Directory walk started
[2026-11-14T08:43:25.041Z] Directory walk done - 10 packages
[2026-11-14T08:43:25.041Z] Temporary output repo path: ./.repodata/
[2026-11-14T08:43:25.041Z] Preparing sqlite DBs
[2026-11-14T08:43:25.041Z] Pool started (with 5 workers)
[2026-11-14T08:43:25.041Z] Pool finished
[2026-11-14T08:43:25.041Z] /srv/anvil/cache
[2026-11-14T08:43:25.041Z] bash: line 1: rhc: command not found
[2026-11-14T08:43:25.391Z] bash: line 1: insights-client: command not found
[2026-11-14T08:43:26.135Z] bash: line 1: subscription-manager: command not found
[2026-11-14T08:43:28.485Z] Domain 'an-cache' destroyed
[2026-11-14T08:43:28.485Z] 
[2026-11-14T08:43:28.485Z] Domain 'an-cache' has been undefined
[2026-11-14T08:43:28.485Z] 
[2026-11-14T08:43:28.833Z] Done building drbd kmods
[2026-11-14T08:43:28.906Z] [Pipeline] }
[2026-11-14T08:43:28.908Z] [Pipeline] // stage
[2026-11-14T08:43:28.911Z] [Pipeline] stage
[2026-11-14T08:43:28.912Z] [Pipeline] { (Declarative: Post Actions)
[2026-11-14T08:43:28.917Z] [Pipeline] sh
[2026-11-14T08:43:29.421Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-11-14T08:43:29.421Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-14T08:43:29.769Z] Genering ssh keys and ssh config
[2026-11-14T08:43:30.116Z] Cleaning up simengine configuration
[2026-11-14T08:43:34.022Z] Destroying VMs (if any)
[2026-11-14T08:43:34.445Z] [Pipeline] cleanWs
[2026-11-14T08:43:34.494Z] [WS-CLEANUP] Deleting project workspace...
[2026-11-14T08:43:34.494Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-11-14T08:43:34.520Z] [WS-CLEANUP] done
[2026-11-14T08:43:34.524Z] [Pipeline] script
[2026-11-14T08:43:34.526Z] [Pipeline] {
[2026-11-14T08:43:34.540Z] [Pipeline] stage
[2026-11-14T08:43:34.540Z] [Pipeline] { (Copying logs)
[2026-11-14T08:43:34.571Z] [Pipeline] node
[2026-11-14T08:43:34.667Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-11-14T08:43:34.668Z] [Pipeline] {
[2026-11-14T08:43:34.702Z] [Pipeline] node
[2026-11-14T08:43:34.800Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-11-14T08:43:34.801Z] [Pipeline] {
[2026-11-14T08:43:34.804Z] [Pipeline] sh
[2026-11-14T08:43:35.059Z] + mkdir -p /var/lib/jenkins/locks
[2026-11-14T08:43:35.068Z] [Pipeline] echo
[2026-11-14T08:43:35.068Z] RWLock: FD for lock log_archive in stage projectFinishUp is 423
[2026-11-14T08:43:35.071Z] [Pipeline] sleep
[2026-11-14T08:43:35.071Z] No need to sleep any longer
[2026-11-14T08:43:35.073Z] [Pipeline] echo
[2026-11-14T08:43:35.073Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-11-14T08:43:35.076Z] [Pipeline] }
[2026-11-14T08:43:35.077Z] [Pipeline] // node
[2026-11-14T08:43:35.080Z] [Pipeline] echo
[2026-11-14T08:43:35.080Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4841/
[2026-11-14T08:43:35.081Z] [Pipeline] sh
[2026-11-14T08:43:35.336Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4841/
[2026-11-14T08:43:35.338Z] [Pipeline] sh