[2026-10-24T08:38:38.927Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 705
[2026-10-24T08:38:38.927Z] originally caused by:
[2026-10-24T08:38:38.927Z]  Started by upstream project "anvil/anvil-build-cron" build number 205
[2026-10-24T08:38:38.927Z]  originally caused by:
[2026-10-24T08:38:38.927Z]   Started by timer
[2026-10-24T08:38:39.917Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-10-24T08:38:39.923Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-10-24T08:38:40.124Z] Examining kronosnet/ci-tools
[2026-10-24T08:38:40.124Z] Attempting to resolve main as a branch
[2026-10-24T08:38:40.279Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-10-24T08:38:40.280Z] Selected Git installation does not exist. Using Default
[2026-10-24T08:38:40.280Z] The recommended git tool is: NONE
[2026-10-24T08:38:40.280Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-24T08:38:40.284Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-24T08:38:40.284Z] Wiping out workspace first.
[2026-10-24T08:38:40.310Z] Cloning the remote Git repository
[2026-10-24T08:38:40.311Z] Using shallow clone with depth 1
[2026-10-24T08:38:40.311Z] Avoid fetching tags
[2026-10-24T08:38:40.311Z] Honoring refspec on initial clone
[2026-10-24T08:38:40.311Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:40.311Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@4 # timeout=10
[2026-10-24T08:38:40.320Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:40.320Z]  > git --version # timeout=10
[2026-10-24T08:38:40.326Z]  > git --version # 'git version 2.52.0'
[2026-10-24T08:38:40.326Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-24T08:38:40.332Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:40.585Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-24T08:38:40.592Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:40.600Z] Avoid second fetch
[2026-10-24T08:38:40.600Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-10-24T08:38:40.600Z]  > git config core.sparsecheckout # timeout=10
[2026-10-24T08:38:40.606Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-10-24T08:38:40.648Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-10-24T08:38:40.656Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-10-24T08:38:40.835Z] Examining kronosnet/ci-tools
[2026-10-24T08:38:40.835Z] Attempting to resolve main as a branch
[2026-10-24T08:38:41.031Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-10-24T08:38:41.031Z] Selected Git installation does not exist. Using Default
[2026-10-24T08:38:41.031Z] The recommended git tool is: NONE
[2026-10-24T08:38:41.031Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-24T08:38:41.033Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-24T08:38:41.033Z] Wiping out workspace first.
[2026-10-24T08:38:41.053Z] Cloning the remote Git repository
[2026-10-24T08:38:41.053Z] Using shallow clone with depth 1
[2026-10-24T08:38:41.053Z] Avoid fetching tags
[2026-10-24T08:38:41.053Z] Honoring refspec on initial clone
[2026-10-24T08:38:41.054Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:41.054Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-10-24T08:38:41.063Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:41.063Z]  > git --version # timeout=10
[2026-10-24T08:38:41.070Z]  > git --version # 'git version 2.52.0'
[2026-10-24T08:38:41.070Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-24T08:38:41.077Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:41.322Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-24T08:38:41.331Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:41.341Z] Avoid second fetch
[2026-10-24T08:38:41.341Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-10-24T08:38:41.341Z]  > git config core.sparsecheckout # timeout=10
[2026-10-24T08:38:41.349Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-10-24T08:38:41.384Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-10-24T08:38:41.423Z] [Pipeline] Start of Pipeline
[2026-10-24T08:38:41.511Z] [Pipeline] node
[2026-10-24T08:38:41.513Z] Running on anvil-ci-bm-phy05 in /srv/workspace/anvil/anvil-build-kmods
[2026-10-24T08:38:41.513Z] [Pipeline] {
[2026-10-24T08:38:41.520Z] [Pipeline] stage
[2026-10-24T08:38:41.520Z] [Pipeline] { (Prep build env)
[2026-10-24T08:38:41.529Z] [Pipeline] cleanWs
[2026-10-24T08:38:41.579Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-24T08:38:41.579Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-24T08:38:41.604Z] [WS-CLEANUP] done
[2026-10-24T08:38:41.620Z] [Pipeline] lock
[2026-10-24T08:38:41.620Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-10-24T08:38:41.620Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-10-24T08:38:41.621Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-10-24T08:38:41.621Z] [Pipeline] {
[2026-10-24T08:38:41.623Z] [Pipeline] }
[2026-10-24T08:38:41.623Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-10-24T08:38:41.625Z] [Pipeline] // lock
[2026-10-24T08:38:41.628Z] [Pipeline] sh
[2026-10-24T08:38:42.104Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-24T08:38:42.104Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:38:42.450Z] Genering ssh keys and ssh config
[2026-10-24T08:38:43.192Z] Cleaning up simengine configuration
[2026-10-24T08:38:47.185Z] Destroying VMs (if any)
[2026-10-24T08:38:47.259Z] [Pipeline] }
[2026-10-24T08:38:47.262Z] [Pipeline] // stage
[2026-10-24T08:38:47.265Z] [Pipeline] stage
[2026-10-24T08:38:47.265Z] [Pipeline] { (Build kmod)
[2026-10-24T08:38:47.274Z] [Pipeline] sh
[2026-10-24T08:38:47.752Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise-staging none
[2026-10-24T08:38:47.752Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:38:48.098Z] Genering ssh keys and ssh config
[2026-10-24T08:38:48.444Z] Destroying VMs (if any)
[2026-10-24T08:38:48.796Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:38:49.540Z] Genering ssh keys and ssh config
[2026-10-24T08:38:49.886Z] Cache already updated
[2026-10-24T08:38:49.886Z] Building drbd kmod for almalinux-9 repo: enterprise-staging anvil: none
[2026-10-24T08:38:49.886Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-10-24T08:38:49.886Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-10-24T08:38:52.230Z] 
[2026-10-24T08:38:52.230Z] Starting install...
[2026-10-24T08:38:52.230Z] 
[2026-10-24T08:38:52.230Z] Creating domain...                                          |         00:00     
[2026-10-24T08:38:52.230Z] Domain creation completed.
[2026-10-24T08:38:52.230Z] Waiting for nodes and cloud-init to complete full init
[2026-10-24T08:38:55.290Z] cloud-init status node an-cache: 
[2026-10-24T08:38:55.290Z] Sat Oct 24 04:38:55 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:08.636Z] cloud-init status node an-cache: 
[2026-10-24T08:39:08.636Z] Sat Oct 24 04:39:08 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:19.672Z] cloud-init status node an-cache: 
[2026-10-24T08:39:19.672Z] Sat Oct 24 04:39:18 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:30.696Z] cloud-init status node an-cache: running
[2026-10-24T08:39:30.696Z] Sat Oct 24 04:39:29 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:41.745Z] cloud-init status node an-cache: running
[2026-10-24T08:39:41.745Z] Sat Oct 24 04:39:41 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:52.783Z] cloud-init status node an-cache: running
[2026-10-24T08:39:52.783Z] Sat Oct 24 04:39:52 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:03.928Z] cloud-init status node an-cache: running
[2026-10-24T08:40:03.928Z] Sat Oct 24 04:40:03 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:15.585Z] cloud-init status node an-cache: running
[2026-10-24T08:40:15.585Z] Sat Oct 24 04:40:14 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:28.920Z] cloud-init status node an-cache: running
[2026-10-24T08:40:28.920Z] Sat Oct 24 04:40:26 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:39.949Z] cloud-init status node an-cache: running
[2026-10-24T08:40:39.949Z] Sat Oct 24 04:40:38 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:50.981Z] cloud-init status node an-cache: running
[2026-10-24T08:40:50.981Z] Sat Oct 24 04:40:50 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:41:02.116Z] cloud-init status node an-cache: running
[2026-10-24T08:41:02.116Z] Sat Oct 24 04:41:01 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:41:15.473Z] cloud-init status node an-cache: running
[2026-10-24T08:41:15.473Z] Sat Oct 24 04:41:13 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:41:26.600Z] cloud-init status node an-cache: running
[2026-10-24T08:41:26.600Z] Sat Oct 24 04:41:25 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:41:37.633Z] cloud-init status node an-cache: running
[2026-10-24T08:41:37.633Z] Sat Oct 24 04:41:36 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:41:48.661Z] cloud-init status node an-cache: running
[2026-10-24T08:41:48.661Z] Sat Oct 24 04:41:47 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:41:59.779Z] cloud-init status node an-cache: running
[2026-10-24T08:41:59.779Z] Sat Oct 24 04:41:58 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:42:10.811Z] cloud-init status node an-cache: done
[2026-10-24T08:42:10.811Z] Sat Oct 24 04:42:09 EDT 2026 actual: 1 expected: 1
[2026-10-24T08:42:10.811Z] Waiting for akmods to complete build
[2026-10-24T08:42:10.811Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:21.834Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:31.009Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:42.029Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:53.066Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:04.100Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:13.188Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:24.215Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:35.328Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:44.413Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:55.469Z] build not found, sleeping 10 seconds
[2026-10-24T08:44:06.592Z] build not found, sleeping 10 seconds
[2026-10-24T08:44:17.612Z] build not found, sleeping 10 seconds
[2026-10-24T08:44:28.641Z] build not found, sleeping 10 seconds
[2026-10-24T08:44:37.822Z] build not found, sleeping 10 seconds
[2026-10-24T08:44:48.850Z] build not found, sleeping 10 seconds
[2026-10-24T08:44:59.877Z] build not found, sleeping 10 seconds
[2026-10-24T08:45:10.977Z] build not found, sleeping 10 seconds
[2026-10-24T08:45:21.997Z] build not found, sleeping 10 seconds
[2026-10-24T08:45:31.069Z] build not found, sleeping 10 seconds
[2026-10-24T08:45:42.192Z] build not found, sleeping 10 seconds
[2026-10-24T08:45:53.235Z] build not found, sleeping 10 seconds
[2026-10-24T08:46:04.262Z] build not found, sleeping 10 seconds
[2026-10-24T08:46:15.390Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-10-24T08:46:15.390Z] build found
[2026-10-24T08:46:15.390Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:46:15.738Z] Directory walk started
[2026-10-24T08:46:15.738Z] Directory walk done - 8 packages
[2026-10-24T08:46:15.738Z] Temporary output repo path: ./.repodata/
[2026-10-24T08:46:15.738Z] Preparing sqlite DBs
[2026-10-24T08:46:15.738Z] Pool started (with 5 workers)
[2026-10-24T08:46:15.738Z] Pool finished
[2026-10-24T08:46:15.738Z] /srv/anvil/cache
[2026-10-24T08:46:16.084Z] bash: line 1: rhc: command not found
[2026-10-24T08:46:16.829Z] bash: line 1: insights-client: command not found
[2026-10-24T08:46:16.829Z] bash: line 1: subscription-manager: command not found
[2026-10-24T08:46:19.178Z] Domain 'an-cache' destroyed
[2026-10-24T08:46:19.178Z] 
[2026-10-24T08:46:19.524Z] Domain 'an-cache' has been undefined
[2026-10-24T08:46:19.524Z] 
[2026-10-24T08:46:19.870Z] Done building drbd kmods
[2026-10-24T08:46:19.943Z] [Pipeline] }
[2026-10-24T08:46:19.945Z] [Pipeline] // stage
[2026-10-24T08:46:19.948Z] [Pipeline] stage
[2026-10-24T08:46:19.948Z] [Pipeline] { (Declarative: Post Actions)
[2026-10-24T08:46:19.953Z] [Pipeline] sh
[2026-10-24T08:46:20.494Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-24T08:46:20.494Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:46:20.840Z] Genering ssh keys and ssh config
[2026-10-24T08:46:21.187Z] Cleaning up simengine configuration
[2026-10-24T08:46:25.089Z] Destroying VMs (if any)
[2026-10-24T08:46:25.510Z] [Pipeline] cleanWs
[2026-10-24T08:46:25.559Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-24T08:46:25.559Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-24T08:46:25.585Z] [WS-CLEANUP] done
[2026-10-24T08:46:25.589Z] [Pipeline] script
[2026-10-24T08:46:25.591Z] [Pipeline] {
[2026-10-24T08:46:25.604Z] [Pipeline] stage
[2026-10-24T08:46:25.605Z] [Pipeline] { (Copying logs)
[2026-10-24T08:46:25.638Z] [Pipeline] node
[2026-10-24T08:46:25.740Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-10-24T08:46:25.740Z] [Pipeline] {
[2026-10-24T08:46:25.773Z] [Pipeline] node
[2026-10-24T08:46:25.873Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-10-24T08:46:25.874Z] [Pipeline] {
[2026-10-24T08:46:25.877Z] [Pipeline] sh
[2026-10-24T08:46:26.132Z] + mkdir -p /var/lib/jenkins/locks
[2026-10-24T08:46:26.139Z] [Pipeline] echo
[2026-10-24T08:46:26.139Z] RWLock: FD for lock log_archive in stage projectFinishUp is 384
[2026-10-24T08:46:26.142Z] [Pipeline] sleep
[2026-10-24T08:46:26.142Z] No need to sleep any longer
[2026-10-24T08:46:26.145Z] [Pipeline] echo
[2026-10-24T08:46:26.145Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-10-24T08:46:26.147Z] [Pipeline] }
[2026-10-24T08:46:26.149Z] [Pipeline] // node
[2026-10-24T08:46:26.152Z] [Pipeline] echo
[2026-10-24T08:46:26.152Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4722/
[2026-10-24T08:46:26.153Z] [Pipeline] sh
[2026-10-24T08:46:26.407Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4722/
[2026-10-24T08:46:26.409Z] [Pipeline] sh