[2026-08-28T08:40:19.501Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 649
[2026-08-28T08:40:19.501Z] originally caused by:
[2026-08-28T08:40:19.501Z]  Started by upstream project "anvil/anvil-build-cron" build number 149
[2026-08-28T08:40:19.501Z]  originally caused by:
[2026-08-28T08:40:19.501Z]   Started by timer
[2026-08-28T08:40:19.727Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-08-28T08:40:19.732Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-08-28T08:40:19.945Z] Examining kronosnet/ci-tools
[2026-08-28T08:40:19.945Z] Attempting to resolve main as a branch
[2026-08-28T08:40:20.103Z] Resolved main as branch main at revision 0a8e5b2a8551c2a85499d4080db07a87613468c2
[2026-08-28T08:40:20.105Z] Selected Git installation does not exist. Using Default
[2026-08-28T08:40:20.105Z] The recommended git tool is: NONE
[2026-08-28T08:40:20.105Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-08-28T08:40:20.108Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-08-28T08:40:20.108Z] Wiping out workspace first.
[2026-08-28T08:40:20.151Z] Cloning the remote Git repository
[2026-08-28T08:40:20.151Z] Using shallow clone with depth 1
[2026-08-28T08:40:20.151Z] Avoid fetching tags
[2026-08-28T08:40:20.151Z] Honoring refspec on initial clone
[2026-08-28T08:40:20.152Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-08-28T08:40:20.152Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-08-28T08:40:20.160Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-08-28T08:40:20.160Z]  > git --version # timeout=10
[2026-08-28T08:40:20.167Z]  > git --version # 'git version 2.52.0'
[2026-08-28T08:40:20.167Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-08-28T08:40:20.173Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-08-28T08:40:20.515Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-08-28T08:40:20.521Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-08-28T08:40:20.535Z] Avoid second fetch
[2026-08-28T08:40:20.535Z] Checking out Revision 0a8e5b2a8551c2a85499d4080db07a87613468c2 (main)
[2026-08-28T08:40:20.535Z]  > git config core.sparsecheckout # timeout=10
[2026-08-28T08:40:20.541Z]  > git checkout -f 0a8e5b2a8551c2a85499d4080db07a87613468c2 # timeout=10
[2026-08-28T08:40:20.581Z] Commit message: "Normalize defaultiscsi for providers not using iSCSI by default"
[2026-08-28T08:40:20.591Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-08-28T08:40:20.800Z] Examining kronosnet/ci-tools
[2026-08-28T08:40:20.800Z] Attempting to resolve main as a branch
[2026-08-28T08:40:20.995Z] Resolved main as branch main at revision 0a8e5b2a8551c2a85499d4080db07a87613468c2
[2026-08-28T08:40:20.997Z] Selected Git installation does not exist. Using Default
[2026-08-28T08:40:20.997Z] The recommended git tool is: NONE
[2026-08-28T08:40:20.997Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-08-28T08:40:21.001Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-08-28T08:40:21.001Z] Wiping out workspace first.
[2026-08-28T08:40:21.056Z] Cloning the remote Git repository
[2026-08-28T08:40:21.056Z] Using shallow clone with depth 1
[2026-08-28T08:40:21.056Z] Avoid fetching tags
[2026-08-28T08:40:21.056Z] Honoring refspec on initial clone
[2026-08-28T08:40:21.056Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-08-28T08:40:21.056Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@4 # timeout=10
[2026-08-28T08:40:21.065Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-08-28T08:40:21.065Z]  > git --version # timeout=10
[2026-08-28T08:40:21.071Z]  > git --version # 'git version 2.52.0'
[2026-08-28T08:40:21.071Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-08-28T08:40:21.077Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-08-28T08:40:21.385Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-08-28T08:40:21.392Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-08-28T08:40:21.400Z] Avoid second fetch
[2026-08-28T08:40:21.401Z] Checking out Revision 0a8e5b2a8551c2a85499d4080db07a87613468c2 (main)
[2026-08-28T08:40:21.401Z]  > git config core.sparsecheckout # timeout=10
[2026-08-28T08:40:21.408Z]  > git checkout -f 0a8e5b2a8551c2a85499d4080db07a87613468c2 # timeout=10
[2026-08-28T08:40:21.444Z] Commit message: "Normalize defaultiscsi for providers not using iSCSI by default"
[2026-08-28T08:40:21.633Z] [Pipeline] Start of Pipeline
[2026-08-28T08:40:21.770Z] [Pipeline] node
[2026-08-28T08:40:21.773Z] Running on anvil-ci-bm-phy01 in /srv/workspace/anvil/anvil-build-kmods
[2026-08-28T08:40:21.774Z] [Pipeline] {
[2026-08-28T08:40:21.785Z] [Pipeline] stage
[2026-08-28T08:40:21.785Z] [Pipeline] { (Prep build env)
[2026-08-28T08:40:21.800Z] [Pipeline] cleanWs
[2026-08-28T08:40:21.850Z] [WS-CLEANUP] Deleting project workspace...
[2026-08-28T08:40:21.850Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-08-28T08:40:21.874Z] [WS-CLEANUP] done
[2026-08-28T08:40:21.895Z] [Pipeline] lock
[2026-08-28T08:40:21.895Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-08-28T08:40:21.895Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-08-28T08:40:21.896Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-08-28T08:40:21.896Z] [Pipeline] {
[2026-08-28T08:40:21.898Z] [Pipeline] }
[2026-08-28T08:40:21.899Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-08-28T08:40:21.901Z] [Pipeline] // lock
[2026-08-28T08:40:21.905Z] [Pipeline] sh
[2026-08-28T08:40:22.369Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-08-28T08:40:22.369Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-08-28T08:40:22.710Z] Genering ssh keys and ssh config
[2026-08-28T08:40:23.053Z] Cleaning up simengine configuration
[2026-08-28T08:40:26.916Z] Destroying VMs (if any)
[2026-08-28T08:40:26.986Z] [Pipeline] }
[2026-08-28T08:40:26.988Z] [Pipeline] // stage
[2026-08-28T08:40:26.992Z] [Pipeline] stage
[2026-08-28T08:40:26.992Z] [Pipeline] { (Build kmod)
[2026-08-28T08:40:27.003Z] [Pipeline] sh
[2026-08-28T08:40:27.464Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise-staging none
[2026-08-28T08:40:27.465Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-08-28T08:40:27.465Z] Genering ssh keys and ssh config
[2026-08-28T08:40:28.196Z] Destroying VMs (if any)
[2026-08-28T08:40:28.196Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-08-28T08:40:28.537Z] Genering ssh keys and ssh config
[2026-08-28T08:40:28.878Z] Cache already updated
[2026-08-28T08:40:28.878Z] Building drbd kmod for almalinux-9 repo: enterprise-staging anvil: none
[2026-08-28T08:40:28.878Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-08-28T08:40:28.878Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-08-28T08:40:30.065Z] 
[2026-08-28T08:40:30.065Z] Starting install...
[2026-08-28T08:40:30.065Z] 
[2026-08-28T08:40:30.065Z] Creating domain...                                          |         00:00     
[2026-08-28T08:40:30.065Z] Domain creation completed.
[2026-08-28T08:40:30.065Z] Waiting for nodes and cloud-init to complete full init
[2026-08-28T08:40:33.094Z] cloud-init status node an-cache: 
[2026-08-28T08:40:33.436Z] Fri Aug 28 04:40:33 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:40:46.718Z] cloud-init status node an-cache: 
[2026-08-28T08:40:46.718Z] Fri Aug 28 04:40:44 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:40:56.221Z] cloud-init status node an-cache: running
[2026-08-28T08:40:56.221Z] Fri Aug 28 04:40:55 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:41:07.195Z] cloud-init status node an-cache: running
[2026-08-28T08:41:07.195Z] Fri Aug 28 04:41:06 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:41:18.169Z] cloud-init status node an-cache: running
[2026-08-28T08:41:18.169Z] Fri Aug 28 04:41:16 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:41:29.141Z] cloud-init status node an-cache: running
[2026-08-28T08:41:29.141Z] Fri Aug 28 04:41:27 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:41:40.109Z] cloud-init status node an-cache: running
[2026-08-28T08:41:40.109Z] Fri Aug 28 04:41:38 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:41:51.090Z] cloud-init status node an-cache: running
[2026-08-28T08:41:51.090Z] Fri Aug 28 04:41:49 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:42:00.114Z] cloud-init status node an-cache: running
[2026-08-28T08:42:00.114Z] Fri Aug 28 04:41:59 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:42:11.078Z] cloud-init status node an-cache: running
[2026-08-28T08:42:11.078Z] Fri Aug 28 04:42:10 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:42:22.050Z] cloud-init status node an-cache: running
[2026-08-28T08:42:22.050Z] Fri Aug 28 04:42:21 EDT 2026 actual: 0 expected: 1
[2026-08-28T08:42:33.024Z] cloud-init status node an-cache: done
[2026-08-28T08:42:33.024Z] Fri Aug 28 04:42:32 EDT 2026 actual: 1 expected: 1
[2026-08-28T08:42:33.024Z] Waiting for akmods to complete build
[2026-08-28T08:42:33.024Z] build not found, sleeping 10 seconds
[2026-08-28T08:42:43.996Z] build not found, sleeping 10 seconds
[2026-08-28T08:42:54.968Z] build not found, sleeping 10 seconds
[2026-08-28T08:43:03.997Z] build not found, sleeping 10 seconds
[2026-08-28T08:43:14.970Z] build not found, sleeping 10 seconds
[2026-08-28T08:43:23.997Z] build not found, sleeping 10 seconds
[2026-08-28T08:43:34.968Z] build not found, sleeping 10 seconds
[2026-08-28T08:43:45.938Z] build not found, sleeping 10 seconds
[2026-08-28T08:43:54.963Z] build not found, sleeping 10 seconds
[2026-08-28T08:44:05.936Z] build not found, sleeping 10 seconds
[2026-08-28T08:44:16.910Z] build not found, sleeping 10 seconds
[2026-08-28T08:44:25.930Z] build not found, sleeping 10 seconds
[2026-08-28T08:44:36.897Z] build not found, sleeping 10 seconds
[2026-08-28T08:44:47.870Z] build not found, sleeping 10 seconds
[2026-08-28T08:44:56.895Z] build not found, sleeping 10 seconds
[2026-08-28T08:45:07.862Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-08-28T08:45:07.862Z] build found
[2026-08-28T08:45:07.862Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-08-28T08:45:07.862Z] Directory walk started
[2026-08-28T08:45:07.862Z] Directory walk done - 8 packages
[2026-08-28T08:45:07.862Z] Temporary output repo path: ./.repodata/
[2026-08-28T08:45:07.862Z] Preparing sqlite DBs
[2026-08-28T08:45:07.862Z] Pool started (with 5 workers)
[2026-08-28T08:45:07.862Z] Pool finished
[2026-08-28T08:45:07.862Z] /srv/anvil/cache
[2026-08-28T08:45:08.204Z] bash: line 1: rhc: command not found
[2026-08-28T08:45:08.546Z] bash: line 1: insights-client: command not found
[2026-08-28T08:45:08.546Z] bash: line 1: subscription-manager: command not found
[2026-08-28T08:45:10.864Z] Domain 'an-cache' destroyed
[2026-08-28T08:45:10.864Z] 
[2026-08-28T08:45:10.864Z] Domain 'an-cache' has been undefined
[2026-08-28T08:45:10.864Z] 
[2026-08-28T08:45:11.204Z] Done building drbd kmods
[2026-08-28T08:45:11.274Z] [Pipeline] }
[2026-08-28T08:45:11.276Z] [Pipeline] // stage
[2026-08-28T08:45:11.280Z] [Pipeline] stage
[2026-08-28T08:45:11.281Z] [Pipeline] { (Declarative: Post Actions)
[2026-08-28T08:45:11.289Z] [Pipeline] sh
[2026-08-28T08:45:11.819Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-08-28T08:45:11.819Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-08-28T08:45:11.819Z] Genering ssh keys and ssh config
[2026-08-28T08:45:12.160Z] Cleaning up simengine configuration
[2026-08-28T08:45:16.029Z] Destroying VMs (if any)
[2026-08-28T08:45:16.101Z] [Pipeline] cleanWs
[2026-08-28T08:45:16.151Z] [WS-CLEANUP] Deleting project workspace...
[2026-08-28T08:45:16.151Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-08-28T08:45:16.174Z] [WS-CLEANUP] done
[2026-08-28T08:45:16.179Z] [Pipeline] script
[2026-08-28T08:45:16.183Z] [Pipeline] {
[2026-08-28T08:45:16.198Z] [Pipeline] stage
[2026-08-28T08:45:16.198Z] [Pipeline] { (Copying logs)
[2026-08-28T08:45:16.232Z] [Pipeline] node
[2026-08-28T08:45:16.344Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-08-28T08:45:16.345Z] [Pipeline] {
[2026-08-28T08:45:16.385Z] [Pipeline] node
[2026-08-28T08:45:16.493Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@3
[2026-08-28T08:45:16.494Z] [Pipeline] {
[2026-08-28T08:45:16.497Z] [Pipeline] sh
[2026-08-28T08:45:16.753Z] + mkdir -p /var/lib/jenkins/locks
[2026-08-28T08:45:16.762Z] [Pipeline] echo
[2026-08-28T08:45:16.763Z] RWLock: FD for lock log_archive in stage projectFinishUp is 98
[2026-08-28T08:45:16.766Z] [Pipeline] sleep
[2026-08-28T08:45:16.766Z] No need to sleep any longer
[2026-08-28T08:45:16.768Z] [Pipeline] echo
[2026-08-28T08:45:16.768Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-08-28T08:45:16.771Z] [Pipeline] }
[2026-08-28T08:45:16.774Z] [Pipeline] // node
[2026-08-28T08:45:16.777Z] [Pipeline] echo
[2026-08-28T08:45:16.777Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4386/
[2026-08-28T08:45:16.778Z] [Pipeline] sh
[2026-08-28T08:45:17.033Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4386/
[2026-08-28T08:45:17.035Z] [Pipeline] sh