[2026-05-02T08:40:17.396Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 545
[2026-05-02T08:40:17.396Z] originally caused by:
[2026-05-02T08:40:17.396Z]  Started by upstream project "anvil/anvil-build-cron" build number 42
[2026-05-02T08:40:17.396Z]  originally caused by:
[2026-05-02T08:40:17.396Z]   Started by timer
[2026-05-02T08:40:17.701Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-05-02T08:40:17.707Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-05-02T08:40:17.857Z] Examining kronosnet/ci-tools
[2026-05-02T08:40:17.857Z] Attempting to resolve main as a branch
[2026-05-02T08:40:18.014Z] Resolved main as branch main at revision 9ad09a984fa36f4673663554aea24fb7e9688b8f
[2026-05-02T08:40:18.015Z] Selected Git installation does not exist. Using Default
[2026-05-02T08:40:18.015Z] The recommended git tool is: NONE
[2026-05-02T08:40:18.015Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-05-02T08:40:18.018Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-05-02T08:40:18.018Z] Wiping out workspace first.
[2026-05-02T08:40:18.040Z] Cloning the remote Git repository
[2026-05-02T08:40:18.040Z] Using shallow clone with depth 1
[2026-05-02T08:40:18.040Z] Avoid fetching tags
[2026-05-02T08:40:18.040Z] Honoring refspec on initial clone
[2026-05-02T08:40:18.040Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-05-02T08:40:18.040Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-05-02T08:40:18.049Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-05-02T08:40:18.049Z]  > git --version # timeout=10
[2026-05-02T08:40:18.055Z]  > git --version # 'git version 2.47.3'
[2026-05-02T08:40:18.055Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-05-02T08:40:18.061Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-05-02T08:40:18.251Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-05-02T08:40:18.258Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-05-02T08:40:18.266Z] Avoid second fetch
[2026-05-02T08:40:18.266Z] Checking out Revision 9ad09a984fa36f4673663554aea24fb7e9688b8f (main)
[2026-05-02T08:40:18.266Z]  > git config core.sparsecheckout # timeout=10
[2026-05-02T08:40:18.273Z]  > git checkout -f 9ad09a984fa36f4673663554aea24fb7e9688b8f # timeout=10
[2026-05-02T08:40:18.306Z] Commit message: "Merge pull request #44 from nrwahl2/nrwahl2-pacemaker"
[2026-05-02T08:40:18.312Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-05-02T08:40:18.496Z] Examining kronosnet/ci-tools
[2026-05-02T08:40:18.496Z] Attempting to resolve main as a branch
[2026-05-02T08:40:18.696Z] Resolved main as branch main at revision 9ad09a984fa36f4673663554aea24fb7e9688b8f
[2026-05-02T08:40:18.697Z] Selected Git installation does not exist. Using Default
[2026-05-02T08:40:18.697Z] The recommended git tool is: NONE
[2026-05-02T08:40:18.697Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-05-02T08:40:18.701Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-05-02T08:40:18.701Z] Wiping out workspace first.
[2026-05-02T08:40:18.724Z] Cloning the remote Git repository
[2026-05-02T08:40:18.724Z] Using shallow clone with depth 1
[2026-05-02T08:40:18.724Z] Avoid fetching tags
[2026-05-02T08:40:18.724Z] Honoring refspec on initial clone
[2026-05-02T08:40:18.724Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-05-02T08:40:18.724Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@6 # timeout=10
[2026-05-02T08:40:18.734Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-05-02T08:40:18.734Z]  > git --version # timeout=10
[2026-05-02T08:40:18.740Z]  > git --version # 'git version 2.47.3'
[2026-05-02T08:40:18.740Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-05-02T08:40:18.746Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-05-02T08:40:18.922Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-05-02T08:40:18.929Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-05-02T08:40:18.937Z] Avoid second fetch
[2026-05-02T08:40:18.937Z] Checking out Revision 9ad09a984fa36f4673663554aea24fb7e9688b8f (main)
[2026-05-02T08:40:18.937Z]  > git config core.sparsecheckout # timeout=10
[2026-05-02T08:40:18.944Z]  > git checkout -f 9ad09a984fa36f4673663554aea24fb7e9688b8f # timeout=10
[2026-05-02T08:40:18.976Z] Commit message: "Merge pull request #44 from nrwahl2/nrwahl2-pacemaker"
[2026-05-02T08:40:19.013Z] [Pipeline] Start of Pipeline
[2026-05-02T08:40:19.103Z] [Pipeline] node
[2026-05-02T08:40:19.105Z] Running on anvil-ci-bm-phy07 in /srv/workspace/anvil/anvil-build-kmods
[2026-05-02T08:40:19.105Z] [Pipeline] {
[2026-05-02T08:40:19.113Z] [Pipeline] stage
[2026-05-02T08:40:19.113Z] [Pipeline] { (Prep build env)
[2026-05-02T08:40:19.123Z] [Pipeline] cleanWs
[2026-05-02T08:40:19.193Z] [WS-CLEANUP] Deleting project workspace...
[2026-05-02T08:40:19.193Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-05-02T08:40:19.225Z] [WS-CLEANUP] done
[2026-05-02T08:40:19.244Z] [Pipeline] lock
[2026-05-02T08:40:19.244Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-05-02T08:40:19.244Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-05-02T08:40:19.244Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-05-02T08:40:19.244Z] [Pipeline] {
[2026-05-02T08:40:19.247Z] [Pipeline] }
[2026-05-02T08:40:19.247Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-05-02T08:40:19.249Z] [Pipeline] // lock
[2026-05-02T08:40:19.252Z] [Pipeline] sh
[2026-05-02T08:40:19.801Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-05-02T08:40:19.801Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-05-02T08:40:19.801Z] Genering ssh keys and ssh config
[2026-05-02T08:40:20.185Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:20.185Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:20.185Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:20.185Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:20.185Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:20.562Z] Cleaning up simengine configuration
[2026-05-02T08:40:23.828Z] Destroying VMs (if any)
[2026-05-02T08:40:23.939Z] [Pipeline] }
[2026-05-02T08:40:23.941Z] [Pipeline] // stage
[2026-05-02T08:40:23.943Z] [Pipeline] stage
[2026-05-02T08:40:23.943Z] [Pipeline] { (Build kmod)
[2026-05-02T08:40:23.952Z] [Pipeline] sh
[2026-05-02T08:40:24.490Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise-staging none
[2026-05-02T08:40:24.490Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-05-02T08:40:24.490Z] Genering ssh keys and ssh config
[2026-05-02T08:40:24.876Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:24.876Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:24.876Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:24.876Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:24.876Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:25.256Z] Destroying VMs (if any)
[2026-05-02T08:40:25.256Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-05-02T08:40:25.642Z] Genering ssh keys and ssh config
[2026-05-02T08:40:25.642Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:25.642Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:25.642Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:26.033Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:26.033Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:40:26.033Z] Cache already updated
[2026-05-02T08:40:26.033Z] Building drbd kmod for almalinux-9 repo: enterprise-staging anvil: none
[2026-05-02T08:40:26.033Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-05-02T08:40:26.033Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-05-02T08:40:27.883Z] 
[2026-05-02T08:40:27.883Z] Starting install...
[2026-05-02T08:40:27.883Z] 
[2026-05-02T08:40:27.883Z] Creating domain...                                          |         00:00     
[2026-05-02T08:40:27.883Z] Domain creation completed.
[2026-05-02T08:40:27.883Z] Waiting for nodes and cloud-init to complete full init
[2026-05-02T08:40:31.123Z] cloud-init status node an-cache: 
[2026-05-02T08:40:31.123Z] Sat May  2 04:40:30 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:40:42.651Z] cloud-init status node an-cache: 
[2026-05-02T08:40:42.651Z] Sat May  2 04:40:41 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:40:54.122Z] cloud-init status node an-cache: running
[2026-05-02T08:40:54.122Z] Sat May  2 04:40:53 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:41:05.505Z] cloud-init status node an-cache: running
[2026-05-02T08:41:05.505Z] Sat May  2 04:41:03 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:41:15.039Z] cloud-init status node an-cache: running
[2026-05-02T08:41:15.039Z] Sat May  2 04:41:14 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:41:26.432Z] cloud-init status node an-cache: running
[2026-05-02T08:41:26.432Z] Sat May  2 04:41:25 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:41:37.873Z] cloud-init status node an-cache: running
[2026-05-02T08:41:37.873Z] Sat May  2 04:41:36 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:41:47.458Z] cloud-init status node an-cache: running
[2026-05-02T08:41:47.458Z] Sat May  2 04:41:46 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:41:58.857Z] cloud-init status node an-cache: running
[2026-05-02T08:41:58.857Z] Sat May  2 04:41:57 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:42:10.271Z] cloud-init status node an-cache: running
[2026-05-02T08:42:10.271Z] Sat May  2 04:42:08 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:42:19.818Z] cloud-init status node an-cache: running
[2026-05-02T08:42:19.818Z] Sat May  2 04:42:19 EDT 2026 actual: 0 expected: 1
[2026-05-02T08:42:31.226Z] cloud-init status node an-cache: done
[2026-05-02T08:42:31.226Z] Sat May  2 04:42:29 EDT 2026 actual: 1 expected: 1
[2026-05-02T08:42:31.226Z] Waiting for akmods to complete build
[2026-05-02T08:42:31.226Z] build not found, sleeping 10 seconds
[2026-05-02T08:42:40.672Z] build not found, sleeping 10 seconds
[2026-05-02T08:42:52.244Z] build not found, sleeping 10 seconds
[2026-05-02T08:43:01.707Z] build not found, sleeping 10 seconds
[2026-05-02T08:43:13.096Z] build not found, sleeping 10 seconds
[2026-05-02T08:43:22.642Z] build not found, sleeping 10 seconds
[2026-05-02T08:43:34.017Z] build not found, sleeping 10 seconds
[2026-05-02T08:43:43.421Z] build not found, sleeping 10 seconds
[2026-05-02T08:43:52.822Z] build not found, sleeping 10 seconds
[2026-05-02T08:44:04.200Z] build not found, sleeping 10 seconds
[2026-05-02T08:44:13.636Z] build not found, sleeping 10 seconds
[2026-05-02T08:44:25.160Z] build not found, sleeping 10 seconds
[2026-05-02T08:44:34.586Z] build not found, sleeping 10 seconds
[2026-05-02T08:44:45.954Z] build not found, sleeping 10 seconds
[2026-05-02T08:44:55.477Z] build not found, sleeping 10 seconds
[2026-05-02T08:45:04.875Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-611.el9_7-9.2.16-1.el9.x86_64.rpm
[2026-05-02T08:45:04.875Z] build found
[2026-05-02T08:45:05.250Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-05-02T08:45:06.051Z] Directory walk started
[2026-05-02T08:45:06.051Z] Directory walk done - 7 packages
[2026-05-02T08:45:06.051Z] Temporary output repo path: ./.repodata/
[2026-05-02T08:45:06.051Z] Preparing sqlite DBs
[2026-05-02T08:45:06.051Z] Pool started (with 5 workers)
[2026-05-02T08:45:06.051Z] Pool finished
[2026-05-02T08:45:06.051Z] /srv/anvil/cache
[2026-05-02T08:45:06.426Z] bash: line 1: rhc: command not found
[2026-05-02T08:45:06.801Z] bash: line 1: insights-client: command not found
[2026-05-02T08:45:06.801Z] bash: line 1: subscription-manager: command not found
[2026-05-02T08:45:09.287Z] Domain 'an-cache' destroyed
[2026-05-02T08:45:09.287Z] 
[2026-05-02T08:45:09.287Z] Domain 'an-cache' has been undefined
[2026-05-02T08:45:09.287Z] 
[2026-05-02T08:45:09.287Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:09.287Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:09.662Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:09.662Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:09.662Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:09.662Z] Done building drbd kmods
[2026-05-02T08:45:09.756Z] [Pipeline] }
[2026-05-02T08:45:09.760Z] [Pipeline] // stage
[2026-05-02T08:45:09.763Z] [Pipeline] stage
[2026-05-02T08:45:09.763Z] [Pipeline] { (Declarative: Post Actions)
[2026-05-02T08:45:09.768Z] [Pipeline] sh
[2026-05-02T08:45:10.305Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-05-02T08:45:10.305Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-05-02T08:45:10.305Z] Genering ssh keys and ssh config
[2026-05-02T08:45:10.681Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:10.681Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:10.681Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:10.681Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:10.681Z] # github.com:22 SSH-2.0-a59182e
[2026-05-02T08:45:10.681Z] Cleaning up simengine configuration
[2026-05-02T08:45:14.785Z] Destroying VMs (if any)
[2026-05-02T08:45:14.880Z] [Pipeline] cleanWs
[2026-05-02T08:45:14.944Z] [WS-CLEANUP] Deleting project workspace...
[2026-05-02T08:45:14.944Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-05-02T08:45:14.977Z] [WS-CLEANUP] done
[2026-05-02T08:45:14.980Z] [Pipeline] script
[2026-05-02T08:45:14.982Z] [Pipeline] {
[2026-05-02T08:45:14.997Z] [Pipeline] stage
[2026-05-02T08:45:14.997Z] [Pipeline] { (Copying logs)
[2026-05-02T08:45:15.029Z] [Pipeline] node
[2026-05-02T08:45:15.128Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@5
[2026-05-02T08:45:15.128Z] [Pipeline] {
[2026-05-02T08:45:15.162Z] [Pipeline] node
[2026-05-02T08:45:15.256Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@6
[2026-05-02T08:45:15.257Z] [Pipeline] {
[2026-05-02T08:45:15.260Z] [Pipeline] sh
[2026-05-02T08:45:15.515Z] + mkdir -p /var/lib/jenkins/locks
[2026-05-02T08:45:15.523Z] [Pipeline] echo
[2026-05-02T08:45:15.523Z] RWLock: FD for lock log_archive in stage projectFinishUp is 381
[2026-05-02T08:45:15.526Z] [Pipeline] sleep
[2026-05-02T08:45:15.526Z] No need to sleep any longer
[2026-05-02T08:45:15.528Z] [Pipeline] echo
[2026-05-02T08:45:15.529Z] Waiting for lock log_archive
[2026-05-02T08:45:15.531Z] [Pipeline] sleep
[2026-05-02T08:45:15.531Z] Sleeping for 1 min 0 sec
[2026-05-02T08:46:15.532Z] [Pipeline] echo
[2026-05-02T08:46:15.533Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-05-02T08:46:15.536Z] [Pipeline] }
[2026-05-02T08:46:15.538Z] [Pipeline] // node
[2026-05-02T08:46:15.540Z] [Pipeline] echo
[2026-05-02T08:46:15.540Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3762/
[2026-05-02T08:46:15.541Z] [Pipeline] sh
[2026-05-02T08:46:15.796Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3762/
[2026-05-02T08:46:15.798Z] [Pipeline] sh