[2026-04-22T08:37:49.265Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 536
[2026-04-22T08:37:49.265Z] originally caused by:
[2026-04-22T08:37:49.265Z]  Started by upstream project "anvil/anvil-build-cron" build number 33
[2026-04-22T08:37:49.265Z]  originally caused by:
[2026-04-22T08:37:49.265Z]   Started by timer
[2026-04-22T08:37:49.440Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-04-22T08:37:49.446Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-04-22T08:37:49.698Z] Examining kronosnet/ci-tools
[2026-04-22T08:37:49.698Z] Attempting to resolve main as a branch
[2026-04-22T08:37:49.876Z] Resolved main as branch main at revision 15d3cedba46357ac93022b02edbbaf956f5bf651
[2026-04-22T08:37:49.876Z] Selected Git installation does not exist. Using Default
[2026-04-22T08:37:49.876Z] The recommended git tool is: NONE
[2026-04-22T08:37:49.877Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-22T08:37:49.879Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-22T08:37:49.879Z] Wiping out workspace first.
[2026-04-22T08:37:49.901Z] Cloning the remote Git repository
[2026-04-22T08:37:49.901Z] Using shallow clone with depth 1
[2026-04-22T08:37:49.901Z] Avoid fetching tags
[2026-04-22T08:37:49.901Z] Honoring refspec on initial clone
[2026-04-22T08:37:49.901Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-22T08:37:49.901Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-04-22T08:37:49.911Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-22T08:37:49.911Z]  > git --version # timeout=10
[2026-04-22T08:37:49.918Z]  > git --version # 'git version 2.47.3'
[2026-04-22T08:37:49.918Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-22T08:37:49.925Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-22T08:37:50.108Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-22T08:37:50.114Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-22T08:37:50.122Z] Avoid second fetch
[2026-04-22T08:37:50.122Z] Checking out Revision 15d3cedba46357ac93022b02edbbaf956f5bf651 (main)
[2026-04-22T08:37:50.122Z]  > git config core.sparsecheckout # timeout=10
[2026-04-22T08:37:50.128Z]  > git checkout -f 15d3cedba46357ac93022b02edbbaf956f5bf651 # timeout=10
[2026-04-22T08:37:50.159Z] Commit message: "New getUpNodesByLabel() call"
[2026-04-22T08:37:50.166Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-04-22T08:37:50.446Z] Examining kronosnet/ci-tools
[2026-04-22T08:37:50.446Z] Attempting to resolve main as a branch
[2026-04-22T08:37:50.617Z] Resolved main as branch main at revision 15d3cedba46357ac93022b02edbbaf956f5bf651
[2026-04-22T08:37:50.617Z] Selected Git installation does not exist. Using Default
[2026-04-22T08:37:50.617Z] The recommended git tool is: NONE
[2026-04-22T08:37:50.617Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-22T08:37:50.620Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-22T08:37:50.620Z] Wiping out workspace first.
[2026-04-22T08:37:50.640Z] Cloning the remote Git repository
[2026-04-22T08:37:50.640Z] Using shallow clone with depth 1
[2026-04-22T08:37:50.640Z] Avoid fetching tags
[2026-04-22T08:37:50.640Z] Honoring refspec on initial clone
[2026-04-22T08:37:50.640Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-22T08:37:50.640Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-04-22T08:37:50.649Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-22T08:37:50.649Z]  > git --version # timeout=10
[2026-04-22T08:37:50.655Z]  > git --version # 'git version 2.47.3'
[2026-04-22T08:37:50.655Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-22T08:37:50.661Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-22T08:37:50.869Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-22T08:37:50.876Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-22T08:37:50.886Z] Avoid second fetch
[2026-04-22T08:37:50.887Z] Checking out Revision 15d3cedba46357ac93022b02edbbaf956f5bf651 (main)
[2026-04-22T08:37:50.887Z]  > git config core.sparsecheckout # timeout=10
[2026-04-22T08:37:50.894Z]  > git checkout -f 15d3cedba46357ac93022b02edbbaf956f5bf651 # timeout=10
[2026-04-22T08:37:50.926Z] Commit message: "New getUpNodesByLabel() call"
[2026-04-22T08:37:50.974Z] [Pipeline] Start of Pipeline
[2026-04-22T08:37:51.093Z] [Pipeline] node
[2026-04-22T08:37:51.100Z] Running on anvil-ci-bm-phy02 in /srv/workspace/anvil/anvil-build-kmods
[2026-04-22T08:37:51.100Z] [Pipeline] {
[2026-04-22T08:37:51.109Z] [Pipeline] stage
[2026-04-22T08:37:51.109Z] [Pipeline] { (Prep build env)
[2026-04-22T08:37:51.121Z] [Pipeline] cleanWs
[2026-04-22T08:37:51.188Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-22T08:37:51.188Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-22T08:37:51.221Z] [WS-CLEANUP] done
[2026-04-22T08:37:51.238Z] [Pipeline] lock
[2026-04-22T08:37:51.238Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-04-22T08:37:51.238Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-04-22T08:37:51.238Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-04-22T08:37:51.238Z] [Pipeline] {
[2026-04-22T08:37:51.240Z] [Pipeline] }
[2026-04-22T08:37:51.241Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-04-22T08:37:51.242Z] [Pipeline] // lock
[2026-04-22T08:37:51.245Z] [Pipeline] sh
[2026-04-22T08:37:51.781Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-04-22T08:37:51.781Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-22T08:37:52.157Z] Genering ssh keys and ssh config
[2026-04-22T08:37:52.157Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:52.157Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:52.157Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:52.531Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:52.531Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:52.531Z] Cleaning up simengine configuration
[2026-04-22T08:37:55.760Z] Destroying VMs (if any)
[2026-04-22T08:37:55.854Z] [Pipeline] }
[2026-04-22T08:37:55.856Z] [Pipeline] // stage
[2026-04-22T08:37:55.858Z] [Pipeline] stage
[2026-04-22T08:37:55.859Z] [Pipeline] { (Build kmod)
[2026-04-22T08:37:55.867Z] [Pipeline] sh
[2026-04-22T08:37:56.403Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 ci ci
[2026-04-22T08:37:56.403Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-22T08:37:56.403Z] Genering ssh keys and ssh config
[2026-04-22T08:37:56.777Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:56.777Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:56.777Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:56.777Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:56.777Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:56.777Z] Destroying VMs (if any)
[2026-04-22T08:37:57.151Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-22T08:37:57.524Z] Genering ssh keys and ssh config
[2026-04-22T08:37:57.524Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:57.524Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:57.897Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:57.897Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:57.897Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:37:57.897Z] Cache already updated
[2026-04-22T08:37:57.898Z] Building drbd kmod for almalinux-9 repo: ci anvil: ci
[2026-04-22T08:37:57.898Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-22T08:37:57.898Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-22T08:37:59.744Z] 
[2026-04-22T08:37:59.744Z] Starting install...
[2026-04-22T08:37:59.744Z] 
[2026-04-22T08:37:59.744Z] Creating domain...                                          |         00:00     
[2026-04-22T08:37:59.744Z] Domain creation completed.
[2026-04-22T08:37:59.744Z] Waiting for nodes and cloud-init to complete full init
[2026-04-22T08:38:02.974Z] cloud-init status node an-cache: 
[2026-04-22T08:38:02.974Z] Wed Apr 22 04:38:02 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:38:14.343Z] cloud-init status node an-cache: 
[2026-04-22T08:38:14.343Z] Wed Apr 22 04:38:12 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:38:23.807Z] cloud-init status node an-cache: running
[2026-04-22T08:38:23.807Z] Wed Apr 22 04:38:23 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:38:35.204Z] cloud-init status node an-cache: running
[2026-04-22T08:38:35.204Z] Wed Apr 22 04:38:34 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:38:46.583Z] cloud-init status node an-cache: running
[2026-04-22T08:38:46.583Z] Wed Apr 22 04:38:45 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:38:56.238Z] cloud-init status node an-cache: running
[2026-04-22T08:38:56.238Z] Wed Apr 22 04:38:56 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:39:07.804Z] cloud-init status node an-cache: running
[2026-04-22T08:39:07.804Z] Wed Apr 22 04:39:06 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:39:19.254Z] cloud-init status node an-cache: running
[2026-04-22T08:39:19.254Z] Wed Apr 22 04:39:17 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:39:28.737Z] cloud-init status node an-cache: running
[2026-04-22T08:39:28.737Z] Wed Apr 22 04:39:28 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:39:40.206Z] cloud-init status node an-cache: running
[2026-04-22T08:39:40.206Z] Wed Apr 22 04:39:39 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:39:51.656Z] cloud-init status node an-cache: running
[2026-04-22T08:39:51.656Z] Wed Apr 22 04:39:49 EDT 2026 actual: 0 expected: 1
[2026-04-22T08:40:01.060Z] cloud-init status node an-cache: done
[2026-04-22T08:40:01.060Z] Wed Apr 22 04:40:00 EDT 2026 actual: 1 expected: 1
[2026-04-22T08:40:01.060Z] Waiting for akmods to complete build
[2026-04-22T08:40:01.435Z] build not found, sleeping 10 seconds
[2026-04-22T08:40:12.921Z] build not found, sleeping 10 seconds
[2026-04-22T08:40:22.320Z] build not found, sleeping 10 seconds
[2026-04-22T08:40:33.308Z] build not found, sleeping 10 seconds
[2026-04-22T08:40:42.718Z] build not found, sleeping 10 seconds
[2026-04-22T08:40:54.117Z] build not found, sleeping 10 seconds
[2026-04-22T08:41:03.519Z] build not found, sleeping 10 seconds
[2026-04-22T08:41:12.996Z] build not found, sleeping 10 seconds
[2026-04-22T08:41:24.437Z] build not found, sleeping 10 seconds
[2026-04-22T08:41:33.836Z] build not found, sleeping 10 seconds
[2026-04-22T08:41:43.981Z] build not found, sleeping 10 seconds
[2026-04-22T08:41:55.360Z] build not found, sleeping 10 seconds
[2026-04-22T08:42:04.777Z] build not found, sleeping 10 seconds
[2026-04-22T08:42:16.201Z] build not found, sleeping 10 seconds
[2026-04-22T08:42:25.609Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-611.el9_7-9.2.16-1.el9.x86_64.rpm
[2026-04-22T08:42:25.609Z] build found
[2026-04-22T08:42:25.609Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-22T08:42:25.986Z] Directory walk started
[2026-04-22T08:42:25.986Z] Directory walk done - 9 packages
[2026-04-22T08:42:25.986Z] Temporary output repo path: ./.repodata/
[2026-04-22T08:42:25.986Z] Preparing sqlite DBs
[2026-04-22T08:42:25.986Z] Pool started (with 5 workers)
[2026-04-22T08:42:25.986Z] Pool finished
[2026-04-22T08:42:26.361Z] /srv/anvil/cache
[2026-04-22T08:42:26.361Z] bash: line 1: rhc: command not found
[2026-04-22T08:42:26.737Z] bash: line 1: insights-client: command not found
[2026-04-22T08:42:27.112Z] bash: line 1: subscription-manager: command not found
[2026-04-22T08:42:29.605Z] Domain 'an-cache' destroyed
[2026-04-22T08:42:29.605Z] 
[2026-04-22T08:42:29.605Z] Domain 'an-cache' has been undefined
[2026-04-22T08:42:29.605Z] 
[2026-04-22T08:42:29.605Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:29.605Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:29.605Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:29.605Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:29.605Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:29.605Z] Done building drbd kmods
[2026-04-22T08:42:29.704Z] [Pipeline] }
[2026-04-22T08:42:29.706Z] [Pipeline] // stage
[2026-04-22T08:42:29.709Z] [Pipeline] stage
[2026-04-22T08:42:29.709Z] [Pipeline] { (Declarative: Post Actions)
[2026-04-22T08:42:29.714Z] [Pipeline] sh
[2026-04-22T08:42:30.622Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-04-22T08:42:30.623Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-22T08:42:30.623Z] Genering ssh keys and ssh config
[2026-04-22T08:42:31.097Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:31.097Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:31.097Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:31.097Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:31.097Z] # github.com:22 SSH-2.0-199cd5e
[2026-04-22T08:42:31.097Z] Cleaning up simengine configuration
[2026-04-22T08:42:34.352Z] Destroying VMs (if any)
[2026-04-22T08:42:34.454Z] [Pipeline] cleanWs
[2026-04-22T08:42:34.522Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-22T08:42:34.522Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-22T08:42:34.555Z] [WS-CLEANUP] done
[2026-04-22T08:42:34.558Z] [Pipeline] script
[2026-04-22T08:42:34.559Z] [Pipeline] {
[2026-04-22T08:42:34.573Z] [Pipeline] stage
[2026-04-22T08:42:34.573Z] [Pipeline] { (Copying logs)
[2026-04-22T08:42:34.603Z] [Pipeline] node
[2026-04-22T08:42:34.692Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-04-22T08:42:34.693Z] [Pipeline] {
[2026-04-22T08:42:34.725Z] [Pipeline] node
[2026-04-22T08:42:34.812Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-04-22T08:42:34.813Z] [Pipeline] {
[2026-04-22T08:42:34.815Z] [Pipeline] sh
[2026-04-22T08:42:35.071Z] + mkdir -p /var/lib/jenkins/locks
[2026-04-22T08:42:35.078Z] [Pipeline] echo
[2026-04-22T08:42:35.078Z] RWLock: FD for lock log_archive in stage projectFinishUp is 656
[2026-04-22T08:42:35.080Z] [Pipeline] sleep
[2026-04-22T08:42:35.081Z] No need to sleep any longer
[2026-04-22T08:42:35.083Z] [Pipeline] echo
[2026-04-22T08:42:35.083Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-04-22T08:42:35.085Z] [Pipeline] }
[2026-04-22T08:42:35.087Z] [Pipeline] // node
[2026-04-22T08:42:35.089Z] [Pipeline] echo
[2026-04-22T08:42:35.089Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3707/
[2026-04-22T08:42:35.090Z] [Pipeline] sh
[2026-04-22T08:42:35.345Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3707/
[2026-04-22T08:42:35.346Z] [Pipeline] sh