[2026-04-13T09:07:25.844Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 527
[2026-04-13T09:07:25.844Z] originally caused by:
[2026-04-13T09:07:25.844Z]  Started by upstream project "anvil/anvil-build-cron" build number 24
[2026-04-13T09:07:25.844Z]  originally caused by:
[2026-04-13T09:07:25.844Z]   Started by timer
[2026-04-13T09:07:26.744Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-04-13T09:07:26.750Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-04-13T09:07:26.984Z] Examining kronosnet/ci-tools
[2026-04-13T09:07:26.985Z] Attempting to resolve main as a branch
[2026-04-13T09:07:27.108Z] Resolved main as branch main at revision 1d4a4a241ca5567469f009c88d247668dbd0cdd3
[2026-04-13T09:07:27.109Z] Selected Git installation does not exist. Using Default
[2026-04-13T09:07:27.109Z] The recommended git tool is: NONE
[2026-04-13T09:07:27.109Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-13T09:07:27.113Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-13T09:07:27.113Z] Wiping out workspace first.
[2026-04-13T09:07:27.137Z] Cloning the remote Git repository
[2026-04-13T09:07:27.137Z] Using shallow clone with depth 1
[2026-04-13T09:07:27.137Z] Avoid fetching tags
[2026-04-13T09:07:27.137Z] Honoring refspec on initial clone
[2026-04-13T09:07:27.137Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-13T09:07:27.137Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@5 # timeout=10
[2026-04-13T09:07:27.147Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-13T09:07:27.147Z]  > git --version # timeout=10
[2026-04-13T09:07:27.154Z]  > git --version # 'git version 2.47.3'
[2026-04-13T09:07:27.154Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-13T09:07:27.160Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-13T09:07:27.366Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-13T09:07:27.373Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-13T09:07:27.381Z] Avoid second fetch
[2026-04-13T09:07:27.382Z] Checking out Revision 1d4a4a241ca5567469f009c88d247668dbd0cdd3 (main)
[2026-04-13T09:07:27.382Z]  > git config core.sparsecheckout # timeout=10
[2026-04-13T09:07:27.388Z]  > git checkout -f 1d4a4a241ca5567469f009c88d247668dbd0cdd3 # timeout=10
[2026-04-13T09:07:27.421Z] Commit message: "Make runStage() use runWithArtifacts()"
[2026-04-13T09:07:27.427Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-04-13T09:07:27.683Z] Examining kronosnet/ci-tools
[2026-04-13T09:07:27.683Z] Attempting to resolve main as a branch
[2026-04-13T09:07:27.817Z] Resolved main as branch main at revision 1d4a4a241ca5567469f009c88d247668dbd0cdd3
[2026-04-13T09:07:27.818Z] Selected Git installation does not exist. Using Default
[2026-04-13T09:07:27.818Z] The recommended git tool is: NONE
[2026-04-13T09:07:27.818Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-13T09:07:27.821Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-13T09:07:27.821Z] Wiping out workspace first.
[2026-04-13T09:07:27.842Z] Cloning the remote Git repository
[2026-04-13T09:07:27.842Z] Using shallow clone with depth 1
[2026-04-13T09:07:27.842Z] Avoid fetching tags
[2026-04-13T09:07:27.842Z] Honoring refspec on initial clone
[2026-04-13T09:07:27.842Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-13T09:07:27.842Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@5 # timeout=10
[2026-04-13T09:07:27.851Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-13T09:07:27.851Z]  > git --version # timeout=10
[2026-04-13T09:07:27.860Z]  > git --version # 'git version 2.47.3'
[2026-04-13T09:07:27.860Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-13T09:07:27.868Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-13T09:07:28.051Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-13T09:07:28.058Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-13T09:07:28.070Z] Avoid second fetch
[2026-04-13T09:07:28.070Z] Checking out Revision 1d4a4a241ca5567469f009c88d247668dbd0cdd3 (main)
[2026-04-13T09:07:28.071Z]  > git config core.sparsecheckout # timeout=10
[2026-04-13T09:07:28.080Z]  > git checkout -f 1d4a4a241ca5567469f009c88d247668dbd0cdd3 # timeout=10
[2026-04-13T09:07:28.127Z] Commit message: "Make runStage() use runWithArtifacts()"
[2026-04-13T09:07:28.164Z] [Pipeline] Start of Pipeline
[2026-04-13T09:07:28.250Z] [Pipeline] node
[2026-04-13T09:07:28.251Z] Running on anvil-ci-bm-phy05 in /srv/workspace/anvil/anvil-build-kmods
[2026-04-13T09:07:28.252Z] [Pipeline] {
[2026-04-13T09:07:28.260Z] [Pipeline] stage
[2026-04-13T09:07:28.260Z] [Pipeline] { (Prep build env)
[2026-04-13T09:07:28.270Z] [Pipeline] cleanWs
[2026-04-13T09:07:28.333Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-13T09:07:28.333Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-13T09:07:28.364Z] [WS-CLEANUP] done
[2026-04-13T09:07:28.383Z] [Pipeline] lock
[2026-04-13T09:07:28.383Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-04-13T09:07:28.383Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-04-13T09:07:28.384Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-04-13T09:07:28.384Z] [Pipeline] {
[2026-04-13T09:07:28.386Z] [Pipeline] }
[2026-04-13T09:07:28.386Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-04-13T09:07:28.388Z] [Pipeline] // lock
[2026-04-13T09:07:28.390Z] [Pipeline] sh
[2026-04-13T09:07:28.926Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-04-13T09:07:28.927Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-13T09:07:29.297Z] Genering ssh keys and ssh config
[2026-04-13T09:07:29.297Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:29.668Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:29.668Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:29.668Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:29.668Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:29.668Z] Cleaning up simengine configuration
[2026-04-13T09:07:33.741Z] Destroying VMs (if any)
[2026-04-13T09:07:34.202Z] [Pipeline] }
[2026-04-13T09:07:34.204Z] [Pipeline] // stage
[2026-04-13T09:07:34.207Z] [Pipeline] stage
[2026-04-13T09:07:34.208Z] [Pipeline] { (Build kmod)
[2026-04-13T09:07:34.217Z] [Pipeline] sh
[2026-04-13T09:07:34.743Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise-staging none
[2026-04-13T09:07:34.743Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-13T09:07:35.114Z] Genering ssh keys and ssh config
[2026-04-13T09:07:35.114Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:35.114Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:35.114Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:35.114Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:35.485Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:35.485Z] Destroying VMs (if any)
[2026-04-13T09:07:35.485Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-13T09:07:35.856Z] Genering ssh keys and ssh config
[2026-04-13T09:07:36.227Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:36.227Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:36.227Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:36.227Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:36.227Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:07:36.227Z] Cache already updated
[2026-04-13T09:07:36.227Z] Building drbd kmod for almalinux-9 repo: enterprise-staging anvil: none
[2026-04-13T09:07:36.598Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-13T09:07:36.598Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-13T09:07:39.807Z] 
[2026-04-13T09:07:39.807Z] Starting install...
[2026-04-13T09:07:39.807Z] 
[2026-04-13T09:07:39.807Z] Creating domain...                                          |         00:00     
[2026-04-13T09:07:39.807Z] Domain creation completed.
[2026-04-13T09:07:39.807Z] Waiting for nodes and cloud-init to complete full init
[2026-04-13T09:07:43.015Z] cloud-init status node an-cache: 
[2026-04-13T09:07:43.015Z] Mon Apr 13 05:07:42 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:07:56.686Z] cloud-init status node an-cache: 
[2026-04-13T09:07:56.686Z] Mon Apr 13 05:07:55 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:08:06.044Z] cloud-init status node an-cache: 
[2026-04-13T09:08:06.044Z] Mon Apr 13 05:08:05 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:08:19.711Z] cloud-init status node an-cache: running
[2026-04-13T09:08:19.711Z] Mon Apr 13 05:08:17 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:08:31.040Z] cloud-init status node an-cache: running
[2026-04-13T09:08:31.040Z] Mon Apr 13 05:08:29 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:08:42.455Z] cloud-init status node an-cache: running
[2026-04-13T09:08:42.455Z] Mon Apr 13 05:08:40 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:08:52.709Z] cloud-init status node an-cache: running
[2026-04-13T09:08:52.709Z] Mon Apr 13 05:08:52 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:09:04.035Z] cloud-init status node an-cache: running
[2026-04-13T09:09:04.035Z] Mon Apr 13 05:09:03 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:09:17.703Z] cloud-init status node an-cache: running
[2026-04-13T09:09:17.703Z] Mon Apr 13 05:09:15 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:09:29.490Z] cloud-init status node an-cache: running
[2026-04-13T09:09:29.490Z] Mon Apr 13 05:09:27 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:09:40.821Z] cloud-init status node an-cache: running
[2026-04-13T09:09:40.821Z] Mon Apr 13 05:09:39 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:09:52.147Z] cloud-init status node an-cache: running
[2026-04-13T09:09:52.147Z] Mon Apr 13 05:09:51 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:10:03.736Z] cloud-init status node an-cache: running
[2026-04-13T09:10:03.736Z] Mon Apr 13 05:10:03 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:10:17.404Z] cloud-init status node an-cache: running
[2026-04-13T09:10:17.404Z] Mon Apr 13 05:10:15 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:10:26.745Z] cloud-init status node an-cache: running
[2026-04-13T09:10:26.745Z] Mon Apr 13 05:10:26 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:10:38.387Z] cloud-init status node an-cache: running
[2026-04-13T09:10:38.387Z] Mon Apr 13 05:10:37 EDT 2026 actual: 0 expected: 1
[2026-04-13T09:10:49.724Z] cloud-init status node an-cache: done
[2026-04-13T09:10:49.725Z] Mon Apr 13 05:10:48 EDT 2026 actual: 1 expected: 1
[2026-04-13T09:10:49.725Z] Waiting for akmods to complete build
[2026-04-13T09:10:49.725Z] build not found, sleeping 10 seconds
[2026-04-13T09:11:01.047Z] build not found, sleeping 10 seconds
[2026-04-13T09:11:10.593Z] build not found, sleeping 10 seconds
[2026-04-13T09:11:21.902Z] build not found, sleeping 10 seconds
[2026-04-13T09:11:31.249Z] build not found, sleeping 10 seconds
[2026-04-13T09:11:42.816Z] build not found, sleeping 10 seconds
[2026-04-13T09:11:54.139Z] build not found, sleeping 10 seconds
[2026-04-13T09:12:03.487Z] build not found, sleeping 10 seconds
[2026-04-13T09:12:14.979Z] build not found, sleeping 10 seconds
[2026-04-13T09:12:26.292Z] build not found, sleeping 10 seconds
[2026-04-13T09:12:35.640Z] build not found, sleeping 10 seconds
[2026-04-13T09:12:47.182Z] build not found, sleeping 10 seconds
[2026-04-13T09:12:58.507Z] build not found, sleeping 10 seconds
[2026-04-13T09:13:09.831Z] build not found, sleeping 10 seconds
[2026-04-13T09:13:19.181Z] build not found, sleeping 10 seconds
[2026-04-13T09:13:30.531Z] build not found, sleeping 10 seconds
[2026-04-13T09:13:41.854Z] build not found, sleeping 10 seconds
[2026-04-13T09:13:51.379Z] build not found, sleeping 10 seconds
[2026-04-13T09:14:02.696Z] build not found, sleeping 10 seconds
[2026-04-13T09:14:14.021Z] build not found, sleeping 10 seconds
[2026-04-13T09:14:25.344Z] build not found, sleeping 10 seconds
[2026-04-13T09:14:34.688Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-611.el9_7-9.2.16-1.el9.x86_64.rpm
[2026-04-13T09:14:34.688Z] build found
[2026-04-13T09:14:35.480Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-13T09:14:36.271Z] Directory walk started
[2026-04-13T09:14:36.271Z] Directory walk done - 7 packages
[2026-04-13T09:14:36.271Z] Temporary output repo path: ./.repodata/
[2026-04-13T09:14:36.271Z] Preparing sqlite DBs
[2026-04-13T09:14:36.271Z] Pool started (with 5 workers)
[2026-04-13T09:14:36.271Z] Pool finished
[2026-04-13T09:14:36.271Z] /srv/anvil/cache
[2026-04-13T09:14:37.063Z] bash: line 1: rhc: command not found
[2026-04-13T09:14:37.434Z] bash: line 1: insights-client: command not found
[2026-04-13T09:14:37.805Z] bash: line 1: subscription-manager: command not found
[2026-04-13T09:14:40.271Z] Domain 'an-cache' destroyed
[2026-04-13T09:14:40.271Z] 
[2026-04-13T09:14:40.271Z] Domain 'an-cache' has been undefined
[2026-04-13T09:14:40.271Z] 
[2026-04-13T09:14:40.271Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:40.271Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:40.642Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:40.642Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:40.642Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:40.642Z] Done building drbd kmods
[2026-04-13T09:14:40.733Z] [Pipeline] }
[2026-04-13T09:14:40.735Z] [Pipeline] // stage
[2026-04-13T09:14:40.737Z] [Pipeline] stage
[2026-04-13T09:14:40.738Z] [Pipeline] { (Declarative: Post Actions)
[2026-04-13T09:14:40.742Z] [Pipeline] sh
[2026-04-13T09:14:41.412Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-04-13T09:14:41.412Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-13T09:14:41.782Z] Genering ssh keys and ssh config
[2026-04-13T09:14:41.782Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:41.782Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:41.782Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:42.153Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:42.153Z] # github.com:22 SSH-2.0-3992d52
[2026-04-13T09:14:42.153Z] Cleaning up simengine configuration
[2026-04-13T09:14:46.228Z] Destroying VMs (if any)
[2026-04-13T09:14:46.320Z] [Pipeline] cleanWs
[2026-04-13T09:14:46.382Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-13T09:14:46.382Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-13T09:14:46.412Z] [WS-CLEANUP] done
[2026-04-13T09:14:46.416Z] [Pipeline] script
[2026-04-13T09:14:46.417Z] [Pipeline] {
[2026-04-13T09:14:46.430Z] [Pipeline] stage
[2026-04-13T09:14:46.430Z] [Pipeline] { (Copying logs)
[2026-04-13T09:14:46.460Z] [Pipeline] node
[2026-04-13T09:14:46.467Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-04-13T09:14:46.467Z] [Pipeline] {
[2026-04-13T09:14:46.498Z] [Pipeline] node
[2026-04-13T09:14:46.505Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@3
[2026-04-13T09:14:46.505Z] [Pipeline] {
[2026-04-13T09:14:46.508Z] [Pipeline] sh
[2026-04-13T09:14:46.763Z] + mkdir -p /var/lib/jenkins/locks
[2026-04-13T09:14:46.771Z] [Pipeline] echo
[2026-04-13T09:14:46.771Z] RWLock: FD for lock log_archive in stage projectFinishUp is 392
[2026-04-13T09:14:46.774Z] [Pipeline] sleep
[2026-04-13T09:14:46.774Z] No need to sleep any longer
[2026-04-13T09:14:46.777Z] [Pipeline] echo
[2026-04-13T09:14:46.777Z] Waiting for lock log_archive
[2026-04-13T09:14:46.779Z] [Pipeline] sleep
[2026-04-13T09:14:46.779Z] Sleeping for 1 min 0 sec
[2026-04-13T09:15:46.780Z] [Pipeline] echo
[2026-04-13T09:15:46.781Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-04-13T09:15:46.784Z] [Pipeline] }
[2026-04-13T09:15:46.785Z] [Pipeline] // node
[2026-04-13T09:15:46.788Z] [Pipeline] echo
[2026-04-13T09:15:46.788Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3654/
[2026-04-13T09:15:46.789Z] [Pipeline] sh
[2026-04-13T09:15:47.044Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3654/
[2026-04-13T09:15:47.046Z] [Pipeline] sh