[2026-09-20T08:40:21.740Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 671
[2026-09-20T08:40:21.740Z] originally caused by:
[2026-09-20T08:40:21.740Z]  Started by upstream project "anvil/anvil-build-cron" build number 171
[2026-09-20T08:40:21.740Z]  originally caused by:
[2026-09-20T08:40:21.740Z]   Started by timer
[2026-09-20T08:40:22.579Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-09-20T08:40:22.586Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-09-20T08:40:22.766Z] Examining kronosnet/ci-tools
[2026-09-20T08:40:22.766Z] Attempting to resolve main as a branch
[2026-09-20T08:40:22.933Z] Resolved main as branch main at revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879
[2026-09-20T08:40:22.934Z] Selected Git installation does not exist. Using Default
[2026-09-20T08:40:22.934Z] The recommended git tool is: NONE
[2026-09-20T08:40:22.934Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-09-20T08:40:22.938Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-09-20T08:40:22.938Z] Wiping out workspace first.
[2026-09-20T08:40:22.964Z] Cloning the remote Git repository
[2026-09-20T08:40:22.964Z] Using shallow clone with depth 1
[2026-09-20T08:40:22.964Z] Avoid fetching tags
[2026-09-20T08:40:22.964Z] Honoring refspec on initial clone
[2026-09-20T08:40:22.964Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:40:22.965Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@3 # timeout=10
[2026-09-20T08:40:22.976Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:40:22.976Z]  > git --version # timeout=10
[2026-09-20T08:40:23.008Z]  > git --version # 'git version 2.52.0'
[2026-09-20T08:40:23.008Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-09-20T08:40:23.015Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:40:23.310Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-09-20T08:40:23.318Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:40:23.327Z] Avoid second fetch
[2026-09-20T08:40:23.327Z] Checking out Revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879 (main)
[2026-09-20T08:40:23.327Z]  > git config core.sparsecheckout # timeout=10
[2026-09-20T08:40:23.334Z]  > git checkout -f 10ba49ff26b0e424c550d2fed1e2a22a6160f879 # timeout=10
[2026-09-20T08:40:23.371Z] Commit message: "fn-testing: stop using gcloud directly"
[2026-09-20T08:40:23.379Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-09-20T08:40:23.556Z] Examining kronosnet/ci-tools
[2026-09-20T08:40:23.556Z] Attempting to resolve main as a branch
[2026-09-20T08:40:23.701Z] Resolved main as branch main at revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879
[2026-09-20T08:40:23.701Z] Selected Git installation does not exist. Using Default
[2026-09-20T08:40:23.701Z] The recommended git tool is: NONE
[2026-09-20T08:40:23.704Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-09-20T08:40:23.707Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-09-20T08:40:23.707Z] Wiping out workspace first.
[2026-09-20T08:40:23.735Z] Cloning the remote Git repository
[2026-09-20T08:40:23.735Z] Using shallow clone with depth 1
[2026-09-20T08:40:23.735Z] Avoid fetching tags
[2026-09-20T08:40:23.735Z] Honoring refspec on initial clone
[2026-09-20T08:40:23.736Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:40:23.736Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@6 # timeout=10
[2026-09-20T08:40:23.748Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:40:23.748Z]  > git --version # timeout=10
[2026-09-20T08:40:23.758Z]  > git --version # 'git version 2.52.0'
[2026-09-20T08:40:23.758Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-09-20T08:40:23.767Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:40:24.073Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-09-20T08:40:24.081Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:40:24.089Z] Avoid second fetch
[2026-09-20T08:40:24.089Z] Checking out Revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879 (main)
[2026-09-20T08:40:24.089Z]  > git config core.sparsecheckout # timeout=10
[2026-09-20T08:40:24.096Z]  > git checkout -f 10ba49ff26b0e424c550d2fed1e2a22a6160f879 # timeout=10
[2026-09-20T08:40:24.132Z] Commit message: "fn-testing: stop using gcloud directly"
[2026-09-20T08:40:24.172Z] [Pipeline] Start of Pipeline
[2026-09-20T08:40:24.271Z] [Pipeline] node
[2026-09-20T08:40:25.597Z] Running on anvil-ci-bm-phy06 in /srv/workspace/anvil/anvil-build-kmods
[2026-09-20T08:40:25.597Z] [Pipeline] {
[2026-09-20T08:40:25.607Z] [Pipeline] stage
[2026-09-20T08:40:25.607Z] [Pipeline] { (Prep build env)
[2026-09-20T08:40:25.618Z] [Pipeline] cleanWs
[2026-09-20T08:40:25.718Z] [WS-CLEANUP] Deleting project workspace...
[2026-09-20T08:40:25.718Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-09-20T08:40:25.759Z] [WS-CLEANUP] done
[2026-09-20T08:40:25.783Z] [Pipeline] lock
[2026-09-20T08:40:25.783Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-09-20T08:40:25.784Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-09-20T08:40:25.784Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-09-20T08:40:25.784Z] [Pipeline] {
[2026-09-20T08:40:25.787Z] [Pipeline] }
[2026-09-20T08:40:25.787Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-09-20T08:40:25.789Z] [Pipeline] // lock
[2026-09-20T08:40:25.793Z] [Pipeline] sh
[2026-09-20T08:40:26.440Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-09-20T08:40:26.440Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-20T08:40:26.851Z] Genering ssh keys and ssh config
[2026-09-20T08:40:27.261Z] Cleaning up simengine configuration
[2026-09-20T08:40:31.671Z] Destroying VMs (if any)
[2026-09-20T08:40:31.797Z] [Pipeline] }
[2026-09-20T08:40:31.799Z] [Pipeline] // stage
[2026-09-20T08:40:31.801Z] [Pipeline] stage
[2026-09-20T08:40:31.802Z] [Pipeline] { (Build kmod)
[2026-09-20T08:40:31.810Z] [Pipeline] sh
[2026-09-20T08:40:32.454Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise-staging none
[2026-09-20T08:40:32.454Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-20T08:40:32.454Z] Genering ssh keys and ssh config
[2026-09-20T08:40:33.326Z] Destroying VMs (if any)
[2026-09-20T08:40:33.742Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-20T08:40:33.742Z] Genering ssh keys and ssh config
[2026-09-20T08:40:34.615Z] Cache already updated
[2026-09-20T08:40:34.615Z] Building drbd kmod for almalinux-9 repo: enterprise-staging anvil: none
[2026-09-20T08:40:34.615Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-09-20T08:40:34.615Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-09-20T08:40:37.283Z] 
[2026-09-20T08:40:37.283Z] Starting install...
[2026-09-20T08:40:37.283Z] 
[2026-09-20T08:40:37.283Z] Creating domain...                                          |         00:00     
[2026-09-20T08:40:37.283Z] Domain creation completed.
[2026-09-20T08:40:37.283Z] Waiting for nodes and cloud-init to complete full init
[2026-09-20T08:40:40.734Z] cloud-init status node an-cache: 
[2026-09-20T08:40:40.734Z] Sun Sep 20 04:40:40 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:40:54.941Z] cloud-init status node an-cache: 
[2026-09-20T08:40:54.941Z] Sun Sep 20 04:40:53 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:41:04.776Z] cloud-init status node an-cache: 
[2026-09-20T08:41:04.776Z] Sun Sep 20 04:41:03 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:41:16.598Z] cloud-init status node an-cache: running
[2026-09-20T08:41:16.598Z] Sun Sep 20 04:41:14 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:41:26.416Z] cloud-init status node an-cache: running
[2026-09-20T08:41:26.416Z] Sun Sep 20 04:41:26 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:41:38.239Z] cloud-init status node an-cache: running
[2026-09-20T08:41:38.239Z] Sun Sep 20 04:41:37 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:41:50.047Z] cloud-init status node an-cache: running
[2026-09-20T08:41:50.047Z] Sun Sep 20 04:41:48 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:41:59.816Z] cloud-init status node an-cache: running
[2026-09-20T08:41:59.816Z] Sun Sep 20 04:41:59 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:42:11.626Z] cloud-init status node an-cache: running
[2026-09-20T08:42:11.626Z] Sun Sep 20 04:42:09 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:42:23.451Z] cloud-init status node an-cache: running
[2026-09-20T08:42:23.451Z] Sun Sep 20 04:42:21 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:42:35.279Z] cloud-init status node an-cache: running
[2026-09-20T08:42:35.279Z] Sun Sep 20 04:42:33 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:42:45.151Z] cloud-init status node an-cache: running
[2026-09-20T08:42:45.151Z] Sun Sep 20 04:42:45 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:42:56.976Z] cloud-init status node an-cache: running
[2026-09-20T08:42:56.976Z] Sun Sep 20 04:42:56 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:43:08.803Z] cloud-init status node an-cache: running
[2026-09-20T08:43:08.803Z] Sun Sep 20 04:43:08 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:43:20.626Z] cloud-init status node an-cache: running
[2026-09-20T08:43:20.626Z] Sun Sep 20 04:43:19 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:43:32.472Z] cloud-init status node an-cache: running
[2026-09-20T08:43:32.472Z] Sun Sep 20 04:43:30 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:43:42.295Z] cloud-init status node an-cache: running
[2026-09-20T08:43:42.295Z] Sun Sep 20 04:43:41 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:43:54.108Z] cloud-init status node an-cache: running
[2026-09-20T08:43:54.108Z] Sun Sep 20 04:43:52 EDT 2026 actual: 0 expected: 1
[2026-09-20T08:44:03.950Z] cloud-init status node an-cache: done
[2026-09-20T08:44:03.950Z] Sun Sep 20 04:44:02 EDT 2026 actual: 1 expected: 1
[2026-09-20T08:44:03.950Z] Waiting for akmods to complete build
[2026-09-20T08:44:03.950Z] build not found, sleeping 10 seconds
[2026-09-20T08:44:15.792Z] build not found, sleeping 10 seconds
[2026-09-20T08:44:25.638Z] build not found, sleeping 10 seconds
[2026-09-20T08:44:35.442Z] build not found, sleeping 10 seconds
[2026-09-20T08:44:47.262Z] build not found, sleeping 10 seconds
[2026-09-20T08:44:57.091Z] build not found, sleeping 10 seconds
[2026-09-20T08:45:08.943Z] build not found, sleeping 10 seconds
[2026-09-20T08:45:18.774Z] build not found, sleeping 10 seconds
[2026-09-20T08:45:28.640Z] build not found, sleeping 10 seconds
[2026-09-20T08:45:40.549Z] build not found, sleeping 10 seconds
[2026-09-20T08:45:50.341Z] build not found, sleeping 10 seconds
[2026-09-20T08:46:00.141Z] build not found, sleeping 10 seconds
[2026-09-20T08:46:11.945Z] build not found, sleeping 10 seconds
[2026-09-20T08:46:23.764Z] build not found, sleeping 10 seconds
[2026-09-20T08:46:33.569Z] build not found, sleeping 10 seconds
[2026-09-20T08:46:43.380Z] build not found, sleeping 10 seconds
[2026-09-20T08:46:55.191Z] build not found, sleeping 10 seconds
[2026-09-20T08:47:04.986Z] build not found, sleeping 10 seconds
[2026-09-20T08:47:16.791Z] build not found, sleeping 10 seconds
[2026-09-20T08:47:26.568Z] build not found, sleeping 10 seconds
[2026-09-20T08:47:38.379Z] build not found, sleeping 10 seconds
[2026-09-20T08:47:48.475Z] build not found, sleeping 10 seconds
[2026-09-20T08:47:58.353Z] build not found, sleeping 10 seconds
[2026-09-20T08:48:10.163Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-09-20T08:48:10.163Z] build found
[2026-09-20T08:48:10.163Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-20T08:48:10.575Z] Directory walk started
[2026-09-20T08:48:10.575Z] Directory walk done - 8 packages
[2026-09-20T08:48:10.575Z] Temporary output repo path: ./.repodata/
[2026-09-20T08:48:10.575Z] Preparing sqlite DBs
[2026-09-20T08:48:10.575Z] Pool started (with 5 workers)
[2026-09-20T08:48:10.575Z] Pool finished
[2026-09-20T08:48:10.575Z] /srv/anvil/cache
[2026-09-20T08:48:10.986Z] bash: line 1: rhc: command not found
[2026-09-20T08:48:11.399Z] bash: line 1: insights-client: command not found
[2026-09-20T08:48:11.810Z] bash: line 1: subscription-manager: command not found
[2026-09-20T08:48:14.486Z] Domain 'an-cache' destroyed
[2026-09-20T08:48:14.486Z] 
[2026-09-20T08:48:14.486Z] Domain 'an-cache' has been undefined
[2026-09-20T08:48:14.486Z] 
[2026-09-20T08:48:14.897Z] Done building drbd kmods
[2026-09-20T08:48:15.018Z] [Pipeline] }
[2026-09-20T08:48:15.021Z] [Pipeline] // stage
[2026-09-20T08:48:15.024Z] [Pipeline] stage
[2026-09-20T08:48:15.024Z] [Pipeline] { (Declarative: Post Actions)
[2026-09-20T08:48:15.029Z] [Pipeline] sh
[2026-09-20T08:48:15.809Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-09-20T08:48:15.809Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-20T08:48:15.809Z] Genering ssh keys and ssh config
[2026-09-20T08:48:16.681Z] Cleaning up simengine configuration
[2026-09-20T08:48:21.037Z] Destroying VMs (if any)
[2026-09-20T08:48:21.159Z] [Pipeline] cleanWs
[2026-09-20T08:48:21.243Z] [WS-CLEANUP] Deleting project workspace...
[2026-09-20T08:48:21.243Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-09-20T08:48:21.284Z] [WS-CLEANUP] done
[2026-09-20T08:48:21.287Z] [Pipeline] script
[2026-09-20T08:48:21.288Z] [Pipeline] {
[2026-09-20T08:48:21.303Z] [Pipeline] stage
[2026-09-20T08:48:21.303Z] [Pipeline] { (Copying logs)
[2026-09-20T08:48:21.343Z] [Pipeline] node
[2026-09-20T08:48:22.015Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@3
[2026-09-20T08:48:22.016Z] [Pipeline] {
[2026-09-20T08:48:22.049Z] [Pipeline] node
[2026-09-20T08:48:23.154Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-09-20T08:48:23.154Z] [Pipeline] {
[2026-09-20T08:48:23.158Z] [Pipeline] sh
[2026-09-20T08:48:23.415Z] + mkdir -p /var/lib/jenkins/locks
[2026-09-20T08:48:23.424Z] [Pipeline] echo
[2026-09-20T08:48:23.424Z] RWLock: FD for lock log_archive in stage projectFinishUp is 742
[2026-09-20T08:48:23.427Z] [Pipeline] sleep
[2026-09-20T08:48:23.427Z] No need to sleep any longer
[2026-09-20T08:48:23.430Z] [Pipeline] echo
[2026-09-20T08:48:23.430Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-09-20T08:48:23.432Z] [Pipeline] }
[2026-09-20T08:48:23.434Z] [Pipeline] // node
[2026-09-20T08:48:23.437Z] [Pipeline] echo
[2026-09-20T08:48:23.438Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4518/
[2026-09-20T08:48:23.439Z] [Pipeline] sh
[2026-09-20T08:48:23.694Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4518/
[2026-09-20T08:48:23.696Z] [Pipeline] sh