[2026-04-14T09:07:00.340Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 528
[2026-04-14T09:07:00.340Z] originally caused by:
[2026-04-14T09:07:00.340Z]  Started by upstream project "anvil/anvil-build-cron" build number 25
[2026-04-14T09:07:00.340Z]  originally caused by:
[2026-04-14T09:07:00.340Z]   Started by timer
[2026-04-14T09:07:00.654Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-04-14T09:07:00.660Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-04-14T09:07:00.884Z] Examining kronosnet/ci-tools
[2026-04-14T09:07:00.884Z] Attempting to resolve main as a branch
[2026-04-14T09:07:01.024Z] Resolved main as branch main at revision 122331b302b30271242a259844a3b4a95de3e23f
[2026-04-14T09:07:01.025Z] Selected Git installation does not exist. Using Default
[2026-04-14T09:07:01.025Z] The recommended git tool is: NONE
[2026-04-14T09:07:01.025Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-14T09:07:01.027Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-14T09:07:01.027Z] Wiping out workspace first.
[2026-04-14T09:07:01.048Z] Cloning the remote Git repository
[2026-04-14T09:07:01.048Z] Using shallow clone with depth 1
[2026-04-14T09:07:01.048Z] Avoid fetching tags
[2026-04-14T09:07:01.048Z] Honoring refspec on initial clone
[2026-04-14T09:07:01.049Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-14T09:07:01.049Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-04-14T09:07:01.057Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-14T09:07:01.057Z]  > git --version # timeout=10
[2026-04-14T09:07:01.064Z]  > git --version # 'git version 2.47.3'
[2026-04-14T09:07:01.064Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-14T09:07:01.070Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-14T09:07:01.277Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-14T09:07:01.286Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-14T09:07:01.295Z] Avoid second fetch
[2026-04-14T09:07:01.296Z] Checking out Revision 122331b302b30271242a259844a3b4a95de3e23f (main)
[2026-04-14T09:07:01.296Z]  > git config core.sparsecheckout # timeout=10
[2026-04-14T09:07:01.302Z]  > git checkout -f 122331b302b30271242a259844a3b4a95de3e23f # timeout=10
[2026-04-14T09:07:01.334Z] Commit message: "fn-testing: move aws to us-west-2"
[2026-04-14T09:07:01.340Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-04-14T09:07:01.563Z] Examining kronosnet/ci-tools
[2026-04-14T09:07:01.564Z] Attempting to resolve main as a branch
[2026-04-14T09:07:01.698Z] Resolved main as branch main at revision 122331b302b30271242a259844a3b4a95de3e23f
[2026-04-14T09:07:01.699Z] Selected Git installation does not exist. Using Default
[2026-04-14T09:07:01.699Z] The recommended git tool is: NONE
[2026-04-14T09:07:01.699Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-04-14T09:07:01.703Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-04-14T09:07:01.703Z] Wiping out workspace first.
[2026-04-14T09:07:01.722Z] Cloning the remote Git repository
[2026-04-14T09:07:01.722Z] Using shallow clone with depth 1
[2026-04-14T09:07:01.722Z] Avoid fetching tags
[2026-04-14T09:07:01.722Z] Honoring refspec on initial clone
[2026-04-14T09:07:01.722Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-04-14T09:07:01.722Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-04-14T09:07:01.731Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-04-14T09:07:01.731Z]  > git --version # timeout=10
[2026-04-14T09:07:01.737Z]  > git --version # 'git version 2.47.3'
[2026-04-14T09:07:01.737Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-04-14T09:07:01.744Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-14T09:07:01.944Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-04-14T09:07:01.953Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-04-14T09:07:01.961Z] Avoid second fetch
[2026-04-14T09:07:01.962Z] Checking out Revision 122331b302b30271242a259844a3b4a95de3e23f (main)
[2026-04-14T09:07:01.962Z]  > git config core.sparsecheckout # timeout=10
[2026-04-14T09:07:01.969Z]  > git checkout -f 122331b302b30271242a259844a3b4a95de3e23f # timeout=10
[2026-04-14T09:07:02.000Z] Commit message: "fn-testing: move aws to us-west-2"
[2026-04-14T09:07:02.036Z] [Pipeline] Start of Pipeline
[2026-04-14T09:07:02.132Z] [Pipeline] node
[2026-04-14T09:07:02.133Z] Running on anvil-ci-bm-phy07 in /srv/workspace/anvil/anvil-build-kmods
[2026-04-14T09:07:02.134Z] [Pipeline] {
[2026-04-14T09:07:02.142Z] [Pipeline] stage
[2026-04-14T09:07:02.143Z] [Pipeline] { (Prep build env)
[2026-04-14T09:07:02.153Z] [Pipeline] cleanWs
[2026-04-14T09:07:02.217Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-14T09:07:02.217Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-14T09:07:02.249Z] [WS-CLEANUP] done
[2026-04-14T09:07:02.267Z] [Pipeline] lock
[2026-04-14T09:07:02.267Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-04-14T09:07:02.267Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-04-14T09:07:02.267Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-04-14T09:07:02.267Z] [Pipeline] {
[2026-04-14T09:07:02.270Z] [Pipeline] }
[2026-04-14T09:07:02.270Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-04-14T09:07:02.273Z] [Pipeline] // lock
[2026-04-14T09:07:02.276Z] [Pipeline] sh
[2026-04-14T09:07:02.811Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-04-14T09:07:02.811Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-14T09:07:02.811Z] Genering ssh keys and ssh config
[2026-04-14T09:07:03.185Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:03.185Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:03.185Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:03.185Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:03.558Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:03.558Z] Cleaning up simengine configuration
[2026-04-14T09:07:06.776Z] Destroying VMs (if any)
[2026-04-14T09:07:06.869Z] [Pipeline] }
[2026-04-14T09:07:06.871Z] [Pipeline] // stage
[2026-04-14T09:07:06.874Z] [Pipeline] stage
[2026-04-14T09:07:06.874Z] [Pipeline] { (Build kmod)
[2026-04-14T09:07:06.882Z] [Pipeline] sh
[2026-04-14T09:07:07.413Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 ci ci
[2026-04-14T09:07:07.413Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-14T09:07:07.413Z] Genering ssh keys and ssh config
[2026-04-14T09:07:07.787Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:07.787Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:07.787Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:07.787Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:07.787Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:08.160Z] Destroying VMs (if any)
[2026-04-14T09:07:08.160Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-14T09:07:08.532Z] Genering ssh keys and ssh config
[2026-04-14T09:07:08.532Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:08.532Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:08.532Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:08.906Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:08.906Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:07:08.906Z] Cache already updated
[2026-04-14T09:07:08.906Z] Building drbd kmod for almalinux-9 repo: ci anvil: ci
[2026-04-14T09:07:08.906Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-04-14T09:07:08.906Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-04-14T09:07:10.740Z] 
[2026-04-14T09:07:10.740Z] Starting install...
[2026-04-14T09:07:10.740Z] 
[2026-04-14T09:07:10.740Z] Creating domain...                                          |         00:00     
[2026-04-14T09:07:10.740Z] Domain creation completed.
[2026-04-14T09:07:10.740Z] Waiting for nodes and cloud-init to complete full init
[2026-04-14T09:07:13.959Z] cloud-init status node an-cache: 
[2026-04-14T09:07:13.959Z] Tue Apr 14 05:07:13 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:07:25.305Z] cloud-init status node an-cache: 
[2026-04-14T09:07:25.305Z] Tue Apr 14 05:07:24 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:07:37.190Z] cloud-init status node an-cache: running
[2026-04-14T09:07:37.190Z] Tue Apr 14 05:07:35 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:07:46.570Z] cloud-init status node an-cache: running
[2026-04-14T09:07:46.570Z] Tue Apr 14 05:07:46 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:07:57.959Z] cloud-init status node an-cache: running
[2026-04-14T09:07:57.959Z] Tue Apr 14 05:07:57 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:08:09.305Z] cloud-init status node an-cache: running
[2026-04-14T09:08:09.305Z] Tue Apr 14 05:08:08 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:08:20.654Z] cloud-init status node an-cache: running
[2026-04-14T09:08:20.654Z] Tue Apr 14 05:08:18 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:08:30.032Z] cloud-init status node an-cache: running
[2026-04-14T09:08:30.032Z] Tue Apr 14 05:08:29 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:08:41.819Z] cloud-init status node an-cache: running
[2026-04-14T09:08:41.819Z] Tue Apr 14 05:08:40 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:08:53.159Z] cloud-init status node an-cache: running
[2026-04-14T09:08:53.159Z] Tue Apr 14 05:08:51 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:09:02.529Z] cloud-init status node an-cache: running
[2026-04-14T09:09:02.529Z] Tue Apr 14 05:09:02 EDT 2026 actual: 0 expected: 1
[2026-04-14T09:09:14.201Z] cloud-init status node an-cache: done
[2026-04-14T09:09:14.201Z] Tue Apr 14 05:09:13 EDT 2026 actual: 1 expected: 1
[2026-04-14T09:09:14.201Z] Waiting for akmods to complete build
[2026-04-14T09:09:14.201Z] build not found, sleeping 10 seconds
[2026-04-14T09:09:25.563Z] build not found, sleeping 10 seconds
[2026-04-14T09:09:34.938Z] build not found, sleeping 10 seconds
[2026-04-14T09:09:46.587Z] build not found, sleeping 10 seconds
[2026-04-14T09:09:55.965Z] build not found, sleeping 10 seconds
[2026-04-14T09:10:07.329Z] build not found, sleeping 10 seconds
[2026-04-14T09:10:17.269Z] build not found, sleeping 10 seconds
[2026-04-14T09:10:26.654Z] build not found, sleeping 10 seconds
[2026-04-14T09:10:38.007Z] build not found, sleeping 10 seconds
[2026-04-14T09:10:47.386Z] build not found, sleeping 10 seconds
[2026-04-14T09:10:58.737Z] build not found, sleeping 10 seconds
[2026-04-14T09:11:08.123Z] build not found, sleeping 10 seconds
[2026-04-14T09:11:19.662Z] build not found, sleeping 10 seconds
[2026-04-14T09:11:29.051Z] build not found, sleeping 10 seconds
[2026-04-14T09:11:38.536Z] build not found, sleeping 10 seconds
[2026-04-14T09:11:49.891Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-611.el9_7-9.2.16-1.el9.x86_64.rpm
[2026-04-14T09:11:49.891Z] build found
[2026-04-14T09:11:49.891Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-14T09:11:49.891Z] Directory walk started
[2026-04-14T09:11:49.891Z] Directory walk done - 9 packages
[2026-04-14T09:11:49.891Z] Temporary output repo path: ./.repodata/
[2026-04-14T09:11:49.891Z] Preparing sqlite DBs
[2026-04-14T09:11:49.891Z] Pool started (with 5 workers)
[2026-04-14T09:11:49.891Z] Pool finished
[2026-04-14T09:11:49.891Z] /srv/anvil/cache
[2026-04-14T09:11:50.264Z] bash: line 1: rhc: command not found
[2026-04-14T09:11:50.638Z] bash: line 1: insights-client: command not found
[2026-04-14T09:11:51.011Z] bash: line 1: subscription-manager: command not found
[2026-04-14T09:11:53.487Z] Domain 'an-cache' destroyed
[2026-04-14T09:11:53.487Z] 
[2026-04-14T09:11:53.487Z] Domain 'an-cache' has been undefined
[2026-04-14T09:11:53.487Z] 
[2026-04-14T09:11:53.487Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:53.487Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:53.487Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:53.487Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:53.487Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:53.487Z] Done building drbd kmods
[2026-04-14T09:11:53.580Z] [Pipeline] }
[2026-04-14T09:11:53.582Z] [Pipeline] // stage
[2026-04-14T09:11:53.585Z] [Pipeline] stage
[2026-04-14T09:11:53.585Z] [Pipeline] { (Declarative: Post Actions)
[2026-04-14T09:11:53.590Z] [Pipeline] sh
[2026-04-14T09:11:54.210Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-04-14T09:11:54.210Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-04-14T09:11:54.210Z] Genering ssh keys and ssh config
[2026-04-14T09:11:54.210Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:54.584Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:54.584Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:54.584Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:54.584Z] # github.com:22 SSH-2.0-3992d52
[2026-04-14T09:11:54.584Z] Cleaning up simengine configuration
[2026-04-14T09:11:58.675Z] Destroying VMs (if any)
[2026-04-14T09:11:58.770Z] [Pipeline] cleanWs
[2026-04-14T09:11:58.833Z] [WS-CLEANUP] Deleting project workspace...
[2026-04-14T09:11:58.833Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-04-14T09:11:58.864Z] [WS-CLEANUP] done
[2026-04-14T09:11:58.867Z] [Pipeline] script
[2026-04-14T09:11:58.869Z] [Pipeline] {
[2026-04-14T09:11:58.882Z] [Pipeline] stage
[2026-04-14T09:11:58.883Z] [Pipeline] { (Copying logs)
[2026-04-14T09:11:58.912Z] [Pipeline] node
[2026-04-14T09:11:58.918Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-04-14T09:11:58.918Z] [Pipeline] {
[2026-04-14T09:11:58.949Z] [Pipeline] node
[2026-04-14T09:11:58.954Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-04-14T09:11:58.955Z] [Pipeline] {
[2026-04-14T09:11:58.957Z] [Pipeline] sh
[2026-04-14T09:11:59.212Z] + mkdir -p /var/lib/jenkins/locks
[2026-04-14T09:11:59.220Z] [Pipeline] echo
[2026-04-14T09:11:59.220Z] RWLock: FD for lock log_archive in stage projectFinishUp is 416
[2026-04-14T09:11:59.223Z] [Pipeline] sleep
[2026-04-14T09:11:59.223Z] No need to sleep any longer
[2026-04-14T09:11:59.225Z] [Pipeline] echo
[2026-04-14T09:11:59.225Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-04-14T09:11:59.227Z] [Pipeline] }
[2026-04-14T09:11:59.229Z] [Pipeline] // node
[2026-04-14T09:11:59.232Z] [Pipeline] echo
[2026-04-14T09:11:59.232Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3659/
[2026-04-14T09:11:59.232Z] [Pipeline] sh
[2026-04-14T09:11:59.487Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/3659/
[2026-04-14T09:11:59.489Z] [Pipeline] sh