[2026-11-11T08:40:18.859Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 722
[2026-11-11T08:40:18.859Z] originally caused by:
[2026-11-11T08:40:18.863Z]  Started by upstream project "anvil/anvil-build-cron" build number 222
[2026-11-11T08:40:18.863Z]  originally caused by:
[2026-11-11T08:40:18.863Z]   Started by timer
[2026-11-11T08:40:19.608Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-11-11T08:40:19.617Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-11-11T08:40:19.896Z] Examining kronosnet/ci-tools
[2026-11-11T08:40:19.896Z] Attempting to resolve main as a branch
[2026-11-11T08:40:20.112Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-11-11T08:40:20.114Z] Selected Git installation does not exist. Using Default
[2026-11-11T08:40:20.114Z] The recommended git tool is: NONE
[2026-11-11T08:40:20.114Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-11-11T08:40:20.116Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-11-11T08:40:20.116Z] Wiping out workspace first.
[2026-11-11T08:40:20.147Z] Cloning the remote Git repository
[2026-11-11T08:40:20.147Z] Using shallow clone with depth 1
[2026-11-11T08:40:20.147Z] Avoid fetching tags
[2026-11-11T08:40:20.147Z] Honoring refspec on initial clone
[2026-11-11T08:40:20.147Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-11-11T08:40:20.147Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-11-11T08:40:20.160Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-11-11T08:40:20.160Z]  > git --version # timeout=10
[2026-11-11T08:40:20.174Z]  > git --version # 'git version 2.52.0'
[2026-11-11T08:40:20.174Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-11-11T08:40:20.183Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-11T08:40:20.429Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-11-11T08:40:20.437Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-11T08:40:20.445Z] Avoid second fetch
[2026-11-11T08:40:20.445Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-11-11T08:40:20.445Z]  > git config core.sparsecheckout # timeout=10
[2026-11-11T08:40:20.452Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-11-11T08:40:20.488Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-11-11T08:40:20.496Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-11-11T08:40:20.791Z] Examining kronosnet/ci-tools
[2026-11-11T08:40:20.791Z] Attempting to resolve main as a branch
[2026-11-11T08:40:20.985Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-11-11T08:40:20.986Z] Selected Git installation does not exist. Using Default
[2026-11-11T08:40:20.986Z] The recommended git tool is: NONE
[2026-11-11T08:40:20.986Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-11-11T08:40:20.998Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-11-11T08:40:20.998Z] Wiping out workspace first.
[2026-11-11T08:40:21.040Z] Cloning the remote Git repository
[2026-11-11T08:40:21.040Z] Using shallow clone with depth 1
[2026-11-11T08:40:21.040Z] Avoid fetching tags
[2026-11-11T08:40:21.040Z] Honoring refspec on initial clone
[2026-11-11T08:40:21.040Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-11-11T08:40:21.040Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@6 # timeout=10
[2026-11-11T08:40:21.054Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-11-11T08:40:21.054Z]  > git --version # timeout=10
[2026-11-11T08:40:21.062Z]  > git --version # 'git version 2.52.0'
[2026-11-11T08:40:21.062Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-11-11T08:40:21.070Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-11T08:40:21.296Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-11-11T08:40:21.304Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-11T08:40:21.313Z] Avoid second fetch
[2026-11-11T08:40:21.313Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-11-11T08:40:21.313Z]  > git config core.sparsecheckout # timeout=10
[2026-11-11T08:40:21.321Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-11-11T08:40:21.360Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-11-11T08:40:21.410Z] [Pipeline] Start of Pipeline
[2026-11-11T08:40:21.524Z] [Pipeline] node
[2026-11-11T08:40:21.541Z] Running on anvil-ci-bm-phy07 in /srv/workspace/anvil/anvil-build-kmods
[2026-11-11T08:40:21.541Z] [Pipeline] {
[2026-11-11T08:40:21.551Z] [Pipeline] stage
[2026-11-11T08:40:21.551Z] [Pipeline] { (Prep build env)
[2026-11-11T08:40:21.562Z] [Pipeline] cleanWs
[2026-11-11T08:40:21.611Z] [WS-CLEANUP] Deleting project workspace...
[2026-11-11T08:40:21.611Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-11-11T08:40:21.636Z] [WS-CLEANUP] done
[2026-11-11T08:40:21.660Z] [Pipeline] lock
[2026-11-11T08:40:21.660Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-11-11T08:40:21.660Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-11-11T08:40:21.661Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT], resources: [MAINTENANCE LOCKOUT]
[2026-11-11T08:40:21.661Z] [Pipeline] {
[2026-11-11T08:40:21.664Z] [Pipeline] }
[2026-11-11T08:40:21.665Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT], resources: [MAINTENANCE LOCKOUT]
[2026-11-11T08:40:21.667Z] [Pipeline] // lock
[2026-11-11T08:40:21.672Z] [Pipeline] sh
[2026-11-11T08:40:22.161Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-11-11T08:40:22.161Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-11T08:40:22.506Z] Genering ssh keys and ssh config
[2026-11-11T08:40:22.849Z] Cleaning up simengine configuration
[2026-11-11T08:40:26.731Z] Destroying VMs (if any)
[2026-11-11T08:40:26.802Z] [Pipeline] }
[2026-11-11T08:40:26.804Z] [Pipeline] // stage
[2026-11-11T08:40:26.807Z] [Pipeline] stage
[2026-11-11T08:40:26.807Z] [Pipeline] { (Build kmod)
[2026-11-11T08:40:26.817Z] [Pipeline] sh
[2026-11-11T08:40:27.306Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise none
[2026-11-11T08:40:27.306Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-11T08:40:27.649Z] Genering ssh keys and ssh config
[2026-11-11T08:40:27.993Z] Destroying VMs (if any)
[2026-11-11T08:40:28.338Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-11T08:40:28.681Z] Genering ssh keys and ssh config
[2026-11-11T08:40:29.026Z] Cache already updated
[2026-11-11T08:40:29.026Z] Building drbd kmod for almalinux-9 repo: enterprise anvil: none
[2026-11-11T08:40:29.026Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-11-11T08:40:29.026Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-11-11T08:40:30.220Z] 
[2026-11-11T08:40:30.220Z] Starting install...
[2026-11-11T08:40:30.220Z] 
[2026-11-11T08:40:30.220Z] Creating domain...                                          |         00:00     
[2026-11-11T08:40:30.220Z] Domain creation completed.
[2026-11-11T08:40:30.564Z] Waiting for nodes and cloud-init to complete full init
[2026-11-11T08:40:33.731Z] cloud-init status node an-cache: 
[2026-11-11T08:40:33.731Z] Wed Nov 11 03:40:33 EST 2026 actual: 0 expected: 1
[2026-11-11T08:40:47.050Z] cloud-init status node an-cache: 
[2026-11-11T08:40:47.050Z] Wed Nov 11 03:40:45 EST 2026 actual: 0 expected: 1
[2026-11-11T08:40:56.130Z] cloud-init status node an-cache: running
[2026-11-11T08:40:56.130Z] Wed Nov 11 03:40:55 EST 2026 actual: 0 expected: 1
[2026-11-11T08:41:07.393Z] cloud-init status node an-cache: running
[2026-11-11T08:41:07.393Z] Wed Nov 11 03:41:06 EST 2026 actual: 0 expected: 1
[2026-11-11T08:41:18.392Z] cloud-init status node an-cache: running
[2026-11-11T08:41:18.392Z] Wed Nov 11 03:41:17 EST 2026 actual: 0 expected: 1
[2026-11-11T08:41:29.469Z] cloud-init status node an-cache: running
[2026-11-11T08:41:29.469Z] Wed Nov 11 03:41:28 EST 2026 actual: 0 expected: 1
[2026-11-11T08:41:39.203Z] cloud-init status node an-cache: running
[2026-11-11T08:41:39.203Z] Wed Nov 11 03:41:38 EST 2026 actual: 0 expected: 1
[2026-11-11T08:41:50.213Z] cloud-init status node an-cache: running
[2026-11-11T08:41:50.213Z] Wed Nov 11 03:41:49 EST 2026 actual: 0 expected: 1
[2026-11-11T08:42:01.213Z] cloud-init status node an-cache: running
[2026-11-11T08:42:01.213Z] Wed Nov 11 03:42:00 EST 2026 actual: 0 expected: 1
[2026-11-11T08:42:12.502Z] cloud-init status node an-cache: running
[2026-11-11T08:42:12.502Z] Wed Nov 11 03:42:11 EST 2026 actual: 0 expected: 1
[2026-11-11T08:42:23.507Z] cloud-init status node an-cache: running
[2026-11-11T08:42:23.507Z] Wed Nov 11 03:42:21 EST 2026 actual: 0 expected: 1
[2026-11-11T08:42:32.685Z] cloud-init status node an-cache: running
[2026-11-11T08:42:32.685Z] Wed Nov 11 03:42:32 EST 2026 actual: 0 expected: 1
[2026-11-11T08:42:43.692Z] cloud-init status node an-cache: done
[2026-11-11T08:42:43.692Z] Wed Nov 11 03:42:43 EST 2026 actual: 1 expected: 1
[2026-11-11T08:42:43.692Z] Waiting for akmods to complete build
[2026-11-11T08:42:43.692Z] build not found, sleeping 10 seconds
[2026-11-11T08:42:54.701Z] build not found, sleeping 10 seconds
[2026-11-11T08:43:05.707Z] build not found, sleeping 10 seconds
[2026-11-11T08:43:14.767Z] build not found, sleeping 10 seconds
[2026-11-11T08:43:25.775Z] build not found, sleeping 10 seconds
[2026-11-11T08:43:36.776Z] build not found, sleeping 10 seconds
[2026-11-11T08:43:46.056Z] build not found, sleeping 10 seconds
[2026-11-11T08:43:57.061Z] build not found, sleeping 10 seconds
[2026-11-11T08:44:06.122Z] build not found, sleeping 10 seconds
[2026-11-11T08:44:17.127Z] build not found, sleeping 10 seconds
[2026-11-11T08:44:28.139Z] build not found, sleeping 10 seconds
[2026-11-11T08:44:37.205Z] build not found, sleeping 10 seconds
[2026-11-11T08:44:48.303Z] build not found, sleeping 10 seconds
[2026-11-11T08:44:57.366Z] build not found, sleeping 10 seconds
[2026-11-11T08:45:08.370Z] build not found, sleeping 10 seconds
[2026-11-11T08:45:19.367Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-11-11T08:45:19.367Z] build found
[2026-11-11T08:45:19.367Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-11T08:45:19.367Z] Directory walk started
[2026-11-11T08:45:19.367Z] Directory walk done - 8 packages
[2026-11-11T08:45:19.367Z] Temporary output repo path: ./.repodata/
[2026-11-11T08:45:19.367Z] Preparing sqlite DBs
[2026-11-11T08:45:19.367Z] Pool started (with 5 workers)
[2026-11-11T08:45:19.367Z] Pool finished
[2026-11-11T08:45:19.367Z] /srv/anvil/cache
[2026-11-11T08:45:19.845Z] bash: line 1: rhc: command not found
[2026-11-11T08:45:19.845Z] bash: line 1: insights-client: command not found
[2026-11-11T08:45:20.189Z] bash: line 1: subscription-manager: command not found
[2026-11-11T08:45:22.519Z] Domain 'an-cache' destroyed
[2026-11-11T08:45:22.519Z] 
[2026-11-11T08:45:22.519Z] Domain 'an-cache' has been undefined
[2026-11-11T08:45:22.519Z] 
[2026-11-11T08:45:22.862Z] Done building drbd kmods
[2026-11-11T08:45:22.933Z] [Pipeline] }
[2026-11-11T08:45:22.936Z] [Pipeline] // stage
[2026-11-11T08:45:22.940Z] [Pipeline] stage
[2026-11-11T08:45:22.941Z] [Pipeline] { (Declarative: Post Actions)
[2026-11-11T08:45:22.946Z] [Pipeline] sh
[2026-11-11T08:45:23.488Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-11-11T08:45:23.488Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-11-11T08:45:23.832Z] Genering ssh keys and ssh config
[2026-11-11T08:45:24.176Z] Cleaning up simengine configuration
[2026-11-11T08:45:28.058Z] Destroying VMs (if any)
[2026-11-11T08:45:28.131Z] [Pipeline] cleanWs
[2026-11-11T08:45:28.179Z] [WS-CLEANUP] Deleting project workspace...
[2026-11-11T08:45:28.179Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-11-11T08:45:28.203Z] [WS-CLEANUP] done
[2026-11-11T08:45:28.207Z] [Pipeline] script
[2026-11-11T08:45:28.208Z] [Pipeline] {
[2026-11-11T08:45:28.224Z] [Pipeline] stage
[2026-11-11T08:45:28.224Z] [Pipeline] { (Copying logs)
[2026-11-11T08:45:28.258Z] [Pipeline] node
[2026-11-11T08:45:28.497Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@4
[2026-11-11T08:45:28.498Z] [Pipeline] {
[2026-11-11T08:45:28.539Z] [Pipeline] node
[2026-11-11T08:45:28.778Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-11-11T08:45:28.778Z] [Pipeline] {
[2026-11-11T08:45:28.781Z] [Pipeline] sh
[2026-11-11T08:45:29.038Z] + mkdir -p /var/lib/jenkins/locks
[2026-11-11T08:45:29.048Z] [Pipeline] echo
[2026-11-11T08:45:29.048Z] RWLock: FD for lock log_archive in stage projectFinishUp is 665
[2026-11-11T08:45:29.051Z] [Pipeline] sleep
[2026-11-11T08:45:29.051Z] No need to sleep any longer
[2026-11-11T08:45:29.053Z] [Pipeline] echo
[2026-11-11T08:45:29.053Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-11-11T08:45:29.056Z] [Pipeline] }
[2026-11-11T08:45:29.058Z] [Pipeline] // node
[2026-11-11T08:45:29.061Z] [Pipeline] echo
[2026-11-11T08:45:29.061Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4824/
[2026-11-11T08:45:29.062Z] [Pipeline] sh
[2026-11-11T08:45:29.317Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4824/
[2026-11-11T08:45:29.319Z] [Pipeline] sh