[2026-10-10T08:40:08.514Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 691
[2026-10-10T08:40:08.514Z] originally caused by:
[2026-10-10T08:40:08.514Z]  Started by upstream project "anvil/anvil-build-cron" build number 191
[2026-10-10T08:40:08.514Z]  originally caused by:
[2026-10-10T08:40:08.514Z]   Started by timer
[2026-10-10T08:40:09.057Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-10-10T08:40:09.063Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-10-10T08:40:09.278Z] Examining kronosnet/ci-tools
[2026-10-10T08:40:09.278Z] Attempting to resolve main as a branch
[2026-10-10T08:40:09.430Z] Resolved main as branch main at revision 95b9e63faaef276d10f2788adad5f3a77d3e23df
[2026-10-10T08:40:09.432Z] Selected Git installation does not exist. Using Default
[2026-10-10T08:40:09.432Z] The recommended git tool is: NONE
[2026-10-10T08:40:09.432Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-10T08:40:09.435Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-10T08:40:09.435Z] Wiping out workspace first.
[2026-10-10T08:40:09.489Z] Cloning the remote Git repository
[2026-10-10T08:40:09.489Z] Using shallow clone with depth 1
[2026-10-10T08:40:09.489Z] Avoid fetching tags
[2026-10-10T08:40:09.489Z] Honoring refspec on initial clone
[2026-10-10T08:40:09.489Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-10T08:40:09.490Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-10-10T08:40:09.500Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-10T08:40:09.501Z]  > git --version # timeout=10
[2026-10-10T08:40:09.507Z]  > git --version # 'git version 2.52.0'
[2026-10-10T08:40:09.507Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-10T08:40:09.514Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-10T08:40:09.761Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-10T08:40:09.770Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-10T08:40:09.778Z] Avoid second fetch
[2026-10-10T08:40:09.778Z] Checking out Revision 95b9e63faaef276d10f2788adad5f3a77d3e23df (main)
[2026-10-10T08:40:09.778Z]  > git config core.sparsecheckout # timeout=10
[2026-10-10T08:40:09.786Z]  > git checkout -f 95b9e63faaef276d10f2788adad5f3a77d3e23df # timeout=10
[2026-10-10T08:40:09.819Z] Commit message: "ansible: generate an inventory dynamically"
[2026-10-10T08:40:09.827Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-10-10T08:40:10.056Z] Examining kronosnet/ci-tools
[2026-10-10T08:40:10.056Z] Attempting to resolve main as a branch
[2026-10-10T08:40:10.218Z] Resolved main as branch main at revision 95b9e63faaef276d10f2788adad5f3a77d3e23df
[2026-10-10T08:40:10.219Z] Selected Git installation does not exist. Using Default
[2026-10-10T08:40:10.219Z] The recommended git tool is: NONE
[2026-10-10T08:40:10.219Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-10T08:40:10.222Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-10T08:40:10.222Z] Wiping out workspace first.
[2026-10-10T08:40:10.242Z] Cloning the remote Git repository
[2026-10-10T08:40:10.242Z] Using shallow clone with depth 1
[2026-10-10T08:40:10.242Z] Avoid fetching tags
[2026-10-10T08:40:10.242Z] Honoring refspec on initial clone
[2026-10-10T08:40:10.242Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-10T08:40:10.242Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-10-10T08:40:10.253Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-10T08:40:10.253Z]  > git --version # timeout=10
[2026-10-10T08:40:10.260Z]  > git --version # 'git version 2.52.0'
[2026-10-10T08:40:10.260Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-10T08:40:10.267Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-10T08:40:10.502Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-10T08:40:10.510Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-10T08:40:10.520Z] Avoid second fetch
[2026-10-10T08:40:10.520Z] Checking out Revision 95b9e63faaef276d10f2788adad5f3a77d3e23df (main)
[2026-10-10T08:40:10.520Z]  > git config core.sparsecheckout # timeout=10
[2026-10-10T08:40:10.527Z]  > git checkout -f 95b9e63faaef276d10f2788adad5f3a77d3e23df # timeout=10
[2026-10-10T08:40:10.561Z] Commit message: "ansible: generate an inventory dynamically"
[2026-10-10T08:40:10.614Z] [Pipeline] Start of Pipeline
[2026-10-10T08:40:10.732Z] [Pipeline] node
[2026-10-10T08:40:10.741Z] Running on anvil-ci-bm-phy07 in /srv/workspace/anvil/anvil-build-kmods
[2026-10-10T08:40:10.742Z] [Pipeline] {
[2026-10-10T08:40:10.753Z] [Pipeline] stage
[2026-10-10T08:40:10.754Z] [Pipeline] { (Prep build env)
[2026-10-10T08:40:10.767Z] [Pipeline] cleanWs
[2026-10-10T08:40:10.816Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-10T08:40:10.816Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-10T08:40:10.842Z] [WS-CLEANUP] done
[2026-10-10T08:40:10.867Z] [Pipeline] lock
[2026-10-10T08:40:10.878Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-10-10T08:40:10.879Z] The resource [MAINTENANCE LOCKOUT] is locked by build anvil » anvil-build-kmods #4641 #4641 since Oct 10, 2026, 8:40 AM.
[2026-10-10T08:40:10.879Z] [Resource: MAINTENANCE LOCKOUT] is not free, waiting for execution ...
[2026-10-10T08:40:10.880Z] [Required resources: [MAINTENANCE LOCKOUT]] added into queue at position 0
[2026-10-10T08:40:10.884Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-10-10T08:40:10.895Z] [Pipeline] {
[2026-10-10T08:40:10.897Z] [Pipeline] }
[2026-10-10T08:40:10.897Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-10-10T08:40:10.900Z] [Pipeline] // lock
[2026-10-10T08:40:10.904Z] [Pipeline] sh
[2026-10-10T08:40:11.368Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-10T08:40:11.368Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-10T08:40:11.710Z] Genering ssh keys and ssh config
[2026-10-10T08:40:12.053Z] Cleaning up simengine configuration
[2026-10-10T08:40:15.925Z] Destroying VMs (if any)
[2026-10-10T08:40:15.996Z] [Pipeline] }
[2026-10-10T08:40:15.998Z] [Pipeline] // stage
[2026-10-10T08:40:16.001Z] [Pipeline] stage
[2026-10-10T08:40:16.002Z] [Pipeline] { (Build kmod)
[2026-10-10T08:40:16.013Z] [Pipeline] sh
[2026-10-10T08:40:16.498Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 ci ci
[2026-10-10T08:40:16.498Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-10T08:40:16.842Z] Genering ssh keys and ssh config
[2026-10-10T08:40:17.184Z] Destroying VMs (if any)
[2026-10-10T08:40:17.184Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-10T08:40:17.526Z] Genering ssh keys and ssh config
[2026-10-10T08:40:17.869Z] Cache already updated
[2026-10-10T08:40:17.869Z] Building drbd kmod for almalinux-9 repo: ci anvil: ci
[2026-10-10T08:40:17.869Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-10-10T08:40:18.212Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-10-10T08:40:19.400Z] 
[2026-10-10T08:40:19.400Z] Starting install...
[2026-10-10T08:40:19.400Z] 
[2026-10-10T08:40:19.400Z] Creating domain...                                          |         00:00     
[2026-10-10T08:40:19.400Z] Domain creation completed.
[2026-10-10T08:40:19.400Z] Waiting for nodes and cloud-init to complete full init
[2026-10-10T08:40:22.437Z] cloud-init status node an-cache: 
[2026-10-10T08:40:22.437Z] Sat Oct 10 04:40:22 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:40:35.745Z] cloud-init status node an-cache: 
[2026-10-10T08:40:35.745Z] Sat Oct 10 04:40:33 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:40:45.161Z] cloud-init status node an-cache: running
[2026-10-10T08:40:45.161Z] Sat Oct 10 04:40:44 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:40:56.143Z] cloud-init status node an-cache: running
[2026-10-10T08:40:56.144Z] Sat Oct 10 04:40:55 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:41:07.131Z] cloud-init status node an-cache: running
[2026-10-10T08:41:07.131Z] Sat Oct 10 04:41:06 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:41:18.115Z] cloud-init status node an-cache: running
[2026-10-10T08:41:18.115Z] Sat Oct 10 04:41:16 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:41:29.106Z] cloud-init status node an-cache: running
[2026-10-10T08:41:29.106Z] Sat Oct 10 04:41:27 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:41:40.108Z] cloud-init status node an-cache: running
[2026-10-10T08:41:40.108Z] Sat Oct 10 04:41:38 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:41:51.153Z] cloud-init status node an-cache: running
[2026-10-10T08:41:51.153Z] Sat Oct 10 04:41:49 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:42:00.186Z] cloud-init status node an-cache: running
[2026-10-10T08:42:00.186Z] Sat Oct 10 04:41:59 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:42:11.169Z] cloud-init status node an-cache: running
[2026-10-10T08:42:11.169Z] Sat Oct 10 04:42:10 EDT 2026 actual: 0 expected: 1
[2026-10-10T08:42:22.157Z] cloud-init status node an-cache: done
[2026-10-10T08:42:22.157Z] Sat Oct 10 04:42:21 EDT 2026 actual: 1 expected: 1
[2026-10-10T08:42:22.157Z] Waiting for akmods to complete build
[2026-10-10T08:42:22.157Z] build not found, sleeping 10 seconds
[2026-10-10T08:42:33.139Z] build not found, sleeping 10 seconds
[2026-10-10T08:42:44.126Z] build not found, sleeping 10 seconds
[2026-10-10T08:42:53.169Z] build not found, sleeping 10 seconds
[2026-10-10T08:43:04.151Z] build not found, sleeping 10 seconds
[2026-10-10T08:43:13.186Z] build not found, sleeping 10 seconds
[2026-10-10T08:43:24.171Z] build not found, sleeping 10 seconds
[2026-10-10T08:43:35.155Z] build not found, sleeping 10 seconds
[2026-10-10T08:43:44.206Z] build not found, sleeping 10 seconds
[2026-10-10T08:43:55.199Z] build not found, sleeping 10 seconds
[2026-10-10T08:44:06.191Z] build not found, sleeping 10 seconds
[2026-10-10T08:44:15.236Z] build not found, sleeping 10 seconds
[2026-10-10T08:44:26.218Z] build not found, sleeping 10 seconds
[2026-10-10T08:44:37.212Z] build not found, sleeping 10 seconds
[2026-10-10T08:44:46.293Z] build not found, sleeping 10 seconds
[2026-10-10T08:44:57.284Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-10-10T08:44:57.284Z] build found
[2026-10-10T08:44:57.284Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-10T08:44:57.627Z] Directory walk started
[2026-10-10T08:44:57.627Z] Directory walk done - 10 packages
[2026-10-10T08:44:57.627Z] Temporary output repo path: ./.repodata/
[2026-10-10T08:44:57.627Z] Preparing sqlite DBs
[2026-10-10T08:44:57.627Z] Pool started (with 5 workers)
[2026-10-10T08:44:57.627Z] Pool finished
[2026-10-10T08:44:57.627Z] /srv/anvil/cache
[2026-10-10T08:44:57.627Z] bash: line 1: rhc: command not found
[2026-10-10T08:44:57.969Z] bash: line 1: insights-client: command not found
[2026-10-10T08:44:58.312Z] bash: line 1: subscription-manager: command not found
[2026-10-10T08:45:00.634Z] Domain 'an-cache' destroyed
[2026-10-10T08:45:00.634Z] 
[2026-10-10T08:45:00.634Z] Domain 'an-cache' has been undefined
[2026-10-10T08:45:00.634Z] 
[2026-10-10T08:45:00.978Z] Done building drbd kmods
[2026-10-10T08:45:01.049Z] [Pipeline] }
[2026-10-10T08:45:01.052Z] [Pipeline] // stage
[2026-10-10T08:45:01.057Z] [Pipeline] stage
[2026-10-10T08:45:01.057Z] [Pipeline] { (Declarative: Post Actions)
[2026-10-10T08:45:01.064Z] [Pipeline] sh
[2026-10-10T08:45:01.600Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-10T08:45:01.600Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-10T08:45:01.943Z] Genering ssh keys and ssh config
[2026-10-10T08:45:02.287Z] Cleaning up simengine configuration
[2026-10-10T08:45:06.177Z] Destroying VMs (if any)
[2026-10-10T08:45:06.249Z] [Pipeline] cleanWs
[2026-10-10T08:45:06.297Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-10T08:45:06.297Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-10T08:45:06.321Z] [WS-CLEANUP] done
[2026-10-10T08:45:06.327Z] [Pipeline] script
[2026-10-10T08:45:06.332Z] [Pipeline] {
[2026-10-10T08:45:06.352Z] [Pipeline] stage
[2026-10-10T08:45:06.352Z] [Pipeline] { (Copying logs)
[2026-10-10T08:45:06.394Z] [Pipeline] node
[2026-10-10T08:45:06.508Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-10-10T08:45:06.509Z] [Pipeline] {
[2026-10-10T08:45:06.555Z] [Pipeline] node
[2026-10-10T08:45:06.660Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-10-10T08:45:06.661Z] [Pipeline] {
[2026-10-10T08:45:06.666Z] [Pipeline] sh
[2026-10-10T08:45:06.921Z] + mkdir -p /var/lib/jenkins/locks
[2026-10-10T08:45:06.932Z] [Pipeline] echo
[2026-10-10T08:45:06.932Z] RWLock: FD for lock log_archive in stage projectFinishUp is 442
[2026-10-10T08:45:06.935Z] [Pipeline] sleep
[2026-10-10T08:45:06.935Z] No need to sleep any longer
[2026-10-10T08:45:06.938Z] [Pipeline] echo
[2026-10-10T08:45:06.938Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-10-10T08:45:06.941Z] [Pipeline] }
[2026-10-10T08:45:06.943Z] [Pipeline] // node
[2026-10-10T08:45:06.947Z] [Pipeline] echo
[2026-10-10T08:45:06.947Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4637/
[2026-10-10T08:45:06.948Z] [Pipeline] sh
[2026-10-10T08:45:07.203Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4637/
[2026-10-10T08:45:07.205Z] [Pipeline] sh