[2026-09-26T08:39:18.560Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 677
[2026-09-26T08:39:18.560Z] originally caused by:
[2026-09-26T08:39:18.560Z]  Started by upstream project "anvil/anvil-build-cron" build number 177
[2026-09-26T08:39:18.560Z]  originally caused by:
[2026-09-26T08:39:18.560Z]   Started by timer
[2026-09-26T08:39:21.386Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-09-26T08:39:21.390Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-09-26T08:39:21.574Z] Examining kronosnet/ci-tools
[2026-09-26T08:39:21.574Z] Attempting to resolve main as a branch
[2026-09-26T08:39:21.714Z] Resolved main as branch main at revision b175ea1eaa3b116a3499f67254edeed28a1abb28
[2026-09-26T08:39:21.715Z] Selected Git installation does not exist. Using Default
[2026-09-26T08:39:21.715Z] The recommended git tool is: NONE
[2026-09-26T08:39:21.715Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-09-26T08:39:21.719Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-09-26T08:39:21.719Z] Wiping out workspace first.
[2026-09-26T08:39:21.744Z] Cloning the remote Git repository
[2026-09-26T08:39:21.744Z] Using shallow clone with depth 1
[2026-09-26T08:39:21.744Z] Avoid fetching tags
[2026-09-26T08:39:21.744Z] Honoring refspec on initial clone
[2026-09-26T08:39:21.744Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-09-26T08:39:21.744Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@6 # timeout=10
[2026-09-26T08:39:21.753Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-09-26T08:39:21.753Z]  > git --version # timeout=10
[2026-09-26T08:39:21.759Z]  > git --version # 'git version 2.52.0'
[2026-09-26T08:39:21.759Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-09-26T08:39:21.765Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-26T08:39:22.519Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-09-26T08:39:22.529Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-26T08:39:22.538Z] Avoid second fetch
[2026-09-26T08:39:22.538Z] Checking out Revision b175ea1eaa3b116a3499f67254edeed28a1abb28 (main)
[2026-09-26T08:39:22.538Z]  > git config core.sparsecheckout # timeout=10
[2026-09-26T08:39:22.548Z]  > git checkout -f b175ea1eaa3b116a3499f67254edeed28a1abb28 # timeout=10
[2026-09-26T08:39:22.581Z] Commit message: "support ansible development/testing in CITBRANCH"
[2026-09-26T08:39:22.588Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-09-26T08:39:22.781Z] Examining kronosnet/ci-tools
[2026-09-26T08:39:22.781Z] Attempting to resolve main as a branch
[2026-09-26T08:39:22.962Z] Resolved main as branch main at revision b175ea1eaa3b116a3499f67254edeed28a1abb28
[2026-09-26T08:39:22.963Z] Selected Git installation does not exist. Using Default
[2026-09-26T08:39:22.963Z] The recommended git tool is: NONE
[2026-09-26T08:39:22.963Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-09-26T08:39:22.966Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-09-26T08:39:22.966Z] Wiping out workspace first.
[2026-09-26T08:39:22.985Z] Cloning the remote Git repository
[2026-09-26T08:39:22.985Z] Using shallow clone with depth 1
[2026-09-26T08:39:22.985Z] Avoid fetching tags
[2026-09-26T08:39:22.985Z] Honoring refspec on initial clone
[2026-09-26T08:39:22.985Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-09-26T08:39:22.985Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@4 # timeout=10
[2026-09-26T08:39:22.994Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-09-26T08:39:22.994Z]  > git --version # timeout=10
[2026-09-26T08:39:23.000Z]  > git --version # 'git version 2.52.0'
[2026-09-26T08:39:23.000Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-09-26T08:39:23.006Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-26T08:39:23.728Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-09-26T08:39:23.736Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-26T08:39:23.743Z] Avoid second fetch
[2026-09-26T08:39:23.744Z] Checking out Revision b175ea1eaa3b116a3499f67254edeed28a1abb28 (main)
[2026-09-26T08:39:23.744Z]  > git config core.sparsecheckout # timeout=10
[2026-09-26T08:39:23.750Z]  > git checkout -f b175ea1eaa3b116a3499f67254edeed28a1abb28 # timeout=10
[2026-09-26T08:39:23.783Z] Commit message: "support ansible development/testing in CITBRANCH"
[2026-09-26T08:39:23.821Z] [Pipeline] Start of Pipeline
[2026-09-26T08:39:23.911Z] [Pipeline] node
[2026-09-26T08:39:23.913Z] Running on anvil-ci-bm-phy03 in /srv/workspace/anvil/anvil-build-kmods
[2026-09-26T08:39:23.914Z] [Pipeline] {
[2026-09-26T08:39:23.921Z] [Pipeline] stage
[2026-09-26T08:39:23.921Z] [Pipeline] { (Prep build env)
[2026-09-26T08:39:23.931Z] [Pipeline] cleanWs
[2026-09-26T08:39:24.014Z] [WS-CLEANUP] Deleting project workspace...
[2026-09-26T08:39:24.014Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-09-26T08:39:24.055Z] [WS-CLEANUP] done
[2026-09-26T08:39:24.071Z] [Pipeline] lock
[2026-09-26T08:39:24.071Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-09-26T08:39:24.071Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-09-26T08:39:24.072Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-09-26T08:39:24.072Z] [Pipeline] {
[2026-09-26T08:39:24.074Z] [Pipeline] }
[2026-09-26T08:39:24.074Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-09-26T08:39:24.076Z] [Pipeline] // lock
[2026-09-26T08:39:24.079Z] [Pipeline] sh
[2026-09-26T08:39:24.697Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-09-26T08:39:24.697Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-26T08:39:25.108Z] Genering ssh keys and ssh config
[2026-09-26T08:39:25.519Z] Cleaning up simengine configuration
[2026-09-26T08:39:28.966Z] Destroying VMs (if any)
[2026-09-26T08:39:29.088Z] [Pipeline] }
[2026-09-26T08:39:29.091Z] [Pipeline] // stage
[2026-09-26T08:39:29.094Z] [Pipeline] stage
[2026-09-26T08:39:29.094Z] [Pipeline] { (Build kmod)
[2026-09-26T08:39:29.103Z] [Pipeline] sh
[2026-09-26T08:39:29.850Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise none
[2026-09-26T08:39:29.850Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-26T08:39:29.850Z] Genering ssh keys and ssh config
[2026-09-26T08:39:30.720Z] Destroying VMs (if any)
[2026-09-26T08:39:30.720Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-26T08:39:31.130Z] Genering ssh keys and ssh config
[2026-09-26T08:39:31.540Z] Cache already updated
[2026-09-26T08:39:31.540Z] Building drbd kmod for almalinux-9 repo: enterprise anvil: none
[2026-09-26T08:39:31.540Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-09-26T08:39:31.950Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-09-26T08:39:32.822Z] 
[2026-09-26T08:39:32.822Z] Starting install...
[2026-09-26T08:39:32.822Z] 
[2026-09-26T08:39:32.822Z] Creating domain...                                          |         00:00     
[2026-09-26T08:39:32.822Z] Domain creation completed.
[2026-09-26T08:39:32.822Z] Waiting for nodes and cloud-init to complete full init
[2026-09-26T08:39:36.269Z] cloud-init status node an-cache: 
[2026-09-26T08:39:36.269Z] Sat Sep 26 04:39:35 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:39:50.465Z] cloud-init status node an-cache: 
[2026-09-26T08:39:50.465Z] Sat Sep 26 04:39:48 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:40:00.271Z] cloud-init status node an-cache: running
[2026-09-26T08:40:00.271Z] Sat Sep 26 04:39:59 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:40:10.597Z] cloud-init status node an-cache: running
[2026-09-26T08:40:10.597Z] Sat Sep 26 04:40:10 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:40:22.527Z] cloud-init status node an-cache: running
[2026-09-26T08:40:22.527Z] Sat Sep 26 04:40:20 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:40:32.320Z] cloud-init status node an-cache: running
[2026-09-26T08:40:32.320Z] Sat Sep 26 04:40:31 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:40:42.474Z] cloud-init status node an-cache: running
[2026-09-26T08:40:42.474Z] Sat Sep 26 04:40:42 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:40:53.321Z] cloud-init status node an-cache: running
[2026-09-26T08:40:53.321Z] Sat Sep 26 04:40:52 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:41:05.138Z] cloud-init status node an-cache: running
[2026-09-26T08:41:05.138Z] Sat Sep 26 04:41:03 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:41:15.258Z] cloud-init status node an-cache: running
[2026-09-26T08:41:15.258Z] Sat Sep 26 04:41:14 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:41:27.067Z] cloud-init status node an-cache: running
[2026-09-26T08:41:27.067Z] Sat Sep 26 04:41:25 EDT 2026 actual: 0 expected: 1
[2026-09-26T08:41:36.871Z] cloud-init status node an-cache: done
[2026-09-26T08:41:36.871Z] Sat Sep 26 04:41:35 EDT 2026 actual: 1 expected: 1
[2026-09-26T08:41:36.871Z] Waiting for akmods to complete build
[2026-09-26T08:41:36.871Z] build not found, sleeping 10 seconds
[2026-09-26T08:41:46.955Z] build not found, sleeping 10 seconds
[2026-09-26T08:41:58.782Z] build not found, sleeping 10 seconds
[2026-09-26T08:42:08.577Z] build not found, sleeping 10 seconds
[2026-09-26T08:42:18.692Z] build not found, sleeping 10 seconds
[2026-09-26T08:42:28.493Z] build not found, sleeping 10 seconds
[2026-09-26T08:42:40.307Z] build not found, sleeping 10 seconds
[2026-09-26T08:42:50.388Z] build not found, sleeping 10 seconds
[2026-09-26T08:43:00.248Z] build not found, sleeping 10 seconds
[2026-09-26T08:43:10.048Z] build not found, sleeping 10 seconds
[2026-09-26T08:43:19.841Z] build not found, sleeping 10 seconds
[2026-09-26T08:43:31.660Z] build not found, sleeping 10 seconds
[2026-09-26T08:43:41.456Z] build not found, sleeping 10 seconds
[2026-09-26T08:43:51.549Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-09-26T08:43:51.549Z] build found
[2026-09-26T08:43:51.549Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-26T08:43:51.959Z] Directory walk started
[2026-09-26T08:43:51.959Z] Directory walk done - 8 packages
[2026-09-26T08:43:51.959Z] Temporary output repo path: ./.repodata/
[2026-09-26T08:43:51.959Z] Preparing sqlite DBs
[2026-09-26T08:43:51.960Z] Pool started (with 5 workers)
[2026-09-26T08:43:51.960Z] Pool finished
[2026-09-26T08:43:51.960Z] /srv/anvil/cache
[2026-09-26T08:43:51.960Z] bash: line 1: rhc: command not found
[2026-09-26T08:43:52.372Z] bash: line 1: insights-client: command not found
[2026-09-26T08:43:52.783Z] bash: line 1: subscription-manager: command not found
[2026-09-26T08:43:54.773Z] Domain 'an-cache' destroyed
[2026-09-26T08:43:54.773Z] 
[2026-09-26T08:43:54.773Z] Domain 'an-cache' has been undefined
[2026-09-26T08:43:54.773Z] 
[2026-09-26T08:43:55.643Z] Done building drbd kmods
[2026-09-26T08:43:55.766Z] [Pipeline] }
[2026-09-26T08:43:55.768Z] [Pipeline] // stage
[2026-09-26T08:43:55.772Z] [Pipeline] stage
[2026-09-26T08:43:55.772Z] [Pipeline] { (Declarative: Post Actions)
[2026-09-26T08:43:55.777Z] [Pipeline] sh
[2026-09-26T08:43:56.396Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-09-26T08:43:56.396Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-09-26T08:43:56.396Z] Genering ssh keys and ssh config
[2026-09-26T08:43:57.269Z] Cleaning up simengine configuration
[2026-09-26T08:44:00.743Z] Destroying VMs (if any)
[2026-09-26T08:44:00.868Z] [Pipeline] cleanWs
[2026-09-26T08:44:00.953Z] [WS-CLEANUP] Deleting project workspace...
[2026-09-26T08:44:00.953Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-09-26T08:44:00.995Z] [WS-CLEANUP] done
[2026-09-26T08:44:00.998Z] [Pipeline] script
[2026-09-26T08:44:00.999Z] [Pipeline] {
[2026-09-26T08:44:01.012Z] [Pipeline] stage
[2026-09-26T08:44:01.012Z] [Pipeline] { (Copying logs)
[2026-09-26T08:44:01.041Z] [Pipeline] node
[2026-09-26T08:44:01.140Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-09-26T08:44:01.141Z] [Pipeline] {
[2026-09-26T08:44:01.174Z] [Pipeline] node
[2026-09-26T08:44:01.270Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-09-26T08:44:01.270Z] [Pipeline] {
[2026-09-26T08:44:01.273Z] [Pipeline] sh
[2026-09-26T08:44:01.529Z] + mkdir -p /var/lib/jenkins/locks
[2026-09-26T08:44:01.537Z] [Pipeline] echo
[2026-09-26T08:44:01.537Z] RWLock: FD for lock log_archive in stage projectFinishUp is 428
[2026-09-26T08:44:01.540Z] [Pipeline] sleep
[2026-09-26T08:44:01.540Z] No need to sleep any longer
[2026-09-26T08:44:01.542Z] [Pipeline] echo
[2026-09-26T08:44:01.542Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-09-26T08:44:01.545Z] [Pipeline] }
[2026-09-26T08:44:01.547Z] [Pipeline] // node
[2026-09-26T08:44:01.550Z] [Pipeline] echo
[2026-09-26T08:44:01.550Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4555/
[2026-09-26T08:44:01.551Z] [Pipeline] sh
[2026-09-26T08:44:01.806Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4555/
[2026-09-26T08:44:01.807Z] [Pipeline] sh