[2026-07-03T08:34:04.588Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 605
[2026-07-03T08:34:04.588Z] originally caused by:
[2026-07-03T08:34:04.588Z]  Started by upstream project "anvil/anvil-build-cron" build number 103
[2026-07-03T08:34:04.588Z]  originally caused by:
[2026-07-03T08:34:04.588Z]   Started by timer
[2026-07-03T08:34:05.506Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-07-03T08:34:05.515Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-07-03T08:34:05.757Z] Examining kronosnet/ci-tools
[2026-07-03T08:34:05.757Z] Attempting to resolve main as a branch
[2026-07-03T08:34:05.915Z] Resolved main as branch main at revision 08eec0b40de1c061b67d067ec1534b5930b1a926
[2026-07-03T08:34:05.916Z] Selected Git installation does not exist. Using Default
[2026-07-03T08:34:05.916Z] The recommended git tool is: NONE
[2026-07-03T08:34:05.916Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-07-03T08:34:05.920Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-07-03T08:34:05.920Z] Wiping out workspace first.
[2026-07-03T08:34:05.937Z] Cloning the remote Git repository
[2026-07-03T08:34:05.937Z] Using shallow clone with depth 1
[2026-07-03T08:34:05.937Z] Avoid fetching tags
[2026-07-03T08:34:05.937Z] Honoring refspec on initial clone
[2026-07-03T08:34:05.937Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-07-03T08:34:05.937Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@3 # timeout=10
[2026-07-03T08:34:05.946Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-07-03T08:34:05.946Z]  > git --version # timeout=10
[2026-07-03T08:34:05.952Z]  > git --version # 'git version 2.52.0'
[2026-07-03T08:34:05.952Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-07-03T08:34:05.958Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-03T08:34:06.149Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-07-03T08:34:06.157Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-03T08:34:06.165Z] Avoid second fetch
[2026-07-03T08:34:06.165Z] Checking out Revision 08eec0b40de1c061b67d067ec1534b5930b1a926 (main)
[2026-07-03T08:34:06.165Z]  > git config core.sparsecheckout # timeout=10
[2026-07-03T08:34:06.173Z]  > git checkout -f 08eec0b40de1c061b67d067ec1534b5930b1a926 # timeout=10
[2026-07-03T08:34:06.209Z] Commit message: "ansible: reboot nodes after updates are applied"
[2026-07-03T08:34:06.218Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-07-03T08:34:06.414Z] Examining kronosnet/ci-tools
[2026-07-03T08:34:06.414Z] Attempting to resolve main as a branch
[2026-07-03T08:34:06.584Z] Resolved main as branch main at revision 08eec0b40de1c061b67d067ec1534b5930b1a926
[2026-07-03T08:34:06.584Z] Selected Git installation does not exist. Using Default
[2026-07-03T08:34:06.584Z] The recommended git tool is: NONE
[2026-07-03T08:34:06.585Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-07-03T08:34:06.588Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-07-03T08:34:06.588Z] Wiping out workspace first.
[2026-07-03T08:34:06.608Z] Cloning the remote Git repository
[2026-07-03T08:34:06.608Z] Using shallow clone with depth 1
[2026-07-03T08:34:06.608Z] Avoid fetching tags
[2026-07-03T08:34:06.609Z] Honoring refspec on initial clone
[2026-07-03T08:34:06.609Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-07-03T08:34:06.609Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-07-03T08:34:06.619Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-07-03T08:34:06.619Z]  > git --version # timeout=10
[2026-07-03T08:34:06.627Z]  > git --version # 'git version 2.52.0'
[2026-07-03T08:34:06.627Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-07-03T08:34:06.634Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-03T08:34:06.853Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-07-03T08:34:06.860Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-03T08:34:06.868Z] Avoid second fetch
[2026-07-03T08:34:06.869Z] Checking out Revision 08eec0b40de1c061b67d067ec1534b5930b1a926 (main)
[2026-07-03T08:34:06.869Z]  > git config core.sparsecheckout # timeout=10
[2026-07-03T08:34:06.875Z]  > git checkout -f 08eec0b40de1c061b67d067ec1534b5930b1a926 # timeout=10
[2026-07-03T08:34:06.907Z] Commit message: "ansible: reboot nodes after updates are applied"
[2026-07-03T08:34:06.969Z] [Pipeline] Start of Pipeline
[2026-07-03T08:34:07.082Z] [Pipeline] node
[2026-07-03T08:34:07.085Z] Running on anvil-ci-bm-phy05 in /srv/workspace/anvil/anvil-build-kmods
[2026-07-03T08:34:07.085Z] [Pipeline] {
[2026-07-03T08:34:07.093Z] [Pipeline] stage
[2026-07-03T08:34:07.093Z] [Pipeline] { (Prep build env)
[2026-07-03T08:34:07.106Z] [Pipeline] cleanWs
[2026-07-03T08:34:07.157Z] [WS-CLEANUP] Deleting project workspace...
[2026-07-03T08:34:07.157Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-07-03T08:34:07.182Z] [WS-CLEANUP] done
[2026-07-03T08:34:07.203Z] [Pipeline] lock
[2026-07-03T08:34:07.203Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-07-03T08:34:07.203Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-07-03T08:34:07.204Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-07-03T08:34:07.204Z] [Pipeline] {
[2026-07-03T08:34:07.206Z] [Pipeline] }
[2026-07-03T08:34:07.207Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-07-03T08:34:07.209Z] [Pipeline] // lock
[2026-07-03T08:34:07.213Z] [Pipeline] sh
[2026-07-03T08:34:07.693Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-07-03T08:34:07.694Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-07-03T08:34:08.042Z] Genering ssh keys and ssh config
[2026-07-03T08:34:08.392Z] Cleaning up simengine configuration
[2026-07-03T08:34:12.300Z] Destroying VMs (if any)
[2026-07-03T08:34:12.721Z] [Pipeline] }
[2026-07-03T08:34:12.724Z] [Pipeline] // stage
[2026-07-03T08:34:12.727Z] [Pipeline] stage
[2026-07-03T08:34:12.727Z] [Pipeline] { (Build kmod)
[2026-07-03T08:34:12.737Z] [Pipeline] sh
[2026-07-03T08:34:13.241Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise none
[2026-07-03T08:34:13.241Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-07-03T08:34:13.241Z] Genering ssh keys and ssh config
[2026-07-03T08:34:13.985Z] Destroying VMs (if any)
[2026-07-03T08:34:13.985Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-07-03T08:34:14.333Z] Genering ssh keys and ssh config
[2026-07-03T08:34:14.681Z] Cache already updated
[2026-07-03T08:34:14.681Z] Building drbd kmod for almalinux-9 repo: enterprise anvil: none
[2026-07-03T08:34:15.029Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-07-03T08:34:15.029Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-07-03T08:34:16.763Z] 
[2026-07-03T08:34:16.763Z] Starting install...
[2026-07-03T08:34:16.763Z] 
[2026-07-03T08:34:16.763Z] Creating domain...                                          |         00:00     
[2026-07-03T08:34:16.763Z] Domain creation completed.
[2026-07-03T08:34:16.763Z] Waiting for nodes and cloud-init to complete full init
[2026-07-03T08:34:19.836Z] cloud-init status node an-cache: 
[2026-07-03T08:34:19.836Z] Fri Jul  3 04:34:19 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:34:33.202Z] cloud-init status node an-cache: 
[2026-07-03T08:34:33.202Z] Fri Jul  3 04:34:32 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:34:44.278Z] cloud-init status node an-cache: 
[2026-07-03T08:34:44.278Z] Fri Jul  3 04:34:42 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:34:55.320Z] cloud-init status node an-cache: running
[2026-07-03T08:34:55.320Z] Fri Jul  3 04:34:54 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:35:06.362Z] cloud-init status node an-cache: running
[2026-07-03T08:35:06.363Z] Fri Jul  3 04:35:06 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:35:19.710Z] cloud-init status node an-cache: running
[2026-07-03T08:35:19.710Z] Fri Jul  3 04:35:17 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:35:30.832Z] cloud-init status node an-cache: running
[2026-07-03T08:35:30.832Z] Fri Jul  3 04:35:29 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:35:41.860Z] cloud-init status node an-cache: running
[2026-07-03T08:35:41.860Z] Fri Jul  3 04:35:40 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:35:52.901Z] cloud-init status node an-cache: running
[2026-07-03T08:35:52.901Z] Fri Jul  3 04:35:52 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:36:03.943Z] cloud-init status node an-cache: running
[2026-07-03T08:36:03.943Z] Fri Jul  3 04:36:03 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:36:17.302Z] cloud-init status node an-cache: running
[2026-07-03T08:36:17.302Z] Fri Jul  3 04:36:15 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:36:28.342Z] cloud-init status node an-cache: running
[2026-07-03T08:36:28.342Z] Fri Jul  3 04:36:27 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:36:39.386Z] cloud-init status node an-cache: running
[2026-07-03T08:36:39.386Z] Fri Jul  3 04:36:38 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:36:52.741Z] cloud-init status node an-cache: running
[2026-07-03T08:36:52.741Z] Fri Jul  3 04:36:50 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:37:01.828Z] cloud-init status node an-cache: running
[2026-07-03T08:37:01.828Z] Fri Jul  3 04:37:01 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:37:12.846Z] cloud-init status node an-cache: running
[2026-07-03T08:37:12.846Z] Fri Jul  3 04:37:12 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:37:23.858Z] cloud-init status node an-cache: running
[2026-07-03T08:37:23.858Z] Fri Jul  3 04:37:23 EDT 2026 actual: 0 expected: 1
[2026-07-03T08:37:34.888Z] cloud-init status node an-cache: done
[2026-07-03T08:37:34.888Z] Fri Jul  3 04:37:34 EDT 2026 actual: 1 expected: 1
[2026-07-03T08:37:34.888Z] Waiting for akmods to complete build
[2026-07-03T08:37:34.888Z] build not found, sleeping 10 seconds
[2026-07-03T08:37:45.910Z] build not found, sleeping 10 seconds
[2026-07-03T08:37:56.958Z] build not found, sleeping 10 seconds
[2026-07-03T08:38:07.986Z] build not found, sleeping 10 seconds
[2026-07-03T08:38:17.070Z] build not found, sleeping 10 seconds
[2026-07-03T08:38:28.220Z] build not found, sleeping 10 seconds
[2026-07-03T08:38:39.259Z] build not found, sleeping 10 seconds
[2026-07-03T08:38:48.341Z] build not found, sleeping 10 seconds
[2026-07-03T08:38:59.368Z] build not found, sleeping 10 seconds
[2026-07-03T08:39:10.413Z] build not found, sleeping 10 seconds
[2026-07-03T08:39:21.526Z] build not found, sleeping 10 seconds
[2026-07-03T08:39:30.615Z] build not found, sleeping 10 seconds
[2026-07-03T08:39:41.659Z] build not found, sleeping 10 seconds
[2026-07-03T08:39:52.713Z] build not found, sleeping 10 seconds
[2026-07-03T08:40:03.766Z] build not found, sleeping 10 seconds
[2026-07-03T08:40:14.805Z] build not found, sleeping 10 seconds
[2026-07-03T08:40:23.900Z] build not found, sleeping 10 seconds
[2026-07-03T08:40:34.937Z] build not found, sleeping 10 seconds
[2026-07-03T08:40:45.967Z] build not found, sleeping 10 seconds
[2026-07-03T08:40:56.991Z] build not found, sleeping 10 seconds
[2026-07-03T08:41:08.042Z] build not found, sleeping 10 seconds
[2026-07-03T08:41:17.140Z] build not found, sleeping 10 seconds
[2026-07-03T08:41:28.192Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-07-03T08:41:28.192Z] build found
[2026-07-03T08:41:28.541Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-07-03T08:41:29.747Z] Directory walk started
[2026-07-03T08:41:29.747Z] Directory walk done - 8 packages
[2026-07-03T08:41:29.747Z] Temporary output repo path: ./.repodata/
[2026-07-03T08:41:29.747Z] Preparing sqlite DBs
[2026-07-03T08:41:29.747Z] Pool started (with 5 workers)
[2026-07-03T08:41:29.747Z] Pool finished
[2026-07-03T08:41:29.747Z] /srv/anvil/cache
[2026-07-03T08:41:30.096Z] bash: line 1: rhc: command not found
[2026-07-03T08:41:30.444Z] bash: line 1: insights-client: command not found
[2026-07-03T08:41:30.792Z] bash: line 1: subscription-manager: command not found
[2026-07-03T08:41:33.141Z] Domain 'an-cache' destroyed
[2026-07-03T08:41:33.141Z] 
[2026-07-03T08:41:33.141Z] Domain 'an-cache' has been undefined
[2026-07-03T08:41:33.141Z] 
[2026-07-03T08:41:33.487Z] Done building drbd kmods
[2026-07-03T08:41:33.563Z] [Pipeline] }
[2026-07-03T08:41:33.565Z] [Pipeline] // stage
[2026-07-03T08:41:33.568Z] [Pipeline] stage
[2026-07-03T08:41:33.569Z] [Pipeline] { (Declarative: Post Actions)
[2026-07-03T08:41:33.575Z] [Pipeline] sh
[2026-07-03T08:41:34.108Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-07-03T08:41:34.108Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-07-03T08:41:34.456Z] Genering ssh keys and ssh config
[2026-07-03T08:41:34.803Z] Cleaning up simengine configuration
[2026-07-03T08:41:38.710Z] Destroying VMs (if any)
[2026-07-03T08:41:38.786Z] [Pipeline] cleanWs
[2026-07-03T08:41:38.837Z] [WS-CLEANUP] Deleting project workspace...
[2026-07-03T08:41:38.837Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-07-03T08:41:38.862Z] [WS-CLEANUP] done
[2026-07-03T08:41:38.866Z] [Pipeline] script
[2026-07-03T08:41:38.869Z] [Pipeline] {
[2026-07-03T08:41:38.885Z] [Pipeline] stage
[2026-07-03T08:41:38.886Z] [Pipeline] { (Copying logs)
[2026-07-03T08:41:38.920Z] [Pipeline] node
[2026-07-03T08:41:39.020Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-07-03T08:41:39.021Z] [Pipeline] {
[2026-07-03T08:41:39.057Z] [Pipeline] node
[2026-07-03T08:41:39.160Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-07-03T08:41:39.161Z] [Pipeline] {
[2026-07-03T08:41:39.164Z] [Pipeline] sh
[2026-07-03T08:41:39.420Z] + mkdir -p /var/lib/jenkins/locks
[2026-07-03T08:41:39.430Z] [Pipeline] echo
[2026-07-03T08:41:39.430Z] RWLock: FD for lock log_archive in stage projectFinishUp is 385
[2026-07-03T08:41:39.433Z] [Pipeline] sleep
[2026-07-03T08:41:39.433Z] No need to sleep any longer
[2026-07-03T08:41:39.435Z] [Pipeline] echo
[2026-07-03T08:41:39.435Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-07-03T08:41:39.438Z] [Pipeline] }
[2026-07-03T08:41:39.439Z] [Pipeline] // node
[2026-07-03T08:41:39.442Z] [Pipeline] echo
[2026-07-03T08:41:39.442Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4123/
[2026-07-03T08:41:39.443Z] [Pipeline] sh
[2026-07-03T08:41:39.698Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4123/
[2026-07-03T08:41:39.700Z] [Pipeline] sh