[2026-10-28T08:39:28.698Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 709
[2026-10-28T08:39:28.698Z] originally caused by:
[2026-10-28T08:39:28.698Z]  Started by upstream project "anvil/anvil-build-cron" build number 209
[2026-10-28T08:39:28.698Z]  originally caused by:
[2026-10-28T08:39:28.698Z]   Started by timer
[2026-10-28T08:39:29.469Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-10-28T08:39:29.474Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-10-28T08:39:29.770Z] Examining kronosnet/ci-tools
[2026-10-28T08:39:29.770Z] Attempting to resolve main as a branch
[2026-10-28T08:39:29.957Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-10-28T08:39:29.958Z] Selected Git installation does not exist. Using Default
[2026-10-28T08:39:29.958Z] The recommended git tool is: NONE
[2026-10-28T08:39:29.958Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-28T08:39:29.962Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-28T08:39:29.962Z] Wiping out workspace first.
[2026-10-28T08:39:29.990Z] Cloning the remote Git repository
[2026-10-28T08:39:29.990Z] Using shallow clone with depth 1
[2026-10-28T08:39:29.990Z] Avoid fetching tags
[2026-10-28T08:39:29.990Z] Honoring refspec on initial clone
[2026-10-28T08:39:29.990Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-28T08:39:29.990Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@4 # timeout=10
[2026-10-28T08:39:30.002Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-28T08:39:30.002Z]  > git --version # timeout=10
[2026-10-28T08:39:30.010Z]  > git --version # 'git version 2.52.0'
[2026-10-28T08:39:30.010Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-28T08:39:30.017Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-28T08:39:30.289Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-28T08:39:30.297Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-28T08:39:30.305Z] Avoid second fetch
[2026-10-28T08:39:30.305Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-10-28T08:39:30.305Z]  > git config core.sparsecheckout # timeout=10
[2026-10-28T08:39:30.313Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-10-28T08:39:30.348Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-10-28T08:39:30.358Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-10-28T08:39:30.658Z] Examining kronosnet/ci-tools
[2026-10-28T08:39:30.658Z] Attempting to resolve main as a branch
[2026-10-28T08:39:30.849Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-10-28T08:39:30.849Z] Selected Git installation does not exist. Using Default
[2026-10-28T08:39:30.849Z] The recommended git tool is: NONE
[2026-10-28T08:39:30.850Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-28T08:39:30.852Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-28T08:39:30.852Z] Wiping out workspace first.
[2026-10-28T08:39:30.873Z] Cloning the remote Git repository
[2026-10-28T08:39:30.873Z] Using shallow clone with depth 1
[2026-10-28T08:39:30.873Z] Avoid fetching tags
[2026-10-28T08:39:30.873Z] Honoring refspec on initial clone
[2026-10-28T08:39:30.873Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-28T08:39:30.873Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-10-28T08:39:30.882Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-28T08:39:30.882Z]  > git --version # timeout=10
[2026-10-28T08:39:30.889Z]  > git --version # 'git version 2.52.0'
[2026-10-28T08:39:30.889Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-28T08:39:30.895Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-28T08:39:31.153Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-28T08:39:31.163Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-28T08:39:31.171Z] Avoid second fetch
[2026-10-28T08:39:31.172Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-10-28T08:39:31.172Z]  > git config core.sparsecheckout # timeout=10
[2026-10-28T08:39:31.179Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-10-28T08:39:31.215Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-10-28T08:39:31.296Z] [Pipeline] Start of Pipeline
[2026-10-28T08:39:31.388Z] [Pipeline] node
[2026-10-28T08:39:31.434Z] Running on anvil-ci-bm-phy03 in /srv/workspace/anvil/anvil-build-kmods
[2026-10-28T08:39:31.434Z] [Pipeline] {
[2026-10-28T08:39:31.443Z] [Pipeline] stage
[2026-10-28T08:39:31.443Z] [Pipeline] { (Prep build env)
[2026-10-28T08:39:31.457Z] [Pipeline] cleanWs
[2026-10-28T08:39:31.516Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-28T08:39:31.516Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-28T08:39:31.545Z] [WS-CLEANUP] done
[2026-10-28T08:39:31.564Z] [Pipeline] lock
[2026-10-28T08:39:31.564Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-10-28T08:39:31.564Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-10-28T08:39:31.564Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-10-28T08:39:31.564Z] [Pipeline] {
[2026-10-28T08:39:31.566Z] [Pipeline] }
[2026-10-28T08:39:31.567Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-10-28T08:39:31.568Z] [Pipeline] // lock
[2026-10-28T08:39:31.571Z] [Pipeline] sh
[2026-10-28T08:39:32.085Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-28T08:39:32.085Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-28T08:39:32.449Z] Genering ssh keys and ssh config
[2026-10-28T08:39:32.813Z] Cleaning up simengine configuration
[2026-10-28T08:39:36.869Z] Destroying VMs (if any)
[2026-10-28T08:39:36.956Z] [Pipeline] }
[2026-10-28T08:39:36.959Z] [Pipeline] // stage
[2026-10-28T08:39:36.961Z] [Pipeline] stage
[2026-10-28T08:39:36.961Z] [Pipeline] { (Build kmod)
[2026-10-28T08:39:36.972Z] [Pipeline] sh
[2026-10-28T08:39:37.487Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 enterprise none
[2026-10-28T08:39:37.487Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-28T08:39:37.852Z] Genering ssh keys and ssh config
[2026-10-28T08:39:38.217Z] Destroying VMs (if any)
[2026-10-28T08:39:38.217Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-28T08:39:38.996Z] Genering ssh keys and ssh config
[2026-10-28T08:39:39.360Z] Cache already updated
[2026-10-28T08:39:39.360Z] Building drbd kmod for almalinux-9 repo: enterprise anvil: none
[2026-10-28T08:39:39.360Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-10-28T08:39:39.360Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-10-28T08:39:40.616Z] 
[2026-10-28T08:39:40.616Z] Starting install...
[2026-10-28T08:39:40.616Z] 
[2026-10-28T08:39:40.616Z] Creating domain...                                          |         00:00     
[2026-10-28T08:39:40.616Z] Domain creation completed.
[2026-10-28T08:39:40.616Z] Waiting for nodes and cloud-init to complete full init
[2026-10-28T08:39:43.785Z] cloud-init status node an-cache: 
[2026-10-28T08:39:43.785Z] Wed Oct 28 04:39:43 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:39:55.038Z] cloud-init status node an-cache: 
[2026-10-28T08:39:55.038Z] Wed Oct 28 04:39:54 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:40:06.536Z] cloud-init status node an-cache: running
[2026-10-28T08:40:06.536Z] Wed Oct 28 04:40:05 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:40:17.786Z] cloud-init status node an-cache: running
[2026-10-28T08:40:17.786Z] Wed Oct 28 04:40:16 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:40:27.080Z] cloud-init status node an-cache: running
[2026-10-28T08:40:27.080Z] Wed Oct 28 04:40:26 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:40:38.479Z] cloud-init status node an-cache: running
[2026-10-28T08:40:38.479Z] Wed Oct 28 04:40:37 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:40:49.732Z] cloud-init status node an-cache: running
[2026-10-28T08:40:49.732Z] Wed Oct 28 04:40:48 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:40:59.020Z] cloud-init status node an-cache: running
[2026-10-28T08:40:59.020Z] Wed Oct 28 04:40:58 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:41:10.544Z] cloud-init status node an-cache: running
[2026-10-28T08:41:10.544Z] Wed Oct 28 04:41:09 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:41:21.790Z] cloud-init status node an-cache: running
[2026-10-28T08:41:21.790Z] Wed Oct 28 04:41:20 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:41:33.046Z] cloud-init status node an-cache: running
[2026-10-28T08:41:33.046Z] Wed Oct 28 04:41:31 EDT 2026 actual: 0 expected: 1
[2026-10-28T08:41:42.488Z] cloud-init status node an-cache: done
[2026-10-28T08:41:42.488Z] Wed Oct 28 04:41:41 EDT 2026 actual: 1 expected: 1
[2026-10-28T08:41:42.488Z] Waiting for akmods to complete build
[2026-10-28T08:41:42.488Z] build not found, sleeping 10 seconds
[2026-10-28T08:41:53.743Z] build not found, sleeping 10 seconds
[2026-10-28T08:42:03.033Z] build not found, sleeping 10 seconds
[2026-10-28T08:42:14.433Z] build not found, sleeping 10 seconds
[2026-10-28T08:42:23.725Z] build not found, sleeping 10 seconds
[2026-10-28T08:42:34.970Z] build not found, sleeping 10 seconds
[2026-10-28T08:42:44.405Z] build not found, sleeping 10 seconds
[2026-10-28T08:42:55.676Z] build not found, sleeping 10 seconds
[2026-10-28T08:43:04.964Z] build not found, sleeping 10 seconds
[2026-10-28T08:43:16.364Z] build not found, sleeping 10 seconds
[2026-10-28T08:43:25.654Z] build not found, sleeping 10 seconds
[2026-10-28T08:43:36.910Z] build not found, sleeping 10 seconds
[2026-10-28T08:43:46.332Z] build not found, sleeping 10 seconds
[2026-10-28T08:43:57.588Z] build not found, sleeping 10 seconds
[2026-10-28T08:44:06.874Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-10-28T08:44:06.874Z] build found
[2026-10-28T08:44:06.874Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-28T08:44:08.130Z] Directory walk started
[2026-10-28T08:44:08.130Z] Directory walk done - 8 packages
[2026-10-28T08:44:08.130Z] Temporary output repo path: ./.repodata/
[2026-10-28T08:44:08.130Z] Preparing sqlite DBs
[2026-10-28T08:44:08.130Z] Pool started (with 5 workers)
[2026-10-28T08:44:08.130Z] Pool finished
[2026-10-28T08:44:08.130Z] /srv/anvil/cache
[2026-10-28T08:44:08.495Z] bash: line 1: rhc: command not found
[2026-10-28T08:44:08.495Z] bash: line 1: insights-client: command not found
[2026-10-28T08:44:08.860Z] bash: line 1: subscription-manager: command not found
[2026-10-28T08:44:11.295Z] Domain 'an-cache' destroyed
[2026-10-28T08:44:11.295Z] 
[2026-10-28T08:44:11.295Z] Domain 'an-cache' has been undefined
[2026-10-28T08:44:11.295Z] 
[2026-10-28T08:44:11.520Z] Done building drbd kmods
[2026-10-28T08:44:11.521Z] [Pipeline] }
[2026-10-28T08:44:11.524Z] [Pipeline] // stage
[2026-10-28T08:44:11.527Z] [Pipeline] stage
[2026-10-28T08:44:11.528Z] [Pipeline] { (Declarative: Post Actions)
[2026-10-28T08:44:11.534Z] [Pipeline] sh
[2026-10-28T08:44:12.130Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-28T08:44:12.130Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-28T08:44:12.496Z] Genering ssh keys and ssh config
[2026-10-28T08:44:12.861Z] Cleaning up simengine configuration
[2026-10-28T08:44:16.033Z] Destroying VMs (if any)
[2026-10-28T08:44:16.489Z] [Pipeline] cleanWs
[2026-10-28T08:44:16.548Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-28T08:44:16.548Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-28T08:44:16.577Z] [WS-CLEANUP] done
[2026-10-28T08:44:16.581Z] [Pipeline] script
[2026-10-28T08:44:16.584Z] [Pipeline] {
[2026-10-28T08:44:16.605Z] [Pipeline] stage
[2026-10-28T08:44:16.606Z] [Pipeline] { (Copying logs)
[2026-10-28T08:44:16.642Z] [Pipeline] node
[2026-10-28T08:44:16.806Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-10-28T08:44:16.807Z] [Pipeline] {
[2026-10-28T08:44:16.842Z] [Pipeline] node
[2026-10-28T08:44:17.017Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-10-28T08:44:17.018Z] [Pipeline] {
[2026-10-28T08:44:17.023Z] [Pipeline] sh
[2026-10-28T08:44:17.279Z] + mkdir -p /var/lib/jenkins/locks
[2026-10-28T08:44:17.293Z] [Pipeline] echo
[2026-10-28T08:44:17.293Z] RWLock: FD for lock log_archive in stage projectFinishUp is 666
[2026-10-28T08:44:17.296Z] [Pipeline] sleep
[2026-10-28T08:44:17.296Z] No need to sleep any longer
[2026-10-28T08:44:17.298Z] [Pipeline] echo
[2026-10-28T08:44:17.299Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-10-28T08:44:17.302Z] [Pipeline] }
[2026-10-28T08:44:17.305Z] [Pipeline] // node
[2026-10-28T08:44:17.310Z] [Pipeline] echo
[2026-10-28T08:44:17.310Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4747/
[2026-10-28T08:44:17.312Z] [Pipeline] sh
[2026-10-28T08:44:17.568Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4747/
[2026-10-28T08:44:17.569Z] [Pipeline] sh