[2026-10-24T08:38:38.927Z] Started by upstream project "anvil/anvil-build-all-kmods" build number 705
[2026-10-24T08:38:38.927Z] originally caused by:
[2026-10-24T08:38:38.927Z]  Started by upstream project "anvil/anvil-build-cron" build number 205
[2026-10-24T08:38:38.927Z]  originally caused by:
[2026-10-24T08:38:38.927Z]   Started by timer
[2026-10-24T08:38:39.258Z] Obtained pipelines/projects/anvil/build-kmods/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-10-24T08:38:39.264Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-10-24T08:38:39.475Z] Examining kronosnet/ci-tools
[2026-10-24T08:38:39.476Z] Attempting to resolve main as a branch
[2026-10-24T08:38:39.661Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-10-24T08:38:39.662Z] Selected Git installation does not exist. Using Default
[2026-10-24T08:38:39.662Z] The recommended git tool is: NONE
[2026-10-24T08:38:39.662Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-24T08:38:39.664Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-24T08:38:39.664Z] Wiping out workspace first.
[2026-10-24T08:38:39.689Z] Cloning the remote Git repository
[2026-10-24T08:38:39.689Z] Using shallow clone with depth 1
[2026-10-24T08:38:39.689Z] Avoid fetching tags
[2026-10-24T08:38:39.689Z] Honoring refspec on initial clone
[2026-10-24T08:38:39.689Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:39.689Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b@2 # timeout=10
[2026-10-24T08:38:39.698Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:39.698Z]  > git --version # timeout=10
[2026-10-24T08:38:39.704Z]  > git --version # 'git version 2.52.0'
[2026-10-24T08:38:39.704Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-24T08:38:39.711Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:39.959Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-24T08:38:39.966Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:39.973Z] Avoid second fetch
[2026-10-24T08:38:39.973Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-10-24T08:38:39.973Z]  > git config core.sparsecheckout # timeout=10
[2026-10-24T08:38:39.979Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-10-24T08:38:40.013Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-10-24T08:38:40.022Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-10-24T08:38:40.229Z] Examining kronosnet/ci-tools
[2026-10-24T08:38:40.229Z] Attempting to resolve main as a branch
[2026-10-24T08:38:40.373Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-10-24T08:38:40.375Z] Selected Git installation does not exist. Using Default
[2026-10-24T08:38:40.375Z] The recommended git tool is: NONE
[2026-10-24T08:38:40.375Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-10-24T08:38:40.379Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-10-24T08:38:40.379Z] Wiping out workspace first.
[2026-10-24T08:38:40.399Z] Cloning the remote Git repository
[2026-10-24T08:38:40.399Z] Using shallow clone with depth 1
[2026-10-24T08:38:40.399Z] Avoid fetching tags
[2026-10-24T08:38:40.399Z] Honoring refspec on initial clone
[2026-10-24T08:38:40.399Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:40.399Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-kmods@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-10-24T08:38:40.408Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-10-24T08:38:40.408Z]  > git --version # timeout=10
[2026-10-24T08:38:40.415Z]  > git --version # 'git version 2.52.0'
[2026-10-24T08:38:40.415Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-10-24T08:38:40.421Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:40.673Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-10-24T08:38:40.680Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-10-24T08:38:40.687Z] Avoid second fetch
[2026-10-24T08:38:40.688Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-10-24T08:38:40.688Z]  > git config core.sparsecheckout # timeout=10
[2026-10-24T08:38:40.695Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-10-24T08:38:40.731Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-10-24T08:38:40.771Z] [Pipeline] Start of Pipeline
[2026-10-24T08:38:40.865Z] [Pipeline] node
[2026-10-24T08:38:40.868Z] Running on anvil-ci-bm-phy07 in /srv/workspace/anvil/anvil-build-kmods
[2026-10-24T08:38:40.868Z] [Pipeline] {
[2026-10-24T08:38:40.876Z] [Pipeline] stage
[2026-10-24T08:38:40.876Z] [Pipeline] { (Prep build env)
[2026-10-24T08:38:40.886Z] [Pipeline] cleanWs
[2026-10-24T08:38:40.934Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-24T08:38:40.934Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-24T08:38:40.958Z] [WS-CLEANUP] done
[2026-10-24T08:38:40.976Z] [Pipeline] lock
[2026-10-24T08:38:40.976Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-10-24T08:38:40.976Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-10-24T08:38:40.976Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-10-24T08:38:40.977Z] [Pipeline] {
[2026-10-24T08:38:40.979Z] [Pipeline] }
[2026-10-24T08:38:40.979Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-10-24T08:38:40.981Z] [Pipeline] // lock
[2026-10-24T08:38:40.984Z] [Pipeline] sh
[2026-10-24T08:38:41.451Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-24T08:38:41.451Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:38:41.796Z] Genering ssh keys and ssh config
[2026-10-24T08:38:42.139Z] Cleaning up simengine configuration
[2026-10-24T08:38:46.022Z] Destroying VMs (if any)
[2026-10-24T08:38:46.108Z] [Pipeline] }
[2026-10-24T08:38:46.110Z] [Pipeline] // stage
[2026-10-24T08:38:46.113Z] [Pipeline] stage
[2026-10-24T08:38:46.113Z] [Pipeline] { (Build kmod)
[2026-10-24T08:38:46.122Z] [Pipeline] sh
[2026-10-24T08:38:46.588Z] + /root/ci-tools/ci-setup-anvil-bm-vm-kmods almalinux-9 ci ci
[2026-10-24T08:38:46.588Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:38:46.933Z] Genering ssh keys and ssh config
[2026-10-24T08:38:47.276Z] Destroying VMs (if any)
[2026-10-24T08:38:47.276Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:38:48.014Z] Genering ssh keys and ssh config
[2026-10-24T08:38:48.358Z] Cache already updated
[2026-10-24T08:38:48.358Z] Building drbd kmod for almalinux-9 repo: ci anvil: ci
[2026-10-24T08:38:48.358Z] Formatting 'an-cache-vol.qcow2', fmt=qcow2 cluster_size=65536 extended_l2=off compression_type=zlib size=214748364800 backing_file=/srv/anvil/cache/almalinux-9-latest.qcow2 backing_fmt=qcow2 lazy_refcounts=off refcount_bits=16
[2026-10-24T08:38:48.358Z] wrote an-cache-seed.img with filesystem=iso9660 and diskformat=raw
[2026-10-24T08:38:49.552Z] 
[2026-10-24T08:38:49.552Z] Starting install...
[2026-10-24T08:38:49.552Z] 
[2026-10-24T08:38:49.552Z] Creating domain...                                          |         00:00     
[2026-10-24T08:38:49.552Z] Domain creation completed.
[2026-10-24T08:38:49.552Z] Waiting for nodes and cloud-init to complete full init
[2026-10-24T08:38:52.596Z] cloud-init status node an-cache: 
[2026-10-24T08:38:52.596Z] Sat Oct 24 04:38:52 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:06.039Z] cloud-init status node an-cache: 
[2026-10-24T08:39:06.039Z] Sat Oct 24 04:39:04 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:17.051Z] cloud-init status node an-cache: running
[2026-10-24T08:39:17.051Z] Sat Oct 24 04:39:15 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:28.048Z] cloud-init status node an-cache: running
[2026-10-24T08:39:28.048Z] Sat Oct 24 04:39:26 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:37.250Z] cloud-init status node an-cache: running
[2026-10-24T08:39:37.250Z] Sat Oct 24 04:39:36 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:48.263Z] cloud-init status node an-cache: running
[2026-10-24T08:39:48.263Z] Sat Oct 24 04:39:47 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:39:59.271Z] cloud-init status node an-cache: running
[2026-10-24T08:39:59.271Z] Sat Oct 24 04:39:58 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:11.041Z] cloud-init status node an-cache: running
[2026-10-24T08:40:11.041Z] Sat Oct 24 04:40:09 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:20.097Z] cloud-init status node an-cache: running
[2026-10-24T08:40:20.097Z] Sat Oct 24 04:40:20 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:31.097Z] cloud-init status node an-cache: running
[2026-10-24T08:40:31.097Z] Sat Oct 24 04:40:30 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:42.233Z] cloud-init status node an-cache: running
[2026-10-24T08:40:42.233Z] Sat Oct 24 04:40:41 EDT 2026 actual: 0 expected: 1
[2026-10-24T08:40:53.239Z] cloud-init status node an-cache: done
[2026-10-24T08:40:53.239Z] Sat Oct 24 04:40:52 EDT 2026 actual: 1 expected: 1
[2026-10-24T08:40:53.239Z] Waiting for akmods to complete build
[2026-10-24T08:40:53.239Z] build not found, sleeping 10 seconds
[2026-10-24T08:41:04.249Z] build not found, sleeping 10 seconds
[2026-10-24T08:41:13.436Z] build not found, sleeping 10 seconds
[2026-10-24T08:41:24.444Z] build not found, sleeping 10 seconds
[2026-10-24T08:41:35.452Z] build not found, sleeping 10 seconds
[2026-10-24T08:41:44.628Z] build not found, sleeping 10 seconds
[2026-10-24T08:41:55.633Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:04.692Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:15.818Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:26.823Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:35.885Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:47.011Z] build not found, sleeping 10 seconds
[2026-10-24T08:42:58.022Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:07.090Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:18.214Z] build not found, sleeping 10 seconds
[2026-10-24T08:43:27.273Z] /var/cache/akmods/drbd/kmod-drbd-5.14.0-687.el9_8-9.2.16-1.el9.x86_64.rpm
[2026-10-24T08:43:27.273Z] build found
[2026-10-24T08:43:27.273Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:43:28.469Z] Directory walk started
[2026-10-24T08:43:28.469Z] Directory walk done - 10 packages
[2026-10-24T08:43:28.469Z] Temporary output repo path: ./.repodata/
[2026-10-24T08:43:28.469Z] Preparing sqlite DBs
[2026-10-24T08:43:28.469Z] Pool started (with 5 workers)
[2026-10-24T08:43:28.469Z] Pool finished
[2026-10-24T08:43:28.469Z] /srv/anvil/cache
[2026-10-24T08:43:28.813Z] bash: line 1: rhc: command not found
[2026-10-24T08:43:28.813Z] bash: line 1: insights-client: command not found
[2026-10-24T08:43:29.158Z] bash: line 1: subscription-manager: command not found
[2026-10-24T08:43:31.489Z] Domain 'an-cache' destroyed
[2026-10-24T08:43:31.489Z] 
[2026-10-24T08:43:31.489Z] Domain 'an-cache' has been undefined
[2026-10-24T08:43:31.489Z] 
[2026-10-24T08:43:31.833Z] Done building drbd kmods
[2026-10-24T08:43:31.905Z] [Pipeline] }
[2026-10-24T08:43:31.907Z] [Pipeline] // stage
[2026-10-24T08:43:31.910Z] [Pipeline] stage
[2026-10-24T08:43:31.910Z] [Pipeline] { (Declarative: Post Actions)
[2026-10-24T08:43:31.915Z] [Pipeline] sh
[2026-10-24T08:43:32.471Z] + /root/ci-tools/ci-destroy-anvil-bm-vm
[2026-10-24T08:43:32.471Z] Warning: Permanently added '[anvil-ci-proxy]:8086' (ED25519) to the list of known hosts.
[2026-10-24T08:43:32.820Z] Genering ssh keys and ssh config
[2026-10-24T08:43:33.164Z] Cleaning up simengine configuration
[2026-10-24T08:43:37.052Z] Destroying VMs (if any)
[2026-10-24T08:43:37.125Z] [Pipeline] cleanWs
[2026-10-24T08:43:37.175Z] [WS-CLEANUP] Deleting project workspace...
[2026-10-24T08:43:37.175Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-10-24T08:43:37.199Z] [WS-CLEANUP] done
[2026-10-24T08:43:37.202Z] [Pipeline] script
[2026-10-24T08:43:37.203Z] [Pipeline] {
[2026-10-24T08:43:37.222Z] [Pipeline] stage
[2026-10-24T08:43:37.222Z] [Pipeline] { (Copying logs)
[2026-10-24T08:43:37.276Z] [Pipeline] node
[2026-10-24T08:43:37.378Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods
[2026-10-24T08:43:37.379Z] [Pipeline] {
[2026-10-24T08:43:37.414Z] [Pipeline] node
[2026-10-24T08:43:37.513Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-kmods@2
[2026-10-24T08:43:37.514Z] [Pipeline] {
[2026-10-24T08:43:37.517Z] [Pipeline] sh
[2026-10-24T08:43:37.772Z] + mkdir -p /var/lib/jenkins/locks
[2026-10-24T08:43:37.781Z] [Pipeline] echo
[2026-10-24T08:43:37.781Z] RWLock: FD for lock log_archive in stage projectFinishUp is 565
[2026-10-24T08:43:37.784Z] [Pipeline] sleep
[2026-10-24T08:43:37.784Z] No need to sleep any longer
[2026-10-24T08:43:37.787Z] [Pipeline] echo
[2026-10-24T08:43:37.787Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-10-24T08:43:37.789Z] [Pipeline] }
[2026-10-24T08:43:37.792Z] [Pipeline] // node
[2026-10-24T08:43:37.796Z] [Pipeline] echo
[2026-10-24T08:43:37.796Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4721/
[2026-10-24T08:43:37.798Z] [Pipeline] sh
[2026-10-24T08:43:38.054Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-kmods/4721/
[2026-10-24T08:43:38.055Z] [Pipeline] sh