[2026-11-12T08:16:00.524Z] Started by timer
[2026-11-12T08:16:00.744Z] Obtained pipelines/projects/anvil/build-cron/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-11-12T08:16:00.763Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-11-12T08:16:01.160Z] Examining kronosnet/ci-tools
[2026-11-12T08:16:01.160Z] Attempting to resolve main as a branch
[2026-11-12T08:16:01.362Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-11-12T08:16:01.364Z] Selected Git installation does not exist. Using Default
[2026-11-12T08:16:01.364Z] The recommended git tool is: NONE
[2026-11-12T08:16:01.364Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-11-12T08:16:01.366Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-11-12T08:16:01.366Z] Wiping out workspace first.
[2026-11-12T08:16:01.394Z] Cloning the remote Git repository
[2026-11-12T08:16:01.394Z] Using shallow clone with depth 1
[2026-11-12T08:16:01.394Z] Avoid fetching tags
[2026-11-12T08:16:01.394Z] Honoring refspec on initial clone
[2026-11-12T08:16:01.394Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-11-12T08:16:01.394Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-cron@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-11-12T08:16:01.405Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-11-12T08:16:01.405Z]  > git --version # timeout=10
[2026-11-12T08:16:01.411Z]  > git --version # 'git version 2.52.0'
[2026-11-12T08:16:01.411Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-11-12T08:16:01.417Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-12T08:16:01.708Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-11-12T08:16:01.715Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-12T08:16:01.722Z] Avoid second fetch
[2026-11-12T08:16:01.723Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-11-12T08:16:01.723Z]  > git config core.sparsecheckout # timeout=10
[2026-11-12T08:16:01.729Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-11-12T08:16:01.765Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-11-12T08:16:01.773Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-11-12T08:16:02.067Z] Examining kronosnet/ci-tools
[2026-11-12T08:16:02.067Z] Attempting to resolve main as a branch
[2026-11-12T08:16:02.284Z] Resolved main as branch main at revision fd5667069c7b69778ce97df718cf25626f5beefc
[2026-11-12T08:16:02.284Z] Selected Git installation does not exist. Using Default
[2026-11-12T08:16:02.284Z] The recommended git tool is: NONE
[2026-11-12T08:16:02.285Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-11-12T08:16:02.290Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-11-12T08:16:02.290Z] Wiping out workspace first.
[2026-11-12T08:16:02.310Z] Cloning the remote Git repository
[2026-11-12T08:16:02.311Z] Using shallow clone with depth 1
[2026-11-12T08:16:02.311Z] Avoid fetching tags
[2026-11-12T08:16:02.311Z] Honoring refspec on initial clone
[2026-11-12T08:16:02.311Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-11-12T08:16:02.311Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-cron@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-11-12T08:16:02.320Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-11-12T08:16:02.320Z]  > git --version # timeout=10
[2026-11-12T08:16:02.326Z]  > git --version # 'git version 2.52.0'
[2026-11-12T08:16:02.326Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-11-12T08:16:02.333Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-12T08:16:02.611Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-11-12T08:16:02.618Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-11-12T08:16:02.626Z] Avoid second fetch
[2026-11-12T08:16:02.626Z] Checking out Revision fd5667069c7b69778ce97df718cf25626f5beefc (main)
[2026-11-12T08:16:02.626Z]  > git config core.sparsecheckout # timeout=10
[2026-11-12T08:16:02.633Z]  > git checkout -f fd5667069c7b69778ce97df718cf25626f5beefc # timeout=10
[2026-11-12T08:16:02.671Z] Commit message: "pipelines: fix ansible managed update pipelines to process all nodes in parallel"
[2026-11-12T08:16:02.867Z] [Pipeline] Start of Pipeline
[2026-11-12T08:16:02.962Z] [Pipeline] node
[2026-11-12T08:16:03.074Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron
[2026-11-12T08:16:03.075Z] [Pipeline] {
[2026-11-12T08:16:03.084Z] [Pipeline] stage
[2026-11-12T08:16:03.084Z] [Pipeline] { (Setup build env)
[2026-11-12T08:16:03.094Z] [Pipeline] script
[2026-11-12T08:16:03.096Z] [Pipeline] {
[2026-11-12T08:16:03.100Z] [Pipeline] cleanWs
[2026-11-12T08:16:03.101Z] [WS-CLEANUP] Deleting project workspace...
[2026-11-12T08:16:03.101Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-11-12T08:16:03.102Z] [WS-CLEANUP] done
[2026-11-12T08:16:03.123Z] [Pipeline] lock
[2026-11-12T08:16:03.123Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-11-12T08:16:03.123Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-11-12T08:16:03.123Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT], resources: [MAINTENANCE LOCKOUT]
[2026-11-12T08:16:03.124Z] [Pipeline] {
[2026-11-12T08:16:03.126Z] [Pipeline] }
[2026-11-12T08:16:03.126Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT], resources: [MAINTENANCE LOCKOUT]
[2026-11-12T08:16:03.129Z] [Pipeline] // lock
[2026-11-12T08:16:03.132Z] [Pipeline] }
[2026-11-12T08:16:03.134Z] [Pipeline] // script
[2026-11-12T08:16:03.136Z] [Pipeline] }
[2026-11-12T08:16:03.138Z] [Pipeline] // stage
[2026-11-12T08:16:03.141Z] [Pipeline] stage
[2026-11-12T08:16:03.141Z] [Pipeline] { (Update repos and cache)
[2026-11-12T08:16:03.147Z] [Pipeline] parallel
[2026-11-12T08:16:03.147Z] [Pipeline] { (Branch: anvil build cache)
[2026-11-12T08:16:03.147Z] [Pipeline] { (Branch: anvil build dep repos)
[2026-11-12T08:16:03.151Z] [Pipeline] stage
[2026-11-12T08:16:03.151Z] [Pipeline] { (anvil build cache)
[2026-11-12T08:16:03.152Z] [Pipeline] stage
[2026-11-12T08:16:03.152Z] [Pipeline] { (anvil build dep repos)
[2026-11-12T08:16:03.160Z] [Pipeline] script
[2026-11-12T08:16:03.161Z] [Pipeline] {
[2026-11-12T08:16:03.161Z] [Pipeline] script
[2026-11-12T08:16:03.162Z] [Pipeline] {
[2026-11-12T08:16:03.175Z] [Pipeline] build
[2026-11-12T08:16:03.176Z] Scheduling project: anvil » anvil-build-cache
[2026-11-12T08:16:03.177Z] [Pipeline] build
[2026-11-12T08:16:03.177Z] Scheduling project: anvil » anvil-build-dep-repos » main
[2026-11-12T08:16:11.778Z] Starting building: anvil » anvil-build-dep-repos » main #227
[2026-11-12T08:16:11.778Z] Starting building: anvil » anvil-build-cache #792
[2026-11-12T08:16:11.779Z] [Pipeline] waitForBuild
[2026-11-12T08:16:11.779Z] Waiting for anvil » anvil-build-dep-repos » main #227 to complete
[2026-11-12T08:16:11.783Z] [Pipeline] waitForBuild
[2026-11-12T08:16:11.783Z] Waiting for anvil » anvil-build-cache #792 to complete
[2026-11-12T08:38:59.218Z] Build anvil » anvil-build-cache #792 completed: SUCCESS
[2026-11-12T08:38:59.220Z] [Pipeline] }
[2026-11-12T08:38:59.223Z] [Pipeline] // script
[2026-11-12T08:38:59.227Z] [Pipeline] }
[2026-11-12T08:38:59.231Z] [Pipeline] // stage
[2026-11-12T08:38:59.233Z] [Pipeline] }
[2026-11-12T08:39:09.561Z] Build anvil » anvil-build-dep-repos » main #227 completed: SUCCESS
[2026-11-12T08:39:09.563Z] [Pipeline] }
[2026-11-12T08:39:09.565Z] [Pipeline] // script
[2026-11-12T08:39:09.568Z] [Pipeline] }
[2026-11-12T08:39:09.570Z] [Pipeline] // stage
[2026-11-12T08:39:09.572Z] [Pipeline] }
[2026-11-12T08:39:09.574Z] [Pipeline] // parallel
[2026-11-12T08:39:09.577Z] [Pipeline] }
[2026-11-12T08:39:09.579Z] [Pipeline] // stage
[2026-11-12T08:39:09.582Z] [Pipeline] stage
[2026-11-12T08:39:09.582Z] [Pipeline] { (Update kernel modules)
[2026-11-12T08:39:09.588Z] [Pipeline] parallel
[2026-11-12T08:39:09.588Z] [Pipeline] { (Branch: anvil build all kmods)
[2026-11-12T08:39:09.592Z] [Pipeline] stage
[2026-11-12T08:39:09.592Z] [Pipeline] { (anvil build all kmods)
[2026-11-12T08:39:09.599Z] [Pipeline] script
[2026-11-12T08:39:09.602Z] [Pipeline] {
[2026-11-12T08:39:09.605Z] [Pipeline] build
[2026-11-12T08:39:09.605Z] Scheduling project: anvil » anvil-build-all-kmods
[2026-11-12T08:39:14.958Z] Starting building: anvil » anvil-build-all-kmods #723
[2026-11-12T08:39:14.960Z] [Pipeline] waitForBuild
[2026-11-12T08:39:14.961Z] Waiting for anvil » anvil-build-all-kmods #723 to complete
[2026-11-12T08:48:32.567Z] Build anvil » anvil-build-all-kmods #723 completed: SUCCESS
[2026-11-12T08:48:32.570Z] [Pipeline] }
[2026-11-12T08:48:32.573Z] [Pipeline] // script
[2026-11-12T08:48:32.575Z] [Pipeline] }
[2026-11-12T08:48:32.578Z] [Pipeline] // stage
[2026-11-12T08:48:32.581Z] [Pipeline] }
[2026-11-12T08:48:32.585Z] [Pipeline] // parallel
[2026-11-12T08:48:32.587Z] [Pipeline] }
[2026-11-12T08:48:32.589Z] [Pipeline] // stage
[2026-11-12T08:48:32.592Z] [Pipeline] stage
[2026-11-12T08:48:32.593Z] [Pipeline] { (Run daily functional testing)
[2026-11-12T08:48:32.598Z] [Pipeline] parallel
[2026-11-12T08:48:32.599Z] [Pipeline] { (Branch: almalinux-9 ci ci)
[2026-11-12T08:48:32.599Z] [Pipeline] { (Branch: rhel-9 ci ci)
[2026-11-12T08:48:32.599Z] [Pipeline] { (Branch: almalinux-9 enterprise none)
[2026-11-12T08:48:32.599Z] [Pipeline] { (Branch: rhel-9 enterprise none)
[2026-11-12T08:48:32.599Z] [Pipeline] { (Branch: almalinux-9 enterprise-staging none)
[2026-11-12T08:48:32.599Z] [Pipeline] { (Branch: rhel-9 enterprise-staging none)
[2026-11-12T08:48:32.607Z] [Pipeline] stage
[2026-11-12T08:48:32.607Z] [Pipeline] { (almalinux-9 ci ci)
[2026-11-12T08:48:32.607Z] [Pipeline] stage
[2026-11-12T08:48:32.608Z] [Pipeline] { (rhel-9 ci ci)
[2026-11-12T08:48:32.608Z] [Pipeline] stage
[2026-11-12T08:48:32.609Z] [Pipeline] { (almalinux-9 enterprise none)
[2026-11-12T08:48:32.609Z] [Pipeline] stage
[2026-11-12T08:48:32.609Z] [Pipeline] { (rhel-9 enterprise none)
[2026-11-12T08:48:32.610Z] [Pipeline] stage
[2026-11-12T08:48:32.610Z] [Pipeline] { (almalinux-9 enterprise-staging none)
[2026-11-12T08:48:32.611Z] [Pipeline] stage
[2026-11-12T08:48:32.611Z] [Pipeline] { (rhel-9 enterprise-staging none)
[2026-11-12T08:48:32.627Z] [Pipeline] script
[2026-11-12T08:48:32.629Z] [Pipeline] {
[2026-11-12T08:48:32.629Z] [Pipeline] script
[2026-11-12T08:48:32.630Z] [Pipeline] {
[2026-11-12T08:48:32.631Z] [Pipeline] script
[2026-11-12T08:48:32.632Z] [Pipeline] {
[2026-11-12T08:48:32.633Z] [Pipeline] script
[2026-11-12T08:48:32.633Z] [Pipeline] {
[2026-11-12T08:48:32.634Z] [Pipeline] script
[2026-11-12T08:48:32.635Z] [Pipeline] {
[2026-11-12T08:48:32.636Z] [Pipeline] script
[2026-11-12T08:48:32.636Z] [Pipeline] {
[2026-11-12T08:48:32.641Z] [Pipeline] build
[2026-11-12T08:48:32.641Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-11-12T08:48:32.643Z] [Pipeline] build
[2026-11-12T08:48:32.643Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-11-12T08:48:32.644Z] [Pipeline] build
[2026-11-12T08:48:32.645Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-11-12T08:48:32.646Z] [Pipeline] build
[2026-11-12T08:48:32.646Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-11-12T08:48:32.647Z] [Pipeline] build
[2026-11-12T08:48:32.648Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-11-12T08:48:32.649Z] [Pipeline] build
[2026-11-12T08:48:32.649Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-11-12T08:48:38.907Z] Starting building: anvil » anvil-build-functional-testing #1539
[2026-11-12T08:48:38.907Z] Starting building: anvil » anvil-build-functional-testing #1538
[2026-11-12T08:48:38.908Z] Starting building: anvil » anvil-build-functional-testing #1537
[2026-11-12T08:48:38.908Z] Starting building: anvil » anvil-build-functional-testing #1540
[2026-11-12T08:48:38.908Z] [Pipeline] waitForBuild
[2026-11-12T08:48:38.908Z] Waiting for anvil » anvil-build-functional-testing #1539 to complete
[2026-11-12T08:48:38.909Z] Starting building: anvil » anvil-build-functional-testing #1542
[2026-11-12T08:48:38.910Z] Starting building: anvil » anvil-build-functional-testing #1541
[2026-11-12T08:48:38.916Z] [Pipeline] waitForBuild
[2026-11-12T08:48:38.917Z] Waiting for anvil » anvil-build-functional-testing #1537 to complete
[2026-11-12T08:48:38.918Z] [Pipeline] waitForBuild
[2026-11-12T08:48:38.918Z] Waiting for anvil » anvil-build-functional-testing #1538 to complete
[2026-11-12T08:48:38.919Z] [Pipeline] waitForBuild
[2026-11-12T08:48:38.919Z] Waiting for anvil » anvil-build-functional-testing #1540 to complete
[2026-11-12T08:48:38.926Z] [Pipeline] waitForBuild
[2026-11-12T08:48:38.926Z] Waiting for anvil » anvil-build-functional-testing #1541 to complete
[2026-11-12T08:48:38.927Z] [Pipeline] waitForBuild
[2026-11-12T08:48:38.927Z] Waiting for anvil » anvil-build-functional-testing #1542 to complete
[2026-11-12T11:15:42.714Z] Build anvil » anvil-build-functional-testing #1539 completed: SUCCESS
[2026-11-12T11:15:42.717Z] [Pipeline] }
[2026-11-12T11:15:42.720Z] [Pipeline] // script
[2026-11-12T11:15:42.722Z] [Pipeline] }
[2026-11-12T11:15:42.725Z] [Pipeline] // stage
[2026-11-12T11:15:42.728Z] [Pipeline] }
[2026-11-12T11:15:59.243Z] Build anvil » anvil-build-functional-testing #1542 completed: SUCCESS
[2026-11-12T11:15:59.245Z] [Pipeline] }
[2026-11-12T11:15:59.247Z] [Pipeline] // script
[2026-11-12T11:15:59.250Z] [Pipeline] }
[2026-11-12T11:15:59.253Z] [Pipeline] // stage
[2026-11-12T11:15:59.255Z] [Pipeline] }
[2026-11-12T11:40:13.704Z] Build anvil » anvil-build-functional-testing #1540 completed: SUCCESS
[2026-11-12T11:40:13.706Z] [Pipeline] }
[2026-11-12T11:40:13.708Z] [Pipeline] // script
[2026-11-12T11:40:13.711Z] [Pipeline] }
[2026-11-12T11:40:13.713Z] [Pipeline] // stage
[2026-11-12T11:40:13.718Z] [Pipeline] }
[2026-11-12T11:43:47.753Z] Build anvil » anvil-build-functional-testing #1537 completed: SUCCESS
[2026-11-12T11:43:47.755Z] [Pipeline] }
[2026-11-12T11:43:47.757Z] [Pipeline] // script
[2026-11-12T11:43:47.760Z] [Pipeline] }
[2026-11-12T11:43:47.762Z] [Pipeline] // stage
[2026-11-12T11:43:47.764Z] [Pipeline] }
[2026-11-12T12:08:21.489Z] Build anvil » anvil-build-functional-testing #1538 completed: SUCCESS
[2026-11-12T12:08:21.491Z] [Pipeline] }
[2026-11-12T12:08:21.493Z] [Pipeline] // script
[2026-11-12T12:08:21.495Z] [Pipeline] }
[2026-11-12T12:08:21.498Z] [Pipeline] // stage
[2026-11-12T12:08:21.500Z] [Pipeline] }
[2026-11-12T14:47:40.880Z] Build anvil » anvil-build-functional-testing #1541 completed: ABORTED
[2026-11-12T14:47:40.882Z] [Pipeline] catchError
[2026-11-12T14:47:40.883Z] [Pipeline] {
[2026-11-12T14:47:40.893Z] [Pipeline] sh
[2026-11-12T14:47:41.151Z] [Pipeline] }
[2026-11-12T14:47:41.151Z] ERROR: script returned exit code 1
[2026-11-12T14:47:41.151Z] Setting overall build result to FAILURE
[2026-11-12T14:47:41.154Z] [Pipeline] // catchError
[2026-11-12T14:47:41.157Z] [Pipeline] }
[2026-11-12T14:47:41.159Z] [Pipeline] // script
[2026-11-12T14:47:41.162Z] [Pipeline] }
[2026-11-12T14:47:41.164Z] [Pipeline] // stage
[2026-11-12T14:47:41.166Z] [Pipeline] }
[2026-11-12T14:47:41.168Z] [Pipeline] // parallel
[2026-11-12T14:47:41.170Z] [Pipeline] }
[2026-11-12T14:47:41.173Z] [Pipeline] // stage
[2026-11-12T14:47:41.176Z] [Pipeline] stage
[2026-11-12T14:47:41.176Z] [Pipeline] { (Declarative: Post Actions)
[2026-11-12T14:47:41.193Z] [Pipeline] stage
[2026-11-12T14:47:41.193Z] [Pipeline] { (Copying logs)
[2026-11-12T14:47:41.227Z] [Pipeline] node
[2026-11-12T14:47:41.327Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron@2
[2026-11-12T14:47:41.328Z] [Pipeline] {
[2026-11-12T14:47:41.370Z] [Pipeline] node
[2026-11-12T14:47:41.465Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron@3
[2026-11-12T14:47:41.466Z] [Pipeline] {
[2026-11-12T14:47:41.470Z] [Pipeline] sh
[2026-11-12T14:47:41.726Z] + mkdir -p /var/lib/jenkins/locks
[2026-11-12T14:47:41.735Z] [Pipeline] echo
[2026-11-12T14:47:41.735Z] RWLock: FD for lock log_archive in stage projectFinishUp is 649
[2026-11-12T14:47:41.738Z] [Pipeline] sleep
[2026-11-12T14:47:41.738Z] No need to sleep any longer
[2026-11-12T14:47:41.741Z] [Pipeline] echo
[2026-11-12T14:47:41.741Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-11-12T14:47:41.744Z] [Pipeline] }
[2026-11-12T14:47:41.747Z] [Pipeline] // node
[2026-11-12T14:47:41.752Z] [Pipeline] echo
[2026-11-12T14:47:41.752Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-cron/223/
[2026-11-12T14:47:41.753Z] [Pipeline] sh
[2026-11-12T14:47:42.008Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-cron/223/
[2026-11-12T14:47:42.010Z] [Pipeline] sh