[2026-09-20T08:16:00.265Z] Started by timer
[2026-09-20T08:16:00.763Z] Obtained pipelines/projects/anvil/build-cron/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-09-20T08:16:00.782Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-09-20T08:16:01.161Z] Examining kronosnet/ci-tools
[2026-09-20T08:16:01.161Z] Attempting to resolve main as a branch
[2026-09-20T08:16:01.316Z] Resolved main as branch main at revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879
[2026-09-20T08:16:01.317Z] Selected Git installation does not exist. Using Default
[2026-09-20T08:16:01.317Z] The recommended git tool is: NONE
[2026-09-20T08:16:01.317Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-09-20T08:16:01.320Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-09-20T08:16:01.320Z] Wiping out workspace first.
[2026-09-20T08:16:01.344Z] Cloning the remote Git repository
[2026-09-20T08:16:01.344Z] Using shallow clone with depth 1
[2026-09-20T08:16:01.344Z] Avoid fetching tags
[2026-09-20T08:16:01.344Z] Honoring refspec on initial clone
[2026-09-20T08:16:01.345Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:16:01.345Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-cron@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-09-20T08:16:01.354Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:16:01.354Z]  > git --version # timeout=10
[2026-09-20T08:16:01.361Z]  > git --version # 'git version 2.52.0'
[2026-09-20T08:16:01.361Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-09-20T08:16:01.368Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:16:02.189Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-09-20T08:16:02.197Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:16:02.206Z] Avoid second fetch
[2026-09-20T08:16:02.206Z] Checking out Revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879 (main)
[2026-09-20T08:16:02.206Z]  > git config core.sparsecheckout # timeout=10
[2026-09-20T08:16:02.214Z]  > git checkout -f 10ba49ff26b0e424c550d2fed1e2a22a6160f879 # timeout=10
[2026-09-20T08:16:02.257Z] Commit message: "fn-testing: stop using gcloud directly"
[2026-09-20T08:16:02.268Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-09-20T08:16:02.454Z] Examining kronosnet/ci-tools
[2026-09-20T08:16:02.454Z] Attempting to resolve main as a branch
[2026-09-20T08:16:02.608Z] Resolved main as branch main at revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879
[2026-09-20T08:16:02.608Z] Selected Git installation does not exist. Using Default
[2026-09-20T08:16:02.608Z] The recommended git tool is: NONE
[2026-09-20T08:16:02.609Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-09-20T08:16:02.612Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-09-20T08:16:02.612Z] Wiping out workspace first.
[2026-09-20T08:16:02.630Z] Cloning the remote Git repository
[2026-09-20T08:16:02.630Z] Using shallow clone with depth 1
[2026-09-20T08:16:02.630Z] Avoid fetching tags
[2026-09-20T08:16:02.630Z] Honoring refspec on initial clone
[2026-09-20T08:16:02.631Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:16:02.631Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-cron@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-09-20T08:16:02.641Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-09-20T08:16:02.641Z]  > git --version # timeout=10
[2026-09-20T08:16:02.650Z]  > git --version # 'git version 2.52.0'
[2026-09-20T08:16:02.650Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-09-20T08:16:02.657Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:16:03.434Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-09-20T08:16:03.441Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-09-20T08:16:03.448Z] Avoid second fetch
[2026-09-20T08:16:03.449Z] Checking out Revision 10ba49ff26b0e424c550d2fed1e2a22a6160f879 (main)
[2026-09-20T08:16:03.449Z]  > git config core.sparsecheckout # timeout=10
[2026-09-20T08:16:03.455Z]  > git checkout -f 10ba49ff26b0e424c550d2fed1e2a22a6160f879 # timeout=10
[2026-09-20T08:16:03.489Z] Commit message: "fn-testing: stop using gcloud directly"
[2026-09-20T08:16:03.545Z] [Pipeline] Start of Pipeline
[2026-09-20T08:16:03.641Z] [Pipeline] node
[2026-09-20T08:16:04.002Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron
[2026-09-20T08:16:04.002Z] [Pipeline] {
[2026-09-20T08:16:04.012Z] [Pipeline] stage
[2026-09-20T08:16:04.012Z] [Pipeline] { (Setup build env)
[2026-09-20T08:16:04.021Z] [Pipeline] script
[2026-09-20T08:16:04.024Z] [Pipeline] {
[2026-09-20T08:16:04.028Z] [Pipeline] cleanWs
[2026-09-20T08:16:04.031Z] [WS-CLEANUP] Deleting project workspace...
[2026-09-20T08:16:04.031Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-09-20T08:16:04.031Z] [WS-CLEANUP] done
[2026-09-20T08:16:04.051Z] [Pipeline] lock
[2026-09-20T08:16:04.051Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-09-20T08:16:04.051Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-09-20T08:16:04.052Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-09-20T08:16:04.052Z] [Pipeline] {
[2026-09-20T08:16:04.054Z] [Pipeline] }
[2026-09-20T08:16:04.054Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-09-20T08:16:04.056Z] [Pipeline] // lock
[2026-09-20T08:16:04.060Z] [Pipeline] }
[2026-09-20T08:16:04.062Z] [Pipeline] // script
[2026-09-20T08:16:04.064Z] [Pipeline] }
[2026-09-20T08:16:04.066Z] [Pipeline] // stage
[2026-09-20T08:16:04.069Z] [Pipeline] stage
[2026-09-20T08:16:04.070Z] [Pipeline] { (Update repos and cache)
[2026-09-20T08:16:04.077Z] [Pipeline] parallel
[2026-09-20T08:16:04.077Z] [Pipeline] { (Branch: anvil build cache)
[2026-09-20T08:16:04.077Z] [Pipeline] { (Branch: anvil build dep repos)
[2026-09-20T08:16:04.082Z] [Pipeline] stage
[2026-09-20T08:16:04.082Z] [Pipeline] { (anvil build cache)
[2026-09-20T08:16:04.083Z] [Pipeline] stage
[2026-09-20T08:16:04.083Z] [Pipeline] { (anvil build dep repos)
[2026-09-20T08:16:04.091Z] [Pipeline] script
[2026-09-20T08:16:04.092Z] [Pipeline] {
[2026-09-20T08:16:04.093Z] [Pipeline] script
[2026-09-20T08:16:04.094Z] [Pipeline] {
[2026-09-20T08:16:04.108Z] [Pipeline] build
[2026-09-20T08:16:04.108Z] Scheduling project: anvil » anvil-build-cache
[2026-09-20T08:16:04.565Z] [Pipeline] build
[2026-09-20T08:16:04.565Z] Scheduling project: anvil » anvil-build-dep-repos » main
[2026-09-20T08:16:10.783Z] Starting building: anvil » anvil-build-cache #740
[2026-09-20T08:16:10.783Z] Starting building: anvil » anvil-build-dep-repos » main #175
[2026-09-20T08:16:10.784Z] [Pipeline] waitForBuild
[2026-09-20T08:16:10.784Z] Waiting for anvil » anvil-build-cache #740 to complete
[2026-09-20T08:16:10.793Z] [Pipeline] waitForBuild
[2026-09-20T08:16:10.794Z] Waiting for anvil » anvil-build-dep-repos » main #175 to complete
[2026-09-20T08:39:40.192Z] Build anvil » anvil-build-cache #740 completed: SUCCESS
[2026-09-20T08:39:40.195Z] [Pipeline] }
[2026-09-20T08:39:40.199Z] [Pipeline] // script
[2026-09-20T08:39:40.202Z] [Pipeline] }
[2026-09-20T08:39:40.205Z] [Pipeline] // stage
[2026-09-20T08:39:40.209Z] [Pipeline] }
[2026-09-20T08:39:59.923Z] Build anvil » anvil-build-dep-repos » main #175 completed: SUCCESS
[2026-09-20T08:39:59.925Z] [Pipeline] }
[2026-09-20T08:39:59.928Z] [Pipeline] // script
[2026-09-20T08:39:59.931Z] [Pipeline] }
[2026-09-20T08:39:59.933Z] [Pipeline] // stage
[2026-09-20T08:39:59.935Z] [Pipeline] }
[2026-09-20T08:39:59.937Z] [Pipeline] // parallel
[2026-09-20T08:39:59.940Z] [Pipeline] }
[2026-09-20T08:39:59.942Z] [Pipeline] // stage
[2026-09-20T08:39:59.946Z] [Pipeline] stage
[2026-09-20T08:39:59.946Z] [Pipeline] { (Update kernel modules)
[2026-09-20T08:39:59.952Z] [Pipeline] parallel
[2026-09-20T08:39:59.952Z] [Pipeline] { (Branch: anvil build all kmods)
[2026-09-20T08:39:59.956Z] [Pipeline] stage
[2026-09-20T08:39:59.956Z] [Pipeline] { (anvil build all kmods)
[2026-09-20T08:39:59.963Z] [Pipeline] script
[2026-09-20T08:39:59.966Z] [Pipeline] {
[2026-09-20T08:39:59.970Z] [Pipeline] build
[2026-09-20T08:39:59.970Z] Scheduling project: anvil » anvil-build-all-kmods
[2026-09-20T08:40:10.905Z] Starting building: anvil » anvil-build-all-kmods #671
[2026-09-20T08:40:10.908Z] [Pipeline] waitForBuild
[2026-09-20T08:40:10.908Z] Waiting for anvil » anvil-build-all-kmods #671 to complete
[2026-09-20T08:48:50.077Z] Build anvil » anvil-build-all-kmods #671 completed: SUCCESS
[2026-09-20T08:48:50.078Z] [Pipeline] }
[2026-09-20T08:48:50.081Z] [Pipeline] // script
[2026-09-20T08:48:50.083Z] [Pipeline] }
[2026-09-20T08:48:50.085Z] [Pipeline] // stage
[2026-09-20T08:48:50.087Z] [Pipeline] }
[2026-09-20T08:48:50.090Z] [Pipeline] // parallel
[2026-09-20T08:48:50.092Z] [Pipeline] }
[2026-09-20T08:48:50.094Z] [Pipeline] // stage
[2026-09-20T08:48:50.097Z] [Pipeline] stage
[2026-09-20T08:48:50.097Z] [Pipeline] { (Run daily functional testing)
[2026-09-20T08:48:50.103Z] [Pipeline] parallel
[2026-09-20T08:48:50.103Z] [Pipeline] { (Branch: almalinux-9 ci ci)
[2026-09-20T08:48:50.103Z] [Pipeline] { (Branch: rhel-9 ci ci)
[2026-09-20T08:48:50.103Z] [Pipeline] { (Branch: almalinux-9 enterprise none)
[2026-09-20T08:48:50.103Z] [Pipeline] { (Branch: rhel-9 enterprise none)
[2026-09-20T08:48:50.104Z] [Pipeline] { (Branch: almalinux-9 enterprise-staging none)
[2026-09-20T08:48:50.104Z] [Pipeline] { (Branch: rhel-9 enterprise-staging none)
[2026-09-20T08:48:50.111Z] [Pipeline] stage
[2026-09-20T08:48:50.112Z] [Pipeline] { (almalinux-9 ci ci)
[2026-09-20T08:48:50.112Z] [Pipeline] stage
[2026-09-20T08:48:50.113Z] [Pipeline] { (rhel-9 ci ci)
[2026-09-20T08:48:50.113Z] [Pipeline] stage
[2026-09-20T08:48:50.113Z] [Pipeline] { (almalinux-9 enterprise none)
[2026-09-20T08:48:50.114Z] [Pipeline] stage
[2026-09-20T08:48:50.114Z] [Pipeline] { (rhel-9 enterprise none)
[2026-09-20T08:48:50.115Z] [Pipeline] stage
[2026-09-20T08:48:50.115Z] [Pipeline] { (almalinux-9 enterprise-staging none)
[2026-09-20T08:48:50.116Z] [Pipeline] stage
[2026-09-20T08:48:50.116Z] [Pipeline] { (rhel-9 enterprise-staging none)
[2026-09-20T08:48:50.132Z] [Pipeline] script
[2026-09-20T08:48:50.134Z] [Pipeline] {
[2026-09-20T08:48:50.134Z] [Pipeline] script
[2026-09-20T08:48:50.135Z] [Pipeline] {
[2026-09-20T08:48:50.136Z] [Pipeline] script
[2026-09-20T08:48:50.137Z] [Pipeline] {
[2026-09-20T08:48:50.138Z] [Pipeline] script
[2026-09-20T08:48:50.138Z] [Pipeline] {
[2026-09-20T08:48:50.139Z] [Pipeline] script
[2026-09-20T08:48:50.140Z] [Pipeline] {
[2026-09-20T08:48:50.141Z] [Pipeline] script
[2026-09-20T08:48:50.142Z] [Pipeline] {
[2026-09-20T08:48:50.146Z] [Pipeline] build
[2026-09-20T08:48:50.146Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-09-20T08:48:50.791Z] [Pipeline] build
[2026-09-20T08:48:50.791Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-09-20T08:48:51.053Z] [Pipeline] build
[2026-09-20T08:48:51.053Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-09-20T08:48:51.287Z] [Pipeline] build
[2026-09-20T08:48:51.288Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-09-20T08:48:51.297Z] [Pipeline] build
[2026-09-20T08:48:51.298Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-09-20T08:48:51.300Z] [Pipeline] build
[2026-09-20T08:48:51.300Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-09-20T08:48:56.005Z] Starting building: anvil » anvil-build-functional-testing #1225
[2026-09-20T08:48:56.008Z] [Pipeline] waitForBuild
[2026-09-20T08:48:56.008Z] Waiting for anvil » anvil-build-functional-testing #1225 to complete
[2026-09-20T08:48:59.438Z] Starting building: anvil » anvil-build-functional-testing #1229
[2026-09-20T08:48:59.439Z] Starting building: anvil » anvil-build-functional-testing #1230
[2026-09-20T08:48:59.439Z] Starting building: anvil » anvil-build-functional-testing #1228
[2026-09-20T08:48:59.439Z] Starting building: anvil » anvil-build-functional-testing #1226
[2026-09-20T08:48:59.439Z] Starting building: anvil » anvil-build-functional-testing #1227
[2026-09-20T08:48:59.449Z] [Pipeline] waitForBuild
[2026-09-20T08:48:59.450Z] Waiting for anvil » anvil-build-functional-testing #1229 to complete
[2026-09-20T08:48:59.458Z] [Pipeline] waitForBuild
[2026-09-20T08:48:59.458Z] Waiting for anvil » anvil-build-functional-testing #1226 to complete
[2026-09-20T08:48:59.460Z] [Pipeline] waitForBuild
[2026-09-20T08:48:59.460Z] Waiting for anvil » anvil-build-functional-testing #1227 to complete
[2026-09-20T08:48:59.461Z] [Pipeline] waitForBuild
[2026-09-20T08:48:59.461Z] Waiting for anvil » anvil-build-functional-testing #1228 to complete
[2026-09-20T08:48:59.462Z] [Pipeline] waitForBuild
[2026-09-20T08:48:59.462Z] Waiting for anvil » anvil-build-functional-testing #1230 to complete
[2026-09-20T11:13:35.935Z] Build anvil » anvil-build-functional-testing #1228 completed: SUCCESS
[2026-09-20T11:13:35.937Z] [Pipeline] }
[2026-09-20T11:13:35.940Z] [Pipeline] // script
[2026-09-20T11:13:35.944Z] [Pipeline] }
[2026-09-20T11:13:35.946Z] [Pipeline] // stage
[2026-09-20T11:13:35.949Z] [Pipeline] }
[2026-09-20T11:37:04.461Z] Build anvil » anvil-build-functional-testing #1226 completed: SUCCESS
[2026-09-20T11:37:04.464Z] [Pipeline] }
[2026-09-20T11:37:04.466Z] [Pipeline] // script
[2026-09-20T11:37:04.469Z] [Pipeline] }
[2026-09-20T11:37:04.471Z] [Pipeline] // stage
[2026-09-20T11:37:04.473Z] [Pipeline] }
[2026-09-20T11:37:19.131Z] Build anvil » anvil-build-functional-testing #1227 completed: SUCCESS
[2026-09-20T11:37:19.134Z] [Pipeline] }
[2026-09-20T11:37:19.136Z] [Pipeline] // script
[2026-09-20T11:37:19.139Z] [Pipeline] }
[2026-09-20T11:37:19.141Z] [Pipeline] // stage
[2026-09-20T11:37:19.143Z] [Pipeline] }
[2026-09-20T11:40:59.391Z] Build anvil » anvil-build-functional-testing #1230 completed: SUCCESS
[2026-09-20T11:40:59.392Z] [Pipeline] }
[2026-09-20T11:40:59.395Z] [Pipeline] // script
[2026-09-20T11:40:59.397Z] [Pipeline] }
[2026-09-20T11:40:59.400Z] [Pipeline] // stage
[2026-09-20T11:40:59.402Z] [Pipeline] }
[2026-09-20T11:42:04.159Z] Build anvil » anvil-build-functional-testing #1225 completed: SUCCESS
[2026-09-20T11:42:04.161Z] [Pipeline] }
[2026-09-20T11:42:04.164Z] [Pipeline] // script
[2026-09-20T11:42:04.166Z] [Pipeline] }
[2026-09-20T11:42:04.168Z] [Pipeline] // stage
[2026-09-20T11:42:04.171Z] [Pipeline] }
[2026-09-20T14:49:16.396Z] Build anvil » anvil-build-functional-testing #1229 completed: FAILURE
[2026-09-20T14:49:16.398Z] [Pipeline] catchError
[2026-09-20T14:49:16.399Z] [Pipeline] {
[2026-09-20T14:49:16.411Z] [Pipeline] sh
[2026-09-20T14:49:16.668Z] [Pipeline] }
[2026-09-20T14:49:16.669Z] ERROR: script returned exit code 1
[2026-09-20T14:49:16.669Z] Setting overall build result to FAILURE
[2026-09-20T14:49:16.671Z] [Pipeline] // catchError
[2026-09-20T14:49:16.674Z] [Pipeline] }
[2026-09-20T14:49:16.676Z] [Pipeline] // script
[2026-09-20T14:49:16.679Z] [Pipeline] }
[2026-09-20T14:49:16.681Z] [Pipeline] // stage
[2026-09-20T14:49:16.683Z] [Pipeline] }
[2026-09-20T14:49:16.685Z] [Pipeline] // parallel
[2026-09-20T14:49:16.688Z] [Pipeline] }
[2026-09-20T14:49:16.690Z] [Pipeline] // stage
[2026-09-20T14:49:16.693Z] [Pipeline] stage
[2026-09-20T14:49:16.694Z] [Pipeline] { (Declarative: Post Actions)
[2026-09-20T14:49:16.709Z] [Pipeline] stage
[2026-09-20T14:49:16.709Z] [Pipeline] { (Copying logs)
[2026-09-20T14:49:16.746Z] [Pipeline] node
[2026-09-20T14:49:16.856Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron@2
[2026-09-20T14:49:16.857Z] [Pipeline] {
[2026-09-20T14:49:16.891Z] [Pipeline] node
[2026-09-20T14:49:16.991Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron@3
[2026-09-20T14:49:16.992Z] [Pipeline] {
[2026-09-20T14:49:16.995Z] [Pipeline] sh
[2026-09-20T14:49:17.251Z] + mkdir -p /var/lib/jenkins/locks
[2026-09-20T14:49:17.259Z] [Pipeline] echo
[2026-09-20T14:49:17.260Z] RWLock: FD for lock log_archive in stage projectFinishUp is 400
[2026-09-20T14:49:17.263Z] [Pipeline] sleep
[2026-09-20T14:49:17.263Z] No need to sleep any longer
[2026-09-20T14:49:17.266Z] [Pipeline] echo
[2026-09-20T14:49:17.266Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-09-20T14:49:17.269Z] [Pipeline] }
[2026-09-20T14:49:17.271Z] [Pipeline] // node
[2026-09-20T14:49:17.275Z] [Pipeline] echo
[2026-09-20T14:49:17.275Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-cron/171/
[2026-09-20T14:49:17.276Z] [Pipeline] sh
[2026-09-20T14:49:17.531Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-cron/171/
[2026-09-20T14:49:17.533Z] [Pipeline] sh