[2026-07-29T08:16:00.220Z] Started by timer
[2026-07-29T08:16:00.544Z] Obtained pipelines/projects/anvil/build-cron/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-07-29T08:16:00.569Z] Loading library ProjectLib@main:pipelines/projects/anvil/
[2026-07-29T08:16:01.200Z] Examining kronosnet/ci-tools
[2026-07-29T08:16:01.200Z] Attempting to resolve main as a branch
[2026-07-29T08:16:01.378Z] Resolved main as branch main at revision 6ce0407511838a0f53db0a9d55a27373f67bb79b
[2026-07-29T08:16:01.380Z] Selected Git installation does not exist. Using Default
[2026-07-29T08:16:01.380Z] The recommended git tool is: NONE
[2026-07-29T08:16:01.380Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-07-29T08:16:01.385Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-07-29T08:16:01.385Z] Wiping out workspace first.
[2026-07-29T08:16:01.409Z] Cloning the remote Git repository
[2026-07-29T08:16:01.409Z] Using shallow clone with depth 1
[2026-07-29T08:16:01.409Z] Avoid fetching tags
[2026-07-29T08:16:01.409Z] Honoring refspec on initial clone
[2026-07-29T08:16:01.410Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-07-29T08:16:01.410Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-cron@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-07-29T08:16:01.420Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-07-29T08:16:01.420Z]  > git --version # timeout=10
[2026-07-29T08:16:01.426Z]  > git --version # 'git version 2.52.0'
[2026-07-29T08:16:01.426Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-07-29T08:16:01.433Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-29T08:16:01.918Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-07-29T08:16:01.925Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-29T08:16:01.932Z] Avoid second fetch
[2026-07-29T08:16:01.933Z] Checking out Revision 6ce0407511838a0f53db0a9d55a27373f67bb79b (main)
[2026-07-29T08:16:01.933Z]  > git config core.sparsecheckout # timeout=10
[2026-07-29T08:16:01.939Z]  > git checkout -f 6ce0407511838a0f53db0a9d55a27373f67bb79b # timeout=10
[2026-07-29T08:16:01.973Z] Commit message: "all-weekly/reinstall-all: call the multibranch/main versions now they are in gitlab and not pagure"
[2026-07-29T08:16:01.981Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-07-29T08:16:02.205Z] Examining kronosnet/ci-tools
[2026-07-29T08:16:02.205Z] Attempting to resolve main as a branch
[2026-07-29T08:16:02.361Z] Resolved main as branch main at revision 6ce0407511838a0f53db0a9d55a27373f67bb79b
[2026-07-29T08:16:02.361Z] Selected Git installation does not exist. Using Default
[2026-07-29T08:16:02.361Z] The recommended git tool is: NONE
[2026-07-29T08:16:02.361Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-07-29T08:16:02.364Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-07-29T08:16:02.364Z] Wiping out workspace first.
[2026-07-29T08:16:02.382Z] Cloning the remote Git repository
[2026-07-29T08:16:02.382Z] Using shallow clone with depth 1
[2026-07-29T08:16:02.382Z] Avoid fetching tags
[2026-07-29T08:16:02.382Z] Honoring refspec on initial clone
[2026-07-29T08:16:02.382Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-07-29T08:16:02.383Z]  > git init /var/lib/jenkins/workspace/anvil/anvil-build-cron@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-07-29T08:16:02.392Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-07-29T08:16:02.392Z]  > git --version # timeout=10
[2026-07-29T08:16:02.399Z]  > git --version # 'git version 2.52.0'
[2026-07-29T08:16:02.399Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-07-29T08:16:02.404Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-29T08:16:02.895Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-07-29T08:16:02.903Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-07-29T08:16:02.911Z] Avoid second fetch
[2026-07-29T08:16:02.911Z] Checking out Revision 6ce0407511838a0f53db0a9d55a27373f67bb79b (main)
[2026-07-29T08:16:02.911Z]  > git config core.sparsecheckout # timeout=10
[2026-07-29T08:16:02.918Z]  > git checkout -f 6ce0407511838a0f53db0a9d55a27373f67bb79b # timeout=10
[2026-07-29T08:16:02.949Z] Commit message: "all-weekly/reinstall-all: call the multibranch/main versions now they are in gitlab and not pagure"
[2026-07-29T08:16:03.329Z] [Pipeline] Start of Pipeline
[2026-07-29T08:16:03.498Z] [Pipeline] node
[2026-07-29T08:16:03.604Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron
[2026-07-29T08:16:03.604Z] [Pipeline] {
[2026-07-29T08:16:03.618Z] [Pipeline] stage
[2026-07-29T08:16:03.618Z] [Pipeline] { (Setup build env)
[2026-07-29T08:16:03.630Z] [Pipeline] script
[2026-07-29T08:16:03.633Z] [Pipeline] {
[2026-07-29T08:16:03.637Z] [Pipeline] cleanWs
[2026-07-29T08:16:03.638Z] [WS-CLEANUP] Deleting project workspace...
[2026-07-29T08:16:03.638Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-07-29T08:16:03.639Z] [WS-CLEANUP] done
[2026-07-29T08:16:03.666Z] [Pipeline] lock
[2026-07-29T08:16:03.666Z] Trying to acquire lock on [Resource: MAINTENANCE LOCKOUT]
[2026-07-29T08:16:03.667Z] Resource [MAINTENANCE LOCKOUT] did not exist. Created.
[2026-07-29T08:16:03.667Z] Lock acquired on [Resource: MAINTENANCE LOCKOUT]
[2026-07-29T08:16:03.668Z] [Pipeline] {
[2026-07-29T08:16:03.670Z] [Pipeline] }
[2026-07-29T08:16:03.670Z] Lock released on resource [Resource: MAINTENANCE LOCKOUT]
[2026-07-29T08:16:03.672Z] [Pipeline] // lock
[2026-07-29T08:16:03.675Z] [Pipeline] }
[2026-07-29T08:16:03.678Z] [Pipeline] // script
[2026-07-29T08:16:03.680Z] [Pipeline] }
[2026-07-29T08:16:03.682Z] [Pipeline] // stage
[2026-07-29T08:16:03.685Z] [Pipeline] stage
[2026-07-29T08:16:03.685Z] [Pipeline] { (Update repos and cache)
[2026-07-29T08:16:03.691Z] [Pipeline] parallel
[2026-07-29T08:16:03.691Z] [Pipeline] { (Branch: anvil build cache)
[2026-07-29T08:16:03.691Z] [Pipeline] { (Branch: anvil build dep repos)
[2026-07-29T08:16:03.695Z] [Pipeline] stage
[2026-07-29T08:16:03.696Z] [Pipeline] { (anvil build cache)
[2026-07-29T08:16:03.696Z] [Pipeline] stage
[2026-07-29T08:16:03.697Z] [Pipeline] { (anvil build dep repos)
[2026-07-29T08:16:03.705Z] [Pipeline] script
[2026-07-29T08:16:03.706Z] [Pipeline] {
[2026-07-29T08:16:03.707Z] [Pipeline] script
[2026-07-29T08:16:03.708Z] [Pipeline] {
[2026-07-29T08:16:03.721Z] [Pipeline] build
[2026-07-29T08:16:03.722Z] Scheduling project: anvil » anvil-build-cache
[2026-07-29T08:16:03.723Z] [Pipeline] build
[2026-07-29T08:16:03.723Z] Scheduling project: anvil » anvil-build-dep-repos » main
[2026-07-29T08:16:10.673Z] Starting building: anvil » anvil-build-dep-repos » main #133
[2026-07-29T08:16:10.673Z] Starting building: anvil » anvil-build-cache #698
[2026-07-29T08:16:10.674Z] [Pipeline] waitForBuild
[2026-07-29T08:16:10.674Z] Waiting for anvil » anvil-build-dep-repos » main #133 to complete
[2026-07-29T08:16:10.680Z] [Pipeline] waitForBuild
[2026-07-29T08:16:10.680Z] Waiting for anvil » anvil-build-cache #698 to complete
[2026-07-29T08:36:06.118Z] Build anvil » anvil-build-cache #698 completed: SUCCESS
[2026-07-29T08:36:06.120Z] [Pipeline] }
[2026-07-29T08:36:06.123Z] [Pipeline] // script
[2026-07-29T08:36:06.125Z] [Pipeline] }
[2026-07-29T08:36:06.127Z] [Pipeline] // stage
[2026-07-29T08:36:06.130Z] [Pipeline] }
[2026-07-29T08:36:20.497Z] Build anvil » anvil-build-dep-repos » main #133 completed: SUCCESS
[2026-07-29T08:36:20.499Z] [Pipeline] }
[2026-07-29T08:36:20.502Z] [Pipeline] // script
[2026-07-29T08:36:20.504Z] [Pipeline] }
[2026-07-29T08:36:20.506Z] [Pipeline] // stage
[2026-07-29T08:36:20.509Z] [Pipeline] }
[2026-07-29T08:36:20.511Z] [Pipeline] // parallel
[2026-07-29T08:36:20.513Z] [Pipeline] }
[2026-07-29T08:36:20.515Z] [Pipeline] // stage
[2026-07-29T08:36:20.518Z] [Pipeline] stage
[2026-07-29T08:36:20.518Z] [Pipeline] { (Update kernel modules)
[2026-07-29T08:36:20.523Z] [Pipeline] parallel
[2026-07-29T08:36:20.523Z] [Pipeline] { (Branch: anvil build all kmods)
[2026-07-29T08:36:20.527Z] [Pipeline] stage
[2026-07-29T08:36:20.527Z] [Pipeline] { (anvil build all kmods)
[2026-07-29T08:36:20.533Z] [Pipeline] script
[2026-07-29T08:36:20.535Z] [Pipeline] {
[2026-07-29T08:36:20.538Z] [Pipeline] build
[2026-07-29T08:36:20.538Z] Scheduling project: anvil » anvil-build-all-kmods
[2026-07-29T08:36:26.084Z] Starting building: anvil » anvil-build-all-kmods #629
[2026-07-29T08:36:26.086Z] [Pipeline] waitForBuild
[2026-07-29T08:36:26.086Z] Waiting for anvil » anvil-build-all-kmods #629 to complete
[2026-07-29T08:45:41.719Z] Build anvil » anvil-build-all-kmods #629 completed: SUCCESS
[2026-07-29T08:45:41.721Z] [Pipeline] }
[2026-07-29T08:45:41.723Z] [Pipeline] // script
[2026-07-29T08:45:41.726Z] [Pipeline] }
[2026-07-29T08:45:41.728Z] [Pipeline] // stage
[2026-07-29T08:45:41.730Z] [Pipeline] }
[2026-07-29T08:45:41.732Z] [Pipeline] // parallel
[2026-07-29T08:45:41.735Z] [Pipeline] }
[2026-07-29T08:45:41.737Z] [Pipeline] // stage
[2026-07-29T08:45:41.740Z] [Pipeline] stage
[2026-07-29T08:45:41.740Z] [Pipeline] { (Run daily functional testing)
[2026-07-29T08:45:41.745Z] [Pipeline] parallel
[2026-07-29T08:45:41.745Z] [Pipeline] { (Branch: almalinux-9 ci ci)
[2026-07-29T08:45:41.746Z] [Pipeline] { (Branch: rhel-9 ci ci)
[2026-07-29T08:45:41.746Z] [Pipeline] { (Branch: almalinux-9 enterprise none)
[2026-07-29T08:45:41.746Z] [Pipeline] { (Branch: rhel-9 enterprise none)
[2026-07-29T08:45:41.746Z] [Pipeline] { (Branch: almalinux-9 enterprise-staging none)
[2026-07-29T08:45:41.746Z] [Pipeline] { (Branch: rhel-9 enterprise-staging none)
[2026-07-29T08:45:41.753Z] [Pipeline] stage
[2026-07-29T08:45:41.753Z] [Pipeline] { (almalinux-9 ci ci)
[2026-07-29T08:45:41.754Z] [Pipeline] stage
[2026-07-29T08:45:41.754Z] [Pipeline] { (rhel-9 ci ci)
[2026-07-29T08:45:41.755Z] [Pipeline] stage
[2026-07-29T08:45:41.755Z] [Pipeline] { (almalinux-9 enterprise none)
[2026-07-29T08:45:41.756Z] [Pipeline] stage
[2026-07-29T08:45:41.756Z] [Pipeline] { (rhel-9 enterprise none)
[2026-07-29T08:45:41.756Z] [Pipeline] stage
[2026-07-29T08:45:41.757Z] [Pipeline] { (almalinux-9 enterprise-staging none)
[2026-07-29T08:45:41.757Z] [Pipeline] stage
[2026-07-29T08:45:41.757Z] [Pipeline] { (rhel-9 enterprise-staging none)
[2026-07-29T08:45:41.772Z] [Pipeline] script
[2026-07-29T08:45:41.774Z] [Pipeline] {
[2026-07-29T08:45:41.774Z] [Pipeline] script
[2026-07-29T08:45:41.775Z] [Pipeline] {
[2026-07-29T08:45:41.776Z] [Pipeline] script
[2026-07-29T08:45:41.777Z] [Pipeline] {
[2026-07-29T08:45:41.778Z] [Pipeline] script
[2026-07-29T08:45:41.778Z] [Pipeline] {
[2026-07-29T08:45:41.779Z] [Pipeline] script
[2026-07-29T08:45:41.780Z] [Pipeline] {
[2026-07-29T08:45:41.781Z] [Pipeline] script
[2026-07-29T08:45:41.782Z] [Pipeline] {
[2026-07-29T08:45:41.786Z] [Pipeline] build
[2026-07-29T08:45:41.786Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-07-29T08:45:41.787Z] [Pipeline] build
[2026-07-29T08:45:41.788Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-07-29T08:45:41.789Z] [Pipeline] build
[2026-07-29T08:45:41.789Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-07-29T08:45:41.790Z] [Pipeline] build
[2026-07-29T08:45:41.790Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-07-29T08:45:41.791Z] [Pipeline] build
[2026-07-29T08:45:41.792Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-07-29T08:45:41.793Z] [Pipeline] build
[2026-07-29T08:45:41.793Z] Scheduling project: anvil » anvil-build-functional-testing
[2026-07-29T08:45:51.170Z] Starting building: anvil » anvil-build-functional-testing #962
[2026-07-29T08:45:51.170Z] Starting building: anvil » anvil-build-functional-testing #964
[2026-07-29T08:45:51.170Z] Starting building: anvil » anvil-build-functional-testing #961
[2026-07-29T08:45:51.171Z] Starting building: anvil » anvil-build-functional-testing #966
[2026-07-29T08:45:51.171Z] [Pipeline] waitForBuild
[2026-07-29T08:45:51.171Z] Starting building: anvil » anvil-build-functional-testing #963
[2026-07-29T08:45:51.171Z] Waiting for anvil » anvil-build-functional-testing #962 to complete
[2026-07-29T08:45:51.171Z] Starting building: anvil » anvil-build-functional-testing #965
[2026-07-29T08:45:51.188Z] [Pipeline] waitForBuild
[2026-07-29T08:45:51.188Z] Waiting for anvil » anvil-build-functional-testing #963 to complete
[2026-07-29T08:45:51.189Z] [Pipeline] waitForBuild
[2026-07-29T08:45:51.189Z] Waiting for anvil » anvil-build-functional-testing #964 to complete
[2026-07-29T08:45:51.190Z] [Pipeline] waitForBuild
[2026-07-29T08:45:51.190Z] Waiting for anvil » anvil-build-functional-testing #966 to complete
[2026-07-29T08:45:51.191Z] [Pipeline] waitForBuild
[2026-07-29T08:45:51.191Z] Waiting for anvil » anvil-build-functional-testing #961 to complete
[2026-07-29T08:45:51.192Z] [Pipeline] waitForBuild
[2026-07-29T08:45:51.192Z] Waiting for anvil » anvil-build-functional-testing #965 to complete
[2026-07-29T11:14:00.813Z] Build anvil » anvil-build-functional-testing #964 completed: SUCCESS
[2026-07-29T11:14:00.815Z] [Pipeline] }
[2026-07-29T11:14:00.818Z] [Pipeline] // script
[2026-07-29T11:14:00.820Z] [Pipeline] }
[2026-07-29T11:14:00.823Z] [Pipeline] // stage
[2026-07-29T11:14:00.826Z] [Pipeline] }
[2026-07-29T11:15:40.259Z] Build anvil » anvil-build-functional-testing #961 completed: SUCCESS
[2026-07-29T11:15:40.261Z] [Pipeline] }
[2026-07-29T11:15:40.263Z] [Pipeline] // script
[2026-07-29T11:15:40.266Z] [Pipeline] }
[2026-07-29T11:15:40.268Z] [Pipeline] // stage
[2026-07-29T11:15:40.272Z] [Pipeline] }
[2026-07-29T11:31:25.680Z] Build anvil » anvil-build-functional-testing #966 completed: SUCCESS
[2026-07-29T11:31:25.683Z] [Pipeline] }
[2026-07-29T11:31:25.685Z] [Pipeline] // script
[2026-07-29T11:31:25.687Z] [Pipeline] }
[2026-07-29T11:31:25.690Z] [Pipeline] // stage
[2026-07-29T11:31:25.692Z] [Pipeline] }
[2026-07-29T11:34:22.271Z] Build anvil » anvil-build-functional-testing #962 completed: SUCCESS
[2026-07-29T11:34:22.273Z] [Pipeline] }
[2026-07-29T11:34:22.276Z] [Pipeline] // script
[2026-07-29T11:34:22.278Z] [Pipeline] }
[2026-07-29T11:34:22.281Z] [Pipeline] // stage
[2026-07-29T11:34:22.283Z] [Pipeline] }
[2026-07-29T11:38:26.701Z] Build anvil » anvil-build-functional-testing #965 completed: SUCCESS
[2026-07-29T11:38:26.702Z] [Pipeline] }
[2026-07-29T11:38:26.705Z] [Pipeline] // script
[2026-07-29T11:38:26.707Z] [Pipeline] }
[2026-07-29T11:38:26.709Z] [Pipeline] // stage
[2026-07-29T11:38:26.711Z] [Pipeline] }
[2026-07-29T13:23:07.168Z] Build anvil » anvil-build-functional-testing #963 completed: FAILURE
[2026-07-29T13:23:07.170Z] [Pipeline] catchError
[2026-07-29T13:23:07.171Z] [Pipeline] {
[2026-07-29T13:23:07.183Z] [Pipeline] sh
[2026-07-29T13:23:07.439Z] [Pipeline] }
[2026-07-29T13:23:07.439Z] ERROR: script returned exit code 1
[2026-07-29T13:23:07.439Z] Setting overall build result to FAILURE
[2026-07-29T13:23:07.442Z] [Pipeline] // catchError
[2026-07-29T13:23:07.445Z] [Pipeline] }
[2026-07-29T13:23:07.447Z] [Pipeline] // script
[2026-07-29T13:23:07.450Z] [Pipeline] }
[2026-07-29T13:23:07.452Z] [Pipeline] // stage
[2026-07-29T13:23:07.454Z] [Pipeline] }
[2026-07-29T13:23:07.456Z] [Pipeline] // parallel
[2026-07-29T13:23:07.459Z] [Pipeline] }
[2026-07-29T13:23:07.461Z] [Pipeline] // stage
[2026-07-29T13:23:07.464Z] [Pipeline] stage
[2026-07-29T13:23:07.464Z] [Pipeline] { (Declarative: Post Actions)
[2026-07-29T13:23:07.480Z] [Pipeline] stage
[2026-07-29T13:23:07.480Z] [Pipeline] { (Copying logs)
[2026-07-29T13:23:07.512Z] [Pipeline] node
[2026-07-29T13:23:07.619Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron@2
[2026-07-29T13:23:07.619Z] [Pipeline] {
[2026-07-29T13:23:07.652Z] [Pipeline] node
[2026-07-29T13:23:07.757Z] Running on Jenkins in /var/lib/jenkins/workspace/anvil/anvil-build-cron@3
[2026-07-29T13:23:07.758Z] [Pipeline] {
[2026-07-29T13:23:07.761Z] [Pipeline] sh
[2026-07-29T13:23:08.016Z] + mkdir -p /var/lib/jenkins/locks
[2026-07-29T13:23:08.023Z] [Pipeline] echo
[2026-07-29T13:23:08.024Z] RWLock: FD for lock log_archive in stage projectFinishUp is 493
[2026-07-29T13:23:08.027Z] [Pipeline] sleep
[2026-07-29T13:23:08.027Z] No need to sleep any longer
[2026-07-29T13:23:08.030Z] [Pipeline] echo
[2026-07-29T13:23:08.030Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-07-29T13:23:08.033Z] [Pipeline] }
[2026-07-29T13:23:08.035Z] [Pipeline] // node
[2026-07-29T13:23:08.039Z] [Pipeline] echo
[2026-07-29T13:23:08.039Z] Copying logs to /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-cron/129/
[2026-07-29T13:23:08.040Z] [Pipeline] sh
[2026-07-29T13:23:08.294Z] + mkdir -p /var/www/ci.kronosnet.org/job/anvil/job/anvil-build-cron/129/
[2026-07-29T13:23:08.296Z] [Pipeline] sh