[2026-05-06T04:08:21.970Z] Started by user Fabio M. Di Nitto
[2026-05-06T04:08:22.172Z] Obtained pipelines/global/ha-functional-testing/Jenkinsfile from git https://github.com/kronosnet/ci-tools
[2026-05-06T04:08:22.181Z] Loading library ProjectLib@main:pipelines/global/
[2026-05-06T04:08:22.181Z] Attempting to resolve main from remote references...
[2026-05-06T04:08:22.181Z]  > git --version # timeout=10
[2026-05-06T04:08:22.188Z]  > git --version # 'git version 2.47.3'
[2026-05-06T04:08:22.188Z]  > git ls-remote -h -- https://github.com/kronosnet/ci-tools # timeout=10
[2026-05-06T04:08:22.288Z] Found match: refs/heads/main revision d42d4a22a70b71837e433a8647689100c9c2e4ea
[2026-05-06T04:08:22.289Z] Selected Git installation does not exist. Using Default
[2026-05-06T04:08:22.289Z] The recommended git tool is: NONE
[2026-05-06T04:08:22.289Z] No credentials specified
[2026-05-06T04:08:22.289Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-05-06T04:08:22.289Z] Wiping out workspace first.
[2026-05-06T04:08:22.313Z] Cloning the remote Git repository
[2026-05-06T04:08:22.313Z] Using shallow clone with depth 1
[2026-05-06T04:08:22.313Z] Avoid fetching tags
[2026-05-06T04:08:22.313Z] Honoring refspec on initial clone
[2026-05-06T04:08:22.313Z] Cloning repository https://github.com/kronosnet/ci-tools
[2026-05-06T04:08:22.313Z]  > git init /var/lib/jenkins/workspace/global/ha-functional-testing@libs/d56456a8a5ffe2af36aec67f7c631a8ce5f10f01613ac19d74a87c1e7c103023 # timeout=10
[2026-05-06T04:08:22.323Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools
[2026-05-06T04:08:22.323Z]  > git --version # timeout=10
[2026-05-06T04:08:22.329Z]  > git --version # 'git version 2.47.3'
[2026-05-06T04:08:22.329Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools +refs/heads/*:refs/remotes/origin/* # timeout=10
[2026-05-06T04:08:22.542Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools # timeout=10
[2026-05-06T04:08:22.548Z]  > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
[2026-05-06T04:08:22.556Z] Avoid second fetch
[2026-05-06T04:08:22.556Z] Checking out Revision d42d4a22a70b71837e433a8647689100c9c2e4ea (main)
[2026-05-06T04:08:22.556Z]  > git config core.sparsecheckout # timeout=10
[2026-05-06T04:08:22.562Z]  > git checkout -f d42d4a22a70b71837e433a8647689100c9c2e4ea # timeout=10
[2026-05-06T04:08:22.595Z] Commit message: "Merge pull request #45 from alexaring/kernel_ark_latest"
[2026-05-06T04:08:22.596Z] [Checks API] No suitable checks publisher found.
[2026-05-06T04:08:22.600Z] Loading library GlobalLib@main:./pipelines/libs/global/
[2026-05-06T04:08:22.946Z] Examining kronosnet/ci-tools
[2026-05-06T04:08:22.946Z] Attempting to resolve main as a branch
[2026-05-06T04:08:23.182Z] Resolved main as branch main at revision d42d4a22a70b71837e433a8647689100c9c2e4ea
[2026-05-06T04:08:23.186Z] Selected Git installation does not exist. Using Default
[2026-05-06T04:08:23.186Z] The recommended git tool is: NONE
[2026-05-06T04:08:23.186Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-05-06T04:08:23.189Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-05-06T04:08:23.189Z] Wiping out workspace first.
[2026-05-06T04:08:23.210Z] Cloning the remote Git repository
[2026-05-06T04:08:23.210Z] Using shallow clone with depth 1
[2026-05-06T04:08:23.210Z] Avoid fetching tags
[2026-05-06T04:08:23.210Z] Honoring refspec on initial clone
[2026-05-06T04:08:23.210Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-05-06T04:08:23.210Z]  > git init /var/lib/jenkins/workspace/global/ha-functional-testing@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-05-06T04:08:23.219Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-05-06T04:08:23.219Z]  > git --version # timeout=10
[2026-05-06T04:08:23.226Z]  > git --version # 'git version 2.47.3'
[2026-05-06T04:08:23.226Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-05-06T04:08:23.232Z]  > git fetch --no-tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-05-06T04:08:23.414Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-05-06T04:08:23.422Z]  > git config --add remote.origin.fetch +refs/heads/main:refs/remotes/origin/main # timeout=10
[2026-05-06T04:08:23.430Z] Avoid second fetch
[2026-05-06T04:08:23.430Z] Checking out Revision d42d4a22a70b71837e433a8647689100c9c2e4ea (main)
[2026-05-06T04:08:23.430Z]  > git config core.sparsecheckout # timeout=10
[2026-05-06T04:08:23.437Z]  > git checkout -f d42d4a22a70b71837e433a8647689100c9c2e4ea # timeout=10
[2026-05-06T04:08:23.467Z] Commit message: "Merge pull request #45 from alexaring/kernel_ark_latest"
[2026-05-06T04:08:23.468Z] [Checks API] No suitable checks publisher found.
[2026-05-06T04:08:23.482Z] Loading library VaporLib@main:./pipelines/libs/vapor/
[2026-05-06T04:08:23.635Z] Examining kronosnet/ci-tools
[2026-05-06T04:08:23.635Z] Attempting to resolve main as a branch
[2026-05-06T04:08:23.812Z] Resolved main as branch main at revision d42d4a22a70b71837e433a8647689100c9c2e4ea
[2026-05-06T04:08:23.815Z] Selected Git installation does not exist. Using Default
[2026-05-06T04:08:23.815Z] The recommended git tool is: NONE
[2026-05-06T04:08:23.815Z] using credential 93a393a1-7fe9-45ae-ade0-5a533c87d8d9
[2026-05-06T04:08:23.818Z] DEPRECATED: The 'Wipe out repository & force clone' extension is deprecated for Pipeline jobs. Pipeline users should use the deleteDir() step instead.
[2026-05-06T04:08:23.818Z] Wiping out workspace first.
[2026-05-06T04:08:23.836Z] Cloning the remote Git repository
[2026-05-06T04:08:23.836Z] Using shallow clone with depth 1
[2026-05-06T04:08:23.836Z] Cloning repository https://github.com/kronosnet/ci-tools.git
[2026-05-06T04:08:23.836Z]  > git init /var/lib/jenkins/workspace/global/ha-functional-testing@libs/a38125f6c167b5c61aae7e05cd041ecf55e96373eebcceb3c4473bea537ec70b # timeout=10
[2026-05-06T04:08:23.845Z] Fetching upstream changes from https://github.com/kronosnet/ci-tools.git
[2026-05-06T04:08:23.845Z]  > git --version # timeout=10
[2026-05-06T04:08:23.852Z]  > git --version # 'git version 2.47.3'
[2026-05-06T04:08:23.852Z] using GIT_ASKPASS to set credentials getCredUUID - github
[2026-05-06T04:08:23.858Z]  > git fetch --tags --force --progress --depth=1 -- https://github.com/kronosnet/ci-tools.git +refs/heads/*:refs/remotes/origin/* # timeout=10
[2026-05-06T04:08:24.096Z]  > git config remote.origin.url https://github.com/kronosnet/ci-tools.git # timeout=10
[2026-05-06T04:08:24.103Z]  > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
[2026-05-06T04:08:24.111Z] Avoid second fetch
[2026-05-06T04:08:24.111Z] Checking out Revision d42d4a22a70b71837e433a8647689100c9c2e4ea (main)
[2026-05-06T04:08:24.111Z]  > git config core.sparsecheckout # timeout=10
[2026-05-06T04:08:24.119Z]  > git checkout -f d42d4a22a70b71837e433a8647689100c9c2e4ea # timeout=10
[2026-05-06T04:08:24.156Z] Commit message: "Merge pull request #45 from alexaring/kernel_ark_latest"
[2026-05-06T04:08:24.156Z] [Checks API] No suitable checks publisher found.
[2026-05-06T04:08:24.200Z] [Pipeline] Start of Pipeline
[2026-05-06T04:08:24.302Z] [Pipeline] node
[2026-05-06T04:08:24.314Z] Running on vapor-driver-x86-64 in /srv/workspace/global/ha-functional-testing
[2026-05-06T04:08:24.314Z] [Pipeline] {
[2026-05-06T04:08:24.325Z] [Pipeline] stage
[2026-05-06T04:08:24.325Z] [Pipeline] { (Prepare test cluster)
[2026-05-06T04:08:24.336Z] [Pipeline] script
[2026-05-06T04:08:24.338Z] [Pipeline] {
[2026-05-06T04:08:24.356Z] [Pipeline] sh
[2026-05-06T04:08:24.627Z] + env
[2026-05-06T04:08:24.627Z] + sort
[2026-05-06T04:08:24.627Z]  *' --no-redirect '*)
[2026-05-06T04:08:24.627Z]  *' --redirect '*)
[2026-05-06T04:08:24.627Z]  /usr/bin/scl "$@";
[2026-05-06T04:08:24.627Z]  ;;
[2026-05-06T04:08:24.627Z]  ;;
[2026-05-06T04:08:24.627Z]  _mlredir=0
[2026-05-06T04:08:24.627Z]  _mlredir=0;
[2026-05-06T04:08:24.627Z]  _mlredir=1
[2026-05-06T04:08:24.627Z]  _mlredir=1;
[2026-05-06T04:08:24.627Z]  _mlstatus=$?;
[2026-05-06T04:08:24.627Z]  _module_raw "$@" 2>&1;
[2026-05-06T04:08:24.627Z]  _module_raw "$@";
[2026-05-06T04:08:24.627Z]  case " $@ " in 
[2026-05-06T04:08:24.627Z]  else
[2026-05-06T04:08:24.627Z]  else
[2026-05-06T04:08:24.627Z]  else
[2026-05-06T04:08:24.627Z]  esac;
[2026-05-06T04:08:24.627Z]  eval "module $@";
[2026-05-06T04:08:24.627Z]  eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@
[2026-05-06T04:08:24.627Z]  fi
[2026-05-06T04:08:24.627Z]  fi
[2026-05-06T04:08:24.627Z]  fi;
[2026-05-06T04:08:24.627Z]  fi;
[2026-05-06T04:08:24.627Z]  fi;
[2026-05-06T04:08:24.627Z]  if [ "$MODULES_REDIRECT_OUTPUT" = '0' ]; then
[2026-05-06T04:08:24.627Z]  if [ "$MODULES_REDIRECT_OUTPUT" = '1' ]; then
[2026-05-06T04:08:24.627Z]  if [ $_mlredir -eq 0 ]; then
[2026-05-06T04:08:24.627Z]  if [ -n "${MODULES_REDIRECT_OUTPUT+x}" ]; then
[2026-05-06T04:08:24.627Z]  return $_mlstatus
[2026-05-06T04:08:24.627Z] BASH_FUNC__module_raw%%=() {  eval "$(/usr/bin/tclsh '/usr/share/Modules/libexec/modulecmd.tcl' bash "$@")";
[2026-05-06T04:08:24.627Z] BASH_FUNC_ml%%=() {  module ml "$@"
[2026-05-06T04:08:24.627Z] BASH_FUNC_module%%=() {  local _mlredir=0;
[2026-05-06T04:08:24.627Z] BASH_FUNC_scl%%=() {  if [ "$1" = "load" -o "$1" = "unload" ]; then
[2026-05-06T04:08:24.627Z] BASH_FUNC_which%%=() {  ( alias;
[2026-05-06T04:08:24.627Z] BUILD_DISPLAY_NAME=#10248
[2026-05-06T04:08:24.627Z] BUILD_ID=10248
[2026-05-06T04:08:24.627Z] BUILD_NUMBER=10248
[2026-05-06T04:08:24.627Z] BUILD_TAG=jenkins-global-ha-functional-testing-10248
[2026-05-06T04:08:24.627Z] BUILD_URL=https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testing/10248/
[2026-05-06T04:08:24.627Z] CI=true
[2026-05-06T04:08:24.627Z] DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/0/bus
[2026-05-06T04:08:24.627Z] DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima:
[2026-05-06T04:08:24.627Z] DOCKER_HOST=unix:///run/podman/podman.sock
[2026-05-06T04:08:24.627Z] EXECUTOR_NUMBER=86
[2026-05-06T04:08:24.627Z] GITLAB_OBJECT_KIND=none
[2026-05-06T04:08:24.627Z] HOME=/root
[2026-05-06T04:08:24.627Z] HUDSON_COOKIE=1183ab07-fb60-4f29-ab54-49e21e6912d1
[2026-05-06T04:08:24.627Z] HUDSON_HOME=/var/lib/jenkins
[2026-05-06T04:08:24.627Z] HUDSON_SERVER_COOKIE=f72c2a7a1ea776d6
[2026-05-06T04:08:24.627Z] HUDSON_URL=https://haci.fast.eng.rdu2.dc.redhat.com/
[2026-05-06T04:08:24.627Z] JENKINS_HOME=/var/lib/jenkins
[2026-05-06T04:08:24.627Z] JENKINS_NODE_COOKIE=0e84c45e-6c4d-4a91-9ff1-5f15ab7e458a
[2026-05-06T04:08:24.627Z] JENKINS_SERVER_COOKIE=durable-57aec1a68794528c27d4a489794a5af96a00da222bbdd122b6cb56791fb1bff9
[2026-05-06T04:08:24.627Z] JENKINS_URL=https://haci.fast.eng.rdu2.dc.redhat.com/
[2026-05-06T04:08:24.627Z] JOB_BASE_NAME=ha-functional-testing
[2026-05-06T04:08:24.627Z] JOB_DISPLAY_URL=https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testing/display/redirect
[2026-05-06T04:08:24.627Z] JOB_NAME=global/ha-functional-testing
[2026-05-06T04:08:24.627Z] JOB_URL=https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testing/
[2026-05-06T04:08:24.627Z] LANG=C.UTF-8
[2026-05-06T04:08:24.627Z] LESSOPEN=||/usr/bin/lesspipe.sh %s
[2026-05-06T04:08:24.627Z] LOGNAME=root
[2026-05-06T04:08:24.627Z] MANPATH=/usr/share/man:
[2026-05-06T04:08:24.627Z] MODULEPATH=/etc/scl/modulefiles:/usr/share/Modules/modulefiles:/etc/modulefiles:/usr/share/modulefiles
[2026-05-06T04:08:24.627Z] MODULESHOME=/usr/share/Modules
[2026-05-06T04:08:24.627Z] MODULES_CMD=/usr/share/Modules/libexec/modulecmd.tcl
[2026-05-06T04:08:24.627Z] MODULES_RUN_QUARANTINE=LD_LIBRARY_PATH LD_PRELOAD
[2026-05-06T04:08:24.627Z] MOTD_SHOWN=pam
[2026-05-06T04:08:24.627Z] NODE_LABELS=vapor-driver-x86-64 x86-64 ocpv kubesan-cache osp ibmvpc yum kbuild gcp stable rhel-9 aws aliyun azure
[2026-05-06T04:08:24.627Z] NODE_NAME=vapor-driver-x86-64
[2026-05-06T04:08:24.627Z] PATH=/root/.local/bin:/root/bin:/usr/share/Modules/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
[2026-05-06T04:08:24.627Z] PWD=/srv/workspace/global/ha-functional-testing
[2026-05-06T04:08:24.627Z] RUN_ARTIFACTS_DISPLAY_URL=https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testing/10248/display/redirect?page=artifacts
[2026-05-06T04:08:24.627Z] RUN_CHANGES_DISPLAY_URL=https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testing/10248/display/redirect?page=changes
[2026-05-06T04:08:24.627Z] RUN_DISPLAY_URL=https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testing/10248/display/redirect
[2026-05-06T04:08:24.627Z] RUN_TESTS_DISPLAY_URL=https://haci.fast.eng.rdu2.dc.redhat.com/job/global/job/ha-functional-testing/10248/display/redirect?page=tests
[2026-05-06T04:08:24.627Z] SHELL=/bin/bash
[2026-05-06T04:08:24.627Z] SHLVL=2
[2026-05-06T04:08:24.627Z] SSH_CLIENT=10.130.4.3 46144 22
[2026-05-06T04:08:24.627Z] SSH_CONNECTION=10.130.4.3 46144 10.0.2.2 22
[2026-05-06T04:08:24.627Z] STAGE_NAME=Prepare test cluster
[2026-05-06T04:08:24.627Z] USER=root
[2026-05-06T04:08:24.627Z] WORKSPACE=/srv/workspace/global/ha-functional-testing
[2026-05-06T04:08:24.627Z] WORKSPACE_TMP=/srv/workspace/global/ha-functional-testing@tmp
[2026-05-06T04:08:24.627Z] XDG_DATA_DIRS=/root/.local/share/flatpak/exports/share:/var/lib/flatpak/exports/share:/usr/local/share:/usr/share
[2026-05-06T04:08:24.627Z] XDG_RUNTIME_DIR=/run/user/0
[2026-05-06T04:08:24.627Z] XDG_SESSION_CLASS=user
[2026-05-06T04:08:24.627Z] XDG_SESSION_ID=668
[2026-05-06T04:08:24.627Z] XDG_SESSION_TYPE=tty
[2026-05-06T04:08:24.627Z] _=/usr/bin/env
[2026-05-06T04:08:24.627Z] __MODULES_LMINIT=module use --append /usr/share/Modules/modulefiles:module use --append /etc/modulefiles:module use --append /usr/share/modulefiles
[2026-05-06T04:08:24.627Z] __MODULES_SHARE_MANPATH=:1
[2026-05-06T04:08:24.627Z] dryrun=1
[2026-05-06T04:08:24.627Z] echorun=no
[2026-05-06T04:08:24.627Z] fromnodes=2
[2026-05-06T04:08:24.627Z] library.GlobalLib.version=main
[2026-05-06T04:08:24.627Z] library.ProjectLib.version=main
[2026-05-06T04:08:24.627Z] library.VaporLib.version=main
[2026-05-06T04:08:24.627Z] osver=rhel9
[2026-05-06T04:08:24.627Z] provider=osp
[2026-05-06T04:08:24.627Z] taglist=auto
[2026-05-06T04:08:24.627Z] tagtimeout=600
[2026-05-06T04:08:24.627Z] testlist=auto
[2026-05-06T04:08:24.627Z] tests=smoke
[2026-05-06T04:08:24.627Z] testtimeout=180
[2026-05-06T04:08:24.627Z] testvariant=default
[2026-05-06T04:08:24.627Z] tonodes=2
[2026-05-06T04:08:24.627Z] upstream=next-stable
[2026-05-06T04:08:24.627Z] vapordebug=no
[2026-05-06T04:08:24.627Z] which_declare=declare -f
[2026-05-06T04:08:24.627Z] zstream=no
[2026-05-06T04:08:24.627Z] }
[2026-05-06T04:08:24.627Z] }
[2026-05-06T04:08:24.627Z] }
[2026-05-06T04:08:24.627Z] }
[2026-05-06T04:08:24.627Z] }
[2026-05-06T04:08:24.651Z] [Pipeline] echo
[2026-05-06T04:08:24.651Z] info map: [nonvoting_fail:0, nonvoting_fail_nodes:, voting_fail:0, voting_fail_nodes:, nonvoting_run:0, voting_run:0, exception_text:, email_extra_text:, covtgtdir:, cov_results_urls:[], repo_urls:[], new_cov_results_urls:[], EXTRAVER_LIST:[], subjobs:[], state:completed, CHECKS:, DISTROCONFOPTS:, EXTRACHECKS:, MAKEINSTALLOPTS:, MAKEOPTS:, RPMDEPS:, bootstrap:null, fullrebuild:null, project:ha-functional-testing, projectid:haft, provider:osp, fromnodes:2, tonodes:2, osver:rhel9, zstream:no, brewbuild:, upstream:next-stable, iscsi:, block:, customrepo:, tests:smoke, testvariant:default, testlist:auto, taglist:auto, testtimeout:180, tagtimeout:600, dryrun:1, nodes:0, runtest:, runtesttimeout:0, testtype:, testopt:, logsrc:, logdst:, stages_fail_nodes:, stages_fail:0, stages_run:0, vapordebug:]
[2026-05-06T04:08:24.665Z] [Pipeline] stage
[2026-05-06T04:08:24.665Z] [Pipeline] { (Prep build env)
[2026-05-06T04:08:24.670Z] [Pipeline] cleanWs
[2026-05-06T04:08:24.674Z] [WS-CLEANUP] Deleting project workspace...
[2026-05-06T04:08:24.674Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-05-06T04:08:24.676Z] [WS-CLEANUP] done
[2026-05-06T04:08:24.687Z] [Pipeline] echo
[2026-05-06T04:08:24.687Z] Deleting test cluster
[2026-05-06T04:08:24.688Z] [Pipeline] }
[2026-05-06T04:08:24.691Z] [Pipeline] // stage
[2026-05-06T04:08:24.694Z] [Pipeline] stage
[2026-05-06T04:08:24.694Z] [Pipeline] { (Create osp rhel9 test cluster)
[2026-05-06T04:08:24.709Z] [Pipeline] echo
[2026-05-06T04:08:24.710Z] Creating test cluster
[2026-05-06T04:08:24.710Z] [Pipeline] }
[2026-05-06T04:08:24.713Z] [Pipeline] // stage
[2026-05-06T04:08:24.717Z] [Pipeline] stage
[2026-05-06T04:08:24.717Z] [Pipeline] { (Deploy osp rhel9 zstream: no upstream: next-stable test cluster)
[2026-05-06T04:08:24.732Z] [Pipeline] echo
[2026-05-06T04:08:24.732Z] Deploy test cluster
[2026-05-06T04:08:24.732Z] [Pipeline] }
[2026-05-06T04:08:24.735Z] [Pipeline] // stage
[2026-05-06T04:08:24.738Z] [Pipeline] }
[2026-05-06T04:08:24.741Z] [Pipeline] // script
[2026-05-06T04:08:24.743Z] [Pipeline] }
[2026-05-06T04:08:24.746Z] [Pipeline] // stage
[2026-05-06T04:08:24.750Z] [Pipeline] stage
[2026-05-06T04:08:24.750Z] [Pipeline] { (Run tests)
[2026-05-06T04:08:24.757Z] [Pipeline] script
[2026-05-06T04:08:24.759Z] [Pipeline] {
[2026-05-06T04:08:24.801Z] [Pipeline] echo
[2026-05-06T04:08:24.801Z] {nonvoting_fail=0, nonvoting_fail_nodes=, voting_fail=0, voting_fail_nodes=, nonvoting_run=0, voting_run=0, exception_text=, email_extra_text=, covtgtdir=, cov_results_urls=[], repo_urls=[], new_cov_results_urls=[], EXTRAVER_LIST=[], subjobs=[], state=completed, CHECKS=, DISTROCONFOPTS=, EXTRACHECKS=, MAKEINSTALLOPTS=, MAKEOPTS=, RPMDEPS=, bootstrap=null, fullrebuild=null, project=ha-functional-testing, projectid=haft, provider=osp, fromnodes=2, tonodes=2, osver=rhel9, zstream=no, brewbuild=, upstream=next-stable, iscsi=, block=, customrepo=, tests=smoke, testvariant=default, testlist=auto, taglist=auto, testtimeout=180, tagtimeout=600, dryrun=1, nodes=2, runtest=deploy_cluster, runtesttimeout=180, testtype=tests, testopt=, logsrc=, logdst=, stages_fail_nodes=, stages_fail=0, stages_run=0, vapordebug=, branch=osp rhel9 zstream: no upstream: next-stable tests: smoke}
[2026-05-06T04:08:24.817Z] [Pipeline] echo
[2026-05-06T04:08:24.818Z] [cleanup, setup, pacemaker,resource,IPv4,recovery, pacemaker,recovery,RecoveryActiveNode, pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot]
[2026-05-06T04:08:24.821Z] [Pipeline] stage
[2026-05-06T04:08:24.822Z] [Pipeline] { (Run test 'cleanup' on 2 nodes)
[2026-05-06T04:08:24.864Z] [Pipeline] echo
[2026-05-06T04:08:24.864Z] runWithTimeout 182
[2026-05-06T04:08:24.865Z] [Pipeline] timeout
[2026-05-06T04:08:24.865Z] Timeout set to expire in 3 hr 2 min
[2026-05-06T04:08:24.865Z] [Pipeline] {
[2026-05-06T04:08:24.869Z] [Pipeline] sh
[2026-05-06T04:08:25.136Z] + rm -f vapor.log
[2026-05-06T04:08:25.141Z] [Pipeline] tee
[2026-05-06T04:08:25.142Z] [Pipeline] {
[2026-05-06T04:08:25.146Z] [Pipeline] echo
[2026-05-06T04:08:25.148Z] INFO: [nonvoting_fail:0, nonvoting_fail_nodes:, voting_fail:0, voting_fail_nodes:, nonvoting_run:0, voting_run:0, exception_text:, email_extra_text:, covtgtdir:, cov_results_urls:[], repo_urls:[], new_cov_results_urls:[], EXTRAVER_LIST:[], subjobs:[], state:completed, CHECKS:, DISTROCONFOPTS:, EXTRACHECKS:, MAKEINSTALLOPTS:, MAKEOPTS:, RPMDEPS:, bootstrap:null, fullrebuild:null, project:ha-functional-testing, projectid:haft, provider:osp, fromnodes:2, tonodes:2, osver:rhel9, zstream:no, brewbuild:, upstream:next-stable, iscsi:, block:, customrepo:, tests:smoke, testvariant:default, testlist:auto, taglist:auto, testtimeout:180, tagtimeout:600, dryrun:1, nodes:2, runtest:cleanup, runtesttimeout:2, testtype:tests, testopt:, logsrc:rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup, logdst:, stages_fail_nodes:, stages_fail:0, stages_run:0, vapordebug:, branch:osp rhel9 zstream: no upstream: next-stable tests: smoke]
[2026-05-06T04:08:25.149Z] [Pipeline] echo
[2026-05-06T04:08:25.149Z] SLEEP 5
[2026-05-06T04:08:25.150Z] [Pipeline] sleep
[2026-05-06T04:08:25.150Z] Sleeping for 5 sec
[2026-05-06T04:08:30.151Z] [Pipeline] }
[2026-05-06T04:08:30.155Z] [Pipeline] // tee
[2026-05-06T04:08:30.158Z] [Pipeline] }
[2026-05-06T04:08:30.161Z] [Pipeline] // timeout
[2026-05-06T04:08:30.165Z] [Pipeline] sh
[2026-05-06T04:08:30.433Z] + mkdir -p rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup
[2026-05-06T04:08:30.433Z] + mv vapor.log rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup/
[2026-05-06T04:08:30.433Z] + tar Jcvpf rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup.tar.xz rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup/
[2026-05-06T04:08:30.433Z] rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup/
[2026-05-06T04:08:30.433Z] rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup/vapor.log
[2026-05-06T04:08:30.433Z] + rm -rf rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup
[2026-05-06T04:08:30.439Z] [Pipeline] sh
[2026-05-06T04:08:30.705Z] + mv rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup.tar.xz SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup.tar.xz
[2026-05-06T04:08:30.711Z] [Pipeline] archiveArtifacts
[2026-05-06T04:08:30.713Z] Archiving artifacts
[2026-05-06T04:08:30.721Z] [Pipeline] }
[2026-05-06T04:08:30.724Z] [Pipeline] // stage
[2026-05-06T04:08:30.728Z] [Pipeline] stage
[2026-05-06T04:08:30.728Z] [Pipeline] { (Run test 'setup' on 2 nodes)
[2026-05-06T04:08:30.734Z] [Pipeline] echo
[2026-05-06T04:08:30.734Z] runWithTimeout 182
[2026-05-06T04:08:30.735Z] [Pipeline] timeout
[2026-05-06T04:08:30.735Z] Timeout set to expire in 3 hr 2 min
[2026-05-06T04:08:30.735Z] [Pipeline] {
[2026-05-06T04:08:30.739Z] [Pipeline] sh
[2026-05-06T04:08:31.006Z] + rm -f vapor.log
[2026-05-06T04:08:31.011Z] [Pipeline] tee
[2026-05-06T04:08:31.011Z] [Pipeline] {
[2026-05-06T04:08:31.015Z] [Pipeline] echo
[2026-05-06T04:08:31.017Z] INFO: [nonvoting_fail:0, nonvoting_fail_nodes:, voting_fail:0, voting_fail_nodes:, nonvoting_run:0, voting_run:0, exception_text:, email_extra_text:, covtgtdir:, cov_results_urls:[], repo_urls:[], new_cov_results_urls:[], EXTRAVER_LIST:[], subjobs:[], state:completed, CHECKS:, DISTROCONFOPTS:, EXTRACHECKS:, MAKEINSTALLOPTS:, MAKEOPTS:, RPMDEPS:, bootstrap:null, fullrebuild:null, project:ha-functional-testing, projectid:haft, provider:osp, fromnodes:2, tonodes:2, osver:rhel9, zstream:no, brewbuild:, upstream:next-stable, iscsi:, block:, customrepo:, tests:smoke, testvariant:default, testlist:auto, taglist:auto, testtimeout:180, tagtimeout:600, dryrun:1, nodes:2, runtest:setup, runtesttimeout:2, testtype:tests, testopt:, logsrc:rhel9-zstream_no-upstream_next-stable-nodes_2-setup, logdst:SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-cleanup.tar.xz, stages_fail_nodes:, stages_fail:0, stages_run:1, vapordebug:, branch:osp rhel9 zstream: no upstream: next-stable tests: smoke]
[2026-05-06T04:08:31.018Z] [Pipeline] echo
[2026-05-06T04:08:31.018Z] SLEEP 5
[2026-05-06T04:08:31.019Z] [Pipeline] sleep
[2026-05-06T04:08:31.019Z] Sleeping for 5 sec
[2026-05-06T04:08:36.020Z] [Pipeline] }
[2026-05-06T04:08:36.024Z] [Pipeline] // tee
[2026-05-06T04:08:36.027Z] [Pipeline] }
[2026-05-06T04:08:36.030Z] [Pipeline] // timeout
[2026-05-06T04:08:36.035Z] [Pipeline] sh
[2026-05-06T04:08:36.307Z] + mkdir -p rhel9-zstream_no-upstream_next-stable-nodes_2-setup
[2026-05-06T04:08:36.307Z] + mv vapor.log rhel9-zstream_no-upstream_next-stable-nodes_2-setup/
[2026-05-06T04:08:36.307Z] + tar Jcvpf rhel9-zstream_no-upstream_next-stable-nodes_2-setup.tar.xz rhel9-zstream_no-upstream_next-stable-nodes_2-setup/
[2026-05-06T04:08:36.307Z] rhel9-zstream_no-upstream_next-stable-nodes_2-setup/
[2026-05-06T04:08:36.307Z] rhel9-zstream_no-upstream_next-stable-nodes_2-setup/vapor.log
[2026-05-06T04:08:36.307Z] + rm -rf rhel9-zstream_no-upstream_next-stable-nodes_2-setup
[2026-05-06T04:08:36.313Z] [Pipeline] sh
[2026-05-06T04:08:36.580Z] + mv rhel9-zstream_no-upstream_next-stable-nodes_2-setup.tar.xz SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-setup.tar.xz
[2026-05-06T04:08:36.586Z] [Pipeline] archiveArtifacts
[2026-05-06T04:08:36.588Z] Archiving artifacts
[2026-05-06T04:08:36.592Z] [Pipeline] }
[2026-05-06T04:08:36.595Z] [Pipeline] // stage
[2026-05-06T04:08:36.599Z] [Pipeline] stage
[2026-05-06T04:08:36.599Z] [Pipeline] { (Run test 'pacemaker,resource,IPv4,recovery' on 2 nodes)
[2026-05-06T04:08:36.603Z] [Pipeline] echo
[2026-05-06T04:08:36.603Z] runWithTimeout 182
[2026-05-06T04:08:36.604Z] [Pipeline] timeout
[2026-05-06T04:08:36.604Z] Timeout set to expire in 3 hr 2 min
[2026-05-06T04:08:36.605Z] [Pipeline] {
[2026-05-06T04:08:36.608Z] [Pipeline] sh
[2026-05-06T04:08:36.875Z] + rm -f vapor.log
[2026-05-06T04:08:36.880Z] [Pipeline] tee
[2026-05-06T04:08:36.880Z] [Pipeline] {
[2026-05-06T04:08:36.884Z] [Pipeline] echo
[2026-05-06T04:08:36.886Z] INFO: [nonvoting_fail:0, nonvoting_fail_nodes:, voting_fail:0, voting_fail_nodes:, nonvoting_run:0, voting_run:0, exception_text:, email_extra_text:, covtgtdir:, cov_results_urls:[], repo_urls:[], new_cov_results_urls:[], EXTRAVER_LIST:[], subjobs:[], state:completed, CHECKS:, DISTROCONFOPTS:, EXTRACHECKS:, MAKEINSTALLOPTS:, MAKEOPTS:, RPMDEPS:, bootstrap:null, fullrebuild:null, project:ha-functional-testing, projectid:haft, provider:osp, fromnodes:2, tonodes:2, osver:rhel9, zstream:no, brewbuild:, upstream:next-stable, iscsi:, block:, customrepo:, tests:smoke, testvariant:default, testlist:auto, taglist:auto, testtimeout:180, tagtimeout:600, dryrun:1, nodes:2, runtest:pacemaker,resource,IPv4,recovery, runtesttimeout:2, testtype:tests, testopt:, logsrc:rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery, logdst:SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-setup.tar.xz, stages_fail_nodes:, stages_fail:0, stages_run:2, vapordebug:, branch:osp rhel9 zstream: no upstream: next-stable tests: smoke]
[2026-05-06T04:08:36.887Z] [Pipeline] echo
[2026-05-06T04:08:36.887Z] SLEEP 5
[2026-05-06T04:08:36.888Z] [Pipeline] sleep
[2026-05-06T04:08:36.888Z] Sleeping for 5 sec
[2026-05-06T04:08:41.889Z] [Pipeline] }
[2026-05-06T04:08:41.892Z] [Pipeline] // tee
[2026-05-06T04:08:41.895Z] [Pipeline] }
[2026-05-06T04:08:41.898Z] [Pipeline] // timeout
[2026-05-06T04:08:41.902Z] [Pipeline] sh
[2026-05-06T04:08:42.170Z] + mkdir -p rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery
[2026-05-06T04:08:42.170Z] + mv vapor.log rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery/
[2026-05-06T04:08:42.170Z] + tar Jcvpf rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery.tar.xz rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery/
[2026-05-06T04:08:42.170Z] rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery/
[2026-05-06T04:08:42.170Z] rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery/vapor.log
[2026-05-06T04:08:42.170Z] + rm -rf rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery
[2026-05-06T04:08:42.175Z] [Pipeline] sh
[2026-05-06T04:08:42.442Z] + mv rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery.tar.xz SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery.tar.xz
[2026-05-06T04:08:42.448Z] [Pipeline] archiveArtifacts
[2026-05-06T04:08:42.451Z] Archiving artifacts
[2026-05-06T04:08:42.456Z] [Pipeline] }
[2026-05-06T04:08:42.459Z] [Pipeline] // stage
[2026-05-06T04:08:42.462Z] [Pipeline] stage
[2026-05-06T04:08:42.463Z] [Pipeline] { (Run test 'pacemaker,recovery,RecoveryActiveNode' on 2 nodes)
[2026-05-06T04:08:42.467Z] [Pipeline] echo
[2026-05-06T04:08:42.467Z] runWithTimeout 182
[2026-05-06T04:08:42.468Z] [Pipeline] timeout
[2026-05-06T04:08:42.468Z] Timeout set to expire in 3 hr 2 min
[2026-05-06T04:08:42.469Z] [Pipeline] {
[2026-05-06T04:08:42.472Z] [Pipeline] sh
[2026-05-06T04:08:42.738Z] + rm -f vapor.log
[2026-05-06T04:08:42.742Z] [Pipeline] tee
[2026-05-06T04:08:42.743Z] [Pipeline] {
[2026-05-06T04:08:42.747Z] [Pipeline] echo
[2026-05-06T04:08:42.749Z] INFO: [nonvoting_fail:0, nonvoting_fail_nodes:, voting_fail:0, voting_fail_nodes:, nonvoting_run:0, voting_run:0, exception_text:, email_extra_text:, covtgtdir:, cov_results_urls:[], repo_urls:[], new_cov_results_urls:[], EXTRAVER_LIST:[], subjobs:[], state:completed, CHECKS:, DISTROCONFOPTS:, EXTRACHECKS:, MAKEINSTALLOPTS:, MAKEOPTS:, RPMDEPS:, bootstrap:null, fullrebuild:null, project:ha-functional-testing, projectid:haft, provider:osp, fromnodes:2, tonodes:2, osver:rhel9, zstream:no, brewbuild:, upstream:next-stable, iscsi:, block:, customrepo:, tests:smoke, testvariant:default, testlist:auto, taglist:auto, testtimeout:180, tagtimeout:600, dryrun:1, nodes:2, runtest:pacemaker,recovery,RecoveryActiveNode, runtesttimeout:2, testtype:tests, testopt:, logsrc:rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode, logdst:SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_resource_IPv4_recovery.tar.xz, stages_fail_nodes:, stages_fail:0, stages_run:3, vapordebug:, branch:osp rhel9 zstream: no upstream: next-stable tests: smoke]
[2026-05-06T04:08:42.750Z] [Pipeline] echo
[2026-05-06T04:08:42.750Z] SLEEP 5
[2026-05-06T04:08:42.751Z] [Pipeline] sleep
[2026-05-06T04:08:42.751Z] Sleeping for 5 sec
[2026-05-06T04:08:47.752Z] [Pipeline] }
[2026-05-06T04:08:47.755Z] [Pipeline] // tee
[2026-05-06T04:08:47.759Z] [Pipeline] }
[2026-05-06T04:08:47.761Z] [Pipeline] // timeout
[2026-05-06T04:08:47.765Z] [Pipeline] sh
[2026-05-06T04:08:48.036Z] + mkdir -p rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode
[2026-05-06T04:08:48.036Z] + mv vapor.log rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode/
[2026-05-06T04:08:48.036Z] + tar Jcvpf rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode.tar.xz rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode/
[2026-05-06T04:08:48.036Z] rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode/
[2026-05-06T04:08:48.036Z] rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode/vapor.log
[2026-05-06T04:08:48.036Z] + rm -rf rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode
[2026-05-06T04:08:48.041Z] [Pipeline] sh
[2026-05-06T04:08:48.309Z] + mv rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode.tar.xz SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode.tar.xz
[2026-05-06T04:08:48.315Z] [Pipeline] archiveArtifacts
[2026-05-06T04:08:48.317Z] Archiving artifacts
[2026-05-06T04:08:48.322Z] [Pipeline] }
[2026-05-06T04:08:48.325Z] [Pipeline] // stage
[2026-05-06T04:08:48.329Z] [Pipeline] stage
[2026-05-06T04:08:48.329Z] [Pipeline] { (Run test 'pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot' on 2 nodes)
[2026-05-06T04:08:48.335Z] [Pipeline] echo
[2026-05-06T04:08:48.335Z] runWithTimeout 182
[2026-05-06T04:08:48.336Z] [Pipeline] timeout
[2026-05-06T04:08:48.337Z] Timeout set to expire in 3 hr 2 min
[2026-05-06T04:08:48.337Z] [Pipeline] {
[2026-05-06T04:08:48.341Z] [Pipeline] sh
[2026-05-06T04:08:48.609Z] + rm -f vapor.log
[2026-05-06T04:08:48.613Z] [Pipeline] tee
[2026-05-06T04:08:48.614Z] [Pipeline] {
[2026-05-06T04:08:48.618Z] [Pipeline] echo
[2026-05-06T04:08:48.620Z] INFO: [nonvoting_fail:0, nonvoting_fail_nodes:, voting_fail:0, voting_fail_nodes:, nonvoting_run:0, voting_run:0, exception_text:, email_extra_text:, covtgtdir:, cov_results_urls:[], repo_urls:[], new_cov_results_urls:[], EXTRAVER_LIST:[], subjobs:[], state:completed, CHECKS:, DISTROCONFOPTS:, EXTRACHECKS:, MAKEINSTALLOPTS:, MAKEOPTS:, RPMDEPS:, bootstrap:null, fullrebuild:null, project:ha-functional-testing, projectid:haft, provider:osp, fromnodes:2, tonodes:2, osver:rhel9, zstream:no, brewbuild:, upstream:next-stable, iscsi:, block:, customrepo:, tests:smoke, testvariant:default, testlist:auto, taglist:auto, testtimeout:180, tagtimeout:600, dryrun:1, nodes:2, runtest:pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot, runtesttimeout:2, testtype:tests, testopt:, logsrc:rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot, logdst:SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode.tar.xz, stages_fail_nodes:, stages_fail:0, stages_run:4, vapordebug:, branch:osp rhel9 zstream: no upstream: next-stable tests: smoke]
[2026-05-06T04:08:48.621Z] [Pipeline] echo
[2026-05-06T04:08:48.621Z] SLEEP 5
[2026-05-06T04:08:48.622Z] [Pipeline] sleep
[2026-05-06T04:08:48.623Z] Sleeping for 5 sec
[2026-05-06T04:08:53.623Z] [Pipeline] }
[2026-05-06T04:08:53.627Z] [Pipeline] // tee
[2026-05-06T04:08:53.630Z] [Pipeline] }
[2026-05-06T04:08:53.633Z] [Pipeline] // timeout
[2026-05-06T04:08:53.637Z] [Pipeline] sh
[2026-05-06T04:08:53.904Z] + mkdir -p rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot
[2026-05-06T04:08:53.904Z] + mv vapor.log rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot/
[2026-05-06T04:08:53.904Z] + tar Jcvpf rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot.tar.xz rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot/
[2026-05-06T04:08:53.904Z] rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot/
[2026-05-06T04:08:53.904Z] rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot/vapor.log
[2026-05-06T04:08:53.904Z] + rm -rf rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot
[2026-05-06T04:08:53.910Z] [Pipeline] sh
[2026-05-06T04:08:54.177Z] + mv rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot.tar.xz SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot.tar.xz
[2026-05-06T04:08:54.182Z] [Pipeline] archiveArtifacts
[2026-05-06T04:08:54.184Z] Archiving artifacts
[2026-05-06T04:08:54.190Z] [Pipeline] }
[2026-05-06T04:08:54.193Z] [Pipeline] // stage
[2026-05-06T04:08:54.199Z] [Pipeline] echo
[2026-05-06T04:08:54.199Z] {nonvoting_fail=0, nonvoting_fail_nodes=, voting_fail=0, voting_fail_nodes=, nonvoting_run=0, voting_run=0, exception_text=, email_extra_text=, covtgtdir=, cov_results_urls=[], repo_urls=[], new_cov_results_urls=[], EXTRAVER_LIST=[], subjobs=[], state=completed, CHECKS=, DISTROCONFOPTS=, EXTRACHECKS=, MAKEINSTALLOPTS=, MAKEOPTS=, RPMDEPS=, bootstrap=null, fullrebuild=null, project=ha-functional-testing, projectid=haft, provider=osp, fromnodes=2, tonodes=2, osver=rhel9, zstream=no, brewbuild=, upstream=next-stable, iscsi=, block=, customrepo=, tests=smoke, testvariant=default, testlist=auto, taglist=auto, testtimeout=180, tagtimeout=600, dryrun=1, nodes=2, runtest=pacemaker,recovery,RecoveryActiveNode,sbd-only,kill_reboot, runtesttimeout=600, testtype=tags, testopt=, logsrc=rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot, logdst=SUCCESS_rhel9-zstream_no-upstream_next-stable-nodes_2-pacemaker_recovery_RecoveryActiveNode_sbd-only_kill_reboot.tar.xz, stages_fail_nodes=, stages_fail=0, stages_run=5, vapordebug=, branch=osp rhel9 zstream: no upstream: next-stable tests: smoke}
[2026-05-06T04:08:54.204Z] [Pipeline] echo
[2026-05-06T04:08:54.204Z] []
[2026-05-06T04:08:54.213Z] [Pipeline] }
[2026-05-06T04:08:54.216Z] [Pipeline] // script
[2026-05-06T04:08:54.219Z] [Pipeline] }
[2026-05-06T04:08:54.222Z] [Pipeline] // stage
[2026-05-06T04:08:54.228Z] [Pipeline] stage
[2026-05-06T04:08:54.228Z] [Pipeline] { (Declarative: Post Actions)
[2026-05-06T04:08:54.244Z] [Pipeline] echo
[2026-05-06T04:08:54.245Z] Deleting test cluster
[2026-05-06T04:08:54.246Z] [Pipeline] cleanWs
[2026-05-06T04:08:54.251Z] [WS-CLEANUP] Deleting project workspace...
[2026-05-06T04:08:54.251Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration...
[2026-05-06T04:08:54.254Z] [WS-CLEANUP] done
[2026-05-06T04:08:54.256Z] [Pipeline] node
[2026-05-06T04:08:54.347Z] Running on Jenkins in /var/lib/jenkins/workspace/global/ha-functional-testing
[2026-05-06T04:08:54.348Z] [Pipeline] {
[2026-05-06T04:08:54.352Z] [Pipeline] script
[2026-05-06T04:08:54.354Z] [Pipeline] {
[2026-05-06T04:08:54.373Z] [Pipeline] stage
[2026-05-06T04:08:54.374Z] [Pipeline] { (Copying logs)
[2026-05-06T04:08:54.407Z] [Pipeline] node
[2026-05-06T04:08:54.508Z] Running on Jenkins in /var/lib/jenkins/workspace/global/ha-functional-testing@2
[2026-05-06T04:08:54.508Z] [Pipeline] {
[2026-05-06T04:08:54.561Z] [Pipeline] node
[2026-05-06T04:08:54.657Z] Running on Jenkins in /var/lib/jenkins/workspace/global/ha-functional-testing@3
[2026-05-06T04:08:54.658Z] [Pipeline] {
[2026-05-06T04:08:54.663Z] [Pipeline] sh
[2026-05-06T04:08:54.918Z] + mkdir -p /var/lib/jenkins/locks
[2026-05-06T04:08:54.926Z] [Pipeline] echo
[2026-05-06T04:08:54.926Z] RWLock: FD for lock log_archive in stage projectFinishUp is 433
[2026-05-06T04:08:54.930Z] [Pipeline] sleep
[2026-05-06T04:08:54.931Z] No need to sleep any longer
[2026-05-06T04:08:54.934Z] [Pipeline] echo
[2026-05-06T04:08:54.934Z] RWLock: log_archive in stage projectFinishUp locked for WRITE
[2026-05-06T04:08:54.938Z] [Pipeline] }
[2026-05-06T04:08:54.941Z] [Pipeline] // node
[2026-05-06T04:08:54.945Z] [Pipeline] echo
[2026-05-06T04:08:54.945Z] Copying logs to /var/www/ci.kronosnet.org/job/global/job/ha-functional-testing/10248/
[2026-05-06T04:08:54.946Z] [Pipeline] sh
[2026-05-06T04:08:55.201Z] + mkdir -p /var/www/ci.kronosnet.org/job/global/job/ha-functional-testing/10248/
[2026-05-06T04:08:55.203Z] [Pipeline] sh